Senior Data & Integration Engineer – Incident Management Platform
Core
Design and deliver a centralized Incident Management Platform (Vantage) by integrating alerting tools, Jira, and AI agents into a Databricks lakehouse to create auditable data products.
Role type
Senior Data & Integration Engineer
Builds
Centralized Incident Management Platform (Vantage)
Domain
SaaS / Incident Management / Data Engineering
Deliverable
production ML models
Required skills
Databricks, Delta Lake, PySpark, SQL, AWS S3, REST APIs, Webhooks, Python (FastAPI/Flask), LLM integration, Human-in-the-loop workflows, Git, CI/CD, Automated testing
Preferred skills
Jira Cloud/JSM APIs, Databricks Unity Catalog, SRE metrics (MTTR/MTTD), Observability tools (CloudWatch/Datadog)
Technologies
Databricks, Delta Lake, PySpark, AWS S3, FastAPI, Flask, Jira, LLMs
Responsibilities
Design and maintain production-grade API and webhook integrations; Implement Jira AI-agent integrations with tool calling and audit logging; Build robust incremental data pipelines into Databricks; Design curated datasets for SRE metrics; Own testing suites, failure recovery, and operational runbooks.
Seniority
Senior, hands-on IC