Senior Software Engineer (Data Platform)
Core
Build and operate the Data Intelligence Platform to automate decision-making across the company, including metrics stores, ETL frameworks, and data pipelines.
Role type
Senior Software Engineer (Data Platform)
Builds
Data Intelligence Platform, metrics store, ETL frameworks, data pipelines, and infrastructure tooling for Databricks.
Domain
Data infrastructure, cloud computing, big data processing
Deliverable
production ML models | product features | infrastructure
Required skills
ETL framework design, metrics store architecture, multi-geo data pipeline management, workflow orchestration (Airflow, DBT), large-scale messaging systems (Kafka, RabbitMQ), infrastructure-as-code, CI/CD, data quality testing, API design for telemetry/logs
Preferred skills
Technical leadership on large-scale projects, cross-functional collaboration, consensus building, conference speaking
Technologies
Databricks, Airflow, DBT, Kafka, RabbitMQ, OSS tools
Responsibilities
Design and run the Databricks metrics store; develop tooling for managing Databricks at scale across clouds; design the base ETL framework; establish conventions for telemetry and audit logs; provide leadership on long-term product vision; represent Databricks at academic and industrial events
Seniority
Senior, hands-on IC with technical leadership
