Lead Data Engineer (DBT, Databricks, Azure)
Core
Lead the RTS delivery squad to own end-to-end delivery of strategic data products and low-latency, API-driven data solutions on a modern cloud data platform.
Role type
Lead Data Engineer (IC with team leadership)
Builds
Scalable backend services, REST APIs, curated data layers, and low-latency data serving solutions
Domain
Cloud Data Engineering (Azure Databricks, DBT)
Deliverable
production ML models | product features | infrastructure
Required skills
Python (OOP), Azure Databricks, DBT, SQL, Terraform, REST API design, CI/CD, Data Modeling, Team Leadership, Infrastructure as Code
Preferred skills
Snowflake integration, Azure AI Search, Kafka/Event Hubs, Data Governance, Cloud Migration (AWS-to-Azure), ML platform collaboration
Technologies
Azure Databricks, DBT, Terraform, Python, SQL, PyTest, Git, Kafka, Event Hubs, Delta Live Tables
Responsibilities
Lead RTS delivery squad and own end-to-end delivery of strategic data products; Design and oversee architecture of low-latency, API-driven data solutions; Build and maintain scalable backend services and REST APIs using Python; Design, develop, and optimize data pipelines using Azure Databricks, DBT, and SQL; Own architecture and implementation of curated data layers; Lead infrastructure deployment and management using Terraform; Mentor and develop a team of data and machine learning engineers; Conduct code reviews and establish engineering standards; Collaborate with stakeholders to define technical solutions; Ensure data quality, observability, and SLA compliance; Drive CI/CD adoption and oversee release management; Act as primary technical escalation point for production issues.
Seniority
Senior, hands-on IC with team leadership