[Job-32197] Tech Lead Data - Databricks
Core
Senior Data Tech Lead driving technical leadership for data engineering initiatives on Databricks in Azure, building scalable pipelines within the Medallion architecture.
Role type
Senior hands-on IC Data Tech Lead
Builds
Scalable, reliable data pipelines (Bronze/Silver/Gold layers) on Databricks/Azure
Domain
Data Engineering / Cloud Data Platform (Azure/Databricks)
Deliverable
production ML models
Required skills
Databricks (PySpark, Spark SQL), Delta Lake, Medallion architecture, Azure (ADLS, Active Directory), SQL, Python, DataOps (Git, CI/CD, testing), Technical leadership
Preferred skills
Unity Catalog, Databricks Workflows/Repos, Delta Live Tables, Data quality frameworks (Great Expectations/Soda, dbt), Orchestration (Airflow), CDC/streaming (Event Hubs/Kafka), Consulting experience
Technologies
Databricks, Azure, PySpark, Spark SQL, Delta Lake, Git, Airflow, Event Hubs, Kafka
Responsibilities
Provide technical leadership to Data Engineering squads; Co-define technical vision and standards with Data Architect; Design and oversee pipelines across Bronze/Silver/Gold layers; Implement DataOps practices (version control, CI/CD, testing); Optimize jobs/pipelines for performance and cost; Ensure security and governance compliance; Collaborate with stakeholders to translate requirements; Mentor engineers and create references.
Seniority
Senior, hands-on IC