Senior Data Engineer
Core
Design, build, and optimize scalable, secure, production-grade data pipelines and ETL processes using Azure and Databricks for client engagements.
Role type
Senior Data Engineer (Databricks Focused)
Builds
Scalable data pipelines, ETL processes, and data integration solutions on Azure and Databricks
Domain
Cloud data engineering, Microsoft Azure ecosystem, Databricks
Deliverable
production ML models | product features | infrastructure
Required skills
Data pipeline design, ETL development, Azure Data Lake, Azure Synapse, Azure DevOps, Apache Spark, Delta Lake, data modeling, distributed systems
Preferred skills
Client engagement leadership, mentoring junior engineers, translating business requirements to technical architectures
Technologies
Databricks, Apache Spark, Azure Data Lake, Azure Synapse, Azure DevOps, Delta Lake
Responsibilities
Design and optimize data pipelines using Databricks and Spark; Develop scalable ETL processes for structured and unstructured data; Implement data integration solutions across cloud and on-premises sources; Automate data ingestion, transformation, and validation workflows; Monitor and troubleshoot data pipeline performance; Serve as primary technical lead for client engagements; Mentor junior team members
Seniority
Senior, hands-on IC with client leadership