Senior Data Engineer
Core
Designing and owning scalable, production-grade data pipelines and medallion architecture across ingestion, transformation, and serving layers.
Role type
Senior Data Engineer (Databricks)
Builds
Scalable data pipelines, canonical data models, and data products for consumption via APIs or analytics tools.
Domain
Big Data / Data Engineering / Cloud Data Platforms
Deliverable
production ML models | product features | infrastructure
Required skills
Databricks (Spark, Delta Lake, Delta Live Tables, Autoloader, Unity Catalog), Python, SQL, medallion architecture, data warehousing, cloud platforms (AWS/Azure/GCP), data governance, API development, ETL/ELT pipeline design
Preferred skills
Kafka, dimensional modeling, SCD, performance tuning, mentoring
Technologies
Databricks, Spark, Delta Lake, Delta Live Tables, Autoloader, Unity Catalog, Kafka, Python, SQL, AWS, Azure, Google Cloud
Responsibilities
Design and own scalable, production-grade data pipelines across the medallion architecture; Define and enforce canonical data models aligned to business domains; Architect pipelines for scalability, reliability, and cost efficiency; Build and optimize data workflows using Databricks; Establish robust data quality, validation, and testing frameworks; Partner with data scientists, analysts, and business stakeholders to translate requirements into high-quality data products; Develop and maintain data integrations and APIs; Implement data governance, security, and compliance best practices; Mentor and support engineers by setting best practices and providing technical guidance.
Seniority
Senior, hands-on IC with mentorship responsibilities
