Senior Data Engineer - Databricks
Core
Designing, building, and operating production-grade end-to-end data pipelines and a modern Databricks lakehouse platform for real-time insights and advanced analytics.
Role type
Senior Data Engineer (Databricks)
Builds
End-to-end data pipelines, Databricks lakehouse architecture, and CI/CD infrastructure
Domain
Entertainment sector, Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks (jobs, notebooks, workflows, Delta Lake), Python, SQL, CI/CD pipeline design, Lakehouse architecture (Medallion pattern), Data modeling (star/snowflake, SCD), Streaming/event-driven architectures, Performance tuning, Cost optimization, Data quality/observability
Preferred skills
dbt, Snowflake, ML workloads, Data mesh
Technologies
Databricks, Delta Lake, Python, SQL, CI/CD tools
Responsibilities
Design and operate end-to-end data pipelines; Own and evolve Databricks architecture for batch/streaming workloads; Implement and mature CI/CD pipelines; Develop reusable data frameworks; Drive engineering best practices for performance, security, and cost; Lead technical design decisions; Mentor engineers
Seniority
Senior, hands-on IC with architectural influence