CareerPlanSign in

Senior Data Engineer - Databricks

London, UK💼 Full-time💰 $80,000–$80,000🗓 2026-06-08 → 2026-08-06

Core

Designing, building, and operating production-grade end-to-end data pipelines and a modern Databricks lakehouse platform for real-time insights and advanced analytics.

Role type

Senior Data Engineer (Databricks)

Builds

End-to-end data pipelines, Databricks lakehouse architecture, and CI/CD infrastructure

Domain

Entertainment sector, Cloud Data Engineering

Deliverable

production ML models | product features | dashboards & analysis

Required skills

Databricks (jobs, notebooks, workflows, Delta Lake), Python, SQL, CI/CD pipeline design, Lakehouse architecture (Medallion pattern), Data modeling (star/snowflake, SCD), Streaming/event-driven architectures, Performance tuning, Cost optimization, Data quality/observability

Preferred skills

dbt, Snowflake, ML workloads, Data mesh

Technologies

Databricks, Delta Lake, Python, SQL, CI/CD tools

Responsibilities

Design and operate end-to-end data pipelines; Own and evolve Databricks architecture for batch/streaming workloads; Implement and mature CI/CD pipelines; Develop reusable data frameworks; Drive engineering best practices for performance, security, and cost; Lead technical design decisions; Mentor engineers

Seniority

Senior, hands-on IC with architectural influence

Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.