CareerPlanSign in

Data Engineer

Kensington, West London💼 Full-time🗓 2026-05-15 → 2026-09-08

Core

Designing and maintaining cloud-native data architectures and pipelines to support a decentralized Data Mesh organization, enabling analytics and AI-ready data products for internal and external consumption.

Role type

Senior IC Data Engineer (AWS Cloud & Data Mesh)

Builds

Scalable data pipelines, data products, and processing environments on AWS PaaS.

Domain

Cloud Data Engineering, Data Mesh, AWS Infrastructure

Deliverable

production ML models | product features | infrastructure

Required skills

AWS services (Glue, EMR, S3, MWAA, Redshift, Sagemaker), Python, PySpark, SQL, Medallion architecture, Data Mesh concepts, Relational databases (Postgres, Oracle, SQL Server), IaC (CloudFormation), CI/CD (GitLab), Git versioning, Data modeling, Legacy-to-modern migration

Preferred skills

Terraform, Spatial Data Processing, Machine Learning/AI workflows, Jira

Technologies

AWS (Glue, EMR, S3, MWAA, Step Functions, Redshift, Sagemaker Unified Studio, Aurora, Snowflake), Python, PySpark, SQL, CloudFormation, GitLab, Terraform

Responsibilities

Design and implement data processing environments and integrations using AWS PaaS; Build data processing and analytics pipelines as code; Design and apply security and access control architectures; Collaborate across departments to develop and maintain data products; Enable business units by delivering complete and manageable solutions.

Seniority

Mid-Senior, hands-on IC

Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.