Data Engineer
Core
Build governed data platforms on AWS and/or Databricks to support analytics, machine learning, and generative AI.
Role type
Senior Data Engineer / Data Engineering Lead / Senior Data Engineering Lead
Builds
Batch and streaming pipelines, ETL/ELT frameworks, data platforms on warehouse and lakehouse
Domain
Financial services / Cloud data engineering
Deliverable
production ML models
Required skills
SQL, Python, Spark, AWS (Glue, Redshift, Athena, MSK, MWAA, Lake Formation), Databricks (Unity Catalog, Delta Lake), IaC, CI/CD
Preferred skills
Kafka, Flink, Airflow, dbt, RAG retrieval layers, AWS/Databricks/dbt/Snowflake certifications
Technologies
AWS, Databricks, SQL, Python, Spark, Glue, Redshift, Athena, MSK, MWAA, Lake Formation, Unity Catalog, Delta Lake, Iceberg, Kafka, Flink, Airflow, dbt
Responsibilities
Build and optimise batch and streaming pipelines; Deliver data platforms on AWS and/or Databricks; Model data for real query patterns; Build data quality, lineage, access control and FinOps; Lead a workstream and grow a team (Lead level and above)
Seniority
Senior (3-6 years), Lead (6-10 years), Senior Lead (10-15 years)