Senior Data Engineer
Core
Design and implement scalable cloud data architectures, build robust ETL/ELT pipelines, and architect Data & AI solutions for a government housing board.
Role type
Senior Data Engineer (Cloud & Data Architecture)
Builds
Cloud-native Data Lakehouse solutions, ETL/ELT pipelines, and Data & AI platform architectures
Domain
Public Sector (Housing) + Cloud Data Engineering
Deliverable
production ML models
Required skills
SQL, Python, Apache Spark, Apache Kafka, Airflow, Terraform, Cloud Infrastructure as Code, Distributed Systems, Data Governance
Preferred skills
AWS Services, MLOps, LLMOps, Serverless Computing, Edge Computing, IoT Architectures, Data Visualization
Technologies
AWS (S3, Glue, Lake Formation, SageMaker, Bedrock), Apache Spark, Apache Kafka, Airflow, Terraform
Responsibilities
Design scalable data architectures on cloud platforms; Lead development of Data Lakehouse solutions; Build and maintain robust ETL/ELT pipelines; Implement automated data quality checks; Design cloud-native Data & AI solutions; Lead cloud migration strategies; Mentor junior data engineers.
Seniority
Senior, hands-on IC with technical leadership