Senior Data Engineer
Core
Design and implement scalable cloud data architectures, build robust ETL/ELT pipelines, and architect Data & AI solutions for a government housing board.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Cloud-native Data Lakehouse solutions, ETL/ELT pipelines, and Data & AI platform architectures
Domain
Public Sector / Housing / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Python, Apache Spark, Apache Kafka, Airflow, Terraform, Cloud Infrastructure as Code, Distributed Systems, Data Governance
Preferred skills
AWS Services, MLOps, LLMOps, Serverless Computing, Edge Computing, IoT Architectures, Data Visualization
Technologies
AWS, Terraform, Apache Spark, Apache Kafka, Airflow, Amazon SageMaker, Amazon Quick Suite, AWS S3, AWS Glue, AWS Lake Formation, AWS Bedrock, AWS Agent Core
Responsibilities
Design scalable data architectures on cloud platforms; Build and maintain robust ETL/ELT pipelines; Lead development of Data Lakehouse solutions; Implement automated data quality checks and monitoring; Drive integration of Data & AI capabilities into platform architectures; Mentor junior data engineers
Seniority
Senior, hands-on IC with technical leadership
