Senior Data Engineer - 12 Months FTC
Core
Design, build, and optimise scalable data solutions on an AWS data platform to support real-time processing and high-quality analytics for a national lottery operator.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, ETL processes, and data warehousing solutions on AWS.
Domain
Lottery and gaming industry; Cloud data engineering.
Deliverable
production ML models | product features | dashboards & analysis
Required skills
AWS data services (Redshift, S3, Glue, Lambda), Python, SQL, Airflow, Spark, data modelling, data warehousing, performance optimisation, CI/CD, Agile delivery.
Preferred skills
Experience in regulated environments, lottery/gaming/financial services domain knowledge.
Technologies
AWS, Redshift, Python, Airflow, Spark, GitHub, S3, Glue, Lambda.
Responsibilities
Build and maintain scalable data pipelines and ETL processes; Develop batch and near real-time data solutions; Optimise data performance, reliability and cost efficiency; Implement monitoring, alerting and operational support processes; Champion engineering best practice, code quality, automation and documentation; Collaborate with Architecture, Analytics and Platform teams; Support data governance, security and compliance requirements; Mentor colleagues and contribute to continuous improvement initiatives.
Seniority
Senior, hands-on IC
