Senior Data Engineer (Streaming + AI Systems)
Core
Design and evolve real-time data systems and scalable architecture supporting operational intelligence and predictive modelling for an industrial/infrastructure operator.
Role type
Senior individual contributor data engineer (streaming + AI systems)
Builds
Real-time and batch data pipelines, scalable lakehouse architecture, production ML pipelines, and infrastructure
Domain
Industrial/Infrastructure, Data Engineering, Applied AI/Statistics
Deliverable
production ML models | product features | infrastructure
Required skills
Real-time data streaming, Distributed data processing, System design, ML pipeline productionization, Statistical modelling, Infrastructure as Code (IaC)
Preferred skills
None stated
Technologies
AWS (Glue, Lambda, ECS, S3), Apache Spark, Kafka, Terraform, Delta Lake
Responsibilities
Architect and operate real-time and batch data pipelines, Lead the evolution of a scalable lakehouse architecture, Design and productionize end-to-end ML pipelines, Apply statistical methods to high-impact business problems, Own infrastructure design using IaC, Drive performance, reliability, and observability across data systems
Seniority
Senior, hands-on IC