[LTA-TRO] SENIOR/ EXECUTIVE/ DATA ENGINEER - TRANSPORT AI PROGRAMME
Core
Design, build, and maintain scalable data infrastructure and pipelines to enable AI models and applications to access high-quality, timely, and trustworthy data for Singapore's land transport network.
Role type
Senior Data Engineer (Transport AI)
Builds
Data pipelines, data models, data catalogues, feature stores, and shared data platforms for AI workloads.
Domain
Public sector / Government / Transport / AI Infrastructure
Deliverable
production ML models
Required skills
Python, SQL, Apache Spark, Apache Kafka, dbt, Airflow, Cloud data platforms (AWS Glue, Azure Data Factory, Google Dataflow, Databricks), Data warehousing, Lakehouse architectures, Real-time/streaming data processing, Feature stores, Data governance, Data quality tooling, Metadata management
Preferred skills
Experience in regulated/government/critical infrastructure environments, Data governance frameworks, Data quality tooling, Metadata management practices
Technologies
Python, SQL, Apache Spark, Apache Kafka, dbt, Airflow, AWS Glue, Azure Data Factory, Google Dataflow, Databricks
Responsibilities
Design and maintain scalable data pipelines for structured and unstructured data; Develop and manage data models, catalogues, and feature stores; Ensure data quality, consistency, and lineage; Implement data governance practices including access controls and anonymisation; Design performant and cost-efficient data infrastructure; Collaborate with AI developers to translate data requirements into production-grade products; Support integration of external data sources; Monitor and maintain production pipelines.
Seniority
Senior, hands-on IC