Data Engineer
Core
Build and evolve CitySwift's core data processing engine to ingest, clean, and join high-velocity transport data, powering automated pipelines and geospatial mapping tools for public transport networks.
Role type
Senior Data Engineer (Transport Data)
Builds
Automated data pipelines, data validation algorithms, and geospatial mapping tools for public transport optimization.
Domain
Public Transport / Data Engineering
Deliverable
production ML models
Required skills
Data pipeline design, ETL/ELT, Data modeling, Cloud platforms (AWS/Azure/GCP), Advanced SQL, Python or Java, Distributed tools (Spark/Airflow/dbt/Kafka)
Preferred skills
Geospatial data processing, Real-time data handling, NoSQL databases
Technologies
AWS, Azure, GCP, Snowflake, BigQuery, Redshift, MySQL, MongoDB, Spark, Airflow, dbt, Kafka
Responsibilities
Design scalable data pipelines for multi-source transport datasets; Develop automated data cleaning and validation logic; Optimize pipelines for geospatial mapping and real-time/batch enrichment; Support pipeline management, monitoring, and error handling; Collaborate with data scientists to translate algorithms into engine code; Troubleshoot complex data processing issues.
Seniority
Mid-Senior, hands-on IC
