Senior Data Engineer
Core
Design, build, and maintain scalable data pipelines, integrations, and analytical platforms supporting global analytics and reporting.
Role type
Senior IC data engineer (cloud data platform)
Builds
Enterprise data warehouse solutions, ETL/ELT pipelines, and data lakehouse architectures
Domain
Transportation / Cloud Data Engineering
Deliverable
production ML models
Required skills
Azure Data Factory, Azure Databricks (PySpark, Spark SQL), Python, SQL (Azure Synapse, Azure SQL), Data Modeling (Star/Snowflake, Medallion), CI/CD, Git, Data Governance
Preferred skills
Apache Airflow, Event Hub, Kafka, Spark Streaming, Machine Learning (scikit-learn, XGBoost, PyTorch, TensorFlow, MLOps), Power BI, API integration
Technologies
Azure Data Factory, Azure Databricks, Azure Synapse, Azure SQL, Azure Data Lake Storage, Azure Key Vault, Azure Logic Apps, Azure Functions, PySpark, Delta Lake, Git, CI/CD pipelines
Responsibilities
Design and optimize data pipelines using Azure Data Factory and Databricks; Develop robust ETL/ELT processes for large volumes of operational and telemetry data; Implement scalable workflows leveraging Azure services; Build efficient advanced SQL queries and stored procedures; Collaborate with analysts and operations teams to enable reliable datasets; Design and maintain data models and metadata following COE architecture patterns
Seniority
Senior, hands-on IC