Data Engineer, Digital Transformation & Data (DT&D)
Core
Designing and developing data pipelines, managing data integration, and optimizing data processing workflows for business applications and AI solutions.
Role type
Senior Data Engineer (Azure/Databricks)
Builds
Data pipelines, data models, and AI/ML deployment infrastructure
Domain
Aviation technology, cloud data engineering
Deliverable
production ML models | infrastructure
Required skills
Python (PySpark), SQL, data pipeline design, data modeling, CI/CD, Azure cloud services, Databricks, NoSQL/SQL databases, performance tuning
Preferred skills
Java, Scala, legacy Oracle databases, Unity Catalog, Microsoft Purview, Power BI, feature engineering
Technologies
Azure, Databricks, PySpark, SQL, Java, Scala, Oracle, Unity Catalog, Microsoft Purview, Power BI, Azure DevOps
Responsibilities
Design and develop new data pipelines; implement data quality checks and validations; optimize data processing workflows for performance and scalability; manage logical and physical data models; support deployment and maintenance of AI solutions; guide business users on report and dashboard creation.
Seniority
Senior, hands-on IC
