(Senior) Data Engineer (d/f/m) – Data Platform for AI-based Autonomy
Core
Building and maintaining the data platform and ETL/ELT pipelines that supply data to AI-based autonomy applications for defense and dual-use systems.
Role type
Senior Data Engineer (Data Platform & AI Infrastructure)
Builds
Data Products, robust ETL/ELT pipelines, and a governed Data Lakehouse architecture for ML and analytics teams.
Domain
Aerospace & Defense, Artificial Intelligence, Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Data modeling & Lakehouse architecture (Delta Lake, Iceberg), ETL/ELT pipeline development, SQL, Python, Data Governance & Cataloging, Mentoring & Technical Leadership
Preferred skills
Master's or PhD in Computer Science/Data Engineering, Experience with Apache Airflow, Spark, Trino, OpenMetadata, Superset
Technologies
Apache Airflow, Spark, Trino, Delta Lake, Iceberg, Hive Metastore, Polaris, OpenMetadata, Superset
Responsibilities
Design and maintain data structures in a Lakehouse architecture; Build and operate robust ETL/ELT pipelines; Manage Data Metastore, Lineage, Quality, and Contracts; Administer table access and provide dashboards; Monitor pipelines and handle alerts; Mentor engineers and establish technical standards.
Seniority
Senior, hands-on IC with architectural leadership