Senior Data Engineer
Core
Design, develop, and maintain data pipelines and data products for a defense industry client to collect, process, and make data available efficiently and securely.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, data products, and modern data architectures
Domain
Defense industry, Cloud data platforms
Deliverable
production ML models
Required skills
Python, PySpark, Microsoft Fabric, ETL, Data Modeling, CI/CD, Apache Airflow, Cloud platforms (Azure/AWS/GCP), Delta Tables, Apache Iceberg, S3 storage, Data Quality automation, Machine Learning/AI Engineering
Preferred skills
Medallion Architecture, Lakehouse, RAG pipelines
Responsibilities
Design, develop, and maintain data pipelines and data products; Work on data modeling, ETL processes, and modern data architectures; Develop and optimize solutions for data storage and processing; Ensure data quality through automated testing; Contribute to automation of data flows via CI/CD; Collaborate with developers and data scientists; Contribute to ML and AI solution development.
Seniority
Senior, hands-on IC