Data Engineer
Core
Design, build, and maintain data pipelines and architectures to support advanced engineering and production projects in the defense sector.
Role type
Data Engineer
Builds
Data pipelines, databases, data lakes, and data storage solutions
Domain
Defense / Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Spark, Docker, CI/CD, Jenkins, Jupyter, Superset, Dagster, Git, DevOps, Unit testing
Preferred skills
Kubeflow, Data warehousing, C/C++, MATLAB testing
Technologies
Jenkins, Jupyter, Superset, Dagster, Kubeflow, Git, Bitbucket, MATLAB
Responsibilities
Design and maintain data pipelines and architectures; Set up and optimize databases, data lakes, and storage; Develop pipelines for ML and analytics; Manage CI/CD pipelines; Ensure testing and validation of data workflows; Collaborate with developers and data scientists.
Seniority
Mid-level, hands-on IC