Data Engineer II
Core
Build and maintain AWS-based ETL/ELT pipelines, curated analytical datasets, and reporting workflows to support operational decision-making for the F-35 AI/ML Spares Project.
Role type
Mid-level IC data engineer
Builds
Scalable data infrastructure powering business intelligence, machine learning, and operational analytics for aerospace supply chain management
Domain
Aerospace defense / Federal government / Cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python (PySpark, pandas), SQL (CTEs, window functions), AWS (Glue, Redshift, S3), Apache Airflow, dbt, Azure Databricks (Spark), Azure Data Factory, REST/SOAP APIs, Kafka, Docker, Kubernetes, Git, CI/CD
Preferred skills
AWS Professional/Specialty Certification, DoD/VA mission support, ML/NLP/AI algorithms, streaming data technologies, infrastructure-as-code (Terraform, Pulumi), data catalog tools (DataHub, Alation)
Technologies
AWS Glue, Amazon Redshift, Amazon S3, Apache Airflow, dbt, Prefect, Azure Databricks, Spark, Azure Data Factory, Snowflake, BigQuery, Kafka, Docker, Kubernetes, Tableau, Power BI, Elasticsearch, R, Alteryx
Responsibilities
Design, develop, and maintain robust ETL/ELT pipelines; build and optimize data models in cloud data warehouses; integrate data from diverse sources including APIs and event streams; monitor pipeline health and enforce data quality controls; partner with data scientists to deliver clean datasets; mentor Marines at the squadron level to improve data entry and indexing practices; design and disseminate innovative reports
Seniority
Mid-level, hands-on IC
