Data Engineer Team Lead
Core
Lead a team of data engineers to design, develop, and maintain scalable data pipelines and the data lifeblood for the US Department of Defense.
Role type
Senior Data Engineer Team Lead
Builds
Resilient, scalable, and cost-efficient data pipelines and data solutions for the DoD
Domain
Defense / National Security / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Spark, PySpark, Cloud data platforms (AWS/Azure), Databricks, Palantir, Snowflake, Team leadership, Technical strategy, Infrastructure-as-Code (IaC), Automated monitoring, Agile best practices
Preferred skills
Databricks Delta Live Tables, Terraform, CI/CD pipelines, Data orchestration (Airflow), Data quality frameworks (Great Expectations), Streaming data (Kafka), Containerization (Docker, Kubernetes), ETL/ELT tools
Technologies
Databricks, AWS, Azure, Palantir, Snowflake, Terraform, Airflow, Kafka, Docker, Kubernetes
Responsibilities
Lead, mentor, and manage a team of data engineers; Drive technical strategy for the data pipeline ecosystem; Enforce reusable pipeline templates and IaC standards; Oversee development of new pipelines using modular patterns; Direct optimization of existing pipelines via automated monitoring; Facilitate code reviews and documentation; Collaborate on technical improvements like GPU utilization
Seniority
Senior, hands-on IC with leadership responsibilities