Data Lake Engineer
Core
Design, implement, and maintain scalable Data Lake architectures to support structured and unstructured data ingestion, integration with knowledge graph platforms, and mission-driven analytics for DoD customers.
Role type
Senior Data Lake Engineer (DoD/Defense)
Builds
Scalable federated data ecosystems, ETL pipelines, and data governance frameworks for real-time information sharing.
Domain
Defense & Government / Data Engineering & Cloud Architecture
Deliverable
production ML models | infrastructure
Required skills
Data Lake architecture design, ETL/ELT pipeline development, Databricks administration, Cloud security (IAM/RBAC), Python, SQL/NoSQL, Apache Spark, Terraform, CI/CD, Git
Preferred skills
Knowledge graph integration (Stardog/SPARQL), Unity Catalog, Delta Lake optimization, SysEngOps, DevSecOps
Technologies
Databricks, AWS, Azure, GCP, Terraform, Python, SQL, Apache Spark, Stardog, Git
Responsibilities
Design and maintain scalable Data Lake architectures; Configure integration interfaces with knowledge graph platforms; Optimize ETL pipelines for high-volume data transformation; Implement storage tiering and access controls; Submit performance and compliance reports.
Seniority
Senior, hands-on IC