Lead Data Engineer (eDV)
Core
Build and operate secure batch/real-time data platforms for government clients, ingesting data from diverse sources, transforming it, and ensuring availability for downstream consumers.
Role type
Lead Data Engineer (Security Cleared)
Builds
Ultra-secure, high-performance cloud-based data infrastructure
Domain
Enterprise Data Platforms / Government Sector
Deliverable
production ML models | infrastructure
Required skills
Data pipeline development, Data modelling, Public Cloud services (AWS), Relational and NoSQL database configuration, Python programming, Test Driven Development
Preferred skills
CI tools (Jenkins/Drone), Configuration tools (Ansible/Packer), Infrastructure as Code (Terraform), Linux and Windows administration
Technologies
AWS (EC2, RDS, Lambda, Athena, Glue), Python, Jenkins, Drone, Ansible, Packer, Terraform
Responsibilities
Code, test, and document data pipelines; Conduct logical and physical database design; Expand data platform capabilities; Perform root cause analysis on data and processes
Seniority
Lead, hands-on IC