Senior Data Engineer
Core
Design, build, and maintain scalable data pipelines within a Databricks E2 environment on AWS for federal civilian, defense, and intelligence community customers.
Role type
Senior Data Engineer (Data Platform)
Builds
Production-grade data pipelines, medallion architecture datasets (Bronze/Silver/Gold), and analytics-ready data
Domain
Federal government contracting, Cloud Data Engineering
Deliverable
production ML models
Required skills
Databricks, Apache Spark, Python, AWS (DMS, RDS, S3), SQL, Delta Lake, GitLab/CI/CD, Medallion Architecture
Preferred skills
R, Terraform/CloudFormation, Kafka/Kinesis, Data Quality Frameworks, FISMA/FedRAMP compliance
Technologies
Databricks, AWS, Apache Spark, Delta Lake, GitLab, Python, R, SQL, Kafka, Kinesis, Terraform
Responsibilities
Design and implement efficient, scalable data pipelines; Build and maintain Databricks solutions using medallion architecture; Write advanced SQL for aggregations and anomaly analysis; Implement real-time data ingestion using AWS DMS; Manage source code, versioning, and deployments using GitLab and CI/CD; Ensure data engineering practices align with FISMA High and multi-tenant security standards.
Seniority
Senior, hands-on IC
