AWS Databricks Engineer
Core
Design, build, and optimize scalable data pipelines and processing workflows using Databricks, Apache Spark, and AWS services for federal agencies.
Role type
Senior IC data engineering engineer (cloud/lakehouse)
Builds
Production data solutions, ETL/ELT pipelines, and modern lakehouse architectures on AWS
Domain
Federal government / Cloud data engineering
Deliverable
production ML models
Required skills
Databricks, Apache Spark, PySpark, AWS (S3, Glue, Redshift, Lambda, IAM), Delta Lake, SQL, Python, Infrastructure as Code (Terraform, CDK), CI/CD, Data modeling, Data governance
Preferred skills
Active Secret clearance, CompTIA Security+, Databricks certifications, Unity Catalog, Delta Live Tables, AWS CDK, FedRAMP knowledge
Technologies
AWS Lambda, Redshift, CloudWatch, Databricks, Git, GitHub, Jenkins, Terraform, Unity Catalog, PySpark, SQL, Spark, pandas
Responsibilities
Design and implement medallion-layer lakehouse solutions; Build and maintain ETL/ELT pipelines across AWS services; Optimize Spark workloads and storage configurations; Implement data quality, cataloging, and access-control practices; Automate deployments using IaC and CI/CD; Collaborate with stakeholders to deliver production-ready data solutions.
Seniority
Senior, hands-on IC
