Senior Data Engineer - AWS & Databricks (Public Sector)
Core
Design, build, and operate dependable data pipelines and reusable data products on AWS and Databricks to support analytics, reporting, and machine learning.
Role type
Senior hands-on IC data engineer
Builds
Production-grade data pipelines, lakehouse architectures, and curated data products
Domain
Cloud data engineering (AWS, Databricks)
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Apache Spark, Delta Lake, AWS services (S3, Glue, IAM, KMS, Lambda, Step Functions, EventBridge, CloudWatch, Redshift), data modeling, incremental ingestion, change data capture, data quality validation, schema enforcement, metadata and lineage, workflow orchestration, infrastructure as code (Terraform), cloud security
Preferred skills
Unity Catalog, Lakeflow, Delta Live Tables, Apache Airflow, dbt, Kafka, AWS DMS, data mesh, MLOps, public-sector security compliance, Databricks or AWS certifications
