Lead Data Engineer DHS
Core
Design, build, and maintain resilient, scalable data pipelines and production-grade ETL/ELT solutions on cloud platforms.
Role type
Lead Data Engineer
Builds
Data pipelines, data warehouses, data lakes, and operational data stores
Domain
Cloud data engineering and big data
Required skills
SQL, Python, Airflow, dbt, Databricks, Spark, Kafka, AWS (Glue, S3, Redshift, EMR), Terraform, NoSQL, data modeling, CI/CD, Git
Preferred skills
Azure, BigQuery, Scala, data quality frameworks, star schema, schema-on-read
Technologies
Airflow, AWS, AWS Glue, Redshift, Azure, BigQuery, CI/CD, Databricks, DevOps, Git, Kafka, NoSQL, Python, Scala, Spark, Terraform, dbt
Responsibilities
Develop and manage data processes to ensure information availability; build and automate data pipelines and platforms; write clean, efficient, well-documented code; monitor data quality using automated testing frameworks; collaborate with Architects, Product Owners, Data Scientists, and DevOps; research data acquisition sources; integrate data management solutions into client environments; identify and reduce data risks; build and maintain data repositories.
Seniority
Senior, hands-on IC with leadership responsibilities
