Data Engineer (Databricks)
Core
Senior Databricks SME enabling secure, scalable data exchange and building data pipelines/warehouses for federal emergency management decision-makers.
Role type
Senior IC data engineer (Databricks/Cloud)
Builds
Data pipelines, data lakes, feature stores, and data warehouse structures for analytics and ML workflows.
Domain
Federal government / Emergency management / Cloud data platforms
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks, Delta Lake, Delta Sharing, Apache Spark, ETL pipeline development, Azure Synapse/Data Factory, Python, SQL, CI/CD, Terraform
Preferred skills
MLOps, data visualization (Tableau/Power BI), Scala, emergency management domain knowledge
Technologies
Databricks, Azure, Spark, SQL, Python, Tableau, Git, Jenkins, CodeBuild, Terraform
Responsibilities
Design and develop data pipelines and ETL routines; conduct data profiling, transformation, and quality assurance; build and optimize data lakes and warehouses; prepare data for data science and MLOps workflows; monitor data flow across BI and ML pipelines; engage with stakeholders to define data needs; provide mentorship to junior resources.
Seniority
Senior, hands-on IC with mentorship
