Data Scientist_W2
Core
Design and optimize enterprise data pipelines, lakehouse solutions, and data warehouse workloads for sensitive agency data.
Role type
Senior Data Engineer (Data Science adjacent)
Builds
Enterprise data pipelines, lakehouse solutions, and data warehouse workloads
Domain
Data Engineering / Cloud Data Platforms
Deliverable
production ML models
Required skills
Azure Databricks, PySpark, Spark SQL, Delta Lake, medallion lakehouse architecture, batch and streaming pipelines, incremental ingestion, Azure Synapse Analytics, SQL, dimensional modeling, data warehouse optimization, Azure Data Factory, Databricks Workflows, Unity Catalog, ADLS Gen2, Microsoft Entra ID, Key Vault, data governance, security controls, Git, CI/CD, Azure DevOps, GitHub, monitoring, troubleshooting
Preferred skills
Databricks Certified Data Engineer Associate or Professional certification, Microsoft Azure Data Engineer certification (DP-203), Power BI connectivity and performance optimization, HIPAA and agency security policy compliance
Technologies
Azure, Databricks, PySpark, Spark SQL, Delta Lake, Azure Synapse Analytics, Azure Data Factory, Unity Catalog, ADLS Gen2, Microsoft Entra ID, Key Vault, Git, Azure DevOps, GitHub, Power BI
Responsibilities
Develop and optimize enterprise data pipelines, lakehouse solutions, and data warehouse workloads. Support data integration, governance, security, and analytics for sensitive agency data.
Seniority
Mid-Senior, hands-on IC