Senior Data Engineer
Core
Design, build, and operate scalable data pipelines and data products supporting analytics, reporting, and AI initiatives.
Role type
Senior IC data engineer (cloud platforms & governance)
Builds
Batch and streaming data pipelines, medallion data architectures, and AI-enabled automation workflows
Domain
Cloud data engineering, data governance, and AI automation
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Python, PySpark, CI/CD, infrastructure-as-code, data governance concepts, cloud platform experience
Preferred skills
Microsoft Purview, AI agents/LLM automation, policy-as-code, Microsoft Fabric/Databricks
Technologies
Azure, Microsoft Fabric, AWS, Databricks, Terraform, Bicep, SQL, Python, PySpark
Responsibilities
Design and operate batch/streaming pipelines; implement medallion architectures; partner on data governance standards; develop AI-enabled automation for metadata and quality checks; maintain CI/CD pipelines with IaC.
Seniority
Senior, hands-on IC
