Principal Data Engineer
Core
Provide technical leadership and hands-on engineering to build scalable data solutions bridging data engineering, data science, and software engineering.
Role type
Principal Software Engineer (Data Engineering focus)
Builds
Scalable, high-performance data processing solutions and ML workflows on Azure and Databricks
Domain
Cloud-native data platforms (Azure, Databricks)
Deliverable
production ML models
Required skills
Python, Scala, Java, Apache Spark, Delta Lake, Azure Data Lake, Azure Synapse, Azure Functions, Apache Airflow, Docker, Kubernetes, Terraform, Bicep, microservices, event-driven systems, CI/CD, DevOps
Preferred skills
Data Mesh, Lakehouse architecture, event-driven pipelines, line management, mentoring, hiring
Technologies
Azure, Databricks, Apache Spark, Delta Lake, Apache Airflow, Docker, Kubernetes, Terraform, Bicep
Responsibilities
Design scalable data processing solutions; lead high-quality coding and code reviews; provide line management and mentor engineers; collaborate with data scientists and product owners; champion data governance and security; implement data architecture patterns like Data Mesh or Lakehouse.
Seniority
Principal, hands-on IC with line management