Principal Data Engineer (m/w/d)
Core
Designing and building Big Data, Analytics, and AI platforms; operationalizing Data Science models for production; leading engineering projects and consulting clients on technology stacks.
Role type
Principal Data Engineer (Consulting/Client-facing)
Builds
Scalable data platforms, data pipelines, and production-ready AI/ML models
Domain
Data Engineering, Big Data, Cloud Infrastructure, AI/ML Operations
Deliverable
production ML models | product features | infrastructure
Required skills
Python, Scala, SQL, Spark, Kafka, distributed storage systems, OpenTable formats, cloud components (AWS/Azure/GCP), IaC (Terraform, AWS CDK), CI/CD
Preferred skills
UNIX systems, network configuration, Databricks, Snowflake, AWS SageMaker, Azure Synapse
Technologies
Spark, Kafka, Terraform, AWS CDK, Databricks, Snowflake, AWS SageMaker, Azure Synapse, AWS, Azure, GCP
Responsibilities
Conceive and build Big Data/Analytics/AI platforms with DevOps workflows; develop and scale data pipelines with data quality measures; operationalize statistical and AI models; consult clients on technology stacks; lead engineering projects and manage a development team; build internal Data Engineering expertise through training and community participation
Seniority
Principal, hands-on IC with leadership responsibilities