Principal Data Engineer (m/w/d)
Core
Designing and building Big Data/Analytics/AI platforms, developing scalable data pipelines, and operationalizing statistical and AI models for production use.
Role type
Principal Data Engineer (Consulting/Client-facing)
Builds
Data platforms, data pipelines, and operationalized AI/ML models
Domain
Data Engineering, Big Data, Cloud Infrastructure, AI/ML Operations
Deliverable
production ML models
Required skills
Python, Scala, SQL, Spark, Kafka, distributed storage systems, OpenTable formats, cluster computing, AWS/Azure/GCP, Terraform, CI/CD
Preferred skills
UNIX systems, network configuration
Technologies
Databricks, Snowflake, AWS Sagemaker, Azure Synapse, GIT
Responsibilities
Conceive and build Big Data/Analytics/AI platforms with DevOps workflows; Design and scale data pipelines on various cloud architectures; Operationalize statistical and AI models; Advise clients on technology stacks; Lead engineering projects and client communication; Build internal Data Engineering expertise through training and community participation.