Principal Data Engineer (m/w/d)
Core
Designing and building Big Data, Analytics, and AI platforms; operationalizing statistical and AI models for production use; leading engineering projects and advising clients on technology stacks.
Role type
Principal Data Engineer (Consulting/Leadership)
Builds
Big Data/Analytics/AI platforms, scalable data pipelines, and operationalized ML models
Domain
Data Engineering, Cloud Infrastructure, AI/ML Operations
Deliverable
production ML models
Required skills
Python, Scala, SQL, Spark, Kafka, distributed storage systems, OpenTable formats, cluster computing, AWS/Azure/GCP, Terraform, CI/CD
Preferred skills
UNIX systems, network configuration
Technologies
Databricks, Snowflake, AWS Sagemaker, Azure Synapse, GIT
Responsibilities
Conceive and build Big Data/Analytics/AI platforms with DevOps workflows; develop and scale data pipelines on cloud architectures; operationalize data science models; advise clients on technology stacks; lead engineering projects and teams; build internal Data Engineering expertise through training and community participation