Data Engineer
Core
Designing, building, and optimizing robust, automated ETL/ELT pipelines for structured, semi-structured, and streaming data extraction, transformation, and integration from edge-to-cloud sources in the manufacturing domain.
Role type
Senior Data Engineer (Manufacturing)
Builds
Scalable Lakehouse architecture (Bronze, Silver, Gold layers) on managed Unity Catalog using Databricks.
Domain
Manufacturing / Industrial IoT / Data Engineering
Deliverable
production ML models
Required skills
Python, Java, Git, CI/CD, Azure (Databricks, ADLS Gen2, Virtual Networks, Unity Catalog), Apache Spark (PySpark/Scala), SQL, Manufacturing Execution Systems (MES/Nexeed), Machine logs
Preferred skills
Azure Data Engineer Associate or Databricks Certified Data Engineer, Infrastructure as Code (Terraform), Confluent Kafka, Flink, German language
Technologies
Databricks, Unity Catalog, Azure, PySpark, Scala, SQL, Terraform, Kafka, Flink, Nexeed
Responsibilities
Create, operate, and optimize ETL/ELT pipelines; Design and implement scalable Lakehouse architecture; Ingest and harmonize complex data from physical manufacturing tools and machine logs; Develop automated data validation and quality control mechanisms; Collaborate with manufacturing experts and data scientists to support advanced analytics and AI/ML model deployment.
Seniority
Senior, hands-on IC
