Lead Expert Data & AI Engineer - Manufacturing
Core
Design, maintain, and optimize robust data pipelines for data ingestion, transformation, and storage within the Manufacturing/Sustainability domain.
Role type
Lead Expert Data & AI Engineer
Builds
Scalable data pipelines and data integration solutions
Domain
Manufacturing / Sustainability
Deliverable
production ML models | product features
Required skills
dbt, SQL, Python, PySpark, Git, Azure DevOps, Databricks, cloud engineering (AWS/Azure), CI/CD pipeline deployment, data quality testing, infrastructure-as-code
Preferred skills
scientific datasets handling (cheminformatics/bioinformatics), FAIR data principles, data governance, team management, stakeholder engagement
Technologies
dbt, SQL, Python, Spark, Git, Azure DevOps, Databricks, AWS, Azure
Responsibilities
Design and implement efficient pipeline architectures for data ingestion, transformation, and storage; Develop modular code for data transformation and integration; Perform data ingestion from source systems including ETL processes; Conduct regular pipeline maintenance, troubleshooting, and upgrades; Implement data quality testing and validation; Collaborate with data modelers, scientists, and SMEs to ensure seamless data integration.
Seniority
Senior, hands-on IC with leadership responsibilities