Lead Expert Data Engineer- Procurement
Core
Design, maintain, and optimize robust data pipelines for data ingestion, transformation, and storage to support scientific datasets and business initiatives.
Role type
Lead Expert Data Engineer
Builds
Scalable data pipelines and integration solutions for health, nutrition, and beauty sectors
Domain
Life Sciences / Data Engineering
Deliverable
production ML models
Required skills
dbt, SQL, Python, PySpark, Git, Azure DevOps, Databricks, Cloud Engineering (AWS/Azure), CI/CD pipelines, Infrastructure-as-Code, ETL processes, Data Quality Testing, Data Governance (via careerplan.io/jobs/562949978300002-lead-expert-data-engineer-procurement-at-dsm)
Preferred skills
Cheminformatics/Bioinformatics experience, FAIR data principles, Scientific data standards
Responsibilities
Design and implement efficient pipeline architectures; Develop modular code for data transformation and integration; Perform data ingestion from source systems; Conduct regular pipeline maintenance and troubleshooting; Implement automated data quality testing and validation; Collaborate with data modelers, scientists, and SMEs for seamless integration.
Seniority
Senior, hands-on IC with leadership responsibilities
