Lead Expert D&T Data Engineer Research, Innovation & Labs
Core
Design and maintain robust data pipelines for data ingestion, transformation, and storage to support health, nutrition, and beauty research projects.
Role type
Senior IC data engineer (research & innovation)
Builds
Data pipelines and integrated data solutions for scientific research
Domain
Health, nutrition, and beauty industry; scientific research (cheminformatics/bioinformatics)
Deliverable
production ML models | product features
Required skills
dbt, SQL, Python, Spark, Cypher, Git, Databricks, ETL processes, data quality testing, data governance, FAIR data principles
Preferred skills
Cloud engineering (AWS, Azure), infra-as-code, CICD pipelines, graph databases (Neo4j), scientific software integration, cheminformatics/bioinformatics datasets
Technologies
dbt, SQL, Python, Spark, Cypher, Git, Databricks, Neo4j, AWS, Azure
Responsibilities
Design and implement efficient pipeline architectures for data ingestion, transformation, and storage; Develop modular, efficient code for data transformation and integration; Perform data ingestion from source systems and conduct regular pipeline maintenance; Implement data quality testing and validation to maintain data integrity; Provide technical recommendations and evaluate project feasibility; Collaborate with data scientists, modelers, and subject matter experts
Seniority
Senior, hands-on IC
