Senior Data Engineer - Data & ML Engineering
Core
Designing, building, and maintaining ETL pipelines and data products to support reporting, analysis, and AI/ML initiatives within a life sciences R&D environment.
Role type
Senior Data Engineer (Cloud & Data Platform)
Builds
Real-time data ingestion pipelines, data lakehouses, and analytic-ready data solutions on AWS.
Domain
Life Sciences Research and Development / Cloud Data Engineering
Deliverable
production ML models | data infrastructure
Required skills
Python, PySpark, SQL, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, AWS Athena, AWS Lake Formation, Databricks, CloudFormation, boto3, PyTorch, Scala, MySQL, PostgreSQL, Presto
Preferred skills
Tableau, Cloudera Data Platform, experience in Agile/Product-based environments
Technologies
AWS (Glue, Lambda, S3, Redshift, Athena, Lake Formation), Databricks, CloudFormation, GitHub Actions, boto3
Responsibilities
Design and maintain optimal data pipeline architecture; develop and maintain data models for reporting; optimize data storage and retrieval for performance; ensure data quality through validation and testing; collaborate with data scientists and analysts to support their data needs; implement security protocols for sensitive data; mentor team members.
Seniority
Senior, hands-on IC with mentorship responsibilities