Data Engineer
Core
Design, develop, and support scalable data pipelines and integration solutions for analytics, reporting, and AI use cases using large and complex datasets.
Role type
Senior Data Engineer
Builds
Production ETL/ELT pipelines, data models, and data-integration solutions
Domain
Life Sciences / Biotechnology / Data Engineering
Deliverable
production ML models
Required skills
Databricks, Apache Spark, PySpark, Spark SQL, Python, SQL, ETL/ELT, workflow orchestration, data modeling, cloud platforms, Git, CI/CD, data quality, data governance
Preferred skills
Delta Lake, Unity Catalog, AWS data services, API development, vector databases, data visualization, ML/AI data pipelines, Generative AI solutions, AI-assisted development tools
Technologies
Databricks, Apache Spark, Python, SQL, AWS, Git, Tableau, Power BI
Responsibilities
Design and maintain scalable data pipelines; Build ETL/ELT processes; Integrate data from enterprise applications and APIs; Develop reusable Python and SQL components; Implement data-quality checks and governance; Optimize Spark workloads and SQL queries; Support workflow orchestration and monitoring; Contribute to CI/CD pipelines; Troubleshoot pipeline failures; Collaborate with data architects and data scientists.
Seniority
Senior, hands-on IC