Data Engineer
Core
Design, build, maintain, and optimize large-scale data pipelines and ETL/ELT processes to generate actionable insights for business decisions.
Role type
Senior Data Engineer (Big Data)
Builds
Scalable data pipelines, data models, and integration solutions for structured and unstructured data.
Domain
Biotechnology / Big Data Engineering
Deliverable
production ML models
Required skills
PySpark, SQL, Databricks, ETL/ELT, Data Modeling, Cloud Platforms (AWS), Workflow Orchestration, Performance Tuning
Preferred skills
Python, Apache Airflow, Machine Learning, Data Governance, GDPR/CCPA compliance
Technologies
Databricks, PySpark, SQL, AWS, Apache Airflow, SageMaker
Responsibilities
Design and develop data pipelines using Databricks and PySpark; Implement ETL/ELT processes to migrate and deploy data; Optimize Spark job performance through tuning and partitioning; Build integrations with SQL databases, APIs, and cloud storage; Manage data quality and documentation; Collaborate with Data Architects and Data Scientists on end-to-end solutions.
Seniority
Senior, hands-on IC