Senior Data Engineering Developer
Core
Designing, developing, and maintaining scalable data pipelines and data models for large-scale clinical and genomic research datasets using cloud platforms.
Role type
Senior Data Engineer (Cloud/Big Data)
Builds
Cloud-based data pipelines and data warehouse schemas for clinical research
Domain
Healthcare / Genomics / Cloud Data Engineering
Deliverable
production ML models
Required skills
PySpark, SQL, Apache Spark, Databricks, AWS, Data Modeling, ETL Modernization, Data Quality, Performance Optimization
Preferred skills
On-premises SQL Server migration, Legacy ETL modernization
Technologies
Databricks, AWS, PySpark, SQL, Apache Spark, Microsoft SQL Server
Responsibilities
Design and maintain PySpark and SQL data pipelines for clinical data transformation; Develop and optimize data models and data warehouse schemas within Databricks; Modernize legacy on-premises ETL processes to cloud environments; Monitor and troubleshoot Spark and SQL workloads for performance and reliability; Implement data quality checks and validation processes; Provide technical support and documentation for team stakeholders.
Seniority
Senior, hands-on IC