Data Engineer - Remote
Core
Building scalable data pipelines and ensuring data quality on a modern data platform.
Role type
Data Engineer
Builds
Scalable data pipelines and metadata-driven ingestion frameworks
Domain
Healthcare data infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
PySpark, Databricks, SQL, ETL/ELT pipeline development, Delta Lake concepts, cloud platforms (Azure), Git, data governance tools, Fivetran, data quality validation
Preferred skills
Metadata-driven framework experience, schema evolution handling, incremental load patterns
Technologies
PySpark, Databricks, Delta Lake, Azure, Fivetran, DataHub
Responsibilities
Develop and maintain data pipelines, implement data quality checks, support ingestion from file-based sources, handle schema changes and incremental loads, contribute to data governance practices, troubleshoot pipeline failures, collaborate on data onboarding requirements
Seniority
Mid-level, hands-on IC