Data Engineer
Core
Build and operate production-grade batch ELT pipelines and a scalable data lakehouse to enable advanced analytics for healthcare organizations.
Role type
Senior Data Engineer (Batch ELT & Lakehouse)
Builds
Production data pipelines, curated data products, and a medallion-pattern lakehouse for healthcare market research.
Domain
Healthcare market research / Life sciences
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, data modeling (dimensional/lakehouse), Databricks, Spark, batch ELT, orchestration (Airflow), transformation (dbt), data quality automation, CI/CD
Preferred skills
Delta Lake optimization, CDC ingestion, streaming pipelines, observability, cost/performance tuning, multi-tenant data governance
Technologies
Databricks, Spark, Airflow, dbt, Delta Lake, Kafka, Auto Loader
Responsibilities
Build and own batch ELT pipelines with frequent cadence; design and operate a lakehouse using medallion patterns; create reusable data products; implement automated testing and monitoring; partner with stakeholders on data models; ensure data governance and security compliance.
Seniority
Senior, hands-on IC