Senior Big Data Engineer (FastAPI expert)
Core
Design, develop, and support data engineering solutions for processing and analyzing patient-level healthcare data, including mapping drug and diagnosis data to standard coding frames.
Role type
Senior Big Data Engineer (Healthcare Data)
Builds
Data pipelines for loading and processing millions of electronic medical records into Databricks
Domain
Healthcare / Big Data Engineering
Deliverable
production ML models | product features
Required skills
SQL, Python, Scala, Databricks, Apache Spark, ETL design, CI/CD automation, database design, algorithms & design patterns
Preferred skills
FastAPI, healthcare/pharmaceutical data experience, AI-powered productivity tools
Technologies
Databricks, Azure Cloud Services, Apache Spark, Delta, Parquet, Jenkins, GitLab
Responsibilities
Oversee and guide junior/mid-level engineers; build pipelines for processing big medical data; participate in analysis, system design, development, deployment, and maintenance; conduct peer code reviews; create automated unit and integration tests
Seniority
Senior, hands-on IC with mentoring responsibilities
