Data Engineer
Core
Building governed data products and pipelines using Databricks and AWS for a healthcare consulting firm.
Role type
Senior Data Engineer (Databricks/AWS)
Builds
Reusable, governed data products and ETL pipelines
Domain
Healthcare/Pharma, Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Databricks (Workflows, Notebooks, Jobs, Delta Lake), Python, PySpark, Apache Spark performance tuning, AWS stack, Data modeling
Preferred skills
Unity Catalog, CI/CD for data (Git, DBX), Pharma/lifesciences domain experience
Technologies
Databricks, AWS, Python, PySpark, Apache Spark, Delta Lake, Unity Catalog, Git
Responsibilities
Translate analytics logic into reusable data products, optimize Spark queries and handle performance tuning, collaborate with analysts and architects
Seniority
Mid-Senior, hands-on IC
Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.