Senior Data Specialist
Core
Design, build, and optimize cloud-native data solutions on Azure Databricks to support analytics, AI/ML, and business decision-making in a highly regulated healthcare environment.
Role type
Senior IC data engineer (Azure Databricks)
Builds
Enterprise-scale data pipelines, modern lakehouse architectures, and production-ready data products
Domain
Healthcare / Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
Azure Databricks, PySpark, advanced SQL, Azure Data Factory, Azure Data Lake Storage, Delta Lake, Delta Live Tables, Change Data Capture, Medallion Architecture, ETL/ELT, CI/CD, data governance
Preferred skills
Snowflake, Kafka, streaming architectures, AI/ML enablement, Azure certifications, Databricks certifications
Technologies
Azure Databricks, PySpark, Azure Data Factory, Azure Data Lake Storage Gen2, Delta Lake, Delta Live Tables, Kafka, Snowflake
Responsibilities
Design and optimize large-scale data pipelines using PySpark and SQL; Develop batch and near real-time data ingestion frameworks; Build and support modern Lakehouse solutions leveraging Medallion Architecture; Implement automated testing and reconciliation processes for data quality; Collaborate with stakeholders to translate business requirements into scalable technical solutions; Mentor junior engineers and drive engineering best practices
Seniority
Senior, hands-on IC