Data Engineer
Core
Design and maintain robust ETL/ELT pipelines, build reusable frameworks on Databricks, and implement secure cloud architectures on AWS to ingest and process structured, semi-structured, and unstructured data for analytics.
Role type
Senior Data Engineer (Cloud & Databricks)
Builds
Scalable batch and real-time streaming data pipelines, Databricks frameworks, and AWS cloud infrastructure for data platforms.
Domain
Healthcare / Cloud Data Engineering
Required skills
SQL, PySpark, Databricks (Notebooks, DLT, DABs), AWS (S3, Lambda, Glue, Redshift, Athena), Python, CloudFormation, Data Modeling (SCD), Data Quality
Preferred skills
Dimensional modeling, Infrastructure as Code, CI/CD workflows
Technologies
Databricks, AWS, Python, PySpark, Delta Lake, Redshift, Athena, Glue, Lambda, CloudFormation
Responsibilities
Design and maintain ETL/ELT pipelines for cloud lakehouses and data warehouses; Build reusable frameworks using Databricks Notebooks and Delta Live Tables; Configure and tune Databricks clusters for performance; Automate infrastructure deployment using CloudFormation and GitHub Workflows; Optimize data layout and query execution across storage systems; Establish automated data validation and quality testing.
Seniority
Mid-Senior, hands-on IC