Software Engineer III
Core
Design, build, and optimize scalable ETL/ELT data pipelines and platforms for reliable, secure data processing across enterprise environments.
Role type
Senior IC data engineer (Azure/Big Data)
Builds
Data pipelines, data models, and analytics platforms for US Healthcare, Insurance, and Government domains
Domain
Insurance, Healthcare, Government
Deliverable
production ML models | product features
Required skills
SQL, ETL/ELT patterns, Azure Databricks, Spark SQL, PySpark, Azure Data Factory, Azure Data Lake Storage, HPCC (ECL), Delta Lake, Parquet, Agile methodologies, SDLC, data modeling, performance optimization
Preferred skills
Insurance terminology knowledge
Technologies
Azure Databricks, Spark SQL, PySpark, Azure Data Factory, Azure SQL, Synapse, HPCC, ECL, Delta Lake, Parquet, Power BI, Essbase, Talend
Responsibilities
Design and develop scalable ETL/ELT pipelines; Ingest data from relational databases, APIs, and file systems; Implement data transformations on HPCC and Azure; Develop and optimize notebooks and jobs in Azure Databricks; Write efficient Spark jobs for large-scale processing; Design and implement data models using ECL and columnar formats; Optimize ECL, SQL, and Spark workloads; Collaborate with business analysts and data scientists to understand requirements.
Seniority
Senior, hands-on IC