Senior Data Developer
Core
Design, build, and operate production ETL/ELT pipelines on AWS to migrate and cleanse data from legacy systems into a trusted data lake for a broker and distributor master-data platform.
Role type
Senior IC data developer (ETL/ELT)
Builds
Production ETL/ELT pipelines, data lake layers, and trusted data feeds for downstream reporting and legacy systems.
Domain
Insurance technology / Data engineering
Required skills
SQL, Python, Java, AWS ecosystem, CI/CD, Git, data modeling, data quality controls, observability
Preferred skills
PySpark, Informatica, Talend, Control-M, Databricks, Snowflake, Change Data Capture (CDC), Master Data Management concepts
Technologies
AWS, Glue, EMR, Step Functions, Athena, Spark, Databricks, Snowflake, Informatica, Talend, SSIS, Control-M, PySpark, Java, Scala
Responsibilities
Co-design target data models with Data Architect; build and operate batch/incremental pipelines; lead data extraction, profiling, cleansing, and reconciliation; implement automated data quality controls and lineage; publish trusted data to downstream consumers; implement unit/integration tests and CI/CD; provide technical guidance via code reviews; collaborate with Product Owner and stakeholders in Scrum/Kanban.
Seniority
Senior, hands-on IC
