Senior QA Data Engineer
Core
Establishing next-generation data quality and testing to ensure the trustworthiness of customer data powering AI solutions for the insurance industry.
Role type
Senior QA Data Engineer
Builds
Automated data quality suite and checks for data pipelines
Domain
Insurtech / Data Engineering
Deliverable
production ML models
Required skills
Automated data testing, SQL, Python, Airflow, Databricks, dbt, Soda, CI/CD, Data pipeline testing
Preferred skills
Health insurance data, Anomaly detection, Data observability, Front-end test automation
Technologies
dbt, Soda, SQL, Python, Airflow, Databricks
Responsibilities
Build and maintain automated data quality suite via Airflow; Define checks as code (dbt, Soda, SQL); Validate loads for completeness and schema; Reconcile data across Databricks layers; Detect anomalies and unexpected changes; Define severity levels and produce data quality reports; Track quality metrics to retire flaky checks; Partner with engineers to integrate checks into new pipelines.
Seniority
Senior, hands-on IC