Senior QA Data Engineer
Core
Establish the next generation of data quality and testing at Gradient AI by designing, building, and running automated data quality checks across the data pipeline to ensure the trustworthiness of customer data powering AI solutions for insurance.
Role type
Senior QA Data Engineer
Builds
Automated data quality suite, data quality reports, and validation checks for data pipelines
Domain
Insurtech / Data Engineering / Quality Assurance
Deliverable
production ML models
Required skills
Automated data testing, SQL (Spark SQL), Python, Airflow, Databricks (Delta Lake), dbt, Soda, CI/CD, data pipeline testing, anomaly detection, root-cause analysis
Preferred skills
Health insurance or healthcare data experience, data observability tools, front-end test automation (Cypress, Playwright)
Technologies
dbt, Soda, Spark SQL, Python, Airflow, Databricks, Delta Lake
Responsibilities
Design and maintain automated data quality checks using dbt tests, Soda, and custom SQL; Validate data loads for completeness, sequencing, and schema; Reconcile data across Databricks layers and downstream outputs; Detect anomalies and unexpected changes in historical data; Define severity levels and produce data quality reports; Track quality metrics to retire flaky checks; Partner with engineers to integrate checks into new pipelines
Seniority
Senior, hands-on IC