EDA DataOps Quality Engineer (Tester)
Core
Design and run automated quality engineering tests for data pipelines, APIs, and Databricks-based data-processing solutions to validate high-volume datasets and complex transformation rules.
Role type
Senior IC DataOps Quality Engineer (Tester)
Builds
Automated test suites and frameworks for data integrity and regression testing
Domain
Healthcare Payer / Life Sciences / Data Engineering
Deliverable
production ML models
Required skills
Python, Pytest, Advanced SQL, Databricks, ETL/ELT testing, API testing, Data reconciliation, CI/CD integration
Preferred skills
PySpark, Delta Lake, Playwright, Azure Cloud, Data pipeline performance testing
Technologies
Azure, Databricks, PySpark, Delta Lake, Playwright, Azure DevOps, SQL, Python, Pytest
Responsibilities
Design and run automated quality engineering tests for data pipelines and APIs; Build reusable automation frameworks for SQL-based source-to-target reconciliations; Integrate automated test suites into Azure DevOps CI/CD pipelines; Work with data engineers and stakeholders to identify defects and maintain production-grade data integrity.