Data Engineer QA/Data Quality (F/H)
Core
Designing and implementing data quality frameworks, automated tests, and observability solutions for cloud data pipelines to ensure reliable data for business, analytics, and AI use cases.
Role type
Data Engineer specializing in QA and Data Quality
Builds
Automated data validation frameworks, CI/CD integrated tests, and observability monitoring for data pipelines
Domain
Banking, Cloud Data Engineering, Data Quality
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data quality rule definition, automated testing (unit/integration/regression), ETL/ELT pipeline development, Spark, Databricks, data anomaly detection, CI/CD integration, data contract definition
Preferred skills
Cloud platform expertise (AWS), Agile methodology, cross-functional collaboration
Technologies
Databricks, AWS, Spark
Responsibilities
Define and implement data quality rules (completeness, consistency, uniqueness, accuracy); Design and integrate automated tests into data pipelines; Build observability and monitoring solutions for data pipelines; Analyze and correct production data quality anomalies; Collaborate with Data Engineers, Analysts, and Product Teams to define data contracts
Seniority
Mid-level, hands-on IC
