Data Engineer QA/Data Quality (F/H) - Freelance
Core
Designing and implementing data quality rules, automated testing frameworks, and observability solutions for cloud data pipelines to ensure reliable data for business, analytics, and AI use cases.
Role type
Senior Data Engineer specializing in Data Quality and QA
Builds
Production data pipelines (ETL/ELT) with embedded quality controls and monitoring on Databricks and AWS
Domain
Banking / Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, ETL/ELT, Data Quality Frameworks, Automated Data Testing, Spark, Databricks, AWS, CI/CD, Monitoring & Observability, Agile/Scrum
Preferred skills
Data Contracts, Data Observability, Data Governance
Responsibilities
Define and implement data quality rules (completeness, consistency, uniqueness, accuracy); Build automated unit, integration, and regression tests for data pipelines; Design and evolve data pipelines with quality control mechanisms; Analyze and correct production data quality anomalies; Implement observability solutions including alerting and anomaly detection; Collaborate with Data Engineers, Analysts, and Product Teams to define data contracts.
Seniority
Senior, hands-on IC