Senior Data Quality Engineer (ETL Testing)
Core
Design and execute ETL tests, validate data transformations, and monitor AWS-based data pipelines to ensure data integrity and reliability.
Role type
Senior Data Quality Engineer (ETL Testing)
Builds
Robust data platforms and validated data pipelines for client analytics initiatives.
Domain
Cloud data engineering and data quality
Deliverable
production ML models | product features | dashboards & analysis
Required skills
ETL testing, data validation, AWS Glue, AWS S3, AWS Athena, AWS MSK, AWS SQS, AWS Lambda, AWS Step Functions, Python, SQL, Power BI, test automation, Agile/Scrum
Preferred skills
Data governance, data observability tools, Java, C#, C++
Responsibilities
Design and perform thorough ETL tests including test case development and transformation accuracy checks; Monitor and optimize AWS-based pipelines; Develop Python scripts to automate data quality checks; Collaborate with data engineers and analysts to resolve data quality issues; Maintain documentation of testing procedures and quality metrics.
Seniority
Senior, hands-on IC