ETL Automation Quality Engineer
Core
Design, develop, and maintain automated test frameworks to validate data integrity, accuracy, and performance of ETL workflows in cloud environments.
Role type
ETL Automation Quality Engineer
Builds
Automated testing frameworks for data pipelines
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, Unix/Linux, AWS S3, automated ETL testing frameworks, CI/CD integration
Preferred skills
API testing tools, GitHub Actions, AI/ML tools
Technologies
AWS, Hadoop, Parquet, GitHub, GitHub Actions
Responsibilities
Design and maintain automated test frameworks for ETL workflows; Write complex SQL queries to validate data transformations; Implement Python scripts to automate testing and monitor pipeline performance; Integrate automated tests into CI/CD pipelines; Manage data storage and retrieval processes in AWS S3; Apply QE methodologies to identify and resolve issues in ETL pipelines; Document test strategies and results.
Seniority
Mid-level, hands-on IC
