Quality and Automation Engineer 2
Core
Design, develop, and execute ETL test strategies and automated validation frameworks for data ingestion, transformation, and loading processes.
Role type
ETL SDET Engineer 2
Builds
Enterprise data platforms, data pipelines, warehouses, and lakes
Domain
Data Engineering / ETL
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery | infrastructure | physical/clinical work
Required skills
SQL, Python, Java, ETL processes, data warehouses, data quality principles, data reconciliation, lineage validation, impact analysis, API testing, data ingestion frameworks
Preferred skills
Snowflake, Databricks, Airflow, dbt, CI/CD practices, test automation for data pipelines, metadata management
Technologies
Snowflake, Databricks, Airflow, dbt
Responsibilities
Design and execute ETL test strategies and automated validation frameworks; Validate data quality, completeness, accuracy, and transformation rules; Perform data reconciliation and lineage validation; Test data ingestion frameworks, APIs, and data consumption layers; Collaborate with Data Engineering and Analytics teams to troubleshoot issues; Develop SQL and Python-based validation scripts; Monitor ETL workflows and ensure timely validation of batch jobs; Participate in code reviews and defect triage.
Seniority
Mid-level IC (2-5 years experience)