Sr. Test Automation Engineer
Core
Design and execute manual and automated test strategies for complex real-time and batch data pipelines, ensuring high-quality data delivery across AWS and Databricks-based analytics platforms.
Role type
Senior IC Test Automation Engineer (Data/ETL)
Builds
Automated data validation scripts, reusable automation frameworks, and CI/CD integrated tests for data pipelines.
Domain
Biotechnology / Data Engineering / Analytics
Deliverable
production ML models
Required skills
SQL, Python, PySpark, GraphQL API testing, Semantic layer validation (Looker, dbt), Data pipeline testing, ETL validation, CI/CD integration, Test planning, Defect tracking
Preferred skills
Data governance tools (Apache Atlas, Collibra), Observability tools (Datadog, Prometheus), Test data generation, Metadata-driven testing
Technologies
Python, PySpark, SQL, AWS (Glue, S3, Athena, Redshift), Databricks, Looker, dbt, JIRA, Jenkins, GitHub Actions, Postman, Parquet, Avro, JSON, CSV
Responsibilities
Design end-to-end test strategies for data validation and semantic layer testing; Develop automated validation scripts using Python/PySpark; Validate GraphQL APIs and schema/data contracts; Integrate automated tests into CI/CD pipelines; Manage test plans, cases, and defect tracking; Collaborate with Data Engineers and DevOps on shift-left testing.
Seniority
Senior, hands-on IC