Senior Automation Tester - PyTest / Databricks
Core
Design, build, and maintain automated test suites in Python and Pytest for Databricks-based data platforms, validating SQL-to-Databricks migrations, ETL/ELT pipelines, and large-scale data migrations.
Role type
Senior IC automation tester (data engineering)
Builds
Automated test suites, CI/CD pipelines, and validated data pipelines
Domain
Data engineering / Cloud data platforms
Deliverable
production ML models
Required skills
Python, Pytest, SQL, Databricks, CI/CD (GitHub Actions), Test management (qTest), Data validation, ETL/ELT testing, Delta Lake, Unity Catalog
Preferred skills
Databricks Genie, GitHub Copilot, AI tools, Agile/Scrum, Defect management
Technologies
Python, Pytest, Databricks, SQL, GitHub Actions, qTest, Delta Lake, Unity Catalog, Azure, PySpark, REST
Responsibilities
Design, build, and maintain automated test suites in Python and Pytest; Validate SQL-to-Databricks migrations and transformations; Write and run complex SQL queries in Databricks to verify ETL/ELT pipelines; Integrate automated tests into GitHub Actions CI/CD pipelines; Manage test cases, plans, and defect traceability in qTest; Use Databricks Genie and GitHub Copilot to support test creation and troubleshooting; Mentor junior testers and review automation code; Investigate failures and identify root causes.
Seniority
Senior, hands-on IC