Senior Databricks QA Engineer
Core
Automating tests for data pipelines, ETL processes, and data quality within a Databricks and AWS environment.
Role type
Senior QA Automation Engineer
Builds
Automated testing frameworks for data pipelines and ETL processes
Domain
Data Engineering / Cloud Data Platforms
Deliverable
production ML models | infrastructure
Required skills
Data pipeline testing, ETL process testing, Apache Spark, Databricks, AWS Glue, Python, Data quality principles, Cloud platforms (AWS)
Preferred skills
Large-scale data generation and validation
Technologies
Apache Spark, Databricks, AWS Glue, Python, AWS
Responsibilities
Build automation or testing frameworks, Test data pipelines and ETL processes, Validate data transformations and joins
Seniority
Senior, hands-on IC
Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
