Quality Assurance Architect - Hadoop / Big Data / Python
Core
Design, implement, and govern enterprise-wide quality engineering practices for large-scale Big Data, Hadoop, and Data Warehouse platforms.
Role type
Senior Quality Assurance Architect (Big Data)
Builds
Scalable test automation solutions for data ingestion, transformation, processing, and reporting systems
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Test architecture, Python development, Big Data/Hadoop ecosystem testing, Data Warehouse/ETL testing, Apache Spark/PySpark, HQL/SQL, Cloud platforms (AWS), CI/CD pipelines, Team leadership (3-5 members)
Preferred skills
Hadoop ecosystem tools (Hive, HDFS, YARN), Data quality frameworks, Performance/scalability testing, Data governance and lineage
Technologies
Python, Apache Spark, PySpark, HQL, SQL, AWS, Hive, HDFS, YARN
Responsibilities
Define QA architecture and test strategies for Big Data applications; Lead a team of QA engineers; Design automated validation frameworks for data pipelines; Collaborate with cross-functional teams on quality releases; Perform root cause analysis and drive continuous quality improvements.
Seniority
Senior, hands-on IC with leadership responsibilities