Data QA Engineer
Core
Ensure accuracy, reliability, and quality of data delivered to customers across web scraping and AI-assisted projects by translating requirements into testing strategies and validating datasets.
Role type
Data QA Engineer
Builds
Validated datasets and quality reports for web scraping and AI projects
Domain
Data Quality / Web Scraping / AI
Deliverable
production ML models
Required skills
Python, SQL, Test Case Design, Data Quality Concepts, API Testing, Agile/Scrum, LLM Tools
Preferred skills
Scrapy, Test Automation Frameworks, Data Science concepts
Technologies
Python, Pandas, Jupyter Notebook, SQL, HTML, XPath, JSON, HTTP, CSS, Scrapy
Responsibilities
Translate customer data extraction and web scraping requirements into clear, measurable testing strategies, taking ownership of quality assurance from the beginning of new projects. Design and execute comprehensive test plans combining exploratory, manual, visual, and automated testing approaches according to project needs. Perform regular testing cycles on extracted datasets to validate data accuracy, completeness, consistency, and reliability. Identify, investigate, document, and report defects with clear reproduction steps and sufficient technical detail to enable developers to resolve issues efficiently. Apply descriptive statistics, data summaries, and visualizations to assess data quality, identify anomalies, and monitor potential data drift. Prepare detailed test reports and quality scores, providing internal stakeholders and customers with an accurate understanding of project quality and potential risks. Clearly communicate testing coverage, limitations, unresolved issues, and remaining risks throughout the delivery process. Collaborate with project managers and customers to clarify requirements, identify ambiguities, and ensure that expectations are measurable and testable before QA activities begin. Contribute to the development and continuous improvement of test automation frameworks, focusing on test coverage, reliability, and performance. Identify and implement improvements to QA processes and tools, including browser extensions, spreadsheet add-ons, and user-interface-based testing solutions. Work closely with QA leadership, developers, and project managers to maintain high-quality standards while operating with a high degree of independence.
Seniority
Mid-Senior (5+ years)