Agentic Data Testing Manager
Core
Co-owning pre-production data assurance and testing strategy for Risk Intelligence datasets under a Continuous Data Assurance framework, ensuring data quality prior to production release.
Role type
Manager, Data Testing & Quality Assurance
Builds
Production-ready Risk Intelligence datasets with validated data quality and confidence scores
Domain
Financial markets data infrastructure and governance
Deliverable
production ML models | product features
Required skills
Data regression testing at scale, Schema and lineage validation, Test automation, Large dataset analysis, AI/LLM evaluation techniques, Synthetic data generation, Deterministic and agentic pipeline testing
Preferred skills
Experience with semantic equivalence testing, Eval pipelines, Client impact assessment on testing outcomes
Technologies
Deterministic pipelines, Agentic flows, LLM evaluation frameworks
Responsibilities
Define CDA testing scenarios and scorecards based on business priorities, Generate and improve synthetic data sets for lower environments, Implement data assurance testing and regression testing suites, Conduct source-to-product reconciliations and data lineage validation, Present data testing updates to Director-level collaborators, Raise requirements to Business Analysts to enable testing plan execution
Seniority
Manager, hands-on IC with team leadership
