Technical Solution Management Specialist - AI Evaluation, Research, and Technical Architecture Func.
Core
Define and communicate a future-state vision for AI evaluation, research quality, and technical architecture across the XIO AI Innovation Lab, scaling pre 0-to-1 motions from research to Test Kitchen handoff.
Role type
Senior IC technical program manager specializing in AI evaluation and research architecture
Builds
Multi-dimensional evaluation approaches, automated testing frameworks, reference architectures, and reusable solution patterns for diverse lab-stage AI workloads
Domain
Artificial Intelligence, Machine Learning, Research, Data Science
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery | infrastructure
Required skills
AI evaluation methodologies, automated testing pipelines, synthetic data generation, A/B experimentation, Responsible AI frameworks, reference architecture design, research paper production, cross-functional project management, UX research principles, stakeholder alignment
Preferred skills
Experience in customer experience domains, product development, reading/writing code, adapting strategy based on emerging technology trends
Technologies
Synthetic scenario generation, adversarial stress-testing, feature-flagged trials, batch evaluation, offline evaluation
Responsibilities
Develop and maintain technical blueprints for research, validation, and Test Kitchen handoff; Define processes and playbooks for scaling pre 0-to-1 motions; Influence technical roadmaps for product evaluation frameworks; Build and scale multi-dimensional evaluation approaches for chatbots, agents, and generative tools; Coordinate across business, technical, and governance teams; Lead direct customer and field-team engagements to collect performance metrics
Seniority
Senior, hands-on IC with strategic planning and mentorship responsibilities
