Principal Quality Development Engineer
Core
Develop, maintain, and implement AI validation methodologies and tools to validate non-deterministic AI-enabled applications and LLMs within a unified healthcare information system.
Role type
Principal Quality Development Engineer (AI/ML Validation)
Builds
TrakCare and IntelliCare (unified healthcare information system) for healthcare organizations
Domain
Healthcare IT / Artificial Intelligence / Large Language Models
Deliverable
production ML models
Required skills
AI validation methodologies, non-functional testing strategies, LLM performance evaluation, test plan design, system administration, DevOps, multiple programming languages, SDLC principles
Preferred skills
AI certifications, interdisciplinary team collaboration, custom tool development for UI/API/AI/ML validation
Technologies
LLMs, AI tools, HealthShare platform
Responsibilities
Develop and implement AI validation methodologies for non-deterministic applications; Define and standardize testing strategies for performance, security, and interoperability across LLMs; Collaborate with Agile teams to prioritize testing efforts; Research and maintain industry knowledge in AI; Evaluate and optimize LLM performance including accuracy and hallucination detection; Lead development of AI test strategies and detailed test plans; Provide governance across AI validation activities
Seniority
Principal, hands-on IC with strategic oversight