CareerPlanGet AI match score →

Staff Principal Ai Engineer

💼 Full-time🗓 2026-07-26

Core

Define technical roadmap and architecture for evolving prompt-based systems to RAG and AI agents in healthcare, overseeing model evaluation, deployment, and cost optimization.

Role type

Staff Principal AI Engineer (Gen AI Strategy & Architecture)

Builds

Scalable, cost-effective Generative AI solutions for medical specialties

Domain

Healthcare + Generative AI

Deliverable

production ML models

Required skills

Deep Learning, Large Language Models, RAG architectures, vector databases, AI agent frameworks, MLOps, Python, cloud platforms (AWS/Azure/GCP), distributed systems, microservices, API design, data engineering, ETL pipelines, CI/CD

Preferred skills

Healthcare technology, clinical workflows, medical data, HIPAA/FDA regulations, medical coding standards (ICD-10, CPT, SNOMED-CT), regulated industries QA

Technologies

Python, AWS, Azure, GCP, vector databases, AI agent frameworks

Responsibilities

Define technical roadmap for Gen AI evolution, drive architectural decisions for scalable solutions, oversee model evaluation and deployment, manage project timelines and resource allocation, implement monitoring and observability for production systems, partner with leadership on Gen AI strategy

Seniority

Staff Principal, hands-on IC with strategic leadership

Rewrite
## About the role What will you do? ### Technical Strategy & Architecture - Define technical roadmap for evolving from prompt-based systems to RAG and AI agents - Drive architectural decisions for scalable, cost-effective Gen AI solutions in healthcare - Oversee model evaluation, selection, and deployment strategies across multiple medical specialties - Ensure technical debt management and maintainable code standards across the team - Lead technical design reviews and architecture discussions - Stay current with Gen AI research and translate innovations into product capabilities ### Product & Project Delivery - Collaborate with Product, Clinical, and Business teams to translate requirements into technical solutions - Manage project timelines, resource allocation, and delivery commitments for Gen AI initiatives - Drive cross-functional collaboration to ensure seamless integration of AI capabilities - Oversee A/B testing, experimentation, and data-driven decision making for AI features - Ensure compliance with healthcare regulations (HIPAA) and coding standards (ICD-10, CPT) ### Operational Excellence & Cost Management - Implement monitoring, observability, and SLA management for production Gen AI systems - Drive cost optimization initiatives for LLM usage, infrastructure, and data processing - Establish best practices for Gen AI MLOps, including model versioning and deployment pipelines - Ensure system reliability, scalability, and performance optimization - Lead incident response and post-mortem processes for AI system issues ### Strategic Planning - Partner with leadership to define Gen AI strategy and competitive positioning - Evaluate build vs buy decisions for Gen AI capabilities and tooling - Drive innovation initiatives and proof-of-concept development for new AI applications - Represent engineering in executive discussions about AI roadmap and investment priorities ## Requirements We are looking for someone with: ### Gen AI & Technical Expertise - 3+ years hands-on experience with Deep Learning, Large Language Models and Gen AI applications and total 10+ Years of Exp in Data Science/ML roles. - Deep understanding of RAG architectures, vector databases, and AI agent frameworks - Experience with production Gen AI systems: deployment, monitoring, and cost optimization - Knowledge of model evaluation, fine-tuning, and prompt engineering best practices - Understanding of MLOps practices for LLM deployments and model lifecycle management ### Healthcare & Regulatory Knowledge - Experience with healthcare technology, clinical workflows, or medical data (preferred) - Understanding of healthcare compliance requirements (HIPAA, FDA regulations) - Knowledge of medical coding standards (ICD-10, CPT, SNOMED-CT) is a plus - Experience with regulated industries and quality assurance processes ### Technical Leadership - Strong software engineering background with expertise in Python, cloud platforms (AWS/Azure/GCP) - Experience with distributed systems, microservices architecture, and API design - Understanding of data engineering, ETL pipelines, and real-time processing systems - Knowledge of modern development practices: CI/CD, testing, code review, agile methodologies ### Business Acumen - Experience translating business requirements into technical solutions - Understanding of cost optimization and budget management for AI/ML projects - Ability to communicate technical concepts to non-technical stakeholders - Experience with product development lifecycle in fast-paced startup environment ### Strategic Thinking - Proven ability to define and execute technical roadmaps - Experience with technology evaluation, vendor management, and build vs buy decisions - Understanding of AI/ML market landscape and competitive positioning - Track record of driving innovation while maintaining operational excellence ## What we offer - Exceptional total compensation with equity upside - Hybrid Setup with flexible working arrangements - Opportunity to lead cutting-edge Gen AI applications in healthcare - Work with a world class team solving critical problems in healthcare automation - Leading healthcare benefits and comprehensive wellness programs - Professional development budget for conferences, training, and certifications - Direct impact on healthcare providers and patient outcomes across the USA
Sourced via wellfound · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Wellfound ↗