Software Engineer II, AI Performance
Core
Design and build data pipelines and evaluation frameworks to measure the real-world performance, precision, and business impact of Disney's operational AI and observability tools.
Role type
Senior IC backend/data pipeline engineer (AI performance & observability)
Builds
Automated ground-truth pipelines, model evaluation frameworks, and single-pane dashboards for AI reliability and incident metrics
Domain
Media streaming (Disney+, Hulu, ESPN) + AI Observability
Deliverable
production ML models | dashboards & analysis
Required skills
backend engineering, data pipeline engineering, distributed processing (PySpark, SQL), model evaluation (precision, recall, drift), API development, cloud-native deployments
Preferred skills
observability platforms (Datadog, Grafana), agentic workflows, SRE metrics, data attribution tooling
Technologies
FastAPI, Flask, PySpark, SQL, Pandas, Databricks, Snowflake, AWS, EKS, GitHub, Docker, Cursor, Claude Code
Responsibilities
Design automated feedback pipelines correlating AI predictions with operational outcomes; Develop programmatic evaluation frameworks to track model drift and precision; Build data pipelines linking AI outputs to incident lifecycles; Design scalable APIs and dashboards for AI ROI and operational health; Build mechanisms to capture structured end-user feedback for model improvement
Seniority
Mid-level (3+ years), hands-on IC