Business Intelligence Analyst I – AI & Model Monitoring
Core
Design and scale model governance capabilities to monitor, measure, and communicate machine learning model performance across the business.
Role type
Business Intelligence Analyst I – AI & Model Monitoring
Builds
Monitoring frameworks, performance KPIs, dashboards, and automated alerting solutions for AI and predictive models
Domain
Finance Analytics / Machine Learning Model Governance
Deliverable
production ML models
Required skills
Python (pandas, numpy, scipy, visualization libraries), SQL, data profiling, statistical analysis, documentation, alert configuration
Preferred skills
Databricks (notebooks, jobs, Delta tables, Unity Catalog), BI/visualization tools (Tableau, Power BI)
Technologies
Python, SQL, Databricks, Tableau, Power BI
Responsibilities
Develop and automate monitoring dashboards and reports for model health metrics; Execute quantitative monitoring tests (back-testing, benchmarking, sensitivity analysis); Profile and analyze incoming data sources for quality and suitability; Document monitoring methodologies and alert configurations; Track and report on monitoring findings and escalate issues; Work with model owners to refine monitoring requirements and validate thresholds
Seniority
Individual Contributor, early career (2+ years experience)
