Financial Risk & Safety Specialist (AI Systems)
Core
Part-time expert evaluator reviewing AI-generated financial content and conversations to identify risks like misleading guidance, overconfidence, and inappropriate alignment in consumer-facing contexts.
Role type
Part-time AI safety and red teaming specialist (financial domain)
Builds
Safer AI systems for consumer financial interactions
Domain
Financial services + AI safety
Deliverable
production ML models
Required skills
Financial risk assessment, regulatory compliance knowledge, adversarial testing, red teaming, uncertainty communication analysis, sycophancy detection, multi-turn conversation evaluation, written documentation
Preferred skills
CFA/CFP/CPA/FRM certification, fintech product experience, AI evaluation background, NLP interest
Technologies
Slack, standard productivity tools, AI conversational interfaces
Responsibilities
Review AI-generated financial content for accuracy and risk, identify unsafe or misleading financial guidance, evaluate model handling of uncertainty and disclaimers, assess model pushback on risky user assumptions, identify patterns of sycophancy and over-alignment, evaluate multi-turn conversations for policy breakdown, participate in red teaming exercises, support QA of red teaming outputs, document edge cases and failure modes, provide structured written feedback, collaborate on safety frameworks
Seniority
Part-time contractor/freelance