AI & Data Science Intern
Core
Intern supporting the evaluation, governance, and performance tuning of agentic AI harnesses within a cybersecurity DevSecOps team.
Role type
AI & Data Science Intern
Builds
Internal governance pipelines, evaluation frameworks, benchmark datasets, and telemetry instrumentation for AI systems.
Domain
Cybersecurity / Applied AI / Large Language Models
Deliverable
production ML models
Required skills
Python, data manipulation (pandas, numpy), LLM API usage, analytical thinking, written communication
Preferred skills
Experience with agentic systems, prompt evaluation techniques, LLM benchmarking
Technologies
Python, pandas, numpy, LLM APIs
Responsibilities
Define and implement evaluation frameworks to measure AI harness accuracy and reliability; Design and run structured evals to detect output drift and behavioral degradation; Instrument agentic harnesses with telemetry to capture latency, token usage, and error rates; Analyze telemetry data to identify patterns and surface anomalies for tuning; Contribute to building an internal AI governance pipeline including standards definition and audit trails; Collaborate with AI and AppSec teams to drive iterative improvements based on eval results.