Senior Software Development Engineer in
Core
Design and architect quality strategies, automated test suites, and evaluation frameworks for LLM-powered applications and agentic workflows.
Role type
Senior Software Development Engineer (QA/Automation)
Builds
End-to-end automated test suites, prompt-testing systems, regression suites, and internal testing tools for GenAI implementations.
Domain
Generative AI, Large Language Models (LLMs), Software Quality Assurance
Deliverable
production ML models
Required skills
Python, Test automation frameworks, Prompt engineering, API testing, CI/CD integration, Adversarial testing, Regression testing, Performance testing, Security testing, Analytical problem-solving
Preferred skills
Selenium, Pytest, JavaScript, REST Assured, Postman, Golden-example dataset creation
Technologies
Python, Selenium, Pytest, JavaScript, Postman, REST Assured
Responsibilities
Design and architect test plans and evaluation frameworks for LLM applications; Develop automated test suites for evaluations, APIs, UI, and performance; Create automated prompt-testing and regression systems; Define evaluation criteria for accuracy, safety, and latency; Perform adversarial testing to identify hallucinations and vulnerabilities; Deploy real-time monitoring for AI feature quality; Own the quality strategy including QA best practices.
Seniority
Senior, hands-on IC