Senior Software Engineer, Test
Core
Build automated test suites, infrastructure, and tooling for complex software systems, including AI/ML components, to ensure reliability and quality in fast-moving development environments.
Role type
Senior individual-contributor software quality engineer (SDET)
Builds
Automated test frameworks, CI/CD test gates, evaluation suites for AI/ML features, and reusable testing tooling
Domain
Software engineering, Quality Engineering, AI/ML systems
Deliverable
production ML models | product features
Required skills
Python, Java, TypeScript, automated test frameworks (pytest, JUnit), API testing, CI/CD integration, debugging, test data management, performance testing, AI/ML testing, non-deterministic system validation
Preferred skills
LLM evaluation frameworks (promptfoo, DeepEval, Ragas), RAG system testing, agentic workflow testing, LLM-as-judge techniques, observability tools (Langfuse, LangSmith)
Technologies
Python, Java, TypeScript, pytest, JUnit, Playwright, Cypress, Postman, k6, JMeter, PostgreSQL, TimescaleDB, Linux, Docker, JIRA, Bitbucket
Responsibilities
Design and maintain automated test suites across unit, integration, API, and end-to-end testing; build and improve test infrastructure and CI/CD gates; debug complex failures across application and infrastructure layers; establish performance and load testing for high-throughput systems; validate AI/ML features using representative datasets and metrics; review test code and help engineers improve testing practices; adapt testing practices for AI-assisted development
Seniority
Senior, hands-on IC