CareerPlanSign in

Software Test Engineer

USA | Remote💼 Full-time🗓 2026-08-27 → 2026-09-25

Core

Design, build, and maintain automated test frameworks and exploratory test suites for voice AI products, models, APIs, and data platforms.

Role type

Senior Software Test Engineer (Voice AI/ML)

Builds

Scalable automation, evaluation pipelines, data-quality gates, and CI/CD integration for speech-to-text and text-to-speech systems.

Domain

Voice AI, Speech Recognition, Real-time Systems

Deliverable

production ML models | product features | dashboards & analysis

Required skills

Python, Rust, Go, automated test pipeline design, statistical analysis, adversarial testing, CI/CD integration, data quality validation, bug reporting

Preferred skills

LLM/RAG testing, voice/audio metrics (WER, MOS), cloud infrastructure, containerization, cross-platform testing, open-source contributions

Technologies

Python, Rust, Go, Grafana, CI/CD systems, React Native, ephemeral test environments

Responsibilities

Define and execute test plans for products, APIs, and model-powered features; build automated test suites for functional, integration, and regression testing; create adversarial test datasets and fixtures; validate model behavior using metrics and human review; integrate quality checks into CI/CD; partner with Research and Engineering to establish test coverage; write precise bug reports and participate in triage.

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.