Software Engineer 3
Core
Building automated testing frameworks and tooling to verify functional equivalence, performance, and data integrity for enterprise application and data modernization projects.
Role type
Senior Software Engineer (Testing Frameworks & LLM Integration)
Builds
Automated testing frameworks, contract testing tools, and LLM-based unit test generators for database modernization.
Domain
Data Engineering / Software Testing / AI Integration
Deliverable
production ML models | product features
Required skills
Java (Spring ecosystem), LLM evaluation (DeepEval, Ragas, Promptfoo), LLM integration for test generation, database state comparison algorithms, Change Data Capture (CDC), event-driven database interception, relational and document data modeling, SQL (Postgres/MySQL), NoSQL (MongoDB), algorithms and data structures, software architecture.
Preferred skills
Experience with OpenAI/Anthropic models, building developer tools, CI/CD implementation.
Technologies
Java, Spring, OpenAI, Anthropic, DeepEval, Ragas, Promptfoo, Postgres, MySQL, MongoDB, AWS, Google Cloud, Microsoft Azure.
Responsibilities
Design and build automated frameworks for functional equivalence and performance validation; integrate LLMs to automate unit test generation and edge-case discovery; curate golden datasets and adversarial test sets; collaborate with product management and engineers on the roadmap; conduct code reviews and troubleshoot distributed system issues.
Seniority
Senior, hands-on IC
