Software EngineerSoftware Engineer, Data & Scalability Platform
Core
Build and operate high-scale data stores, streaming pipelines, and processing services to store, move, and transform evaluation results and metrics for AI agent resilience.
Role type
Senior backend software engineer (data platform & distributed systems)
Builds
Scalable data infrastructure including relational/analytical/object storage, stream processors, and distributed worker fleets for AI observability.
Domain
AI infrastructure, data engineering, distributed systems
Required skills
Python, Go/Java/C++, distributed systems design, database schema design, query tuning, streaming systems, system performance optimization, CI/CD, automated testing
Preferred skills
Columnar/analytical/time-series databases, queue consumer tuning, load testing, Kubernetes, cloud platforms, observability tooling, multi-tenant systems
Technologies
Kafka, RabbitMQ, Pulsar, Kinesis, ClickHouse, Druid, BigQuery, Snowflake, OpenTelemetry, AWS, GCP
Responsibilities
Design and implement backend services and data pipelines; optimize query/write performance via indexing and tuning; debug production issues across data stores and services; lead features from design to deployment; contribute to load testing and profiling.
Seniority
Senior, hands-on IC
