Staff Software Engineer, Data & Scalability Platform
Core
Architecting and scaling the data plane (storage, streaming, compute) for AI agent resilience, ensuring reliability, cost-efficiency, and multi-tenant isolation.
Role type
Staff Software Engineer (Data & Scalability Platform)
Builds
Scalable data stores, streaming pipelines, distributed worker fleets, and performance tooling for AI observability.
Domain
AI Infrastructure / Distributed Systems / Data Engineering
Deliverable
production ML models
Required skills
Distributed systems architecture, Data-intensive backend services, Cloud-native technologies, Kubernetes, Go/Java/Rust/C++/Python, Capacity modeling, SLO definition, Multi-tenant isolation design, Performance engineering, Streaming systems, Columnar stores, FinOps
Preferred skills
OLTP/Analytical DB tuning, Streaming/Queueing systems, Compute scaling, ClickHouse, Disaster recovery, Observability instrumentation, Distributed task frameworks, Stateful systems, Mentorship
Technologies
Kubernetes, AWS/GCP, Kafka, RabbitMQ, Pulsar, Kinesis, ClickHouse, Druid, BigQuery, Snowflake, OpenTelemetry, Pyroscope, Celery, Temporal, Flink, Spark Streaming, Trino/Presto
Responsibilities
Define multi-quarter technical roadmap for data platform; Lead architecture of storage, streaming, and compute; Establish platform-wide standards for schema and migration; Lead capacity, performance, and SLO initiatives; Drive cost efficiency and quota design; Design multi-tenant isolation; Build internal performance tooling; Lead production investigations and systemic remediation; Mentor engineers and raise technical standards.
Seniority
Staff, technical leadership & strategy
