Software Engineer, Distributed Systems & AI Infrastructure
Core
Design and build AI infrastructure, privacy-preserving data systems, and resilient distributed infrastructure for high-stakes government and regulated institution environments.
Role type
Senior IC distributed systems engineer (AI infrastructure)
Builds
Post-training pipelines, evaluation systems, production inference, offline-first distributed systems, and secure data computation platforms.
Domain
Government & regulated institutions, AI infrastructure, distributed systems, privacy-preserving computation
Deliverable
production ML models | infrastructure
Required skills
Operating systems, networking, distributed systems, consensus algorithms, CRDTs, event sourcing, model quantization, inference optimization, Go, Kubernetes, K3s, analytical/vector databases
Preferred skills
Experience with high-stakes environments, building simple resilient systems
Technologies
Go, Kubernetes, K3s, vLLM, TGI, ClickHouse, Pinecone, Weaviate
Responsibilities
Own post-training pipelines and production inference systems; design privacy-preserving data systems enforcing data sovereignty; build offline-first distributed systems operating across unreliable networks; reconcile conflicting state and deploy local models.
Seniority
Senior, hands-on IC