Software Engineer, Data Infrastructure
Core
Architect and build foundational data infrastructure to aggregate simulation outputs and user inputs into a unified ensemble optimized for LLM consumption and rapid wargaming iterations.
Role type
Senior Software Engineer (Data Infrastructure)
Builds
Scalable, high-performance data pipelines and relational data models for massive batch processing of simulation data.
Domain
Defense & National Security / Distributed Simulation / AI Data Infrastructure
Deliverable
production ML models
Required skills
Systems programming (Rust, Go, C++, Python), Distributed systems architecture, Memory management, High-throughput data processing, Complex data modeling, First-principles problem solving
Preferred skills
Search & RecSys, Gaming/MMO state management, High-Frequency Trading (HFT), LLM context optimization, Vector embeddings
Technologies
Rust, Go, C++, Python, Java, Spark, PySpark
Responsibilities
Design and implement architecture to ensemble diverse sources of injected context into a unified format; Build highly scalable, resilient data architectures from scratch for massive batch jobs; Design sophisticated relational data models for state-based simulation environments; Navigate ambiguous requirements to design custom ground-up systems; Set technical standards for code quality and system performance.
Seniority
Senior, hands-on IC
