Systems & Data Infrastructure Engineer
Core
Design crash-safe binary data formats, manage HPC batch/interactive job lifecycles, and build real-time async backend services with AI service integration.
Role type
Senior IC systems & data infrastructure engineer (HPC & real-time streaming)
Builds
High-speed data pipelines, HPC job orchestration systems, real-time event channels, and AI service integrations
Domain
High-performance computing, real-time data streaming, scientific data architecture
Deliverable
production ML models | infrastructure
Required skills
Python 3 async/await, FastAPI, relational DB modeling with async ORM, Server-Sent Events/WebSockets with backpressure, RBAC with JWT/OAuth, subprocess management, binary/streaming file format design, REST/SDK integration
Preferred skills
Go, GraphQL, PostgreSQL administration, message queues (Redis/RabbitMQ/Kafka), HPC schedulers (SLURM/PBS), Linux cluster filesystems, NumPy/columnar formats (Parquet/HDF5), tool-calling orchestration
