Senior Software Engineer
Core
Build the backend infrastructure for capturing, buffering, processing, and storing multimodal data (video, audio, text, time series) to create high-performance training datasets for foundation models.
Role type
Senior Software Engineer (Backend Infrastructure)
Builds
Fault-tolerant data ingestion engines, hybrid on-premise/cloud infrastructure, and unified device abstraction layers for TB-scale daily data.
Domain
AI infrastructure, data engineering, multimodal data processing
Deliverable
production ML models
Required skills
Python, Rust, C++, or Go; high-performance messaging and queuing (ZeroMQ, Kafka, RabbitMQ, Redis); cloud infrastructure management (AWS, GCP, Azure); low-latency streaming protocols (WebRTC, RTSP, HLS); programmatic video processing (FFmpeg, GStreamer, OpenCV); high-performance data transfer (zero-copy networking, shared memory, memory-mapped files); time-series databases (TimescaleDB, InfluxDB, ClickHouse); efficient file formats (Parquet, Avro, Arrow); networking fundamentals.
Preferred skills
ML framework data requirements (PyTorch/TensorFlow), neurotech, mental health, or human-AI interaction.
Technologies
ZeroMQ, Kafka, RabbitMQ, Redis, AWS, GCP, Azure, WebRTC, RTSP, HLS, FFmpeg, GStreamer, OpenCV, TimescaleDB, InfluxDB, ClickHouse, Parquet, Avro, Arrow
Responsibilities
Architect fault-tolerant data ingestion engines; write robust multi-process applications for concurrent data streams; design unified device abstraction layers; optimize I/O-bound operations and track bandwidth/latency; define storage topology for TB-scale ingestion; manage on-premise server provisioning; build synchronization logic for edge-to-cloud data transfer.
Seniority
Senior, hands-on IC