Data Infrastructure Engineer
Core
Build backend and hardware architecture for high-quality, fast research by owning the entire data lifecycle from processing massive multimodal datasets to managing cloud and bare metal compute clusters.
Role type
Senior IC data infrastructure engineer
Builds
High-throughput, low-latency data pipelines and compute clusters for foundational model training
Domain
Neuroscience technology / Deep learning infrastructure
Deliverable
infrastructure
Required skills
systems-level architecture, Python, Rust, C++, Go, high-performance ETL pipeline design, bare-metal cluster provisioning, high-speed networking, heterogeneous hardware data stream handling, hybrid environment storage topology design, database management (TimescaleDB, ClickHouse), cloud sync (AWS/GCP/Azure), low-level I/O optimization
Preferred skills
modern ML frameworks (PyTorch/TensorFlow), distributed GPU training networking (InfiniBand, RoCE), zero-copy networking, shared memory optimization, programmatic video processing (FFmpeg, GStreamer, OpenCV)
Technologies
Python, Rust, C++, Go, TimescaleDB, ClickHouse, AWS, GCP, Azure, InfiniBand, RoCE, FFmpeg, GStreamer, OpenCV
Responsibilities
Build pipelines to process massive multimodal datasets (video, audio, text, time-series); provision and manage cloud and bare metal compute clusters; bridge physical neuro hardware with central repositories; optimize low-level I/O bound operations; define storage topologies and sync datasets between on-premise edge servers and the cloud
Seniority
Senior, hands-on IC