Senior Software Engineer - Data Infrastructure
Core
Design and develop scalable open-source data infrastructure to support the entire data lifecycle (collection, ingestion, storage, querying, retrieval) for massive volumes of data across cloud, hybrid, and on-prem environments.
Role type
Senior IC infrastructure engineer (data platforms)
Builds
External and internal data products, processing pipelines, and performant query interfaces
Domain
Physical AI, automotive, defense, logistics, and industrial automation
Deliverable
production ML models | infrastructure
Required skills
Large-scale open-source data technologies, containerization, modern software development workflows, open-source landscape judgment
Preferred skills
Modern programming languages (Python, C++, Go, Scala), Kubernetes, enterprise software environments, data quality and profiling techniques
Technologies
Spark, Kafka, Hudi, Flyte
Responsibilities
Scale infrastructure across deployment types and regions, tune processing pipelines for fast ingestion and indexing, enable product workflows with performant query interfaces, develop and deploy high-quality software using modern tooling
Seniority
Senior, hands-on IC
