Software Engineer, Data Infrastructure
Core
Building and maintaining high-performance petabyte-scale storage infrastructure and networking for AI model training and evaluation workloads.
Role type
Senior IC software engineer (data infrastructure)
Builds
High-performance data layers for frontier AI model training and evaluation
Domain
AI/ML infrastructure, distributed systems, cloud storage
Deliverable
infrastructure
Required skills
Python, Kubernetes (storage side), distributed data processing frameworks (Apache Beam, Spark, Flink), petabyte-scale storage management, unstructured data transformation
Preferred skills
Modern analytics tooling (BigQuery, Airflow, dbt), AI research knowledge
Technologies
Kubernetes, S3, GCS, POSIX, Apache Beam, Spark, Flink
Responsibilities
Work on petabyte-scale storage infrastructure; address networking and performance challenges; collaborate with top-tier researchers and engineers
Seniority
Senior, hands-on IC