Software Engineer, ML Data Infrastructure
Core
Building robust data infrastructure and optimizing data processing workflows for massive throughput to power foundation models at petabyte scale.
Role type
Senior IC machine-learning data infrastructure engineer
Builds
Production-grade data systems and distributed pipelines for multi-modal training
Domain
Generative AI / Large-scale distributed systems
Deliverable
infrastructure
Required skills
distributed systems, data structures, algorithms, databases, data storage architectures, large-scale data processing, project scoping, execution, iteration
Preferred skills
Kubernetes, GCP, Google Bigtable, Google BigQuery, Google Spanner, Google Pub/Sub, Docker, Terraform, TPU infrastructure
Responsibilities
Scaling distributed systems, building robust data infrastructure for foundation models, optimizing data processing workflows, partnering with research scientists to translate data requirements into production systems
Seniority
Mid-level, hands-on IC
