Software Engineer, Data Infrastructure & Acquisition - Culver City, CA, USA
Core
Building high-quality datasets at petabyte-scale to support model training operations for next-generation AI products.
Role type
Senior Software Engineer (Data Infrastructure & Acquisition)
Builds
Ingestion pipelines for audio data and cloud infrastructure for model training
Domain
Artificial Intelligence / Audio / Data Engineering
Deliverable
production ML models
Required skills
Python scripting, Bash scripting, Linux environments, Docker, Infrastructure-as-Code, GCP, web crawlers, large-scale data processing workflows
Preferred skills
Experience with web crawlers, large-scale data processing workflows
Technologies
GCP, Terraform, Docker, Python, Bash
Responsibilities
Find new sources of audio data and integrate them into the ingestion pipeline; Operate and extend cloud infrastructure for data ingestion; Collaborate with scientists to optimize cost, throughput, and quality of datasets; Craft the AI team's dataset roadmap for consumer and enterprise products
Seniority
Senior, hands-on IC
