Software Engineer, Data Infrastructure & Acquisition - Tucson, AZ, USA
Core
Building high-quality datasets at petabyte-scale to support model training operations for next-generation AI products.
Role type
Senior IC software engineer (data infrastructure & acquisition)
Builds
Ingestion pipelines for audio data collection and dataset curation
Domain
Artificial Intelligence / Audio / Data Infrastructure
Deliverable
production ML models
Required skills
Python scripting, Bash scripting, Linux environments, Docker, Infrastructure-as-Code, GCP, web crawlers, large-scale data processing workflows
Preferred skills
Experience with data collection sources, cost optimization strategies
Technologies
GCP, Terraform, Docker, Python, Bash
Responsibilities
Find new sources of audio data and integrate them into the ingestion pipeline; Operate and extend cloud infrastructure for data ingestion; Collaborate with scientists to optimize cost, throughput, and quality of datasets; Craft the AI team's dataset roadmap for consumer and enterprise products
Seniority
Senior, hands-on IC