Software Engineer, Data Infrastructure & Acquisition - Oxford, United Kingdom
Core
Building high-quality datasets at petabyte-scale to support model training operations for next-generation AI models.
Role type
Senior IC software engineer (data infrastructure & acquisition)
Builds
Data ingestion pipelines and cloud infrastructure for AI model training
Domain
Artificial Intelligence / Audio / Data Engineering
Deliverable
production ML models
Required skills
Python scripting, Bash scripting, Linux environments, Docker, Infrastructure-as-Code, GCP, web crawlers, large-scale data processing workflows
Preferred skills
Experience with web crawlers, large-scale data processing workflows
Technologies
GCP, Terraform, Docker, Python, Bash
Responsibilities
Find new sources of audio data and integrate them into the ingestion pipeline; Operate and extend cloud infrastructure for data ingestion; Collaborate with scientists to optimize cost, throughput, and quality of datasets; Collaborate with leadership to craft the dataset roadmap
Seniority
Senior, hands-on IC
