Member of Technical Staff, Software Engineer
Core
Create high-quality datasets for training and evaluation, run experiments on new datasets, and develop scalable data pipelines for multimodal ingestion and pre-processing.
Role type
Senior IC data engineer (multimodal datasets)
Builds
Scalable data pipelines for multimodal ingestion, pre-processing, filtering, and annotation
Domain
AI/ML data infrastructure, multimodal data processing
Deliverable
production ML models
Required skills
Python, Pandas, NumPy, statistics, exploratory data analysis, data processing frameworks (Spark, Ray, Apache Beam), large-scale unstructured/semi-structured dataset handling
Preferred skills
Experience with dataset auditing, visualization, and versioning tools
Technologies
Python, Pandas, NumPy, Spark, Ray, Apache Beam
Responsibilities
Create high-quality datasets for training and evaluation; run experiments on new datasets to assess impact; develop and maintain scalable data pipelines; analyse real-world multimodal datasets to assess quality and diversity; build lightweight tools for dataset auditing and versioning
Seniority
Senior, hands-on IC