Data Engineer, AI Infra
Core
Build and scale data pipelines and infrastructure to power the training and evaluation of multimodal AI models (text, image, audio, video) at Microsoft AI.
Role type
Senior IC Data Engineer (AI Infrastructure)
Builds
Petabyte-scale multimodal datasets and distributed computing frameworks for frontier AI model training.
Domain
Artificial Intelligence / Data Infrastructure
Deliverable
production ML models
Required skills
Data pipeline development, Spark, Ray, Vector Databases, distributed computing frameworks, petabyte-scale data management, data quality curation
Preferred skills
Large-scale data platform experience, AI/ML data infrastructure experience
Technologies
Spark, Ray, Vector Databases
Responsibilities
Build and scale data pipelines for multimodal AI model training; Develop and operate large-scale data infrastructure; Own critical data systems and distributed computing frameworks; Partner with model training teams to improve data quality and experimentation.