Senior AI Data Infrastructure Engineer
Core
Design, build, and operate distributed data systems for large-scale AI model training, handling ingestion, processing, and transformation of massive structured and unstructured data (images, videos, 3D models).
Role type
Senior IC data infrastructure engineer (AI/ML data pipelines)
Builds
Scalable ETL/ELT pipelines, distributed data processing frameworks, and high-quality training datasets for generative AI models
Domain
Generative AI, 3D asset creation, distributed systems
Deliverable
production ML models
Required skills
Distributed system development, ETL/ELT pipeline design, Spark/Ray/Flink optimization, cloud object storage management, Kubernetes orchestration, Terraform/IaC, CI/CD implementation, data lineage tracking, unstructured data preprocessing
Preferred skills
Large model training workflow knowledge (pre-training/fine-tuning), 3D/2D asset processing, GPU/HPC cluster experience, data warehouse/lake platform expertise, open-source ML infrastructure contributions
Technologies
Spark, Ray, Flink, Kubernetes, Terraform, Databricks, Snowflake, BigQuery, Blender, Unity, Unreal
Responsibilities
Design and maintain scalable ETL/ELT pipelines for structured and unstructured data; optimize data processing using distributed frameworks; preprocess and verify quality of model pre-training data; manage infrastructure environments using IaC and CI/CD best practices
Seniority
Senior, hands-on IC