智能模型数据平台工程师-AI Data
Core
Build a unified platform for the full lifecycle management, production, consumption, and quality assurance of massive datasets for the Seed large language model.
Role type
Senior IC AI Data Platform Engineer
Builds
Unified data platform for LLM pre-training, SFT, and RLHF; Data Agents; High-throughput data infrastructure (data lakes, object storage, distributed computing, vector databases).
Domain
Artificial Intelligence / Large Language Models / Data Engineering
Deliverable
production ML models
Required skills
Python, Java, Go, Spark, Flink, Ray, Hudi, Iceberg, Paimon, Doris, ClickHouse, PyTorch, TensorFlow, Vector Databases, Distributed Computing, Data Lake Architecture
Preferred skills
LLM data scraping, processing, and synthesis, Agent project development, Harness Engineering, Source code reading, Engine secondary development
Responsibilities
Design and implement data infrastructure components (scheduling engines, compute platforms, lineage systems); Optimize architecture for high throughput and fault tolerance; Collaborate on cloud platform integration; Lead technology selection for data processing stacks.