大模型基础设施工程师（大模型资源管理/数据管理处理方向）-TikTok Shop
Core
Design and implement multi-tenant compute resource management and scheduling systems for e-commerce scenarios, covering training, inference, and evaluation workloads.
Role type
Senior Infrastructure Engineer (LLM Resource & Data Management)
Builds
Scalable GPU/CPU clusters, FinOps cost optimization systems, and end-to-end LLM data platforms supporting SFT/RLHF.
Domain
E-commerce, Large Language Models (LLM), Cloud Infrastructure
Deliverable
infrastructure
Required skills
Go/Java/Python, Kubernetes, GPU scheduling, Distributed systems, Object storage, Data pipelines (ETL/ELT), Observability, FinOps
Preferred skills
LLM training/inference optimization (NCCL/CUDA/Triton), RLHF platform experience, Multi-cloud/Hybrid cloud, RDMA/NVLink optimization
Technologies
Kubernetes, Volcano, Kueue, Kafka, Flink, Spark, Iceberg, Delta Lake, Prometheus, Grafana, ELK, IAM, KMS