大模型数据/评估平台工程师(模型数据或评估平台方向)(J105495)
Core
Build stable, reusable platform services and a reliable runtime platform for the full lifecycle of large language models (LLMs), focusing on data governance, automated evaluation, and distributed scheduling.
Role type
Senior IC Platform Engineer (LLM Data & Evaluation)
Builds
Identity/permission/config services, data governance pipelines, automated benchmark infrastructure, and distributed task scheduling systems.
Domain
AI Engineering / Large Language Models / Cloud Native Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Go or Python, Kubernetes, distributed systems, container runtime, data consistency, high-concurrency systems, GPU resource management
Preferred skills
LLM data platform experience, automated evaluation frameworks, HPC platforms, multi-cluster management, microVMs, cost optimization
Technologies
Go, Python, Kubernetes, gRPC, REST, Linux, Docker, GPU clusters, object storage, relational databases, message queues
Responsibilities
Design and develop backend services for identity, permissions, and configuration; manage end-to-end LLM data lifecycle (collection, cleaning, versioning); build and maintain automated benchmark systems for model evaluation; implement task orchestration, queue management, and resource allocation; resolve high-concurrency and multi-tenant platform challenges; establish monitoring, alerting, and audit trails for system stability.