Backend Engineer, ARK Large Model Platform (Singapore)
Core
Developing the Ark Large Model Platform on Volcano Engine to reduce IT costs for large model applications across various industries.
Role type
Senior IC backend engineer (large model platform)
Builds
Cloud-native machine learning infrastructure, large model inference services, and specialized utility programs.
Domain
Cloud computing, distributed systems, large language models (LLM), and machine learning infrastructure.
Deliverable
production ML models | infrastructure | product features
Required skills
distributed systems under Linux, Golang/Python/C/C++/Java/Scala/Javascript, technical design, software testing and validation, hardware-software integration
Preferred skills
ACM ICPC/Codeforces experience, LLM application development (fine-tuning, inference, deployment), Kubernetes operator development, micro-service architecture, Terraform
Technologies
VolcanoEngine, Kubernetes, Terraform, LangChain, Llama, Falcon, miniGPT4
Responsibilities
Research and design systematic solutions for large model implementations, develop computer and network software, analyze user needs and develop software solutions, update and enhance existing software capabilities, integrate hardware and software systems
Seniority
Senior, hands-on IC