金融科技-Agent架构设计与推理性能优化工程师
Core
Design and optimize Agent harness architecture and LLM inference performance for financial technology applications.
Role type
Senior IC machine-learning engineer (Agent & Inference Optimization)
Builds
Custom Agent tools, sandbox environments, and optimized inference clusters for business functions.
Domain
Financial Technology + Large Language Models
Deliverable
production ML models
Required skills
Agent framework design, LLM inference optimization, tool integration, cluster scheduling, context engineering
Preferred skills
GPU inference adaptation, cost optimization, open-source contributions
Technologies
vLLM, sglang
Responsibilities
Design Agent harness and platform development; Optimize Agent efficiency via metrics and trajectory analysis; Improve inference performance through caching and cluster scheduling; Integrate Agent frameworks with evaluation systems; Explore and implement cutting-edge Agent technologies.