Controllable Video Generation Researcher
Core
Design and research multimodal controllable video generation frameworks for game characters and environments, supporting inputs like keyboard, controller, trajectory, and voice.
Role type
Senior IC research scientist (controllable video generation)
Builds
High-fidelity controllable video generation models for multiplayer collaborative control in games
Domain
Gaming + Generative AI (Video Generation)
Deliverable
production ML models
Required skills
conditional generation models, diffusion models, trajectory control, camera control, motion control, posture control, Python, PyTorch
Preferred skills
Game AI, game development, real-time/interactive video generation
Technologies
PyTorch, diffusion models
Responsibilities
Design multimodal generation frameworks supporting various inputs; Research high-fidelity generation under sparse control signals; Achieve decoupling and combination of trajectory, camera, motion, and posture controls; Develop video generation capabilities for multi-player collaborative control; Collaborate with Engine/Agent teams to define standardized interfaces; Drive joint optimization with Reinforcement Learning post-training
Seniority
Senior, hands-on IC