Research Intern: Multimodal Sensor Foundation Models
Core
Develop foundation models for multimodal sensing to understand physical environments, recognize events, and transfer knowledge across tasks and systems.
Role type
Research intern (PhD student)
Builds
Research methods and prototypes for sensor fusion and representation learning
Domain
AI, signal processing, cyber-physical systems, robotics
Deliverable
research
Required skills
deep learning, Python, PyTorch/TensorFlow, multimodal learning, time-series modeling, computer vision, sensor data analysis
Preferred skills
foundation models, self-supervised learning, contrastive learning, masked modeling, generative modeling, raw sensor data handling, signal processing, domain adaptation, few-shot learning, edge AI
Technologies
PyTorch, TensorFlow, radar, acoustic, vibration, image, lidar, Wi-Fi, inertial sensors
Responsibilities
Design, train, and evaluate foundation models for heterogeneous sensor data; Investigate self-supervised and multimodal representation learning; Develop methods for sensor fusion and adaptation; Evaluate models on scene understanding, activity recognition, and anomaly detection; Explore robustness to missing modalities and noisy measurements; Collaborate on prototyping and communicate findings via reports or publications
Seniority
Intern (PhD student)