Princeton Symposium on Safe Deployment of Foundation Models in Robotics

Talks, poster sessions and Panel discussion
Monday, November 4, 2024

   TALKS      ARTICLE    POSTERS

Foundation models such as large language models (LLMs) and vision-language models (VLMs) have showcased remarkable capabilities in areas like commonsense reasoning, planning, and physical understanding. These advancements have paved the way for applying such models in robotics, enabling them to perceive their environment, generate and evaluate potential plans, and even command low-level actions. However, the integration of foundation models in robotics also raises significant challenges, particularly around ensuring the safety and alignment of robotic systems given the black-box nature of these models. This symposium brings together leading experts from both academia and industry to explore the opportunities and challenges of safely incorporating foundation models into robotic systems

Program

8:00 am8:45 am
8:45 am9:00 am
Opening Remarks
Speakers
Sanjeev Arora
Director of Princeton Language and Intelligence, Charles C. Fitzmorris Professor of Computer Science
Anirudha Majumdar
Associate Professor of Mechanical & Aerospace Engineering
9:00 am9:45 am
Common Sense, Asimov and the Semantics of Safety in the era of Embodied Foundation Models
Speakers
Vincent Vanhoucke
Distinguished Engineer, Waymo, Former Head of Robotics, Google DeepMind
9:50 am10:35 am
Interactive LLM-Based Robotics Planning and Decision-Making
Speakers
Chuchu Fan
Assistant Professor in the Department of Aeronautics and Astronautics (AeroAstro) and Laboratory for Information and Decision Systems (LIDS), MIT
10:40 am11:25 pm
Yann LeCun
Speakers
Yann Lecun
Chief AI Scientist, Meta, Silver Professor of Computer Science, New York University
11:30 am1:30 pm
1:30 pm2:30 pm
2:35 pm3:20 pm
Data Pyramid and Data Flywheel for Robotic Foundation Models
Speakers
Yuke Zhu
Assistant Professor in Computer Science, UT Austin, Senior Research Scientist, NVIDIA
3:20 pm3:40 pm
3:40 pm4:25 pm
Towards Uncertainty-Aware Large Behavior Models (LBMs)
Speakers
Masha Itkina
Research Scientist, Toyota Research Institute
4:30 pm5:15 pm
Simulation: A Bridge to Embodied Intelligence
Speakers
Roozbeh Mottaghi
Senior AI Research Scientist Manager, META Fundamental AI Research, Affiliate Associate Professor, University of Washington