Andy Zeng

Andy is a co-founder at Generalist. Before that, he was a research scientist and tech lead at Google DeepMind – and before that, a student at Princeton and UC Berkeley. Andy has worked on training large-scale robotics Foundation models, developing robots that write their own code, and inventing handheld data collection for robots. These days, he is interested in training large neural nets on massive amounts of robot data.


Andy Zeng is a co-founder at Generalist, where he leads a small team working on self-improving Foundation models for robots. He received his Bachelors in Computer Science and Mathematics at UC Berkeley, and his PhD in Computer Science at Princeton. He is interested in building algorithms that enable machines to intelligently interact with the world and improve themselves over time. Andy received Best Paper Awards from HRI '24, CoRL '23, ICRA '23, T-RO '20, RSS'19, and has been finalist for paper awards at RSS '23, CoRL '20 - '22, ICRA '20, RSS '19, IROS '18. He led machine learning as part of Team MIT-Princeton, winning 1st place (stow task) at the worldwide Amazon Picking Challenge '17. Andy is a recipient of the Princeton SEAS Award for Excellence, Japan Foundation Paper Award, NVIDIA Fellowship, and Gordon Y.S. Wu Fellowship in Engineering and Wu Prize. His work has been featured in the press, including the New York Times, BBC, and Wired.


X (Twitter) G. Scholar LinkedIn Github

andyzeng at generalistai dot com

2025

Out of stealth! co-founded Generalist to make general-purpose robots a reality

2024

IEEE Robotics and Automation (RAS) Early Career Award

2023

Conference on Robot Learning (CoRL) Best Student Paper Award
IEEE International Conference on Robotics and Automation (ICRA) Outstanding Learning Paper Award

2022

Google AI blog post "Robots That Write Their Own Code"
AXIOS article "Unleash All This Creativity: Google AI's Breathtaking Potential"
CNET video "Google’s Most Advanced Robot Brain Just Got a Body"

2020

IEEE Transactions on Robotics (T-RO) Best Paper Award

2019

New York Times article "A New Lab Full of Fast Learners"
For a more up-to-date list, visit my Google Scholar

PaLM-E: An Embodied Multimodal Language Model

Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence
International Conference on Machine Learning (ICML) 2023
WebpagePDFDemoGoogle AI Blog

Video Language Planning

Yilun Du, Mengjiao Yang, Pete Florence, Fei Xia, Ayzaan Wahid, Brian Ichter, Pierre Sermanet, Tianhe Yu, Pieter Abbeel, Joshua B. Tenenbaum, Leslie Kaelbling, Andy Zeng, Jonathan
Tompson
International Conference on Learning Representations (ICLR) 2024
WebpagePDFCode

Code as Policies: Language Model Programs for Embodied Control

Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, Andy Zeng
IEEE International Conference on Robotics and Automation (ICRA) 2023
★ Outstanding Learning Paper Award, ICRA ★
WebpagePDFCodeColabGoogle AI BlogTechCrunchAXIOS

Grasping in the Wild: Learning 6DoF Closed-Loop Grasping from Low-Cost Demonstrations

Shuran Song, Andy Zeng, Johnny Lee, Thomas Funkhouser
IEEE International Conference on Intelligent Robots and Systems (IROS) 2020
IEEE Robotics and Automation Letters (RA-L) 2020
WebpagePDF

TossingBot: Learning to Throw Arbitrary Objects with Residual Physics

Andy Zeng, Shuran Song, Johnny Lee, Alberto Rodriguez, Thomas Funkhouser
Robotics: Science and Systems (RSS) 2019
IEEE Transactions on Robotics (T-RO) 2020
★ Best Paper Award, T-RO & Best Systems Paper Award, RSS ★
WebpagePDFGoogle AI BlogNew York TimesIEEE Spectrum

Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matching

Andy Zeng, Shuran Song, Kuan-Ting Yu, Elliott Donlon, Francois R. Hogan, Maria Bauza, Daolin Ma, Orion Taylor, Melody Liu, Eudald Romo, Nima Fazeli, Ferran Alet, Nikhil Chavan Dafle, Rachel Holladay, Isabella Morona, Prem Qu Nair, Druck Green, Ian Taylor, Weber Liu, Thomas Funkhouser, Alberto Rodriguez
IEEE International Conference on Robotics and Automation (ICRA) 2018
The International Journal of Robotics Research (IJRR) 2019
★ 1st Place (Stow Task), Amazon Robotics Challenge 2017 ★
WebpagePDFCodeMIT NewsEngadget

Learning to Learn Faster from Human Feedback with Language Model Predictive Control

Jacky Liang, Fei Xia, Wenhao Yu, Andy Zeng, Montserrat Gonzalez Arenas, Maria Attarian, Maria Bauza, Matthew Bennice, Alex Bewley, Adil Dostmohamed, Chuyuan Kelly Fu, Nimrod Gileadi, Marissa Giustina, Keerthana Gopalakrishnan, Leonard Hasenclever, Jan Humplik, Jasmine Hsu, Nikhil Joshi, Ben Jyenis, Chase Kew, Sean Kirmani, Tsang-Wei Edward Lee, Kuang-Huei Lee, Assaf Hurwitz Michaely, Joss Moore, Ken Oslund, Dushyant Rao, Allen Ren, Baruch Tabanpour, Quan Vuong, Ayzaan Wahid, Ted Xiao, Ying Xu, Vincent Zhuang, Peng Xu, Erik Frey, Ken Caluwaerts, Tingnan Zhang, Brian Ichter, Jonathan Tompson, Leila Takayama, Vincent Vanhoucke, Izhak Shafran, Maja Mataric, Dorsa Sadigh, Nicolas Heess, Kanishka Rao, Nik Stewart, Jie Tan, Carolina Parada
Robotics: Science and Systems (RSS) 2024
WebpagePDFCode

Real-World Robot Applications of Foundation Models: A Review

Kento Kawaharazuka, Tatsuya Matsushima, Andrew Gambardella, Jiaxian Guo, Chris Paxton, Andy Zeng
Advanced Robotics (AR) 2024
PDF

Generative Expressive Robot Behaviors using Large Language Models

Karthik Mahadevan, Jonathan Chien, Noah Brown, Zhuo Xu, Carolina Parada, Fei Xia, Andy Zeng, Leila Takayama, Dorsa Sadigh
ACM/IEEE International Conference on Human Robot Interaction (HRI) 2024
★ Best Paper Award, HRI ★
WebpagePDF

Chain of Code: Reasoning with a Language Model-Augmented Code Emulator

Chengshu Li, Jacky Liang, Andy Zeng, Xinyun Chen, Karol Hausman, Dorsa Sadigh, Sergey Levine, Li Fei-Fei, Fei Xia, Brian Ichter
International Conference on Machine Learning (ICML) 2024
★ Oral Presentation, ICML ★
WebpagePDFCode

Video Language Planning

Yilun Du, Mengjiao Yang, Pete Florence, Fei Xia, Ayzaan Wahid, Brian Ichter, Pierre Sermanet, Tianhe Yu, Pieter Abbeel, Joshua B. Tenenbaum, Leslie Kaelbling, Andy Zeng, Jonathan Tompson
International Conference on Learning Representations (ICLR) 2024
WebpagePDFCode

Large Language Models as General Pattern Machines

Suvir Mirchandani, Fei Xia, Pete Florence, Brian Ichter, Danny Driess, Montserrat Gonzalez Arenas, Kanishka Rao, Dorsa Sadigh, Andy Zeng
Conference on Robot Learning (CoRL) 2023
WebpagePDFCode

Robots That Ask For Help: Uncertainty Alignment for Large Language Model Planners

Allen Z. Ren, Anushri Dixit, Alexandra Bodrova, Sumeet Singh, Stephen Tu, Noah Brown, Peng Xu, Leila Takayama, Fei Xia, Jake Varley, Zhenjia Xu, Dorsa Sadigh, Andy Zeng, Anirudha Majumdar
Conference on Robot Learning (CoRL) 2023
★ Oral Presentation, Best Student Paper Award, CoRL ★
WebpagePDFVideo

Language to Rewards for Robotic Skill Synthesis

Wenhao Yu, Nimrod Gileadi, Chuyuan Fu, Sean Kirmani, Kuang-Huei Lee, Montse Gonzalez Arenas, Hao-Tien Lewis Chiang, Tom Erez, Leonard Hasenclever, Jan Humplik, Brian Ichter, Ted Xiao, Peng Xu, Andy Zeng, Tingnan Zhang, Nicolas Heess, Dorsa Sadigh, Jie Tan, Yuval Tassa, Fei Xia
Conference on Robot Learning (CoRL) 2023
★ Oral Presentation, CoRL ★
WebpagePDFVideo

Rearrangement Planning for General Part Assembly

Yulong Li, Andy Zeng, Shuran Song
Conference on Robot Learning (CoRL) 2023
★ Oral Presentation, CoRL ★
WebpagePDFVideoCode

CALAMARI: Contact-Aware and Language conditioned spatial Action MApping for contact-RIch manipulation

Youngsun Wi, Mark Van der Merwe, Pete Florence, Andy Zeng, Nima Fazeli
Conference on Robot Learning (CoRL) 2023
PDF

TidyBot: Personalized Robot Assistance with Large Language Models

Jimmy Wu, Rika Antonova, Adam Kan, Marion Lepert, Andy Zeng, Shuran Song, Jeannette Bohg, Szymon Rusinkiewicz, Thomas Funkhouser
IEEE International Conference on Intelligent Robots and Systems (IROS) 2023
Autonomous Robots 2023
WebpagePDFCode

Modular Visual Question Answering via Code Generation

Sanjay Subramanian, Medhini Narasimhan, Kushal Khangaonkar, Kevin Yang, Arsha Nagrani, Cordelia Schmid, Andy Zeng, Trevor Darrell, Dan Klein
Association for Computational Linguistics (ACL) 2023
PDFCodeGoogle AI Blog

PaLM-E: An Embodied Multimodal Language Model

Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence
International Conference on Machine Learning (ICML) 2023
WebpagePDFDemoGoogle AI Blog

RoboPianist: A Benchmark for High-Dimensional Robot Control

Kevin Zakka, Laura Smith, Nimrod Gileadi, Taylor Howell, Xue Bin Peng, Sumeet Singh, Yuval Tassa, Pete Florence, Andy Zeng, Pieter Abbeel
Conference on Robot Learning (CoRL) 2023
WebpagePDFCodeColabDemo

Audio Visual Language Maps for Robot Navigation

Chenguang Huang, Oier Mees, Andy Zeng, Wolfram Burgard
International Symposium on Experimental Robotics (ISER) 2023
WebpagePDFColab

Grounded Decoding: Guiding Text Generation with Grounded Models for Robot Control

Wenlong Huang, Fei Xia, Dhruv Shah, Danny Driess, Andy Zeng, Yao Lu, Pete Florence, Igor Mordatch, Sergey Levine, Karol Hausman, Brian Ichter
Conference on Neural Information Processing Systems (NeurIPS) 2023
WebpagePDFVideo

Code as Policies: Language Model Programs for Embodied Control

Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, Andy Zeng
IEEE International Conference on Robotics and Automation (ICRA) 2023
★ Outstanding Learning Paper Award, ICRA ★
WebpagePDFCodeColabGoogle AI BlogTechCrunchAXIOS

Visual Language Maps for Robot Navigation

Chenguang Huang, Oier Mees, Andy Zeng, Wolfram Burgard
IEEE International Conference on Robotics and Automation (ICRA) 2023
WebpagePDFCodeGoogle AI Blog

Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language

Andy Zeng, Maria Attarian, Brian Ichter, Krzysztof Choromanski, Adrian Wong, Stefan Welker, Federico Tombari, Aveek Purohit, Michael Ryoo, Vikas Sindhwani, Johnny Lee, Vincent Vanhoucke, Pete Florence
International Conference on Learning Representations (ICLR) 2023
★ Oral Presentation, ICLR ★
WebpagePDFCode

MIRA: Mental Imagery for Robotic Affordances

Lin Yen-Chen, Pete Florence, Andy Zeng, Jonathan T. Barron, Yilun Du, Wei-Chiu Ma, Anthony Simeonov, Alberto Rodriguez Garcia, Phillip Isola
Conference on Robot Learning (CoRL) 2022
WebpagePDF

Inner Monologue: Embodied Reasoning through Planning with Language Models

Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, Pierre Sermanet, Noah Brown, Tomas Jackson, Linda Luu, Sergey Levine, Karol Hausman, Brian Ichter
Conference on Robot Learning (CoRL) 2022
WebpagePDF2 Minute Papers

VIRDO++: Real-World, Visuo-Tactile Dynamics and Perception of Deformable Objects

Youngsun Wi, Andy Zeng, Pete Florence, Nima Fazeli
Conference on Robot Learning (CoRL) 2022
WebpagePDF

Do As I Can, Not As I Say: Grounding Language in Robotic Affordances

Michael Ahn, Anthony Brohan, Noah Brown, Yevgen Chebotar, Omar Cortes, Byron David, Chelsea Finn, Chuyuan Fu, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Daniel Ho, Jasmine Hsu, Julian Ibarz, Brian Ichter, Alex Irpan, Eric Jang, Rosario Jauregui Ruano, Kyle Jeffrey, Sally Jesmonth, Nikhil J Joshi, Ryan Julian, Dmitry Kalashnikov, Yuheng Kuang, Kuang-Huei Lee, Sergey Levine, Yao Lu, Linda Luu, Carolina Parada, Peter Pastor, Jornell Quiambao, Kanishka Rao, Jarek Rettinghouse, Diego Reyes, Pierre Sermanet, Nicolas Sievers, Clayton Tan, Alexander Toshev, Vincent Vanhoucke, Fei Xia, Ted Xiao, Peng Xu, Sichun Xu, Mengyuan Yan, Andy Zeng
Conference on Robot Learning (CoRL) 2022
★ Oral Presentation, Special Innovation Award, CoRL ★
WebpagePDFCodeGoogle AI BlogWiredWashington PostCNET

Learning to Fold Real Garments with One Arm: A Case Study in Cloud-Based Robotics Research

Ryan Hoque, Kaushik Shivakumar, Shrey Aeron, Gabriel Deza, Aditya Ganapathi, Adrian Wong, Johnny Lee, Andy Zeng, Vincent Vanhoucke, Ken Goldberg
IEEE International Conference on Intelligent Robots and Systems (IROS) 2022
WebpagePDFCode

Algorithms and Systems for Manipulating Multiple Objects

Zherong Pan, Andy Zeng, Yunzhu Li, Jingjin Yu, Kris Hauser
IEEE Transactions on Robotics (T-RO) 2022
PDF

Learning Pneumatic Non-Prehensile Manipulation with a Mobile Blower

Jimmy Wu, Xingyuan Sun, Andy Zeng, Shuran Song, Szymon Rusinkiewicz, Thomas Funkhouser
IEEE International Conference on Intelligent Robots and Systems (IROS) 2022
IEEE Robotics and Automation Letters (RA-L) 2022
WebpagePDFCode

Multiscale Sensor Fusion and Continuous Control with Neural CDEs

Sumeet Singh, Francis McCann Ramirez, Jacob Varley, Andy Zeng, Vikas Sindhwani
IEEE International Conference on Intelligent Robots and Systems (IROS) 2022
PDF

Implicit Kinematic Policies: Unifying Joint and Cartesian Action Spaces in End-to-End Robot Learning

Aditya Ganapathi, Pete Florence, Jake Varley, Kaylee Burns, Ken Goldberg, Andy Zeng
IEEE International Conference on Robotics and Automation (ICRA) 2022
WebpagePDF

VIRDO: Visio-Tactile Implicit Representations of Deformable Objects

Youngsun Wi, Pete Florence, Andy Zeng, Nima Fazeli
IEEE International Conference on Robotics and Automation (ICRA) 2022
PDFCode

Multi-Task Learning with Sequence-Conditioned Transporter Networks

Michael H. Lim, Andy Zeng, Brian Ichter, Maryam Bandari, Erwin Coumans, Claire Tomlin, Stefan Schaal, Aleksandra Faust
IEEE International Conference on Robotics and Automation (ICRA) 2022
PDF

Hybrid Random Features

Krzysztof Choromanski, Haoxian Chen, Han Lin, Yuanzhe Ma, Arijit Sehanobish, Deepali Jain, Michael S Ryoo, Jake Varley, Andy Zeng, Valerii Likhosherstov, Dmitry Kalashnikov, Vikas Sindhwani, Adrian Weller
The International Conference on Learning Representations (ICLR) 2022
PDF

Implicit Behavioral Cloning

Pete Florence, Corey Lynch, Andy Zeng, Oscar Ramirez, Ayzaan Wahid, Laura Downs, Adrian Wong, Johnny Lee, Igor Mordatch, Jonathan Tompson
Conference on Robot Learning (CoRL) 2021
WebpagePDFCodeGoogle AI Blog

XIRL: Cross-Embodiment Inverse Reinforcement Learning

Kevin Zakka, Andy Zeng, Pete Florence, Jonathan Tompson, Jeannette Bohg, Debidatta Dwibedi
Conference on Robot Learning (CoRL) 2021
★ Best Paper Award Finalist, CoRL ★
WebpagePDFCodeBenchmarkGoogle AI Blog

Spatial Intention Maps for Multi-Agent Mobile Manipulation

Jimmy Wu, Xingyuan Sun, Andy Zeng, Shuran Song, Szymon Rusinkiewicz, Thomas Funkhouser
IEEE International Conference on Robotics and Automation (ICRA) 2021
WebpagePDFCodePrinceton News

Learning to Rearrange Deformable Cables, Fabrics, and Bags with Goal-Conditioned Transporter Networks

Daniel Seita, Pete Florence, Jonathan Tompson, Erwin Coumans, Vikas Sindhwani, Ken Goldberg, Andy Zeng
IEEE International Conference on Robotics and Automation (ICRA) 2021
WebpagePDFCodeGoogle AI Blog

Transporter Networks: Rearranging the Visual World for Robotic Manipulation

Andy Zeng, Pete Florence, Jonathan Tompson, Stefan Welker, Jonathan Chien, Maria Attarian, Travis Armstrong, Ivan Krasin, Dan Duong, Vikas Sindhwani, Johnny Lee
Conference on Robot Learning (CoRL) 2020
★ Plenary Talk, Best Paper Presentation Award Finalist, CoRL ★
WebpagePDFCodeGoogle AI BlogVentureBeat

Spatial Action Maps for Mobile Manipulation

Jimmy Wu, Xingyuan Sun, Andy Zeng, Shuran Song, Johnny Lee, Szymon Rusinkiewicz, Thomas Funkhouser
Robotics: Science and Systems (RSS) 2020
WebpagePDFCodePrinceton News

Grasping in the Wild: Learning 6DoF Closed-Loop Grasping from Low-Cost Demonstrations

Shuran Song, Andy Zeng, Johnny Lee, Thomas Funkhouser
IEEE International Conference on Intelligent Robots and Systems (IROS) 2020
IEEE Robotics and Automation Letters (RA-L) 2020
WebpagePDF

Form2Fit: Learning Shape Priors for Generalizable Assembly from Disassembly

Kevin Zakka, Andy Zeng, Johnny Lee, Shuran Song
IEEE International Conference on Robotics and Automation (ICRA) 2020
★ Best Paper in Automation Award Finalist, ICRA ★
WebpagePDFCodeGoogle AI BlogVentureBeat2 Minute Papers

ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulation

Shreeyak Sajjan, Matthew Moore, Mike Pan, Ganesh Nagaraja, Johnny Lee, Andy Zeng, Shuran Song
IEEE International Conference on Robotics and Automation (ICRA) 2020
WebpagePDFCodeDatasetGoogle AI BlogVentureBeat

Learning to See before Learning to Act: Visual Pre-training for Manipulation

Lin Yen-Chen, Andy Zeng, Shuran Song, Phillip Isola, Tsung-Yi Lin
IEEE International Conference on Robotics and Automation (ICRA) 2020
WebpagePDFCodeGoogle AI BlogVentureBeat

TossingBot: Learning to Throw Arbitrary Objects with Residual Physics

Andy Zeng, Shuran Song, Johnny Lee, Alberto Rodriguez, Thomas Funkhouser
Robotics: Science and Systems (RSS) 2019
IEEE Transactions on Robotics (T-RO) 2020
Featured on the front page of The New York Times Business!
★ King-Sun Fu Memorial Best Paper Award, T-RO ★
★ Best Systems Paper Award, RSS ★
★ Best Student Paper Award Finalist, RSS ★
WebpagePDFGoogle AI BlogNew York TimesIEEE Spectrum

DensePhysNet: Learning Dense Physical Object Representations via Multi-step Dynamic Interactions

Zhenjia Xu, Jiajun Wu, Andy Zeng, Joshua B. Tenenbaum, Shuran Song
Robotics: Science and Systems (RSS) 2019
WebpagePDFCode

Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learning

Andy Zeng, Shuran Song, Stefan Welker, Johnny Lee, Alberto Rodriguez, Thomas Funkhouser
IEEE International Conference on Intelligent Robots and Systems (IROS) 2018
★ Best Cognitive Robotics Paper Award Finalist, IROS ★
WebpagePDFCode2 Minute Papers

What are the Important Technologies for Bin Picking? Technology Analysis of Robots in Competitions Based on a Set of Performance Metrics

Masahiro Fujita, Yukiyasu Domae, Akio Noda, Gustavo Alfonso Garcia Ricardez, Tatsuya Nagatani, Andy Zeng, Shuran Song, Alberto Rodriguez, Albert Causo, I-Ming Chen, Tsukasa Ogasawara
Advanced Robotics (Journal) 2019
★ Japan Factory Automation (FA) Foundation Paper Award ★
WebpagePDF

Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matching

Andy Zeng, Shuran Song, Kuan-Ting Yu, Elliott Donlon, Francois R. Hogan, Maria Bauza, Daolin Ma, Orion Taylor, Melody Liu, Eudald Romo, Nima Fazeli, Ferran Alet, Nikhil Chavan Dafle, Rachel Holladay, Isabella Morona, Prem Qu Nair, Druck Green, Ian Taylor, Weber Liu, Thomas Funkhouser, Alberto Rodriguez
IEEE International Conference on Robotics and Automation (ICRA) 2018
The International Journal of Robotics Research (IJRR) 2019
★ Best Systems Paper Award, Amazon Robotics ★
★ 1st Place (Stow Task), Amazon Robotics Challenge 2017 ★
WebpagePDFCodeJournal (IJRR)MIT NewsEngadget

Im2Pano3D: Extrapolating 360° Structure and Semantics Beyond the Field of View

Shuran Song, Andy Zeng, Angel X. Chang, Manolis Savva, Silvio Savarese, Thomas Funkhouser
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018
★ Oral Presentation, CVPR ★
WebpagePDF

Matterport3D: Learning from RGB-D Data in Indoor Environments

Angel Chang, Angela Dai, Thomas Funkhouser, Maciej Halber, Matthias Nießner, Manolis Savva, Shuran Song, Andy Zeng, Yinda Zhang
IEEE International Conference on 3D Vision (3DV) 2017
WebpagePDFCodeMatterport Blog

3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions

Andy Zeng, Shuran Song, Matthias Nießner, Matthew Fisher, Jianxiong Xiao, Thomas Funkhouser
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017
★ Oral Presentation, CVPR ★
WebpagePDFCodeTalk2 Minute Papers

Semantic Scene Completion from a Single Depth Image

Shuran Song, Fisher Yu, Andy Zeng, Angel X. Chang, Manolis Savva, Thomas Funkhouser
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017
★ Oral Presentation, CVPR ★
WebpagePDFSUNCG DatasetCodeTalk2 Minute Papers

Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challenge

Andy Zeng, Kuan-Ting Yu, Shuran Song, Daniel Suo, Ed Walker Jr., Alberto Rodriguez, Jianxiong Xiao
IEEE International Conference on Robotics and Automation (ICRA) 2017
★ 3rd Place, Amazon Robotics Challenge 2016 ★
WebpagePDFShelf & Tote DatasetCode

2024

UIUC CSL Student Conference

2023

EMNLP Workshop on RoboNLP
Cornell Robotics Seminar
MILA Robot Learning Seminar
UPenn GRASP SFI Seminar
RSS Workshop on Symmetries in Robot Learning (video)
RSS Workshop on Generalizable Manipulation Policy Learning: Paradigms and Debates
CVPR Workshop on 3D Scene Understanding for Vision, Graphics, and Robotics
ICRA Workshop on Embracing Contact: Making Robots Physically Interact with our World
ICRA Round-Table Discussion with Science Robotics
ICRA Workshop on Life-Long Learning with Human Help
Panel on Northwestern Grand Challenges in Robotics (video)
Guest Lecture at Columbia COMS 4733: Computational Aspects of Robotics
Stanford Vision and Learning Lab

2022

CoRL Workshop on Language and Robot Learning (video)
NeurIPS Workshop on Robot Learning (video)
NeurIPS Workshop on Habitat Rearrangement Challenge
Guest Lecture at Columbia IEOR E6617: Machine Learning and High-Dimensional Data
Princeton Robotics Seminar
RSS Workshop on Implicit Representations (video)
CVPR Tutorial on Vision-Based Robot Learning
MIT CSL Seminar (video)
Guest Lecture at Columbia COMS 4733: Computational Aspects of Robotics

2021

CVPR Workshop on 3D Vision and Robotics
Guest Lecture at Stony Brook University CSE525: Introduction to Robotics
Guest Lecture at NYU CSCI-UA 74: Big Ideas in Artificial Intelligence

2020

RSS Workshop on Self-Supervised Robot Learning
RSS Workshop on Robotics Retrospectives (video)

2019

Amazon Research Robotics Symposium

2018

RE·WORK Deep Learning for Robotics Summit
Guest Lecture at NCTU Robotics Seminar: Robotic Manipulation

2025

Advanced Robotics (AR) Best Survey Paper Award

2024

IEEE Robotics and Automation (RAS) Early Career Award
Human-Robot Interaction (HRI) Best Paper Award (Technical Track)
IEEE International Conference on Intelligent Robots and Systems (IROS) RoboCup Best Paper Award

2023

Conference on Robot Learning (CoRL) Best Student Paper Award
Associate Editor, IEEE Robotics and Automation Letters (RA-L)
Robotics: Science and Systems (RSS) Best Demo Paper Award Finalist
Google AI blog post "Modular Visual Question Answering via Code Generation"
Demo, Robotics: Science and Systems (RSS) - Large Language Models on Robots (memories)
Co-Organizer, RSS Workshop on Articulate Robots
IEEE International Conference on Robotics and Automation (ICRA) Outstanding Learning Paper Award
Associate Editor, IEEE International Conference on Robotics and Automation (ICRA)
Demo, Google I/O - Code as Policies with PaLI and PaLM 2 (memories)
Google AI blog post "Visual Language Maps for Robot Navigation"
Co-Organizer, AAAI Tutorial on Everything You Need to Know about Transformers
Google Research PaLM-E debut - "An Embodied Multimodal Language Model" (20+ derived YouTube videos)
Google AI blog post "PaLM-E: An Embodied Multimodal Language Model"

2022

Conference on Robot Learning (CoRL) Special Innovation Award
Area Chair, Conference on Robot Learning (CoRL)
Co-Organizer, CoRL Workshop on Pre-training Robot Learning
Co-Organizer, CoRL Workshop on Inductive Bias in Robot Learning
Google AI blog post "Robots That Write Their Own Code"
Google AI@ Event Code as Policies debut (memories) - AXIOS, TechCrunch, ZDNet (60+ articles)
Session Chair, Robotics: Science and Systems (RSS)
Co-Organizer, 2nd RSS Workshop on Scaling Robot Learning
Sponsor, Google Research Scholar Program
Co-Organizer, CVPR Tutorial on Vision-Based Robot Learning
Session Chair, IEEE International Conference on Robotics and Automation (ICRA)
Co-Organizer, ICRA Workshop on Scaling Robot Learning
AXIOS article "Unleash All This Creativity: Google AI's Breathtaking Potential"
CNET video "Google’s Most Advanced Robot Brain Just Got a Body"
Google Research PaLM-SayCan debut - Wired, Washington Post, The Verge (260+ articles)
Google AI blog post "Robot See, Robot Do"
Princeton News article "In Picking Up Trash, Robots Pick Up New Approaches to Work"

2021

Conference on Robot Learning (CoRL) Best Paper Award Finalist
Google AI blog post "Decisiveness in Imitation Learning for Robots"
Session Chair, IEEE International Conference on Robotics and Automation (ICRA)
Co-Organizer, RSS Workshop on Advancing AI and Manipulation for Robotics
Area Chair, Conference on Robot Learning (CoRL)
Google AI blog post "Learning to Manipulate Deformable Objects"
Sponsor, Google Research Scholar Program
Japan Factory Automation (FA) Foundation Paper Award
Google AI blog post "Rearranging the Visual World"

2020

IEEE Transactions on Robotics (T-RO) Best Paper Award
Conference on Robot Learning (CoRL) Best Paper Presentation Award Finalist
Google AI blog post "Visual Transfer Learning for Robotic Manipulation"
IEEE International Conference on Robotics and Automation (ICRA) Best Paper in Automation Award Finalist
Google AI blog post "Learning to See Transparent Objects"
Mentor, Google CS Research Mentorship Program
Sponsor, Google Faculty Research Awards

2019

New York Times article "A New Lab Full of Fast Learners" (100+ articles)
Google AI blog post "Learning to Assemble and to Generalize"
Robotics: Science and Systems (RSS) Best System Paper Award
Google AI blog post "Unifying Physics and Deep Learning with TossingBot"

2018

Honored to be a recipient of the Princeton SEAS Award for Excellence
Demo, Google TGIF - TossingBot (memories)
IEEE International Conference on Intelligent Robots and Systems (IROS) Best Cognitive Paper Award Finalist
Amazon Robotics Best System Paper Award
Honored to be a recipient of the NVIDIA Fellowship
MIT News article "Robo-Picker Grasps and Packs"

2017

1st place winners (stow) at the worldwide Amazon Picking Challenge 2017 with Team MIT-Princeton

2016

3rd place winners at the worldwide Amazon Picking Challenge 2016 with Team MIT-Princeton
Co-Organizer, CVPR Workshop on 3D Deep Learning

2015

Honored to be a recipient of the Gordon Y.S. Wu Fellowship in Engineering and Wu Prize

2015+

Reviewer, T-RO, RSS, CoRL, IJRR, RA-L, ICRA, NeurIPS, CVPR, IROS, ECCV, ICCV
Reviewer, SIGGRAPH, PR Journal, Eurographics, TMM, TIP, CASE, TCSVT
Member, IEEE

AltStyle によって変換されたページ (->オリジナル) /