RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control

Brianna Zitkovich, Tianhe Yu, Sichun Xu, Peng Xu, Ted Xiao, Fei Xia, Jialin Wu, Paul Wohlhart, Stefan Welker, Ayzaan Wahid, Quan Vuong, Vincent Vanhoucke, Huong T. Tran, Radu Soricut, Anikait Singh, Jaspiar Singh, Pierre Sermanet, Pannag R. Sanketi, Grecia Salazar, Michael S. Ryoo, Krista Reymann, Kanishka Rao, Karl Pertsch, Igor Mordatch, Henryk Michalewski, Yao Lu 0006, Sergey Levine, Lisa Lee, Tsang-Wei Edward Lee, Isabel Leal, Yuheng Kuang, Dmitry Kalashnikov, Ryan Julian, Nikhil J. Joshi, Alex Irpan, Brian Ichter, Jasmine Hsu, Alexander Herzog, Karol Hausman, Keerthana Gopalakrishnan, Chuyuan Fu, Pete Florence, Chelsea Finn, Kumar Avinava Dubey, Danny Driess, Tianli Ding, Krzysztof Marcin Choromanski, Xi Chen 0071, Yevgen Chebotar, Justice Carbajal, Noah Brown, Anthony Brohan, Montserrat Gonzalez Arenas, Kehang Han. RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control. In Jie Tan, Marc Toussaint, Kourosh Darvish, editors, Conference on Robot Learning, CoRL 2023, 6-9 November 2023, Atlanta, GA, USA. Volume 229 of Proceedings of Machine Learning Research, pages 2165-2183, PMLR, 2023. [doi]

Authors

Brianna Zitkovich

This author has not been identified. Look up 'Brianna Zitkovich' in Google

Tianhe Yu

This author has not been identified. Look up 'Tianhe Yu' in Google

Sichun Xu

This author has not been identified. Look up 'Sichun Xu' in Google

Peng Xu

This author has not been identified. Look up 'Peng Xu' in Google

Ted Xiao

This author has not been identified. Look up 'Ted Xiao' in Google

Fei Xia

This author has not been identified. Look up 'Fei Xia' in Google

Jialin Wu

This author has not been identified. Look up 'Jialin Wu' in Google

Paul Wohlhart

This author has not been identified. Look up 'Paul Wohlhart' in Google

Stefan Welker

This author has not been identified. Look up 'Stefan Welker' in Google

Ayzaan Wahid

This author has not been identified. Look up 'Ayzaan Wahid' in Google

Quan Vuong

This author has not been identified. Look up 'Quan Vuong' in Google

Vincent Vanhoucke

This author has not been identified. Look up 'Vincent Vanhoucke' in Google

Huong T. Tran

This author has not been identified. Look up 'Huong T. Tran' in Google

Radu Soricut

This author has not been identified. Look up 'Radu Soricut' in Google

Anikait Singh

This author has not been identified. Look up 'Anikait Singh' in Google

Jaspiar Singh

This author has not been identified. Look up 'Jaspiar Singh' in Google

Pierre Sermanet

This author has not been identified. Look up 'Pierre Sermanet' in Google

Pannag R. Sanketi

This author has not been identified. Look up 'Pannag R. Sanketi' in Google

Grecia Salazar

This author has not been identified. Look up 'Grecia Salazar' in Google

Michael S. Ryoo

This author has not been identified. Look up 'Michael S. Ryoo' in Google

Krista Reymann

This author has not been identified. Look up 'Krista Reymann' in Google

Kanishka Rao

This author has not been identified. Look up 'Kanishka Rao' in Google

Karl Pertsch

This author has not been identified. Look up 'Karl Pertsch' in Google

Igor Mordatch

This author has not been identified. Look up 'Igor Mordatch' in Google

Henryk Michalewski

This author has not been identified. Look up 'Henryk Michalewski' in Google

Yao Lu 0006

This author has not been identified. Look up 'Yao Lu 0006' in Google

Sergey Levine

This author has not been identified. Look up 'Sergey Levine' in Google

Lisa Lee

This author has not been identified. Look up 'Lisa Lee' in Google

Tsang-Wei Edward Lee

This author has not been identified. Look up 'Tsang-Wei Edward Lee' in Google

Isabel Leal

This author has not been identified. Look up 'Isabel Leal' in Google

Yuheng Kuang

This author has not been identified. Look up 'Yuheng Kuang' in Google

Dmitry Kalashnikov

This author has not been identified. Look up 'Dmitry Kalashnikov' in Google

Ryan Julian

This author has not been identified. Look up 'Ryan Julian' in Google

Nikhil J. Joshi

This author has not been identified. Look up 'Nikhil J. Joshi' in Google

Alex Irpan

This author has not been identified. Look up 'Alex Irpan' in Google

Brian Ichter

This author has not been identified. Look up 'Brian Ichter' in Google

Jasmine Hsu

This author has not been identified. Look up 'Jasmine Hsu' in Google

Alexander Herzog

This author has not been identified. Look up 'Alexander Herzog' in Google

Karol Hausman

This author has not been identified. Look up 'Karol Hausman' in Google

Keerthana Gopalakrishnan

This author has not been identified. Look up 'Keerthana Gopalakrishnan' in Google

Chuyuan Fu

This author has not been identified. Look up 'Chuyuan Fu' in Google

Pete Florence

This author has not been identified. Look up 'Pete Florence' in Google

Chelsea Finn

This author has not been identified. Look up 'Chelsea Finn' in Google

Kumar Avinava Dubey

This author has not been identified. Look up 'Kumar Avinava Dubey' in Google

Danny Driess

This author has not been identified. Look up 'Danny Driess' in Google

Tianli Ding

This author has not been identified. Look up 'Tianli Ding' in Google

Krzysztof Marcin Choromanski

This author has not been identified. Look up 'Krzysztof Marcin Choromanski' in Google

Xi Chen 0071

This author has not been identified. Look up 'Xi Chen 0071' in Google

Yevgen Chebotar

This author has not been identified. Look up 'Yevgen Chebotar' in Google

Justice Carbajal

This author has not been identified. Look up 'Justice Carbajal' in Google

Noah Brown

This author has not been identified. Look up 'Noah Brown' in Google

Anthony Brohan

This author has not been identified. Look up 'Anthony Brohan' in Google

Montserrat Gonzalez Arenas

This author has not been identified. Look up 'Montserrat Gonzalez Arenas' in Google

Kehang Han

This author has not been identified. Look up 'Kehang Han' in Google