Scaling Vision Transformers to 22 Billion Parameters - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Mostafa Dehghani 0001, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang 0038, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov 0003, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah J. Harmsen, Neil Houlsby. Scaling Vision Transformers to 22 Billion Parameters. In Andreas Krause 0001, Emma Brunskill, KyungHyun Cho, Barbara Engelhardt, Sivan Sabato, Jonathan Scarlett, editors, International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA. Volume 202 of Proceedings of Machine Learning Research, pages 7480-7512, PMLR, 2023. [doi]

This author has not been identified. Look up 'Mostafa Dehghani 0001' in GoogleThis author has not been identified. Look up 'Josip Djolonga' in GoogleThis author has not been identified. Look up 'Basil Mustafa' in GoogleThis author has not been identified. Look up 'Piotr Padlewski' in GoogleThis author has not been identified. Look up 'Jonathan Heek' in GoogleThis author has not been identified. Look up 'Justin Gilmer' in GoogleThis author has not been identified. Look up 'Andreas Peter Steiner' in GoogleThis author has not been identified. Look up 'Mathilde Caron' in GoogleThis author has not been identified. Look up 'Robert Geirhos' in GoogleThis author has not been identified. Look up 'Ibrahim Alabdulmohsin' in GoogleThis author has not been identified. Look up 'Rodolphe Jenatton' in GoogleThis author has not been identified. Look up 'Lucas Beyer' in GoogleThis author has not been identified. Look up 'Michael Tschannen' in GoogleThis author has not been identified. Look up 'Anurag Arnab' in GoogleThis author has not been identified. Look up 'Xiao Wang 0038' in GoogleThis author has not been identified. Look up 'Carlos Riquelme Ruiz' in GoogleThis author has not been identified. Look up 'Matthias Minderer' in GoogleThis author has not been identified. Look up 'Joan Puigcerver' in GoogleThis author has not been identified. Look up 'Utku Evci' in GoogleThis author has not been identified. Look up 'Manoj Kumar' in GoogleThis author has not been identified. Look up 'Sjoerd van Steenkiste' in GoogleThis author has not been identified. Look up 'Gamaleldin Fathy Elsayed' in GoogleThis author has not been identified. Look up 'Aravindh Mahendran' in GoogleThis author has not been identified. Look up 'Fisher Yu' in GoogleThis author has not been identified. Look up 'Avital Oliver' in GoogleThis author has not been identified. Look up 'Fantine Huot' in GoogleThis author has not been identified. Look up 'Jasmijn Bastings' in GoogleThis author has not been identified. Look up 'Mark Collier' in GoogleThis author has not been identified. Look up 'Alexey A. Gritsenko' in GoogleThis author has not been identified. Look up 'Vighnesh Birodkar' in GoogleThis author has not been identified. Look up 'Cristina Nader Vasconcelos' in GoogleThis author has not been identified. Look up 'Yi Tay' in GoogleThis author has not been identified. Look up 'Thomas Mensink' in GoogleThis author has not been identified. Look up 'Alexander Kolesnikov 0003' in GoogleThis author has not been identified. Look up 'Filip Pavetic' in GoogleThis author has not been identified. Look up 'Dustin Tran' in GoogleThis author has not been identified. Look up 'Thomas Kipf' in GoogleThis author has not been identified. Look up 'Mario Lucic' in GoogleThis author has not been identified. Look up 'Xiaohua Zhai' in GoogleThis author has not been identified. Look up 'Daniel Keysers' in GoogleThis author has not been identified. Look up 'Jeremiah J. Harmsen' in GoogleThis author has not been identified. Look up 'Neil Houlsby' in Google

runs on WebDSL