General-purpose, long-context autoregressive modeling with Perceiver AR

Curtis Hawthorne, Andrew Jaegle, Catalina Cangea, Sebastian Borgeaud, Charlie Nash, Mateusz Malinowski, Sander Dieleman, Oriol Vinyals, Matthew M. Botvinick, Ian Simon, Hannah Sheahan, Neil Zeghidour, Jean-Baptiste Alayrac, João Carreira, Jesse H. Engel. General-purpose, long-context autoregressive modeling with Perceiver AR. In Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvári, Gang Niu 0001, Sivan Sabato, editors, International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA. Volume 162 of Proceedings of Machine Learning Research, pages 8535-8558, PMLR, 2022. [doi]

Authors

Curtis Hawthorne

This author has not been identified. Look up 'Curtis Hawthorne' in Google

Andrew Jaegle

This author has not been identified. Look up 'Andrew Jaegle' in Google

Catalina Cangea

This author has not been identified. Look up 'Catalina Cangea' in Google

Sebastian Borgeaud

This author has not been identified. Look up 'Sebastian Borgeaud' in Google

Charlie Nash

This author has not been identified. Look up 'Charlie Nash' in Google

Mateusz Malinowski

This author has not been identified. Look up 'Mateusz Malinowski' in Google

Sander Dieleman

This author has not been identified. Look up 'Sander Dieleman' in Google

Oriol Vinyals

This author has not been identified. Look up 'Oriol Vinyals' in Google

Matthew M. Botvinick

This author has not been identified. Look up 'Matthew M. Botvinick' in Google

Ian Simon

This author has not been identified. Look up 'Ian Simon' in Google

Hannah Sheahan

This author has not been identified. Look up 'Hannah Sheahan' in Google

Neil Zeghidour

This author has not been identified. Look up 'Neil Zeghidour' in Google

Jean-Baptiste Alayrac

This author has not been identified. Look up 'Jean-Baptiste Alayrac' in Google

João Carreira

This author has not been identified. Look up 'João Carreira' in Google

Jesse H. Engel

This author has not been identified. Look up 'Jesse H. Engel' in Google