Sumformer: Universal Approximation for Efficient Transformers

Silas Alberti, Niclas Dern, Laura Thesing, Gitta Kutyniok. Sumformer: Universal Approximation for Efficient Transformers. In Timothy Doster, Tegan Emerson, Henry Kvinge, Nina Miolane, Mathilde Papillon, Bastian Rieck, Sophia Sanborn, editors, Topological, Algebraic and Geometric Learning Workshops 2023, 28 July 2023, Honolulu, HI, USA. Volume 221 of Proceedings of Machine Learning Research, pages 72-86, PMLR, 2023. [doi]

Authors

Silas Alberti

This author has not been identified. Look up 'Silas Alberti' in Google

Niclas Dern

This author has not been identified. Look up 'Niclas Dern' in Google

Laura Thesing

This author has not been identified. Look up 'Laura Thesing' in Google

Gitta Kutyniok

This author has not been identified. Look up 'Gitta Kutyniok' in Google