Transformers discover an elementary calculation system exploiting local attention and grid-like problem representation

Samuel Cognolato, Alberto Testolin. Transformers discover an elementary calculation system exploiting local attention and grid-like problem representation. In International Joint Conference on Neural Networks, IJCNN 2022, Padua, Italy, July 18-23, 2022. pages 1-8, IEEE, 2022. [doi]

Abstract

Abstract is missing.