Induction Heads as an Essential Mechanism for Pattern Matching in In-context Learning

Joy Crosbie, Ekaterina Shutova. Induction Heads as an Essential Mechanism for Pattern Matching in In-context Learning. In Luis Chiruzzo, Alan Ritter, Lu Wang, editors, Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, New Mexico, USA, April 29 - May 4, 2025. pages 5034-5096, Association for Computational Linguistics, 2025. [doi]

Abstract

Abstract is missing.