On the Effect of (Near) Duplicate Subwords in Language Modelling

Anton Schäfer, Thomas Hofmann, Imanol Schlag, Tiago Pimentel. On the Effect of (Near) Duplicate Subwords in Language Modelling. In Lun-Wei Ku, Andre Martins, Vivek Srikumar, editors, Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11-16, 2024. pages 9580-9597, Association for Computational Linguistics, 2024. [doi]

Abstract

Abstract is missing.