A Partition Cover Approach to Tokenization

Jia Peng Lim, Shawn Tan, Davin Choo, Hady W. Lauw. A Partition Cover Approach to Tokenization. In Danielle Belgrave, Cheng Zhang 0005, Laura N. Montoya, Hsuan-Tien Lin, Razvan Pascanu, Piotr Koniusz, Marzyeh Ghassemi, Nancy Chen, Iván Vladimir Meza Ruíz, Arturo Loaiza-Bonilla, editors, Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, NeurIPS 2025, San Diago, CA, USA, December 2-7, 2025 / Mexico City, Mexico, November 30 - December 5, 2025. 2025. [doi]

Authors

Jia Peng Lim

This author has not been identified. Look up 'Jia Peng Lim' in Google

Shawn Tan

This author has not been identified. Look up 'Shawn Tan' in Google

Davin Choo

This author has not been identified. Look up 'Davin Choo' in Google

Hady W. Lauw

This author has not been identified. Look up 'Hady W. Lauw' in Google