On the Way to Lossless Compression of Language Transformers: Exploring Cross-Domain Properties of Quantization

Nikita Martynov, Aleksei Goncharov, Gleb Kumichev, Evgeniy Egorov, Stanislav Vladimirovich Pavlov, Mikhail Sergeevich Durinov, Aleksandr Sergeevich Zuev, Egor Anatolievich Filimonov. On the Way to Lossless Compression of Language Transformers: Exploring Cross-Domain Properties of Quantization. In Nicoletta Calzolari, Min-Yen Kan, Véronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue, editors, Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC/COLING 2024, 20-25 May, 2024, Torino, Italy. pages 12435-12442, ELRA and ICCL, 2024. [doi]

Abstract

Abstract is missing.