LightToken: A Task and Model-agnostic Lightweight Token Embedding Framework for Pre-trained Language Models

Haoyu Wang, Ruirui Li 0002, Haoming Jiang, Zhengyang Wang, Xianfeng Tang, Bin Bi, Monica Xiao Cheng, Bing Yin, Yaqing Wang, Tuo Zhao, Jing Gao 0004. LightToken: A Task and Model-agnostic Lightweight Token Embedding Framework for Pre-trained Language Models. In Ambuj Singh, Yizhou Sun, Leman Akoglu, Dimitrios Gunopulos, Xifeng Yan, Ravi Kumar 0001, Fatma Ozcan, Jieping Ye, editors, Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2023, Long Beach, CA, USA, August 6-10, 2023. pages 2302-2313, ACM, 2023. [doi]

Abstract

Abstract is missing.