An Empirical Analysis and Resource Footprint Study of Deploying Large Language Models on Edge Devices

Nobel Dhar, Bobin Deng, Dan C. Lo, Xiaofeng Wu, Liang Zhao, Kun Suo. An Empirical Analysis and Resource Footprint Study of Deploying Large Language Models on Edge Devices. In Proceedings of the 2024 ACM Southeast Conference, ACM SE 2024, Marietta, GA, USA, April 18-20, 2024. pages 69-76, ACM, 2024. [doi]

Abstract

Abstract is missing.