EdgeTP: Enabling Distributed Full-size Large Language Model Inference on Edge Devices with Tensor Parallelism

Laizhong Cui, Yi Guo, Weixuan Peng, Yaodong Huang. EdgeTP: Enabling Distributed Full-size Large Language Model Inference on Edge Devices with Tensor Parallelism. In 46th IEEE International Conference on Distributed Computing Systems, ICDCS 2026, Seoul, Republic of Korea, June 22-25, 2026. pages 1378-1388, IEEE, 2026. [doi]

Abstract

Abstract is missing.