LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation

Tianyu Liu, Qitan Lv, Hao Li, Xing Gao, Xiao Sun, Xiaoyan Sun. LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation. In Maria Liakata, Viviane P. Moreira, Jiajun Zhang 0001, David Jurgens, editors, Findings of the Association for Computational Linguistics, ACL 2026, San Diego, California, United States, July 2-7, 2026. pages 33070-33092, Association for Computational Linguistics, 2026. [doi]

References

No references recorded for this publication.

Cited by

No citations of this publication recorded.