Break the Sequential Dependency of LLM Inference Using Lookahead Decoding - researchr publication

researchr

You are not signed in
Sign in
Sign up

Yichao Fu, Peter Bailis, Ion Stoica, Hao Zhang 0108. Break the Sequential Dependency of LLM Inference Using Lookahead Decoding. In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net, 2024. [doi]

Abstract is missing.

runs on WebDSL