PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Branden Butler, Sixing Yu, Arya Mazaheri, Ali Jannesari. PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis, SC 2024, Atlanta, GA, USA, November 17-22, 2024. pages 40, IEEE, 2024. [doi]

This author has not been identified. Look up 'Branden Butler' in GoogleThis author has not been identified. Look up 'Sixing Yu' in GoogleThis author has not been identified. Look up 'Arya Mazaheri' in GoogleThis author has not been identified. Look up 'Ali Jannesari' in Google

runs on WebDSL