Deepak Narayanan, Keshav Santhanam, Peter Henderson 0002, Rishi Bommasani, Tony Lee, Percy Liang. Cheaply Estimating Inference Efficiency Metrics for Autoregressive Transformer Models. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]
Abstract is missing.