Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments

Maor Ivgi, Yair Carmon, Jonathan Berant. Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022. pages 7354-7371, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.