Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments

Maor Ivgi, Yair Carmon, Jonathan Berant. Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022. pages 7354-7371, Association for Computational Linguistics, 2022. [doi]

@inproceedings{IvgiCB22,
  title = {Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments},
  author = {Maor Ivgi and Yair Carmon and Jonathan Berant},
  year = {2022},
  url = {https://aclanthology.org/2022.findings-emnlp.544},
  researchr = {https://researchr.org/publication/IvgiCB22},
  cites = {0},
  citedby = {0},
  pages = {7354-7371},
  booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022},
  editor = {Yoav Goldberg and Zornitsa Kozareva and Yue Zhang},
  publisher = {Association for Computational Linguistics},
}