How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench

Qinyuan Ye, Harvey Yiyun Fu, Xiang Ren, Robin Jia. How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023. pages 7493-7517, Association for Computational Linguistics, 2023. [doi]

@inproceedings{YeFRJ23,
  title = {How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench},
  author = {Qinyuan Ye and Harvey Yiyun Fu and Xiang Ren and Robin Jia},
  year = {2023},
  url = {https://aclanthology.org/2023.findings-emnlp.503},
  researchr = {https://researchr.org/publication/YeFRJ23},
  cites = {0},
  citedby = {0},
  pages = {7493-7517},
  booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023},
  editor = {Houda Bouamor and Juan Pino 0001 and Kalika Bali},
  publisher = {Association for Computational Linguistics},
  isbn = {979-8-89176-061-5},
}