Towards Learning Universal Hyperparameter Optimizers with Transformers

Yutian Chen, Xingyou Song, Chansoo Lee, Zi Wang, Richard Zhang 0003, David Dohan, Kazuya Kawakami, Greg Kochanski, Arnaud Doucet, Marc'Aurelio Ranzato, Sagi Perel, Nando de Freitas. Towards Learning Universal Hyperparameter Optimizers with Transformers. In Sanmi Koyejo, S. Mohamed, A. Agarwal, Danielle Belgrave, K. Cho, A. Oh, editors, Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022. 2022. [doi]

@inproceedings{ChenSLW0DKKDRPF22,
  title = {Towards Learning Universal Hyperparameter Optimizers with Transformers},
  author = {Yutian Chen and Xingyou Song and Chansoo Lee and Zi Wang and Richard Zhang 0003 and David Dohan and Kazuya Kawakami and Greg Kochanski and Arnaud Doucet and Marc'Aurelio Ranzato and Sagi Perel and Nando de Freitas},
  year = {2022},
  url = {http://papers.nips.cc/paper_files/paper/2022/hash/cf6501108fced72ee5c47e2151c4e153-Abstract-Conference.html},
  researchr = {https://researchr.org/publication/ChenSLW0DKKDRPF22},
  cites = {0},
  citedby = {0},
  booktitle = {Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022},
  editor = {Sanmi Koyejo and S. Mohamed and A. Agarwal and Danielle Belgrave and K. Cho and A. Oh},
  isbn = {9781713871088},
}