Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in Transformers

Philip Kenneweg, Alexander Schulz 0001, Sarah Schröder, Barbara Hammer. Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in Transformers. In Hujun Yin, David Camacho, Peter Tiño, editors, Intelligent Data Engineering and Automated Learning - IDEAL 2022 - 23rd International Conference, IDEAL 2022, Manchester, UK, November 24-26, 2022, Proceedings. Volume 13756 of Lecture Notes in Computer Science, pages 252-261, Springer, 2022. [doi]

@inproceedings{KennewegSSH22,
  title = {Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in Transformers},
  author = {Philip Kenneweg and Alexander Schulz 0001 and Sarah Schröder and Barbara Hammer},
  year = {2022},
  doi = {10.1007/978-3-031-21753-1_25},
  url = {https://doi.org/10.1007/978-3-031-21753-1_25},
  researchr = {https://researchr.org/publication/KennewegSSH22},
  cites = {0},
  citedby = {0},
  pages = {252-261},
  booktitle = {Intelligent Data Engineering and Automated Learning - IDEAL 2022 - 23rd International Conference, IDEAL 2022, Manchester, UK, November 24-26, 2022, Proceedings},
  editor = {Hujun Yin and David Camacho and Peter Tiño},
  volume = {13756},
  series = {Lecture Notes in Computer Science},
  publisher = {Springer},
  isbn = {978-3-031-21753-1},
}