Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in Transformers

Philip Kenneweg, Alexander Schulz 0001, Sarah Schröder, Barbara Hammer. Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in Transformers. In Hujun Yin, David Camacho, Peter Tiño, editors, Intelligent Data Engineering and Automated Learning - IDEAL 2022 - 23rd International Conference, IDEAL 2022, Manchester, UK, November 24-26, 2022, Proceedings. Volume 13756 of Lecture Notes in Computer Science, pages 252-261, Springer, 2022. [doi]

Abstract

Abstract is missing.