Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in Transformers

Philip Kenneweg, Alexander Schulz 0001, Sarah Schröder, Barbara Hammer. Intelligent Learning Rate Distribution to Reduce Catastrophic Forgetting in Transformers. In Hujun Yin, David Camacho, Peter Tiño, editors, Intelligent Data Engineering and Automated Learning - IDEAL 2022 - 23rd International Conference, IDEAL 2022, Manchester, UK, November 24-26, 2022, Proceedings. Volume 13756 of Lecture Notes in Computer Science, pages 252-261, Springer, 2022. [doi]

Authors

Philip Kenneweg

This author has not been identified. Look up 'Philip Kenneweg' in Google

Alexander Schulz 0001

This author has not been identified. Look up 'Alexander Schulz 0001' in Google

Sarah Schröder

This author has not been identified. Look up 'Sarah Schröder' in Google

Barbara Hammer

This author has not been identified. Look up 'Barbara Hammer' in Google