Continual Learning with Dual Regularizations

• Published in: Machine Learning and Knowledge Discovery in Databases. Research Track Vol. 12975; pp. 619 - 634
• Main Authors: Han, Xuejun, Guo, Yuhong
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2021; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Continual learning; Functional regularization; Representation regularization
• ISBN: 3030864855; 9783030864859
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-86486-6_38

Continual learning (CL) has received a great amount of attention in recent years and a multitude of continual learning approaches arose. In this paper, we propose a continual learning approach with dual regularizations to alleviate the well-known issue of catastrophic forgetting in a challenging continual learning scenario – domain incremental learning. We reserve a buffer of past examples, dubbed memory set, to retain some information about previous tasks. The key idea is to regularize the learned representation space as well as the model outputs by utilizing the memory set based on interleaving the memory examples into the current training process. We verify our approach on four CL dataset benchmarks. Our experimental results demonstrate that the proposed approach is consistently superior to the compared methods on all benchmarks, especially in the case of small buffer size.