METHOD FOR PERFORMING CONTINUAL LEARNING USING REPRESENTATION LEARNING AND APPARATUS THEREOF

The present disclosure relates to a continual learning technology using machine learning, and a method for performing continual learning by a learning apparatus includes generating a teacher network and a student network from a pre-trained model using knowledge distillation, generating a representat...

Full description

Saved in:
Bibliographic Details
Main Authors TARIQ, Shahroz, KIM, Minha, WOO, Simon Sungil
Format Patent
LanguageEnglish
Published 06.07.2023
Subjects
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:The present disclosure relates to a continual learning technology using machine learning, and a method for performing continual learning by a learning apparatus includes generating a teacher network and a student network from a pre-trained model using knowledge distillation, generating a representation memory configured of a plurality of storages as many as the number of classes to store feature representation values in the teacher network and the student network, extracting the feature representation value for target data through the teacher network and storing the feature representation value in the storage before learning is entered, entering the learning to extract the feature representation value for the target data through the student network and storing the feature representation value in the storage, and calculating a representation loss using values derived from the storage of the teacher network and the storage of the student network.
Bibliography:Application Number: US202318092590