METHOD FOR PERFORMING CONTINUAL LEARNING USING REPRESENTATION LEARNING AND APPARATUS THEREOF
The present disclosure relates to a continual learning technology using machine learning, and a method for performing continual learning by a learning apparatus includes generating a teacher network and a student network from a pre-trained model using knowledge distillation, generating a representat...
Saved in:
Main Authors | , , |
---|---|
Format | Patent |
Language | English |
Published |
06.07.2023
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | The present disclosure relates to a continual learning technology using machine learning, and a method for performing continual learning by a learning apparatus includes generating a teacher network and a student network from a pre-trained model using knowledge distillation, generating a representation memory configured of a plurality of storages as many as the number of classes to store feature representation values in the teacher network and the student network, extracting the feature representation value for target data through the teacher network and storing the feature representation value in the storage before learning is entered, entering the learning to extract the feature representation value for the target data through the student network and storing the feature representation value in the storage, and calculating a representation loss using values derived from the storage of the teacher network and the storage of the student network. |
---|---|
Bibliography: | Application Number: US202318092590 |