APPARATUS AND METHOD FOR TRAINING MODEL FOR DOCUMENT SUMMARIZATION

An apparatus for training a document summarization model includes a token generation unit, a named entity recognition unit, and a model training unit. The token generation unit generates document tokens and summarization tokens. The named entity recognition unit assigns named entity token status to...

Full description

Saved in:
Bibliographic Details
Main Authors KIM, Ju-Dong, CHOI, Hyun-Jin, LEE, Hyun-Jae, HWANG, Bong-Kyu, YUN, Jae-Woong
Format Patent
LanguageEnglish
Published 01.12.2022
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:An apparatus for training a document summarization model includes a token generation unit, a named entity recognition unit, and a model training unit. The token generation unit generates document tokens and summarization tokens. The named entity recognition unit assigns named entity token status to a summarization token, recognized as a named entity through NER, and assigns non-named entity token status to the other tokens. The model training unit obtains feature vectors by inputting the plurality of document tokens into an encoder inside a document summarization model, obtains a first loss related to the named entity token, a second loss related to the other tokens, and a total loss using a weighted value by inputting the feature vectors, the summarization tokens, the named entity token, and the non-named entity token into a decoder inside the document summarization model, and trains the document summarization model on the basis of the total loss.
Bibliography:Application Number: US202217828400