Data processing method and device
The invention provides a data processing method and device. In the application, input data is processed based on a data processing network to obtain intermediate data, fixed attention features output by an attention network are obtained, and the fixed attention features are obtained after at least u...
Saved in:
Main Authors | , , , |
---|---|
Format | Patent |
Language | Chinese English |
Published |
24.08.2021
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | The invention provides a data processing method and device. In the application, input data is processed based on a data processing network to obtain intermediate data, fixed attention features output by an attention network are obtained, and the fixed attention features are obtained after at least using an initialized attention feature training model. The attention weights included in the initialized attention features are not all the same, intermediate data are processed according to the fixed attention features based on a data aggregation network in the model to obtain output data, and the fixed attention network is not connected with any input before, that is, the attention features output by the attention network are irrelevant to the input data. The fixed attention features can not only enable more important parameters in the model to play a greater role, improve the accuracy of the model and position the importance of the parameters, but also facilitate further compression of the model, and in addition, |
---|---|
Bibliography: | Application Number: CN202110212564 |