Data deduplication method and equipment

The invention aims to provide a data deduplication method and equipment, and the method comprises the steps: obtaining all historical data generated before a current date, corresponding historical occurrence time, a first data type and a first user to which the data belongs, and carrying out the ded...

Full description

Saved in:
Bibliographic Details
Main Author DUAN WENGUO
Format Patent
LanguageChinese
English
Published 23.11.2021
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:The invention aims to provide a data deduplication method and equipment, and the method comprises the steps: obtaining all historical data generated before a current date, corresponding historical occurrence time, a first data type and a first user to which the data belongs, and carrying out the deduplication processing of all historical data, so as to obtain at least one piece of historical non-duplicate data; obtaining all newly-added data generated in the current date, and performing de-duplication processing on all the newly-added data to obtain at least one piece of newly-added non-duplicate data, corresponding current occurrence time and a second user to which the newly-added non-duplicate data belong; and carrying out full association operation on the at least one piece of historical non-duplicate data and the at least one piece of newly-added non-duplicate data, and obtaining at least two pieces of comprehensive non-duplicate data ending the current date and the latest time corresponding to the compre
Bibliography:Application Number: CN202110645059