Method and system for processing data

Methods, computer systems, and computer program products for processing data a computing environment are provided. The computer environment for data deduplication storage receives a plurality of write operations for deduplication storage of the data. The data is buffered in a plurality of buffers wi...

Full description

Saved in:
Bibliographic Details
Main Authors Tzur, Itai, Akirav, Shay H, Edelstein, Ron, Hirsch, Michael, Ish-Shalom, Ariel J, Loya, Liran
Format Patent
LanguageEnglish
Published 11.12.2012
Online AccessGet full text

Cover

More Information
Summary:Methods, computer systems, and computer program products for processing data a computing environment are provided. The computer environment for data deduplication storage receives a plurality of write operations for deduplication storage of the data. The data is buffered in a plurality of buffers with overflow temporarily stored to a memory hierarchy when the data received for deduplication storage is sequential or non sequential. The data is accumulated and updated in the plurality of buffers per a data structure, the data structure serving as a fragment map between the plurality of buffers and a plurality of user file locations. The data is restructured in the plurality of buffers to form a complete sequence of a required sequence size. The data is provided as at least one stream to a stream-based deduplication algorithm for processing and storage.