Method and apparatus for block level data de-duplication

Techniques for performing de-duplication for data blocks in a computer storage environment. At least one chunking/hashing unit receives input data from a source and processes it to output data blocks and content addresses for them. In one aspect, the chunking/hashing unit outputs all blocks without...

Full description

Saved in:
Bibliographic Details
Main Authors Healey, Michael W, Dunbar, J. Michael, Kallat, Avinash, Fishman, Michael Craig
Format Patent
LanguageEnglish
Published 12.06.2012
Online AccessGet full text

Cover

More Information
Summary:Techniques for performing de-duplication for data blocks in a computer storage environment. At least one chunking/hashing unit receives input data from a source and processes it to output data blocks and content addresses for them. In one aspect, the chunking/hashing unit outputs all blocks without checking to see whether any is a duplicate of a block previously stored on the storage environment. In another aspect, each data block is processed by one of a plurality of distributed object addressable storage (OAS) devices that each is selected to process data blocks having content addresses with a particular range. The OAS devices determine whether each received data block is a duplicate of another previously stored on the computer storage environment, and when it is not, stores the data block.