Research on Compression Storage of Massive Agricultural Data Based on Cloud Environment

With the development of information technology, agriculture data show large amount of data, distributed, heterogeneous characteristics. It is difficult to access and management with the massive data are continuously increasing which affect the large-scale use of agricultural information data. In thi...

Full description

Saved in:
Bibliographic Details
Published inApplied Mechanics and Materials Vol. 441; pp. 1025 - 1029
Main Authors Wu, Hua Rui, Gao, Rong Hua
Format Journal Article
LanguageEnglish
Published Zurich Trans Tech Publications Ltd 01.12.2013
Subjects
Cloud Storage
Compression Storage
Huffman Tree
Massive Data
Online AccessGet full text

Cover

More Information
Summary:With the development of information technology, agriculture data show large amount of data, distributed, heterogeneous characteristics. It is difficult to access and management with the massive data are continuously increasing which affect the large-scale use of agricultural information data. In this paper, the method of compression algorithm is proposed which based on real-time and time space correlation characteristics. All data is divided into several categories by Huffman compression algorithm combines parallel processing cloud platform. Then, the massive agricultural data is compressed and reducing the data storage. Exprienment result show that cloud storage platform with dynamic scalability. Under the same experimental data, the method of this paper has higher compress ratio, and compression consuming less when a larger amount data, compared with the Huffman compress and dictionary-based data compression algorithm.
Bibliography:Selected, peer reviewed papers from the 2013 3rd International Conference on Machinery Electronics and Control Engineering (ICMECE 2013), November 29-30, 2013, Jinan, Shandong, China
ISBN:9783037859032
3037859032
ISSN:1660-9336
1662-7482
1662-7482
DOI:10.4028/www.scientific.net/AMM.441.1025