Metadata acquisition method and device for distributed file system

The invention provides a metadata collection method and device for a distributed file system, and the method comprises the steps: obtaining configuration information which comprises a to-be-collected host of the distributed file system; according to the configuration information, sequentially carryi...

Full description

Saved in:
Bibliographic Details
Main Authors HE YUWEI, GU JINGLING, QI XIANGDONG, WU YUNKUN, ZOU PINLUOWEI, XIONG PAN, SHAO RUI, XING YUNFEI, DENG YATING, HE ANDI, XU BIAO, JIANG YONG, YANG XIAOXIA, FENG ZHONGTIAN
Format Patent
LanguageChinese
English
Published 10.05.2022
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:The invention provides a metadata collection method and device for a distributed file system, and the method comprises the steps: obtaining configuration information which comprises a to-be-collected host of the distributed file system; according to the configuration information, sequentially carrying out operations including directory collection, file collection and storage space collection on a host of the distributed file system; and acquiring data volume and metadata information based on an operation result acquired by the operations of directory acquisition, file acquisition and storage space acquisition. According to the method, the position corresponding to the metadata of the to-be-collected data is determined by configuring some information in advance, and then the metadata of the to-be-collected data is acquired according to the position information, so that a method for providing basis information for data management is provided, and HDFS data can be conveniently managed and controlled. 本发明提供一种用于分布
Bibliography:Application Number: CN202111664135