New energy meteorological data management method and system

The invention provides a new energy meteorological data management method and system. The method comprises the steps of obtaining meteorological data; storing the acquired meteorological data on a node of a large-scale parallel processing system MPP; and establishing a meteorological data query tabl...

Full description

Saved in:
Bibliographic Details
Main Authors LIU ZHENJING, LIU PENG, DENG CHUNYU, CHE JIANFENG, WANG XIAORONG, WU ZIWEI, LIU HUASHE
Format Patent
LanguageChinese
English
Published 16.07.2019
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
MEASURING
METEOROLOGY
PHYSICS
TESTING
Online AccessGet full text

Cover

More Information
Summary:The invention provides a new energy meteorological data management method and system. The method comprises the steps of obtaining meteorological data; storing the acquired meteorological data on a node of a large-scale parallel processing system MPP; and establishing a meteorological data query table for the node. According to the technical scheme provided by the invention, the distributed storagecapacity of the MPP is utilized to support measurement data of tens of PB-level meteorological bureau; massive time sequence big data can be efficiently stored and rapidly processed; based on hash storage on a Shared nothing architecture of Hash in an MPP library and MPP parallel processing capability, the intelligent index and column type storage capability in a single node are brought into playto the maximum extent, and the scanning speed of big table data is greatly increased. 本发明提供了一种新能源气象数据管理方法及系统，包括：获取气象数据；将所述获取的气象数据存储在大规模并行处理系统MPP的节点上；建立针对所述节点的气象数据查询表。本发明提供的技术方案利用MPP的分布式存储能力，支撑数十PB级气象局量测数据；可以高效存储和快速处理海量时序大数据；基
Bibliography:Application Number: CN201711353102