A log storage method and system for a marine big data cluster

The invention discloses a log storage method and system for a marine big data cluster. The method comprises the steps of obtaining a local log associated with a marine big data cluster, and acquiringthe key data through analysis, wherein the key data comprises the server running state and the resour...

Full description

Saved in:
Bibliographic Details
Main Authors WEI ZHIQIANG, YANG YONGQUAN, XING BIAO
Format Patent
LanguageChinese
English
Published 14.06.2019
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:The invention discloses a log storage method and system for a marine big data cluster. The method comprises the steps of obtaining a local log associated with a marine big data cluster, and acquiringthe key data through analysis, wherein the key data comprises the server running state and the resource use condition, the server current task execution condition, the server historical task executioncondition and the alarm information text or number; analyzing each log in the local logs to determine the storage type of each log; setting a deletion deadline for each deletion type log, and deleting the logs which still meet the deletion condition when the deletion deadline expires; setting a compression processing period, compressing each compressed log in the log storage system when the running time of the log storage system reaches the compression processing period, and moving the compressed logs into a historical storage area of the log storage system; receiving a query request for a log, and determining the typ
Bibliography:Application Number: CN201910032045