Log collection method and system of distributed system

• Main Authors: ZHANG TAO, WANG XUN, AI RUFEI, LI ZHENGGAO, WU BIN
• Format: Patent
• Language: Chinese; English
• Published: 01.07.2022
• Subjects: ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION

The invention provides a log collection method and system for a distributed system, and relates to the technical field of log processing, and the method comprises the steps: collecting events of all servers of the distributed system, integrating log frames, and carrying out the extension and classification of the log frames based on a preset basic library, so as to generate log information; asynchronously writing the log information into a log message queue, and storing the log information; executing a multi-thread consumption task under the log message queue; when the consumption task is abnormal, whether a prompt is sent out is judged according to a preset reminding rule; if yes, writing into a message reminding queue for sending to a development end for reminding; when a consumption task is normal, the log information is synchronously stored in Elasticsearch in batches, and the log information is searched and analyzed by adopting Kibana, so that the problems of low collection efficiency and high cost due t