Scheduling resource management method and system based on batch processing program analysis

The invention discloses a scheduling resource management method and system based on batch processing program analysis, and relates to the related field of big data processing.The method comprises the steps that according to batch processing scheduling job information, SQL execution statements of bat...

Full description

Saved in:
Bibliographic Details
Main Authors WENG SHIQING, CHEN WENBAI, CHEN SHOUDANG
Format Patent
LanguageChinese
English
Published 29.11.2022
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:The invention discloses a scheduling resource management method and system based on batch processing program analysis, and relates to the related field of big data processing.The method comprises the steps that according to batch processing scheduling job information, SQL execution statements of batch processing programs are output; inputting the SQL execution statement into a statement analysis module to obtain statement analysis information; obtaining logic resource information and hardware resource information according to the statement analysis information; performing resource prediction by taking the logic resource information and the hardware resource information as input information to obtain a predicted resource total amount; and comparing a preset total resource amount with the predicted total resource amount, judging whether an execution condition is met or not, and if so, executing the SQL execution statement. The technical problems that effective resource load analysis cannot be carried out, the d
Bibliography:Application Number: CN202211189933