WORKFLOW OPTIMIZATION

• Main Authors: Winston, Joseph Blake, Walker, Clifton Brent, Senften, Scott David, Srinivasan, Nagaraj, Pinho, Romulo D, Wang, Xi, Maximo, Andre, Yeleshwarapu, Chandra, Ciarlini, Angelo, Rangarajan, Keshava, Dev, Ashwani, Holmes, David, Dias, Jonas F, Pacheco, Edward, Gottin, Vinicius
• Format: Patent
• Language: English
• Published: 15.07.2024
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

A computer implemented method, computer program product, and system for managing execution of a workflow comprising a set of subworkflows, comprising optimizing the set of subworkflows using a deep neural network, wherein each subworkflow of the set of subworkflows has a set of tasks, wherein each task of the sets of tasks has a requirement of resources of a set of resources; wherein each task of the sets of tasks is enabled to be dependent on another task of the sets of tasks, training the deep neural network by: executing the set of subworkflows, collecting provenance data from the execution, and collecting monitoring data that represents the state of said set of resources, wherein the training causes the neural network to learn relationships between the states of said set of resources, the said sets of tasks, their parameters and the obtained performance, optimizing an allocation of resources of the set of resources to each task of the sets of tasks to ensure compliance with a user-defined quality metric based on the deep neural network output.