A Descent Generalized RMIL Spectral Gradient Algorithm for Optimization Problems

• Published in: International journal of applied mathematics and computer science Vol. 34; no. 2; pp. 225 - 233
• Main Authors: Sulaiman, Ibrahim M., Kaelo, P., Khalid, Ruzelan, Nawawi, Mohd Kamal M.
• Format: Journal Article
• Language: English
• Published: Sciendo 01.06.2024
• Subjects: global convergence; line search strategy; optimization models; spectral CG algorithm
• ISSN: 1641-876X; 2083-8492
• DOI: 10.61822/amcs-2024-0016

This study develops a new conjugate gradient (CG) search direction that incorporates a well defined spectral parameter while the step size is required to satisfy the famous strong Wolfe line search (SWP) strategy. The proposed spectral direction is derived based on a recent method available in the literature, and satisfies the sufficient descent condition irrespective of the line search strategy and without imposing any restrictions or conditions. The global convergence results of the new formula are established using the assumption that the gradient of the defined smooth function is Lipschitz continuous. To illustrate the computational efficiency of the new direction, the study presents two sets of experiments on a number of benchmark functions. The first experiment is performed by setting uniform SWP parameter values for all the algorithms considered for comparison. For the second experiment, the study evaluates the performance of all the algorithms by considering the exact SWP parameter values used for the numerical experiments as reported in each work. The idea of these experiments is to study the influence of parameters in the computational efficiency of various CG algorithms. The results obtained demonstrate the effect of the parameter value on the robustness of the algorithms.