Multi-step spectral gradient methods with modified weak secant relation for large scale unconstrained optimization

Hong Seng Sim; Wah June Leong; Chuei Yee Chen; Siti Nur Iqmal Ibrahim

doi:10.3934/naco.2018024

Article Contents

2018, Volume 8, Issue 3: 377-387. Doi: 10.3934/naco.2018024

This issue Previous Article Differential evolution with improved sub-route reversal repair mechanism for multiobjective urban transit routing problem Next Article

Multi-step spectral gradient methods with modified weak secant relation for large scale unconstrained optimization

1.
Department of Mathematical and Actuarial Sciences, Lee Kong Chian Faculty of Engineering and Science, Universiti Tunku Abdul Rahman, Sungai Long Campus, Jalan Sungai Long 9, Bandar Sungai Long, 43000 Kajang, Selangor, Malaysia
2.
Department of Mathematics, Faculty of Science, Universiti Putra Malaysia, 43400 Serdang, Selangor, Malaysia
3.
Institute for Mathematical Research, Universiti Putra Malaysia, 43400 Serdang, Selangor, Malaysia

* Corresponding author: Hong Seng Sim
* Corresponding author: Hong Seng Sim

Received: May 2017

Revised: March 2018

Published: June 2018

The first author is supported by Yayasan Sultan Iskandar Johor 2014

Abstract Full Text(HTML) Figure(3) Related Papers Cited by

Abstract

In this paper, we aim to propose some spectral gradient methods via variational technique under log-determinant norm. The spectral parameters satisfy the modified weak secant relations that inspired by the multistep approximation for solving large scale unconstrained optimization. An executable code is developed to test the efficiency of the proposed method with spectral gradient method using standard weak secant relation as constraint. Numerical results are presented which suggest a better performance has been achieved.

Keywords:

Mathematics Subject Classification: Primary: 65K10, 93B40; Secondary: 90C06.

Citation:

FullText(HTML)

Figure 1. Performance Profiling for the Modified Multiple Spectral Gradient Methods and Standard Multiple Spectral Gradient Method in terms of Number of Iterations.

Download: Full-size image PowerPoint slide

Figure 2. Performance Profiling for the Modified Multiple Spectral Gradient Methods and Standard Multiple Spectral Gradient Method in terms of Number of Function Calls.

Download: Full-size image PowerPoint slide

Figure 3. Performance Profiling for the Modified Multiple Spectral Gradient Methods and Standard Multiple Spectral Gradient Method in terms of CPU Time.

Download: Full-size image PowerPoint slide

Related Papers

Cited by

References

	N. Andrei , An unconstrained optimization test functions collection, Advanced Modeling and Optimization, 10 (2008) , 147-161.
	J. Barzilai and J. Borwein , Two-point step size gradient methods, IMA Journal of Numerical Analysis, 8 (1988) , 141-148. doi: 10.1093/imanum/8.1.141.
	I. Bongartz , A. R. Conn , N. I. M. Gould and Ph. L. Toint , CUTE: constrained and unconstrained testing environment, ACM Transactions on Mathematical Software, 21 (1995) , 123-160. doi: 10.1145/200979.201043.
	R. H. Byrd and J. Nocedal , A tool for the analysis of quasi-Newton methods with application to unconstrained minimization, SIAM J. Numer. Anal., 26 (1989) , 727-739. doi: 10.1137/0726042.
	J. E. Dennis and H. Wolkowicz , Sizing and least change secant methods, SIAM Journal on Numerical Analysis, 30 (1993) , 1291-1313. doi: 10.1137/0730067.
	J. A. Ford and I. A. Moghrabi , Multi-step quasi-Newton methods for optimization, Journal of Computational and Applied Mathematics, 50 (1994) , 305-323. doi: 10.1016/0377-0427(94)90309-3.
	W. La Cruz , J. Martinez and M. Raydan , Spectral residual method without gradient information for solving large-scale nonlinear systems of equations, Math. Comput., 75 (2006) , 1449-1466. doi: 10.1090/S0025-5718-06-01840-0.
	W. La Cruz and M. Raydan , Nonmonotone spectral methods for large-scale nonlinear systems, Optim. Methods Softw., 18 (2003) , 583-599. doi: 10.1080/10556780310001610493.
	D. C. Liu and J. Nocedal , On the limited memory BFGS method for large scale optimization, Mathematical Programming, 45 (1989) , 503-528. doi: 10.1007/BF01589116.
	M. Raydan , The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem, SIAM Journal of Optimization, 7 (1997) , 26-33. doi: 10.1137/S1052623494266365.
	M. Zhu , J. L. Nazareth and H. Wolkowicz , The quasi-Cauchy relation and diagonal updating, SIAM Journal on Optimization, 4 (1999) , 1192-1204. doi: 10.1137/S1052623498331793.