# American Institute of Mathematical Sciences

2007, 2007(Special): 721-730. doi: 10.3934/proc.2007.2007.721

## Global convergence of a memory gradient method with closed-form step size formula

 1 UAE University, Department of Matematical Sciences, P.O. Box 17551, Al-Ain, United Arab Emirates

Received  September 2006 Revised  June 2007 Published  September 2007

The memory gradient method is used to solve large scale unconstrained optimization problems. We investigate a closed-form step size formula given by a finite number of iterates ofWeiszfeld’s algorithm to compute the step size for a memory gradient method. This formula can be classified as a no-line search procedure since no stopping criteria is involved to ensure convergence, unlike the classical line search procedures. We show the global convergence of the memory gradient method, under weaker conditions.
Citation: Nora Merabet. Global convergence of a memory gradient method with closed-form step size formula. Conference Publications, 2007, 2007 (Special) : 721-730. doi: 10.3934/proc.2007.2007.721
 [1] Sigve Hovda. Closed-form expression for the inverse of a class of tridiagonal matrices. Numerical Algebra, Control and Optimization, 2016, 6 (4) : 437-445. doi: 10.3934/naco.2016019 [2] Jacinto Marabel Romo. A closed-form solution for outperformance options with stochastic correlation and stochastic volatility. Journal of Industrial and Management Optimization, 2015, 11 (4) : 1185-1209. doi: 10.3934/jimo.2015.11.1185 [3] Azam Chaudhry, Rehana Naz. Closed-form solutions for the Lucas-Uzawa growth model with logarithmic utility preferences via the partial Hamiltonian approach. Discrete and Continuous Dynamical Systems - S, 2018, 11 (4) : 643-654. doi: 10.3934/dcdss.2018039 [4] Yigui Ou, Yuanwen Liu. A memory gradient method based on the nonmonotone technique. Journal of Industrial and Management Optimization, 2017, 13 (2) : 857-872. doi: 10.3934/jimo.2016050 [5] Yanfei Wang, Qinghua Ma. A gradient method for regularizing retrieval of aerosol particle size distribution function. Journal of Industrial and Management Optimization, 2009, 5 (1) : 115-126. doi: 10.3934/jimo.2009.5.115 [6] Stefan Kindermann. Convergence of the gradient method for ill-posed problems. Inverse Problems and Imaging, 2017, 11 (4) : 703-720. doi: 10.3934/ipi.2017033 [7] Feng Ma, Jiansheng Shu, Yaxiong Li, Jian Wu. The dual step size of the alternating direction method can be larger than 1.618 when one function is strongly convex. Journal of Industrial and Management Optimization, 2021, 17 (3) : 1173-1185. doi: 10.3934/jimo.2020016 [8] C.Y. Wang, M.X. Li. Convergence property of the Fletcher-Reeves conjugate gradient method with errors. Journal of Industrial and Management Optimization, 2005, 1 (2) : 193-200. doi: 10.3934/jimo.2005.1.193 [9] Yu-Ning Yang, Su Zhang. On linear convergence of projected gradient method for a class of affine rank minimization problems. Journal of Industrial and Management Optimization, 2016, 12 (4) : 1507-1519. doi: 10.3934/jimo.2016.12.1507 [10] Yulan Lu, Minghui Song, Mingzhu Liu. Convergence rate and stability of the split-step theta method for stochastic differential equations with piecewise continuous arguments. Discrete and Continuous Dynamical Systems - B, 2019, 24 (2) : 695-717. doi: 10.3934/dcdsb.2018203 [11] Minoru Murai, Waichiro Matsumoto, Shoji Yotsutani. Representation formula for the plane closed elastic curves. Conference Publications, 2013, 2013 (special) : 565-585. doi: 10.3934/proc.2013.2013.565 [12] Yoonsang Lee, Bjorn Engquist. Variable step size multiscale methods for stiff and highly oscillatory dynamical systems. Discrete and Continuous Dynamical Systems, 2014, 34 (3) : 1079-1097. doi: 10.3934/dcds.2014.34.1079 [13] Zhili Ge, Gang Qian, Deren Han. Global convergence of an inexact operator splitting method for monotone variational inequalities. Journal of Industrial and Management Optimization, 2011, 7 (4) : 1013-1026. doi: 10.3934/jimo.2011.7.1013 [14] Liyan Qi, Xiantao Xiao, Liwei Zhang. On the global convergence of a parameter-adjusting Levenberg-Marquardt method. Numerical Algebra, Control and Optimization, 2015, 5 (1) : 25-36. doi: 10.3934/naco.2015.5.25 [15] Gonglin Yuan, Zhan Wang, Pengyuan Li. Global convergence of a modified Broyden family method for nonconvex functions. Journal of Industrial and Management Optimization, 2021  doi: 10.3934/jimo.2021164 [16] Gaohang Yu, Lutai Guan, Guoyin Li. Global convergence of modified Polak-Ribière-Polyak conjugate gradient methods with sufficient descent property. Journal of Industrial and Management Optimization, 2008, 4 (3) : 565-579. doi: 10.3934/jimo.2008.4.565 [17] Amal Attouchi, Eero Ruosteenoja. Gradient regularity for a singular parabolic equation in non-divergence form. Discrete and Continuous Dynamical Systems, 2020, 40 (10) : 5955-5972. doi: 10.3934/dcds.2020254 [18] Changjun Yu, Lei Yuan, Shuxuan Su. A new gradient computational formula for optimal control problems with time-delay. Journal of Industrial and Management Optimization, 2021  doi: 10.3934/jimo.2021076 [19] Timoteo Carletti. The lagrange inversion formula on non--Archimedean fields, non--analytical form of differential and finite difference equations. Discrete and Continuous Dynamical Systems, 2003, 9 (4) : 835-858. doi: 10.3934/dcds.2003.9.835 [20] Hui Liu, Yiming Long, Yuming Xiao. The existence of two non-contractible closed geodesics on every bumpy Finsler compact space form. Discrete and Continuous Dynamical Systems, 2018, 38 (8) : 3803-3829. doi: 10.3934/dcds.2018165

Impact Factor:

## Metrics

• HTML views (0)
• Cited by (0)

• on AIMS