# American Institute of Mathematical Sciences

June  2020, 10(2): 227-235. doi: 10.3934/naco.2019049

## A new type of quasi-newton updating formulas based on the new quasi-newton equation

 Department of Mathematics, College of Computers Sciences and Mathematics, University of Mosul, Iraq

* Corresponding author: Basim A. Hassan

Received  February 2019 Revised  July 2019 Published  September 2019

The quasi-Newton equation is the very foundation of an assortment of the quasi-Newton methods. Therefore, by using the offered alternative equation, we derive the modified BFGS quasi-Newton updating formulas. In this paper, a new y-technique has been introduced to modify the secant equation of the quasi-Newton methods. Prove the global convergence of this algorithm is associated with a line search rule. The numerical results explain that the offered method is effectual for the known test problems.

Citation: Basim A. Hassan. A new type of quasi-newton updating formulas based on the new quasi-newton equation. Numerical Algebra, Control & Optimization, 2020, 10 (2) : 227-235. doi: 10.3934/naco.2019049
##### References:

show all references

##### References:
Some modifications of QN-equations
 Author(s) QN conditions Ref. Powell $B_{k+1}s_k=\tilde{y}_k= \varphi_k y_k +(1-\varphi_k)B_ks_k$ [8] Li and Fukushima $B_{k+1}s_k=\tilde{y}_k= y_k +t_ks_k, t_k \le 10^{-6}$ [5] Wei, Li, and Qi $B_{k+1}s_k=\tilde{y}_k= y_k +\frac{2(f_k-f_{k+1})+(g_{k+1}+g_k)^Ts_k}{\Vert s_k \Vert^2} s_k$ [9] Zhang, Deng, and Chen $B_{k+1}s_k=\tilde{y}_k= y_k +\frac{6(f_k-f_{k+1})+3(g_{k+1}+g_k)^Ts_k}{\Vert s_k \Vert^2} s_k$ [18] Yuan and Wei $B_{k+1}s_k=\tilde{y}_k= y_k +\frac{max(0, 2(f_k-f_{k+1})+(g_{k+1}+g_k)^Ts_k}{\Vert s_k \Vert^2} s_k$ [14] Yuan, Wei and Wu $B_{k+1}s_k=\tilde{y}_k= y_k +\frac{max(0, 6(f_k-f_{k+1})+3(g_{k+1}+g_k)^Ts_k}{\Vert s_k \Vert^2} s_k$ [17]
 Author(s) QN conditions Ref. Powell $B_{k+1}s_k=\tilde{y}_k= \varphi_k y_k +(1-\varphi_k)B_ks_k$ [8] Li and Fukushima $B_{k+1}s_k=\tilde{y}_k= y_k +t_ks_k, t_k \le 10^{-6}$ [5] Wei, Li, and Qi $B_{k+1}s_k=\tilde{y}_k= y_k +\frac{2(f_k-f_{k+1})+(g_{k+1}+g_k)^Ts_k}{\Vert s_k \Vert^2} s_k$ [9] Zhang, Deng, and Chen $B_{k+1}s_k=\tilde{y}_k= y_k +\frac{6(f_k-f_{k+1})+3(g_{k+1}+g_k)^Ts_k}{\Vert s_k \Vert^2} s_k$ [18] Yuan and Wei $B_{k+1}s_k=\tilde{y}_k= y_k +\frac{max(0, 2(f_k-f_{k+1})+(g_{k+1}+g_k)^Ts_k}{\Vert s_k \Vert^2} s_k$ [14] Yuan, Wei and Wu $B_{k+1}s_k=\tilde{y}_k= y_k +\frac{max(0, 6(f_k-f_{k+1})+3(g_{k+1}+g_k)^Ts_k}{\Vert s_k \Vert^2} s_k$ [17]
Comparison of different BFGS-algorithms with different test functions and different dimensions
 P.No. n BFGS algorithm BBFGS with $u_k=y_k$ BBFGS with $u_k=g_{k+1}$ NI NF NI NF NI NF 1 2 35 140 36 124 8 29 2 2 9 26 8 23 5 16 3 2 43 166 34 123 3 12 4 2 3 30 3 30 3 30 5 2 15 50 15 48 5 17 6 2 2 27 2 27 2 27 7 3 34 113 26 86 7 20 8 3 16 54 15 51 6 18 9 3 2 4 2 4 2 4 10 3 2 27 2 27 2 27 11 3 2 27 2 27 2 27 12 4 20 60 20 60 5 17 13 4 19 61 24 73 4 13 14 4 21 65 23 72 4 10 15 4 17 54 16 49 5 17 16 5 2 27 2 27 2 27 17 6 25 72 33 101 4 12 18 11 3 31 3 31 3 31 19 20 31 102 33 103 4 13 20 400 64 209 91 297 5 17 21 400 2 27 2 27 2 27 22 200 2 5 2 5 2 5 23 100 2 27 2 27 2 27 24 500 9 33 8 28 10 31 25 500 2 4 2 4 2 4 26 500 6 16 7 19 5 14 27 500 57 281 16 114 5 17 28 500 2 4 2 4 2 4 29 500 3 7 3 7 3 7 30 500 3 7 3 7 3 7 Total 453 1756 437 1625 117 527
 P.No. n BFGS algorithm BBFGS with $u_k=y_k$ BBFGS with $u_k=g_{k+1}$ NI NF NI NF NI NF 1 2 35 140 36 124 8 29 2 2 9 26 8 23 5 16 3 2 43 166 34 123 3 12 4 2 3 30 3 30 3 30 5 2 15 50 15 48 5 17 6 2 2 27 2 27 2 27 7 3 34 113 26 86 7 20 8 3 16 54 15 51 6 18 9 3 2 4 2 4 2 4 10 3 2 27 2 27 2 27 11 3 2 27 2 27 2 27 12 4 20 60 20 60 5 17 13 4 19 61 24 73 4 13 14 4 21 65 23 72 4 10 15 4 17 54 16 49 5 17 16 5 2 27 2 27 2 27 17 6 25 72 33 101 4 12 18 11 3 31 3 31 3 31 19 20 31 102 33 103 4 13 20 400 64 209 91 297 5 17 21 400 2 27 2 27 2 27 22 200 2 5 2 5 2 5 23 100 2 27 2 27 2 27 24 500 9 33 8 28 10 31 25 500 2 4 2 4 2 4 26 500 6 16 7 19 5 14 27 500 57 281 16 114 5 17 28 500 2 4 2 4 2 4 29 500 3 7 3 7 3 7 30 500 3 7 3 7 3 7 Total 453 1756 437 1625 117 527
Relative efficiency of the new Algorithms
 BFGS algorithm BBFGS with $u_k=y_k$ BBFGS with $u_k=g_{k+1}$ NI 100% 96.70% 25.82% NF 100% 92.53% 30.01%
 BFGS algorithm BBFGS with $u_k=y_k$ BBFGS with $u_k=g_{k+1}$ NI 100% 96.70% 25.82% NF 100% 92.53% 30.01%
 [1] Wei Ouyang, Li Li. Hölder strong metric subregularity and its applications to convergence analysis of inexact Newton methods. Journal of Industrial & Management Optimization, 2021, 17 (1) : 169-184. doi: 10.3934/jimo.2019105 [2] Guido Cavallaro, Roberto Garra, Carlo Marchioro. Long time localization of modified surface quasi-geostrophic equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020336 [3] Marion Darbas, Jérémy Heleine, Stephanie Lohrengel. Numerical resolution by the quasi-reversibility method of a data completion problem for Maxwell's equations. Inverse Problems & Imaging, 2020, 14 (6) : 1107-1133. doi: 10.3934/ipi.2020056 [4] Zuliang Lu, Fei Huang, Xiankui Wu, Lin Li, Shang Liu. Convergence and quasi-optimality of $L^2-$norms based an adaptive finite element method for nonlinear optimal control problems. Electronic Research Archive, 2020, 28 (4) : 1459-1486. doi: 10.3934/era.2020077 [5] Yanhong Zhang. Global attractors of two layer baroclinic quasi-geostrophic model. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021023 [6] Wenmeng Geng, Kai Tao. Large deviation theorems for dirichlet determinants of analytic quasi-periodic jacobi operators with Brjuno-Rüssmann frequency. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5305-5335. doi: 10.3934/cpaa.2020240 [7] Jianfeng Huang, Haihua Liang. Limit cycles of planar system defined by the sum of two quasi-homogeneous vector fields. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 861-873. doi: 10.3934/dcdsb.2020145 [8] Jingjing Wang, Zaiyun Peng, Zhi Lin, Daqiong Zhou. On the stability of solutions for the generalized vector quasi-equilibrium problems via free-disposal set. Journal of Industrial & Management Optimization, 2021, 17 (2) : 869-887. doi: 10.3934/jimo.2020002 [9] Jiwei Jia, Young-Ju Lee, Yue Feng, Zichan Wang, Zhongshu Zhao. Hybridized weak Galerkin finite element methods for Brinkman equations. Electronic Research Archive, , () : -. doi: 10.3934/era.2020126 [10] Christian Beck, Lukas Gonon, Martin Hutzenthaler, Arnulf Jentzen. On existence and uniqueness properties for solutions of stochastic fixed point equations. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020320 [11] George W. Patrick. The geometry of convergence in numerical analysis. Journal of Computational Dynamics, 2021, 8 (1) : 33-58. doi: 10.3934/jcd.2021003 [12] Matania Ben–Artzi, Joseph Falcovitz, Jiequan Li. The convergence of the GRP scheme. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 1-27. doi: 10.3934/dcds.2009.23.1 [13] Philippe G. Ciarlet, Liliana Gratie, Cristinel Mardare. Intrinsic methods in elasticity: a mathematical survey. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 133-164. doi: 10.3934/dcds.2009.23.133 [14] Nicolas Rougerie. On two properties of the Fisher information. Kinetic & Related Models, 2021, 14 (1) : 77-88. doi: 10.3934/krm.2020049 [15] Yongjie Wang, Nan Gao. Some properties for almost cellular algebras. Electronic Research Archive, 2021, 29 (1) : 1681-1689. doi: 10.3934/era.2020086 [16] Simone Göttlich, Elisa Iacomini, Thomas Jung. Properties of the LWR model with time delay. Networks & Heterogeneous Media, 2020  doi: 10.3934/nhm.2020032 [17] Bo Tan, Qinglong Zhou. Approximation properties of Lüroth expansions. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020389 [18] Akbar Mahmoodi Rishakani, Seyed Mojtaba Dehnavi, Mohmmadreza Mirzaee Shamsabad, Nasour Bagheri. Cryptographic properties of cyclic binary matrices. Advances in Mathematics of Communications, 2021, 15 (2) : 311-327. doi: 10.3934/amc.2020068 [19] Predrag S. Stanimirović, Branislav Ivanov, Haifeng Ma, Dijana Mosić. A survey of gradient methods for solving nonlinear optimization. Electronic Research Archive, 2020, 28 (4) : 1573-1624. doi: 10.3934/era.2020115 [20] Xing-Bin Pan. Variational and operator methods for Maxwell-Stokes system. Discrete & Continuous Dynamical Systems - A, 2020, 40 (6) : 3909-3955. doi: 10.3934/dcds.2020036

Impact Factor: