A quasi-Newton trust region method based on a new fractional model

Previous Article
Pseudoconvexity properties of average cost functions
NACO Home
This Issue
Next Article
A gradient algorithm for optimal control problems with model-reality differences

2015, 5(3): 237-249. doi: 10.3934/naco.2015.5.237

A quasi-Newton trust region method based on a new fractional model

Honglan Zhu ^1, , Qin Ni ^1, and Meilan Zeng ^2,

1.	Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
2.	Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China

Received October 2014 Revised March 2015 Published August 2015

Abstract
Related Papers

In this paper, a general fractional model is proposed. Based on the fractional model, a quasi-Newton trust region algorithm is presented for unconstrained optimization. The trust region subproblem is solved in the simplified way. We discussed the choices of the parameters in the fractional model and prove the global convergence of the proposed algorithm. Some primary test results shows the feasibility and validity of the fractional model.

Keywords: fractional model, global convergence., Unconstrained optimization, quasi-Newton method, trust region method.

Mathematics Subject Classification: Primary: 49K10; Secondary: 90C3.

Citation: Honglan Zhu, Qin Ni, Meilan Zeng. A quasi-Newton trust region method based on a new fractional model. Numerical Algebra, Control & Optimization, 2015, 5 (3) : 237-249. doi: 10.3934/naco.2015.5.237

References:

[1]	W. C. Davidon, Conic approximations and collinear scalings for optimizers,, \emph{SIAM Journal on Numerical Analysis}, 17 (1980), 268. doi: 10.1137/0717023. Google Scholar
[2]	S. Di and W. Y. Sun, A trust region method for conic model to solve unconstraind optimizaions,, \emph{Optimization Methods and Software}, 6 (1996), 237. doi: 10.1080/10556789608805637. Google Scholar
[3]	D. M. Gay, Computing optimal locally constrained steps,, \emph{SIAM Journal on Scientific and Statistical Computing}, 2 (1981), 186. doi: 10.1137/0902016. Google Scholar
[4]	H. Gourgeon and J. Nocedal, A conic algorithm for optimization,, \emph{SIAM Journal on Scientific and Statistical Computing}, 6 (1985), 253. doi: 10.1137/0906019. Google Scholar
[5]	X. P. Lu, Q. Ni and H. Liu, A dogleg method for solving new trust region subproblems of conic model,, \emph{ACTA Mathematicae Applicatae Sinica}, 30 (2009), 855. Google Scholar
[6]	X. P. Lu and Q. Ni, A quasi-newton trust region method with a new conic model for the unconstrained optimization,, \emph{Applied Mathematics and Computation}, 204 (2008), 373. doi: 10.1016/j.amc.2008.06.062. Google Scholar
[7]	J. J. More, B. S. Garbow and K. E. Hillstrom, Testing unconstrained optimization software,, \emph{ACM Trans. Math. Software}, 7 (1981), 17. doi: 10.1145/355934.355936. Google Scholar
[8]	Q. Ni, Optimality conditions for trust-region subproblems involving a conic model,, \emph{SIAM Journal on Optimization}, 15 (2005), 826. doi: 10.1137/S1052623402418991. Google Scholar
[9]	Q. Ni, Optimization Method and Program Design,, Science Press, (2009). Google Scholar
[10]	J. M. Peng and Y. X. Yuan, Optimality conditions for the minimization of a quadratic with two quadratic constraints,, \emph{SIAM Journal on Optimization}, 7 (1997), 579. doi: 10.1137/S1052623494261520. Google Scholar
[11]	M. J. D. Powell, Convergence properties of a class of minimization algorithms,, in \emph{Nonlinear Programming 2}, (1975), 1. Google Scholar
[12]	M. J. D. Powell and Y. X. Yuan, A trust region algorithm for equality constrained optimization,, \emph{Mathematical Programming}, 49 (1990), 189. doi: 10.1007/BF01588787. Google Scholar
[13]	R. Schnabel, Conic methods for unconstrained minimization and tensor methods for nonlinear equations,, In \emph{Mathematical Programming: The State of the Art}, (1982), 417. Google Scholar
[14]	D. C. Sorensen, Newton's method with a model trust region modification,, \emph{SIAM Journal on Numerical Analysis}, 19 (1982), 409. doi: 10.1137/0719026. Google Scholar
[15]	W. Y. Sun and Y. X. Yuan, A conic trust-region method for nonlinearly constrained optimization,, \emph{Annals of Operations Research}, 103 (2001), 175. doi: 10.1023/A:1012955122229. Google Scholar
[16]	F. S. Wang, K. C. Zhang, C. L. Wang and L. Wang, A variant of trust-region methods for unconstrained optimization,, \emph{Applied Mathematics and Computation}, 203 (2008), 297. doi: 10.1016/j.amc.2008.04.049. Google Scholar
[17]	J. Y. Wang and Q. Ni, An algorithm for solving new trust region subproblem with conic model,, \emph{Science in China, 51 (2008), 461. doi: 10.1007/s11425-007-0149-6. Google Scholar
[18]	H. P. Wu and Q. Ni, A new trust region algorithm with conic model,, \emph{Numerical Mathematics: A Journal of Chinese Universities}, 30 (2008), 57. Google Scholar
[19]	C. X. Xu and X. Y. Yang, Convergence of conic quasi-Newton trust region methods for unconstrained minimization,, \emph{Mathematical Application}, 11 (1998), 71. Google Scholar
[20]	Y. X. Yuan, A review of trust region algorithms for optimization,, \emph{ICIAM}, 99 (2000), 271. Google Scholar
[21]	L. W. Zhang and Q. Ni, Trust region algorithm of new conic model for nonliearly equality constrained optimization,, \emph{Journal on Numerical Methods and Computer Applications}, 31 (2010), 279. Google Scholar
[22]	X. Zhang, J. Wen and Q. Ni, Subspace trust-region algorithm with conic model for unconstrained optimization,, \emph{Numerical Algebra, 3 (2013), 223. doi: 10.3934/naco.2013.3.223. Google Scholar
[23]	L. J. Zhao and W. Y. Sun, Nonmonotone retrospective conic trust region method for unconstrained optimization,, \emph{Numerical Algebra, 3 (2013), 309. doi: 10.3934/naco.2013.3.309. Google Scholar
[24]	X. Zhao and X. Y. Wang, A nonmonotone self-adaptive search based on trust region algorithm with line the new conic model,, \emph{Journal of Taiyuan University of Science and Technology}, 31 (2010), 68. Google Scholar
[25]	M. F. Zhu, Y. Xue and F. S. Zhang, A quasi-Newton type trust region method based on the conic model,, \emph{Numerical Mathematics A Journal of Chinese Universities, 17 (1995), 36. Google Scholar

show all references

References:

[1]	W. C. Davidon, Conic approximations and collinear scalings for optimizers,, \emph{SIAM Journal on Numerical Analysis}, 17 (1980), 268. doi: 10.1137/0717023. Google Scholar
[2]	S. Di and W. Y. Sun, A trust region method for conic model to solve unconstraind optimizaions,, \emph{Optimization Methods and Software}, 6 (1996), 237. doi: 10.1080/10556789608805637. Google Scholar
[3]	D. M. Gay, Computing optimal locally constrained steps,, \emph{SIAM Journal on Scientific and Statistical Computing}, 2 (1981), 186. doi: 10.1137/0902016. Google Scholar
[4]	H. Gourgeon and J. Nocedal, A conic algorithm for optimization,, \emph{SIAM Journal on Scientific and Statistical Computing}, 6 (1985), 253. doi: 10.1137/0906019. Google Scholar
[5]	X. P. Lu, Q. Ni and H. Liu, A dogleg method for solving new trust region subproblems of conic model,, \emph{ACTA Mathematicae Applicatae Sinica}, 30 (2009), 855. Google Scholar
[6]	X. P. Lu and Q. Ni, A quasi-newton trust region method with a new conic model for the unconstrained optimization,, \emph{Applied Mathematics and Computation}, 204 (2008), 373. doi: 10.1016/j.amc.2008.06.062. Google Scholar
[7]	J. J. More, B. S. Garbow and K. E. Hillstrom, Testing unconstrained optimization software,, \emph{ACM Trans. Math. Software}, 7 (1981), 17. doi: 10.1145/355934.355936. Google Scholar
[8]	Q. Ni, Optimality conditions for trust-region subproblems involving a conic model,, \emph{SIAM Journal on Optimization}, 15 (2005), 826. doi: 10.1137/S1052623402418991. Google Scholar
[9]	Q. Ni, Optimization Method and Program Design,, Science Press, (2009). Google Scholar
[10]	J. M. Peng and Y. X. Yuan, Optimality conditions for the minimization of a quadratic with two quadratic constraints,, \emph{SIAM Journal on Optimization}, 7 (1997), 579. doi: 10.1137/S1052623494261520. Google Scholar
[11]	M. J. D. Powell, Convergence properties of a class of minimization algorithms,, in \emph{Nonlinear Programming 2}, (1975), 1. Google Scholar
[12]	M. J. D. Powell and Y. X. Yuan, A trust region algorithm for equality constrained optimization,, \emph{Mathematical Programming}, 49 (1990), 189. doi: 10.1007/BF01588787. Google Scholar
[13]	R. Schnabel, Conic methods for unconstrained minimization and tensor methods for nonlinear equations,, In \emph{Mathematical Programming: The State of the Art}, (1982), 417. Google Scholar
[14]	D. C. Sorensen, Newton's method with a model trust region modification,, \emph{SIAM Journal on Numerical Analysis}, 19 (1982), 409. doi: 10.1137/0719026. Google Scholar
[15]	W. Y. Sun and Y. X. Yuan, A conic trust-region method for nonlinearly constrained optimization,, \emph{Annals of Operations Research}, 103 (2001), 175. doi: 10.1023/A:1012955122229. Google Scholar
[16]	F. S. Wang, K. C. Zhang, C. L. Wang and L. Wang, A variant of trust-region methods for unconstrained optimization,, \emph{Applied Mathematics and Computation}, 203 (2008), 297. doi: 10.1016/j.amc.2008.04.049. Google Scholar
[17]	J. Y. Wang and Q. Ni, An algorithm for solving new trust region subproblem with conic model,, \emph{Science in China, 51 (2008), 461. doi: 10.1007/s11425-007-0149-6. Google Scholar
[18]	H. P. Wu and Q. Ni, A new trust region algorithm with conic model,, \emph{Numerical Mathematics: A Journal of Chinese Universities}, 30 (2008), 57. Google Scholar
[19]	C. X. Xu and X. Y. Yang, Convergence of conic quasi-Newton trust region methods for unconstrained minimization,, \emph{Mathematical Application}, 11 (1998), 71. Google Scholar
[20]	Y. X. Yuan, A review of trust region algorithms for optimization,, \emph{ICIAM}, 99 (2000), 271. Google Scholar
[21]	L. W. Zhang and Q. Ni, Trust region algorithm of new conic model for nonliearly equality constrained optimization,, \emph{Journal on Numerical Methods and Computer Applications}, 31 (2010), 279. Google Scholar
[22]	X. Zhang, J. Wen and Q. Ni, Subspace trust-region algorithm with conic model for unconstrained optimization,, \emph{Numerical Algebra, 3 (2013), 223. doi: 10.3934/naco.2013.3.223. Google Scholar
[23]	L. J. Zhao and W. Y. Sun, Nonmonotone retrospective conic trust region method for unconstrained optimization,, \emph{Numerical Algebra, 3 (2013), 309. doi: 10.3934/naco.2013.3.309. Google Scholar
[24]	X. Zhao and X. Y. Wang, A nonmonotone self-adaptive search based on trust region algorithm with line the new conic model,, \emph{Journal of Taiyuan University of Science and Technology}, 31 (2010), 68. Google Scholar
[25]	M. F. Zhu, Y. Xue and F. S. Zhang, A quasi-Newton type trust region method based on the conic model,, \emph{Numerical Mathematics A Journal of Chinese Universities, 17 (1995), 36. Google Scholar

[1]	Jun Chen, Wenyu Sun, Zhenghao Yang. A non-monotone retrospective trust-region method for unconstrained optimization. Journal of Industrial & Management Optimization, 2013, 9 (4) : 919-944. doi: 10.3934/jimo.2013.9.919
[2]	Lijuan Zhao, Wenyu Sun. Nonmonotone retrospective conic trust region method for unconstrained optimization. Numerical Algebra, Control & Optimization, 2013, 3 (2) : 309-325. doi: 10.3934/naco.2013.3.309
[3]	Xin Zhang, Jie Wen, Qin Ni. Subspace trust-region algorithm with conic model for unconstrained optimization. Numerical Algebra, Control & Optimization, 2013, 3 (2) : 223-234. doi: 10.3934/naco.2013.3.223
[4]	Nobuko Sagara, Masao Fukushima. trust region method for nonsmooth convex optimization. Journal of Industrial & Management Optimization, 2005, 1 (2) : 171-180. doi: 10.3934/jimo.2005.1.171
[5]	Shummin Nakayama, Yasushi Narushima, Hiroshi Yabe. Memoryless quasi-Newton methods based on spectral-scaling Broyden family for unconstrained optimization. Journal of Industrial & Management Optimization, 2019, 15 (4) : 1773-1793. doi: 10.3934/jimo.2018122
[6]	Min Li. A three term Polak-Ribière-Polyak conjugate gradient method close to the memoryless BFGS quasi-Newton method. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-16. doi: 10.3934/jimo.2018149
[7]	Liang Zhang, Wenyu Sun, Raimundo J. B. de Sampaio, Jinyun Yuan. A wedge trust region method with self-correcting geometry for derivative-free optimization. Numerical Algebra, Control & Optimization, 2015, 5 (2) : 169-184. doi: 10.3934/naco.2015.5.169
[8]	Jun Takaki, Nobuo Yamashita. A derivative-free trust-region algorithm for unconstrained optimization with controlled error. Numerical Algebra, Control & Optimization, 2011, 1 (1) : 117-145. doi: 10.3934/naco.2011.1.117
[9]	Dan Xue, Wenyu Sun, Hongjin He. A structured trust region method for nonconvex programming with separable structure. Numerical Algebra, Control & Optimization, 2013, 3 (2) : 283-293. doi: 10.3934/naco.2013.3.283
[10]	Yuhong Dai, Nobuo Yamashita. Convergence analysis of sparse quasi-Newton updates with positive definite matrix completion for two-dimensional functions. Numerical Algebra, Control & Optimization, 2011, 1 (1) : 61-69. doi: 10.3934/naco.2011.1.61
[11]	Liqun Qi, Zheng yan, Hongxia Yin. Semismooth reformulation and Newton's method for the security region problem of power systems. Journal of Industrial & Management Optimization, 2008, 4 (1) : 143-153. doi: 10.3934/jimo.2008.4.143
[12]	Guanghui Zhou, Qin Ni, Meilan Zeng. A scaled conjugate gradient method with moving asymptotes for unconstrained optimization problems. Journal of Industrial & Management Optimization, 2017, 13 (2) : 595-608. doi: 10.3934/jimo.2016034
[13]	Chunlin Hao, Xinwei Liu. A trust-region filter-SQP method for mathematical programs with linear complementarity constraints. Journal of Industrial & Management Optimization, 2011, 7 (4) : 1041-1055. doi: 10.3934/jimo.2011.7.1041
[14]	Zhi-Feng Pang, Yu-Fei Yang. Semismooth Newton method for minimization of the LLT model. Inverse Problems & Imaging, 2009, 3 (4) : 677-691. doi: 10.3934/ipi.2009.3.677
[15]	Bülent Karasözen. Survey of trust-region derivative free optimization methods. Journal of Industrial & Management Optimization, 2007, 3 (2) : 321-334. doi: 10.3934/jimo.2007.3.321
[16]	Chien-Wen Chao, Shu-Cherng Fang, Ching-Jong Liao. A tropical cyclone-based method for global optimization. Journal of Industrial & Management Optimization, 2012, 8 (1) : 103-115. doi: 10.3934/jimo.2012.8.103
[17]	Cheng-Dar Liou. Note on "Cost analysis of the M/M/R machine repair problem with second optional repair: Newton-Quasi method". Journal of Industrial & Management Optimization, 2012, 8 (3) : 727-732. doi: 10.3934/jimo.2012.8.727
[18]	Kuo-Hsiung Wang, Chuen-Wen Liao, Tseng-Chang Yen. Cost analysis of the M/M/R machine repair problem with second optional repair: Newton-Quasi method. Journal of Industrial & Management Optimization, 2010, 6 (1) : 197-207. doi: 10.3934/jimo.2010.6.197
[19]	Weijun Zhou, Youhua Zhou. On the strong convergence of a modified Hestenes-Stiefel method for nonconvex optimization. Journal of Industrial & Management Optimization, 2013, 9 (4) : 893-899. doi: 10.3934/jimo.2013.9.893
[20]	Hongxiu Zhong, Guoliang Chen, Xueping Guo. Semi-local convergence of the Newton-HSS method under the center Lipschitz condition. Numerical Algebra, Control & Optimization, 2019, 9 (1) : 85-99. doi: 10.3934/naco.2019007

Impact Factor:

American Institute of Mathematical Sciences