
Previous Article
A common set of weight approach using an ideal decision making unit in data envelopment analysis
 JIMO Home
 This Issue

Next Article
A neighboring extremal solution for an optimal switched impulsive control problem
Canonical duality solution for alternating support vector machine
1.  Department of Computer Science and Technology, School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237, China 
References:
[1] 
J. O. Berger, "Statistical Decision Theory and Bayesian Analysis," Second edition, Springer Series in Statistics, SpringerVerlag, New York, 1985. 
[2] 
P. J. Bickel and K. A. Doksum, "Mathematical Statistics. Basic Ideas and Selected Topics," Second edition, PrenticeHall, Inc., 2001. 
[3] 
C. J. C. Burges, A tutorial on support vector machines for pattern recognition, Data Mining and Knowledge Discovery, 2 (1998), 121167. 
[4] 
O. Chapelle, V. Vapnik, O. Bousquet and S. Mukherjee, Choosing multiple parameters for support vector machines, Machine Learning, 46 (2002), 131159. 
[5] 
B. Chen and P. T. Harker, Smooth approximations to nonlinear complementarity problems, SIAM J. Optimization, 7 (1997), 403420. 
[6] 
C. Chen and O. L. Mangasarian, A class of smoothing functions for nonlinear and mixed complementarity problems, Computational Optimization and Applications, 5 (1996), 97138. 
[7] 
C. Chen and O. L. Mangasarian, Smoothing methods for convex inequalities and linear complementarity problems, Math. Programming, 71 (1995), 5169. doi: 10.1016/00255610(95)000054. 
[8] 
X. Chen, L. Qi and D. Sun, Global and superlinear convergence of the smoothing newton method and its application to general box constrained variational inequalities, Math. of Computation, 67 (1998), 519540. 
[9] 
X. Chen and Y. Ye, On homotopysmoothing methods for variational inequalities, SIAM J. Control and Optimization, 37 (1999), 589616. doi: 10.1137/S0363012997315907. 
[10] 
G. P. Crespi, I. Ginchev and M. Rocca, Two approaches toward constrained vector optimization and identity of the solutions, Journal of Industrial and Management Optimization, 1 (2005), 549563. 
[11] 
G. W. Flake and L. Steve, Efficient SVM regression training with SMO, Machine Learning, 46 (2002), 271290. 
[12] 
K. Fukunaga, "Introduction to Statistical Pattern Recognition," Second edition, Computer Science and Scientific Computing, Academic Press, Inc., Boston, MA, 1990. 
[13] 
G. Fung and O. L. Mangasarian, Finite Newton method for Lagrangian support vector machine classification, Neurocomputing, 55 (2003), 3955. 
[14] 
D. Y. Gao, Canonical dual transformation method and generalized triality theory in nonsmooth global optimization, J. Global Optimization, 17 (2000), 127160. 
[15] 
D. Y. Gao, Perfect duality theory and complete set of solutions to a class of global optimization, Optimization, 52 (2003), 467493. doi: 10.1080/02331930310001611501. 
[16] 
D. Y. Gao, Complete solutions to constrained quadratic optimization problems, Journal of Global Optimisation, 29 (2004), 377399. doi: 10.1023/B:JOGO.0000048034.94449.e3. 
[17] 
D. Y. Gao, Sufficient conditions and perfect duality in nonconvex minimization with inequality constraints, Journal of Industrial and Management Optimization, 1 (2005), 5363. 
[18] 
D. Y. Gao, Complete solutions and extremality criteria to polynomial optimization problems, Journal of Global Optimization, 35 (2006), 131143. doi: 10.1007/s1089800530685. 
[19] 
L. Gonzalez, C. Angulo, F. Velasco and A. Catala, Dual unification of biclass support vector machine formulations, Pattern Recognition, 39 (2006), 13251332. 
[20] 
A. G. Hadigheh and T. Terlaky, Generalized support set invariancy sensitivity analysis in linear optimization, Journal of Industrial and Management Optimization, 2 (2006), 118. 
[21] 
Q. He, Z.Z. Shi, L.A. Ren and E. S. Lee, A novel classification method based on hypersurface, Mathematical and Computer Modelling, 38 (2003), 395407. doi: 10.1016/S08957177(03)900963. 
[22] 
C. W. Hsu and C. J. Lin, A simple decomposition method for support vector machines, Machine Learning, 46 (2002), 291314. 
[23] 
T. Joachims, Making largescale support vector machine learning practical, in "Advanced in Kernel methods: Support Vector Learning," (eds. B. Scholkopf, B. Burges and A. Smola), The MIT Press, Cambridge, Massachusetts, 1999. 
[24] 
S. S. Keerthi, K. B. Duan, S. K. Shevade and A. N. Poo, A fast dual algorithm for kernel logistic regression, Machine Learning, 61 (2005), 151165. 
[25] 
P. Laskov, Feasible direction decomposition algorithms for training support vector machines, Machine Learning, 46 (2002), 315349. 
[26] 
Y.J. Lee, W. F. Hsieh and C. M. Huang, $\epsilon$SSVR: A smooth support vector machine for $\epsilon$insensitive regression, IEEE Transaction on Knowledge and Data Engineering, 17 (2005), 678685. doi: 10.1109/TKDE.2005.77. 
[27] 
Y.J. Lee and O. L. Mangarasian, SSVM: A smooth support vector machine for classification, Computational Optimization and Applications, 22 (2001), 522. 
[28] 
O. L. Mangasarian and D. R. Musicant, Successive overrelaxation for support vector machines, IEEE Transactions on Neural Networks, 10 (1999), 10321037. doi: 10.1109/72.788643. 
[29] 
T. M. Mitchell, "Machine Learning," McGrawHill Companies, Inc., 1997. 
[30] 
T. Mitchell, Statistical Approaches to Learning and Discovery, The course of Machine Learning at CMU, 2003. 
[31] 
D. Montgomery, "Design and Analysis of Experiments," Third edition, John Wiley & Sons, Inc., New York, 1991. 
[32] 
D. J. Newman, S. Hettich, C. L. Blake and C. J. Merz, "UCI Repository of Machine Learning Databases," University of California, Department of Information and Computer Science, Irvine, CA, 1998. Available from: http://www.ics.uci.edu/~mlearn/MLRepository.html. 
[33] 
P.F. Pai, System reliability forecasting by support vector machines with genetic algorithms, Mathematical and Computer Modelling, 43 (2006), 262274. doi: 10.1016/j.mcm.2005.02.008. 
[34] 
N. Panda and E. Y. Chang, KDX: An Indexer for support vector machines, IEEE Transaction on Knowledge and Data Engineering, 18 (2006), 748763. doi: 10.1109/TKDE.2006.101. 
[35] 
J. Platt, Sequential minimal optimization: A fast algorithm for training support vector machines, Advances in Kernel MethodsSupport Vector Learning [R], (1999), 185208. 
[36] 
K. Schittkowski, Optimal parameter selection in support vector machines, Journal of Industrial and Management Optimization, 1 (2005), 465476. 
[37] 
B. Schölkoft, "Support Vector Learning," R. Oldenbourg Verlag, Munich, 1997. 
[38] 
V. Vapnik, "The Nature of Statistical Learning Theory," SpringerVerlag, New York, 1995. 
[39] 
V. Vapnik, The support vector method of function estimation NATO ASI Series, in "Neural Network and Machine Learning," (ed. C. Bishop), Springer, 1998. 
[40] 
V. Vapnik, An overview of statistical learning theory, in "Advanced in Kernel methods: Support Vector Learning" (eds. B. Scholkopf, B. Burges and A. Smola), The MIT Press, Cambridge, Massachusetts, 1999. 
[41] 
V. Vapnik, Three remarks on support vector function estimation, IEEE transactions on Neural Networks, 10 (1999), 9881000. 
[42] 
Z. Y. Wu, H. W. J. Lee, F. S. Bai and L. S. Zhang, Quadratic smoothing approximation to $l_1$ exact penalty function in global optimization, Journal of Industrial and Management Optimization, 1 (2005), 533547. 
[43] 
K. F. C. Yiu, K. L. Mak and K. L. Teo, Airfoil design via optimal control theory, Journal of Industrial and Management Optimization, 1 (2005), 133148. 
[44] 
Y. Yuan, J. Yan and C. Xu, Polynomial smooth support vector machine (PSSVM), Chinese Journal Of Computers, 28 (2005), 917. 
[45] 
Y. Yuan and T. Huang, A polynomial smooth support vector machine for classification, Lecture Note in Artificial Intelligence, 3584 (2005), 157164. 
[46] 
Y. Yuan and R. Byrd, NonquasiNewton updates for unconstrained optimization, J. Comput. Math., 13 (1995), 95107. 
[47] 
Y. Yuan, A modified BFGS algorithm for unconstrained optimization, IMA J. Numer. Anal., 11 (1991), 325332. doi: 10.1093/imanum/11.3.325. 
show all references
References:
[1] 
J. O. Berger, "Statistical Decision Theory and Bayesian Analysis," Second edition, Springer Series in Statistics, SpringerVerlag, New York, 1985. 
[2] 
P. J. Bickel and K. A. Doksum, "Mathematical Statistics. Basic Ideas and Selected Topics," Second edition, PrenticeHall, Inc., 2001. 
[3] 
C. J. C. Burges, A tutorial on support vector machines for pattern recognition, Data Mining and Knowledge Discovery, 2 (1998), 121167. 
[4] 
O. Chapelle, V. Vapnik, O. Bousquet and S. Mukherjee, Choosing multiple parameters for support vector machines, Machine Learning, 46 (2002), 131159. 
[5] 
B. Chen and P. T. Harker, Smooth approximations to nonlinear complementarity problems, SIAM J. Optimization, 7 (1997), 403420. 
[6] 
C. Chen and O. L. Mangasarian, A class of smoothing functions for nonlinear and mixed complementarity problems, Computational Optimization and Applications, 5 (1996), 97138. 
[7] 
C. Chen and O. L. Mangasarian, Smoothing methods for convex inequalities and linear complementarity problems, Math. Programming, 71 (1995), 5169. doi: 10.1016/00255610(95)000054. 
[8] 
X. Chen, L. Qi and D. Sun, Global and superlinear convergence of the smoothing newton method and its application to general box constrained variational inequalities, Math. of Computation, 67 (1998), 519540. 
[9] 
X. Chen and Y. Ye, On homotopysmoothing methods for variational inequalities, SIAM J. Control and Optimization, 37 (1999), 589616. doi: 10.1137/S0363012997315907. 
[10] 
G. P. Crespi, I. Ginchev and M. Rocca, Two approaches toward constrained vector optimization and identity of the solutions, Journal of Industrial and Management Optimization, 1 (2005), 549563. 
[11] 
G. W. Flake and L. Steve, Efficient SVM regression training with SMO, Machine Learning, 46 (2002), 271290. 
[12] 
K. Fukunaga, "Introduction to Statistical Pattern Recognition," Second edition, Computer Science and Scientific Computing, Academic Press, Inc., Boston, MA, 1990. 
[13] 
G. Fung and O. L. Mangasarian, Finite Newton method for Lagrangian support vector machine classification, Neurocomputing, 55 (2003), 3955. 
[14] 
D. Y. Gao, Canonical dual transformation method and generalized triality theory in nonsmooth global optimization, J. Global Optimization, 17 (2000), 127160. 
[15] 
D. Y. Gao, Perfect duality theory and complete set of solutions to a class of global optimization, Optimization, 52 (2003), 467493. doi: 10.1080/02331930310001611501. 
[16] 
D. Y. Gao, Complete solutions to constrained quadratic optimization problems, Journal of Global Optimisation, 29 (2004), 377399. doi: 10.1023/B:JOGO.0000048034.94449.e3. 
[17] 
D. Y. Gao, Sufficient conditions and perfect duality in nonconvex minimization with inequality constraints, Journal of Industrial and Management Optimization, 1 (2005), 5363. 
[18] 
D. Y. Gao, Complete solutions and extremality criteria to polynomial optimization problems, Journal of Global Optimization, 35 (2006), 131143. doi: 10.1007/s1089800530685. 
[19] 
L. Gonzalez, C. Angulo, F. Velasco and A. Catala, Dual unification of biclass support vector machine formulations, Pattern Recognition, 39 (2006), 13251332. 
[20] 
A. G. Hadigheh and T. Terlaky, Generalized support set invariancy sensitivity analysis in linear optimization, Journal of Industrial and Management Optimization, 2 (2006), 118. 
[21] 
Q. He, Z.Z. Shi, L.A. Ren and E. S. Lee, A novel classification method based on hypersurface, Mathematical and Computer Modelling, 38 (2003), 395407. doi: 10.1016/S08957177(03)900963. 
[22] 
C. W. Hsu and C. J. Lin, A simple decomposition method for support vector machines, Machine Learning, 46 (2002), 291314. 
[23] 
T. Joachims, Making largescale support vector machine learning practical, in "Advanced in Kernel methods: Support Vector Learning," (eds. B. Scholkopf, B. Burges and A. Smola), The MIT Press, Cambridge, Massachusetts, 1999. 
[24] 
S. S. Keerthi, K. B. Duan, S. K. Shevade and A. N. Poo, A fast dual algorithm for kernel logistic regression, Machine Learning, 61 (2005), 151165. 
[25] 
P. Laskov, Feasible direction decomposition algorithms for training support vector machines, Machine Learning, 46 (2002), 315349. 
[26] 
Y.J. Lee, W. F. Hsieh and C. M. Huang, $\epsilon$SSVR: A smooth support vector machine for $\epsilon$insensitive regression, IEEE Transaction on Knowledge and Data Engineering, 17 (2005), 678685. doi: 10.1109/TKDE.2005.77. 
[27] 
Y.J. Lee and O. L. Mangarasian, SSVM: A smooth support vector machine for classification, Computational Optimization and Applications, 22 (2001), 522. 
[28] 
O. L. Mangasarian and D. R. Musicant, Successive overrelaxation for support vector machines, IEEE Transactions on Neural Networks, 10 (1999), 10321037. doi: 10.1109/72.788643. 
[29] 
T. M. Mitchell, "Machine Learning," McGrawHill Companies, Inc., 1997. 
[30] 
T. Mitchell, Statistical Approaches to Learning and Discovery, The course of Machine Learning at CMU, 2003. 
[31] 
D. Montgomery, "Design and Analysis of Experiments," Third edition, John Wiley & Sons, Inc., New York, 1991. 
[32] 
D. J. Newman, S. Hettich, C. L. Blake and C. J. Merz, "UCI Repository of Machine Learning Databases," University of California, Department of Information and Computer Science, Irvine, CA, 1998. Available from: http://www.ics.uci.edu/~mlearn/MLRepository.html. 
[33] 
P.F. Pai, System reliability forecasting by support vector machines with genetic algorithms, Mathematical and Computer Modelling, 43 (2006), 262274. doi: 10.1016/j.mcm.2005.02.008. 
[34] 
N. Panda and E. Y. Chang, KDX: An Indexer for support vector machines, IEEE Transaction on Knowledge and Data Engineering, 18 (2006), 748763. doi: 10.1109/TKDE.2006.101. 
[35] 
J. Platt, Sequential minimal optimization: A fast algorithm for training support vector machines, Advances in Kernel MethodsSupport Vector Learning [R], (1999), 185208. 
[36] 
K. Schittkowski, Optimal parameter selection in support vector machines, Journal of Industrial and Management Optimization, 1 (2005), 465476. 
[37] 
B. Schölkoft, "Support Vector Learning," R. Oldenbourg Verlag, Munich, 1997. 
[38] 
V. Vapnik, "The Nature of Statistical Learning Theory," SpringerVerlag, New York, 1995. 
[39] 
V. Vapnik, The support vector method of function estimation NATO ASI Series, in "Neural Network and Machine Learning," (ed. C. Bishop), Springer, 1998. 
[40] 
V. Vapnik, An overview of statistical learning theory, in "Advanced in Kernel methods: Support Vector Learning" (eds. B. Scholkopf, B. Burges and A. Smola), The MIT Press, Cambridge, Massachusetts, 1999. 
[41] 
V. Vapnik, Three remarks on support vector function estimation, IEEE transactions on Neural Networks, 10 (1999), 9881000. 
[42] 
Z. Y. Wu, H. W. J. Lee, F. S. Bai and L. S. Zhang, Quadratic smoothing approximation to $l_1$ exact penalty function in global optimization, Journal of Industrial and Management Optimization, 1 (2005), 533547. 
[43] 
K. F. C. Yiu, K. L. Mak and K. L. Teo, Airfoil design via optimal control theory, Journal of Industrial and Management Optimization, 1 (2005), 133148. 
[44] 
Y. Yuan, J. Yan and C. Xu, Polynomial smooth support vector machine (PSSVM), Chinese Journal Of Computers, 28 (2005), 917. 
[45] 
Y. Yuan and T. Huang, A polynomial smooth support vector machine for classification, Lecture Note in Artificial Intelligence, 3584 (2005), 157164. 
[46] 
Y. Yuan and R. Byrd, NonquasiNewton updates for unconstrained optimization, J. Comput. Math., 13 (1995), 95107. 
[47] 
Y. Yuan, A modified BFGS algorithm for unconstrained optimization, IMA J. Numer. Anal., 11 (1991), 325332. doi: 10.1093/imanum/11.3.325. 
[1] 
Yubo Yuan, Weiguo Fan, Dongmei Pu. Spline function smooth support vector machine for classification. Journal of Industrial and Management Optimization, 2007, 3 (3) : 529542. doi: 10.3934/jimo.2007.3.529 
[2] 
Qianru Zhai, Ye Tian, Jingyue Zhou. A SMOTEbased quadratic surface support vector machine for imbalanced classification with mislabeled information. Journal of Industrial and Management Optimization, 2022 doi: 10.3934/jimo.2021230 
[3] 
Ning Lu, Ying Liu. Application of support vector machine model in wind power prediction based on particle swarm optimization. Discrete and Continuous Dynamical Systems  S, 2015, 8 (6) : 12671276. doi: 10.3934/dcdss.2015.8.1267 
[4] 
Pooja Louhan, S. K. Suneja. On fractional vector optimization over cones with support functions. Journal of Industrial and Management Optimization, 2017, 13 (2) : 549572. doi: 10.3934/jimo.2016031 
[5] 
Ying Lin, Qi Ye. Support vector machine classifiers by nonEuclidean margins. Mathematical Foundations of Computing, 2020, 3 (4) : 279300. doi: 10.3934/mfc.2020018 
[6] 
Jian Luo, ShuCherng Fang, Yanqin Bai, Zhibin Deng. Fuzzy quadratic surface support vector machine based on fisher discriminant analysis. Journal of Industrial and Management Optimization, 2016, 12 (1) : 357373. doi: 10.3934/jimo.2016.12.357 
[7] 
Xin Li, Ziguan Cui, Linhui Sun, Guanming Lu, Debnath Narayan. Research on iterative repair algorithm of Hyperchaotic image based on support vector machine. Discrete and Continuous Dynamical Systems  S, 2019, 12 (4&5) : 11991218. doi: 10.3934/dcdss.2019083 
[8] 
Fatemeh Bazikar, Saeed Ketabchi, Hossein Moosaei. Smooth augmented Lagrangian method for twin bounded support vector machine. Numerical Algebra, Control and Optimization, 2021 doi: 10.3934/naco.2021027 
[9] 
Xin Yan, Hongmiao Zhu. A kernelfree fuzzy support vector machine with Universum. Journal of Industrial and Management Optimization, 2021 doi: 10.3934/jimo.2021184 
[10] 
Ahmad Mousavi, Zheming Gao, Lanshan Han, Alvin Lim. Quadratic surface support vector machine with L1 norm regularization. Journal of Industrial and Management Optimization, 2022, 18 (3) : 18351861. doi: 10.3934/jimo.2021046 
[11] 
Xinmin Yang. On symmetric and self duality in vector optimization problem. Journal of Industrial and Management Optimization, 2011, 7 (3) : 523529. doi: 10.3934/jimo.2011.7.523 
[12] 
Manxue You, Shengjie Li. Perturbation of Image and conjugate duality for vector optimization. Journal of Industrial and Management Optimization, 2022, 18 (2) : 731745. doi: 10.3934/jimo.2020176 
[13] 
Jutamas Kerdkaew, Rabian Wangkeeree, Rattanaporn Wangkeeree. Global optimality conditions and duality theorems for robust optimal solutions of optimization problems with data uncertainty, using underestimators. Numerical Algebra, Control and Optimization, 2022, 12 (1) : 93107. doi: 10.3934/naco.2021053 
[14] 
Huiqin Zhang, JinChun Wang, Meng Wang, Xudong Chen. Integration of cuckoo search and fuzzy support vector machine for intelligent diagnosis of production process quality. Journal of Industrial and Management Optimization, 2022, 18 (1) : 195217. doi: 10.3934/jimo.2020150 
[15] 
Radu Ioan Boţ, SorinMihai Grad. On linear vector optimization duality in infinitedimensional spaces. Numerical Algebra, Control and Optimization, 2011, 1 (3) : 407415. doi: 10.3934/naco.2011.1.407 
[16] 
Enkhbat Rentsen, N. Tungalag, J. Enkhbayar, O. Battogtokh, L. Enkhtuvshin. Application of survival theory in Mining industry. Numerical Algebra, Control and Optimization, 2021, 11 (3) : 443448. doi: 10.3934/naco.2020036 
[17] 
Fengqiu Liu, Xiaoping Xue. Subgradientbased neural network for nonconvex optimization problems in support vector machines with indefinite kernels. Journal of Industrial and Management Optimization, 2016, 12 (1) : 285301. doi: 10.3934/jimo.2016.12.285 
[18] 
K. Schittkowski. Optimal parameter selection in support vector machines. Journal of Industrial and Management Optimization, 2005, 1 (4) : 465476. doi: 10.3934/jimo.2005.1.465 
[19] 
Florian Dumpert. Quantitative robustness of localized support vector machines. Communications on Pure and Applied Analysis, 2020, 19 (8) : 39473956. doi: 10.3934/cpaa.2020174 
[20] 
HongGunn Chew, ChengChew Lim. On regularisation parameter transformation of support vector machines. Journal of Industrial and Management Optimization, 2009, 5 (2) : 403415. doi: 10.3934/jimo.2009.5.403 
2020 Impact Factor: 1.801
Tools
Metrics
Other articles
by authors
[Back to Top]