• Previous Article
    A mixed simulated annealing-genetic algorithm approach to the multi-buyer multi-item joint replenishment problem: advantages of meta-heuristics
  • JIMO Home
  • This Issue
  • Next Article
    Second order nonlinear impulsive time-variant systems with unbounded perturbation and optimal controls
January  2008, 4(1): 33-52. doi: 10.3934/jimo.2008.4.33

Knot-optimizing spline networks (KOSNETS) for nonparametric regression

1. 

School of Mathematics and Statistics, The University of Western Australia, 35 Stirling Highway, Crawley, WA 6009

2. 

CSIRO Mathematical and Information Sciences, Private Bag 5, Wembley, WA 6913, Australia

3. 

Department of Actuarial Studies, Macquarie University, Sydney, Australia

Received  July 2006 Revised  November 2007 Published  January 2008

In this paper we present a novel method for short term forecast of time series based on Knot-Optimizing Spline Networks (KOSNETS). The time series is first approximated by a nonlinear recurrent system. The resulting recurrent system is then approximated by feedforward $B$-spline networks, yielding a nonlinear optimization problem. In this optimization problem, both the knot points and the coefficients of the $B$-splines are decision variables so that the solution to the problem has both optimal coefficients and partition points. To demonstrate the usefulness and accuracy of the method, numerical simulations and tests using various model and real time series are performed. The numerical simulation results are compared with those from a well-known regression method, MARS. The comparison shows that our method outperforms MARS for nonlinear problems.
Citation: Song Wang, Quanxi Shao, Xian Zhou. Knot-optimizing spline networks (KOSNETS) for nonparametric regression. Journal of Industrial & Management Optimization, 2008, 4 (1) : 33-52. doi: 10.3934/jimo.2008.4.33
[1]

Xiao-Qian Jiang, Lun-Chuan Zhang. Stock price fluctuation prediction method based on time series analysis. Discrete & Continuous Dynamical Systems - S, 2019, 12 (4&5) : 915-927. doi: 10.3934/dcdss.2019061

[2]

Christina Surulescu, Nicolae Surulescu. Modeling and simulation of some cell dispersion problems by a nonparametric method. Mathematical Biosciences & Engineering, 2011, 8 (2) : 263-277. doi: 10.3934/mbe.2011.8.263

[3]

Qinqin Chai, Ryan Loxton, Kok Lay Teo, Chunhua Yang. A unified parameter identification method for nonlinear time-delay systems. Journal of Industrial & Management Optimization, 2013, 9 (2) : 471-486. doi: 10.3934/jimo.2013.9.471

[4]

Jiu Ding, Noah H. Rhee. A unified maximum entropy method via spline functions for Frobenius-Perron operators. Numerical Algebra, Control & Optimization, 2013, 3 (2) : 235-245. doi: 10.3934/naco.2013.3.235

[5]

Lianjun Zhang, Lingchen Kong, Yan Li, Shenglong Zhou. A smoothing iterative method for quantile regression with nonconvex $ \ell_p $ penalty. Journal of Industrial & Management Optimization, 2017, 13 (1) : 93-112. doi: 10.3934/jimo.2016006

[6]

Andrea L. Bertozzi, Ning Ju, Hsiang-Wei Lu. A biharmonic-modified forward time stepping method for fourth order nonlinear diffusion equations. Discrete & Continuous Dynamical Systems - A, 2011, 29 (4) : 1367-1391. doi: 10.3934/dcds.2011.29.1367

[7]

Z.G. Feng, K.L. Teo, Y. Zhao. Branch and bound method for sensor scheduling in discrete time. Journal of Industrial & Management Optimization, 2005, 1 (4) : 499-512. doi: 10.3934/jimo.2005.1.499

[8]

Rodrigo I. Brevis, Jaime H. Ortega, David Pardo. A source time reversal method for seismicity induced by mining. Inverse Problems & Imaging, 2017, 11 (1) : 25-45. doi: 10.3934/ipi.2017002

[9]

Qun Lin, Ryan Loxton, Kok Lay Teo. The control parameterization method for nonlinear optimal control: A survey. Journal of Industrial & Management Optimization, 2014, 10 (1) : 275-309. doi: 10.3934/jimo.2014.10.275

[10]

Jinyan Fan, Jianyu Pan. Inexact Levenberg-Marquardt method for nonlinear equations. Discrete & Continuous Dynamical Systems - B, 2004, 4 (4) : 1223-1232. doi: 10.3934/dcdsb.2004.4.1223

[11]

Zhiyou Wu, Fusheng Bai, Guoquan Li, Yongjian Yang. A new auxiliary function method for systems of nonlinear equations. Journal of Industrial & Management Optimization, 2015, 11 (2) : 345-364. doi: 10.3934/jimo.2015.11.345

[12]

Yongjian Yang, Zhiyou Wu, Fusheng Bai. A filled function method for constrained nonlinear integer programming. Journal of Industrial & Management Optimization, 2008, 4 (2) : 353-362. doi: 10.3934/jimo.2008.4.353

[13]

Igor Griva, Roman A. Polyak. Proximal point nonlinear rescaling method for convex optimization. Numerical Algebra, Control & Optimization, 2011, 1 (2) : 283-299. doi: 10.3934/naco.2011.1.283

[14]

Martin Burger, José A. Carrillo, Marie-Therese Wolfram. A mixed finite element method for nonlinear diffusion equations. Kinetic & Related Models, 2010, 3 (1) : 59-83. doi: 10.3934/krm.2010.3.59

[15]

Thierry Colin, Boniface Nkonga. Multiscale numerical method for nonlinear Maxwell equations. Discrete & Continuous Dynamical Systems - B, 2005, 5 (3) : 631-658. doi: 10.3934/dcdsb.2005.5.631

[16]

Liuyang Yuan, Zhongping Wan, Jingjing Zhang, Bin Sun. A filled function method for solving nonlinear complementarity problem. Journal of Industrial & Management Optimization, 2009, 5 (4) : 911-928. doi: 10.3934/jimo.2009.5.911

[17]

Carlos E. Kenig. The method of energy channels for nonlinear wave equations. Discrete & Continuous Dynamical Systems - A, 2019, 39 (12) : 6979-6993. doi: 10.3934/dcds.2019240

[18]

Erik Kropat, Gerhard Wilhelm Weber. Fuzzy target-environment networks and fuzzy-regression approaches. Numerical Algebra, Control & Optimization, 2018, 8 (2) : 135-155. doi: 10.3934/naco.2018008

[19]

V. Rehbock, K.L. Teo, L.S. Jennings. Suboptimal feedback control for a class of nonlinear systems using spline interpolation. Discrete & Continuous Dynamical Systems - A, 1995, 1 (2) : 223-236. doi: 10.3934/dcds.1995.1.223

[20]

Chuang Peng. Minimum degrees of polynomial models on time series. Conference Publications, 2005, 2005 (Special) : 720-729. doi: 10.3934/proc.2005.2005.720

2018 Impact Factor: 1.025

Metrics

  • PDF downloads (8)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]