# American Institute of Mathematical Sciences

January  2016, 12(1): 1-15. doi: 10.3934/jimo.2016.12.1

## Smoothing and sample average approximation methods for solving stochastic generalized Nash equilibrium problems

 1 School of Mathematics, Liaoning University, Liaoning 110031, China 2 School of Management, Shanghai University, Shanghai 200444, China

Received  January 2014 Revised  October 2014 Published  April 2015

In this paper, we consider the class of stochastic generalized Nash equilibrium problems (SGNEP). Such problems have a wide range of applications and have attracted significant attention recently. First, using the first order optimality condition of SGNEP and the nonlinear complementary function, we present an expected residual minimization (ERM) model for the case when the involved functions are not continuously differentiable. Then, we introduce a smoothing function, depending on a smoothing parameter, to yield a smooth approximate ERM model. We further show that the solutions of this smooth ERM model converge to the solutions of the original ERM model as the smoothing parameter tends to zero. Since the ERM formulation contains an expectation, we further propose a sample average approximate problem for the ERM model. Moreover, we show that the global optimal solutions of these approximate problems converge to the global optimal solutions of the ERM problem with probability one. Here, convergence can be achieved in two ways. One is to fix the smoothing parameter, the other is to let the smoothing parameter tend to zero as the sample increases.
Citation: Mei Ju Luo, Yi Zeng Chen. Smoothing and sample average approximation methods for solving stochastic generalized Nash equilibrium problems. Journal of Industrial & Management Optimization, 2016, 12 (1) : 1-15. doi: 10.3934/jimo.2016.12.1
##### References:
 [1] J. R. Birge, Quasi-Monte Carlo Approaches to Option Pricing,, Technical Report 94-19, (1994), 94.   Google Scholar [2] F. H. Clarke, Optimization and Nonsmooth Analysis,, Wiley, (1983).   Google Scholar [3] X. Chen and M. Fukushima, Expected residual minimization method for stochastic linear complementarity problems,, Mathematics of Operations Research, 30 (2005), 1022.  doi: 10.1287/moor.1050.0160.  Google Scholar [4] X. Chen, C. Zhang and M. Fukushima, Robust solution of monotone stochastic linear complementarity problems,, Mathematical Programming, 117 (2009), 51.  doi: 10.1007/s10107-007-0163-z.  Google Scholar [5] D. De Wolf and Y. Smeers, A stochastic version of a Stackelberg-Nash-Cournot equilibrium model,, Management Science, 43 (1997), 190.   Google Scholar [6] A. Fischer, A special Newton-type optimization method,, Optimization, 24 (1992), 269.  doi: 10.1080/02331939208843795.  Google Scholar [7] F. Facchinei and C. Kanzow, Generalized Nash equilibrium problems,, A Quarterly Journal of Operations Research, 5 (2007), 173.  doi: 10.1007/s10288-007-0054-4.  Google Scholar [8] F. Facchinei and J. S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problems,, Springer-Verlag, (2003).  doi: 10.1007/b97544.  Google Scholar [9] H. Fang, X. Chen and M. Fukushima, Stochastic $R_0$ matrix linear complementarity problems,, SIAM Journal on Optimization, 18 (2007), 482.  doi: 10.1137/050630805.  Google Scholar [10] G. Gürkan, A. Y. Özge and S. M. Robinson, Sample-path solution of stochastic variational inequalities,, Mathematical Programming, 84 (1999), 313.  doi: 10.1007/s101070050024.  Google Scholar [11] J. Gao and Y. Liu, Stochastic Nash equilibrium with a numerical solution method,, Computer Science, 3496 (2005), 811.  doi: 10.1007/11427391_130.  Google Scholar [12] J. B. Krawczyk, Numerical solutions to coupled-constraint (or generalised Nash) equilibrium problems,, Computational Management Science, 4 (2007), 183.  doi: 10.1007/s10287-006-0033-9.  Google Scholar [13] C. Ling, L. Qi, G. Zhou and L. Caccetta, The $SC^1$ property of an expected residual function arising from stochastic complementarity problems,, Operations Research Letters, 36 (2008), 456.  doi: 10.1016/j.orl.2008.01.010.  Google Scholar [14] G. H. Lin, X. Chen and M. Fukushima, New restricted NCP function and their applications to stochastic NCP and stochastic MPEC,, Optimization, 56 (2007), 641.  doi: 10.1080/02331930701617320.  Google Scholar [15] G. H. Lin and M. Fukushima, New reformulations for stochastic nonlinear complementarity problems,, Optimization Methods and Software, 21 (2006), 551.  doi: 10.1080/10556780600627610.  Google Scholar [16] P. Y. Li, Z. F. He and G. H. Lin, Sampling average approximation method for a class of stochastic Nash equilibrium problems,, Optimization Methods and Software, 28 (2013), 785.  doi: 10.1080/10556788.2012.750321.  Google Scholar [17] H. Mukaidani, Stochastic Nash equilibrium seeking for games with general nonlinear payoffs,, SIAM Journal on Control and Optimization, 49 (2011), 1659.  doi: 10.1137/100811738.  Google Scholar [18] H. Niederreiter, Random Number Generation and Quasi-Monte Carlo Methods,, Philadelphia, (1992).  doi: 10.1137/1.9781611970081.  Google Scholar [19] J. F. Nash, Non-Cooperative games,, Annals of Mathematics, 54 (1951), 286.  doi: 10.2307/1969529.  Google Scholar [20] R. T. Rockafellar and R. J. B.wets, Variational Analysis,, Springer-Verlag, (1998).  doi: 10.1007/978-3-642-02431-3.  Google Scholar [21] A. Shapiro, Monte Carlo sampling approch to stochastic programming,, European Series of Applied and Industrial Mathematics: Proceeding, 13 (2003), 65.   Google Scholar [22] A. Shapiro, Monte carlo sampling methods, stochastic programming,, Handbooks in Operations Research and Management Science, 10 (2003), 353.  doi: 10.1016/S0927-0507(03)10006-0.  Google Scholar [23] A. Shapiro and H. F. Xu, Stochasic mathematical programs with equiblbrium constraints, modelling and sample average approximation,, Optimization, 57 (2008), 395.  doi: 10.1080/02331930801954177.  Google Scholar [24] P. Tseng, Growth behavior of a class of merit functions for the nonlinear complementarity problem,, Journal of Optimization Theory and Applications, 89 (1996), 17.  doi: 10.1007/BF02192639.  Google Scholar [25] H. F. Xu and D. L. Zhang, Stochastic Nash equilibrium problems: Sample average approximation and applications,, Computational Optimization and Applications, 55 (2013), 597.  doi: 10.1007/s10589-013-9538-7.  Google Scholar [26] H. F. Xu and D. L. Zhang, Smooth sample average appproximation of stationary points in nonsmooth stochastic optimization and applications,, Mathematical Programming Series A, 119 (2009), 371.  doi: 10.1007/s10107-008-0214-0.  Google Scholar [27] Y. H. Yuan, L. W. Zhang and Y. Wu, A smoothing Newton method based on sample average approximation for a class of stochastic generalized Nash equilibrium problems,, Pacific Journal of Optimization, ().   Google Scholar [28] C. Zhang and X. Chen, Stochastic nonlinear complementarity problem and applications to traffic equilibrium under uncertainty,, Journal of Optimization Theory and Applications, 137 (2008), 277.  doi: 10.1007/s10957-008-9358-6.  Google Scholar

show all references

##### References:
 [1] J. R. Birge, Quasi-Monte Carlo Approaches to Option Pricing,, Technical Report 94-19, (1994), 94.   Google Scholar [2] F. H. Clarke, Optimization and Nonsmooth Analysis,, Wiley, (1983).   Google Scholar [3] X. Chen and M. Fukushima, Expected residual minimization method for stochastic linear complementarity problems,, Mathematics of Operations Research, 30 (2005), 1022.  doi: 10.1287/moor.1050.0160.  Google Scholar [4] X. Chen, C. Zhang and M. Fukushima, Robust solution of monotone stochastic linear complementarity problems,, Mathematical Programming, 117 (2009), 51.  doi: 10.1007/s10107-007-0163-z.  Google Scholar [5] D. De Wolf and Y. Smeers, A stochastic version of a Stackelberg-Nash-Cournot equilibrium model,, Management Science, 43 (1997), 190.   Google Scholar [6] A. Fischer, A special Newton-type optimization method,, Optimization, 24 (1992), 269.  doi: 10.1080/02331939208843795.  Google Scholar [7] F. Facchinei and C. Kanzow, Generalized Nash equilibrium problems,, A Quarterly Journal of Operations Research, 5 (2007), 173.  doi: 10.1007/s10288-007-0054-4.  Google Scholar [8] F. Facchinei and J. S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problems,, Springer-Verlag, (2003).  doi: 10.1007/b97544.  Google Scholar [9] H. Fang, X. Chen and M. Fukushima, Stochastic $R_0$ matrix linear complementarity problems,, SIAM Journal on Optimization, 18 (2007), 482.  doi: 10.1137/050630805.  Google Scholar [10] G. Gürkan, A. Y. Özge and S. M. Robinson, Sample-path solution of stochastic variational inequalities,, Mathematical Programming, 84 (1999), 313.  doi: 10.1007/s101070050024.  Google Scholar [11] J. Gao and Y. Liu, Stochastic Nash equilibrium with a numerical solution method,, Computer Science, 3496 (2005), 811.  doi: 10.1007/11427391_130.  Google Scholar [12] J. B. Krawczyk, Numerical solutions to coupled-constraint (or generalised Nash) equilibrium problems,, Computational Management Science, 4 (2007), 183.  doi: 10.1007/s10287-006-0033-9.  Google Scholar [13] C. Ling, L. Qi, G. Zhou and L. Caccetta, The $SC^1$ property of an expected residual function arising from stochastic complementarity problems,, Operations Research Letters, 36 (2008), 456.  doi: 10.1016/j.orl.2008.01.010.  Google Scholar [14] G. H. Lin, X. Chen and M. Fukushima, New restricted NCP function and their applications to stochastic NCP and stochastic MPEC,, Optimization, 56 (2007), 641.  doi: 10.1080/02331930701617320.  Google Scholar [15] G. H. Lin and M. Fukushima, New reformulations for stochastic nonlinear complementarity problems,, Optimization Methods and Software, 21 (2006), 551.  doi: 10.1080/10556780600627610.  Google Scholar [16] P. Y. Li, Z. F. He and G. H. Lin, Sampling average approximation method for a class of stochastic Nash equilibrium problems,, Optimization Methods and Software, 28 (2013), 785.  doi: 10.1080/10556788.2012.750321.  Google Scholar [17] H. Mukaidani, Stochastic Nash equilibrium seeking for games with general nonlinear payoffs,, SIAM Journal on Control and Optimization, 49 (2011), 1659.  doi: 10.1137/100811738.  Google Scholar [18] H. Niederreiter, Random Number Generation and Quasi-Monte Carlo Methods,, Philadelphia, (1992).  doi: 10.1137/1.9781611970081.  Google Scholar [19] J. F. Nash, Non-Cooperative games,, Annals of Mathematics, 54 (1951), 286.  doi: 10.2307/1969529.  Google Scholar [20] R. T. Rockafellar and R. J. B.wets, Variational Analysis,, Springer-Verlag, (1998).  doi: 10.1007/978-3-642-02431-3.  Google Scholar [21] A. Shapiro, Monte Carlo sampling approch to stochastic programming,, European Series of Applied and Industrial Mathematics: Proceeding, 13 (2003), 65.   Google Scholar [22] A. Shapiro, Monte carlo sampling methods, stochastic programming,, Handbooks in Operations Research and Management Science, 10 (2003), 353.  doi: 10.1016/S0927-0507(03)10006-0.  Google Scholar [23] A. Shapiro and H. F. Xu, Stochasic mathematical programs with equiblbrium constraints, modelling and sample average approximation,, Optimization, 57 (2008), 395.  doi: 10.1080/02331930801954177.  Google Scholar [24] P. Tseng, Growth behavior of a class of merit functions for the nonlinear complementarity problem,, Journal of Optimization Theory and Applications, 89 (1996), 17.  doi: 10.1007/BF02192639.  Google Scholar [25] H. F. Xu and D. L. Zhang, Stochastic Nash equilibrium problems: Sample average approximation and applications,, Computational Optimization and Applications, 55 (2013), 597.  doi: 10.1007/s10589-013-9538-7.  Google Scholar [26] H. F. Xu and D. L. Zhang, Smooth sample average appproximation of stationary points in nonsmooth stochastic optimization and applications,, Mathematical Programming Series A, 119 (2009), 371.  doi: 10.1007/s10107-008-0214-0.  Google Scholar [27] Y. H. Yuan, L. W. Zhang and Y. Wu, A smoothing Newton method based on sample average approximation for a class of stochastic generalized Nash equilibrium problems,, Pacific Journal of Optimization, ().   Google Scholar [28] C. Zhang and X. Chen, Stochastic nonlinear complementarity problem and applications to traffic equilibrium under uncertainty,, Journal of Optimization Theory and Applications, 137 (2008), 277.  doi: 10.1007/s10957-008-9358-6.  Google Scholar
 [1] Håkon Hoel, Gaukhar Shaimerdenova, Raúl Tempone. Multilevel Ensemble Kalman Filtering based on a sample average of independent EnKF estimators. Foundations of Data Science, 2020, 2 (4) : 351-390. doi: 10.3934/fods.2020017 [2] Bo Tan, Qinglong Zhou. Approximation properties of Lüroth expansions. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020389 [3] Yifan Chen, Thomas Y. Hou. Function approximation via the subsampled Poincaré inequality. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 169-199. doi: 10.3934/dcds.2020296 [4] Mostafa Mbekhta. Representation and approximation of the polar factor of an operator on a Hilbert space. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020463 [5] Bilal Al Taki, Khawla Msheik, Jacques Sainte-Marie. On the rigid-lid approximation of shallow water Bingham. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 875-905. doi: 10.3934/dcdsb.2020146 [6] P. K. Jha, R. Lipton. Finite element approximation of nonlocal dynamic fracture models. Discrete & Continuous Dynamical Systems - B, 2021, 26 (3) : 1675-1710. doi: 10.3934/dcdsb.2020178 [7] Simone Fagioli, Emanuela Radici. Opinion formation systems via deterministic particles approximation. Kinetic & Related Models, 2021, 14 (1) : 45-76. doi: 10.3934/krm.2020048 [8] Manuel Friedrich, Martin Kružík, Jan Valdman. Numerical approximation of von Kármán viscoelastic plates. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 299-319. doi: 10.3934/dcdss.2020322 [9] Baoli Yin, Yang Liu, Hong Li, Zhimin Zhang. Approximation methods for the distributed order calculus using the convolution quadrature. Discrete & Continuous Dynamical Systems - B, 2021, 26 (3) : 1447-1468. doi: 10.3934/dcdsb.2020168 [10] Jingjing Wang, Zaiyun Peng, Zhi Lin, Daqiong Zhou. On the stability of solutions for the generalized vector quasi-equilibrium problems via free-disposal set. Journal of Industrial & Management Optimization, 2021, 17 (2) : 869-887. doi: 10.3934/jimo.2020002 [11] Gheorghe Craciun, Jiaxin Jin, Casian Pantea, Adrian Tudorascu. Convergence to the complex balanced equilibrium for some chemical reaction-diffusion systems with boundary equilibria. Discrete & Continuous Dynamical Systems - B, 2021, 26 (3) : 1305-1335. doi: 10.3934/dcdsb.2020164 [12] Pierluigi Colli, Gianni Gilardi, Jürgen Sprekels. Deep quench approximation and optimal control of general Cahn–Hilliard systems with fractional operators and double obstacle potentials. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 243-271. doi: 10.3934/dcdss.2020213 [13] Michiyuki Watanabe. Inverse $N$-body scattering with the time-dependent hartree-fock approximation. Inverse Problems & Imaging, , () : -. doi: 10.3934/ipi.2021002 [14] Peter Frolkovič, Karol Mikula, Jooyoung Hahn, Dirk Martin, Branislav Basara. Flux balanced approximation with least-squares gradient for diffusion equation on polyhedral mesh. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 865-879. doi: 10.3934/dcdss.2020350 [15] Thomas Frenzel, Matthias Liero. Effective diffusion in thin structures via generalized gradient systems and EDP-convergence. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 395-425. doi: 10.3934/dcdss.2020345 [16] Xiaoli Lu, Pengzhan Huang, Yinnian He. Fully discrete finite element approximation of the 2D/3D unsteady incompressible magnetohydrodynamic-Voigt regularization flows. Discrete & Continuous Dynamical Systems - B, 2021, 26 (2) : 815-845. doi: 10.3934/dcdsb.2020143 [17] Shengxin Zhu, Tongxiang Gu, Xingping Liu. AIMS: Average information matrix splitting. Mathematical Foundations of Computing, 2020, 3 (4) : 301-308. doi: 10.3934/mfc.2020012 [18] Weinan E, Weiguo Gao. Orbital minimization with localization. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 249-264. doi: 10.3934/dcds.2009.23.249 [19] Manuel Friedrich, Martin Kružík, Ulisse Stefanelli. Equilibrium of immersed hyperelastic solids. Discrete & Continuous Dynamical Systems - S, 2021  doi: 10.3934/dcdss.2021003 [20] Monia Capanna, Jean C. Nakasato, Marcone C. Pereira, Julio D. Rossi. Homogenization for nonlocal problems with smooth kernels. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020385

2019 Impact Factor: 1.366