# American Institute of Mathematical Sciences

• Previous Article
Optimal production schedule in a single-supplier multi-manufacturer supply chain involving time delays in both levels
• JIMO Home
• This Issue
• Next Article
Linearized block-wise alternating direction method of multipliers for multiple-block convex programming
July  2018, 14(3): 857-876. doi: 10.3934/jimo.2017079

## Ergodic control for a mean reverting inventory model

 1 School of Insurance, Central University of Finance and Economics, Beijing 100081, China 2 Department of Applied Mathematics, The Hong Kong Polytechnic University, Hunghom, Kowloon, Hong Kong, China 3 Department of Systems Engineering and Engineering Management, City University of Hong Kong, Kowloon Tong, Hong Kong, China 4 Naveen Jindal School of Management, University of Texas at Dallas, USA

Received  May 2015 Revised  August 2017 Published  September 2017

Fund Project: This research is supported by Natural and Science Natural Foundation of China(11771466,11301559,11471171), the 111 project(B17050), the National Science Foundation under grants DMS-1303775, DMS-1612880, and the Research Grants Council of the Hong Kong Special Administrative Region (CityU 500113, CityU 113 03 316). The second author is supported by PolyU grant G-YBKM.

In this paper, an inventory control problem with a mean reverting inventory model is considered. The demand is assumed to follow a continuous diffusion process and a mean-reverting process which will take into account of the demand dependent of the inventory level. By choosing when and how much to stock, the objective is to minimize the long-run average cost, which consists of transaction cost for each replenishment, holding and shortage costs associated with the inventory level. An approach for deriving the average cost value of infinite time horizon is developed. By applying the theory of stochastic impulse control, we show that a unique (s, S) policy is indeed optimal. The main contribution of this work is to present a method to derive the (s, S) policy and hence the minimal long-run average cost.

Citation: Jingzhen Liu, Ka Fai Cedric Yiu, Alain Bensoussan. Ergodic control for a mean reverting inventory model. Journal of Industrial & Management Optimization, 2018, 14 (3) : 857-876. doi: 10.3934/jimo.2017079
##### References:
 [1] S. Axsater, Inventory Control, Third edition. International Series in Operations Research & Management Science, 225. Springer, Cham, 2015. doi: 10.1007/978-3-319-15729-0.  Google Scholar [2] D. Beyer and S. P. Sethi, Average cost optimality in inventory models with Markovian demands, Journal of Optimization Theory and Applications, 92 (1997), 497-526.  doi: 10.1023/A:1022651322174.  Google Scholar [3] D. Beyer, S. P. Sethi and M. Taksar, Inventory models with Markovian demands and cost functions of polynomial growth, Journal of Optimization Theory and Applications, 98 (1998), 281-323.  doi: 10.1023/A:1022633400174.  Google Scholar [4] A. Bensoussan, Dynamic Programming and Inventory Control, IOS Press, 2011.  Google Scholar [5] A. Cadenillas, P. Lakner and M. Pinedo, Optimal control of a mean-reverting inventory, Operations Research, 58 (2010), 1697-1710.  doi: 10.1287/opre.1100.0835.  Google Scholar [6] C. Dellacherie and P. A. Meyer, Probabilites et Potentiel. Theorie des Martingales, Hermann, Paris, 1975.  Google Scholar [7] P. L. Fackler and M. J. Livingston, Optimal storage by crop producers, American Journal of Agricultural Economics, 84 (2002), 645-659.  doi: 10.1111/1467-8276.00325.  Google Scholar [8] S. K. Goyal and B. C. Giri, Recent trends in modeling of deteriorating inventory, European Journal of Operational Research, 134 (2001), 1-16.  doi: 10.1016/S0377-2217(00)00248-4.  Google Scholar [9] B. Hogaard and M. Taksar, Controlling risk exposure and dividends payout schemes: Insurance company example, Mathematical Finance, 9 (1999), 153-182.  doi: 10.1111/1467-9965.00066.  Google Scholar [10] R. H. Hollier, K. L. Mak and K. F. C. Yiu, Optimal inventory control of lumpy demand items using (s, S) policies with a maximum issue quantity restriction and opportunistic replenishments, International Journal of Production Research, 43 (2005), 4929-4944.  doi: 10.1080/00207540500218967.  Google Scholar [11] J. Jacod and A. N. Shiryaev, Limit theorems for Stochastic Processes, Springer-Verlag, Berlin, 2003. doi: 10.1007/978-3-662-05265-5.  Google Scholar [12] S. S. Ko, J. Kang and E. Y. Kwon, An (s, S) inventory model with level-dependent G/M/1-Type structure, Journal of Industrial and Management Optimization, 12 (2016), 609-624.  doi: 10.3934/jimo.2016.12.609.  Google Scholar [13] P. Kouvelis, R. Li and Q. Ding, Managing storable commodity risks: The role of inventory and financial hedge, Manufacturing & Service Operations Management, 15 (2013), 507-521.  doi: 10.1002/9781118115800.ch6.  Google Scholar [14] J. Z. Liu, K. F. C. Yiu and L. H. Bai, Minimizing the ruin probability with a risk constraint, Journal of industrial and management optimization, 8 (2012), 531-547.  doi: 10.3934/jimo.2012.8.531.  Google Scholar [15] K. L. Mak, K. K. Lai, W. C. Ng and K. F. C. Yiu, Analysis of optimal opportunistic replenishment policies for inventory systems by using a (s, S) model with a maximum issue quantity restriction, European Journal of Operational Research, 166 (2005), 385-405.  doi: 10.1016/j.ejor.2002.05.001.  Google Scholar [16] M. Ormeci, J. G. Dai and J. Vande Vate, Impulse control of Brownian motion: The constrained average cost case, Operations Research, 56 (2008), 618-629.  doi: 10.1287/opre.1060.0380.  Google Scholar [17] E. L. Porteus, Foundations of Stochastic Inventory Theory, Stanford Business Books, Stanford, 2002. Google Scholar [18] E. Presman and S. P. Sethi, Stochastic inventory models with continuous and Poisson demands and discounted and average costs, Production and Operations Management, 15 (2004), 279-293.   Google Scholar [19] F. Raafat, Survey of literature on continuously deteriorating inventory models, Journal of the Operational Research Society, 42 (1991), 27-37.   Google Scholar [20] L. Schwartz, The Economic Order-Quantity (EOQ) Model, D. Chhajed & T. J. Lowe (Ed. ), Building Intuition: Insights From Basic Operations Management Models and Principles, Springer US, 2008. Google Scholar [21] S. P. Sethi, W. Suo, M. I. Taksar and H. Yan, Optimal production planning in a multi-product stochastic manufacturing system with long-run average cost, Discrete Event Dynamic Systems, 8 (1998), 37-54.  doi: 10.1023/A:1008256409920.  Google Scholar [22] S. P. Sethi, H. Zhang and Q. Zhang, Minimum average cost production planning in stochastic manufacturing systems, Mathematical Models and Methods in Applied Sciences, 8 (1998), 1251-1276.  doi: 10.1142/S0218202598000585.  Google Scholar [23] A. Sulem, A solvable one-dimensional model of a diffusion inventory system, Mathematics of Operations Research, 11 (1986), 125-133.  doi: 10.1287/moor.11.1.125.  Google Scholar [24] M. I. Taksar, Average optimal singular control and a related stopping problem, Mathematics of Operations Research, 10 (1985), 63-81.  doi: 10.1287/moor.10.1.63.  Google Scholar [25] S. Y. Wang, K. F. C. Yiu and K. L. Mak, Optimal inventory policy with fixed and proportional transaction costs under a risk constraint, Mathematical and Computer Modelling, 58 (2013), 1595-1614.  doi: 10.1016/j.mcm.2012.03.009.  Google Scholar [26] C. D. J. Waters, Inventory Control and Management, $2^{nd}$ Ed. , John Wiley & Sons, Chichester, 2003. Google Scholar [27] T. Weston, Applying stochastic dynamic programming to the valuation of gas storage and generation assets, In E. Ronn (ed. ), Real Options and Energy Management Using Options Methodology to Enhance Capital Budgeting Decisions, Risk Publications, London, 2002. Google Scholar [28] T. Wild, Best Practice in Inventory Management, $2^{nd}$ Ed. , Butterworth Heinemann, Oxford, 2002. Google Scholar [29] J. C. Williams and B. D. Wright, Storage and Commodity Markets, Cambridge University Press, 1991. doi: 10.1017/CBO9780511571855.  Google Scholar [30] H. L. Xu, P. Sui, G. L. Zhou and L. Caccetta, Dampening bullwhip effect of order-up-to inventory strategies via an optimal control method, Numerical Algebra, Control and Optimization, 3 (2013), 655-664.  doi: 10.3934/naco.2013.3.655.  Google Scholar [31] K. F. C. Yiu, S. Y. Wang and K. L. Mak, Optimal portfolios under a value-at-risk constraint with applications to inventory control in supply chains, Journal of Industrial and Management Optimization, 4 (2008), 81-94.  doi: 10.3934/jimo.2008.4.81.  Google Scholar [32] K. F. C. Yiu, L. L. Xie and K. L. Mak, Analysis of bullwhip effect in supply chains with heterogeneous decision models, Journal of Industrial and Management Optimization, 5 (2009), 81-94.  doi: 10.3934/jimo.2009.5.81.  Google Scholar [33] Y. S. Zheng, A simple proof for optimality of (s; s) policies in infinite-horizon inventory systems, Journal of Applied Probability, 28 (1991), 802-810.  doi: 10.1017/S0021900200042716.  Google Scholar [34] P. H. Zipkin, Foundations of Inventory Management, McGraw-Hill/Irwin, 2000. Google Scholar

show all references

##### References:
 [1] S. Axsater, Inventory Control, Third edition. International Series in Operations Research & Management Science, 225. Springer, Cham, 2015. doi: 10.1007/978-3-319-15729-0.  Google Scholar [2] D. Beyer and S. P. Sethi, Average cost optimality in inventory models with Markovian demands, Journal of Optimization Theory and Applications, 92 (1997), 497-526.  doi: 10.1023/A:1022651322174.  Google Scholar [3] D. Beyer, S. P. Sethi and M. Taksar, Inventory models with Markovian demands and cost functions of polynomial growth, Journal of Optimization Theory and Applications, 98 (1998), 281-323.  doi: 10.1023/A:1022633400174.  Google Scholar [4] A. Bensoussan, Dynamic Programming and Inventory Control, IOS Press, 2011.  Google Scholar [5] A. Cadenillas, P. Lakner and M. Pinedo, Optimal control of a mean-reverting inventory, Operations Research, 58 (2010), 1697-1710.  doi: 10.1287/opre.1100.0835.  Google Scholar [6] C. Dellacherie and P. A. Meyer, Probabilites et Potentiel. Theorie des Martingales, Hermann, Paris, 1975.  Google Scholar [7] P. L. Fackler and M. J. Livingston, Optimal storage by crop producers, American Journal of Agricultural Economics, 84 (2002), 645-659.  doi: 10.1111/1467-8276.00325.  Google Scholar [8] S. K. Goyal and B. C. Giri, Recent trends in modeling of deteriorating inventory, European Journal of Operational Research, 134 (2001), 1-16.  doi: 10.1016/S0377-2217(00)00248-4.  Google Scholar [9] B. Hogaard and M. Taksar, Controlling risk exposure and dividends payout schemes: Insurance company example, Mathematical Finance, 9 (1999), 153-182.  doi: 10.1111/1467-9965.00066.  Google Scholar [10] R. H. Hollier, K. L. Mak and K. F. C. Yiu, Optimal inventory control of lumpy demand items using (s, S) policies with a maximum issue quantity restriction and opportunistic replenishments, International Journal of Production Research, 43 (2005), 4929-4944.  doi: 10.1080/00207540500218967.  Google Scholar [11] J. Jacod and A. N. Shiryaev, Limit theorems for Stochastic Processes, Springer-Verlag, Berlin, 2003. doi: 10.1007/978-3-662-05265-5.  Google Scholar [12] S. S. Ko, J. Kang and E. Y. Kwon, An (s, S) inventory model with level-dependent G/M/1-Type structure, Journal of Industrial and Management Optimization, 12 (2016), 609-624.  doi: 10.3934/jimo.2016.12.609.  Google Scholar [13] P. Kouvelis, R. Li and Q. Ding, Managing storable commodity risks: The role of inventory and financial hedge, Manufacturing & Service Operations Management, 15 (2013), 507-521.  doi: 10.1002/9781118115800.ch6.  Google Scholar [14] J. Z. Liu, K. F. C. Yiu and L. H. Bai, Minimizing the ruin probability with a risk constraint, Journal of industrial and management optimization, 8 (2012), 531-547.  doi: 10.3934/jimo.2012.8.531.  Google Scholar [15] K. L. Mak, K. K. Lai, W. C. Ng and K. F. C. Yiu, Analysis of optimal opportunistic replenishment policies for inventory systems by using a (s, S) model with a maximum issue quantity restriction, European Journal of Operational Research, 166 (2005), 385-405.  doi: 10.1016/j.ejor.2002.05.001.  Google Scholar [16] M. Ormeci, J. G. Dai and J. Vande Vate, Impulse control of Brownian motion: The constrained average cost case, Operations Research, 56 (2008), 618-629.  doi: 10.1287/opre.1060.0380.  Google Scholar [17] E. L. Porteus, Foundations of Stochastic Inventory Theory, Stanford Business Books, Stanford, 2002. Google Scholar [18] E. Presman and S. P. Sethi, Stochastic inventory models with continuous and Poisson demands and discounted and average costs, Production and Operations Management, 15 (2004), 279-293.   Google Scholar [19] F. Raafat, Survey of literature on continuously deteriorating inventory models, Journal of the Operational Research Society, 42 (1991), 27-37.   Google Scholar [20] L. Schwartz, The Economic Order-Quantity (EOQ) Model, D. Chhajed & T. J. Lowe (Ed. ), Building Intuition: Insights From Basic Operations Management Models and Principles, Springer US, 2008. Google Scholar [21] S. P. Sethi, W. Suo, M. I. Taksar and H. Yan, Optimal production planning in a multi-product stochastic manufacturing system with long-run average cost, Discrete Event Dynamic Systems, 8 (1998), 37-54.  doi: 10.1023/A:1008256409920.  Google Scholar [22] S. P. Sethi, H. Zhang and Q. Zhang, Minimum average cost production planning in stochastic manufacturing systems, Mathematical Models and Methods in Applied Sciences, 8 (1998), 1251-1276.  doi: 10.1142/S0218202598000585.  Google Scholar [23] A. Sulem, A solvable one-dimensional model of a diffusion inventory system, Mathematics of Operations Research, 11 (1986), 125-133.  doi: 10.1287/moor.11.1.125.  Google Scholar [24] M. I. Taksar, Average optimal singular control and a related stopping problem, Mathematics of Operations Research, 10 (1985), 63-81.  doi: 10.1287/moor.10.1.63.  Google Scholar [25] S. Y. Wang, K. F. C. Yiu and K. L. Mak, Optimal inventory policy with fixed and proportional transaction costs under a risk constraint, Mathematical and Computer Modelling, 58 (2013), 1595-1614.  doi: 10.1016/j.mcm.2012.03.009.  Google Scholar [26] C. D. J. Waters, Inventory Control and Management, $2^{nd}$ Ed. , John Wiley & Sons, Chichester, 2003. Google Scholar [27] T. Weston, Applying stochastic dynamic programming to the valuation of gas storage and generation assets, In E. Ronn (ed. ), Real Options and Energy Management Using Options Methodology to Enhance Capital Budgeting Decisions, Risk Publications, London, 2002. Google Scholar [28] T. Wild, Best Practice in Inventory Management, $2^{nd}$ Ed. , Butterworth Heinemann, Oxford, 2002. Google Scholar [29] J. C. Williams and B. D. Wright, Storage and Commodity Markets, Cambridge University Press, 1991. doi: 10.1017/CBO9780511571855.  Google Scholar [30] H. L. Xu, P. Sui, G. L. Zhou and L. Caccetta, Dampening bullwhip effect of order-up-to inventory strategies via an optimal control method, Numerical Algebra, Control and Optimization, 3 (2013), 655-664.  doi: 10.3934/naco.2013.3.655.  Google Scholar [31] K. F. C. Yiu, S. Y. Wang and K. L. Mak, Optimal portfolios under a value-at-risk constraint with applications to inventory control in supply chains, Journal of Industrial and Management Optimization, 4 (2008), 81-94.  doi: 10.3934/jimo.2008.4.81.  Google Scholar [32] K. F. C. Yiu, L. L. Xie and K. L. Mak, Analysis of bullwhip effect in supply chains with heterogeneous decision models, Journal of Industrial and Management Optimization, 5 (2009), 81-94.  doi: 10.3934/jimo.2009.5.81.  Google Scholar [33] Y. S. Zheng, A simple proof for optimality of (s; s) policies in infinite-horizon inventory systems, Journal of Applied Probability, 28 (1991), 802-810.  doi: 10.1017/S0021900200042716.  Google Scholar [34] P. H. Zipkin, Foundations of Inventory Management, McGraw-Hill/Irwin, 2000. Google Scholar
 [1] Wan-Hua He, Chufang Wu, Jia-Wen Gu, Wai-Ki Ching, Chi-Wing Wong. Pricing vulnerable options under a jump-diffusion model with fast mean-reverting stochastic volatility. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021057 [2] Luke Finlay, Vladimir Gaitsgory, Ivan Lebedev. Linear programming solutions of periodic optimization problems: approximation of the optimal control. Journal of Industrial & Management Optimization, 2007, 3 (2) : 399-413. doi: 10.3934/jimo.2007.3.399 [3] Kehan Si, Zhenda Xu, Ka Fai Cedric Yiu, Xun Li. Open-loop solvability for mean-field stochastic linear quadratic optimal control problems of Markov regime-switching system. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021074 [4] J. Frédéric Bonnans, Justina Gianatti, Francisco J. Silva. On the convergence of the Sakawa-Shindo algorithm in stochastic control. Mathematical Control & Related Fields, 2016, 6 (3) : 391-406. doi: 10.3934/mcrf.2016008 [5] Diana Keller. Optimal control of a linear stochastic Schrödinger equation. Conference Publications, 2013, 2013 (special) : 437-446. doi: 10.3934/proc.2013.2013.437 [6] Vladimir Gaitsgory, Ilya Shvartsman. Linear programming estimates for Cesàro and Abel limits of optimal values in optimal control problems. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021102 [7] Qi Lü, Xu Zhang. A concise introduction to control theory for stochastic partial differential equations. Mathematical Control & Related Fields, 2021  doi: 10.3934/mcrf.2021020 [8] Paula A. González-Parra, Sunmi Lee, Leticia Velázquez, Carlos Castillo-Chavez. A note on the use of optimal control on a discrete time model of influenza dynamics. Mathematical Biosciences & Engineering, 2011, 8 (1) : 183-197. doi: 10.3934/mbe.2011.8.183 [9] Guirong Jiang, Qishao Lu. The dynamics of a Prey-Predator model with impulsive state feedback control. Discrete & Continuous Dynamical Systems - B, 2006, 6 (6) : 1301-1320. doi: 10.3934/dcdsb.2006.6.1301 [10] A. K. Misra, Anupama Sharma, Jia Li. A mathematical model for control of vector borne diseases through media campaigns. Discrete & Continuous Dynamical Systems - B, 2013, 18 (7) : 1909-1927. doi: 10.3934/dcdsb.2013.18.1909 [11] Mohammed Abdelghany, Amr B. Eltawil, Zakaria Yahia, Kazuhide Nakata. A hybrid variable neighbourhood search and dynamic programming approach for the nurse rostering problem. Journal of Industrial & Management Optimization, 2021, 17 (4) : 2051-2072. doi: 10.3934/jimo.2020058 [12] Shanjian Tang, Fu Zhang. Path-dependent optimal stochastic control and viscosity solution of associated Bellman equations. Discrete & Continuous Dynamical Systems, 2015, 35 (11) : 5521-5553. doi: 10.3934/dcds.2015.35.5521 [13] Xue Qiao, Zheng Wang, Haoxun Chen. Joint optimal pricing and inventory management policy and its sensitivity analysis for perishable products: lost sale case. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021079 [14] Martin Bohner, Sabrina Streipert. Optimal harvesting policy for the Beverton--Holt model. Mathematical Biosciences & Engineering, 2016, 13 (4) : 673-695. doi: 10.3934/mbe.2016014 [15] Peter Benner, Jens Saak, M. Monir Uddin. Balancing based model reduction for structured index-2 unstable descriptor systems with application to flow control. Numerical Algebra, Control & Optimization, 2016, 6 (1) : 1-20. doi: 10.3934/naco.2016.6.1 [16] Lars Grüne, Luca Mechelli, Simon Pirkelmann, Stefan Volkwein. Performance estimates for economic model predictive control and their application in proper orthogonal decomposition-based implementations. Mathematical Control & Related Fields, 2021  doi: 10.3934/mcrf.2021013 [17] Andrea Signori. Penalisation of long treatment time and optimal control of a tumour growth model of Cahn–Hilliard type with singular potential. Discrete & Continuous Dynamical Systems, 2021, 41 (6) : 2519-2542. doi: 10.3934/dcds.2020373 [18] Yves Dumont, Frederic Chiroleu. Vector control for the Chikungunya disease. Mathematical Biosciences & Engineering, 2010, 7 (2) : 313-345. doi: 10.3934/mbe.2010.7.313 [19] Wensheng Yin, Jinde Cao, Guoqiang Zheng. Further results on stabilization of stochastic differential equations with delayed feedback control under $G$-expectation framework. Discrete & Continuous Dynamical Systems - B, 2021  doi: 10.3934/dcdsb.2021072 [20] Ardeshir Ahmadi, Hamed Davari-Ardakani. A multistage stochastic programming framework for cardinality constrained portfolio optimization. Numerical Algebra, Control & Optimization, 2017, 7 (3) : 359-377. doi: 10.3934/naco.2017023

2019 Impact Factor: 1.366