Dynamic optimal decision making for manufacturers with limited attention based on sparse dynamic programming

Previous Article
A potential reduction method for tensor complementarity problems
JIMO Home
This Issue
Next Article
Higher-order weak radial epiderivatives and non-convex set-valued optimization problems

April 2019, 15(2): 445-464. doi: 10.3934/jimo.2018050

Dynamic optimal decision making for manufacturers with limited attention based on sparse dynamic programming

Haiying Liu ^1,2, , Wenjie Bi ^2,, , Kok Lay Teo ^3, and Naxing Liu ^1,

1.	School of Accountancy, Hunan University of Finance and Economics, Changsha 410205, China
2.	Business School, Central South University, Changsha 410083, China
3.	Department of Mathematics and Statistics, Curtin University, Australia

* Corresponding author: beenjoy@126.com (Wenjie Bi)

Received June 2017 Revised January 2018 Published April 2018

Fund Project: This work is supported by National Natural Science Foundation of China, NO.91646115, 71371191, 71790615 71631008, and Natural Science Foundation of Hunan Province, NO.2018JJ3012

In a fully competitive industry, the market demand is changing rapidly. Thus, it is important for manufacturers to manage their inventory effectively as well as to determine the best order quantity and optimal production strategy. In this paper, our concern is how shall a manufacturer with limited attention determine his optimal order quantity and optimal production strategy in an environment when many factors are volatile, such as the price of raw materials (respectively, finished goods) and attrition rate of inventory of raw materials (respectively, finished product). Under this environment, it is observed, according to various empirical studies, that decision makers tend to focus their attention on factors with major changes. Taking all these into account, our problem is formulated as a discrete-time stochastic dynamic programming. We propose a general approach based on the sparse dynamic programming method to solve this multidimensional dynamic programming problem. From the numerical examples solved using the proposed method, it is interesting to observe that decision makers with limited attention do not adjust their final decision when the volatility is small.

Keywords: Dynamic optimization, limited attention, inventory management, sparse dynamic programming.

Mathematics Subject Classification: Primary: 1201; Secondary: 120100.

Citation: Haiying Liu, Wenjie Bi, Kok Lay Teo, Naxing Liu. Dynamic optimal decision making for manufacturers with limited attention based on sparse dynamic programming. Journal of Industrial & Management Optimization, 2019, 15 (2) : 445-464. doi: 10.3934/jimo.2018050

References:

[1]	A. B. Abel, J. C. Eberly and S. Panageas, Optimal inattention to the stock market with information costs and transactions costs, Econometrica, 81 (2013), 1455-1481. doi: 10.3982/ECTA7624. Google Scholar
[2]	R. Akella, V. F. Araman and J. Kleinknecht, B2B Markets: Procuremen and Supplier Risk Management in E-Business, in Supply chain management: models, applications, and research directions, Springer, (2005), 33-66. Google Scholar
[3]	P. Berling and V. Martínez-de-Albéniz, Optimal inventory policies when purchase price and demand are stochastic, Operations Research, 59 (2011), 109-124. doi: 10.1287/opre.1100.0862. Google Scholar
[4]	P. Berling and K. Rosling, The effects of financial risks on inventory policy, Management Science, 51 (2002), 1804-1815. doi: 10.1287/mnsc.1050.0435. Google Scholar
[5]	W. Bi, G. Li and M. Liu, Dynamic pricing with stochastic reference effects based on a finite memory window, International Journal of Production Research, 55 (2017), 3331-3348. doi: 10.1080/00207543.2016.1221160. Google Scholar
[6]	W. Bi, L. Tian, H. LIu and X. Chen, A stochastic dynamic programming approach based on bounded rationality and application to dynamic portfolio choice, Discrete Dynamics in Nature and Society, 2014 (2014), Article ID 840725, 11pages. Google Scholar
[7]	A. Bouras and L. Tadj, Production planning in a three-stock reverse-logistics system with deteriorating items under a continuous review policy, Journal of Industrial and Management Optimization, 11 (2015), 1041-1058. doi: 10.3934/jimo.2015.11.1041. Google Scholar
[8]	J.-M. Chen and C.-S. Lin, An optimal replenishment model for inventory items with normally distributed deterioration, Production Planning and Control, 13 (2002), 470-480. Google Scholar
[9]	S. K. Devalkar, R. Anupindi and A. Sinha, Integrated optimization of procurement, processing, and trade of commodities, Operations Research, 59 (2011), 1369-1381. doi: 10.1287/opre.1110.0959. Google Scholar
[10]	D. Duffie and T. Sun, Transactions costs and portfolio choice in a discrete-continuous-time setting, Journal of Economic Dynamics and Control, 14 (1990), 35-51. doi: 10.1016/0165-1889(90)90004-Z. Google Scholar
[11]	Q. Fu, C. Y. Lee and C. P. Teo, Procurement management using option contracts: Random spot price and the portfolio effect, IIE Transactions, 42 (2010), 793-811. Google Scholar
[12]	X. Gabaix, A sparsity-based model of bounded rationality, Quarterly Journal of Economics, 129 (2014), 1661-1710. doi: 10.3386/w16911. Google Scholar
[13]	X. Gabaix, Sparse Dynamic Programming and Aggregate Fluctuations, Working Paper, New York University, 2016.Google Scholar
[14]	V. Gaur and S. Seshadri, Hedging inventory risk through market instruments, Manufacturing and Service Operations Management, 7 (2005), 103-120. doi: 10.1287/msom.1040.0061. Google Scholar
[15]	S. Gavirneni, Periodic review inventory control with fluctuating purchasing costs, Operations Research Letters, 32 (2004), 374-379. doi: 10.1016/j.orl.2003.11.003. Google Scholar
[16]	S. Goyal and B. C. Giri, Recent trends in modeling of deteriorating inventory, European Journal of Operational Research, 134 (2001), 1-16. doi: 10.1016/S0377-2217(00)00248-4. Google Scholar
[17]	J. Jenkinson, Procurement in action, the efficio grassroots procurement survey 2011, Efficio Consulting, 2011.Google Scholar
[18]	D. Kahneman, Attention and Effort, Englewood Cliffs, N7T Prentice-Hall, 1973.Google Scholar
[19]	B. A. Kalymon, Stochastic prices in a single-item inventory purchasing model, Operations Research, 19 (1971), 1434-1458. doi: 10.1287/opre.19.6.1434. Google Scholar
[20]	M. Lashgari, A. A. Taleizadeh and S. S. Sana, An inventory control problem for deteriorating items with back-ordering and financial considerations under two levels of trade credit linked to order quantity, Journal of Industrial and Management Optimization, 12 (2016), 1091-1119. Google Scholar
[21]	H. Liu, X. Luo, W. Bi, Y. Man and K. L. Teo, Dynamic pricing of network goods in duopoly markets with boundedly rational consumers, J. Ind. Manag. Optim, 13 (2017), 427-445. Google Scholar
[22]	B. Mackowiak and M Wiederholt, Information processing and limited liability, The American Economic Review, 102 (2012), 30-34. doi: 10.1257/aer.102.3.30. Google Scholar
[23]	B. Mackowiak and M. Wiederholt, Inattention to Rare Events, 2015. Available at SSRN 2477548: https://ssrn.com/abstract=2650452.Google Scholar
[24]	F. Matejka and C. A. Sims, Discrete actions in information -constrained tracking problems, Princeton University Manuscript, (2011). doi: 10.2139/ssrn.1886640. Google Scholar
[25]	S. Nahmias and W. S. Demmy, Operating characteristics of an inventory system with rationing, Management Science, 27 (1981), 1236-1245. Google Scholar
[26]	F. Raafat, Survey of literature on continuously deteriorating inventory models, Journal of the Operational Research Society, 42 (1991), 27-37. Google Scholar
[27]	R. Reis, Inattentive consumers, Journal of Monetary Economics, 53 (2006), 1761-1800. doi: 10.3386/w10883. Google Scholar
[28]	J. Schwartzstein, Selective attention and learning, Journal of the European Economic Association, 12 (2014), 1423-1452. doi: 10.1111/jeea.12104. Google Scholar
[29]	K. Sebastian, A. Maessen and S. Strasmann, Mastering the Uniqueness of Commodity Pricing: How to Guide, Set and Control Prices, Simon-Kucher-Whitepaper, 2010.Google Scholar
[30]	N. H. Shah and Y. Shah, Literature survey on inventory models for deteriorating items, Ekonomski Anali, 44 (2000), 221-237. Google Scholar
[31]	C. A. Sims, Implications of rational inattention, Journal of Monetary Economics, 50 (2003), 665-690. doi: 10.1016/S0304-3932(03)00029-1. Google Scholar
[32]	B. Sivakumar, A perishable inventory system with retrial demands and a finite population, Journal of Computational and Applied Mathematics, 224 (2009), 29-38. doi: 10.1016/j.cam.2008.03.041. Google Scholar
[33]	T. M. Whitin, Inventory control and price theory, Management Science, 2 (1955), 61-68. doi: 10.1287/mnsc.2.1.61. Google Scholar
[34]	O. Q. Wu and H. Chen, Optimal control and equilibrium behavior of production-inventory systems, Management Science, 56 (2010), 1362-1379. doi: 10.1287/mnsc.1100.1186. Google Scholar
[35]	J. X. Zhang, Z. Y. Bai and W. S. Tang, Optimal pricing policy for deteriorating items with preservation technology investment, Journal of Industrial and Management Optimization, 10 (2014), 1261-1277. doi: 10.3934/jimo.2014.10.1261. Google Scholar
[36]	Y.-S. Zheng, Optimal control policy for stochastic inventory systems with Markovian discount opportunities, Operations Research, 42 (1994), 721-738. doi: 10.1287/opre.42.4.721. Google Scholar
[37]	P. Zipkin, Critical number policies for inventory models with periodic data, Management Science, 35 (1989), 71-80. doi: 10.1287/mnsc.35.1.71. Google Scholar

show all references

References:

[1]	A. B. Abel, J. C. Eberly and S. Panageas, Optimal inattention to the stock market with information costs and transactions costs, Econometrica, 81 (2013), 1455-1481. doi: 10.3982/ECTA7624. Google Scholar
[2]	R. Akella, V. F. Araman and J. Kleinknecht, B2B Markets: Procuremen and Supplier Risk Management in E-Business, in Supply chain management: models, applications, and research directions, Springer, (2005), 33-66. Google Scholar
[3]	P. Berling and V. Martínez-de-Albéniz, Optimal inventory policies when purchase price and demand are stochastic, Operations Research, 59 (2011), 109-124. doi: 10.1287/opre.1100.0862. Google Scholar
[4]	P. Berling and K. Rosling, The effects of financial risks on inventory policy, Management Science, 51 (2002), 1804-1815. doi: 10.1287/mnsc.1050.0435. Google Scholar
[5]	W. Bi, G. Li and M. Liu, Dynamic pricing with stochastic reference effects based on a finite memory window, International Journal of Production Research, 55 (2017), 3331-3348. doi: 10.1080/00207543.2016.1221160. Google Scholar
[6]	W. Bi, L. Tian, H. LIu and X. Chen, A stochastic dynamic programming approach based on bounded rationality and application to dynamic portfolio choice, Discrete Dynamics in Nature and Society, 2014 (2014), Article ID 840725, 11pages. Google Scholar
[7]	A. Bouras and L. Tadj, Production planning in a three-stock reverse-logistics system with deteriorating items under a continuous review policy, Journal of Industrial and Management Optimization, 11 (2015), 1041-1058. doi: 10.3934/jimo.2015.11.1041. Google Scholar
[8]	J.-M. Chen and C.-S. Lin, An optimal replenishment model for inventory items with normally distributed deterioration, Production Planning and Control, 13 (2002), 470-480. Google Scholar
[9]	S. K. Devalkar, R. Anupindi and A. Sinha, Integrated optimization of procurement, processing, and trade of commodities, Operations Research, 59 (2011), 1369-1381. doi: 10.1287/opre.1110.0959. Google Scholar
[10]	D. Duffie and T. Sun, Transactions costs and portfolio choice in a discrete-continuous-time setting, Journal of Economic Dynamics and Control, 14 (1990), 35-51. doi: 10.1016/0165-1889(90)90004-Z. Google Scholar
[11]	Q. Fu, C. Y. Lee and C. P. Teo, Procurement management using option contracts: Random spot price and the portfolio effect, IIE Transactions, 42 (2010), 793-811. Google Scholar
[12]	X. Gabaix, A sparsity-based model of bounded rationality, Quarterly Journal of Economics, 129 (2014), 1661-1710. doi: 10.3386/w16911. Google Scholar
[13]	X. Gabaix, Sparse Dynamic Programming and Aggregate Fluctuations, Working Paper, New York University, 2016.Google Scholar
[14]	V. Gaur and S. Seshadri, Hedging inventory risk through market instruments, Manufacturing and Service Operations Management, 7 (2005), 103-120. doi: 10.1287/msom.1040.0061. Google Scholar
[15]	S. Gavirneni, Periodic review inventory control with fluctuating purchasing costs, Operations Research Letters, 32 (2004), 374-379. doi: 10.1016/j.orl.2003.11.003. Google Scholar
[16]	S. Goyal and B. C. Giri, Recent trends in modeling of deteriorating inventory, European Journal of Operational Research, 134 (2001), 1-16. doi: 10.1016/S0377-2217(00)00248-4. Google Scholar
[17]	J. Jenkinson, Procurement in action, the efficio grassroots procurement survey 2011, Efficio Consulting, 2011.Google Scholar
[18]	D. Kahneman, Attention and Effort, Englewood Cliffs, N7T Prentice-Hall, 1973.Google Scholar
[19]	B. A. Kalymon, Stochastic prices in a single-item inventory purchasing model, Operations Research, 19 (1971), 1434-1458. doi: 10.1287/opre.19.6.1434. Google Scholar
[20]	M. Lashgari, A. A. Taleizadeh and S. S. Sana, An inventory control problem for deteriorating items with back-ordering and financial considerations under two levels of trade credit linked to order quantity, Journal of Industrial and Management Optimization, 12 (2016), 1091-1119. Google Scholar
[21]	H. Liu, X. Luo, W. Bi, Y. Man and K. L. Teo, Dynamic pricing of network goods in duopoly markets with boundedly rational consumers, J. Ind. Manag. Optim, 13 (2017), 427-445. Google Scholar
[22]	B. Mackowiak and M Wiederholt, Information processing and limited liability, The American Economic Review, 102 (2012), 30-34. doi: 10.1257/aer.102.3.30. Google Scholar
[23]	B. Mackowiak and M. Wiederholt, Inattention to Rare Events, 2015. Available at SSRN 2477548: https://ssrn.com/abstract=2650452.Google Scholar
[24]	F. Matejka and C. A. Sims, Discrete actions in information -constrained tracking problems, Princeton University Manuscript, (2011). doi: 10.2139/ssrn.1886640. Google Scholar
[25]	S. Nahmias and W. S. Demmy, Operating characteristics of an inventory system with rationing, Management Science, 27 (1981), 1236-1245. Google Scholar
[26]	F. Raafat, Survey of literature on continuously deteriorating inventory models, Journal of the Operational Research Society, 42 (1991), 27-37. Google Scholar
[27]	R. Reis, Inattentive consumers, Journal of Monetary Economics, 53 (2006), 1761-1800. doi: 10.3386/w10883. Google Scholar
[28]	J. Schwartzstein, Selective attention and learning, Journal of the European Economic Association, 12 (2014), 1423-1452. doi: 10.1111/jeea.12104. Google Scholar
[29]	K. Sebastian, A. Maessen and S. Strasmann, Mastering the Uniqueness of Commodity Pricing: How to Guide, Set and Control Prices, Simon-Kucher-Whitepaper, 2010.Google Scholar
[30]	N. H. Shah and Y. Shah, Literature survey on inventory models for deteriorating items, Ekonomski Anali, 44 (2000), 221-237. Google Scholar
[31]	C. A. Sims, Implications of rational inattention, Journal of Monetary Economics, 50 (2003), 665-690. doi: 10.1016/S0304-3932(03)00029-1. Google Scholar
[32]	B. Sivakumar, A perishable inventory system with retrial demands and a finite population, Journal of Computational and Applied Mathematics, 224 (2009), 29-38. doi: 10.1016/j.cam.2008.03.041. Google Scholar
[33]	T. M. Whitin, Inventory control and price theory, Management Science, 2 (1955), 61-68. doi: 10.1287/mnsc.2.1.61. Google Scholar
[34]	O. Q. Wu and H. Chen, Optimal control and equilibrium behavior of production-inventory systems, Management Science, 56 (2010), 1362-1379. doi: 10.1287/mnsc.1100.1186. Google Scholar
[35]	J. X. Zhang, Z. Y. Bai and W. S. Tang, Optimal pricing policy for deteriorating items with preservation technology investment, Journal of Industrial and Management Optimization, 10 (2014), 1261-1277. doi: 10.3934/jimo.2014.10.1261. Google Scholar
[36]	Y.-S. Zheng, Optimal control policy for stochastic inventory systems with Markovian discount opportunities, Operations Research, 42 (1994), 721-738. doi: 10.1287/opre.42.4.721. Google Scholar
[37]	P. Zipkin, Critical number policies for inventory models with periodic data, Management Science, 35 (1989), 71-80. doi: 10.1287/mnsc.35.1.71. Google Scholar

Figure 1. Production inventory system

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2. Attention function

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3. Truncation function

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4. The influence of ${\hat p_1}$ on $\lambda$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5. The influence of ${\hat p_2}$ on $\lambda$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6. The influence of ${\hat \theta _1}$ on $\lambda$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 7. The influence of ${\hat p_1}$ on $q$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 8. The influence of ${\hat p_2}$ on $q$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 9. The influence of ${\hat \theta _1}$ on $q$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 10. The influence of ${\hat \theta _2}$ on $q$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 11. The influence of ${\hat p_1}$ on $s$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 12. The influence of ${\hat p_2}$ on $s$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 13. The influence of ${\hat \theta _2}$ on $s$

Figure Options

Download full-size image

Download as PowerPoint slide

[1]	Andrzej Nowakowski, Jan Sokolowski. On dual dynamic programming in shape control. Communications on Pure & Applied Analysis, 2012, 11 (6) : 2473-2485. doi: 10.3934/cpaa.2012.11.2473
[2]	Jérôme Renault. General limit value in dynamic programming. Journal of Dynamics & Games, 2014, 1 (3) : 471-484. doi: 10.3934/jdg.2014.1.471
[3]	Oliver Junge, Alex Schreiber. Dynamic programming using radial basis functions. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 4439-4453. doi: 10.3934/dcds.2015.35.4439
[4]	Eduardo Espinosa-Avila, Pablo Padilla Longoria, Francisco Hernández-Quiroz. Game theory and dynamic programming in alternate games. Journal of Dynamics & Games, 2017, 4 (3) : 205-216. doi: 10.3934/jdg.2017013
[5]	Rein Luus. Optimal control of oscillatory systems by iterative dynamic programming. Journal of Industrial & Management Optimization, 2008, 4 (1) : 1-15. doi: 10.3934/jimo.2008.4.1
[6]	Qing Liu, Armin Schikorra. General existence of solutions to dynamic programming equations. Communications on Pure & Applied Analysis, 2015, 14 (1) : 167-184. doi: 10.3934/cpaa.2015.14.167
[7]	Xianchao Xiu, Lingchen Kong. Rank-one and sparse matrix decomposition for dynamic MRI. Numerical Algebra, Control & Optimization, 2015, 5 (2) : 127-134. doi: 10.3934/naco.2015.5.127
[8]	Shi'an Wang, N. U. Ahmed. Optimum management of the network of city bus routes based on a stochastic dynamic model. Journal of Industrial & Management Optimization, 2019, 15 (2) : 619-631. doi: 10.3934/jimo.2018061
[9]	Ryan Loxton, Qun Lin. Optimal fleet composition via dynamic programming and golden section search. Journal of Industrial & Management Optimization, 2011, 7 (4) : 875-890. doi: 10.3934/jimo.2011.7.875
[10]	Amin Aalaei, Hamid Davoudpour. Two bounds for integrating the virtual dynamic cellular manufacturing problem into supply chain management. Journal of Industrial & Management Optimization, 2016, 12 (3) : 907-930. doi: 10.3934/jimo.2016.12.907
[11]	Bruce D. Craven, Sardar M. N. Islam. Dynamic optimization models in finance: Some extensions to the framework, models, and computation. Journal of Industrial & Management Optimization, 2014, 10 (4) : 1129-1146. doi: 10.3934/jimo.2014.10.1129
[12]	Fuying Jing, Zirui Lan, Yang Pan. Forecast horizon of dynamic lot size model for perishable inventory with minimum order quantities. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-22. doi: 10.3934/jimo.2019010
[13]	Matthew H. Henry, Yacov Y. Haimes. Robust multiobjective dynamic programming: Minimax envelopes for efficient decisionmaking under scenario uncertainty. Journal of Industrial & Management Optimization, 2009, 5 (4) : 791-824. doi: 10.3934/jimo.2009.5.791
[14]	Martino Bardi, Shigeaki Koike, Pierpaolo Soravia. Pursuit-evasion games with state constraints: dynamic programming and discrete-time approximations. Discrete & Continuous Dynamical Systems - A, 2000, 6 (2) : 361-380. doi: 10.3934/dcds.2000.6.361
[15]	Silvia Faggian. Boundary control problems with convex cost and dynamic programming in infinite dimension part II: Existence for HJB. Discrete & Continuous Dynamical Systems - A, 2005, 12 (2) : 323-346. doi: 10.3934/dcds.2005.12.323
[16]	Guy Barles, Ariela Briani, Emmanuel Trélat. Value function for regional control problems via dynamic programming and Pontryagin maximum principle. Mathematical Control & Related Fields, 2018, 8 (3&4) : 509-533. doi: 10.3934/mcrf.2018021
[17]	Haibo Jin, Long Hai, Xiaoliang Tang. An optimal maintenance strategy for multi-state systems based on a system linear integral equation and dynamic programming. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-26. doi: 10.3934/jimo.2018188
[18]	Yeong-Cheng Liou, Siegfried Schaible, Jen-Chih Yao. Supply chain inventory management via a Stackelberg equilibrium. Journal of Industrial & Management Optimization, 2006, 2 (1) : 81-94. doi: 10.3934/jimo.2006.2.81
[19]	Jian-Wu Xue, Xiao-Kun Xu, Feng Zhang. Big data dynamic compressive sensing system architecture and optimization algorithm for internet of things. Discrete & Continuous Dynamical Systems - S, 2015, 8 (6) : 1401-1414. doi: 10.3934/dcdss.2015.8.1401
[20]	Harald Held, Gabriela Martinez, Philipp Emanuel Stelzig. Stochastic programming approach for energy management in electric microgrids. Numerical Algebra, Control & Optimization, 2014, 4 (3) : 241-267. doi: 10.3934/naco.2014.4.241

2018 Impact Factor: 1.025

Tools

Metrics

Tools

Article outline

Figures and Tables

2018 Impact Factor: 1.025

Tools

Figures and Tables

2018 Impact Factor: 1.025

American Institute of Mathematical Sciences