Dynamic optimal decision making for manufacturers with limited attention based on sparse dynamic programming

Previous Article
A potential reduction method for tensor complementarity problems
JIMO Home
This Issue
Next Article
Higher-order weak radial epiderivatives and non-convex set-valued optimization problems

April 2019, 15(2): 445-464. doi: 10.3934/jimo.2018050

Dynamic optimal decision making for manufacturers with limited attention based on sparse dynamic programming

Haiying Liu ^1,2, , Wenjie Bi ^2,, , Kok Lay Teo ^3, and Naxing Liu ^1,

1.	School of Accountancy, Hunan University of Finance and Economics, Changsha 410205, China
2.	Business School, Central South University, Changsha 410083, China
3.	Department of Mathematics and Statistics, Curtin University, Australia

* Corresponding author: beenjoy@126.com (Wenjie Bi)

Received June 2017 Revised January 2018 Published April 2018

Fund Project: This work is supported by National Natural Science Foundation of China, NO.91646115, 71371191, 71790615 71631008, and Natural Science Foundation of Hunan Province, NO.2018JJ3012

In a fully competitive industry, the market demand is changing rapidly. Thus, it is important for manufacturers to manage their inventory effectively as well as to determine the best order quantity and optimal production strategy. In this paper, our concern is how shall a manufacturer with limited attention determine his optimal order quantity and optimal production strategy in an environment when many factors are volatile, such as the price of raw materials (respectively, finished goods) and attrition rate of inventory of raw materials (respectively, finished product). Under this environment, it is observed, according to various empirical studies, that decision makers tend to focus their attention on factors with major changes. Taking all these into account, our problem is formulated as a discrete-time stochastic dynamic programming. We propose a general approach based on the sparse dynamic programming method to solve this multidimensional dynamic programming problem. From the numerical examples solved using the proposed method, it is interesting to observe that decision makers with limited attention do not adjust their final decision when the volatility is small.

Keywords: Dynamic optimization, limited attention, inventory management, sparse dynamic programming.

Mathematics Subject Classification: Primary: 1201; Secondary: 120100.

Citation: Haiying Liu, Wenjie Bi, Kok Lay Teo, Naxing Liu. Dynamic optimal decision making for manufacturers with limited attention based on sparse dynamic programming. Journal of Industrial & Management Optimization, 2019, 15 (2) : 445-464. doi: 10.3934/jimo.2018050

References:

[1]	A. B. Abel, J. C. Eberly and S. Panageas, Optimal inattention to the stock market with information costs and transactions costs, Econometrica, 81 (2013), 1455-1481. doi: 10.3982/ECTA7624.
[2]	R. Akella, V. F. Araman and J. Kleinknecht, B2B Markets: Procuremen and Supplier Risk Management in E-Business, in Supply chain management: models, applications, and research directions, Springer, (2005), 33-66.
[3]	P. Berling and V. Martínez-de-Albéniz, Optimal inventory policies when purchase price and demand are stochastic, Operations Research, 59 (2011), 109-124. doi: 10.1287/opre.1100.0862.
[4]	P. Berling and K. Rosling, The effects of financial risks on inventory policy, Management Science, 51 (2002), 1804-1815. doi: 10.1287/mnsc.1050.0435.
[5]	W. Bi, G. Li and M. Liu, Dynamic pricing with stochastic reference effects based on a finite memory window, International Journal of Production Research, 55 (2017), 3331-3348. doi: 10.1080/00207543.2016.1221160.
[6]	W. Bi, L. Tian, H. LIu and X. Chen, A stochastic dynamic programming approach based on bounded rationality and application to dynamic portfolio choice, Discrete Dynamics in Nature and Society, 2014 (2014), Article ID 840725, 11pages.
[7]	A. Bouras and L. Tadj, Production planning in a three-stock reverse-logistics system with deteriorating items under a continuous review policy, Journal of Industrial and Management Optimization, 11 (2015), 1041-1058. doi: 10.3934/jimo.2015.11.1041.
[8]	J.-M. Chen and C.-S. Lin, An optimal replenishment model for inventory items with normally distributed deterioration, Production Planning and Control, 13 (2002), 470-480.
[9]	S. K. Devalkar, R. Anupindi and A. Sinha, Integrated optimization of procurement, processing, and trade of commodities, Operations Research, 59 (2011), 1369-1381. doi: 10.1287/opre.1110.0959.
[10]	D. Duffie and T. Sun, Transactions costs and portfolio choice in a discrete-continuous-time setting, Journal of Economic Dynamics and Control, 14 (1990), 35-51. doi: 10.1016/0165-1889(90)90004-Z.
[11]	Q. Fu, C. Y. Lee and C. P. Teo, Procurement management using option contracts: Random spot price and the portfolio effect, IIE Transactions, 42 (2010), 793-811.
[12]	X. Gabaix, A sparsity-based model of bounded rationality, Quarterly Journal of Economics, 129 (2014), 1661-1710. doi: 10.3386/w16911.
[13]	X. Gabaix, Sparse Dynamic Programming and Aggregate Fluctuations, Working Paper, New York University, 2016.
[14]	V. Gaur and S. Seshadri, Hedging inventory risk through market instruments, Manufacturing and Service Operations Management, 7 (2005), 103-120. doi: 10.1287/msom.1040.0061.
[15]	S. Gavirneni, Periodic review inventory control with fluctuating purchasing costs, Operations Research Letters, 32 (2004), 374-379. doi: 10.1016/j.orl.2003.11.003.
[16]	S. Goyal and B. C. Giri, Recent trends in modeling of deteriorating inventory, European Journal of Operational Research, 134 (2001), 1-16. doi: 10.1016/S0377-2217(00)00248-4.
[17]	J. Jenkinson, Procurement in action, the efficio grassroots procurement survey 2011, Efficio Consulting, 2011.
[18]	D. Kahneman, Attention and Effort, Englewood Cliffs, N7T Prentice-Hall, 1973.
[19]	B. A. Kalymon, Stochastic prices in a single-item inventory purchasing model, Operations Research, 19 (1971), 1434-1458. doi: 10.1287/opre.19.6.1434.
[20]	M. Lashgari, A. A. Taleizadeh and S. S. Sana, An inventory control problem for deteriorating items with back-ordering and financial considerations under two levels of trade credit linked to order quantity, Journal of Industrial and Management Optimization, 12 (2016), 1091-1119.
[21]	H. Liu, X. Luo, W. Bi, Y. Man and K. L. Teo, Dynamic pricing of network goods in duopoly markets with boundedly rational consumers, J. Ind. Manag. Optim, 13 (2017), 427-445.
[22]	B. Mackowiak and M Wiederholt, Information processing and limited liability, The American Economic Review, 102 (2012), 30-34. doi: 10.1257/aer.102.3.30.
[23]	B. Mackowiak and M. Wiederholt, Inattention to Rare Events, 2015. Available at SSRN 2477548: https://ssrn.com/abstract=2650452.
[24]	F. Matejka and C. A. Sims, Discrete actions in information -constrained tracking problems, Princeton University Manuscript, (2011). doi: 10.2139/ssrn.1886640.
[25]	S. Nahmias and W. S. Demmy, Operating characteristics of an inventory system with rationing, Management Science, 27 (1981), 1236-1245.
[26]	F. Raafat, Survey of literature on continuously deteriorating inventory models, Journal of the Operational Research Society, 42 (1991), 27-37.
[27]	R. Reis, Inattentive consumers, Journal of Monetary Economics, 53 (2006), 1761-1800. doi: 10.3386/w10883.
[28]	J. Schwartzstein, Selective attention and learning, Journal of the European Economic Association, 12 (2014), 1423-1452. doi: 10.1111/jeea.12104.
[29]	K. Sebastian, A. Maessen and S. Strasmann, Mastering the Uniqueness of Commodity Pricing: How to Guide, Set and Control Prices, Simon-Kucher-Whitepaper, 2010.
[30]	N. H. Shah and Y. Shah, Literature survey on inventory models for deteriorating items, Ekonomski Anali, 44 (2000), 221-237.
[31]	C. A. Sims, Implications of rational inattention, Journal of Monetary Economics, 50 (2003), 665-690. doi: 10.1016/S0304-3932(03)00029-1.
[32]	B. Sivakumar, A perishable inventory system with retrial demands and a finite population, Journal of Computational and Applied Mathematics, 224 (2009), 29-38. doi: 10.1016/j.cam.2008.03.041.
[33]	T. M. Whitin, Inventory control and price theory, Management Science, 2 (1955), 61-68. doi: 10.1287/mnsc.2.1.61.
[34]	O. Q. Wu and H. Chen, Optimal control and equilibrium behavior of production-inventory systems, Management Science, 56 (2010), 1362-1379. doi: 10.1287/mnsc.1100.1186.
[35]	J. X. Zhang, Z. Y. Bai and W. S. Tang, Optimal pricing policy for deteriorating items with preservation technology investment, Journal of Industrial and Management Optimization, 10 (2014), 1261-1277. doi: 10.3934/jimo.2014.10.1261.
[36]	Y.-S. Zheng, Optimal control policy for stochastic inventory systems with Markovian discount opportunities, Operations Research, 42 (1994), 721-738. doi: 10.1287/opre.42.4.721.
[37]	P. Zipkin, Critical number policies for inventory models with periodic data, Management Science, 35 (1989), 71-80. doi: 10.1287/mnsc.35.1.71.

show all references

References:

[1]	A. B. Abel, J. C. Eberly and S. Panageas, Optimal inattention to the stock market with information costs and transactions costs, Econometrica, 81 (2013), 1455-1481. doi: 10.3982/ECTA7624.
[2]	R. Akella, V. F. Araman and J. Kleinknecht, B2B Markets: Procuremen and Supplier Risk Management in E-Business, in Supply chain management: models, applications, and research directions, Springer, (2005), 33-66.
[3]	P. Berling and V. Martínez-de-Albéniz, Optimal inventory policies when purchase price and demand are stochastic, Operations Research, 59 (2011), 109-124. doi: 10.1287/opre.1100.0862.
[4]	P. Berling and K. Rosling, The effects of financial risks on inventory policy, Management Science, 51 (2002), 1804-1815. doi: 10.1287/mnsc.1050.0435.
[5]	W. Bi, G. Li and M. Liu, Dynamic pricing with stochastic reference effects based on a finite memory window, International Journal of Production Research, 55 (2017), 3331-3348. doi: 10.1080/00207543.2016.1221160.
[6]	W. Bi, L. Tian, H. LIu and X. Chen, A stochastic dynamic programming approach based on bounded rationality and application to dynamic portfolio choice, Discrete Dynamics in Nature and Society, 2014 (2014), Article ID 840725, 11pages.
[7]	A. Bouras and L. Tadj, Production planning in a three-stock reverse-logistics system with deteriorating items under a continuous review policy, Journal of Industrial and Management Optimization, 11 (2015), 1041-1058. doi: 10.3934/jimo.2015.11.1041.
[8]	J.-M. Chen and C.-S. Lin, An optimal replenishment model for inventory items with normally distributed deterioration, Production Planning and Control, 13 (2002), 470-480.
[9]	S. K. Devalkar, R. Anupindi and A. Sinha, Integrated optimization of procurement, processing, and trade of commodities, Operations Research, 59 (2011), 1369-1381. doi: 10.1287/opre.1110.0959.
[10]	D. Duffie and T. Sun, Transactions costs and portfolio choice in a discrete-continuous-time setting, Journal of Economic Dynamics and Control, 14 (1990), 35-51. doi: 10.1016/0165-1889(90)90004-Z.
[11]	Q. Fu, C. Y. Lee and C. P. Teo, Procurement management using option contracts: Random spot price and the portfolio effect, IIE Transactions, 42 (2010), 793-811.
[12]	X. Gabaix, A sparsity-based model of bounded rationality, Quarterly Journal of Economics, 129 (2014), 1661-1710. doi: 10.3386/w16911.
[13]	X. Gabaix, Sparse Dynamic Programming and Aggregate Fluctuations, Working Paper, New York University, 2016.
[14]	V. Gaur and S. Seshadri, Hedging inventory risk through market instruments, Manufacturing and Service Operations Management, 7 (2005), 103-120. doi: 10.1287/msom.1040.0061.
[15]	S. Gavirneni, Periodic review inventory control with fluctuating purchasing costs, Operations Research Letters, 32 (2004), 374-379. doi: 10.1016/j.orl.2003.11.003.
[16]	S. Goyal and B. C. Giri, Recent trends in modeling of deteriorating inventory, European Journal of Operational Research, 134 (2001), 1-16. doi: 10.1016/S0377-2217(00)00248-4.
[17]	J. Jenkinson, Procurement in action, the efficio grassroots procurement survey 2011, Efficio Consulting, 2011.
[18]	D. Kahneman, Attention and Effort, Englewood Cliffs, N7T Prentice-Hall, 1973.
[19]	B. A. Kalymon, Stochastic prices in a single-item inventory purchasing model, Operations Research, 19 (1971), 1434-1458. doi: 10.1287/opre.19.6.1434.
[20]	M. Lashgari, A. A. Taleizadeh and S. S. Sana, An inventory control problem for deteriorating items with back-ordering and financial considerations under two levels of trade credit linked to order quantity, Journal of Industrial and Management Optimization, 12 (2016), 1091-1119.
[21]	H. Liu, X. Luo, W. Bi, Y. Man and K. L. Teo, Dynamic pricing of network goods in duopoly markets with boundedly rational consumers, J. Ind. Manag. Optim, 13 (2017), 427-445.
[22]	B. Mackowiak and M Wiederholt, Information processing and limited liability, The American Economic Review, 102 (2012), 30-34. doi: 10.1257/aer.102.3.30.
[23]	B. Mackowiak and M. Wiederholt, Inattention to Rare Events, 2015. Available at SSRN 2477548: https://ssrn.com/abstract=2650452.
[24]	F. Matejka and C. A. Sims, Discrete actions in information -constrained tracking problems, Princeton University Manuscript, (2011). doi: 10.2139/ssrn.1886640.
[25]	S. Nahmias and W. S. Demmy, Operating characteristics of an inventory system with rationing, Management Science, 27 (1981), 1236-1245.
[26]	F. Raafat, Survey of literature on continuously deteriorating inventory models, Journal of the Operational Research Society, 42 (1991), 27-37.
[27]	R. Reis, Inattentive consumers, Journal of Monetary Economics, 53 (2006), 1761-1800. doi: 10.3386/w10883.
[28]	J. Schwartzstein, Selective attention and learning, Journal of the European Economic Association, 12 (2014), 1423-1452. doi: 10.1111/jeea.12104.
[29]	K. Sebastian, A. Maessen and S. Strasmann, Mastering the Uniqueness of Commodity Pricing: How to Guide, Set and Control Prices, Simon-Kucher-Whitepaper, 2010.
[30]	N. H. Shah and Y. Shah, Literature survey on inventory models for deteriorating items, Ekonomski Anali, 44 (2000), 221-237.
[31]	C. A. Sims, Implications of rational inattention, Journal of Monetary Economics, 50 (2003), 665-690. doi: 10.1016/S0304-3932(03)00029-1.
[32]	B. Sivakumar, A perishable inventory system with retrial demands and a finite population, Journal of Computational and Applied Mathematics, 224 (2009), 29-38. doi: 10.1016/j.cam.2008.03.041.
[33]	T. M. Whitin, Inventory control and price theory, Management Science, 2 (1955), 61-68. doi: 10.1287/mnsc.2.1.61.
[34]	O. Q. Wu and H. Chen, Optimal control and equilibrium behavior of production-inventory systems, Management Science, 56 (2010), 1362-1379. doi: 10.1287/mnsc.1100.1186.
[35]	J. X. Zhang, Z. Y. Bai and W. S. Tang, Optimal pricing policy for deteriorating items with preservation technology investment, Journal of Industrial and Management Optimization, 10 (2014), 1261-1277. doi: 10.3934/jimo.2014.10.1261.
[36]	Y.-S. Zheng, Optimal control policy for stochastic inventory systems with Markovian discount opportunities, Operations Research, 42 (1994), 721-738. doi: 10.1287/opre.42.4.721.
[37]	P. Zipkin, Critical number policies for inventory models with periodic data, Management Science, 35 (1989), 71-80. doi: 10.1287/mnsc.35.1.71.

Figure 1. Production inventory system

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2. Attention function

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3. Truncation function

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4. The influence of ${\hat p_1}$ on $\lambda$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5. The influence of ${\hat p_2}$ on $\lambda$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6. The influence of ${\hat \theta _1}$ on $\lambda$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 7. The influence of ${\hat p_1}$ on $q$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 8. The influence of ${\hat p_2}$ on $q$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 9. The influence of ${\hat \theta _1}$ on $q$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 10. The influence of ${\hat \theta _2}$ on $q$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 11. The influence of ${\hat p_1}$ on $s$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 12. The influence of ${\hat p_2}$ on $s$

Figure Options

Download full-size image

Download as PowerPoint slide

Figure 13. The influence of ${\hat \theta _2}$ on $s$

Figure Options

Download full-size image

Download as PowerPoint slide

[1]	Andrzej Nowakowski, Jan Sokolowski. On dual dynamic programming in shape control. Communications on Pure & Applied Analysis, 2012, 11 (6) : 2473-2485. doi: 10.3934/cpaa.2012.11.2473
[2]	Jérôme Renault. General limit value in dynamic programming. Journal of Dynamics & Games, 2014, 1 (3) : 471-484. doi: 10.3934/jdg.2014.1.471
[3]	Oliver Junge, Alex Schreiber. Dynamic programming using radial basis functions. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 4439-4453. doi: 10.3934/dcds.2015.35.4439
[4]	Eduardo Espinosa-Avila, Pablo Padilla Longoria, Francisco Hernández-Quiroz. Game theory and dynamic programming in alternate games. Journal of Dynamics & Games, 2017, 4 (3) : 205-216. doi: 10.3934/jdg.2017013
[5]	Rein Luus. Optimal control of oscillatory systems by iterative dynamic programming. Journal of Industrial & Management Optimization, 2008, 4 (1) : 1-15. doi: 10.3934/jimo.2008.4.1
[6]	Qing Liu, Armin Schikorra. General existence of solutions to dynamic programming equations. Communications on Pure & Applied Analysis, 2015, 14 (1) : 167-184. doi: 10.3934/cpaa.2015.14.167
[7]	Xianchao Xiu, Lingchen Kong. Rank-one and sparse matrix decomposition for dynamic MRI. Numerical Algebra, Control & Optimization, 2015, 5 (2) : 127-134. doi: 10.3934/naco.2015.5.127
[8]	Shi'an Wang, N. U. Ahmed. Optimum management of the network of city bus routes based on a stochastic dynamic model. Journal of Industrial & Management Optimization, 2019, 15 (2) : 619-631. doi: 10.3934/jimo.2018061
[9]	Ryan Loxton, Qun Lin. Optimal fleet composition via dynamic programming and golden section search. Journal of Industrial & Management Optimization, 2011, 7 (4) : 875-890. doi: 10.3934/jimo.2011.7.875
[10]	Amin Aalaei, Hamid Davoudpour. Two bounds for integrating the virtual dynamic cellular manufacturing problem into supply chain management. Journal of Industrial & Management Optimization, 2016, 12 (3) : 907-930. doi: 10.3934/jimo.2016.12.907
[11]	Bruce D. Craven, Sardar M. N. Islam. Dynamic optimization models in finance: Some extensions to the framework, models, and computation. Journal of Industrial & Management Optimization, 2014, 10 (4) : 1129-1146. doi: 10.3934/jimo.2014.10.1129
[12]	Fuying Jing, Zirui Lan, Yang Pan. Forecast horizon of dynamic lot size model for perishable inventory with minimum order quantities. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-22. doi: 10.3934/jimo.2019010
[13]	Matthew H. Henry, Yacov Y. Haimes. Robust multiobjective dynamic programming: Minimax envelopes for efficient decisionmaking under scenario uncertainty. Journal of Industrial & Management Optimization, 2009, 5 (4) : 791-824. doi: 10.3934/jimo.2009.5.791
[14]	Martino Bardi, Shigeaki Koike, Pierpaolo Soravia. Pursuit-evasion games with state constraints: dynamic programming and discrete-time approximations. Discrete & Continuous Dynamical Systems - A, 2000, 6 (2) : 361-380. doi: 10.3934/dcds.2000.6.361
[15]	Silvia Faggian. Boundary control problems with convex cost and dynamic programming in infinite dimension part II: Existence for HJB. Discrete & Continuous Dynamical Systems - A, 2005, 12 (2) : 323-346. doi: 10.3934/dcds.2005.12.323
[16]	Guy Barles, Ariela Briani, Emmanuel Trélat. Value function for regional control problems via dynamic programming and Pontryagin maximum principle. Mathematical Control & Related Fields, 2018, 8 (3&4) : 509-533. doi: 10.3934/mcrf.2018021
[17]	Haibo Jin, Long Hai, Xiaoliang Tang. An optimal maintenance strategy for multi-state systems based on a system linear integral equation and dynamic programming. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-26. doi: 10.3934/jimo.2018188
[18]	Yeong-Cheng Liou, Siegfried Schaible, Jen-Chih Yao. Supply chain inventory management via a Stackelberg equilibrium. Journal of Industrial & Management Optimization, 2006, 2 (1) : 81-94. doi: 10.3934/jimo.2006.2.81
[19]	Jian-Wu Xue, Xiao-Kun Xu, Feng Zhang. Big data dynamic compressive sensing system architecture and optimization algorithm for internet of things. Discrete & Continuous Dynamical Systems - S, 2015, 8 (6) : 1401-1414. doi: 10.3934/dcdss.2015.8.1401
[20]	Harald Held, Gabriela Martinez, Philipp Emanuel Stelzig. Stochastic programming approach for energy management in electric microgrids. Numerical Algebra, Control & Optimization, 2014, 4 (3) : 241-267. doi: 10.3934/naco.2014.4.241

2017 Impact Factor: 0.994

Tools

Metrics

Tools

Article outline

Figures and Tables

2017 Impact Factor: 0.994

Tools

Figures and Tables

2017 Impact Factor: 0.994

American Institute of Mathematical Sciences