Optimal synchronization problem for a multi-agent system

Previous Article
Existence of solutions to a boundary value problem for a phase transition traffic model
NHM Home
This Issue
Next Article
A macroscopic traffic model with phase transitions and local point constraints on the flow

June 2017, 12(2): 277-295. doi: 10.3934/nhm.2017012

Optimal synchronization problem for a multi-agent system

Giulia Cavagnari ^1,, , Antonio Marigonda ^2, and Benedetto Piccoli ^1,

1.	Department of Mathematical Sciences, Rutgers University -Camden, 311 N. 5th Street Camden, NJ 08102, USA
2.	Department of Computer Science, University of Verona, Strada Le Grazie 15, I-37134 Verona, Italy

* Corresponding author: Giulia Cavagnari

Received October 2016 Revised February 2017 Published May 2017

In this paper we investigate a time-optimal control problem in the space of positive and finite Borel measures on $\mathbb R^d$, motivated by applications in multi-agent systems. We provide a definition of admissible trajectory in the space of Borel measures in a particular non-isolated context, inspired by the so called optimal logistic problem, where the aim is to assign an initial amount of resources to a mass of agents, depending only on their initial position, in such a way that they can reach the given target with this minimum amount of supplies. We provide some approximation results connecting the microscopical description with the macroscopical one in the mass-preserving setting, we construct an optimal trajectory in the non isolated case and finally we are able to provide a Dynamic Programming Principle.

Keywords: Multi-agent systems, time-optimal control, dynamic programming, optimal transport, differential inclusions.

Mathematics Subject Classification: Primary: 34A60; Secondary: 49J15.

Citation: Giulia Cavagnari, Antonio Marigonda, Benedetto Piccoli. Optimal synchronization problem for a multi-agent system. Networks & Heterogeneous Media, 2017, 12 (2) : 277-295. doi: 10.3934/nhm.2017012

References:

[1]	L. Ambrosio, N. Fusco and D. Pallara, Functions of Bounded Variation and Free Discontinuity Problems, Oxford Mathematical Monographs, The Clarendon Press Oxford University Press, New York, 2000.
[2]	L. Ambrosio, N. Gigli and G. Savaré, Gradient Flows in Metric Spaces and in the Space of Probability Measures, 2^nd edition, Lectures in Mathematics ETH Zürich, Birkhäuser Verlag, Basel, 2008.
[3]	M. Bernot, V. Caselles and J. -M. Morel, Optimal Transportation Networks -Models and Theory, 1955, Lecture Notes in Mathematics, Springer-Verlag, Berlin, 2009.
[4]	D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control -the Discrete Time Case, 139, Mathematics in Science and Engineering, Academic Press, Inc. [Harcourt Brace Jovanovich, Publishers], New York-London, 1978.
[5]	M. Bonafini, G. Orlandi and E. Oudet, Variational approximation of functionals defined on 1-dimensional connected sets: The planar case, submitted, arXiv: 1610.03839v2.
[6]	R. Brockett and N. Khaneja, On the stochastic control of quantum ensembles, System theory: Modeling, analysis and control (Cambridge, MA, 1999), Kluwer Internat. Ser. Engrg. Comput. Sci., Kluwer Acad. Publ., Boston, MA, 518 (2000), 75-96. doi: 10.1007/978-1-4615-5223-9_6.
[7]	G. Buttazzo, Semicontinuity, Relaxation and Integral Representation in the Calculus of Variations, 207 Longman Scientific & Technical, Harlow; copublished in the United States with John Wiley & Sons, Inc., New York, 1989.
[8]	G. Buttazzo, C. Jimenez and E. Oudet, An optimization problem for mass transportation with congested dynamics, SIAM J. Control Optim., 48 (2009), 1961-1976. doi: 10.1137/07070543X.
[9]	G. Cavagnari, Regularity results for a time-optimal control problem in the space of probability measures, Mathematical Control and Related Fields, 7 (2017), 213-233. doi: 10.3934/mcrf.2017007.
[10]	G. Cavagnari and A. Marigonda, Time-optimal control problem in the space of probability measures, Large-scale scientific computing, Lecture Notes in Computer Science, Springer, Cham, 9374 (2015), 109-116. doi: 10.1007/978-3-319-26520-9.
[11]	G. Cavagnari, A. Marigonda, K. T. Nguyen and F. S. Priuli, Generalized control systems in the space of probability measures, Set-Valued and Variational Analysis, 25 (2017), 1-29. doi: 10.1007/s11228-017-0414-y.
[12]	G. Cavagnari, A. Marigonda and G. Orlandi, Hamilton-Jacobi-Bellman equation for a timeoptimal control problem in the space of probability measures, in System Modeling and Optimization. CSMO 2015 (eds. L. Bociu, J. -A. Désidéri and A. Habbal), IFIP Advances in Information and Communication Technology, 494, Springer, Cham, 2016,200-208. doi: 10.1007/978-3-319-55795-3_18.
[13]	G. Cavagnari, A. Marigonda and B. Piccoli, Averaged time-optimal control problem in the space of positive Borel measures, submitted.
[14]	E. Cristiani, B. Piccoli and A. Tosin, Multiscale Modeling of Pedestrian Dynamics, 12 MS & A. Modeling, Simulation and Applications, Springer, Cham, 2014. doi: 10.1007/978-3-319-06620-2.
[15]	J. Dolbeault, B. Nazaret and G. Savaré, A new class of transport distances between measures, Calc. Var. Partial Differential Equations, 34 (2009), 193-231. doi: 10.1007/s00526-008-0182-5.
[16]	A. Isidori and C. I. Byrnes, Output regulation of nonlinear systems, IEEE Trans. Automat. Control, 35 (1990), 131-140. doi: 10.1109/9.45168.
[17]	B. Oksendal, Stochastic Differential Equations -an Introduction with Applications, 6^th edition, Universitext, Springer-Verlag, Berlin, 2003. doi: 10.1007/978-3-642-14394-6.
[18]	B. Oksendal and A. Sulem, Applied Stochastic Control of Jump Diffusions, 2^nd edition, Universitext, Springer, Berlin, 2007. doi: 10.1007/978-3-540-69826-5.
[19]	B. Piccoli and F. Rossi, Generalized Wasserstein distance and its application to transport equations with source, Arch. Ration. Mech. Anal., 211 (2014), 335-358. doi: 10.1007/s00205-013-0669-x.
[20]	B. Piccoli and F. Rossi, On properties of the Generalized Wasserstein distance, Archive for Rational Mechanics and Analysis, 222 (2016), 1339-1365, arXiv: 1304.7014v3. doi: 10.1007/s00205-016-1026-7.
[21]	B. Piccoli, F. Rossi and E. Trélat, Control to flocking of the kinetic Cucker-Smale model, SIAM J. Math. Anal., 47 (2015), 4685-4719. doi: 10.1137/140996501.
[22]	B. Piccoli and A. Tosin, Time-evolving measures and macroscopic modeling of pedestrian flow, Arch. Ration. Mech. Anal., 199 (2011), 707-738. doi: 10.1007/s00205-010-0366-y.
[23]	R. Tempo, G. Calafiore and F. Dabbene, Randomized Algorithms for Analysis and Control of Uncertain Systems -with Applications, Communications and Control Engineering Series, Springer-Verlag, London, 2013. doi: 10.1007/978-1-4471-4610-0.
[24]	C. Villani, Topics in Optimal Transportation, 58, Graduate Studies in Mathematics, American Mathematical Society, Providence, RI, 2003. doi: 10.1007/b12016.
[25]	J. Yong and X. Y. Zhou, Stochastic Controls -Hamiltonian Systems and HJB Equations, 43, Applications of Mathematics (New York), Springer-Verlag, New York, 1999. doi: 10.1007/978-1-4612-1466-3.

show all references

References:

[1]	L. Ambrosio, N. Fusco and D. Pallara, Functions of Bounded Variation and Free Discontinuity Problems, Oxford Mathematical Monographs, The Clarendon Press Oxford University Press, New York, 2000.
[2]	L. Ambrosio, N. Gigli and G. Savaré, Gradient Flows in Metric Spaces and in the Space of Probability Measures, 2^nd edition, Lectures in Mathematics ETH Zürich, Birkhäuser Verlag, Basel, 2008.
[3]	M. Bernot, V. Caselles and J. -M. Morel, Optimal Transportation Networks -Models and Theory, 1955, Lecture Notes in Mathematics, Springer-Verlag, Berlin, 2009.
[4]	D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control -the Discrete Time Case, 139, Mathematics in Science and Engineering, Academic Press, Inc. [Harcourt Brace Jovanovich, Publishers], New York-London, 1978.
[5]	M. Bonafini, G. Orlandi and E. Oudet, Variational approximation of functionals defined on 1-dimensional connected sets: The planar case, submitted, arXiv: 1610.03839v2.
[6]	R. Brockett and N. Khaneja, On the stochastic control of quantum ensembles, System theory: Modeling, analysis and control (Cambridge, MA, 1999), Kluwer Internat. Ser. Engrg. Comput. Sci., Kluwer Acad. Publ., Boston, MA, 518 (2000), 75-96. doi: 10.1007/978-1-4615-5223-9_6.
[7]	G. Buttazzo, Semicontinuity, Relaxation and Integral Representation in the Calculus of Variations, 207 Longman Scientific & Technical, Harlow; copublished in the United States with John Wiley & Sons, Inc., New York, 1989.
[8]	G. Buttazzo, C. Jimenez and E. Oudet, An optimization problem for mass transportation with congested dynamics, SIAM J. Control Optim., 48 (2009), 1961-1976. doi: 10.1137/07070543X.
[9]	G. Cavagnari, Regularity results for a time-optimal control problem in the space of probability measures, Mathematical Control and Related Fields, 7 (2017), 213-233. doi: 10.3934/mcrf.2017007.
[10]	G. Cavagnari and A. Marigonda, Time-optimal control problem in the space of probability measures, Large-scale scientific computing, Lecture Notes in Computer Science, Springer, Cham, 9374 (2015), 109-116. doi: 10.1007/978-3-319-26520-9.
[11]	G. Cavagnari, A. Marigonda, K. T. Nguyen and F. S. Priuli, Generalized control systems in the space of probability measures, Set-Valued and Variational Analysis, 25 (2017), 1-29. doi: 10.1007/s11228-017-0414-y.
[12]	G. Cavagnari, A. Marigonda and G. Orlandi, Hamilton-Jacobi-Bellman equation for a timeoptimal control problem in the space of probability measures, in System Modeling and Optimization. CSMO 2015 (eds. L. Bociu, J. -A. Désidéri and A. Habbal), IFIP Advances in Information and Communication Technology, 494, Springer, Cham, 2016,200-208. doi: 10.1007/978-3-319-55795-3_18.
[13]	G. Cavagnari, A. Marigonda and B. Piccoli, Averaged time-optimal control problem in the space of positive Borel measures, submitted.
[14]	E. Cristiani, B. Piccoli and A. Tosin, Multiscale Modeling of Pedestrian Dynamics, 12 MS & A. Modeling, Simulation and Applications, Springer, Cham, 2014. doi: 10.1007/978-3-319-06620-2.
[15]	J. Dolbeault, B. Nazaret and G. Savaré, A new class of transport distances between measures, Calc. Var. Partial Differential Equations, 34 (2009), 193-231. doi: 10.1007/s00526-008-0182-5.
[16]	A. Isidori and C. I. Byrnes, Output regulation of nonlinear systems, IEEE Trans. Automat. Control, 35 (1990), 131-140. doi: 10.1109/9.45168.
[17]	B. Oksendal, Stochastic Differential Equations -an Introduction with Applications, 6^th edition, Universitext, Springer-Verlag, Berlin, 2003. doi: 10.1007/978-3-642-14394-6.
[18]	B. Oksendal and A. Sulem, Applied Stochastic Control of Jump Diffusions, 2^nd edition, Universitext, Springer, Berlin, 2007. doi: 10.1007/978-3-540-69826-5.
[19]	B. Piccoli and F. Rossi, Generalized Wasserstein distance and its application to transport equations with source, Arch. Ration. Mech. Anal., 211 (2014), 335-358. doi: 10.1007/s00205-013-0669-x.
[20]	B. Piccoli and F. Rossi, On properties of the Generalized Wasserstein distance, Archive for Rational Mechanics and Analysis, 222 (2016), 1339-1365, arXiv: 1304.7014v3. doi: 10.1007/s00205-016-1026-7.
[21]	B. Piccoli, F. Rossi and E. Trélat, Control to flocking of the kinetic Cucker-Smale model, SIAM J. Math. Anal., 47 (2015), 4685-4719. doi: 10.1137/140996501.
[22]	B. Piccoli and A. Tosin, Time-evolving measures and macroscopic modeling of pedestrian flow, Arch. Ration. Mech. Anal., 199 (2011), 707-738. doi: 10.1007/s00205-010-0366-y.
[23]	R. Tempo, G. Calafiore and F. Dabbene, Randomized Algorithms for Analysis and Control of Uncertain Systems -with Applications, Communications and Control Engineering Series, Springer-Verlag, London, 2013. doi: 10.1007/978-1-4471-4610-0.
[24]	C. Villani, Topics in Optimal Transportation, 58, Graduate Studies in Mathematics, American Mathematical Society, Providence, RI, 2003. doi: 10.1007/b12016.
[25]	J. Yong and X. Y. Zhou, Stochastic Controls -Hamiltonian Systems and HJB Equations, 43, Applications of Mathematics (New York), Springer-Verlag, New York, 1999. doi: 10.1007/978-1-4612-1466-3.

[1]	Rui Li, Yingjing Shi. Finite-time optimal consensus control for second-order multi-agent systems. Journal of Industrial & Management Optimization, 2014, 10 (3) : 929-943. doi: 10.3934/jimo.2014.10.929
[2]	Brendan Pass. Multi-marginal optimal transport and multi-agent matching problems: Uniqueness and structure of solutions. Discrete & Continuous Dynamical Systems - A, 2014, 34 (4) : 1623-1639. doi: 10.3934/dcds.2014.34.1623
[3]	Rein Luus. Optimal control of oscillatory systems by iterative dynamic programming. Journal of Industrial & Management Optimization, 2008, 4 (1) : 1-15. doi: 10.3934/jimo.2008.4.1
[4]	Robert J. Kipka, Yuri S. Ledyaev. Optimal control of differential inclusions on manifolds. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 4455-4475. doi: 10.3934/dcds.2015.35.4455
[5]	Giulia Cavagnari. Regularity results for a time-optimal control problem in the space of probability measures. Mathematical Control & Related Fields, 2017, 7 (2) : 213-233. doi: 10.3934/mcrf.2017007
[6]	Zhiyong Sun, Toshiharu Sugie. Identification of Hessian matrix in distributed gradient-based multi-agent coordination control systems. Numerical Algebra, Control & Optimization, 2019, 9 (3) : 297-318. doi: 10.3934/naco.2019020
[7]	Zhongkui Li, Zhisheng Duan, Guanrong Chen. Consensus of discrete-time linear multi-agent systems with observer-type protocols. Discrete & Continuous Dynamical Systems - B, 2011, 16 (2) : 489-505. doi: 10.3934/dcdsb.2011.16.489
[8]	Piotr Kopacz. A note on time-optimal paths on perturbed spheroid. Journal of Geometric Mechanics, 2018, 10 (2) : 139-172. doi: 10.3934/jgm.2018005
[9]	Haibo Jin, Long Hai, Xiaoliang Tang. An optimal maintenance strategy for multi-state systems based on a system linear integral equation and dynamic programming. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-26. doi: 10.3934/jimo.2018188
[10]	Elimhan N. Mahmudov. Optimal control of evolution differential inclusions with polynomial linear differential operators. Evolution Equations & Control Theory, 2019, 8 (3) : 603-619. doi: 10.3934/eect.2019028
[11]	Tyrone E. Duncan. Some partially observed multi-agent linear exponential quadratic stochastic differential games. Evolution Equations & Control Theory, 2018, 7 (4) : 587-597. doi: 10.3934/eect.2018028
[12]	Roberta Ghezzi, Benedetto Piccoli. Optimal control of a multi-level dynamic model for biofuel production. Mathematical Control & Related Fields, 2017, 7 (2) : 235-257. doi: 10.3934/mcrf.2017008
[13]	Yibo Zhang, Jinfeng Gao, Jia Ren, Huijiao Wang. A type of new consensus protocol for two-dimension multi-agent systems. Numerical Algebra, Control & Optimization, 2017, 7 (3) : 345-357. doi: 10.3934/naco.2017022
[14]	Y. Gong, X. Xiang. A class of optimal control problems of systems governed by the first order linear dynamic equations on time scales. Journal of Industrial & Management Optimization, 2009, 5 (1) : 1-10. doi: 10.3934/jimo.2009.5.1
[15]	Elimhan N. Mahmudov. Optimal control of second order delay-discrete and delay-differential inclusions with state constraints. Evolution Equations & Control Theory, 2018, 7 (3) : 501-529. doi: 10.3934/eect.2018024
[16]	Elimhan N. Mahmudov. Optimal control of Sturm-Liouville type evolution differential inclusions with endpoint constraints. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-18. doi: 10.3934/jimo.2019066
[17]	Marcelo J. Villena, Mauricio Contreras. Global and local advertising strategies: A dynamic multi-market optimal control model. Journal of Industrial & Management Optimization, 2019, 15 (3) : 1017-1048. doi: 10.3934/jimo.2018084
[18]	Robert J. McCann. A glimpse into the differential topology and geometry of optimal transport. Discrete & Continuous Dynamical Systems - A, 2014, 34 (4) : 1605-1621. doi: 10.3934/dcds.2014.34.1605
[19]	Vladimir Gaitsgory, Alex Parkinson, Ilya Shvartsman. Linear programming formulations of deterministic infinite horizon optimal control problems in discrete time. Discrete & Continuous Dynamical Systems - B, 2017, 22 (10) : 3821-3838. doi: 10.3934/dcdsb.2017192
[20]	Vladimir Gaitsgory, Alex Parkinson, Ilya Shvartsman. Linear programming based optimality conditions and approximate solution of a deterministic infinite horizon discounted optimal control problem in discrete time. Discrete & Continuous Dynamical Systems - B, 2019, 24 (4) : 1743-1767. doi: 10.3934/dcdsb.2018235

American Institute of Mathematical Sciences