American Institute of Mathematical Sciences

Advanced
  • Previous Article
    Examination of solving optimal control problems with delays using GPOPS-Ⅱ
  • NACO Home
  • This Issue
  • Next Article
    A primal-dual interior point method for $ P_{\ast }\left( \kappa \right) $-HLCP based on a class of parametric kernel functions
doi: 10.3934/naco.2020034

Solving differential Riccati equations: A nonlinear space-time method using tensor trains

Tobias Breiten 1,, , Sergey Dolgov 2, and  Martin Stoll 3,

1. 

Institute of Mathematics, Technical University of Berlin, 10623 Berlin, Germany
2. 

University of Bath, Department of Mathematical Sciences, BA2 7AY Bath, United Kingdom
3. 

Technische Universität Chemnitz, Department of Mathematics, Scientific Computing Group, 09107 Chemnitz, Germany

* Corresponding author: T. Breiten

Received  December 2019 Revised  July 2020 Published  August 2020

Differential Riccati equations are at the heart of many applications in control theory. They are time-dependent, matrix-valued, and in particular nonlinear equations that require special methods for their solution. Low-rank methods have been used heavily for computing a low-rank solution at every step of a time-discretization. We propose the use of an all-at-once space-time solution leading to a large nonlinear space-time problem for which we propose the use of a Newton–Kleinman iteration. Approximating the space-time problem in a higher-dimensional low-rank tensor form requires fewer degrees of freedom in the solution and in the operator, and gives a faster numerical method. Numerical experiments demonstrate a storage reduction of up to a factor of 100.

Keywords: Optimal Control, Low-rank methods, Riccati equations, Non-linear problems.
Mathematics Subject Classification: Primary: 15A24, 65H10, 15A69, 93A15.
Citation: Tobias Breiten, Sergey Dolgov, Martin Stoll. Solving differential Riccati equations: A nonlinear space-time method using tensor trains. Numerical Algebra, Control & Optimization, doi: 10.3934/naco.2020034
References:
[1]

H. Abou-Kandil, G. Freiling, V. Ionescu and G. Jank, Matrix Riccati Equations, Systems Control: Foundations Applications, Birkhäuser Verlag, Basel, 2003, URL https://doi.org/10.1007/978-3-0348-8081-7, In Control and Systems Theory. doi: 10.1007/978-3-0348-8081-7.  Google Scholar

[2]

N. Ahmed, G. Matthies, L. Tobiska and H. Xie, Discontinuous Galerkin time stepping with local projection stabilization for transient convection–diffusion-reaction problems, Computer Methods in Applied Mechanics and Engineering, 200 (2011), 1747-1756.  doi: 10.1016/j.cma.2011.02.003.  Google Scholar

[3]

J. Ballani and L. Grasedyck, A projection method to solve linear systems in tensor format, Numerical Linear Algebra with Applications, 20 (2013), 27-43.  doi: 10.1002/nla.1818.  Google Scholar

[4]

R. Bellman, Dynamic programming, Courier Corporation, 2013.  Google Scholar

[5]

P. Benner, Z. Bujanović, P. Kürschner and J. Saak, RADI: A low-rank ADI-type algorithm for large scale algebraic Riccati equations, Numerische Mathematik, 138 (2018), 301-330.  doi: 10.1007/s00211-017-0907-5.  Google Scholar

[6]

P. Benner, Z. Bujanović, P. Kürschner and J. Saak, A numerical comparison of different solvers for large-scale, continuous-time algebraic Riccati equations and LQR problems, SIAM Journal on Scientific Computing, 42 (2020), A957–A996. doi: 10.1137/18M1220960.  Google Scholar

[7]

P. Benner, S. Dolgov, A. Onwunta and M. Stoll, Low-rank solvers for unsteady Stokes-Brinkman optimal control problem with random data, Computer Methods in Applied Mechanics and Engineering, 304 (2016), 26-54.  doi: 10.1016/j.cma.2016.02.004.  Google Scholar

[8]

P. Benner and H. Mena, BDF methods for large-scale differential Riccati equations, in in Proceedings of Mathematical Theory of Network and Systems, MTNS, 2004. Google Scholar

[9]

P. Benner and H. Mena, Rosenbrock methods for solving Riccati differential equations, IEEE Transactions on Automatic Control, 58 (2013), 2950-2956.  doi: 10.1109/TAC.2013.2258495.  Google Scholar

[10]

P. Benner, A. Onwunta and M. Stoll, Low rank solution of unsteady diffusion equations with stochastic coefficients, SIAM Journal on Uncertainty Quantification, 3 (2015), 622-649.  doi: 10.1137/130937251.  Google Scholar

[11]

P. Benner and J. Saak, Numerical solution of large and sparse continuous time algebraic matrix Riccati and Lyapunov equations: a state of the art survey, GAMM-Mitteilungen, 36 (2013), 32-52.  doi: 10.1002/gamm.201310003.  Google Scholar

[12]

A. Brooks and T. Hughes, Streamline upwind/Petrov-Galerkin formulations for convection dominated flows with particular emphasis on the incompressible Navier-Stokes equations, Computer Methods in Applied Mechanics and Engineering, 32 (1982), 199-259.  doi: 10.1016/0045-7825(82)90071-8.  Google Scholar

[13]

S. Dolgov and B. Khoromskij, Two-level QTT-Tucker format for optimized tensor calculus, SIAM Journal on Matrix Analysis and Applications, 34 (2013), 593-623.  doi: 10.1137/120882597.  Google Scholar

[14]

S. Dolgov and M. Stoll, Low-rank solutions to an optimization problem constrained by the Navier-Stokes equations, SIAM Journal on Scientific Computing, 39 (2017), A255–A280. doi: 10.1137/15M1040414.  Google Scholar

[15]

S. Dolgov, TT-GMRES: solution to a linear system in the structured tensor format, Russian Journal of Numerical Analysis and Mathematical Modelling, 28 (2013), 149-172.  doi: 10.1515/rnam-2013-0009.  Google Scholar

[16]

S. Dolgov and D. Savostyanov, Alternating minimal energy methods for linear systems in higher dimensions, SIAM Journal on Scientific Computing, 36 (2014), A2248–A2271. doi: 10.1137/140953289.  Google Scholar

[17]

D. Donoho et al., High-dimensional data analysis: The curses and blessings of dimensionality, AMS Math Challenges Lecture, 1 (2000), 32. Google Scholar

[18]

F. Feitzinger, T. Hylla and E. Sachs, Inexact Kleinman–Newton method for Riccati equations, SIAM Journal on Matrix Analysis and Applications, 31 (2009), 272-288.  doi: 10.1137/070700978.  Google Scholar

[19]

C. Fu and J. Pfaendtner, Lifting the curse of dimensionality on enhanced sampling of reaction networks with parallel bias metadynamics, Journal of Chemical Theory and Computation, 14 (2018), 2516-2525.   Google Scholar

[20]

L. Grasedyck and W. Hackbusch, A multigrid method to solve large scale Sylvester equations, SIAM Journal on Matrix Analysis and Applications, 29 (2007), 870-894.  doi: 10.1137/040618102.  Google Scholar

[21]

L. Grasedyck, D. Kressner and C. Tobler, A literature survey of low-rank tensor approximation techniques, GAMM-Mitteilungen, 36 (2013), 53-78.  doi: 10.1002/gamm.201310004.  Google Scholar

[22]

W. Hackbusch, Tensor Spaces And Numerical Tensor Calculus, Springer–Verlag, Berlin, 2012. doi: 10.1007/978-3-642-28027-6.  Google Scholar

[23]

W. Hackbusch, B. N. Khoromskij and E. E. Tyrtyshnikov, Approximate iterations for structured matrices, Numerische Mathematik, 109 (2008), 365-383.  doi: 10.1007/s00211-008-0143-0.  Google Scholar

[24]

E. Hansen and T. Stillfjord, Convergence analysis for splitting of the abstract differential Riccati equation, SIAM Journal on Numerical Analysis, 52 (2014), 3128-3139.  doi: 10.1137/130935501.  Google Scholar

[25]

R. Herzog and E. Sachs, Preconditioned conjugate gradient method for optimal control problems with control and state constraints, SIAM Journal on Matrix Analysis and Applications, 31 (2010), 2291–2317, URL https://doi.org/10.1137/090779127. doi: 10.1137/090779127.  Google Scholar

[26]

M. Hinze, Optimal and Instantaneous Control of the Instationary Navier-Stokes Equations, Habilitation, Technisches Universität Dresden, 2002. Google Scholar

[27]

S. Holtz, T. Rohwedder and R. Schneider, The alternating linear scheme for tensor optimization in the tensor train format, SIAM Journal on Scientific Computing, 34 (2012), A683–A713. doi: 10.1137/100818893.  Google Scholar

[28]

B. Khoromskij and V. Khoromskaia, Multigrid accelerated tensor approximation of function related multidimensional arrays, SIAM Journal on Scientific Computing, 31 (2009), 3002-3026.  doi: 10.1137/080730408.  Google Scholar

[29]

G. Kirsten and V. Simoncini, Order reduction methods for solving large-scale differential matrix Riccati equations, accepted SIAM Journal on Scientific Computing. doi: 10.1137/19M1264217.  Google Scholar

[30]

T. Kolda and B. Bader, Tensor decompositions and applications, SIAM Review, 51 (2009), 455-500.  doi: 10.1137/07070111X.  Google Scholar

[31]

A. Koskela and H. Mena, Analysis of Krylov subspace approximation to large scale differential Riccati equations, arXiv preprint arXiv: 1705.07507. Google Scholar

[32]

D. Kressner and C. Tobler, Krylov subspace methods for linear systems with tensor product structure, SIAM Journal on Matrix Analysis and Applications, 31 (2010), 1688-1714.  doi: 10.1137/090756843.  Google Scholar

[33]

N. Lang, Numerical Methods for Large-Scale Linear Time-Varying Control Systems and Related Differential Matrix Equations, PhD thesis, Technische Universität Chemnitz, 2018. Google Scholar

[34]

N. Lang, H. Mena and J. Saak, On the benefits of the $LDL^T$ factorization for large-scale differential matrix equation solvers, Linear Algebra and its Applications, 480 (2015), 44-71.  doi: 10.1016/j.laa.2015.04.006.  Google Scholar

[35]

Y. Lin and V. Simoncini, A new subspace iteration method for the algebraic Riccati equation, Numerical Linear Algebra with Applications, 22 (2015), 26-47.  doi: 10.1002/nla.1936.  Google Scholar

[36]

H. Mena, A. Ostermann, L.-M. Pfurtscheller and C. Piazzola, Numerical low-rank approximation of matrix differential equations, Journal of Computational and Applied Mathematics, 340 (2018), 602-614.  doi: 10.1016/j.cam.2018.01.035.  Google Scholar

[37]

M. R. Opmeer, Decay of singular values of the Gramians of infinite-dimensional systems, in 2015 European Control Conference (ECC), 2015, 1183–1188. Google Scholar

[38]

I. Oseledets, DMRG approach to fast linear algebra in the TT-format, Computational Methods in Applied Mathematics, 11 (2011), 382-393.  doi: 10.2478/cmam-2011-0021.  Google Scholar

[39]

I. Oseledets, Tensor-train decomposition, SIAM Journal on Scientific Computing, 33 (2011), 2295-2317.  doi: 10.1137/090752286.  Google Scholar

[40]

I. Oseledets, S. Dolgov, V. Kazeev, D. Savostyanov, O. Lebedeva, P. Zhlobich, T. Mach and L. Song, TT-Toolbox, URL https://github.com/oseledets/TT-Toolbox, https://github.com/oseledets/TT-Toolbox. Google Scholar

[41]

I. Oseledets and E. Tyrtyshnikov, Breaking the curse of dimensionality, or how to use SVD in many dimensions, SIAM Journal on Scientific Computing, 31 (2009), 3744-3759.  doi: 10.1137/090748330.  Google Scholar

[42]

J. Pearson, M. Stoll and A. Wathen, Preconditioners for state-constrained optimal control problems with Moreau-Yosida penalty function, Numerical Linear Algebra with Applications, 21 (2014), 81–97, URL https://doi.org/10.1002/nla.1863. doi: 10.1002/nla.1863.  Google Scholar

[43]

J. Saak, M. Köhler and P. Benner, M-M.E.S.S.-2.0 – The matrix equations sparse solvers library, See also: www.mpi-magdeburg.mpg.de/projects/mess. doi: 10.5281/zenodo.3368844.  Google Scholar

[44]

C. Schillings and C. Schwab, Sparse, adaptive Smolyak quadratures for Bayesian inverse problems, Inverse Problems, 29 (2013), 065011. doi: 10.1088/0266-5611/29/6/065011.  Google Scholar

[45]

C. Silvestre and A. Pascoal, Depth control of the INFANTE AUV using gain-scheduled reduced order output feedback, Control Engineering Practice, 15 (2007), 883-895.   Google Scholar

[46]

V. Simoncini, Analysis of the rational Krylov subspace projection method for large-scale algebraic Riccati equations, SIAM Journal on Matrix Analysis and Applications, 37 (2016), 1655-1674.  doi: 10.1137/16M1059382.  Google Scholar

[47]

T. Stillfjord, Singular value decay of operator-valued differential Lyapunov and Riccati equations, SIAM Journal on Control and Optimization, 56 (2018), 3598-3618.  doi: 10.1137/18M1178815.  Google Scholar

[48]

M. Stoll and T. Breiten, A low-rank in time approach to PDE-constrained optimization, SIAM Journal on Scientific Computing, 37 (2015), 1-19.  doi: 10.1137/130926365.  Google Scholar

[49]

C. Tobler, Low-rank Tensor Methods for Linear Systems and Eigenvalue Problems, PhD thesis, Diss., Eidgenössische Technische Hochschule ETH Zürich, Nr. 20320, 2012. Google Scholar

[50]

F. Tröltzsch, Optimale Steuerung Partieller Differentialgleichungen, Vieweg+Teubner Verlag, 2005. Google Scholar

[51]

B. Vandereycken and S. Vandewalle, Local Fourier analysis for tensor-product multigrid, in AIP Conference Proceedings, AIP, 1168 (2009), 354–356. Google Scholar

[52]

C. d. Villemagne and R. E. Skelton, Model reductions using a projection formulation, International Journal of Control, 46 (1987), 2141-2169.  doi: 10.1080/00207178708934040.  Google Scholar

[53]

Z. Zhang, X. Yang, I. Oseledets, G. Karniadakis and L. Daniel, Enabling high-dimensional hierarchical uncertainty quantification by ANOVA and tensor-train decomposition, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 34 (2015), 63-76.   Google Scholar

show all references

References:
[1]

H. Abou-Kandil, G. Freiling, V. Ionescu and G. Jank, Matrix Riccati Equations, Systems Control: Foundations Applications, Birkhäuser Verlag, Basel, 2003, URL https://doi.org/10.1007/978-3-0348-8081-7, In Control and Systems Theory. doi: 10.1007/978-3-0348-8081-7.  Google Scholar

[2]

N. Ahmed, G. Matthies, L. Tobiska and H. Xie, Discontinuous Galerkin time stepping with local projection stabilization for transient convection–diffusion-reaction problems, Computer Methods in Applied Mechanics and Engineering, 200 (2011), 1747-1756.  doi: 10.1016/j.cma.2011.02.003.  Google Scholar

[3]

J. Ballani and L. Grasedyck, A projection method to solve linear systems in tensor format, Numerical Linear Algebra with Applications, 20 (2013), 27-43.  doi: 10.1002/nla.1818.  Google Scholar

[4]

R. Bellman, Dynamic programming, Courier Corporation, 2013.  Google Scholar

[5]

P. Benner, Z. Bujanović, P. Kürschner and J. Saak, RADI: A low-rank ADI-type algorithm for large scale algebraic Riccati equations, Numerische Mathematik, 138 (2018), 301-330.  doi: 10.1007/s00211-017-0907-5.  Google Scholar

[6]

P. Benner, Z. Bujanović, P. Kürschner and J. Saak, A numerical comparison of different solvers for large-scale, continuous-time algebraic Riccati equations and LQR problems, SIAM Journal on Scientific Computing, 42 (2020), A957–A996. doi: 10.1137/18M1220960.  Google Scholar

[7]

P. Benner, S. Dolgov, A. Onwunta and M. Stoll, Low-rank solvers for unsteady Stokes-Brinkman optimal control problem with random data, Computer Methods in Applied Mechanics and Engineering, 304 (2016), 26-54.  doi: 10.1016/j.cma.2016.02.004.  Google Scholar

[8]

P. Benner and H. Mena, BDF methods for large-scale differential Riccati equations, in in Proceedings of Mathematical Theory of Network and Systems, MTNS, 2004. Google Scholar

[9]

P. Benner and H. Mena, Rosenbrock methods for solving Riccati differential equations, IEEE Transactions on Automatic Control, 58 (2013), 2950-2956.  doi: 10.1109/TAC.2013.2258495.  Google Scholar

[10]

P. Benner, A. Onwunta and M. Stoll, Low rank solution of unsteady diffusion equations with stochastic coefficients, SIAM Journal on Uncertainty Quantification, 3 (2015), 622-649.  doi: 10.1137/130937251.  Google Scholar

[11]

P. Benner and J. Saak, Numerical solution of large and sparse continuous time algebraic matrix Riccati and Lyapunov equations: a state of the art survey, GAMM-Mitteilungen, 36 (2013), 32-52.  doi: 10.1002/gamm.201310003.  Google Scholar

[12]

A. Brooks and T. Hughes, Streamline upwind/Petrov-Galerkin formulations for convection dominated flows with particular emphasis on the incompressible Navier-Stokes equations, Computer Methods in Applied Mechanics and Engineering, 32 (1982), 199-259.  doi: 10.1016/0045-7825(82)90071-8.  Google Scholar

[13]

S. Dolgov and B. Khoromskij, Two-level QTT-Tucker format for optimized tensor calculus, SIAM Journal on Matrix Analysis and Applications, 34 (2013), 593-623.  doi: 10.1137/120882597.  Google Scholar

[14]

S. Dolgov and M. Stoll, Low-rank solutions to an optimization problem constrained by the Navier-Stokes equations, SIAM Journal on Scientific Computing, 39 (2017), A255–A280. doi: 10.1137/15M1040414.  Google Scholar

[15]

S. Dolgov, TT-GMRES: solution to a linear system in the structured tensor format, Russian Journal of Numerical Analysis and Mathematical Modelling, 28 (2013), 149-172.  doi: 10.1515/rnam-2013-0009.  Google Scholar

[16]

S. Dolgov and D. Savostyanov, Alternating minimal energy methods for linear systems in higher dimensions, SIAM Journal on Scientific Computing, 36 (2014), A2248–A2271. doi: 10.1137/140953289.  Google Scholar

[17]

D. Donoho et al., High-dimensional data analysis: The curses and blessings of dimensionality, AMS Math Challenges Lecture, 1 (2000), 32. Google Scholar

[18]

F. Feitzinger, T. Hylla and E. Sachs, Inexact Kleinman–Newton method for Riccati equations, SIAM Journal on Matrix Analysis and Applications, 31 (2009), 272-288.  doi: 10.1137/070700978.  Google Scholar

[19]

C. Fu and J. Pfaendtner, Lifting the curse of dimensionality on enhanced sampling of reaction networks with parallel bias metadynamics, Journal of Chemical Theory and Computation, 14 (2018), 2516-2525.   Google Scholar

[20]

L. Grasedyck and W. Hackbusch, A multigrid method to solve large scale Sylvester equations, SIAM Journal on Matrix Analysis and Applications, 29 (2007), 870-894.  doi: 10.1137/040618102.  Google Scholar

[21]

L. Grasedyck, D. Kressner and C. Tobler, A literature survey of low-rank tensor approximation techniques, GAMM-Mitteilungen, 36 (2013), 53-78.  doi: 10.1002/gamm.201310004.  Google Scholar

[22]

W. Hackbusch, Tensor Spaces And Numerical Tensor Calculus, Springer–Verlag, Berlin, 2012. doi: 10.1007/978-3-642-28027-6.  Google Scholar

[23]

W. Hackbusch, B. N. Khoromskij and E. E. Tyrtyshnikov, Approximate iterations for structured matrices, Numerische Mathematik, 109 (2008), 365-383.  doi: 10.1007/s00211-008-0143-0.  Google Scholar

[24]

E. Hansen and T. Stillfjord, Convergence analysis for splitting of the abstract differential Riccati equation, SIAM Journal on Numerical Analysis, 52 (2014), 3128-3139.  doi: 10.1137/130935501.  Google Scholar

[25]

R. Herzog and E. Sachs, Preconditioned conjugate gradient method for optimal control problems with control and state constraints, SIAM Journal on Matrix Analysis and Applications, 31 (2010), 2291–2317, URL https://doi.org/10.1137/090779127. doi: 10.1137/090779127.  Google Scholar

[26]

M. Hinze, Optimal and Instantaneous Control of the Instationary Navier-Stokes Equations, Habilitation, Technisches Universität Dresden, 2002. Google Scholar

[27]

S. Holtz, T. Rohwedder and R. Schneider, The alternating linear scheme for tensor optimization in the tensor train format, SIAM Journal on Scientific Computing, 34 (2012), A683–A713. doi: 10.1137/100818893.  Google Scholar

[28]

B. Khoromskij and V. Khoromskaia, Multigrid accelerated tensor approximation of function related multidimensional arrays, SIAM Journal on Scientific Computing, 31 (2009), 3002-3026.  doi: 10.1137/080730408.  Google Scholar

[29]

G. Kirsten and V. Simoncini, Order reduction methods for solving large-scale differential matrix Riccati equations, accepted SIAM Journal on Scientific Computing. doi: 10.1137/19M1264217.  Google Scholar

[30]

T. Kolda and B. Bader, Tensor decompositions and applications, SIAM Review, 51 (2009), 455-500.  doi: 10.1137/07070111X.  Google Scholar

[31]

A. Koskela and H. Mena, Analysis of Krylov subspace approximation to large scale differential Riccati equations, arXiv preprint arXiv: 1705.07507. Google Scholar

[32]

D. Kressner and C. Tobler, Krylov subspace methods for linear systems with tensor product structure, SIAM Journal on Matrix Analysis and Applications, 31 (2010), 1688-1714.  doi: 10.1137/090756843.  Google Scholar

[33]

N. Lang, Numerical Methods for Large-Scale Linear Time-Varying Control Systems and Related Differential Matrix Equations, PhD thesis, Technische Universität Chemnitz, 2018. Google Scholar

[34]

N. Lang, H. Mena and J. Saak, On the benefits of the $LDL^T$ factorization for large-scale differential matrix equation solvers, Linear Algebra and its Applications, 480 (2015), 44-71.  doi: 10.1016/j.laa.2015.04.006.  Google Scholar

[35]

Y. Lin and V. Simoncini, A new subspace iteration method for the algebraic Riccati equation, Numerical Linear Algebra with Applications, 22 (2015), 26-47.  doi: 10.1002/nla.1936.  Google Scholar

[36]

H. Mena, A. Ostermann, L.-M. Pfurtscheller and C. Piazzola, Numerical low-rank approximation of matrix differential equations, Journal of Computational and Applied Mathematics, 340 (2018), 602-614.  doi: 10.1016/j.cam.2018.01.035.  Google Scholar

[37]

M. R. Opmeer, Decay of singular values of the Gramians of infinite-dimensional systems, in 2015 European Control Conference (ECC), 2015, 1183–1188. Google Scholar

[38]

I. Oseledets, DMRG approach to fast linear algebra in the TT-format, Computational Methods in Applied Mathematics, 11 (2011), 382-393.  doi: 10.2478/cmam-2011-0021.  Google Scholar

[39]

I. Oseledets, Tensor-train decomposition, SIAM Journal on Scientific Computing, 33 (2011), 2295-2317.  doi: 10.1137/090752286.  Google Scholar

[40]

I. Oseledets, S. Dolgov, V. Kazeev, D. Savostyanov, O. Lebedeva, P. Zhlobich, T. Mach and L. Song, TT-Toolbox, URL https://github.com/oseledets/TT-Toolbox, https://github.com/oseledets/TT-Toolbox. Google Scholar

[41]

I. Oseledets and E. Tyrtyshnikov, Breaking the curse of dimensionality, or how to use SVD in many dimensions, SIAM Journal on Scientific Computing, 31 (2009), 3744-3759.  doi: 10.1137/090748330.  Google Scholar

[42]

J. Pearson, M. Stoll and A. Wathen, Preconditioners for state-constrained optimal control problems with Moreau-Yosida penalty function, Numerical Linear Algebra with Applications, 21 (2014), 81–97, URL https://doi.org/10.1002/nla.1863. doi: 10.1002/nla.1863.  Google Scholar

[43]

J. Saak, M. Köhler and P. Benner, M-M.E.S.S.-2.0 – The matrix equations sparse solvers library, See also: www.mpi-magdeburg.mpg.de/projects/mess. doi: 10.5281/zenodo.3368844.  Google Scholar

[44]

C. Schillings and C. Schwab, Sparse, adaptive Smolyak quadratures for Bayesian inverse problems, Inverse Problems, 29 (2013), 065011. doi: 10.1088/0266-5611/29/6/065011.  Google Scholar

[45]

C. Silvestre and A. Pascoal, Depth control of the INFANTE AUV using gain-scheduled reduced order output feedback, Control Engineering Practice, 15 (2007), 883-895.   Google Scholar

[46]

V. Simoncini, Analysis of the rational Krylov subspace projection method for large-scale algebraic Riccati equations, SIAM Journal on Matrix Analysis and Applications, 37 (2016), 1655-1674.  doi: 10.1137/16M1059382.  Google Scholar

[47]

T. Stillfjord, Singular value decay of operator-valued differential Lyapunov and Riccati equations, SIAM Journal on Control and Optimization, 56 (2018), 3598-3618.  doi: 10.1137/18M1178815.  Google Scholar

[48]

M. Stoll and T. Breiten, A low-rank in time approach to PDE-constrained optimization, SIAM Journal on Scientific Computing, 37 (2015), 1-19.  doi: 10.1137/130926365.  Google Scholar

[49]

C. Tobler, Low-rank Tensor Methods for Linear Systems and Eigenvalue Problems, PhD thesis, Diss., Eidgenössische Technische Hochschule ETH Zürich, Nr. 20320, 2012. Google Scholar

[50]

F. Tröltzsch, Optimale Steuerung Partieller Differentialgleichungen, Vieweg+Teubner Verlag, 2005. Google Scholar

[51]

B. Vandereycken and S. Vandewalle, Local Fourier analysis for tensor-product multigrid, in AIP Conference Proceedings, AIP, 1168 (2009), 354–356. Google Scholar

[52]

C. d. Villemagne and R. E. Skelton, Model reductions using a projection formulation, International Journal of Control, 46 (1987), 2141-2169.  doi: 10.1080/00207178708934040.  Google Scholar

[53]

Z. Zhang, X. Yang, I. Oseledets, G. Karniadakis and L. Daniel, Enabling high-dimensional hierarchical uncertainty quantification by ANOVA and tensor-train decomposition, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 34 (2015), 63-76.   Google Scholar

Figure 1.  1D heat equation with $ n = 1000 $ and $ n_t = 2000 $. Left. Controlled and desired states. Right. Singular values of solutions
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  Left. Control and observation domains. Right. Singular values of matrix unfoldings
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  Storage reduction by tensor truncation from $ P(\cdot) $ to $ \tilde{P}(\cdot) $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4.  Left. Control domains. Right. Observation domains
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6.  Left. Desired state $ x_d(\xi_1,\xi_2,t_f) $. Right. Controlled state $ x(\xi_1,\xi_2,t_f) $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  Left. Change in Newton iterates. Right. TT ranks of $ \mathbf{p}_i $ during Newton iteration, $ r_1 $ (solid lines) and $ r_2 $ (dashed lines)
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 7.  Left. Change in Newton iterates. Right. TT ranks of $ \mathbf{p}_i $ during Newton iteration, $ r_1 $ (solid lines) and $ r_2 $ (dashed lines)
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 8.  Left. Desired state $ x_d(\xi_1,\xi_2,t_f) $. Right. Controlled state $ x(\xi_1,\xi_2,t_f) $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 9.  Left. Change in Newton iterates. Right. TT ranks of $ \mathbf{p}_i $ during Newton iteration
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 10.  Left. Desired state $ x_d(\xi_1,\xi_2,t_f) $. Right. Controlled state $ x(\xi_1,\xi_2,t_f) $
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 11.  Relative error w.r.t. to the "true" solution from $\mathtt{ode23}$
Figure Options

Download full-size image

Download as PowerPoint slide

Table 1.  Computing times and storage for $ n_t = 100 $ and $ n_t = 1000 $
Time ($ s $) Memory (MB) Time ($ s $) Memory (MB)
$\mathtt{ode23}$ 731 2048 894 20480
$\mathtt{tt}$ 6142 14.61 11940 18.6
$\mathtt{MMESS (split)}$ 6.5 74.32 86 916
$\mathtt{MMESS (BDF)}$ 48 115.3 172 1045
$\mathtt{RKSM-DRE}$ 12 29.44 153 273
Table Options

Download as excel

Time ($ s $) Memory (MB) Time ($ s $) Memory (MB)
$\mathtt{ode23}$ 731 2048 894 20480
$\mathtt{tt}$ 6142 14.61 11940 18.6
$\mathtt{MMESS (split)}$ 6.5 74.32 86 916
$\mathtt{MMESS (BDF)}$ 48 115.3 172 1045
$\mathtt{RKSM-DRE}$ 12 29.44 153 273
[1]

Dan Zhu, Rosemary A. Renaut, Hongwei Li, Tianyou Liu. Fast non-convex low-rank matrix decomposition for separation of potential field data using minimal memory. Inverse Problems & Imaging, , () : -. doi: 10.3934/ipi.2020076
[2]

Lars Grüne, Matthias A. Müller, Christopher M. Kellett, Steven R. Weller. Strict dissipativity for discrete time discounted optimal control problems. Mathematical Control & Related Fields, 2020  doi: 10.3934/mcrf.2020046
[3]

Youming Guo, Tingting Li. Optimal control strategies for an online game addiction model with low and high risk exposure. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020347
[4]

Bernard Bonnard, Jérémy Rouot. Geometric optimal techniques to control the muscular force response to functional electrical stimulation using a non-isometric force-fatigue model. Journal of Geometric Mechanics, 2020  doi: 10.3934/jgm.2020032
[5]

Hong Niu, Zhijiang Feng, Qijin Xiao, Yajun Zhang. A PID control method based on optimal control strategy. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 117-126. doi: 10.3934/naco.2020019
[6]

Zuliang Lu, Fei Huang, Xiankui Wu, Lin Li, Shang Liu. Convergence and quasi-optimality of $ L^2- $norms based an adaptive finite element method for nonlinear optimal control problems. Electronic Research Archive, 2020, 28 (4) : 1459-1486. doi: 10.3934/era.2020077
[7]

Awais Younus, Zoubia Dastgeer, Nudrat Ishaq, Abdul Ghaffar, Kottakkaran Sooppy Nisar, Devendra Kumar. On the observability of conformable linear time-invariant control systems. Discrete & Continuous Dynamical Systems - S, 2020  doi: 10.3934/dcdss.2020444
[8]

Yongge Tian, Pengyang Xie. Simultaneous optimal predictions under two seemingly unrelated linear random-effects models. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020168
[9]

Gunther Uhlmann, Jian Zhai. Inverse problems for nonlinear hyperbolic equations. Discrete & Continuous Dynamical Systems - A, 2021, 41 (1) : 455-469. doi: 10.3934/dcds.2020380
[10]

Yangrong Li, Shuang Yang, Qiangheng Zhang. Odd random attractors for stochastic non-autonomous Kuramoto-Sivashinsky equations without dissipation. Electronic Research Archive, 2020, 28 (4) : 1529-1544. doi: 10.3934/era.2020080
[11]

Pengyu Chen. Non-autonomous stochastic evolution equations with nonlinear noise and nonlocal conditions governed by noncompact evolution families. Discrete & Continuous Dynamical Systems - A, 2020  doi: 10.3934/dcds.2020383
[12]

Lin Shi, Xuemin Wang, Dingshi Li. Limiting behavior of non-autonomous stochastic reaction-diffusion equations with colored noise on unbounded thin domains. Communications on Pure & Applied Analysis, 2020, 19 (12) : 5367-5386. doi: 10.3934/cpaa.2020242
[13]

Wenqiang Zhao, Yijin Zhang. High-order Wong-Zakai approximations for non-autonomous stochastic $ p $-Laplacian equations on $ \mathbb{R}^N $. Communications on Pure & Applied Analysis, 2021, 20 (1) : 243-280. doi: 10.3934/cpaa.2020265
[14]

Predrag S. Stanimirović, Branislav Ivanov, Haifeng Ma, Dijana Mosić. A survey of gradient methods for solving nonlinear optimization. Electronic Research Archive, 2020, 28 (4) : 1573-1624. doi: 10.3934/era.2020115
[15]

José Madrid, João P. G. Ramos. On optimal autocorrelation inequalities on the real line. Communications on Pure & Applied Analysis, 2021, 20 (1) : 369-388. doi: 10.3934/cpaa.2020271
[16]

Touria Karite, Ali Boutoulout. Global and regional constrained controllability for distributed parabolic linear systems: RHum approach. Numerical Algebra, Control & Optimization, 2020  doi: 10.3934/naco.2020055
[17]

Sihem Guerarra. Maximum and minimum ranks and inertias of the Hermitian parts of the least rank solution of the matrix equation AXB = C. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 75-86. doi: 10.3934/naco.2020016
[18]

Xuefei He, Kun Wang, Liwei Xu. Efficient finite difference methods for the nonlinear Helmholtz equation in Kerr medium. Electronic Research Archive, 2020, 28 (4) : 1503-1528. doi: 10.3934/era.2020079
[19]

Xin Guo, Lei Shi. Preface of the special issue on analysis in data science: Methods and applications. Mathematical Foundations of Computing, 2020, 3 (4) : i-ii. doi: 10.3934/mfc.2020026
[20]

Shun Zhang, Jianlin Jiang, Su Zhang, Yibing Lv, Yuzhen Guo. ADMM-type methods for generalized multi-facility Weber problem. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020171

 Impact Factor: 

Tools

Metrics

  • PDF downloads (43)
  • HTML views (150)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2020 American Institute of Mathematical Sciences