Figure 1.
Exact solution
-
Previous Article
Compound truncated Poisson normal distribution: Mathematical properties and Moment estimation
- IPI Home
- This Issue
-
Next Article
Magnetic parameters inversion method with full tensor gradient data
August
2019, 13(4): 755-786.
doi: 10.3934/ipi.2019035
Total generalized variation regularization in data assimilation for Burgers' equation
| 1. | Research Center of Mathematical Modelling (MODEMAT), Escuela Politécnica Nacional, Quito, Ecuador |
| 2. | Faculty of Mathematics, Professorship Numerical Mathematics (Partial Differential Equations), Chemnitz University of Technology, Chemnitz, Germany |
We propose a second-order total generalized variation (TGV) regularization for the reconstruction of the initial condition in variational data assimilation problems. After showing the equivalence between TGV regularization and a Bayesian MAP estimator, we focus on the detailed study of the inviscid Burgers' data assimilation problem. Due to the difficult structure of the governing hyperbolic conservation law, we consider a discretize–then–optimize approach and rigorously derive a first-order optimality condition for the problem. For the numerical solution, we propose a globalized reduced Newton-type method together with a polynomial line-search strategy, and prove convergence of the algorithm to stationary points. The paper finishes with some numerical experiments where, among others, the performance of TGV–regularization compared to TV–regularization is tested.
Mathematics Subject Classification:
Primary: 76B75, 49M15; Secondary: 49K20.
Citation:
Juan Carlos De los Reyes, Estefanía Loayza-Romero. Total generalized variation regularization in data assimilation for Burgers' equation. Inverse Problems and Imaging,
2019, 13
(4)
: 755-786.
doi: 10.3934/ipi.2019035
![]()
References:
| [1] |
A. Apte, D. Auroux and M. Ramaswamy, Variational data assimilation for discrete Burgers equation, Proc. Electron. J. Differential Equations, 19 (2010), 15–30. Avaliable form http://ejde.math.txstate.edu |
| [2] |
K. Bredies, Y. Dong and M. Hintermüller,
Spatially dependent regularization parameter selection in total generalized variation models for image restoration, Int. J. Comput. Math., 90 (2013), 109-123.
doi: 10.1080/00207160.2012.700400. |
| [3] |
K. Bredies, K. Kunisch and T. Pock,
Total generalized variation, SIAM J. Imaging Sci., 3 (2010), 492-526.
doi: 10.1137/090769521. |
| [4] |
K. Bredies and T. Valkonen, Inverse problems with second-order total generalized variation constraints, Proc. SampTA, 201 (2011). Avaliable from: https://imsc.uni-graz.at/bredies/papers/SampTA2011.pdf |
| [5] |
C. J. Budd, M. A. Freitag and N. K. Nichols,
Regularization techniques for ill-posed inverse problems in data assimilation, Comput. & Fluids, 46 (2011), 168-173.
doi: 10.1016/j.compfluid.2010.10.002. |
| [6] |
T. F. Chan, G. H. Golub and P. Mulet,
A nonlinear primal-dual method for total variation-based image restoration, SIAM J. Sci. Comput., 20 (1999), 1964-1977.
doi: 10.1137/S1064827596299767. |
| [7] |
P. G. Ciarlet, Linear and nonlinear functional analysis with applications, SIAM, 2013. |
| [8] |
J. C. De los Reyes, Numerical PDE-constrained optimization, Springer, 2015.
doi: 10.1007/978-3-319-13395-9. |
| [9] |
J. C. De los Reyes, C. B. Schönlieb and T. Valkonen,
Bilevel parameter learning for higher-order total variation regularisation models, J. Math. Imaging Vision, 57 (2017), 1-25.
doi: 10.1007/s10851-016-0662-8. |
| [10] |
J. E. Dennis Jr. and R. B. Schnabel, Numerical methods for unconstrained optimization and nonlinear equations, SIAM, 1996.
doi: 10.1137/1.9781611971200. |
| [11] |
M. A. Freitag, N. K. Nichols and C. J. Budd,
Resolution of sharp fronts in the presence of model error in variational data assimilation, Q. J. Royal Meteorol. Soc., 139 (2010), 742-757.
doi: 10.1002/qj.2002. |
| [12] |
M. Hintermüller and G. Stadler,
An infeasible primal-dual algorithm for total bounded variation-based inf-convolution-type image restoration, SIAM J. Sci. Comput., 28 (2006), 1-23.
doi: 10.1137/040613263. |
| [13] |
M. Hinze, R. Pinnau, M. Ulbrich and S. Ulbrich, Optimization with PDE constraints, Springer Science & Business Media, 2008. |
| [14] |
E. Kalnay, Atmospheric modeling, data assimilation, and predictability, Cambridge University Press, 2003.
doi: 10.1017/CBO9780511802270. |
| [15] |
F. Knoll, K. Bredies, T. Pock and R. Stollberger,
Second order total generalized variation (TGV) for MRI, Magn. Reson. Med., 65 (2011), 480-491.
doi: 10.1002/mrm.22595. |
| [16] |
J. Lee and P. K. Kitanidis,
Bayesian inversion with total variation prior for discrete geologic structure identification, Water Resour. Res., 49 (2013), 7658-7669.
doi: 10.1002/2012WR013431. |
| [17] |
J. M. Lewis, S. Lakshmivarahan and S. K. Dhall, Dynamic data assimilation : a least squares approach, Cambridge University Press, 2006.
doi: 10.1017/CBO9780511526480. |
| [18] |
J. L. Mueller and S. Siltanen, Linear and Nonlinear Inverse Problems with Practical Applications, SIAM, 2012.
doi: 10.1137/1.9781611972344. |
| [19] |
S. Pfaff and S. Ulbrich,
Optimal boundary control of nonlinear hyperbolic conservation laws with switched boundary data, SIAM J. Control Optim., 53 (2015), 1250-1277.
doi: 10.1137/140995799. |
| [20] |
A. Quarteroni, R. Sacco and F. Saleri, Numerical mathematics, Springer Science & Business Media, 2010. |
| [21] |
C. R. Vogel, Computational Methods for Inverse Problems, SIAM, 2002.
doi: 10.1137/1.9780898717570. |
| [22] |
Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli,
Image quality assessment: from error visibility to structural similarity, IEEE Trans. Image Process., 13 (2004), 600-612.
doi: 10.1109/TIP.2003.819861. |
show all references
References:
| [1] |
A. Apte, D. Auroux and M. Ramaswamy, Variational data assimilation for discrete Burgers equation, Proc. Electron. J. Differential Equations, 19 (2010), 15–30. Avaliable form http://ejde.math.txstate.edu |
| [2] |
K. Bredies, Y. Dong and M. Hintermüller,
Spatially dependent regularization parameter selection in total generalized variation models for image restoration, Int. J. Comput. Math., 90 (2013), 109-123.
doi: 10.1080/00207160.2012.700400. |
| [3] |
K. Bredies, K. Kunisch and T. Pock,
Total generalized variation, SIAM J. Imaging Sci., 3 (2010), 492-526.
doi: 10.1137/090769521. |
| [4] |
K. Bredies and T. Valkonen, Inverse problems with second-order total generalized variation constraints, Proc. SampTA, 201 (2011). Avaliable from: https://imsc.uni-graz.at/bredies/papers/SampTA2011.pdf |
| [5] |
C. J. Budd, M. A. Freitag and N. K. Nichols,
Regularization techniques for ill-posed inverse problems in data assimilation, Comput. & Fluids, 46 (2011), 168-173.
doi: 10.1016/j.compfluid.2010.10.002. |
| [6] |
T. F. Chan, G. H. Golub and P. Mulet,
A nonlinear primal-dual method for total variation-based image restoration, SIAM J. Sci. Comput., 20 (1999), 1964-1977.
doi: 10.1137/S1064827596299767. |
| [7] |
P. G. Ciarlet, Linear and nonlinear functional analysis with applications, SIAM, 2013. |
| [8] |
J. C. De los Reyes, Numerical PDE-constrained optimization, Springer, 2015.
doi: 10.1007/978-3-319-13395-9. |
| [9] |
J. C. De los Reyes, C. B. Schönlieb and T. Valkonen,
Bilevel parameter learning for higher-order total variation regularisation models, J. Math. Imaging Vision, 57 (2017), 1-25.
doi: 10.1007/s10851-016-0662-8. |
| [10] |
J. E. Dennis Jr. and R. B. Schnabel, Numerical methods for unconstrained optimization and nonlinear equations, SIAM, 1996.
doi: 10.1137/1.9781611971200. |
| [11] |
M. A. Freitag, N. K. Nichols and C. J. Budd,
Resolution of sharp fronts in the presence of model error in variational data assimilation, Q. J. Royal Meteorol. Soc., 139 (2010), 742-757.
doi: 10.1002/qj.2002. |
| [12] |
M. Hintermüller and G. Stadler,
An infeasible primal-dual algorithm for total bounded variation-based inf-convolution-type image restoration, SIAM J. Sci. Comput., 28 (2006), 1-23.
doi: 10.1137/040613263. |
| [13] |
M. Hinze, R. Pinnau, M. Ulbrich and S. Ulbrich, Optimization with PDE constraints, Springer Science & Business Media, 2008. |
| [14] |
E. Kalnay, Atmospheric modeling, data assimilation, and predictability, Cambridge University Press, 2003.
doi: 10.1017/CBO9780511802270. |
| [15] |
F. Knoll, K. Bredies, T. Pock and R. Stollberger,
Second order total generalized variation (TGV) for MRI, Magn. Reson. Med., 65 (2011), 480-491.
doi: 10.1002/mrm.22595. |
| [16] |
J. Lee and P. K. Kitanidis,
Bayesian inversion with total variation prior for discrete geologic structure identification, Water Resour. Res., 49 (2013), 7658-7669.
doi: 10.1002/2012WR013431. |
| [17] |
J. M. Lewis, S. Lakshmivarahan and S. K. Dhall, Dynamic data assimilation : a least squares approach, Cambridge University Press, 2006.
doi: 10.1017/CBO9780511526480. |
| [18] |
J. L. Mueller and S. Siltanen, Linear and Nonlinear Inverse Problems with Practical Applications, SIAM, 2012.
doi: 10.1137/1.9781611972344. |
| [19] |
S. Pfaff and S. Ulbrich,
Optimal boundary control of nonlinear hyperbolic conservation laws with switched boundary data, SIAM J. Control Optim., 53 (2015), 1250-1277.
doi: 10.1137/140995799. |
| [20] |
A. Quarteroni, R. Sacco and F. Saleri, Numerical mathematics, Springer Science & Business Media, 2010. |
| [21] |
C. R. Vogel, Computational Methods for Inverse Problems, SIAM, 2002.
doi: 10.1137/1.9780898717570. |
| [22] |
Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli,
Image quality assessment: from error visibility to structural similarity, IEEE Trans. Image Process., 13 (2004), 600-612.
doi: 10.1109/TIP.2003.819861. |
Figure 2.
SSIM index for the TV and TGV regularizations
Figure 3.
Best solutions for TV (left) and TGV (right) regularizations
Figure 4.
Observations vs Optimal state
Figure 5.
Exact solutions and best solutions obtained for the experiment
Figure 6.
Global convergence of the algorithm
Figure 7.
Locally superlinear convergence of the algorithm
Figure 8.
Exact solutions for the experiment
Table 1.
Results of the experiments with different values of $ \mu $
| Experiment | iter | SSIM | time (s) | ||
| 3 | 0 | – | NaN | NaN | – |
| 1e-6 | 13 | 0.9594 | 35.8330 | 7.2 | |
| 1e-8 | 12 | 0.9594 | 35.8330 | 6.9 | |
| 1e-10 | 12 | 0.9594 | 35.8330 | 6.9 | |
| 1e-12 | 13 | 0.9594 | 35.8333 | 7.1 | |
| 1e-14 | 13 | 0.9594 | 35.8329 | 7.1 | |
| 4 | 0 | – | NaN | NaN | – |
| 1e-6 | 14 | 0.9592 | 39.2436 | 7.6 | |
| 1e-8 | 13 | 0.9592 | 39.2434 | 7.0 | |
| 1e-10 | 13 | 0.9592 | 39.2434 | 7.0 | |
| 1e-12 | 14 | 0.9591 | 39.2437 | 7.7 | |
| 1e-14 | 16 | 0.9591 | 39.2439 | 9.1 |
| Experiment | iter | SSIM | time (s) | ||
| 3 | 0 | – | NaN | NaN | – |
| 1e-6 | 13 | 0.9594 | 35.8330 | 7.2 | |
| 1e-8 | 12 | 0.9594 | 35.8330 | 6.9 | |
| 1e-10 | 12 | 0.9594 | 35.8330 | 6.9 | |
| 1e-12 | 13 | 0.9594 | 35.8333 | 7.1 | |
| 1e-14 | 13 | 0.9594 | 35.8329 | 7.1 | |
| 4 | 0 | – | NaN | NaN | – |
| 1e-6 | 14 | 0.9592 | 39.2436 | 7.6 | |
| 1e-8 | 13 | 0.9592 | 39.2434 | 7.0 | |
| 1e-10 | 13 | 0.9592 | 39.2434 | 7.0 | |
| 1e-12 | 14 | 0.9591 | 39.2437 | 7.7 | |
| 1e-14 | 16 | 0.9591 | 39.2439 | 9.1 |
Table 2.
Summary of the experiment
| Observations | M | N | ||||||
| 0.1 | 0.01 | 0.001 | ||||||
| iter | SSIM | iter | SSIM | iter | SSIM | |||
| 4 | 75 | 40 | 20 | 0.9573 | 12 | 0.9895 | 12 | 0.9985 |
| 9 | 50 | 20 | 19 | 0.9576 | 12 | 0.9895 | 11 | 0.9985 |
| 30 | 25 | 10 | 20 | 0.9581 | 14 | 0.9896 | 11 | 0.9985 |
| 40 | 20 | 10 | 19 | 0.9584 | 15 | 0.9896 | 12 | 0.9985 |
| 100 | 15 | 5 | 15 | 0.9604 | 12 | 0.9896 | 11 | 0.9985 |
| 150 | 10 | 5 | 20 | 0.9617 | 13 | 0.9897 | 11 | 0.9985 |
| Observations | M | N | ||||||
| 0.1 | 0.01 | 0.001 | ||||||
| iter | SSIM | iter | SSIM | iter | SSIM | |||
| 4 | 75 | 40 | 20 | 0.9573 | 12 | 0.9895 | 12 | 0.9985 |
| 9 | 50 | 20 | 19 | 0.9576 | 12 | 0.9895 | 11 | 0.9985 |
| 30 | 25 | 10 | 20 | 0.9581 | 14 | 0.9896 | 11 | 0.9985 |
| 40 | 20 | 10 | 19 | 0.9584 | 15 | 0.9896 | 12 | 0.9985 |
| 100 | 15 | 5 | 15 | 0.9604 | 12 | 0.9896 | 11 | 0.9985 |
| 150 | 10 | 5 | 20 | 0.9617 | 13 | 0.9897 | 11 | 0.9985 |
| [1] |
Guoqiang Wang, Zhongchen Wu, Zhongtuan Zheng, Xinzhong Cai. Complexity analysis of primal-dual interior-point methods for semidefinite optimization based on a parametric kernel function with a trigonometric barrier term. Numerical Algebra, Control and Optimization, 2015, 5 (2) : 101-113. doi: 10.3934/naco.2015.5.101 |
| [2] |
Kai Wang, Deren Han. On the linear convergence of the general first order primal-dual algorithm. Journal of Industrial and Management Optimization, 2022, 18 (5) : 3749-3770. doi: 10.3934/jimo.2021134 |
| [3] |
Jae-Hong Pyo, Jie Shen. Normal mode analysis of second-order projection methods for incompressible flows. Discrete and Continuous Dynamical Systems - B, 2005, 5 (3) : 817-840. doi: 10.3934/dcdsb.2005.5.817 |
| [4] |
Panagiotis Stinis. A hybrid method for the inviscid Burgers equation. Discrete and Continuous Dynamical Systems, 2003, 9 (4) : 793-799. doi: 10.3934/dcds.2003.9.793 |
| [5] |
Jen-Yen Lin, Hui-Ju Chen, Ruey-Lin Sheu. Augmented Lagrange primal-dual approach for generalized fractional programming problems. Journal of Industrial and Management Optimization, 2013, 9 (4) : 723-741. doi: 10.3934/jimo.2013.9.723 |
| [6] |
Gianni Di Pillo, Giampaolo Liuzzi, Stefano Lucidi. A primal-dual algorithm for nonlinear programming exploiting negative curvature directions. Numerical Algebra, Control and Optimization, 2011, 1 (3) : 509-528. doi: 10.3934/naco.2011.1.509 |
| [7] |
Zimo Zhu, Gang Chen, Xiaoping Xie. Semi-discrete and fully discrete HDG methods for Burgers' equation. Communications on Pure and Applied Analysis, , () : -. doi: 10.3934/cpaa.2021132 |
| [8] |
Fengmin Wang, Dachuan Xu, Donglei Du, Chenchen Wu. Primal-dual approximation algorithms for submodular cost set cover problems with linear/submodular penalties. Numerical Algebra, Control and Optimization, 2015, 5 (2) : 91-100. doi: 10.3934/naco.2015.5.91 |
| [9] |
Yu-Hong Dai, Xin-Wei Liu, Jie Sun. A primal-dual interior-point method capable of rapidly detecting infeasibility for nonlinear programs. Journal of Industrial and Management Optimization, 2020, 16 (2) : 1009-1035. doi: 10.3934/jimo.2018190 |
| [10] |
Xiaojing Ye, Haomin Zhou. Fast total variation wavelet inpainting via approximated primal-dual hybrid gradient algorithm. Inverse Problems and Imaging, 2013, 7 (3) : 1031-1050. doi: 10.3934/ipi.2013.7.1031 |
| [11] |
Yanqin Bai, Xuerui Gao, Guoqiang Wang. Primal-dual interior-point algorithms for convex quadratic circular cone optimization. Numerical Algebra, Control and Optimization, 2015, 5 (2) : 211-231. doi: 10.3934/naco.2015.5.211 |
| [12] |
Siqi Li, Weiyi Qian. Analysis of complexity of primal-dual interior-point algorithms based on a new kernel function for linear optimization. Numerical Algebra, Control and Optimization, 2015, 5 (1) : 37-46. doi: 10.3934/naco.2015.5.37 |
| [13] |
Yixuan Yang, Yuchao Tang, Meng Wen, Tieyong Zeng. Preconditioned Douglas-Rachford type primal-dual method for solving composite monotone inclusion problems with applications. Inverse Problems and Imaging, 2021, 15 (4) : 787-825. doi: 10.3934/ipi.2021014 |
| [14] |
Yu-Hong Dai, Zhouhong Wang, Fengmin Xu. A Primal-dual algorithm for unfolding neutron energy spectrum from multiple activation foils. Journal of Industrial and Management Optimization, 2021, 17 (5) : 2367-2387. doi: 10.3934/jimo.2020073 |
| [15] |
Xiayang Zhang, Yuqian Kong, Shanshan Liu, Yuan Shen. A relaxed parameter condition for the primal-dual hybrid gradient method for saddle-point problem. Journal of Industrial and Management Optimization, 2022 doi: 10.3934/jimo.2022008 |
| [16] |
Jie Shen, Li-Lian Wang. Laguerre and composite Legendre-Laguerre Dual-Petrov-Galerkin methods for third-order equations. Discrete and Continuous Dynamical Systems - B, 2006, 6 (6) : 1381-1402. doi: 10.3934/dcdsb.2006.6.1381 |
| [17] |
Shan Li, Shi-Mi Yan, Zhong-Qing Wang. Efficient Legendre dual-Petrov-Galerkin methods for odd-order differential equations. Discrete and Continuous Dynamical Systems - B, 2020, 25 (4) : 1543-1563. doi: 10.3934/dcdsb.2019239 |
| [18] |
José F. Cariñena, Javier de Lucas Araujo. Superposition rules and second-order Riccati equations. Journal of Geometric Mechanics, 2011, 3 (1) : 1-22. doi: 10.3934/jgm.2011.3.1 |
| [19] |
Eugenii Shustin, Emilia Fridman, Leonid Fridman. Oscillations in a second-order discontinuous system with delay. Discrete and Continuous Dynamical Systems, 2003, 9 (2) : 339-358. doi: 10.3934/dcds.2003.9.339 |
| [20] |
Jiyu Zhong, Shengfu Deng. Two codimension-two bifurcations of a second-order difference equation from macroeconomics. Discrete and Continuous Dynamical Systems - B, 2018, 23 (4) : 1581-1600. doi: 10.3934/dcdsb.2018062 |
2021 Impact Factor: 1.483
Tools
Metrics
Other articles
by authors
[Back to Top]