# American Institute of Mathematical Sciences

December  2019, 1(4): 433-456. doi: 10.3934/fods.2019018

## On the incorporation of box-constraints for ensemble Kalman inversion

 1 Department of Statistics and Applied Probability, National University of Singapore, 119077, Singapore 2 Institute of Mathematics, University of Mannheim, 68131 Mannheim, Germany

* Corresponding author: Neil K. Chada

Published  December 2019

Fund Project: The first author is supported by a Singapore Ministry of Education Academic Research Funds Tier 2 grant [MOE2016-T2-2-135]. The third author is grateful to the DFG RTG1953 "Statistical Modeling of Complex Systems and Processes" for funding of this research

The Bayesian approach to inverse problems is widely used in practice to infer unknown parameters from noisy observations. In this framework, the ensemble Kalman inversion has been successfully applied for the quantification of uncertainties in various areas of applications. In recent years, a complete analysis of the method has been developed for linear inverse problems adopting an optimization viewpoint. However, many applications require the incorporation of additional constraints on the parameters, e.g. arising due to physical constraints. We propose a new variant of the ensemble Kalman inversion to include box constraints on the unknown parameters motivated by the theory of projected preconditioned gradient flows. Based on the continuous time limit of the constrained ensemble Kalman inversion, we discuss a complete convergence analysis for linear forward problems. We adopt techniques from filtering, such as variance inflation, which are crucial in order to improve the performance and establish a correct descent. These benefits are highlighted through a number of numerical examples on various inverse problems based on partial differential equations.

Citation: Neil K. Chada, Claudia Schillings, Simon Weissmann. On the incorporation of box-constraints for ensemble Kalman inversion. Foundations of Data Science, 2019, 1 (4) : 433-456. doi: 10.3934/fods.2019018
##### References:

show all references

##### References:
Varying contour lines of the function $\Phi(x)$ defined in Example 2.2, with both the preconditioned descent direction in the unconstrained case and the projected preconditioned descent direction
Transformed EnKF estimation in comparison to the EnKF estimation and the projected EnKF estimation. $J = 5$ particles have been simulated
Ensemble spread in the transformed EnKF in comparison to the EnKF and the projected EnKF. $J = 5$ particles have been simulated
KKT-Residuals and difference of the misfit functional and the global minimum in the transformed EnKF in comparison to the projected EnKF. $J = 5$ particles have been simulated
Transformed EnKF estimation in comparison to the EnKF estimation and the projected EnKF estimation. $J = 5$ particles have been simulated
Difference of the misfit functional and the global minimum in the transformed EnKF in comparison to the EnKF and the projected EnKF. $J = 5$ particles have been simulated
Transformed EnKF parameter estimation in comparison to the EnKF estimation and the projected EnKF estimation. $J = 5$ particles have been simulated
Transformed EnKF observation estimation in comparison to the EnKF estimation and the projected EnKF estimation. $J = 5$ particles have been simulated
Ensemble spread in the transformed EnKF in comparison to the EnKF and the projected EnKF. $J = 5$ particles have been simulated
Difference of the misfit functional and the global minimum in the transformed EnKF in comparison to the projected EnKF. $J = 5$ particles have been simulated
 [1] Zi Xu, Siwen Wang, Jinjin Huang. An efficient low complexity algorithm for box-constrained weighted maximin dispersion problem. Journal of Industrial & Management Optimization, 2017, 13 (5) : 0-0. doi: 10.3934/jimo.2020007 [2] Tan Bui-Thanh, Quoc P. Nguyen. FEM-based discretization-invariant MCMC methods for PDE-constrained Bayesian inverse problems. Inverse Problems & Imaging, 2016, 10 (4) : 943-975. doi: 10.3934/ipi.2016028 [3] Masoumeh Dashti, Stephen Harris, Andrew Stuart. Besov priors for Bayesian inverse problems. Inverse Problems & Imaging, 2012, 6 (2) : 183-200. doi: 10.3934/ipi.2012.6.183 [4] Guillaume Bal, Ian Langmore, Youssef Marzouk. Bayesian inverse problems with Monte Carlo forward models. Inverse Problems & Imaging, 2013, 7 (1) : 81-105. doi: 10.3934/ipi.2013.7.81 [5] Li Wang, Yang Li, Liwei Zhang. A differential equation method for solving box constrained variational inequality problems. Journal of Industrial & Management Optimization, 2011, 7 (1) : 183-198. doi: 10.3934/jimo.2011.7.183 [6] David Yang Gao. Solutions and optimality criteria to box constrained nonconvex minimization problems. Journal of Industrial & Management Optimization, 2007, 3 (2) : 293-304. doi: 10.3934/jimo.2007.3.293 [7] Changjun Yu, Kok Lay Teo, Liansheng Zhang, Yanqin Bai. On a refinement of the convergence analysis for the new exact penalty function method for continuous inequality constrained optimization problem. Journal of Industrial & Management Optimization, 2012, 8 (2) : 485-491. doi: 10.3934/jimo.2012.8.485 [8] Xiaodi Bai, Xiaojin Zheng, Xiaoling Sun. A survey on probabilistically constrained optimization problems. Numerical Algebra, Control & Optimization, 2012, 2 (4) : 767-778. doi: 10.3934/naco.2012.2.767 [9] Matthias Gerdts, Martin Kunkel. Convergence analysis of Euler discretization of control-state constrained optimal control problems with controls of bounded variation. Journal of Industrial & Management Optimization, 2014, 10 (1) : 311-336. doi: 10.3934/jimo.2014.10.311 [10] Tan Bui-Thanh, Omar Ghattas. A scalable algorithm for MAP estimators in Bayesian inverse problems with Besov priors. Inverse Problems & Imaging, 2015, 9 (1) : 27-53. doi: 10.3934/ipi.2015.9.27 [11] Kui Lin, Shuai Lu, Peter Mathé. Oracle-type posterior contraction rates in Bayesian inverse problems. Inverse Problems & Imaging, 2015, 9 (3) : 895-915. doi: 10.3934/ipi.2015.9.895 [12] Junyoung Jang, Kihoon Jang, Hee-Dae Kwon, Jeehyun Lee. Feedback control of an HBV model based on ensemble kalman filter and differential evolution. Mathematical Biosciences & Engineering, 2018, 15 (3) : 667-691. doi: 10.3934/mbe.2018030 [13] Lacramioara Grecu, Constantin Popa. Constrained SART algorithm for inverse problems in image reconstruction. Inverse Problems & Imaging, 2013, 7 (1) : 199-216. doi: 10.3934/ipi.2013.7.199 [14] Lassi Roininen, Mark Girolami, Sari Lasanen, Markku Markkanen. Hyperpriors for Matérn fields with applications in Bayesian inversion. Inverse Problems & Imaging, 2019, 13 (1) : 1-29. doi: 10.3934/ipi.2019001 [15] Ronan Costaouec, Haoyun Feng, Jesús Izaguirre, Eric Darve. Analysis of the accelerated weighted ensemble methodology. Conference Publications, 2013, 2013 (special) : 171-181. doi: 10.3934/proc.2013.2013.171 [16] Kazimierz Malanowski, Helmut Maurer. Sensitivity analysis for state constrained optimal control problems. Discrete & Continuous Dynamical Systems - A, 1998, 4 (2) : 241-272. doi: 10.3934/dcds.1998.4.241 [17] T. J. Sullivan. Well-posed Bayesian inverse problems and heavy-tailed stable quasi-Banach space priors. Inverse Problems & Imaging, 2017, 11 (5) : 857-874. doi: 10.3934/ipi.2017040 [18] Didi Lv, Qingping Zhou, Jae Kyu Choi, Jinglai Li, Xiaoqun Zhang. Nonlocal TV-Gaussian prior for Bayesian inverse problems with applications to limited CT reconstruction. Inverse Problems & Imaging, 2020, 14 (1) : 117-132. doi: 10.3934/ipi.2019066 [19] Matti Lassas, Eero Saksman, Samuli Siltanen. Discretization-invariant Bayesian inversion and Besov space priors. Inverse Problems & Imaging, 2009, 3 (1) : 87-122. doi: 10.3934/ipi.2009.3.87 [20] Benedetto Piccoli. Optimal syntheses for state constrained problems with application to optimization of cancer therapies. Mathematical Control & Related Fields, 2012, 2 (4) : 383-398. doi: 10.3934/mcrf.2012.2.383

Impact Factor: