Bayesian image restoration for mosaic active imaging

Previous Article
Compressed sensing with coherent tight frames via $l_q$-minimization for $0 < q \leq 1$
IPI Home
This Issue
Next Article
Stability of the determination of a coefficient for wave equations in an infinite waveguide

August 2014, 8(3): 733-760. doi: 10.3934/ipi.2014.8.733

Bayesian image restoration for mosaic active imaging

Nicolas Lermé ^1, , François Malgouyres ^2, , Dominique Hamoir ^3, and Emmanuelle Thouin ^3,

1.	LTCI, CNRS UMR5141, Institut Mines-Télécom, Télécom ParisTech, Paris, France
2.	IMT, CNRS UMR5219, Université de Toulouse, Toulouse, France
3.	ONERA - The French Aerospace Lab, F-31055 Toulouse, France, France

Received December 2012 Revised February 2014 Published August 2014

Abstract
Related Papers

In this paper, we focus on the restoration of images acquired with a new active imaging concept. This new instrument generates a mosaic of active imaging acquisitions. We first describe a simplified forward model of this so-called ``mosaic active imaging''. We also assume a prior on the distribution of images, using the (TV), and deduce a restoration algorithm. This algorithm is a two-stage iterative process which alternates between: i) the estimation of the restored image; ii) the estimation of the acquisition parameters. We then provide the details useful to the implementation of these two steps. In particular, we show that the image estimation can be performed with graph cuts. This allows a fast resolution of this image estimation step. Finally, we detail numerical experiments showing that acquisitions made with a mosaic active imaging device can be restored even under severe noise levels, with few acquisitions.

Keywords: graph cuts., laser imaging, image reconstruction, Active imaging, image estimation.

Mathematics Subject Classification: Primary: 68U10; Secondary: 94A08, 62M40, 90C27, 90C3.

Citation: Nicolas Lermé, François Malgouyres, Dominique Hamoir, Emmanuelle Thouin. Bayesian image restoration for mosaic active imaging. Inverse Problems and Imaging, 2014, 8 (3) : 733-760. doi: 10.3934/ipi.2014.8.733

References:

[1]	J. Bect, L. Blanc-Féraud, G. Aubert and A. Chambolle, A L1-unified variational framework for image restoration, in Computer Vision - ECCV 2004, Lecture Notes in Computer Science, 3024, Springer-Verlag, Berlin Heidelberg, 2004, 1-13.
[2]	D. Bertsekas, Nonlinear Programming, 2nd edition, Athena Scientific, 2003.
[3]	Y. Boykov and V. Kolmogorov, An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision, Pattern Analysis And Machine Intelligence, 26 (2004), 1124-1137. doi: 10.1109/TPAMI.2004.60.
[4]	A. Chambolle, An algorithm for total variation minimization and applications, Journal of Mathematical Imaging and Vision, 20 (2004), 89-97.
[5]	A. Chambolle, Total variation minimization and a class of binary MRF models, in Energy Minimization Methods in Computer Vision and Pattern Recognition, Lecture Notes in Computer Science, Vol. 3757, Springer, 2005, 136-152. doi: 10.1007/11585978_10.
[6]	A. Chambolle and J. Darbon, On total variation minimization and surface evolution using parametric maximum flows, International Journal of Computer Vision, 84 (2009), 288-307. doi: 10.1007/s11263-009-0238-9.
[7]	A. Chambolle and T. Pock, A first-order primal-dual algorithm for convex problems with applications to imaging, Journal of Mathematical Imaging and Vision, 40 (2011), 120-145. doi: 10.1007/s10851-010-0251-1.
[8]	T. Chan and J. Shen, Variational image inpainting, Communications in Pure and Applied Math., 58 (2005), 579-619. doi: 10.1002/cpa.20075.
[9]	F. Chassat, Optical Propagation through Atmospheric Turbulence: Moral Study and Application of Anisoplanatism in Adaptive Optics, PhD thesis, University of Paris Sud, 1992.
[10]	R. R. Coifman and A. Sowa, Combining the calculus of variations and wavelets for image enhancement, Applied and Computational Harmonic Analysis, 9 (2000), 1-18. doi: 10.1006/acha.2000.0299.
[11]	J. Darbon and M. Sigelle, Image restoration with discrete constrained total variation. I. Fast and exact optimization, Journal of Mathematical Imaging and Vision, 26 (2006), 261-276. doi: 10.1007/s10851-006-8803-0.
[12]	G. Demoment, Image reconstruction and restoration: Overview of common estimation structures and problems, IEEE, Transactions on Acoustics, Speech and Signal Processing, 37 (1989), 2024-2036. doi: 10.1109/29.45551.
[13]	M. Elad, Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing, Springer, New York, 2010. doi: 10.1007/978-1-4419-7011-4.
[14]	R. Fante, Electromagnetic beam propagation in turbulent media, Proceedings of the IEEE, 63 (1975), 1669-1692. doi: 10.1109/PROC.1975.10035.
[15]	D. Fried, Optical resolution through a randomly inhomogeneous medium for very long and very short exposures, Journal of the Optical Society of America, 56 (1966), 1372-1379. doi: 10.1364/JOSA.56.001372.
[16]	D. Greig, B. Porteous and A. Seheult, Exact maximum a posteriori estimation for binary images, Journal of the Royal Statistical Society, 51 (1989), 271-279.
[17]	D. Hamoir, Procédé et système d'imagerie active à champ large: Method and system for active imaging with a large field, Patent WO 2010119225, 2010.
[18]	L. Hespel, M.-T. Velluet, A. Bonnefois, N. Rivière, M. Fraces, D. Hamoir, B. Tanguy, B. Duchenne and J. Isbert, Comparison of a physics-based BIL simulator with experiments, in International Symposium on Photoelectronic Detection and Imaging, Society of Photo-Optical Instrumentation Engineers, 2009, 73822T-73822T-10.
[19]	J. Kiefer, Sequential minimax search for a maximum, Proceedings of the American Mathematical Society, 4 (1953), 502-506. doi: 10.1090/S0002-9939-1953-0055639-3.
[20]	A. Kolmogorov, The local structure of turbulence in incompressible viscous fluid for very large Reynolds numbers, Doklady Akademii Nauk SSSR, 66 (1949), 825; English translation in Turbulence: Classic Papers on Statistical Theory (eds. S. K. Friedlander and L. Topper), Interscience Publishers, Inc., New York, 1961, 151.
[21]	V. Kolmogorov and R. Zabih, What energy functions can be minimized via graph cuts?, Pattern Analysis And Machine Intelligence, 26 (2004), 147-159. doi: 10.1109/TPAMI.2004.1262177.
[22]	F. Luisier, T. Blu and M. Unser, Image denoising in mixed Poisson-Gaussian noise, IEEE Transactions on Image Processing, 20 (2011), 696-708. doi: 10.1109/TIP.2010.2073477.
[23]	F. Malgouyres and F. Guichard, Edge direction preserving image zooming: A mathematical and numerical analysis, SIAM Journal on Numerical Analysis, 39 (2001), 1-37. doi: 10.1137/S0036142999362286.
[24]	Y. Mao and J. Gilles, Non rigid geometric distortions correction - Application to atmospheric turbulence stabilization, Inverse Problems and Imaging, 6 (2012), 531-546. doi: 10.3934/ipi.2012.6.531.
[25]	Y. Meyer, Oscillating Patterns in Image Processing and in Some Nonlinear Evolution Equations, The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures, University Lecture Series, 22, AMS, Providence, RI, 2001.
[26]	M. Mäkitalo and A. Foi, Optimal inversion of the generalized Anscombe transformation for Poisson-Gaussian noise, IEEE Transactions on Image Processing, 22 (2013), 91-103. doi: 10.1109/TIP.2012.2202675.
[27]	M. Nikolova, Local strong homogeneity of a regularized estimator, SIAM Journal of Applied Mathematics, 61 (2000), 633-658. doi: 10.1137/S0036139997327794.
[28]	J. Picard and H. Ratliff, Minimum cuts and related problems, Networks, 5 (1975), 357-370. doi: 10.1002/net.3230050405.
[29]	N. Rivière, L. Hespel, M.-T. Velluet, Y.-M. Frédéric, P. Barillot and F. Hélias, Modeling of an active burst illumination imaging system: Comparison between experimental and modelled 3d scene, in Society of Photo-Optical Instrumentation Engineers, International Symposium on Photoelectronic Detection and Imaging, Vol. 7382, 2010, 783509-783509-11. doi: 10.1117/12.864694.
[30]	F. Roddier, The effects of atmospheric turbulence in optical astronomy, Progress in Optics, 19 (1981), 281-376. doi: 10.1016/S0079-6638(08)70204-X.
[31]	L. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D, 60 (1992), 259-268. doi: 10.1016/0167-2789(92)90242-F.

show all references

References:

[1]	J. Bect, L. Blanc-Féraud, G. Aubert and A. Chambolle, A L1-unified variational framework for image restoration, in Computer Vision - ECCV 2004, Lecture Notes in Computer Science, 3024, Springer-Verlag, Berlin Heidelberg, 2004, 1-13.
[2]	D. Bertsekas, Nonlinear Programming, 2nd edition, Athena Scientific, 2003.
[3]	Y. Boykov and V. Kolmogorov, An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision, Pattern Analysis And Machine Intelligence, 26 (2004), 1124-1137. doi: 10.1109/TPAMI.2004.60.
[4]	A. Chambolle, An algorithm for total variation minimization and applications, Journal of Mathematical Imaging and Vision, 20 (2004), 89-97.
[5]	A. Chambolle, Total variation minimization and a class of binary MRF models, in Energy Minimization Methods in Computer Vision and Pattern Recognition, Lecture Notes in Computer Science, Vol. 3757, Springer, 2005, 136-152. doi: 10.1007/11585978_10.
[6]	A. Chambolle and J. Darbon, On total variation minimization and surface evolution using parametric maximum flows, International Journal of Computer Vision, 84 (2009), 288-307. doi: 10.1007/s11263-009-0238-9.
[7]	A. Chambolle and T. Pock, A first-order primal-dual algorithm for convex problems with applications to imaging, Journal of Mathematical Imaging and Vision, 40 (2011), 120-145. doi: 10.1007/s10851-010-0251-1.
[8]	T. Chan and J. Shen, Variational image inpainting, Communications in Pure and Applied Math., 58 (2005), 579-619. doi: 10.1002/cpa.20075.
[9]	F. Chassat, Optical Propagation through Atmospheric Turbulence: Moral Study and Application of Anisoplanatism in Adaptive Optics, PhD thesis, University of Paris Sud, 1992.
[10]	R. R. Coifman and A. Sowa, Combining the calculus of variations and wavelets for image enhancement, Applied and Computational Harmonic Analysis, 9 (2000), 1-18. doi: 10.1006/acha.2000.0299.
[11]	J. Darbon and M. Sigelle, Image restoration with discrete constrained total variation. I. Fast and exact optimization, Journal of Mathematical Imaging and Vision, 26 (2006), 261-276. doi: 10.1007/s10851-006-8803-0.
[12]	G. Demoment, Image reconstruction and restoration: Overview of common estimation structures and problems, IEEE, Transactions on Acoustics, Speech and Signal Processing, 37 (1989), 2024-2036. doi: 10.1109/29.45551.
[13]	M. Elad, Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing, Springer, New York, 2010. doi: 10.1007/978-1-4419-7011-4.
[14]	R. Fante, Electromagnetic beam propagation in turbulent media, Proceedings of the IEEE, 63 (1975), 1669-1692. doi: 10.1109/PROC.1975.10035.
[15]	D. Fried, Optical resolution through a randomly inhomogeneous medium for very long and very short exposures, Journal of the Optical Society of America, 56 (1966), 1372-1379. doi: 10.1364/JOSA.56.001372.
[16]	D. Greig, B. Porteous and A. Seheult, Exact maximum a posteriori estimation for binary images, Journal of the Royal Statistical Society, 51 (1989), 271-279.
[17]	D. Hamoir, Procédé et système d'imagerie active à champ large: Method and system for active imaging with a large field, Patent WO 2010119225, 2010.
[18]	L. Hespel, M.-T. Velluet, A. Bonnefois, N. Rivière, M. Fraces, D. Hamoir, B. Tanguy, B. Duchenne and J. Isbert, Comparison of a physics-based BIL simulator with experiments, in International Symposium on Photoelectronic Detection and Imaging, Society of Photo-Optical Instrumentation Engineers, 2009, 73822T-73822T-10.
[19]	J. Kiefer, Sequential minimax search for a maximum, Proceedings of the American Mathematical Society, 4 (1953), 502-506. doi: 10.1090/S0002-9939-1953-0055639-3.
[20]	A. Kolmogorov, The local structure of turbulence in incompressible viscous fluid for very large Reynolds numbers, Doklady Akademii Nauk SSSR, 66 (1949), 825; English translation in Turbulence: Classic Papers on Statistical Theory (eds. S. K. Friedlander and L. Topper), Interscience Publishers, Inc., New York, 1961, 151.
[21]	V. Kolmogorov and R. Zabih, What energy functions can be minimized via graph cuts?, Pattern Analysis And Machine Intelligence, 26 (2004), 147-159. doi: 10.1109/TPAMI.2004.1262177.
[22]	F. Luisier, T. Blu and M. Unser, Image denoising in mixed Poisson-Gaussian noise, IEEE Transactions on Image Processing, 20 (2011), 696-708. doi: 10.1109/TIP.2010.2073477.
[23]	F. Malgouyres and F. Guichard, Edge direction preserving image zooming: A mathematical and numerical analysis, SIAM Journal on Numerical Analysis, 39 (2001), 1-37. doi: 10.1137/S0036142999362286.
[24]	Y. Mao and J. Gilles, Non rigid geometric distortions correction - Application to atmospheric turbulence stabilization, Inverse Problems and Imaging, 6 (2012), 531-546. doi: 10.3934/ipi.2012.6.531.
[25]	Y. Meyer, Oscillating Patterns in Image Processing and in Some Nonlinear Evolution Equations, The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures, University Lecture Series, 22, AMS, Providence, RI, 2001.
[26]	M. Mäkitalo and A. Foi, Optimal inversion of the generalized Anscombe transformation for Poisson-Gaussian noise, IEEE Transactions on Image Processing, 22 (2013), 91-103. doi: 10.1109/TIP.2012.2202675.
[27]	M. Nikolova, Local strong homogeneity of a regularized estimator, SIAM Journal of Applied Mathematics, 61 (2000), 633-658. doi: 10.1137/S0036139997327794.
[28]	J. Picard and H. Ratliff, Minimum cuts and related problems, Networks, 5 (1975), 357-370. doi: 10.1002/net.3230050405.
[29]	N. Rivière, L. Hespel, M.-T. Velluet, Y.-M. Frédéric, P. Barillot and F. Hélias, Modeling of an active burst illumination imaging system: Comparison between experimental and modelled 3d scene, in Society of Photo-Optical Instrumentation Engineers, International Symposium on Photoelectronic Detection and Imaging, Vol. 7382, 2010, 783509-783509-11. doi: 10.1117/12.864694.
[30]	F. Roddier, The effects of atmospheric turbulence in optical astronomy, Progress in Optics, 19 (1981), 281-376. doi: 10.1016/S0079-6638(08)70204-X.
[31]	L. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D, 60 (1992), 259-268. doi: 10.1016/0167-2789(92)90242-F.

[1]	Yong Zheng Ong, Haizhao Yang. Generative imaging and image processing via generative encoder. Inverse Problems and Imaging, 2022, 16 (3) : 525-545. doi: 10.3934/ipi.2021060
[2]	Simon Hubmer, Andreas Neubauer, Ronny Ramlau, Henning U. Voss. On the parameter estimation problem of magnetic resonance advection imaging. Inverse Problems and Imaging, 2018, 12 (1) : 175-204. doi: 10.3934/ipi.2018007
[3]	Jianjun Zhang, Yunyi Hu, James G. Nagy. A scaled gradient method for digital tomographic image reconstruction. Inverse Problems and Imaging, 2018, 12 (1) : 239-259. doi: 10.3934/ipi.2018010
[4]	Wenxiang Cong, Ge Wang, Qingsong Yang, Jia Li, Jiang Hsieh, Rongjie Lai. CT image reconstruction on a low dimensional manifold. Inverse Problems and Imaging, 2019, 13 (3) : 449-460. doi: 10.3934/ipi.2019022
[5]	Lacramioara Grecu, Constantin Popa. Constrained SART algorithm for inverse problems in image reconstruction. Inverse Problems and Imaging, 2013, 7 (1) : 199-216. doi: 10.3934/ipi.2013.7.199
[6]	Bernadette N. Hahn, Melina-Loren Kienle Garrido, Christian Klingenberg, Sandra Warnecke. Using the Navier-Cauchy equation for motion estimation in dynamic imaging. Inverse Problems and Imaging, , () : -. doi: 10.3934/ipi.2022018
[7]	Habib Ammari, Josselin Garnier, Vincent Jugnon. Detection, reconstruction, and characterization algorithms from noisy data in multistatic wave imaging. Discrete and Continuous Dynamical Systems - S, 2015, 8 (3) : 389-417. doi: 10.3934/dcdss.2015.8.389
[8]	Chengxiang Wang, Li Zeng, Yumeng Guo, Lingli Zhang. Wavelet tight frame and prior image-based image reconstruction from limited-angle projection data. Inverse Problems and Imaging, 2017, 11 (6) : 917-948. doi: 10.3934/ipi.2017043
[9]	Yunhai Xiao, Junfeng Yang, Xiaoming Yuan. Alternating algorithms for total variation image reconstruction from random projections. Inverse Problems and Imaging, 2012, 6 (3) : 547-563. doi: 10.3934/ipi.2012.6.547
[10]	Ming Yan, Alex A. T. Bui, Jason Cong, Luminita A. Vese. General convergent expectation maximization (EM)-type algorithms for image reconstruction. Inverse Problems and Imaging, 2013, 7 (3) : 1007-1029. doi: 10.3934/ipi.2013.7.1007
[11]	Florian Bossmann, Jianwei Ma. Enhanced image approximation using shifted rank-1 reconstruction. Inverse Problems and Imaging, 2020, 14 (2) : 267-290. doi: 10.3934/ipi.2020012
[12]	Kaitlyn Muller. The relationship between backprojection and best linear unbiased estimation in synthetic-aperture radar imaging. Inverse Problems and Imaging, 2016, 10 (2) : 549-561. doi: 10.3934/ipi.2016011
[13]	Thomas März, Andreas Weinmann. Model-based reconstruction for magnetic particle imaging in 2D and 3D. Inverse Problems and Imaging, 2016, 10 (4) : 1087-1110. doi: 10.3934/ipi.2016033
[14]	Daniela Calvetti, Erkki Somersalo. Microlocal sequential regularization in imaging. Inverse Problems and Imaging, 2007, 1 (1) : 1-11. doi: 10.3934/ipi.2007.1.1
[15]	Guillaume Bal, Olivier Pinaud, Lenya Ryzhik. On the stability of some imaging functionals. Inverse Problems and Imaging, 2016, 10 (3) : 585-616. doi: 10.3934/ipi.2016013
[16]	Laurent Bourgeois, Jean-François Fritsch, Arnaud Recoquillay. Imaging junctions of waveguides. Inverse Problems and Imaging, 2021, 15 (2) : 285-314. doi: 10.3934/ipi.2020065
[17]	Yonggui Zhu, Yuying Shi, Bin Zhang, Xinyan Yu. Weighted-average alternating minimization method for magnetic resonance image reconstruction based on compressive sensing. Inverse Problems and Imaging, 2014, 8 (3) : 925-937. doi: 10.3934/ipi.2014.8.925
[18]	Yunmei Chen, Xiaojing Ye, Feng Huang. A novel method and fast algorithm for MR image reconstruction with significantly under-sampled data. Inverse Problems and Imaging, 2010, 4 (2) : 223-240. doi: 10.3934/ipi.2010.4.223
[19]	Ibrar Hussain, Haider Ali, Muhammad Shahkar Khan, Sijie Niu, Lavdie Rada. Robust region-based active contour models via local statistical similarity and local similarity factor for intensity inhomogeneity and high noise image segmentation. Inverse Problems and Imaging, , () : -. doi: 10.3934/ipi.2022014
[20]	Shenglong Hu, Zheng-Hai Huang, Hong-Yan Ni, Liqun Qi. Positive definiteness of Diffusion Kurtosis Imaging. Inverse Problems and Imaging, 2012, 6 (1) : 57-75. doi: 10.3934/ipi.2012.6.57

2020 Impact Factor: 1.639

Tools

Metrics

Other articles
by authors

on AIMS
Nicolas Lermé François Malgouyres Dominique Hamoir Emmanuelle Thouin
on Google Scholar
Nicolas Lermé François Malgouyres Dominique Hamoir Emmanuelle Thouin

[Back to Top]