A geometry guided image denoising scheme

Previous Article
A note on analyticity properties of far field patterns
IPI Home
This Issue
Next Article
A three-dimensional inverse gravimetry problem for ice with snow caps

May 2013, 7(2): 499-521. doi: 10.3934/ipi.2013.7.499

A geometry guided image denoising scheme

1.	10900 Euclid Avenue, Cleveland, OH 44106-7058, United States, United States

Received August 2011 Revised January 2013 Published May 2013

Abstract
Related Papers

During image denoising, it is often difficult to balance between the removal of noise and the preservation of contrast and fine features, especially when the noise is excessive. We propose to efficiently balance the two using segmentation and more general geometry extraction transforms. Explained in the nonlocal-means (NL-means) framework, we introduce a mutual position function to ensure the averaging is only taken over pixels in the same segmentation phase, and provide selection schemes for convolution kernel and weight function to further improve the performance. To address unreliable segmentation due to more excessive noise, we use a feature extraction transform that is more general than segmentation and less sensitive to noise. Unlike most denoising approaches that only work for one type of noise and/or involve heuristic parameter tuning, the proposed method comes with an automatic parameter selection scheme, and can be easily adapted for various types of noise, ranging from Gaussian, Poisson, Rician to ultrasound noise. Comparison with the original NL-means as well as ROF, BM3D, and K-SVD on various simulated data, MRI and SEM images, indicates potentials of the proposed method.

Keywords: segmentation, nonlocal means., Image denoising.

Mathematics Subject Classification: 68U10, 65D18, 65D1.

Citation: Weihong Guo, Jing Qin. A geometry guided image denoising scheme. Inverse Problems & Imaging, 2013, 7 (2) : 499-521. doi: 10.3934/ipi.2013.7.499

References:

[1]	D. Mumford and J. Shah, Optimal approximations by piecewise smooth functions and associated variational problems,, Comm. Pure Appl. Math., 42 (1989), 577. doi: 10.1002/cpa.3160420503.
[2]	P. Perona and J. Malik, Scale-space and edge detection using anisotropic diffusion,, IEEE Transactions on Pattern Analysis and Machine Intelligence, 12 (1990), 629. doi: 10.1109/34.56205.
[3]	L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithm,, Physica D: Nonlinear Phenomena, 60 (1992), 259. doi: 10.1016/0167-2789(92)90242-F.
[4]	M. Bertalmio, V. Caselles, B. Rougé and A. Solé, TV based image restoration with local constraints,, Journal of Scientific Computing, 19 (2003), 95. doi: 10.1023/A:1025391506181.
[5]	S. Geman and D. Geman, Stochastic relaxation, gibbs distributions, and the bayesian restoration of images,, IEEE Transactions on Pattern Analysis and Machine Intelligence, 6 (1984), 721.
[6]	P. Saint-Marc, J. S. Chen and G. Medioni, Adaptive smoothing: A general tool for early vision,, IEEE Transactions on Pattern Analysis and Machine Intelligence, 13 (1991), 514.
[7]	S. M. Smith and J. M. Brady, SUSAN - A new approach to low level image processing,, International Journal of Computer Vision, 23 (1995), 45.
[8]	C. Tomasi and R. Manduchi, Bilateral filtering for gray and color images,, in, (1998), 839. doi: 10.1109/ICCV.1998.710815.
[9]	M. Elad, On the origin of the bilateral filter and ways to improve it,, IEEE Transactions on Image Processing, 11 (2002), 1141. doi: 10.1109/TIP.2002.801126.
[10]	S. Durand and J. Froment, Reconstruction of wavelet coefficients using total variation minimization,, SIAM J. Sci. Comput., 24 (2003), 1754. doi: 10.1137/S1064827501397792.
[11]	A. Buades, B. Coll and J. M. Morel, A non-local algorithm for image denoising,, IEEE Computer Society, 2 (2005), 60. doi: 10.1109/CVPR.2005.38.
[12]	S. Kindermann, S. Osher and P. W. Jones, Deblurring and Denoising of Images by Nonlocal Functionals,, Multiscale Modelling and Simulation, 4 (2005), 1091. doi: 10.1137/050622249.
[13]	T. Brox and D. Cremers, Iterated nonlocal means for texture restoration,, Scale Space and Variational Methods in Computer Vision, (2008), 13. doi: 10.1007/978-3-540-72823-8_2.
[14]	C. Kervrann, J. Boulanger and P. Coupé, Bayesian non-local means filter, image redundancy and adaptive dictionaries for noise removal,, Scale Space and Variational Methods in Computer Vision, (2007), 520. doi: 10.1007/978-3-540-72823-8_45.
[15]	B. Goossens, Q. Luong, A. Pizurica and W. Philips, An improved non-local denoising algorithm,, in, (2008).
[16]	G. Gilboa and S. Osher, Nonlocal operators with applications to image processing,, Multiscale Modeling and Simulation, 7 (2008), 1005. doi: 10.1137/070698592.
[17]	C-A. Deledalle, L. Denis and F. Tupin, Iterative wieghted maximum likelihood denoising with probabilistic patch-based weights,, Transactions on Image Processing, 18 (2009), 2661. doi: 10.1109/TIP.2009.2029593.
[18]	D. Peter, V. Govindan and A. Mathew, Nonlocal-means image denoising techonology using robust M-estimator,, Journal of Computer Science and Technology, 25 (2010), 623.
[19]	N. Wiest-Daesslé, S. Prima, P. Coupé, S. P. Morrissey and C. Barillot, Rician noise removal by non-local means filtering for low signal-to-noise ratio MRI: Applications to DT-MRI,, in, (2008), 171. doi: 10.1007/978-3-540-85990-1_21.
[20]	P. Coupé, P. Yger, S. Prima, P. Hellier, C. Kervrann and C. Barillot, An optimized blockwise nonlocal means denoising filter for 3-D magnetic resonance images,, Medical Imaging, 27 (2008), 425. doi: 10.1109/TMI.2007.906087.
[21]	C-A. Deledalle, F. Tupin and L. Denis, Poisson NL means: Unsupervised non local means for Poisson noise,, in, (2010). doi: 10.1109/ICIP.2010.5653394.
[22]	S. Osher and J. A. Sethian, Fronts propagating with curvature dependent speed: Algorithms based on Hamilton-Jacobi formulations,, Journal of Computational Physics, 79 (1988), 12. doi: 10.1016/0021-9991(88)90002-2.
[23]	T. F. Chan and L. A. Vese, Active contours without edges,, Image Processing, 10 (2001), 266. doi: 10.1109/83.902291.
[24]	L. A. Vese and T. F. Chan, A multiphase level set framework for image segmentation using the mumford and shah model,, International Journal of Computer Vision, 50 (2002), 271.
[25]	K. Krishnamoorthy, "Handbook of Statistical Distributions with Applications,", Chapman and Hall/CRC Press, (2006). doi: 10.1201/9781420011371.
[26]	T. Gasser, L. Sroka and C. Jennen-Steinmetz, Residual variance and residual pattern in nonlinear regression,, Biometrika, 73 (1986), 625. doi: 10.1093/biomet/73.3.625.
[27]	M. N. Do and M. Vetterli, The contourlet transform: an efficient directional multiresolution image representation,, IEEE Transactions on Image Processing, 14 (2005), 2091. doi: 10.1109/TIP.2005.859376.
[28]	Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, Image quality assessment: From error visibility to structural similarity,, Image Processing, 13 (2004), 600. doi: 10.1109/TIP.2003.819861.
[29]	E. Candés and D. Donoho, "Curvelets: A Surprisingly Effective Nonadaptive Representation of Objects with Edges,", in, ().
[30]	K. Guo, G. Kutyniok and D. Labate, "Sparse Multidimensional Representations using Anisotropic Dilation and Shear Operators,", Wavelets and Splines (Athens, (2005).
[31]	E. A. Nadaraya, On estimating regression,, Theory Probab. Appl., 9 (1964), 141. doi: 10.1137/1109020.
[32]	F. J. Anscombe, The transformation of Poisson, binomial and negative-binomial data,, Biometrika, 35 (1948), 246.
[33]	M. D. DeVore, A. D. Lanterman and J. A. O'Sullivan, ATR performance of a rician model for SAR images,, in, 4050 (2000), 34. doi: 10.1117/12.395589.
[34]	J. Sijbers, A. J. Den Dekker, P. Scheunders and D. Van Dyck, Maximum-likelihood estimation of Rician distribution parameters,, Medical Imaging, 17 (1998), 357. doi: 10.1109/42.712125.
[35]	T. Loupas, W. N. McDicken and P. L. Allan, An adaptive weighted median filter for speckle suppression in medical ultrasonic images,, Circuits and Systems, 36 (1989), 129. doi: 10.1109/31.16577.
[36]	K. Krissian, Speckle-constrained anisotropic diffusion for ultrasound images,, in, (2005), 547.
[37]	K. Dabov, A. Foi, V. Katkovnik and K. Egiazarian, Image denoising with block-matching and 3D filtering,, in, 6064 (2006). doi: 10.1117/12.643267.
[38]	M. Elad and M. Aharon, Image denoising via sparse and redundant representations over learned dictionaries,, Image Processing, 15 (2006), 3736. doi: 10.1109/TIP.2006.881969.
[39]	P. Coupé, P. Hellier, C. Kervrann and C. Barillot, Bayesian non local means-based speckle filtering,, in, (2008), 1291. doi: 10.1109/ISBI.2008.4541240.

show all references

References:

[1]	D. Mumford and J. Shah, Optimal approximations by piecewise smooth functions and associated variational problems,, Comm. Pure Appl. Math., 42 (1989), 577. doi: 10.1002/cpa.3160420503.
[2]	P. Perona and J. Malik, Scale-space and edge detection using anisotropic diffusion,, IEEE Transactions on Pattern Analysis and Machine Intelligence, 12 (1990), 629. doi: 10.1109/34.56205.
[3]	L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithm,, Physica D: Nonlinear Phenomena, 60 (1992), 259. doi: 10.1016/0167-2789(92)90242-F.
[4]	M. Bertalmio, V. Caselles, B. Rougé and A. Solé, TV based image restoration with local constraints,, Journal of Scientific Computing, 19 (2003), 95. doi: 10.1023/A:1025391506181.
[5]	S. Geman and D. Geman, Stochastic relaxation, gibbs distributions, and the bayesian restoration of images,, IEEE Transactions on Pattern Analysis and Machine Intelligence, 6 (1984), 721.
[6]	P. Saint-Marc, J. S. Chen and G. Medioni, Adaptive smoothing: A general tool for early vision,, IEEE Transactions on Pattern Analysis and Machine Intelligence, 13 (1991), 514.
[7]	S. M. Smith and J. M. Brady, SUSAN - A new approach to low level image processing,, International Journal of Computer Vision, 23 (1995), 45.
[8]	C. Tomasi and R. Manduchi, Bilateral filtering for gray and color images,, in, (1998), 839. doi: 10.1109/ICCV.1998.710815.
[9]	M. Elad, On the origin of the bilateral filter and ways to improve it,, IEEE Transactions on Image Processing, 11 (2002), 1141. doi: 10.1109/TIP.2002.801126.
[10]	S. Durand and J. Froment, Reconstruction of wavelet coefficients using total variation minimization,, SIAM J. Sci. Comput., 24 (2003), 1754. doi: 10.1137/S1064827501397792.
[11]	A. Buades, B. Coll and J. M. Morel, A non-local algorithm for image denoising,, IEEE Computer Society, 2 (2005), 60. doi: 10.1109/CVPR.2005.38.
[12]	S. Kindermann, S. Osher and P. W. Jones, Deblurring and Denoising of Images by Nonlocal Functionals,, Multiscale Modelling and Simulation, 4 (2005), 1091. doi: 10.1137/050622249.
[13]	T. Brox and D. Cremers, Iterated nonlocal means for texture restoration,, Scale Space and Variational Methods in Computer Vision, (2008), 13. doi: 10.1007/978-3-540-72823-8_2.
[14]	C. Kervrann, J. Boulanger and P. Coupé, Bayesian non-local means filter, image redundancy and adaptive dictionaries for noise removal,, Scale Space and Variational Methods in Computer Vision, (2007), 520. doi: 10.1007/978-3-540-72823-8_45.
[15]	B. Goossens, Q. Luong, A. Pizurica and W. Philips, An improved non-local denoising algorithm,, in, (2008).
[16]	G. Gilboa and S. Osher, Nonlocal operators with applications to image processing,, Multiscale Modeling and Simulation, 7 (2008), 1005. doi: 10.1137/070698592.
[17]	C-A. Deledalle, L. Denis and F. Tupin, Iterative wieghted maximum likelihood denoising with probabilistic patch-based weights,, Transactions on Image Processing, 18 (2009), 2661. doi: 10.1109/TIP.2009.2029593.
[18]	D. Peter, V. Govindan and A. Mathew, Nonlocal-means image denoising techonology using robust M-estimator,, Journal of Computer Science and Technology, 25 (2010), 623.
[19]	N. Wiest-Daesslé, S. Prima, P. Coupé, S. P. Morrissey and C. Barillot, Rician noise removal by non-local means filtering for low signal-to-noise ratio MRI: Applications to DT-MRI,, in, (2008), 171. doi: 10.1007/978-3-540-85990-1_21.
[20]	P. Coupé, P. Yger, S. Prima, P. Hellier, C. Kervrann and C. Barillot, An optimized blockwise nonlocal means denoising filter for 3-D magnetic resonance images,, Medical Imaging, 27 (2008), 425. doi: 10.1109/TMI.2007.906087.
[21]	C-A. Deledalle, F. Tupin and L. Denis, Poisson NL means: Unsupervised non local means for Poisson noise,, in, (2010). doi: 10.1109/ICIP.2010.5653394.
[22]	S. Osher and J. A. Sethian, Fronts propagating with curvature dependent speed: Algorithms based on Hamilton-Jacobi formulations,, Journal of Computational Physics, 79 (1988), 12. doi: 10.1016/0021-9991(88)90002-2.
[23]	T. F. Chan and L. A. Vese, Active contours without edges,, Image Processing, 10 (2001), 266. doi: 10.1109/83.902291.
[24]	L. A. Vese and T. F. Chan, A multiphase level set framework for image segmentation using the mumford and shah model,, International Journal of Computer Vision, 50 (2002), 271.
[25]	K. Krishnamoorthy, "Handbook of Statistical Distributions with Applications,", Chapman and Hall/CRC Press, (2006). doi: 10.1201/9781420011371.
[26]	T. Gasser, L. Sroka and C. Jennen-Steinmetz, Residual variance and residual pattern in nonlinear regression,, Biometrika, 73 (1986), 625. doi: 10.1093/biomet/73.3.625.
[27]	M. N. Do and M. Vetterli, The contourlet transform: an efficient directional multiresolution image representation,, IEEE Transactions on Image Processing, 14 (2005), 2091. doi: 10.1109/TIP.2005.859376.
[28]	Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, Image quality assessment: From error visibility to structural similarity,, Image Processing, 13 (2004), 600. doi: 10.1109/TIP.2003.819861.
[29]	E. Candés and D. Donoho, "Curvelets: A Surprisingly Effective Nonadaptive Representation of Objects with Edges,", in, ().
[30]	K. Guo, G. Kutyniok and D. Labate, "Sparse Multidimensional Representations using Anisotropic Dilation and Shear Operators,", Wavelets and Splines (Athens, (2005).
[31]	E. A. Nadaraya, On estimating regression,, Theory Probab. Appl., 9 (1964), 141. doi: 10.1137/1109020.
[32]	F. J. Anscombe, The transformation of Poisson, binomial and negative-binomial data,, Biometrika, 35 (1948), 246.
[33]	M. D. DeVore, A. D. Lanterman and J. A. O'Sullivan, ATR performance of a rician model for SAR images,, in, 4050 (2000), 34. doi: 10.1117/12.395589.
[34]	J. Sijbers, A. J. Den Dekker, P. Scheunders and D. Van Dyck, Maximum-likelihood estimation of Rician distribution parameters,, Medical Imaging, 17 (1998), 357. doi: 10.1109/42.712125.
[35]	T. Loupas, W. N. McDicken and P. L. Allan, An adaptive weighted median filter for speckle suppression in medical ultrasonic images,, Circuits and Systems, 36 (1989), 129. doi: 10.1109/31.16577.
[36]	K. Krissian, Speckle-constrained anisotropic diffusion for ultrasound images,, in, (2005), 547.
[37]	K. Dabov, A. Foi, V. Katkovnik and K. Egiazarian, Image denoising with block-matching and 3D filtering,, in, 6064 (2006). doi: 10.1117/12.643267.
[38]	M. Elad and M. Aharon, Image denoising via sparse and redundant representations over learned dictionaries,, Image Processing, 15 (2006), 3736. doi: 10.1109/TIP.2006.881969.
[39]	P. Coupé, P. Hellier, C. Kervrann and C. Barillot, Bayesian non local means-based speckle filtering,, in, (2008), 1291. doi: 10.1109/ISBI.2008.4541240.

[1]	Baoli Shi, Zhi-Feng Pang, Jing Xu. Image segmentation based on the hybrid total variation model and the K-means clustering strategy. Inverse Problems & Imaging, 2016, 10 (3) : 807-828. doi: 10.3934/ipi.2016022
[2]	Sung Ha Kang, Berta Sandberg, Andy M. Yip. A regularized k-means and multiphase scale segmentation. Inverse Problems & Imaging, 2011, 5 (2) : 407-429. doi: 10.3934/ipi.2011.5.407
[3]	Dominique Zosso, Jing An, James Stevick, Nicholas Takaki, Morgan Weiss, Liane S. Slaughter, Huan H. Cao, Paul S. Weiss, Andrea L. Bertozzi. Image segmentation with dynamic artifacts detection and bias correction. Inverse Problems & Imaging, 2017, 11 (3) : 577-600. doi: 10.3934/ipi.2017027
[4]	Matthew S. Keegan, Berta Sandberg, Tony F. Chan. A multiphase logic framework for multichannel image segmentation. Inverse Problems & Imaging, 2012, 6 (1) : 95-110. doi: 10.3934/ipi.2012.6.95
[5]	Ye Yuan, Yan Ren, Xiaodong Liu, Jing Wang. Approach to image segmentation based on interval neutrosophic set. Numerical Algebra, Control & Optimization, 2019, 0 (0) : 0-0. doi: 10.3934/naco.2019028
[6]	Fangfang Dong, Yunmei Chen. A fractional-order derivative based variational framework for image denoising. Inverse Problems & Imaging, 2016, 10 (1) : 27-50. doi: 10.3934/ipi.2016.10.27
[7]	Wei Zhu, Xue-Cheng Tai, Tony Chan. Augmented Lagrangian method for a mean curvature based image denoising model. Inverse Problems & Imaging, 2013, 7 (4) : 1409-1432. doi: 10.3934/ipi.2013.7.1409
[8]	Qiang Liu, Zhichang Guo, Chunpeng Wang. Renormalized solutions to a reaction-diffusion system applied to image denoising. Discrete & Continuous Dynamical Systems - B, 2016, 21 (6) : 1839-1858. doi: 10.3934/dcdsb.2016025
[9]	Feishe Chen, Lixin Shen, Yuesheng Xu, Xueying Zeng. The Moreau envelope approach for the L1/TV image denoising model. Inverse Problems & Imaging, 2014, 8 (1) : 53-77. doi: 10.3934/ipi.2014.8.53
[10]	Jianping Zhang, Ke Chen, Bo Yu, Derek A. Gould. A local information based variational model for selective image segmentation. Inverse Problems & Imaging, 2014, 8 (1) : 293-320. doi: 10.3934/ipi.2014.8.293
[11]	Ruiliang Zhang, Xavier Bresson, Tony F. Chan, Xue-Cheng Tai. Four color theorem and convex relaxation for image segmentation with any number of regions. Inverse Problems & Imaging, 2013, 7 (3) : 1099-1113. doi: 10.3934/ipi.2013.7.1099
[12]	Jie Huang, Xiaoping Yang, Yunmei Chen. A fast algorithm for global minimization of maximum likelihood based on ultrasound image segmentation. Inverse Problems & Imaging, 2011, 5 (3) : 645-657. doi: 10.3934/ipi.2011.5.645
[13]	Shi Yan, Jun Liu, Haiyang Huang, Xue-Cheng Tai. A dual EM algorithm for TV regularized Gaussian mixture model in image segmentation. Inverse Problems & Imaging, 2019, 13 (3) : 653-677. doi: 10.3934/ipi.2019030
[14]	Macarena Boix, Begoña Cantó. Using wavelet denoising and mathematical morphology in the segmentation technique applied to blood cells images. Mathematical Biosciences & Engineering, 2013, 10 (2) : 279-294. doi: 10.3934/mbe.2013.10.279
[15]	Yan Jin, Jürgen Jost, Guofang Wang. A new nonlocal variational setting for image processing. Inverse Problems & Imaging, 2015, 9 (2) : 415-430. doi: 10.3934/ipi.2015.9.415
[16]	Juan Carlos De los Reyes, Carola-Bibiane Schönlieb. Image denoising: Learning the noise model via nonsmooth PDE-constrained optimization. Inverse Problems & Imaging, 2013, 7 (4) : 1183-1214. doi: 10.3934/ipi.2013.7.1183
[17]	Michael Hintermüller, Monserrat Rincon-Camacho. An adaptive finite element method in $L^2$-TV-based image denoising. Inverse Problems & Imaging, 2014, 8 (3) : 685-711. doi: 10.3934/ipi.2014.8.685
[18]	Yupeng Li, Wuchen Li, Guo Cao. Image segmentation via $ L_1 $ Monge-Kantorovich problem. Inverse Problems & Imaging, 2019, 13 (4) : 805-826. doi: 10.3934/ipi.2019037
[19]	Tim McGraw, Baba Vemuri, Evren Özarslan, Yunmei Chen, Thomas Mareci. Variational denoising of diffusion weighted MRI. Inverse Problems & Imaging, 2009, 3 (4) : 625-648. doi: 10.3934/ipi.2009.3.625
[20]	Micol Amar, Andrea Braides. A characterization of variational convergence for segmentation problems. Discrete & Continuous Dynamical Systems - A, 1995, 1 (3) : 347-369. doi: 10.3934/dcds.1995.1.347

2017 Impact Factor: 1.465

American Institute of Mathematical Sciences