In this paper, we focus on learning optimal parameters for PDE-based image denoising and decomposition models. First, we learn the regularization parameter and the differential operator for gray-scale image denoising using the fractional Laplacian in combination with a bilevel optimization problem. In our setting the fractional Laplacian allows the use of Fourier transform, which enables the optimization of the denoising operator. We prove stable and explainable results as an advantage in comparison to machine learning approaches. The numerical experiments correlate with our theoretical model settings and show a reduction of computing time in contrast to the Rudin-Osher-Fatemi model. Second, we introduce a new regularized image decomposition model with the fractional Laplacian and the Riesz potential. We provide an explicit formula for the unique solution and the numerical experiments illustrate the efficiency.
Citation: |
Figure 8. With a higher resolution($ n = 1566 $) than in the sample images before ($ n = 512 $), the noise can be better suppressed optically. The denoised image is visually almost identical to the image in [1]. The small deviation of the optimal parameters is due to the influence of the function $ \varphi_1(s,\alpha) $
Figure 9. On the synthetic image we get a good denoising performance, which is reflected in the high SSIM value. The denoised image is visually almost identical to the image in [1]
Figure 19. The component $ u $ of (26) is obtained with optimal parameters $ \bar{s_1} = 0.351,\; \bar{\alpha} = 9999.4,\; \bar{s_2} = -0.918 $ and $ \bar{\beta} = 9997.2 $. The fractional image decomposition model achieves a significantly better result than the fractional image denoising model with an improvement of the SSIM value by 0.4. The result is less blurred and has a better contrast
[1] |
H. Antil and S. Bartels, Spectral approximation of fractional PDEs in image processing and phase field modeling, Comput. Methods Appl. Math., 17 (2017), 661-678.
doi: 10.1515/cmam-2017-0039.![]() ![]() ![]() |
[2] |
H. Antil, Z. W. Di and R. Khatri, Bilevel optimization, deep learning and fractional laplacian regularization with applications in tomography, Inverse Problems, 36 (2020), 064001.
doi: 10.1088/1361-6420/ab80d7.![]() ![]() ![]() |
[3] |
H. Antil, E. Otárola and A. J. Salgado, Optimization with respect to order in a fractional diffusion model: Analysis, approximation and algorithmic aspects, J. Sci. Comput., 77 (2018), 204-224.
doi: 10.1007/s10915-018-0703-0.![]() ![]() ![]() |
[4] |
H. Antil and C. N. Rautenberg, Sobolev spaces with non-Muckenhoupt weights, fractional elliptic operators, and applications, SIAM J. Math. Anal., 51 (2019), 2479-2503.
doi: 10.1137/18M1224970.![]() ![]() ![]() |
[5] |
J.-F. Aujol, G. Gilboa, T. Chan and S. Osher, Structure-texture image decomposition——modeling, algorithms, and parameter selection, International Journal of Computer Vision, 67 (2006), 111-136.
doi: 10.1007/s11263-006-4331-z.![]() ![]() |
[6] |
J. Batson and L. Royer, {N}oise2{S}elf: Blind denoising by self-supervision, in Proceedings of the 36th International Conference on Machine Learning (eds. K. Chaudhuri and R. Salakhutdinov), vol. 97 of Proceedings of Machine Learning Research, PMLR, (2019), 524–533.
![]() |
[7] |
S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, Cambridge, 2004.
doi: 10.1017/CBO9780511804441.![]() ![]() ![]() |
[8] |
F. Boyer and P. Fabrie, Mathematical Tools for the Study of the Incompressible Navier-Stokes Equations and Related Models, vol. 183 of Applied Mathematical Sciences, Springer, New York, 2013.
doi: 10.1007/978-1-4614-5975-0.![]() ![]() ![]() |
[9] |
A. Bueno-Orovio, D. Kay and K. Burrage, Fourier spectral methods for fractional-in-space reaction-diffusion equations, BIT, 54 (2014), 937-954.
doi: 10.1007/s10543-014-0484-2.![]() ![]() ![]() |
[10] |
Y. Gousseau and J.-M. Morel, Are natural images of bounded variation?, SIAM J. Math. Anal., 33 (2001), 634-648.
doi: 10.1137/S0036141000371150.![]() ![]() ![]() |
[11] |
K. Kunish and T. Pock, A bilevel optimization approach for parameter learning in variational models, SIAM Journal on Imaging Sciences, 6 (2013), 938-983.
doi: 10.1137/120882706.![]() ![]() ![]() |
[12] |
P. Liu and C.-B. Sch{ö}nlieb, Learning optimal orders of the underlying euclidean norm in total variation image denoising, arXiv preprint arXiv: 1903.11953.
![]() |
[13] |
Q. Liu, Z. Zhang and Z. Guo, On a fractional reaction-diffusion system applied to image decomposition and restoration, Comput. Math. Appl., 78 (2019), 1739-1751.
doi: 10.1016/j.camwa.2019.05.030.![]() ![]() ![]() |
[14] |
Y. Nesterov, Introductory Lectures on Convex Optimization, Springer US, 2004.
doi: 10.1007/978-1-4419-8853-9.![]() ![]() ![]() |
[15] |
S. Osher, A. Solé and L. Vese, Image decomposition and restoration using total variation minimization and the $H^{-1}$ norm, Multiscale Model. Simul., 1 (2003), 349-370.
doi: 10.1137/S1540345902416247.![]() ![]() ![]() |
[16] |
G. Peyré, The numerical tours of signal processing, Computing in Science & Engineering, 13 (2011), 94-97.
doi: 10.1109/MCSE.2011.71.![]() ![]() |
[17] |
L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D, 60 (1992), 259-268.
doi: 10.1016/0167-2789(92)90242-F.![]() ![]() ![]() |
[18] |
J. Saranen and G. Vainikko, Periodic Integral and Pseudodifferential Equations with Numerical Approximation, Springer Monographs in Mathematics, Springer-Verlag, Berlin, 2002.
doi: 10.1007/978-3-662-04796-5.![]() ![]() ![]() |
[19] |
J. Sprekels and E. Valdinoci, A new type of identification problems: Optimizing the fractional order in a nonlocal evolution equation, SIAM J. Control Optim., 55 (2017), 70-93.
doi: 10.1137/16M105575X.![]() ![]() ![]() |
[20] |
D. Ulyanov, A. Vedaldi and V. Lempitsky, Deep image prior, International Journal of Computer Vision volume, 128 (2020), 1867-1888.
doi: 10.1007/s11263-020-01303-4.![]() ![]() |
Decomposition of the original image (left) in structural component
Fractional Laplacian (1) of image
Riesz potential (2) of image
The denoising via solving (3) strongly depends on the choice of the parameters
Energy functional
Results for the image "boat". As clearly seen, the model eliminates the fog based on the normally distributed noise
In the image "peppers" there is a significant reduction of noise while maintaining the edges
With a higher resolution(
On the synthetic image we get a good denoising performance, which is reflected in the high SSIM value. The denoised image is visually almost identical to the image in [1]
We study the influence of the noise on the parameter
In the case of the parameter
In comparison to the fractional Laplacian model, the ROF model produces smoother edges. Moreover the ROF model has a better SSIM-value
Runtime comparison between the fractional Laplacian model and the ROF model. Both models show empirically a linear runtime, but the fractional Laplacian model has a reduced computing time by factors 16-22. We used MATLAB R2015a with CPU i3-3240 and 8 GB RAM
The PSNR(peak signal-to-noise ratio) of the ROF model outperforms the Laplacian model, but the discrepancy depends on the choice of the image. We observe a decreasing PSNR for a larger variance, implying a stronger noise. A higher PSNR value implies a better image quality
The SSIM(structural similarity index measure) of the ROF model outperforms the Laplacian model, again the performance gap highly depends on the image. We observe a decreasing SSIM for stronger noise. A higher SSIM value implies a better image quality
Detail of the image "Baboon". The results of the Fractional Laplacian and ROF model are similar.
Image components with fixed
Decomposition of the image "kentaur" with optimal parameters
The component
Detail of the image "pepper" (
Detail of the image "Baboon" (