# American Institute of Mathematical Sciences

February  2021, 15(1): 1-25. doi: 10.3934/ipi.2020048

## Reproducible kernel Hilbert space based global and local image segmentation

 1 Centre for Mathematical Imaging Techniques and Department of Mathematical Sciences, University of Liverpool, United Kingdom 2 Department of Mathematics, Applied Mathematics and Statistics, Case Western Reserve, University, Cleveland, OH 44106, USA 3 Liverpool Vascular & Endovascular Service, Royal Liverpool and Broadgreen University, Hospitals NHS Trust, Liverpool, L7 8XP, United Kingdom

Received  December 2019 Revised  May 2020 Published  February 2021 Early access  August 2020

Image segmentation is the task of partitioning an image into individual objects, and has many important applications in a wide range of fields. The majority of segmentation methods rely on image intensity gradient to define edges between objects. However, intensity gradient fails to identify edges when the contrast between two objects is low. In this paper we aim to introduce methods to make such weak edges more prominent in order to improve segmentation results of objects of low contrast. This is done for two kinds of segmentation models: global and local. We use a combination of a reproducing kernel Hilbert space and approximated Heaviside functions to decompose an image and then show how this decomposition can be applied to a segmentation model. We show some results and robustness to noise, as well as demonstrating that we can combine the reconstruction and segmentation model together, allowing us to obtain both the decomposition and segmentation simultaneously.

Citation: Liam Burrows, Weihong Guo, Ke Chen, Francesco Torella. Reproducible kernel Hilbert space based global and local image segmentation. Inverse Problems & Imaging, 2021, 15 (1) : 1-25. doi: 10.3934/ipi.2020048
##### References:

show all references

##### References:
Comparison of Geodesic and Euclidean distance constraints
Left panel: 3D surface images of $\psi$ of nine parameter pairs $(\theta, c)$; right panel: the corresponding 2D images. In each panel, from left to right and then from top to bottom: $( \frac{4 \pi}{5} , \frac{51}{1024} ), ( \frac{4\pi}{5} , \frac{25}{64} ), ( \frac{4\pi}{5} , \frac{175}{256} ), ( \frac{6\pi}{5}, \frac{135}{1024} ), ( \frac{6\pi}{5}, \frac{1}{2} ), ( \frac{6\pi}{5}, \frac{25}{32} ), ( \frac{8\pi}{5}, \frac{5}{64} )$, $( \frac{8\pi}{5}, \frac{75}{256} ), ( \frac{8\pi}{5}, \frac{75}{128} )$
The decomposition of the input image (top left), into the smooth parts (top middle) and edge parts (top right), obtained from RKHS model (8), and edge indicator function $g(\Psi \beta)$ (bottom left). In comparison, we display the gradient of the image, $|\nabla z|$ and the edge indicator function $g(|\nabla z|)$ in the bottom middle and bottom right respectively
]. Fourth column: Proposed two stage global model (8) and (25). Final column: The proposed combined global segmentation model (26)">Figure 4.  Segmentation of white matter from MRI brain image. We show both the contour overlaid on the original image, and the associated binary segmentation result for each example. First column: segmentation using edge weighted Chan-Vese using $|\nabla z|$ model (24). Second column: Edge weighted Chan-Vese model (24) using Canny ($g = g_{\mathcal{C}}$). Third column: Cai et al. [9]. Fourth column: Proposed two stage global model (8) and (25). Final column: The proposed combined global segmentation model (26)
Row 1: 3% noise, Row 2: 5% noise, Row 3: 7% noise, Row 4: 9% noise. We show both the contour overlaid on the original image, and the associated binary segmentation result for each example. First two columns: Using model (24). Final two columns: Combined model, algorithm (1)
Geodesic distances computed using gradient (middle) and $\Psi \beta$ (right)
Row one: Original clean image and the user input. Row two: Image and result with 20% noise. Row three: Image and result with 40% noise. Row four: Image and result with 60% noise
Segmentation of blood vessel
Segmentation of blood vessel
Result of the combined selective model
 [1] Fan Jia, Xue-Cheng Tai, Jun Liu. Nonlocal regularized CNN for image segmentation. Inverse Problems & Imaging, 2020, 14 (5) : 891-911. doi: 10.3934/ipi.2020041 [2] Ye Yuan, Yan Ren, Xiaodong Liu, Jing Wang. Approach to image segmentation based on interval neutrosophic set. Numerical Algebra, Control & Optimization, 2020, 10 (1) : 1-11. doi: 10.3934/naco.2019028 [3] Dominique Zosso, Jing An, James Stevick, Nicholas Takaki, Morgan Weiss, Liane S. Slaughter, Huan H. Cao, Paul S. Weiss, Andrea L. Bertozzi. Image segmentation with dynamic artifacts detection and bias correction. Inverse Problems & Imaging, 2017, 11 (3) : 577-600. doi: 10.3934/ipi.2017027 [4] Matthew S. Keegan, Berta Sandberg, Tony F. Chan. A multiphase logic framework for multichannel image segmentation. Inverse Problems & Imaging, 2012, 6 (1) : 95-110. doi: 10.3934/ipi.2012.6.95 [5] Shi Yan, Jun Liu, Haiyang Huang, Xue-Cheng Tai. A dual EM algorithm for TV regularized Gaussian mixture model in image segmentation. Inverse Problems & Imaging, 2019, 13 (3) : 653-677. doi: 10.3934/ipi.2019030 [6] Jianping Zhang, Ke Chen, Bo Yu, Derek A. Gould. A local information based variational model for selective image segmentation. Inverse Problems & Imaging, 2014, 8 (1) : 293-320. doi: 10.3934/ipi.2014.8.293 [7] Lu Tan, Ling Li, Senjian An, Zhenkuan Pan. Nonlinear diffusion based image segmentation using two fast algorithms. Mathematical Foundations of Computing, 2019, 2 (2) : 149-168. doi: 10.3934/mfc.2019011 [8] Ruiliang Zhang, Xavier Bresson, Tony F. Chan, Xue-Cheng Tai. Four color theorem and convex relaxation for image segmentation with any number of regions. Inverse Problems & Imaging, 2013, 7 (3) : 1099-1113. doi: 10.3934/ipi.2013.7.1099 [9] Balázs Kósa, Karol Mikula, Markjoe Olunna Uba, Antonia Weberling, Neophytos Christodoulou, Magdalena Zernicka-Goetz. 3D image segmentation supported by a point cloud. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 971-985. doi: 10.3934/dcdss.2020351 [10] Jie Huang, Xiaoping Yang, Yunmei Chen. A fast algorithm for global minimization of maximum likelihood based on ultrasound image segmentation. Inverse Problems & Imaging, 2011, 5 (3) : 645-657. doi: 10.3934/ipi.2011.5.645 [11] Maika Goto, Kazunori Kuwana, Yasuhide Uegata, Shigetoshi Yazaki. A method how to determine parameters arising in a smoldering evolution equation by image segmentation for experiment's movies. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 881-891. doi: 10.3934/dcdss.2020233 [12] Baoli Shi, Zhi-Feng Pang, Jing Xu. Image segmentation based on the hybrid total variation model and the K-means clustering strategy. Inverse Problems & Imaging, 2016, 10 (3) : 807-828. doi: 10.3934/ipi.2016022 [13] Yupeng Li, Wuchen Li, Guo Cao. Image segmentation via $L_1$ Monge-Kantorovich problem. Inverse Problems & Imaging, 2019, 13 (4) : 805-826. doi: 10.3934/ipi.2019037 [14] Kateřina Škardová, Tomáš Oberhuber, Jaroslav Tintěra, Radomír Chabiniok. Signed-distance function based non-rigid registration of image series with varying image intensity. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1145-1160. doi: 10.3934/dcdss.2020386 [15] Yuantian Xia, Juxiang Zhou, Tianwei Xu, Wei Gao. An improved deep convolutional neural network model with kernel loss function in image classification. Mathematical Foundations of Computing, 2020, 3 (1) : 51-64. doi: 10.3934/mfc.2020005 [16] Xiaoli Wang, Meihua Yang, Peter E. Kloeden. Sigmoidal approximations of a delay neural lattice model with Heaviside functions. Communications on Pure & Applied Analysis, 2020, 19 (4) : 2385-2402. doi: 10.3934/cpaa.2020104 [17] Jun Fan, Fusheng Lv, Lei Shi. An RKHS approach to estimate individualized treatment rules based on functional predictors. Mathematical Foundations of Computing, 2019, 2 (2) : 169-181. doi: 10.3934/mfc.2019012 [18] He Zhang, John Harlim, Xiantao Li. Estimating linear response statistics using orthogonal polynomials: An RKHS formulation. Foundations of Data Science, 2020, 2 (4) : 443-485. doi: 10.3934/fods.2020021 [19] Micol Amar, Andrea Braides. A characterization of variational convergence for segmentation problems. Discrete & Continuous Dynamical Systems, 1995, 1 (3) : 347-369. doi: 10.3934/dcds.1995.1.347 [20] Sung Ha Kang, Berta Sandberg, Andy M. Yip. A regularized k-means and multiphase scale segmentation. Inverse Problems & Imaging, 2011, 5 (2) : 407-429. doi: 10.3934/ipi.2011.5.407

2020 Impact Factor: 1.639