Figure 1.
The voxel grid cell with a tetrahedral finite element
-
Previous Article
Computational optimization in solving the geodetic boundary value problems
- DCDS-S Home
- This Issue
-
Next Article
Two notes on the O'Hara energies
March
2021, 14(3): 971-985.
doi: 10.3934/dcdss.2020351
3D image segmentation supported by a point cloud
| 1. | Department of Mathematics and Descriptive Geometry, Faculty of Civil Engineering, Slovak University of Technology, Radlinského 11, 810 05 Bratislava, Slovakia |
| 2. | Department of Mathematics University of Nigeria 410001 Nsukka, Nigeria |
| 3. | Mammalian Embryo and Stem Cell Group, University of Cambridge, Department of Physiology, Development and Neuroscience, Downing Street, Cambridge CB2 3EG, UK |
| 4. | Department of Biological Sciences University of Cyprus University Avenue 1, Nicosia 2109, Cyprus |
Here, we report a novel method of 3D image segmentation, using surface reconstruction from 3D point cloud data and 3D digital image information. For this task, we apply a mathematical model and numerical method based on the level set algorithm. This method solves surface reconstruction by the application of advection equation with a curvature term, which gives the evolution of an initial condition to the final state. This is done by defining the advective velocity in the level set equation as the weighted sum of distance function and edge detector function gradients. The distance function to the shape, represented by the point cloud, is computed using the fast sweeping method. The edge detector function is applied to the presmoothed 3D image. A crucial point for efficiency is the construction of an initial condition by a simple tagging algorithm, which allows us also to highly speed up the numerical scheme when solving PDEs. For the numerical discretization, we use a semi-implicit co-volume scheme in the curvature part and implicit upwind scheme in the advective part. The method was tested on representative examples and applied to real data representing 3D biological microscopic images of developing mammalian embryo.
Mathematics Subject Classification:
Primary: 65M06, 65Y20, 53A05, 68U10; Secondary: 65D17.
Citation:
Balázs Kósa, Karol Mikula, Markjoe Olunna Uba, Antonia Weberling, Neophytos Christodoulou, Magdalena Zernicka-Goetz. 3D image segmentation supported by a point cloud. Discrete and Continuous Dynamical Systems - S,
2021, 14
(3)
: 971-985.
doi: 10.3934/dcdss.2020351
![]()
References:
| [1] |
N. Christodoulou, C. Kyprianou, A. Weberling, R. Wang and G. Cui,
Sequential formation and resolution of multiple rosettes drive embryo remodeling after implantation, Nature Cell Biology, 20 (2018), 1278-1289.
doi: 10.1038/s41556-018-0211-3. |
| [2] |
S. Corsaro, K. Mikula, A. Sarti and F. Sgallari,
Semi-implicit covolume method in 3D image segmentation, SIAM J. Sci. Comput., 28 (2006), 2248-2265.
doi: 10.1137/060651203. |
| [3] |
S. Dyballa, T. Savy, P. Germann, K. Mikula and M.Remešíková, et al., Distribution of neurosensory progenitor pools during inner ear morphogenesis unveiled by cell lineage reconstruction, 6 (2017).
doi: 10.7554/eLife.22268.001. |
| [4] |
L. C. Evans and J. Spruck,
Motion of level sets by mean curvature. Ⅰ, J. Differential Geom., 33 (1991), 635-681.
doi: 10.4310/jdg/1214446559. |
| [5] |
R. Eymard, A. Handlovičvá and K. Mikula,
Study of a finite volume scheme for the regularised mean curvature flow level set equation, IMA J. Numer. Anal., 31 (2011), 813-846.
doi: 10.1093/imanum/drq025. |
| [6] |
E. Faure, et al., A workflow to process 3D+time microscopy images of developing organisms and reconstruct their cell lineage, Nature Communications, 7 (2016).
doi: 10.1038/ncomms9674. |
| [7] |
B. Kósa, J. Haličková-Brehovská and K. Mikula, New efficient numerical method for 3D point cloud surface reconstruction by using level set methods, Proceedings of Equadiff 2017 Conference, 2017,387–396. |
| [8] |
K. Mikula, N. Peyriéras, M. Remešíková and A. Sarti, 3D embryogenesis image segmentation by the generalized subjective surface method using the finite volume technique, in Finite Volumes for Complex Applications V, ISTE, London, 2008,585-592. |
| [9] |
K. Mikula and M. Remešíková,
Finite volume schemes for the generalized subjective surface equation in image segmentation, Kybernetika, 45 (2009), 646-656.
|
| [10] |
K. Mikula and A. Sarti, Parallel co-volume subjective surface method for 3D medical image segmentation, in Deformable Models, Topics in Biomedical Engineering. International Book Series, Springer, NY, 2007,123–160.
doi: 10.1007/978-0-387-68343-0_5. |
| [11] |
S. Osher and R. Fedkiw, Level Set Methods and Dynamic Implicit Surfaces, Applied Mathematical Sciences, 153, Springer-Verlag, New York, 2003.
doi: 10.1007/b98879. |
| [12] |
P. Perona and J. Malik,
Scale-space and edge detection using anisotropic diffusion, IEEE Trans. Pattern Anal. Machine Intelligence, 12 (1990), 629-639.
doi: 10.1109/34.56205. |
| [13] |
A. Sarti, R. Malladi and J. A. Sethian,
Subjective surfaces: A method for completing missing boundaries, Proc. Natl. Acad. Sci. USA, 97 (2000), 6258-6263.
doi: 10.1073/pnas.110135797. |
| [14] |
J. A. Sethian, Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Material Science, Cambridge Monographs on Applied and Computational Mathematics, 3, Cambridge University Press, Cambridge, 1999.
|
| [15] |
M. N. Shahbazi, A. Scialdone, N. Skorupska, A. Weberling and G. Recher,
Pluripotent state transitions coordinate morphogenesis in mouse and human embryos, Nature, 552 (2017), 239-243.
doi: 10.1038/nature24675. |
| [16] |
M. N. Shahbazi and M. Zernicka-Goetz,
Deconstructing and reconstructing the mouse and human early embryo, Nature Cell Biology, 20 (2018), 878-887.
doi: 10.1038/s41556-018-0144-x. |
| [17] |
C. Zanella, M. Campana, B. Rizzi, C. Melani and G. Sanguinetti,
Cells segmentation from 3-D confocal images of early zebrafish embryogenesis, IEEE Trans. Image Process., 19 (2010), 770-781.
doi: 10.1109/TIP.2009.2033629. |
| [18] |
H. Zhao,
A fast sweeping method for Eikonal equations, Math. Comp., 74 (2005), 603-627.
doi: 10.1090/S0025-5718-04-01678-3. |
| [19] |
H. Zhao, S. Osher, B. Merriman and M. Kang,
Implicit and nonparametric shape reconstruction from unorganized data using a variational level set method, Comput. Vision Image Understanding, 80 (2000), 295-319.
doi: 10.1006/cviu.2000.0875. |
show all references
References:
| [1] |
N. Christodoulou, C. Kyprianou, A. Weberling, R. Wang and G. Cui,
Sequential formation and resolution of multiple rosettes drive embryo remodeling after implantation, Nature Cell Biology, 20 (2018), 1278-1289.
doi: 10.1038/s41556-018-0211-3. |
| [2] |
S. Corsaro, K. Mikula, A. Sarti and F. Sgallari,
Semi-implicit covolume method in 3D image segmentation, SIAM J. Sci. Comput., 28 (2006), 2248-2265.
doi: 10.1137/060651203. |
| [3] |
S. Dyballa, T. Savy, P. Germann, K. Mikula and M.Remešíková, et al., Distribution of neurosensory progenitor pools during inner ear morphogenesis unveiled by cell lineage reconstruction, 6 (2017).
doi: 10.7554/eLife.22268.001. |
| [4] |
L. C. Evans and J. Spruck,
Motion of level sets by mean curvature. Ⅰ, J. Differential Geom., 33 (1991), 635-681.
doi: 10.4310/jdg/1214446559. |
| [5] |
R. Eymard, A. Handlovičvá and K. Mikula,
Study of a finite volume scheme for the regularised mean curvature flow level set equation, IMA J. Numer. Anal., 31 (2011), 813-846.
doi: 10.1093/imanum/drq025. |
| [6] |
E. Faure, et al., A workflow to process 3D+time microscopy images of developing organisms and reconstruct their cell lineage, Nature Communications, 7 (2016).
doi: 10.1038/ncomms9674. |
| [7] |
B. Kósa, J. Haličková-Brehovská and K. Mikula, New efficient numerical method for 3D point cloud surface reconstruction by using level set methods, Proceedings of Equadiff 2017 Conference, 2017,387–396. |
| [8] |
K. Mikula, N. Peyriéras, M. Remešíková and A. Sarti, 3D embryogenesis image segmentation by the generalized subjective surface method using the finite volume technique, in Finite Volumes for Complex Applications V, ISTE, London, 2008,585-592. |
| [9] |
K. Mikula and M. Remešíková,
Finite volume schemes for the generalized subjective surface equation in image segmentation, Kybernetika, 45 (2009), 646-656.
|
| [10] |
K. Mikula and A. Sarti, Parallel co-volume subjective surface method for 3D medical image segmentation, in Deformable Models, Topics in Biomedical Engineering. International Book Series, Springer, NY, 2007,123–160.
doi: 10.1007/978-0-387-68343-0_5. |
| [11] |
S. Osher and R. Fedkiw, Level Set Methods and Dynamic Implicit Surfaces, Applied Mathematical Sciences, 153, Springer-Verlag, New York, 2003.
doi: 10.1007/b98879. |
| [12] |
P. Perona and J. Malik,
Scale-space and edge detection using anisotropic diffusion, IEEE Trans. Pattern Anal. Machine Intelligence, 12 (1990), 629-639.
doi: 10.1109/34.56205. |
| [13] |
A. Sarti, R. Malladi and J. A. Sethian,
Subjective surfaces: A method for completing missing boundaries, Proc. Natl. Acad. Sci. USA, 97 (2000), 6258-6263.
doi: 10.1073/pnas.110135797. |
| [14] |
J. A. Sethian, Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Material Science, Cambridge Monographs on Applied and Computational Mathematics, 3, Cambridge University Press, Cambridge, 1999.
|
| [15] |
M. N. Shahbazi, A. Scialdone, N. Skorupska, A. Weberling and G. Recher,
Pluripotent state transitions coordinate morphogenesis in mouse and human embryos, Nature, 552 (2017), 239-243.
doi: 10.1038/nature24675. |
| [16] |
M. N. Shahbazi and M. Zernicka-Goetz,
Deconstructing and reconstructing the mouse and human early embryo, Nature Cell Biology, 20 (2018), 878-887.
doi: 10.1038/s41556-018-0144-x. |
| [17] |
C. Zanella, M. Campana, B. Rizzi, C. Melani and G. Sanguinetti,
Cells segmentation from 3-D confocal images of early zebrafish embryogenesis, IEEE Trans. Image Process., 19 (2010), 770-781.
doi: 10.1109/TIP.2009.2033629. |
| [18] |
H. Zhao,
A fast sweeping method for Eikonal equations, Math. Comp., 74 (2005), 603-627.
doi: 10.1090/S0025-5718-04-01678-3. |
| [19] |
H. Zhao, S. Osher, B. Merriman and M. Kang,
Implicit and nonparametric shape reconstruction from unorganized data using a variational level set method, Comput. Vision Image Understanding, 80 (2000), 295-319.
doi: 10.1006/cviu.2000.0875. |
Figure 2.
Notation for the additional points of a grid cell used for calculation of $ Gu_{i,j,k}^{n,l},\;l = 1,...,24 $
Figure 3.
Tetrahedral finite element with marked edges for approximation of partial derivatives
Figure 4.
In the first column there are 3D images of a sphere with 6 symmetrically placed holes. The experiment was executed on spheres with holes of different shapes and sizes. The second column shows the result of the mathematical model (1) with $ \theta = 0 $ and $ \rho = 1 $ for the advective velocity (3). In the third column we show the result after we added points to the missing parts of the sphere and set $ \theta = 1 $ , $ \rho = 1 $ in (3)
Figure 5.
Sections of the embryo together with the marked points for visceral endoderm (VE)
Figure 6.
3D image of embryo structure, visualized with the reconstructed ExE part of the embryo in the upper picture and with VE part in the lower one
Figure 7.
Reconstructed surface of extraembryonic ectoderm (ExE) and visceral endoderm (VE), visualized with point cloud
| [1] |
Ye Yuan, Yan Ren, Xiaodong Liu, Jing Wang. Approach to image segmentation based on interval neutrosophic set. Numerical Algebra, Control and Optimization, 2020, 10 (1) : 1-11. doi: 10.3934/naco.2019028 |
| [2] |
Zhenlin Guo, Ping Lin, Guangrong Ji, Yangfan Wang. Retinal vessel segmentation using a finite element based binary level set method. Inverse Problems and Imaging, 2014, 8 (2) : 459-473. doi: 10.3934/ipi.2014.8.459 |
| [3] |
Esther Klann, Ronny Ramlau, Wolfgang Ring. A Mumford-Shah level-set approach for the inversion and segmentation of SPECT/CT data. Inverse Problems and Imaging, 2011, 5 (1) : 137-166. doi: 10.3934/ipi.2011.5.137 |
| [4] |
Fan Jia, Xue-Cheng Tai, Jun Liu. Nonlocal regularized CNN for image segmentation. Inverse Problems and Imaging, 2020, 14 (5) : 891-911. doi: 10.3934/ipi.2020041 |
| [5] |
Tetsuya Ishiwata, Takeshi Ohtsuka. Numerical analysis of an ODE and a level set methods for evolving spirals by crystalline eikonal-curvature flow. Discrete and Continuous Dynamical Systems - S, 2021, 14 (3) : 893-907. doi: 10.3934/dcdss.2020390 |
| [6] |
Wenbin Li, Jianliang Qian. Simultaneously recovering both domain and varying density in inverse gravimetry by efficient level-set methods. Inverse Problems and Imaging, 2021, 15 (3) : 387-413. doi: 10.3934/ipi.2020073 |
| [7] |
Maika Goto, Kazunori Kuwana, Yasuhide Uegata, Shigetoshi Yazaki. A method how to determine parameters arising in a smoldering evolution equation by image segmentation for experiment's movies. Discrete and Continuous Dynamical Systems - S, 2021, 14 (3) : 881-891. doi: 10.3934/dcdss.2020233 |
| [8] |
Dominique Zosso, Jing An, James Stevick, Nicholas Takaki, Morgan Weiss, Liane S. Slaughter, Huan H. Cao, Paul S. Weiss, Andrea L. Bertozzi. Image segmentation with dynamic artifacts detection and bias correction. Inverse Problems and Imaging, 2017, 11 (3) : 577-600. doi: 10.3934/ipi.2017027 |
| [9] |
Matthew S. Keegan, Berta Sandberg, Tony F. Chan. A multiphase logic framework for multichannel image segmentation. Inverse Problems and Imaging, 2012, 6 (1) : 95-110. doi: 10.3934/ipi.2012.6.95 |
| [10] |
Wolfgang Wagner. A random cloud model for the Wigner equation. Kinetic and Related Models, 2016, 9 (1) : 217-235. doi: 10.3934/krm.2016.9.217 |
| [11] |
Li Shen, Eric Todd Quinto, Shiqiang Wang, Ming Jiang. Simultaneous reconstruction and segmentation with the Mumford-Shah functional for electron tomography. Inverse Problems and Imaging, 2018, 12 (6) : 1343-1364. doi: 10.3934/ipi.2018056 |
| [12] |
Jianjun Zhang, Yunyi Hu, James G. Nagy. A scaled gradient method for digital tomographic image reconstruction. Inverse Problems and Imaging, 2018, 12 (1) : 239-259. doi: 10.3934/ipi.2018010 |
| [13] |
Wenxiang Cong, Ge Wang, Qingsong Yang, Jia Li, Jiang Hsieh, Rongjie Lai. CT image reconstruction on a low dimensional manifold. Inverse Problems and Imaging, 2019, 13 (3) : 449-460. doi: 10.3934/ipi.2019022 |
| [14] |
Lacramioara Grecu, Constantin Popa. Constrained SART algorithm for inverse problems in image reconstruction. Inverse Problems and Imaging, 2013, 7 (1) : 199-216. doi: 10.3934/ipi.2013.7.199 |
| [15] |
Assyr Abdulle. Multiscale methods for advection-diffusion problems. Conference Publications, 2005, 2005 (Special) : 11-21. doi: 10.3934/proc.2005.2005.11 |
| [16] |
Shi Yan, Jun Liu, Haiyang Huang, Xue-Cheng Tai. A dual EM algorithm for TV regularized Gaussian mixture model in image segmentation. Inverse Problems and Imaging, 2019, 13 (3) : 653-677. doi: 10.3934/ipi.2019030 |
| [17] |
Jianping Zhang, Ke Chen, Bo Yu, Derek A. Gould. A local information based variational model for selective image segmentation. Inverse Problems and Imaging, 2014, 8 (1) : 293-320. doi: 10.3934/ipi.2014.8.293 |
| [18] |
Lu Tan, Ling Li, Senjian An, Zhenkuan Pan. Nonlinear diffusion based image segmentation using two fast algorithms. Mathematical Foundations of Computing, 2019, 2 (2) : 149-168. doi: 10.3934/mfc.2019011 |
| [19] |
Ruiliang Zhang, Xavier Bresson, Tony F. Chan, Xue-Cheng Tai. Four color theorem and convex relaxation for image segmentation with any number of regions. Inverse Problems and Imaging, 2013, 7 (3) : 1099-1113. doi: 10.3934/ipi.2013.7.1099 |
| [20] |
Jie Huang, Xiaoping Yang, Yunmei Chen. A fast algorithm for global minimization of maximum likelihood based on ultrasound image segmentation. Inverse Problems and Imaging, 2011, 5 (3) : 645-657. doi: 10.3934/ipi.2011.5.645 |
2021 Impact Factor: 1.865
Tools
Metrics
Other articles
by authors
[Back to Top]