Figure 1.
An example of artificial greyscale 2D image (left) and smoothed image (right)
-
Previous Article
Fast reaction limit of reaction-diffusion systems
- DCDS-S Home
- This Issue
-
Next Article
An automated segmentation of NATURA 2000 habitats from Sentinel-2 optical data
March
2021, 14(3): 1033-1046.
doi: 10.3934/dcdss.2020231
Semi-automatic segmentation of NATURA 2000 habitats in Sentinel-2 satellite images by evolving open curves
| 1. | Department of Mathematics, Slovak University of Technology, Radlinského 11,810 05 Bratislava, Slovakia |
| 2. | Algoritmy:SK, s.r.o., Šulekova 6,811 06 Bratislava, Slovakia |
| 3. | Institute of Botany, Slovak Academy of Sciences, Dúbravská cesta 9,845 23 Bratislava, Slovakia |
In this paper we introduce mathematical model and real-time numerical method for segmentation of Natura 2000 habitats in satellite images by evolving open planar curves. These curves in the Lagrangian formulation are driven by a suitable velocity vector field, projected to the curve normal. Besides the vector field, the evolving curve is influenced also by the local curvature representing a smoothing term. The model is numerically solved using the flowing finite volume method discretizing the arising intrinsic partial differential equation with Dirichlet boundary conditions. The time discretization is chosen as an explicit due to the ability of real-time edge tracking. We present the results of semi-automatic segmentation of various areas across Slovakia, from the riparian forests to mountainous areas with scrub pine. The numerical results were compared to habitat boundaries tracked by GPS device in the field by using the mean and maximal Hausdorff distances as criterion.
Keywords:
Image segmentation,
curve evolution,
numerical method,
Natura 2000,
satellite images,
Sentinel-2.
Mathematics Subject Classification:
Primary: 35R01, 65M08; Secondary: 35R37, 92F05.
Citation:
Karol Mikula, Jozef Urbán, Michal Kollár, Martin Ambroz, Ivan Jarolímek, Jozef Šibík, Mária Šibíková. Semi-automatic segmentation of NATURA 2000 habitats in Sentinel-2 satellite images by evolving open curves. Discrete & Continuous Dynamical Systems - S,
2021, 14
(3)
: 1033-1046.
doi: 10.3934/dcdss.2020231
![]()
References:
| [1] |
M. Ambroz, M. Balažovjech, M. Medla and K. Mikula,
Numerical modeling of wildland surface fire propagation by evolving surface curves, Advances in Computational Mathematics, 45 (2019), 1067-1103.
doi: 10.1007/s10444-018-9650-4. |
| [2] |
M. Balažovjech, K. Mikula, M. Petrášová and J. Urbán, Lagrangean method with topological changes for numerical modelling of forest fire propagation, Proceedings of ALGORITMY, (2012), 42-52. Google Scholar |
| [3] |
V. Caselles, R. Kimmel and G. Sapiro,
Geodesic active contours, International Journal of Computer Vision, 22 (1997), 61-79.
doi: 10.1109/ICCV.1995.466871. |
| [4] |
S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum, A. Yezzi, Jr. and ,
Conformal curvature flows: From phase transitions to active vision, Arch. Rational Mech. Anal., 134 (1996), 275-301.
doi: 10.1007/BF00379537. |
| [5] |
M. Kolář, M. Beneš and D. Ševčovič,
Computational analysis of the conserved curvature driven flow for open curves in the plane, Mathematics and Computers in Simulation, 126 (2016), 1-13.
doi: 10.1016/j.matcom.2016.02.004. |
| [6] |
Z. Krivá, K. Mikula, M. Peyriéras, B. Rizzi, A. Sarti and O. Stašová, 3D early embryogenesis image filtering by nonlinear partial differential equations, Medical Image Analysis, 14 (2010), 510-526. Google Scholar |
| [7] |
K. Mikula and D. Ševčovič,
Computational and qualitative aspects of evolution of curves driven by curvature and external force, Computing and Visualization in Science, 6 (2004), 211-225.
doi: 10.1007/s00791-004-0131-6. |
| [8] |
K. Mikula and D. Ševčovič,
Evolution of curves on a surface driven by the geodesic curvature and external force, Applicable Analysis, 85 (2006), 345-362.
doi: 10.1080/00036810500333604. |
| [9] |
K. Mikula, D. Ševčovič and M. Balažovjech,
A simple, fast and stabilized flowing finite volume method for solving general curve evolution equations, Communications in Computational Physics, 7 (2010), 195-211.
doi: 10.4208/cicp.2009.08.169. |
| [10] |
P. Pauš, M. Beneš, M. Kolář and J. Kratochvíl, Dynamics of dislocations described as evolving curves interacting with obstacles, Modelling and Simulation in Materials Science and Engineering, 24 (2016), 34 pp. Google Scholar |
| [11] |
P. Perona and J. Malik,
Scale space and edge detection using anisotropic diffusion, Proceedings of the IEEE Society Workshop on Computer Vision, 12 (1987), 629-639.
doi: 10.1109/34.56205. |
| [12] |
Hausdorff distance, 20 12 2018, https://en.wikipedia.org/wiki/Hausdorff_distance. Google Scholar |
show all references
References:
| [1] |
M. Ambroz, M. Balažovjech, M. Medla and K. Mikula,
Numerical modeling of wildland surface fire propagation by evolving surface curves, Advances in Computational Mathematics, 45 (2019), 1067-1103.
doi: 10.1007/s10444-018-9650-4. |
| [2] |
M. Balažovjech, K. Mikula, M. Petrášová and J. Urbán, Lagrangean method with topological changes for numerical modelling of forest fire propagation, Proceedings of ALGORITMY, (2012), 42-52. Google Scholar |
| [3] |
V. Caselles, R. Kimmel and G. Sapiro,
Geodesic active contours, International Journal of Computer Vision, 22 (1997), 61-79.
doi: 10.1109/ICCV.1995.466871. |
| [4] |
S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum, A. Yezzi, Jr. and ,
Conformal curvature flows: From phase transitions to active vision, Arch. Rational Mech. Anal., 134 (1996), 275-301.
doi: 10.1007/BF00379537. |
| [5] |
M. Kolář, M. Beneš and D. Ševčovič,
Computational analysis of the conserved curvature driven flow for open curves in the plane, Mathematics and Computers in Simulation, 126 (2016), 1-13.
doi: 10.1016/j.matcom.2016.02.004. |
| [6] |
Z. Krivá, K. Mikula, M. Peyriéras, B. Rizzi, A. Sarti and O. Stašová, 3D early embryogenesis image filtering by nonlinear partial differential equations, Medical Image Analysis, 14 (2010), 510-526. Google Scholar |
| [7] |
K. Mikula and D. Ševčovič,
Computational and qualitative aspects of evolution of curves driven by curvature and external force, Computing and Visualization in Science, 6 (2004), 211-225.
doi: 10.1007/s00791-004-0131-6. |
| [8] |
K. Mikula and D. Ševčovič,
Evolution of curves on a surface driven by the geodesic curvature and external force, Applicable Analysis, 85 (2006), 345-362.
doi: 10.1080/00036810500333604. |
| [9] |
K. Mikula, D. Ševčovič and M. Balažovjech,
A simple, fast and stabilized flowing finite volume method for solving general curve evolution equations, Communications in Computational Physics, 7 (2010), 195-211.
doi: 10.4208/cicp.2009.08.169. |
| [10] |
P. Pauš, M. Beneš, M. Kolář and J. Kratochvíl, Dynamics of dislocations described as evolving curves interacting with obstacles, Modelling and Simulation in Materials Science and Engineering, 24 (2016), 34 pp. Google Scholar |
| [11] |
P. Perona and J. Malik,
Scale space and edge detection using anisotropic diffusion, Proceedings of the IEEE Society Workshop on Computer Vision, 12 (1987), 629-639.
doi: 10.1109/34.56205. |
| [12] |
Hausdorff distance, 20 12 2018, https://en.wikipedia.org/wiki/Hausdorff_distance. Google Scholar |
Figure 11.
A discrete segmentation curve evolving to habitat boundary in a real 3-band Sentinel-2 optical image. The green color shows trajectories of moving discrete curve points and blue points represents the result of segmentation of this particular section of the habitat border
Figure 5.
An open curve discretization (left) corresponding to the uniform discretization of parameter $ u\in \left[0,1\right] $ (right)
Figure 6.
Trajectories of points of a discrete segmentation curve (red) evolved in the vector field $ \mathbf{v} $ driven to the image edge. The final state of discrete segmentation curve is given by green points localized on the image edge
Figure 7.
Trajectories of points of a discrete segmentation curve (red) evolved in the vector field $ \mathbf{v} $ and their final position (green) visualized over the original image. One can see a problem of non-uniform distribution of points on evolving discrete segmentation curve due to non-controlled tangential velocities in the vector field $ \mathbf{v} $
Figure 8.
Trajectories of points of a discrete segmentation curve (red) evolved in the vector field $ \mathbf{v} $ and their final position (green) visualized over the original image. An improved distribution of the curve grid points after removing the tangential component of the velocity vector field $ \mathbf{v} $ is obvious
Figure 9.
Trajectories of points of a discrete segmentation curve (red) evolved in the vector field $ \mathbf{v} $ and their final position (green) visualized over the original image. Top: the curve evolution by (5) in a less smoothed image when problem of crossing, accumulating and not moving points may arise; bottom: such undesired behaviour is removed by employing the local curvature influence into the model (7)
Figure 10.
Visualization of the curve discretization [1] curve grid points (red), discrete curve segments (different colors) and the midpoints (black). Finite volumes $ \mathbf{p}_{i-1},\mathbf{p}_i, $ and $ \mathbf{p}_{i+1} $ are highlighted by green, brown and yellow color. Note that $ \mathbf{p}_i $ is not a straight line given by $ \mathbf{x}_{i-\frac{1}2} $ and $ \mathbf{x}_{i+\frac{1}2} $ , but a broken line given by $ \mathbf{x}_{i-\frac{1}2} $ , $ \mathbf{x}_{i} $ and $ \mathbf{x}_{i+\frac{1}2} $
Figure 12.
An example of the semi-automatic segmentation showing consecutive building of the segmentation curve (yellow), the final result is on the bottom right
Figure 13.
Semi-automatic segmentation (yellow) and GPS track (light-blue) with almost exact overlap. The maximal Haussdorff distance is 62.1m and the mean Hausdorff distance is 14.0m in this case, which means that we obtained almost the pixel resolution (10m) accuracy
Figure 14.
An example of a complicated border of the riparian forest. We compare the semi-automatic segmentation (yellow) and GPS track (light-blue). The mean Haussdorff distance is 12.0m and the maximal Haussdorff distance, in this case, is 62.1m, indicating correctly discrepancy in habitat area estimate in the field and by employing the Sentinel-2 optical data
Figure 15.
The locality with the highest, 413.3m, maximal Hausdorff distance between semi-automatically segmented and GPS tracked curves among bushes with Pinus mugo tested areas, here also the mean Hausdorff distance was the highest, 44.8m. On the North-West habitat border, we can see the "ecotone zone" that was included during field tracking (light-blue) and excluded by using the semi-automatic segmentation (yellow)
Figure 16.
The locality dominated by Pinus mugo with the "ecotone zone" that was included during the field tracking (light-blue) and excluded by using the semi-automatic segmentation (yellow). The mean Hausdorff distance is 19.1m and the maximal Hausdorff distance is 171.0m
| [1] |
Karol Mikula, Jozef Urbán, Michal Kollár, Martin Ambroz, Ivan Jarolímek, Jozef Šibík, Mária Šibíková. An automated segmentation of NATURA 2000 habitats from Sentinel-2 optical data. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1017-1032. doi: 10.3934/dcdss.2020348 |
| [2] |
Maika Goto, Kazunori Kuwana, Yasuhide Uegata, Shigetoshi Yazaki. A method how to determine parameters arising in a smoldering evolution equation by image segmentation for experiment's movies. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 881-891. doi: 10.3934/dcdss.2020233 |
| [3] |
Petr Pauš, Shigetoshi Yazaki. Segmentation of color images using mean curvature flow and parametric curves. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1123-1132. doi: 10.3934/dcdss.2020389 |
| [4] |
Mehdi Bastani, Davod Khojasteh Salkuyeh. On the GSOR iteration method for image restoration. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 27-43. doi: 10.3934/naco.2020013 |
| [5] |
Liam Burrows, Weihong Guo, Ke Chen, Francesco Torella. Reproducible kernel Hilbert space based global and local image segmentation. Inverse Problems & Imaging, 2021, 15 (1) : 1-25. doi: 10.3934/ipi.2020048 |
| [6] |
Balázs Kósa, Karol Mikula, Markjoe Olunna Uba, Antonia Weberling, Neophytos Christodoulou, Magdalena Zernicka-Goetz. 3D image segmentation supported by a point cloud. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 971-985. doi: 10.3934/dcdss.2020351 |
| [7] |
Zexuan Liu, Zhiyuan Sun, Jerry Zhijian Yang. A numerical study of superconvergence of the discontinuous Galerkin method by patch reconstruction. Electronic Research Archive, 2020, 28 (4) : 1487-1501. doi: 10.3934/era.2020078 |
| [8] |
Leilei Wei, Yinnian He. A fully discrete local discontinuous Galerkin method with the generalized numerical flux to solve the tempered fractional reaction-diffusion equation. Discrete & Continuous Dynamical Systems - B, 2020 doi: 10.3934/dcdsb.2020319 |
| [9] |
Marion Darbas, Jérémy Heleine, Stephanie Lohrengel. Numerical resolution by the quasi-reversibility method of a data completion problem for Maxwell's equations. Inverse Problems & Imaging, 2020, 14 (6) : 1107-1133. doi: 10.3934/ipi.2020056 |
| [10] |
Abdollah Borhanifar, Maria Alessandra Ragusa, Sohrab Valizadeh. High-order numerical method for two-dimensional Riesz space fractional advection-dispersion equation. Discrete & Continuous Dynamical Systems - B, 2020 doi: 10.3934/dcdsb.2020355 |
| [11] |
Peter Frolkovič, Viera Kleinová. A new numerical method for level set motion in normal direction used in optical flow estimation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 851-863. doi: 10.3934/dcdss.2020347 |
| [12] |
Zuliang Lu, Fei Huang, Xiankui Wu, Lin Li, Shang Liu. Convergence and quasi-optimality of $ L^2- $norms based an adaptive finite element method for nonlinear optimal control problems. Electronic Research Archive, 2020, 28 (4) : 1459-1486. doi: 10.3934/era.2020077 |
| [13] |
Yuxi Zheng. Absorption of characteristics by sonic curve of the two-dimensional Euler equations. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 605-616. doi: 10.3934/dcds.2009.23.605 |
| [14] |
Takiko Sasaki. Convergence of a blow-up curve for a semilinear wave equation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1133-1143. doi: 10.3934/dcdss.2020388 |
| [15] |
Riccarda Rossi, Ulisse Stefanelli, Marita Thomas. Rate-independent evolution of sets. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 89-119. doi: 10.3934/dcdss.2020304 |
| [16] |
Manxue You, Shengjie Li. Perturbation of Image and conjugate duality for vector optimization. Journal of Industrial & Management Optimization, 2020 doi: 10.3934/jimo.2020176 |
| [17] |
George W. Patrick. The geometry of convergence in numerical analysis. Journal of Computational Dynamics, 2021, 8 (1) : 33-58. doi: 10.3934/jcd.2021003 |
| [18] |
Huanhuan Tian, Maoan Han. Limit cycle bifurcations of piecewise smooth near-Hamiltonian systems with a switching curve. Discrete & Continuous Dynamical Systems - B, 2020 doi: 10.3934/dcdsb.2020368 |
| [19] |
Kateřina Škardová, Tomáš Oberhuber, Jaroslav Tintěra, Radomír Chabiniok. Signed-distance function based non-rigid registration of image series with varying image intensity. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1145-1160. doi: 10.3934/dcdss.2020386 |
| [20] |
Nguyen Thi Kim Son, Nguyen Phuong Dong, Le Hoang Son, Alireza Khastan, Hoang Viet Long. Complete controllability for a class of fractional evolution equations with uncertainty. Evolution Equations & Control Theory, 2020 doi: 10.3934/eect.2020104 |
2019 Impact Factor: 1.233
Tools
Article outline
Figures and Tables
[Back to Top]