American Institute of Mathematical Sciences

Advanced
  • Previous Article
    Semi-automatic segmentation of NATURA 2000 habitats in Sentinel-2 satellite images by evolving open curves
  • DCDS-S Home
  • This Issue
  • Next Article
    Sharp consistency estimates for a pressure-Poisson problem with Stokes boundary value problems
March  2021, 14(3): 1017-1032. doi: 10.3934/dcdss.2020348

An automated segmentation of NATURA 2000 habitats from Sentinel-2 optical data

Karol Mikula 1,, , Jozef Urbán 1, , Michal Kollár 1, , Martin Ambroz 1, , Ivan Jarolímek 2, , Jozef Šibík 2, and  Mária Šibíková 2,

1. 

Department of Mathematics, Slovak University of Technology, Radlinského 11,810 05 Bratislava, Slovakia, Algoritmy:SK, s.r.o., Šulekova 6,811 06 Bratislava, Slovakia
2. 

Institute of Botany, Slovak Academy of Sciences, Dúbravská cesta 9,845 23 Bratislava, Slovakia

* Corresponding author

Received  December 2018 Revised  November 2019 Published  May 2020

Fund Project: This work was supported by projects APVV-16-0431, APVV-15-0522, VEGA 1/0608/15 and ESA Contract No. 4000122575/17/NL/SC

In this paper, we present a mathematical model and numerical method designed for the segmentation of satellite images, namely to obtain in an automated way borders of Natura 2000 habitats from Sentinel-2 optical data. The segmentation model is based on the evolving closed plane curve approach in the Lagrangian formulation including the efficient treatment of topological changes. The model contains the term expanding the curve in its outer normal direction up to the region of habitat boundary edges, the term attracting the curve accurately to the edges and the smoothing term given by the influence of local curvature. For the numerical solution, we use the flowing finite volume method discretizing the arising advection-diffusion intrinsic partial differential equation including the asymptotically uniform tangential redistribution of curve grid points. We present segmentation results for satellite data from a selected area of Western Slovakia (Záhorie) where the so-called riparian forests represent the important European Natura 2000 habitat. The automatic segmentation results are compared with the semi-automatic segmentation performed by the botany expert and with the GPS tracks obtained in the field. The comparisons show the ability of our numerical model to segment the habitat areas with the accuracy comparable to the pixel resolution of the Sentinel-2 optical data.

Keywords: Image segmentation, curve evolution, numerical method, Natura 2000, satellite images, Sentinel-2.
Mathematics Subject Classification: Primary: 35R01, 65M08; Secondary: 35R37, 92F05.
Citation: Karol Mikula, Jozef Urbán, Michal Kollár, Martin Ambroz, Ivan Jarolímek, Jozef Šibík, Mária Šibíková. An automated segmentation of NATURA 2000 habitats from Sentinel-2 optical data. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1017-1032. doi: 10.3934/dcdss.2020348
References:
[1]

M. Ambroz, M. Balažovjech, M. Medla and K. Mikula, Numerical modeling of wildland surface fire propagation by evolving surface curves, Adv. Comput. Math., 45 (2019), 1067-1103.  doi: 10.1007/s10444-018-9650-4.  Google Scholar

[2]

M. Balažovjech, K. Mikula, M. Petrášová and J. Urbán, Lagrangean method with topological changes for numerical modelling of forest fire propagation, 19th Conference on Scientific Computing, Slovakia, 2012. Google Scholar

[3]

V. Caselles, R. Kimmel and G. Sapiro, Geodesic active contours, Internat. J. Comput. Vision, 22 (1997), 61-79.  doi: 10.1109/ICCV.1995.466871.  Google Scholar

[4]

E. Faure et al., A workflow to process 3D+time microscopy images of developing organisms and reconstruct their cell lineage, Nat. Commun., 7 (2016). doi: 10.1038/ncomms9674.  Google Scholar

[5]

M.A. Finney, et al., FARSITE: Fire Area Simulator–model development and evaluation, U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station, Ogden, UT, 1998. doi: 10.2737/RMRS-RP-4.  Google Scholar

[6]

T.Y. Hou, J. Lowengrub and M. Shelley, Removing the stiffness from interfacial flows with surface tension, J. Comput. Phys., 114 (1994), 312-338.  doi: 10.1006/jcph.1994.1170.  Google Scholar

[7]

S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum and A. Yezzi, Conformal curvature flows: From phase transitions to active vision, Arch. Rational Mech. Anal., 134 (1996), 275-301.  doi: 10.1007/BF00379537.  Google Scholar

[8]

M. Kimura, Numerical analysis for moving boundary problems using the boundary tracking method, Japan J. Indust. Appl. Math., 14 (1997), 373-398.  doi: 10.1007/BF03167390.  Google Scholar

[9]

K. Mikula and M. Ohlberger, Inflow-implicit/outflow-explicit scheme for solving advection equations, in Finite Volumes for Complex Applications VI. Problems & Perspectives. Volume 1, 2, Springer Proc. Math., 4, Springer, Heidelberg, 2011,683–691. doi: 10.1007/978-3-642-20671-9_72.  Google Scholar

[10]

K. Mikula, M. Ohlberger and J. Urbán, Inflow-implicit/outflow-explicit finite volume methods for solving advection equations, Appl. Numer. Math., 85 (2014), 16-37.  doi: 10.1016/j.apnum.2014.06.002.  Google Scholar

[11]

K. Mikula and D. Ševčovič, Evolution of plane curves driven by a nonlinear function of curvature and anisotropy, SIAM J. Appl. Math., 61 (2001), 1473-1501.  doi: 10.1137/S0036139999359288.  Google Scholar

[12]

K. Mikula and D. Ševčovič, A direct method for solving an anisotropic mean curvature flow of plane curves with an external force, Math. Methods Appl. Sci., 27 (2004), 1545-1565.  doi: 10.1002/mma.514.  Google Scholar

[13]

K. Mikula, D. Ševčovič and M. Balažovjech, A simple, fast and stabilized flowing finite volume method for solving general curve evolution equations, Commun. Comput. Phys., 7 (2010), 195-211.  doi: 10.4208/cicp.2009.08.169.  Google Scholar

[14]

K. Mikula and J. Urbán, New fast and stable Lagrangean method for image segmentation, 5th International Congress on Image and Signal Processing, Chongqing, China, 2012. doi: 10.1109/CISP.2012.6469852.  Google Scholar

[15]

K. Mikula, et al., Report on semi-automatic segmentation methods and software tool for static data, ESA PECS project NaturaSat Deliverable 2.1, 2018. Google Scholar

[16]

G. Nakamura and R. Potthast, Inverse Modeling, IOP Expanding Physics, IOP Publishing, Bristol, 2015, 2053–2563. doi: 10.1088/978-0-7503-1218-9.  Google Scholar

[17]

P. Pauš, M. Beneš, Algorithm for topological changes of parametrically described curves, Proceedings of ALGORITMY, 2009,176–184. Google Scholar

[18]

A. Sarti, R. Malladi and J. A. Sethian:, Subjective surfaces: A method for completing missing boundaries, Proc. Natl. Acad. Sci. USA, 97 (2000), 6258-6263.  doi: 10.1073/pnas.110135797.  Google Scholar

show all references

References:
[1]

M. Ambroz, M. Balažovjech, M. Medla and K. Mikula, Numerical modeling of wildland surface fire propagation by evolving surface curves, Adv. Comput. Math., 45 (2019), 1067-1103.  doi: 10.1007/s10444-018-9650-4.  Google Scholar

[2]

M. Balažovjech, K. Mikula, M. Petrášová and J. Urbán, Lagrangean method with topological changes for numerical modelling of forest fire propagation, 19th Conference on Scientific Computing, Slovakia, 2012. Google Scholar

[3]

V. Caselles, R. Kimmel and G. Sapiro, Geodesic active contours, Internat. J. Comput. Vision, 22 (1997), 61-79.  doi: 10.1109/ICCV.1995.466871.  Google Scholar

[4]

E. Faure et al., A workflow to process 3D+time microscopy images of developing organisms and reconstruct their cell lineage, Nat. Commun., 7 (2016). doi: 10.1038/ncomms9674.  Google Scholar

[5]

M.A. Finney, et al., FARSITE: Fire Area Simulator–model development and evaluation, U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station, Ogden, UT, 1998. doi: 10.2737/RMRS-RP-4.  Google Scholar

[6]

T.Y. Hou, J. Lowengrub and M. Shelley, Removing the stiffness from interfacial flows with surface tension, J. Comput. Phys., 114 (1994), 312-338.  doi: 10.1006/jcph.1994.1170.  Google Scholar

[7]

S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum and A. Yezzi, Conformal curvature flows: From phase transitions to active vision, Arch. Rational Mech. Anal., 134 (1996), 275-301.  doi: 10.1007/BF00379537.  Google Scholar

[8]

M. Kimura, Numerical analysis for moving boundary problems using the boundary tracking method, Japan J. Indust. Appl. Math., 14 (1997), 373-398.  doi: 10.1007/BF03167390.  Google Scholar

[9]

K. Mikula and M. Ohlberger, Inflow-implicit/outflow-explicit scheme for solving advection equations, in Finite Volumes for Complex Applications VI. Problems & Perspectives. Volume 1, 2, Springer Proc. Math., 4, Springer, Heidelberg, 2011,683–691. doi: 10.1007/978-3-642-20671-9_72.  Google Scholar

[10]

K. Mikula, M. Ohlberger and J. Urbán, Inflow-implicit/outflow-explicit finite volume methods for solving advection equations, Appl. Numer. Math., 85 (2014), 16-37.  doi: 10.1016/j.apnum.2014.06.002.  Google Scholar

[11]

K. Mikula and D. Ševčovič, Evolution of plane curves driven by a nonlinear function of curvature and anisotropy, SIAM J. Appl. Math., 61 (2001), 1473-1501.  doi: 10.1137/S0036139999359288.  Google Scholar

[12]

K. Mikula and D. Ševčovič, A direct method for solving an anisotropic mean curvature flow of plane curves with an external force, Math. Methods Appl. Sci., 27 (2004), 1545-1565.  doi: 10.1002/mma.514.  Google Scholar

[13]

K. Mikula, D. Ševčovič and M. Balažovjech, A simple, fast and stabilized flowing finite volume method for solving general curve evolution equations, Commun. Comput. Phys., 7 (2010), 195-211.  doi: 10.4208/cicp.2009.08.169.  Google Scholar

[14]

K. Mikula and J. Urbán, New fast and stable Lagrangean method for image segmentation, 5th International Congress on Image and Signal Processing, Chongqing, China, 2012. doi: 10.1109/CISP.2012.6469852.  Google Scholar

[15]

K. Mikula, et al., Report on semi-automatic segmentation methods and software tool for static data, ESA PECS project NaturaSat Deliverable 2.1, 2018. Google Scholar

[16]

G. Nakamura and R. Potthast, Inverse Modeling, IOP Expanding Physics, IOP Publishing, Bristol, 2015, 2053–2563. doi: 10.1088/978-0-7503-1218-9.  Google Scholar

[17]

P. Pauš, M. Beneš, Algorithm for topological changes of parametrically described curves, Proceedings of ALGORITMY, 2009,176–184. Google Scholar

[18]

A. Sarti, R. Malladi and J. A. Sethian:, Subjective surfaces: A method for completing missing boundaries, Proc. Natl. Acad. Sci. USA, 97 (2000), 6258-6263.  doi: 10.1073/pnas.110135797.  Google Scholar

Figure 1.  First row: the original image $ I^0 $ and smoothed image $ I^{\sigma_0} $. Second row: the visualization of $ g(\mathbf{x}) $, smoothed edge detector $ g_1(\mathbf{x}) $ and a zoom of the vector field $ -\nabla g_1(\mathbf{x}) $ where we see arrows pointing towards the edges in $ I^0 $. Third row: the functions $ H(\mathbf{x}) $ using (5) and $ g_2(\mathbf{x} ) $ evaluated by using the initial circle plotted in the Fourth row, left. Fourth row: the initial segmentation curve placed in $ I^0 $ and its time evolution until the final segmentation state (bottom right). In the middle image we see that the evolving curve undergoes topological changes which are resolved efficiently
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  Closed planar curve discretization (left) corresponding to the uniform discretization of the unit circle (right)
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  Visualization of the curve discretization: curve grid points (red) and their midpoints. Finite volumes $ \mathbf{p}_{i-1}, \mathbf{p}_i, $ and $ \mathbf{p}_{i+1} $ are highlighted by green, brown and yellow color. Note that $ \mathbf{p}_i $ is not a straight line given by $ \mathbf{x}_{i-\frac{1}2} $ and $ \mathbf{x}_{i+\frac{1}2} $, but a broken line given by $ \mathbf{x}_{i-\frac{1}2} $, $ \mathbf{x}_{i} $ and $ \mathbf{x}_{i+\frac{1}2} $, see also [1]
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4.  First row: the original image $ I^0 $ and smoothed image $ I^{\sigma_0} $. Second row: the visualization of the function $ g(\mathbf{x}) $ and smoothed edge detector $ g_1(\mathbf{x}) $. Third row: the function $ H(\mathbf{x}) $ and $ g_2(\mathbf{x}) $ evaluated by using the initial circle plotted in the Fourth row, left. Fourth row: the initial segmentation curve placed in $ I^0 $ (bottom left) and its time evolution (bottom middle) until the final segmentation state (bottom right) is reached
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  First row: the original image $ I^0 $ and smoothed image $ I^{\sigma_0} $. Second row: the visualization of the function $ g(\mathbf{x}) $ and smoothed edge detector $ g_1(\mathbf{x}) $. Third row: the function $ H(\mathbf{x}) $ and $ g_2(\mathbf{x}) $ evaluated by using the initial circle plotted in the Fourth row, left. Fourth row: the initial segmentation curve placed in $ I^0 $ (bottom left) and its time evolution (bottom middle) until the final segmentation state (bottom right) is reached
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6.  Left: the evolution of the segmentation curve from the initial circle to the final state. Right: the final automatic segmentation (red) together with the result of the semi-automatic segmentation (yellow) and the GPS track (light-blue)
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 7.  Left: the evolution of the segmentation curve from the initial circle to the final state. Right: the final automatic segmentation (red) together with the result of the semi-automatic segmentation (yellow) and the GPS track (light-blue)
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 8.  Left: the evolution of the segmentation curve from the initial circle to the final state. Right: the final automatic segmentation (red) together with the result of the semi-automatic segmentation (yellow) and the GPS track (light-blue)
Figure Options

Download full-size image

Download as PowerPoint slide

[1]

Karol Mikula, Jozef Urbán, Michal Kollár, Martin Ambroz, Ivan Jarolímek, Jozef Šibík, Mária Šibíková. Semi-automatic segmentation of NATURA 2000 habitats in Sentinel-2 satellite images by evolving open curves. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1033-1046. doi: 10.3934/dcdss.2020231
[2]

Maika Goto, Kazunori Kuwana, Yasuhide Uegata, Shigetoshi Yazaki. A method how to determine parameters arising in a smoldering evolution equation by image segmentation for experiment's movies. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 881-891. doi: 10.3934/dcdss.2020233
[3]

Petr Pauš, Shigetoshi Yazaki. Segmentation of color images using mean curvature flow and parametric curves. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1123-1132. doi: 10.3934/dcdss.2020389
[4]

Mehdi Bastani, Davod Khojasteh Salkuyeh. On the GSOR iteration method for image restoration. Numerical Algebra, Control & Optimization, 2021, 11 (1) : 27-43. doi: 10.3934/naco.2020013
[5]

Liam Burrows, Weihong Guo, Ke Chen, Francesco Torella. Reproducible kernel Hilbert space based global and local image segmentation. Inverse Problems & Imaging, 2021, 15 (1) : 1-25. doi: 10.3934/ipi.2020048
[6]

Balázs Kósa, Karol Mikula, Markjoe Olunna Uba, Antonia Weberling, Neophytos Christodoulou, Magdalena Zernicka-Goetz. 3D image segmentation supported by a point cloud. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 971-985. doi: 10.3934/dcdss.2020351
[7]

Zexuan Liu, Zhiyuan Sun, Jerry Zhijian Yang. A numerical study of superconvergence of the discontinuous Galerkin method by patch reconstruction. Electronic Research Archive, 2020, 28 (4) : 1487-1501. doi: 10.3934/era.2020078
[8]

Leilei Wei, Yinnian He. A fully discrete local discontinuous Galerkin method with the generalized numerical flux to solve the tempered fractional reaction-diffusion equation. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020319
[9]

Marion Darbas, Jérémy Heleine, Stephanie Lohrengel. Numerical resolution by the quasi-reversibility method of a data completion problem for Maxwell's equations. Inverse Problems & Imaging, 2020, 14 (6) : 1107-1133. doi: 10.3934/ipi.2020056
[10]

Abdollah Borhanifar, Maria Alessandra Ragusa, Sohrab Valizadeh. High-order numerical method for two-dimensional Riesz space fractional advection-dispersion equation. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020355
[11]

Peter Frolkovič, Viera Kleinová. A new numerical method for level set motion in normal direction used in optical flow estimation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 851-863. doi: 10.3934/dcdss.2020347
[12]

Zuliang Lu, Fei Huang, Xiankui Wu, Lin Li, Shang Liu. Convergence and quasi-optimality of $ L^2- $norms based an adaptive finite element method for nonlinear optimal control problems. Electronic Research Archive, 2020, 28 (4) : 1459-1486. doi: 10.3934/era.2020077
[13]

Yuxi Zheng. Absorption of characteristics by sonic curve of the two-dimensional Euler equations. Discrete & Continuous Dynamical Systems - A, 2009, 23 (1&2) : 605-616. doi: 10.3934/dcds.2009.23.605
[14]

Takiko Sasaki. Convergence of a blow-up curve for a semilinear wave equation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1133-1143. doi: 10.3934/dcdss.2020388
[15]

Riccarda Rossi, Ulisse Stefanelli, Marita Thomas. Rate-independent evolution of sets. Discrete & Continuous Dynamical Systems - S, 2021, 14 (1) : 89-119. doi: 10.3934/dcdss.2020304
[16]

Manxue You, Shengjie Li. Perturbation of Image and conjugate duality for vector optimization. Journal of Industrial & Management Optimization, 2020  doi: 10.3934/jimo.2020176
[17]

George W. Patrick. The geometry of convergence in numerical analysis. Journal of Computational Dynamics, 2021, 8 (1) : 33-58. doi: 10.3934/jcd.2021003
[18]

Kateřina Škardová, Tomáš Oberhuber, Jaroslav Tintěra, Radomír Chabiniok. Signed-distance function based non-rigid registration of image series with varying image intensity. Discrete & Continuous Dynamical Systems - S, 2021, 14 (3) : 1145-1160. doi: 10.3934/dcdss.2020386
[19]

Huanhuan Tian, Maoan Han. Limit cycle bifurcations of piecewise smooth near-Hamiltonian systems with a switching curve. Discrete & Continuous Dynamical Systems - B, 2020  doi: 10.3934/dcdsb.2020368
[20]

Nguyen Thi Kim Son, Nguyen Phuong Dong, Le Hoang Son, Alireza Khastan, Hoang Viet Long. Complete controllability for a class of fractional evolution equations with uncertainty. Evolution Equations & Control Theory, 2020  doi: 10.3934/eect.2020104

2019 Impact Factor: 1.233

Tools

Metrics

  • PDF downloads (58)
  • HTML views (293)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2021 American Institute of Mathematical Sciences