February  2011, 5(1): 263-284. doi: 10.3934/ipi.2011.5.263

An inviscid model for nonrigid image registration

1. 

Department of Computer Science, University of California, Los Angeles, CA 90095, United States

2. 

David R. Cheriton School of Computer Science, University of Waterloo, Waterloo, ON N2L 6N3, Canada

Received  January 2010 Revised  May 2010 Published  February 2011

We propose an inviscid model for nonrigid image registration in a particle framework, and derive the corresponding nonlinear partial differential equations for computing the spatial transformation. Our idea is to simulate the template image as a set of free particles moving toward the target positions under applied forces. Our model can accommodate both small and large deformations, with sharper edges and clear texture achieved at less computational cost. We demonstrate the performance of our model on a variety of images including 2D and 3D, mono-modal and multi-modal images.
Citation: Zhao Yi, Justin W. L. Wan. An inviscid model for nonrigid image registration. Inverse Problems & Imaging, 2011, 5 (1) : 263-284. doi: 10.3934/ipi.2011.5.263
References:
[1]

Y. Amit, A nonlinear variational problem for image matching,, SIAM Scientific Computing, 15 (1994), 207. doi: 10.1137/0915014.

[2]

R. Bajcsy and S. Kovacic, Multiresolution elastic matching,, Computer Vision, 46 (1989), 1. doi: 10.1016/S0734-189X(89)80014-3.

[3]

F. L. Bookstein and W. D. K. Green, Edge information at landmarks in medical images,, in, (1992), 242.

[4]

M. Bro-Nielsen and C. Gramkow, Fast fluid registration of medical images,, in, (1996), 267.

[5]

C. Broit, "Optimal Registration of Deformed Images,", Ph.D. thesis, (1981).

[6]

T. F. Chan and L. A. Vese, Active contours without edges,, IEEE Transactions on Image Processing, 10 (2001), 266. doi: 10.1109/83.902291.

[7]

G. E. Christensen, S. C. Joshi and M. I. Miller, Volumetric transformation of brain anatomy,, IEEE Transactions on Medical Imaging, 16 (1997), 864. doi: 10.1109/42.650882.

[8]

G. E. Christensen, R. D. Rabbitt and M. I. Miller, A deformable neuroanatomy textbook based on viscous fluid mechanics,, in, (1993), 211.

[9]

G. E. Christensen, R. D. Rabbitt and M. I. Miller, 3D brain mapping using a deformable neuroanatomy,, Physics in Medicine and Biology, 39 (1994), 609. doi: 10.1088/0031-9155/39/3/022.

[10]

G. E. Christensen, R. D. Rabbitt and M. I. Miller, Deformable templates using large deformation kinematics,, IEEE Transactions on Image Processing, 5 (1996), 1435. doi: 10.1109/83.536892.

[11]

E. D'Agostino, F. Maes, D. Vandermeulen and P. Suetens, A viscous fluid model for multimodal non-rigid image registration using mutual information,, Medical Image Analysis, 7 (2003), 565. doi: 10.1016/S1361-8415(03)00039-2.

[12]

C. Davatzikos, Spatial transformation and registration of brain images using elastically deformable models,, Computer Vision and Image Understanding, 66 (1997), 207. doi: 10.1006/cviu.1997.0605.

[13]

J. C. Gee, D. R. Haynor, M. Reivich and R. Bajcsy, Finite element approach to warping of brain images,, in, (1994), 327.

[14]

R. Gonzalez and R. Woods, "Digital Image Processing,", Addison-Wesley, (1992).

[15]

E. Haber and J. Modersitzki, A multilevel method for image registration,, SIAM J. Sci. Comput., 27 (2006), 1594. doi: 10.1137/040608106.

[16]

S. Haker, L. Zhu, A. Tannenbaum and S. Angenent, Optimal mass transport for registration and warping,, International Journal of Computer Vision, 60 (2004), 225. doi: 10.1023/B:VISI.0000036836.66311.97.

[17]

D. D. Holm, J. T. Ratnanather, A. Trouve and L. Younes, Soliton dynamics in computational anatomy,, NeuroImage, 23 (2004), 170. doi: 10.1016/j.neuroimage.2004.07.017.

[18]

S. Kabus, A. Franz and B. Fischer, Variational image registration allowing for discontinuities in the displacement field,, in, (2007). doi: 10.1007/978-3-540-33267-1_20.

[19]

L. D. Landau and E. M. Lifshitz, "Fluid Mechanics,", Pergamon, (1987).

[20]

R. J. LeVeque, "Finite Volume Methods for Hyperbolic Problems,", Cambridge University Press, (2002). doi: 10.1017/CBO9780511791253.

[21]

A. Madabhushi and J. K. Udupa, Interplay between intensity standardization and inhomogeneity correction in MR image processing,, IEEE Transactions on Medical Imaging, 24 (2005), 561. doi: 10.1109/TMI.2004.843256.

[22]

F. Maes, A. Collington, D. Vandermeulen, G. Marchal and P. Suetens, Multimodality image registration by maximization of mutual information,, IEEE Transactions on Medical Imaging, 16 (1997), 187. doi: 10.1109/42.563664.

[23]

S. Marsland and C. J. Twining, Constructing diffeomorphic representations for the groupwise analysis of nonrigid registrations of medical images,, IEEE Transactions on Medical Imaging, 23 (2004), 1006.

[24]

A. Mills, S. Marsland and T. Shardlow, Computing the geodesic interpolating spline,, in, (2006), 169.

[25]

J. Modersitzki, "Numerical Methods for Image Registration,", Oxford University Press, (2004).

[26]

C. A. Pelizzari, G. T. Y. Chen, D. R. Spelbring, R. R. Weichselbaum and C. T. Chen, Accurate three-dimensional registration of CT, PET, and/or MR images of the brain,, Computer Assisted Tomography, 13 (1989), 20. doi: 10.1097/00004728-198901000-00004.

[27]

S. Periaswamy and H. Farid, Elastic registration in the presence of intensity variations,, IEEE Transactions on Medical Imaging, 22 (2003), 865. doi: 10.1109/TMI.2003.815069.

[28]

R. Peyret and T. Taylor, "Computational Methods for Fluid Flow,", Springer, (1983).

[29]

J. P. W. Pluim, J. B. A. Maintz and M. A. Viegever, Mutual information based registration of medical images: A survey,, IEEE Transactions on Medical Imaging, 22 (2003), 986. doi: 10.1109/TMI.2003.815867.

[30]

T. Rehman and A. Tannenbaum, Multigrid optimal mass transport for image registration and morphing,, in, (2007).

[31]

L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms,, Physica D, 60 (1992), 259. doi: 10.1016/0167-2789(92)90242-F.

[32]

R. Temam and A. Miranville, "Mathematical Modeling in Continuum Mechanics,", Cambridge, (2000).

[33]

J. Thirion, Image matching as a diffusion process: An analogy with Maxwell's demons,, Medical Image Analysis, 2 (1998), 243. doi: 10.1016/S1361-8415(98)80022-4.

[34]

A. Trouve, Diffeomorphisms groups and pattern matching in image analysis,, International Journal of Computer Vision, 28 (1998), 213. doi: 10.1023/A:1008001603737.

[35]

P. Viola and W. M. Wells, Alignment by maximization of mutual information,, International Journal of Computer Vision, 24 (1997), 137. doi: 10.1023/A:1007958904918.

[36]

G. Wollny and F. Kruggel, Computational cost of nonrigid registration algorithms based on fluid dynamics,, IEEE Transactions on Medical Imaging, 21 (2002), 946. doi: 10.1109/TMI.2002.803113.

show all references

References:
[1]

Y. Amit, A nonlinear variational problem for image matching,, SIAM Scientific Computing, 15 (1994), 207. doi: 10.1137/0915014.

[2]

R. Bajcsy and S. Kovacic, Multiresolution elastic matching,, Computer Vision, 46 (1989), 1. doi: 10.1016/S0734-189X(89)80014-3.

[3]

F. L. Bookstein and W. D. K. Green, Edge information at landmarks in medical images,, in, (1992), 242.

[4]

M. Bro-Nielsen and C. Gramkow, Fast fluid registration of medical images,, in, (1996), 267.

[5]

C. Broit, "Optimal Registration of Deformed Images,", Ph.D. thesis, (1981).

[6]

T. F. Chan and L. A. Vese, Active contours without edges,, IEEE Transactions on Image Processing, 10 (2001), 266. doi: 10.1109/83.902291.

[7]

G. E. Christensen, S. C. Joshi and M. I. Miller, Volumetric transformation of brain anatomy,, IEEE Transactions on Medical Imaging, 16 (1997), 864. doi: 10.1109/42.650882.

[8]

G. E. Christensen, R. D. Rabbitt and M. I. Miller, A deformable neuroanatomy textbook based on viscous fluid mechanics,, in, (1993), 211.

[9]

G. E. Christensen, R. D. Rabbitt and M. I. Miller, 3D brain mapping using a deformable neuroanatomy,, Physics in Medicine and Biology, 39 (1994), 609. doi: 10.1088/0031-9155/39/3/022.

[10]

G. E. Christensen, R. D. Rabbitt and M. I. Miller, Deformable templates using large deformation kinematics,, IEEE Transactions on Image Processing, 5 (1996), 1435. doi: 10.1109/83.536892.

[11]

E. D'Agostino, F. Maes, D. Vandermeulen and P. Suetens, A viscous fluid model for multimodal non-rigid image registration using mutual information,, Medical Image Analysis, 7 (2003), 565. doi: 10.1016/S1361-8415(03)00039-2.

[12]

C. Davatzikos, Spatial transformation and registration of brain images using elastically deformable models,, Computer Vision and Image Understanding, 66 (1997), 207. doi: 10.1006/cviu.1997.0605.

[13]

J. C. Gee, D. R. Haynor, M. Reivich and R. Bajcsy, Finite element approach to warping of brain images,, in, (1994), 327.

[14]

R. Gonzalez and R. Woods, "Digital Image Processing,", Addison-Wesley, (1992).

[15]

E. Haber and J. Modersitzki, A multilevel method for image registration,, SIAM J. Sci. Comput., 27 (2006), 1594. doi: 10.1137/040608106.

[16]

S. Haker, L. Zhu, A. Tannenbaum and S. Angenent, Optimal mass transport for registration and warping,, International Journal of Computer Vision, 60 (2004), 225. doi: 10.1023/B:VISI.0000036836.66311.97.

[17]

D. D. Holm, J. T. Ratnanather, A. Trouve and L. Younes, Soliton dynamics in computational anatomy,, NeuroImage, 23 (2004), 170. doi: 10.1016/j.neuroimage.2004.07.017.

[18]

S. Kabus, A. Franz and B. Fischer, Variational image registration allowing for discontinuities in the displacement field,, in, (2007). doi: 10.1007/978-3-540-33267-1_20.

[19]

L. D. Landau and E. M. Lifshitz, "Fluid Mechanics,", Pergamon, (1987).

[20]

R. J. LeVeque, "Finite Volume Methods for Hyperbolic Problems,", Cambridge University Press, (2002). doi: 10.1017/CBO9780511791253.

[21]

A. Madabhushi and J. K. Udupa, Interplay between intensity standardization and inhomogeneity correction in MR image processing,, IEEE Transactions on Medical Imaging, 24 (2005), 561. doi: 10.1109/TMI.2004.843256.

[22]

F. Maes, A. Collington, D. Vandermeulen, G. Marchal and P. Suetens, Multimodality image registration by maximization of mutual information,, IEEE Transactions on Medical Imaging, 16 (1997), 187. doi: 10.1109/42.563664.

[23]

S. Marsland and C. J. Twining, Constructing diffeomorphic representations for the groupwise analysis of nonrigid registrations of medical images,, IEEE Transactions on Medical Imaging, 23 (2004), 1006.

[24]

A. Mills, S. Marsland and T. Shardlow, Computing the geodesic interpolating spline,, in, (2006), 169.

[25]

J. Modersitzki, "Numerical Methods for Image Registration,", Oxford University Press, (2004).

[26]

C. A. Pelizzari, G. T. Y. Chen, D. R. Spelbring, R. R. Weichselbaum and C. T. Chen, Accurate three-dimensional registration of CT, PET, and/or MR images of the brain,, Computer Assisted Tomography, 13 (1989), 20. doi: 10.1097/00004728-198901000-00004.

[27]

S. Periaswamy and H. Farid, Elastic registration in the presence of intensity variations,, IEEE Transactions on Medical Imaging, 22 (2003), 865. doi: 10.1109/TMI.2003.815069.

[28]

R. Peyret and T. Taylor, "Computational Methods for Fluid Flow,", Springer, (1983).

[29]

J. P. W. Pluim, J. B. A. Maintz and M. A. Viegever, Mutual information based registration of medical images: A survey,, IEEE Transactions on Medical Imaging, 22 (2003), 986. doi: 10.1109/TMI.2003.815867.

[30]

T. Rehman and A. Tannenbaum, Multigrid optimal mass transport for image registration and morphing,, in, (2007).

[31]

L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms,, Physica D, 60 (1992), 259. doi: 10.1016/0167-2789(92)90242-F.

[32]

R. Temam and A. Miranville, "Mathematical Modeling in Continuum Mechanics,", Cambridge, (2000).

[33]

J. Thirion, Image matching as a diffusion process: An analogy with Maxwell's demons,, Medical Image Analysis, 2 (1998), 243. doi: 10.1016/S1361-8415(98)80022-4.

[34]

A. Trouve, Diffeomorphisms groups and pattern matching in image analysis,, International Journal of Computer Vision, 28 (1998), 213. doi: 10.1023/A:1008001603737.

[35]

P. Viola and W. M. Wells, Alignment by maximization of mutual information,, International Journal of Computer Vision, 24 (1997), 137. doi: 10.1023/A:1007958904918.

[36]

G. Wollny and F. Kruggel, Computational cost of nonrigid registration algorithms based on fluid dynamics,, IEEE Transactions on Medical Imaging, 21 (2002), 946. doi: 10.1109/TMI.2002.803113.

[1]

Yunmei Chen, Jiangli Shi, Murali Rao, Jin-Seop Lee. Deformable multi-modal image registration by maximizing Rényi's statistical dependence measure. Inverse Problems & Imaging, 2015, 9 (1) : 79-103. doi: 10.3934/ipi.2015.9.79

[2]

Massimiliano Caramia, Giovanni Storchi. Evaluating the effects of parking price and location in multi-modal transportation networks. Networks & Heterogeneous Media, 2006, 1 (3) : 441-465. doi: 10.3934/nhm.2006.1.441

[3]

Yangang Chen, Justin W. L. Wan. Numerical method for image registration model based on optimal mass transport. Inverse Problems & Imaging, 2018, 12 (2) : 401-432. doi: 10.3934/ipi.2018018

[4]

José M. Amigó, Beata Graff, Grzegorz Graff, Roberto Monetti, Katarzyna Tessmer. Detecting coupling directions with transcript mutual information: A comparative study. Discrete & Continuous Dynamical Systems - B, 2017, 22 (11) : 1-19. doi: 10.3934/dcdsb.2019051

[5]

Anis Theljani, Ke Chen. An augmented lagrangian method for solving a new variational model based on gradients similarity measures and high order regulariation for multimodality registration. Inverse Problems & Imaging, 2019, 13 (2) : 309-335. doi: 10.3934/ipi.2019016

[6]

Panagiotis Stinis. A hybrid method for the inviscid Burgers equation. Discrete & Continuous Dynamical Systems - A, 2003, 9 (4) : 793-799. doi: 10.3934/dcds.2003.9.793

[7]

Shuai Ren, Tao Zhang, Fangxia Shi. Characteristic analysis of carrier based on the filtering and a multi-wavelet method for the information hiding. Discrete & Continuous Dynamical Systems - S, 2015, 8 (6) : 1291-1299. doi: 10.3934/dcdss.2015.8.1291

[8]

Khalid Boushaba. A multi layer method applied to a model of phytoplankton. Networks & Heterogeneous Media, 2007, 2 (1) : 37-54. doi: 10.3934/nhm.2007.2.37

[9]

Rudolf Ahlswede. The final form of Tao's inequality relating conditional expectation and conditional mutual information. Advances in Mathematics of Communications, 2007, 1 (2) : 239-242. doi: 10.3934/amc.2007.1.239

[10]

Marcus Wagner. A direct method for the solution of an optimal control problem arising from image registration. Numerical Algebra, Control & Optimization, 2012, 2 (3) : 487-510. doi: 10.3934/naco.2012.2.487

[11]

Rui Wang, Denghua Zhong, Yuankun Zhang, Jia Yu, Mingchao Li. A multidimensional information model for managing construction information. Journal of Industrial & Management Optimization, 2015, 11 (4) : 1285-1300. doi: 10.3934/jimo.2015.11.1285

[12]

Alexey Cheskidov, Susan Friedlander, Nataša Pavlović. An inviscid dyadic model of turbulence: The global attractor. Discrete & Continuous Dynamical Systems - A, 2010, 26 (3) : 781-794. doi: 10.3934/dcds.2010.26.781

[13]

José Antonio Carrillo, Yanghong Huang, Francesco Saverio Patacchini, Gershon Wolansky. Numerical study of a particle method for gradient flows. Kinetic & Related Models, 2017, 10 (3) : 613-641. doi: 10.3934/krm.2017025

[14]

Aymen Balti, Valentina Lanza, Moulay Aziz-Alaoui. A multi-base harmonic balance method applied to Hodgkin-Huxley model. Mathematical Biosciences & Engineering, 2018, 15 (3) : 807-825. doi: 10.3934/mbe.2018036

[15]

Yueling Jia, Zhaohui Huo. Inviscid limit behavior of solution for the multi-dimensional derivative complex Ginzburg-Landau equation. Kinetic & Related Models, 2014, 7 (1) : 57-77. doi: 10.3934/krm.2014.7.57

[16]

Qingshan Chen. On the well-posedness of the inviscid multi-layer quasi-geostrophic equations. Discrete & Continuous Dynamical Systems - A, 2019, 39 (6) : 3215-3237. doi: 10.3934/dcds.2019133

[17]

Pierre Degond, Simone Goettlich, Axel Klar, Mohammed Seaid, Andreas Unterreiter. Derivation of a kinetic model from a stochastic particle system. Kinetic & Related Models, 2008, 1 (4) : 557-572. doi: 10.3934/krm.2008.1.557

[18]

Marcello Delitala, Tommaso Lorenzi. A mathematical model for value estimation with public information and herding. Kinetic & Related Models, 2014, 7 (1) : 29-44. doi: 10.3934/krm.2014.7.29

[19]

Roberto Camassa, Pao-Hsiung Chiu, Long Lee, W.-H. Sheu. A particle method and numerical study of a quasilinear partial differential equation. Communications on Pure & Applied Analysis, 2011, 10 (5) : 1503-1515. doi: 10.3934/cpaa.2011.10.1503

[20]

Yanfei Wang, Qinghua Ma. A gradient method for regularizing retrieval of aerosol particle size distribution function. Journal of Industrial & Management Optimization, 2009, 5 (1) : 115-126. doi: 10.3934/jimo.2009.5.115

2017 Impact Factor: 1.465

Metrics

  • PDF downloads (3)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]