4D-CT reconstruction with unified spatial-temporal patch-based regularization

Daniil Kazantsev; William M. Thompson; William R. B. Lionheart; Geert Van Eyndhoven; Anders P. Kaestner; Katherine J. Dobson; Philip J. Withers; Peter D. Lee

doi:10.3934/ipi.2015.9.447

Previous Article
Increasing stability for the inverse problem of the Schrödinger equation with the partial Cauchy data
IPI Home
This Issue
Next Article
Empirical average-case relation between undersampling and sparsity in X-ray CT

May 2015, 9(2): 447-467. doi: 10.3934/ipi.2015.9.447

4D-CT reconstruction with unified spatial-temporal patch-based regularization

Daniil Kazantsev ^1, , William M. Thompson ^2, , William R. B. Lionheart ^2, , Geert Van Eyndhoven ^3, , Anders P. Kaestner ^4, , Katherine J. Dobson ^1, , Philip J. Withers ^1, and Peter D. Lee ^1,

1.	The Manchester X-ray Imaging Facility, School of Materials, The University of Manchester, Manchester, M13 9PL, United Kingdom, United Kingdom, United Kingdom, United Kingdom
2.	School of Mathematics, The University of Manchester, Alan Turing Building, Manchester, M13 9PL, United Kingdom, United Kingdom
3.	iMinds-Vision Lab, The University of Antwerp, Wilrijk, B-2610, Belgium
4.	Laboratory for Neutron Scattering and Imaging, Paul Scherrer Institut (PSI), Villigen, 5232, Switzerland

Received July 2013 Revised April 2014 Published March 2015

Abstract
Related Papers
Under a Creative Commons license

In this paper, we consider a limited data reconstruction problem for temporarily evolving computed tomography (CT), where some regions are static during the whole scan and some are dynamic (intensely or slowly changing). When motion occurs during a tomographic experiment one would like to minimize the number of projections used and reconstruct the image iteratively. To ensure stability of the iterative method spatial and temporal constraints are highly desirable. Here, we present a novel spatial-temporal regularization approach where all time frames are reconstructed collectively as a unified function of space and time. Our method has two main differences from the state-of-the-art spatial-temporal regularization methods. Firstly, all available temporal information is used to improve the spatial resolution of each time frame. Secondly, our method does not treat spatial and temporal penalty terms separately but rather unifies them in one regularization term. Additionally we optimize the temporal smoothing part of the method by considering the non-local patches which are most likely to belong to one intensity class. This modification significantly improves the signal-to-noise ratio of the reconstructed images and reduces computational time. The proposed approach is used in combination with golden ratio sampling of the projection data which allows one to find a better trade-off between temporal and spatial resolution scenarios.

Keywords: GPU acceleration., spatial-temporal penalties, neutron tomography, non local means, Time lapse tomography.

Mathematics Subject Classification: Primary: 65F10, 65F22; Secondary: 62P3.

Citation: Daniil Kazantsev, William M. Thompson, William R. B. Lionheart, Geert Van Eyndhoven, Anders P. Kaestner, Katherine J. Dobson, Philip J. Withers, Peter D. Lee. 4D-CT reconstruction with unified spatial-temporal patch-based regularization. Inverse Problems & Imaging, 2015, 9 (2) : 447-467. doi: 10.3934/ipi.2015.9.447

References:

[1]	S. Bougleux, G. Peyre and L. Cohen, Non-local regularization of inverse problems, Inverse Probl. Imaging, 5 (2011), 511-530. doi: 10.3934/ipi.2011.5.511. Google Scholar
[2]	K. S. Brown, S. Schluter, A. Sheppard and D. Wildenschild, On the challenges of measuring interfacial characteristics of three-phase fluid flow with x-ray microtomography, Journal of Microscopy, 253 (2014), 171-182. doi: 10.1111/jmi.12106. Google Scholar
[3]	A. Buades, B. Coll and J. M. Morel, A review of image denoising algorithms with a new one, Multiscale Model. Simul., 4 (2005), 490-530. doi: 10.1137/040616024. Google Scholar
[4]	C. L. Byrne, Applied Iterative Methods, Natick, MA: Peters, 2008. doi: 10.1201/b10651. Google Scholar
[5]	P. L. Combettes and J.-C. Pesquet, Proximal splitting methods in signal processing, in Fixed-Point Algorithms for Inverse Problems in Science and Engineering, Springer Optim. Appl., {49}, Springer, New York, 2011, 185-212. doi: 10.1007/978-1-4419-9569-8_10. Google Scholar
[6]	H. Gao, J-F. Cai, Z. Shen and H. Zhao, Robust principal component analysis-based four-dimensional computed tomography, Phys Med. Biol., 56 (2011), 3181-3198. doi: 10.1088/0031-9155/56/11/002. Google Scholar
[7]	X. Jia, Y. Lou, B. Dong, Z. Tian and S. Jiang, 4D computed tomography reconstruction from few-projection data via temporal non-local regularization, in Medical Image Computing and Computer-Assisted Intervention - MICCAI 2010, Lecture Notes in Computer Science, 6361, Springer, Berlin-Heidelberg, 2010, 143-150. doi: 10.1007/978-3-642-15705-9_18. Google Scholar
[8]	A. P. Kaestner, S. Hartmann, G. Kuhne, G. Frei, C. Grunzweig, L. Josic, F. Schmid and E. H. Lehmann, The ICON beamline - a facility for cold neutron imaging at SINQ, Nuclear Instruments and Methods in Physics Research, 659 (2011), 387-393. doi: 10.1016/j.nima.2011.08.022. Google Scholar
[9]	A. P. Kaestner, B. Muench, P. Trtik and L. G. Butler, Spatio-temporal computed tomography of dynamic processes, SPIE Optical Engineering, 50 (2011), 1-10. Google Scholar
[10]	J. Kaipio and E. Somersalo, Statistical inverse problems: discretization, model reduction and inverse crimes, Journal of Computational and Applied Mathematics, 198 (2007), 493-504. doi: 10.1016/j.cam.2005.09.027. Google Scholar
[11]	A. C. Kak and M. Slaney, Principles of Computerized Tomographic Imaging, IEEE Press, New York, 1998. doi: 10.1137/1.9780898719277. Google Scholar
[12]	D. Kazantsev, W. R. B. Lionheart, P. J. Withers and P. D. Lee, GPU accelerated 4D-CT reconstruction using higher order PDE regularization in spatial and temporal domains, in Proc. CMSSE, 3, Almeria, Spain, 2013, 843-852. Google Scholar
[13]	D. Kazantsev, S. R. Arridge, S. Pedemonte, A. Bousse, K. Erlandsson, B. F. Hutton and S. Ourselin, An anatomically driven anisotropic diffusion filtering method for 3D SPECT reconstruction, Phys Med. Biol., 57 (2012), 3793-3810. doi: 10.1088/0031-9155/57/12/3793. Google Scholar
[14]	T. Kohler, A projection access scheme for iterative reconstruction based on the golden section, in IEEE Symposium Conference Record Nuclear Science 2004, Vol. 6, IEEE, 2004, 3961-3965. doi: 10.1109/NSSMIC.2004.1466745. Google Scholar
[15]	D. S. Lalush and M. N. Wernick, Iterative image reconstruction, in Emission Tomography (ed. Mark T. Madsen), Academic Press, 2004, 443-472. doi: 10.1016/B978-012744482-6/50024-7. Google Scholar
[16]	D. S. Lalush and B. M. W. Tsui, Block-iterative techniques for fast 4D reconstruction using a priori motion models in gated cardiac SPECT, Phys Med. Biol., 43 (1998), 875-886. doi: 10.1088/0031-9155/43/4/015. Google Scholar
[17]	S. Z. Li, Markov Random Field Modeling in Image Analysis, Springer, 2009. doi: 10.1007/978-1-84800-279-1. Google Scholar
[18]	J. Nocedal and S. Wright, Numerical Optimization, Springer, 2006. doi: 10.1007/978-0-387-40065-5. Google Scholar
[19]	W. J. Palenstijn, K. J. Batenburg and J. Sijbers, Performance improvements for iterative electron tomography reconstruction using graphics processing units (GPUs), J. of Struct. Biol., 176 (2011), 250-253. doi: 10.1016/j.jsb.2011.07.017. Google Scholar
[20]	, PB regularization package (open-source code),, , (). Google Scholar
[21]	K. Perlin, Improving noise, ACM T. Graphic., 21 (2002), 681-682. doi: 10.1145/566654.566636. Google Scholar
[22]	J. Qi and R. M. Leahy, Iterative reconstruction techniques in emission computed tomography, Phys Med. Biol., 51 (2006), R541-R578. doi: 10.1088/0031-9155/51/15/R01. Google Scholar
[23]	A. Rahmim, J. Tang and H. Zaidi, Four-dimensional (4D) image reconstruction strategies in dynamic PET: Beyond conventional independent frame reconstruction, Med. Phys., 36 (2009), 3654-3670. doi: 10.1118/1.3160108. Google Scholar
[24]	L. Ritschl, S. Sawall, M. Knaup, A. Hess and M. Kachelrieß, Iterative 4D cardiac micro-CT image reconstruction using an adaptive spatio-temporal sparsity prior, Phys Med. Biol., 57 (2012), 1517-1526. doi: 10.1088/0031-9155/57/6/1517. Google Scholar
[25]	L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D., 60 (1992), 259-268. doi: 10.1016/0167-2789(92)90242-F. Google Scholar
[26]	M. Strobl, I. Manke, N. Kardjilov, A. Hilger, M. Dawson and J. Banhart, Advances in neutron radiography and tomography, J. Phys. D: Appl. Phys., 42 (2009), 1-21. doi: 10.1088/0022-3727/42/24/243001. Google Scholar
[27]	W. M. Thompson, W. R. Lionheart and E. J. Morton, Real-Time Imaging with a high speed X-Ray CT system, in Proc. 6th International Symposium on Process Tomography, 2012. Google Scholar
[28]	G. Van Eyndhoven, K. J. Batenburg and J. Sijbers, Region-based iterative reconstruction of structurally changing objects in CT, IEEE Trans. on Image Process, 23 (2014), 909-919. doi: 10.1109/TIP.2013.2297024. Google Scholar
[29]	H. Wu, A. Maier, R. Fahrig and J. Hornegger, Spatial-temporal total variation regularization (STTVR) for 4D-CT reconstruction, Proc. SPIE, 8313 (2012), 237-240. doi: 10.1117/12.911162. Google Scholar
[30]	G. Wang and J. Qi, Penalized likelihood PET image reconstruction using patch-based edge-preserving regularization, IEEE Transactions on Medical Imaging, 31 (2012), 2194-2204. doi: 10.1109/tmi.2012.2211378. Google Scholar
[31]	Z. Yang and M. Jacob, Nonlocal regularization of inverse problems: A unified variational framework, IEEE Trans. on Image Process, 22 (2013), 3192-3203. doi: 10.1109/tip.2012.2216278. Google Scholar
[32]	Z. Yang and M. Jacob, Robust non-local regularization framework for motion compensated dynamic imaging without explicit motion estimation, in 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI), 2012, 1056-1059. doi: 10.1109/ISBI.2012.6235740. Google Scholar

show all references

References:

[1]	S. Bougleux, G. Peyre and L. Cohen, Non-local regularization of inverse problems, Inverse Probl. Imaging, 5 (2011), 511-530. doi: 10.3934/ipi.2011.5.511. Google Scholar
[2]	K. S. Brown, S. Schluter, A. Sheppard and D. Wildenschild, On the challenges of measuring interfacial characteristics of three-phase fluid flow with x-ray microtomography, Journal of Microscopy, 253 (2014), 171-182. doi: 10.1111/jmi.12106. Google Scholar
[3]	A. Buades, B. Coll and J. M. Morel, A review of image denoising algorithms with a new one, Multiscale Model. Simul., 4 (2005), 490-530. doi: 10.1137/040616024. Google Scholar
[4]	C. L. Byrne, Applied Iterative Methods, Natick, MA: Peters, 2008. doi: 10.1201/b10651. Google Scholar
[5]	P. L. Combettes and J.-C. Pesquet, Proximal splitting methods in signal processing, in Fixed-Point Algorithms for Inverse Problems in Science and Engineering, Springer Optim. Appl., {49}, Springer, New York, 2011, 185-212. doi: 10.1007/978-1-4419-9569-8_10. Google Scholar
[6]	H. Gao, J-F. Cai, Z. Shen and H. Zhao, Robust principal component analysis-based four-dimensional computed tomography, Phys Med. Biol., 56 (2011), 3181-3198. doi: 10.1088/0031-9155/56/11/002. Google Scholar
[7]	X. Jia, Y. Lou, B. Dong, Z. Tian and S. Jiang, 4D computed tomography reconstruction from few-projection data via temporal non-local regularization, in Medical Image Computing and Computer-Assisted Intervention - MICCAI 2010, Lecture Notes in Computer Science, 6361, Springer, Berlin-Heidelberg, 2010, 143-150. doi: 10.1007/978-3-642-15705-9_18. Google Scholar
[8]	A. P. Kaestner, S. Hartmann, G. Kuhne, G. Frei, C. Grunzweig, L. Josic, F. Schmid and E. H. Lehmann, The ICON beamline - a facility for cold neutron imaging at SINQ, Nuclear Instruments and Methods in Physics Research, 659 (2011), 387-393. doi: 10.1016/j.nima.2011.08.022. Google Scholar
[9]	A. P. Kaestner, B. Muench, P. Trtik and L. G. Butler, Spatio-temporal computed tomography of dynamic processes, SPIE Optical Engineering, 50 (2011), 1-10. Google Scholar
[10]	J. Kaipio and E. Somersalo, Statistical inverse problems: discretization, model reduction and inverse crimes, Journal of Computational and Applied Mathematics, 198 (2007), 493-504. doi: 10.1016/j.cam.2005.09.027. Google Scholar
[11]	A. C. Kak and M. Slaney, Principles of Computerized Tomographic Imaging, IEEE Press, New York, 1998. doi: 10.1137/1.9780898719277. Google Scholar
[12]	D. Kazantsev, W. R. B. Lionheart, P. J. Withers and P. D. Lee, GPU accelerated 4D-CT reconstruction using higher order PDE regularization in spatial and temporal domains, in Proc. CMSSE, 3, Almeria, Spain, 2013, 843-852. Google Scholar
[13]	D. Kazantsev, S. R. Arridge, S. Pedemonte, A. Bousse, K. Erlandsson, B. F. Hutton and S. Ourselin, An anatomically driven anisotropic diffusion filtering method for 3D SPECT reconstruction, Phys Med. Biol., 57 (2012), 3793-3810. doi: 10.1088/0031-9155/57/12/3793. Google Scholar
[14]	T. Kohler, A projection access scheme for iterative reconstruction based on the golden section, in IEEE Symposium Conference Record Nuclear Science 2004, Vol. 6, IEEE, 2004, 3961-3965. doi: 10.1109/NSSMIC.2004.1466745. Google Scholar
[15]	D. S. Lalush and M. N. Wernick, Iterative image reconstruction, in Emission Tomography (ed. Mark T. Madsen), Academic Press, 2004, 443-472. doi: 10.1016/B978-012744482-6/50024-7. Google Scholar
[16]	D. S. Lalush and B. M. W. Tsui, Block-iterative techniques for fast 4D reconstruction using a priori motion models in gated cardiac SPECT, Phys Med. Biol., 43 (1998), 875-886. doi: 10.1088/0031-9155/43/4/015. Google Scholar
[17]	S. Z. Li, Markov Random Field Modeling in Image Analysis, Springer, 2009. doi: 10.1007/978-1-84800-279-1. Google Scholar
[18]	J. Nocedal and S. Wright, Numerical Optimization, Springer, 2006. doi: 10.1007/978-0-387-40065-5. Google Scholar
[19]	W. J. Palenstijn, K. J. Batenburg and J. Sijbers, Performance improvements for iterative electron tomography reconstruction using graphics processing units (GPUs), J. of Struct. Biol., 176 (2011), 250-253. doi: 10.1016/j.jsb.2011.07.017. Google Scholar
[20]	, PB regularization package (open-source code),, , (). Google Scholar
[21]	K. Perlin, Improving noise, ACM T. Graphic., 21 (2002), 681-682. doi: 10.1145/566654.566636. Google Scholar
[22]	J. Qi and R. M. Leahy, Iterative reconstruction techniques in emission computed tomography, Phys Med. Biol., 51 (2006), R541-R578. doi: 10.1088/0031-9155/51/15/R01. Google Scholar
[23]	A. Rahmim, J. Tang and H. Zaidi, Four-dimensional (4D) image reconstruction strategies in dynamic PET: Beyond conventional independent frame reconstruction, Med. Phys., 36 (2009), 3654-3670. doi: 10.1118/1.3160108. Google Scholar
[24]	L. Ritschl, S. Sawall, M. Knaup, A. Hess and M. Kachelrieß, Iterative 4D cardiac micro-CT image reconstruction using an adaptive spatio-temporal sparsity prior, Phys Med. Biol., 57 (2012), 1517-1526. doi: 10.1088/0031-9155/57/6/1517. Google Scholar
[25]	L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D., 60 (1992), 259-268. doi: 10.1016/0167-2789(92)90242-F. Google Scholar
[26]	M. Strobl, I. Manke, N. Kardjilov, A. Hilger, M. Dawson and J. Banhart, Advances in neutron radiography and tomography, J. Phys. D: Appl. Phys., 42 (2009), 1-21. doi: 10.1088/0022-3727/42/24/243001. Google Scholar
[27]	W. M. Thompson, W. R. Lionheart and E. J. Morton, Real-Time Imaging with a high speed X-Ray CT system, in Proc. 6th International Symposium on Process Tomography, 2012. Google Scholar
[28]	G. Van Eyndhoven, K. J. Batenburg and J. Sijbers, Region-based iterative reconstruction of structurally changing objects in CT, IEEE Trans. on Image Process, 23 (2014), 909-919. doi: 10.1109/TIP.2013.2297024. Google Scholar
[29]	H. Wu, A. Maier, R. Fahrig and J. Hornegger, Spatial-temporal total variation regularization (STTVR) for 4D-CT reconstruction, Proc. SPIE, 8313 (2012), 237-240. doi: 10.1117/12.911162. Google Scholar
[30]	G. Wang and J. Qi, Penalized likelihood PET image reconstruction using patch-based edge-preserving regularization, IEEE Transactions on Medical Imaging, 31 (2012), 2194-2204. doi: 10.1109/tmi.2012.2211378. Google Scholar
[31]	Z. Yang and M. Jacob, Nonlocal regularization of inverse problems: A unified variational framework, IEEE Trans. on Image Process, 22 (2013), 3192-3203. doi: 10.1109/tip.2012.2216278. Google Scholar
[32]	Z. Yang and M. Jacob, Robust non-local regularization framework for motion compensated dynamic imaging without explicit motion estimation, in 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI), 2012, 1056-1059. doi: 10.1109/ISBI.2012.6235740. Google Scholar

[1]	Aniello Raffaele Patrone, Otmar Scherzer. On a spatial-temporal decomposition of optical flow. Inverse Problems & Imaging, 2017, 11 (4) : 761-781. doi: 10.3934/ipi.2017036
[2]	Raimund Bürger, Gerardo Chowell, Pep Mulet, Luis M. Villada. Modelling the spatial-temporal progression of the 2009 A/H1N1 influenza pandemic in Chile. Mathematical Biosciences & Engineering, 2016, 13 (1) : 43-65. doi: 10.3934/mbe.2016.13.43
[3]	Zhun Gou, Nan-jing Huang, Ming-hui Wang, Yao-jia Zhang. A stochastic optimal control problem governed by SPDEs via a spatial-temporal interaction operator. Mathematical Control & Related Fields, 2021, 11 (2) : 291-312. doi: 10.3934/mcrf.2020037
[4]	Yoon-Sik Cho, Aram Galstyan, P. Jeffrey Brantingham, George Tita. Latent self-exciting point process model for spatial-temporal networks. Discrete & Continuous Dynamical Systems - B, 2014, 19 (5) : 1335-1354. doi: 10.3934/dcdsb.2014.19.1335
[5]	Qiyu Jin, Ion Grama, Quansheng Liu. Convergence theorems for the Non-Local Means filter. Inverse Problems & Imaging, 2018, 12 (4) : 853-881. doi: 10.3934/ipi.2018036
[6]	Simon Hubmer, Alexander Ploier, Ronny Ramlau, Peter Fosodeder, Sandrine van Frank. A mathematical approach towards THz tomography for non-destructive imaging. Inverse Problems & Imaging, , () : -. doi: 10.3934/ipi.2021041
[7]	Michael V. Klibanov. Travel time tomography with formally determined incomplete data in 3D. Inverse Problems & Imaging, 2019, 13 (6) : 1367-1393. doi: 10.3934/ipi.2019060
[8]	Jan Boman, Vladimir Sharafutdinov. Stability estimates in tensor tomography. Inverse Problems & Imaging, 2018, 12 (5) : 1245-1262. doi: 10.3934/ipi.2018052
[9]	Tim Kreutzmann, Andreas Rieder. Geometric reconstruction in bioluminescence tomography. Inverse Problems & Imaging, 2014, 8 (1) : 173-197. doi: 10.3934/ipi.2014.8.173
[10]	Plamen Stefanov, Wenxiang Cong, Ge Wang. Modulated luminescence tomography. Inverse Problems & Imaging, 2015, 9 (2) : 579-589. doi: 10.3934/ipi.2015.9.579
[11]	James W. Webber, Eric L. Miller. Bragg scattering tomography. Inverse Problems & Imaging, 2021, 15 (4) : 683-721. doi: 10.3934/ipi.2021010
[12]	Bernard Ducomet, Šárka Nečasová. Thermalization time in a model of neutron star. Discrete & Continuous Dynamical Systems - B, 2011, 16 (3) : 801-818. doi: 10.3934/dcdsb.2011.16.801
[13]	Helmut Harbrecht, Thorsten Hohage. A Newton method for reconstructing non star-shaped domains in electrical impedance tomography. Inverse Problems & Imaging, 2009, 3 (2) : 353-371. doi: 10.3934/ipi.2009.3.353
[14]	Melody Dodd, Jennifer L. Mueller. A real-time D-bar algorithm for 2-D electrical impedance tomography data. Inverse Problems & Imaging, 2014, 8 (4) : 1013-1031. doi: 10.3934/ipi.2014.8.1013
[15]	Linh V. Nguyen. A family of inversion formulas in thermoacoustic tomography. Inverse Problems & Imaging, 2009, 3 (4) : 649-675. doi: 10.3934/ipi.2009.3.649
[16]	Ke Zhang, Maokun Li, Fan Yang, Shenheng Xu, Aria Abubakar. Electrical impedance tomography with multiplicative regularization. Inverse Problems & Imaging, 2019, 13 (6) : 1139-1159. doi: 10.3934/ipi.2019051
[17]	Mikko Kaasalainen. Dynamical tomography of gravitationally bound systems. Inverse Problems & Imaging, 2008, 2 (4) : 527-546. doi: 10.3934/ipi.2008.2.527
[18]	Peter Kuchment, Leonid Kunyansky. Synthetic focusing in ultrasound modulated tomography. Inverse Problems & Imaging, 2010, 4 (4) : 665-673. doi: 10.3934/ipi.2010.4.665
[19]	Bastian Gebauer. Localized potentials in electrical impedance tomography. Inverse Problems & Imaging, 2008, 2 (2) : 251-269. doi: 10.3934/ipi.2008.2.251
[20]	Alberto Ibort, Alberto López-Yela. Quantum tomography and the quantum Radon transform. Inverse Problems & Imaging, 2021, 15 (5) : 893-928. doi: 10.3934/ipi.2021021

2020 Impact Factor: 1.639

American Institute of Mathematical Sciences

4D-CT reconstruction with unified spatial-temporal patch-based regularization

References:

References:

Tools

Metrics

Other articles
by authors

Tools

Metrics

Other articles
by authors

American Institute of Mathematical Sciences

4D-CT reconstruction with unified spatial-temporal patch-based regularization

References:

References:

Tools

Metrics

Other articlesby authors

Tools

Metrics

Other articlesby authors

Other articles
by authors

Other articles
by authors