American Institute of Mathematical Sciences

In recent years multi-modal data processing methods have gained considerable research interest as technological advancements in imaging, computing, and data storage have made the collection of redundant, multi-modal data more commonplace. In this work we present an image restoration method tailored for scenarios where pre-existing, high-quality images from different modalities or contrasts are available in addition to the target image. Our method is based on a novel network architecture which combines the benefits of traditional multi-scale signal representation, such as wavelets, with more recent concepts from data fusion methods. Results from numerical simulations in which T1-weighted MRI images are used to restore noisy and undersampled T2-weighted images demonstrate that the proposed network successfully utilizes information from high-quality reference images to improve the restoration quality of the target image beyond that of existing popular methods.

A primary interest in dynamic inverse problems is to identify the underlying temporal behaviour of the system from outside measurements. In this work, we consider the case, where the target can be represented by a decomposition of spatial and temporal basis functions and hence can be efficiently represented by a low-rank decomposition. We then propose a joint reconstruction and low-rank decomposition method based on the Nonnegative Matrix Factorisation to obtain the unknown from highly undersampled dynamic measurement data. The proposed framework allows for flexible incorporation of separate regularisers for spatial and temporal features. For the special case of a stationary operator, we can effectively use the decomposition to reduce the computational complexity and obtain a substantial speed-up. The proposed methods are evaluated for three simulated phantoms and we compare the obtained results to a separate low-rank reconstruction and subsequent decomposition approach based on the widely used principal component analysis.

Limited-angle reconstruction is a very important but challenging problem in the field of computed tomography (CT) which has been extensively studied for many years. However, some difficulties still remain. Based on the theory of visible and invisible boundary developed by Quinto et.al, we propose a reconstruction model for limited-angle CT, which encodes the visible edges as priors to recover the invisible ones. The new model utilizes generalized shrinkage operators as regularizers to perform edge-preserving smoothing such that the visible edges are employed as anchors to recover piecewise-constant or piecewise-smooth reconstructions, while noises and artifacts are suppressed or removed. This work extends our previous research on limited-angle reconstruction which employs gradient \begin{document}$ \ell_0 $\end{document} and \begin{document}$ \ell_1 $\end{document} norm regularizers. The effectiveness of the proposed model and its corresponding solving algorithm shall be verified by numerical experiments with simulated data as well as real data.

In this paper, we propose a novel scheme for single image super resolution (SR) reconstruction. Firstly, we construct a new self-similarity framework by regarding the low resolution (LR) images as the low rank version of corresponding high resolution (HR) images. Subsequently, nuclear norm minimization (NNM) is employed to generate LR image pyramids from HR ones. The structure of our framework is beneficial to extract LR features, where we regard the quotient image, calculated between HR image and LR image at the same layer, as LR feature. This LR feature has the same dimension as LR image; however the dimension of commonly used gradient feature is 4 times than LR image. On the other hand, we employ nonlocal similar patch, within the same scale and across different scales, to generate HR and LR dictionaries. In the course of encoding, codes are calculated from both row and column of LR dictionary for each LR patch; at the same time, both low rank and sparse constraints on codes matrix give us a hand to remove coding noises. Finally, both quantitative and perceptual results demonstrate that our proposed method has a good SR performance.

In this paper, we mainly show a novel fast fractional order anisotropic diffusion algorithm for noise removal based on the recent numerical scheme called the Fast Explicit Diffusion. To balance the efficiency and accuracy of the algorithm, the truncated matrix method is used to deal with the iterative matrix in the model and its error is also estimated. In particular, we obtain the stability condition of the iteration by the spectrum analysis method. Through implementing the fast explicit format iteration algorithm with periodic change of time step size, the efficiency of the algorithm is greatly improved. At last, we show some numerical results on denoising tasks. Many experimental results confirm that the algorithm can more quickly achieve satisfactory denoising results.

We develop new efficient algorithms for a class of inverse problems of gravimetry to recover an anomalous volume mass distribution (measure) in the sense that we design fast local level-set methods to simultaneously reconstruct both unknown domain and varying density of the anomalous measure from modulus of gravity force rather than from gravity force itself. The equivalent-source principle of gravitational potential forces us to consider only measures of the form \begin{document}$ \mu = f\,\chi_{D} $\end{document}, where \begin{document}$ f $\end{document} is a density function and \begin{document}$ D $\end{document} is a domain inside a closed set in \begin{document}$ \bf{R}^n $\end{document}. Accordingly, various constraints are imposed upon both the density function and the domain so that well-posedness theories can be developed for the corresponding inverse problems, such as the domain inverse problem, the density inverse problem, and the domain-density inverse problem. Starting from uniqueness theorems for the domain-density inverse problem, we derive a new gradient from the misfit functional to enforce the directional-independence constraint of the density function and we further introduce a new labeling function into the level-set method to enforce the geometrical constraint of the corresponding domain; consequently, we are able to recover simultaneously both unknown domain and varying density from given modulus of gravity force. Our fast level-set method is built upon localizing the level-set evolution around a narrow band near the zero level-set and upon accelerating numerical modeling by novel low-rank matrix multiplication. Numerical results demonstrate that uniqueness theorems are crucial for solving the inverse problem of gravimetry and will be impactful on gravity prospecting. To the best of our knowledge, our inversion algorithm is the first of such for the domain-density inverse problem since it is based upon the conditional well-posedness theory of the inverse problem.

Existing image restoration methods mostly make full use of various image prior information. However, they rarely exploit the potential of residual histograms, especially their role as ensemble regularization constraint. In this paper, we propose a residual Wasserstein regularization model (RWRM), in which a residual histogram constraint is subtly embedded into a type of variational minimization problems. Specifically, utilizing the Wasserstein distance from the optimal transport theory, this scheme is achieved by enforcing the observed image residual histogram as close as possible to the reference residual histogram. Furthermore, the RWRM unifies the residual Wasserstein regularization and image prior regularization to improve image restoration performance. The robustness of parameter selection in the RWRM makes the proposed algorithms easier to implement. Finally, extensive experiments have confirmed that our RWRM applied to Gaussian denoising and non-blind deconvolution is effective.

For the characteristics of the degraded images with multiplicative noise, the gray level indicators for constructing adaptive total variation are proposed. Based on the new regularization term, we propose the new convex adaptive variational model. Then, considering the existence, uniqueness and comparison principle of the minimizer of the functional. The finite difference method with rescaling technique and the primal-dual method with adaptive step size are used to solve the minimization problem. The paper ends with a report on numerical tests for the denoising of images subject to multiplicative noise, the comparison with other methods is provided as well.

X-ray images of the lower limb bone are the most commonly used imaging modality for clinical studies, and segmentation of the femur and tibia in an X-ray image is helpful for many medical studies such as diagnosis, surgery and treatment. In this paper, we propose a new approach based on pure dilated residual U-Net for the segmentation of the femur and tibia bones. The proposed approach employs dilated convolution completely to increase the receptive field, in this way, we can make full use of the advantages of dilated convolution. We conducted experiments and evaluations on datasets provided by Tianjin hospital. Comparison with the classical U-net and FusionNet, our method has fewer parameters, higher accuracy, and converges more rapidly, which means the high performance of the proposed method.

This paper proposes to learn analysis transform network for dynamic magnetic resonance imaging (LANTERN). Integrating the strength of CS-MRI and deep learning, the proposed framework is highlighted in three components: (ⅰ) The spatial and temporal domains are sparsely constrained by adaptively trained convolutional filters; (ⅱ) We introduce an end-to-end framework to learn the parameters in LANTERN to solve the difficulty of parameter selection in traditional methods; (ⅲ) Compared to existing deep learning reconstruction methods, our experimental results show that our paper has encouraging capability in exploiting the spatial and temporal redundancy of dynamic MR images. We performed quantitative and qualitative analysis of cardiac reconstructions at different acceleration factors (\begin{document}$ 2 \times $\end{document}-\begin{document}$ 11 \times $\end{document}) with different undersampling patterns. In comparison with two state-of-the-art methods, experimental results show that our method achieved encouraging performances.

Retinex theory is introduced to show how the human visual system perceives the color and the illumination effect such as Retinex illusions, medical image intensity inhomogeneity and color shadow effect etc.. Many researchers have studied this ill-posed problem based on the framework of the variation energy functional for decades. However, to the best of our knowledge, the existing models via the sparsity of the image based on the nonconvex \begin{document}$ \ell^p $\end{document}-quasinorm were limited. To deal with this problem, this paper considers a TV\begin{document}$ _p $\end{document}-HOTV\begin{document}$ _q $\end{document}-based retinex model with \begin{document}$ p, q\in(0, 1) $\end{document}. Specially, the TV\begin{document}$ _p $\end{document} term based on the total variation(TV) regularization can describe the reflectance efficiently, which has the piecewise constant structure. The HOTV\begin{document}$ _q $\end{document} term based on the high order total variation(HOTV) regularization can penalize the smooth structure called the illumination. Since the proposed model is non-convex, non-smooth and non-Lipschitz, we employ the iteratively reweighed \begin{document}$ \ell_1 $\end{document} (IRL1) algorithm to solve it. We also discuss some properties of our proposed model and algorithm. Experimental experiments on the simulated and real images illustrate the effectiveness and the robustness of our proposed model both visually and quantitatively by compared with some related state-of-the-art variational models.

Multi-energy CT takes advantage of the non-linearly varying attenuation properties of elemental media with respect to energy, enabling more precise material identification than single-energy CT. The increased precision comes with the cost of a higher radiation dose. A straightforward way to lower the dose is to reduce the number of projections per energy, but this makes tomographic reconstruction more ill-posed. In this paper, we propose how this problem can be overcome with a combination of a regularization method that promotes structural similarity between images at different energies and a suitably selected low-dose data acquisition protocol using non-overlapping projections. The performance of various joint regularization models is assessed with both simulated and experimental data, using the novel low-dose data acquisition protocol. Three of the models are well-established, namely the joint total variation, the linear parallel level sets and the spectral smoothness promoting regularization models. Furthermore, one new joint regularization model is introduced for multi-energy CT: a regularization based on the structure function from the structural similarity index. The findings show that joint regularization outperforms individual channel-by-channel reconstruction. Furthermore, the proposed combination of joint reconstruction and non-overlapping projection geometry enables significant reduction of radiation dose.

Low rank approximation has been extensively studied in the past. It is most suitable to reproduce rectangular like structures in the data. In this work we introduce a generalization using "shifted" rank-\begin{document}$ 1 $\end{document} matrices to approximate \begin{document}$ \mathit{\boldsymbol{{A}}}\in \mathbb{C}^{M\times N} $\end{document}. These matrices are of the form \begin{document}$ S_{\mathit{\boldsymbol{{\lambda}}}}(\mathit{\boldsymbol{{u}}}\mathit{\boldsymbol{{v}}}^*) $\end{document} where \begin{document}$ \mathit{\boldsymbol{{u}}}\in \mathbb{C}^M $\end{document}, \begin{document}$ \mathit{\boldsymbol{{v}}}\in \mathbb{C}^N $\end{document} and \begin{document}$ \mathit{\boldsymbol{{\lambda}}}\in \mathbb{Z}^N $\end{document}. The operator \begin{document}$ S_{\mathit{\boldsymbol{{\lambda}}}} $\end{document} circularly shifts the \begin{document}$ k $\end{document}-th column of \begin{document}$ \mathit{\boldsymbol{{u}}}\mathit{\boldsymbol{{v}}}^* $\end{document} by \begin{document}$ \lambda_k $\end{document}.

These kind of shifts naturally appear in applications, where an object \begin{document}$ \mathit{\boldsymbol{{u}}} $\end{document} is observed in \begin{document}$ N $\end{document} measurements at different positions indicated by the shift \begin{document}$ \mathit{\boldsymbol{{\lambda}}} $\end{document}. The vector \begin{document}$ \mathit{\boldsymbol{{v}}} $\end{document} gives the observation intensity. This model holds for seismic waves that are recorded at \begin{document}$ N $\end{document} sensors at different times \begin{document}$ \mathit{\boldsymbol{{\lambda}}} $\end{document}. Other examples are a car that moves through a video changing its position \begin{document}$ \mathit{\boldsymbol{{\lambda}}} $\end{document} in each of the \begin{document}$ N $\end{document} frames, or non-destructive testing based on ultrasonic waves that are reflected by defects inside the material.

The main difficulty of the above stated problem lies in finding a suitable shift vector \begin{document}$ \mathit{\boldsymbol{{\lambda}}} $\end{document}. Once the shift is known, a simple singular value decomposition can be applied to reconstruct \begin{document}$ \mathit{\boldsymbol{{u}}} $\end{document} and \begin{document}$ \mathit{\boldsymbol{{v}}} $\end{document}. We propose a greedy method to reconstruct \begin{document}$ \mathit{\boldsymbol{{\lambda}}} $\end{document}. By using the formulation of the problem in Fourier domain, a shifted rank-\begin{document}$ 1 $\end{document} approximation can be calculated in \begin{document}$ O(NM\log M) $\end{document}. Convergence to a locally optimal solution is guaranteed. Furthermore, we give a heuristic initial guess strategy that shows good results in the numerical experiments.

We validate our approach in several numerical experiments on different kinds of data. We compare the technique to shift-invariant dictionary learning algorithms. Furthermore, we provide examples from application including object segmentation in non-destructive testing and seismic exploration as well as object tracking in video processing.

An inverse obstacle problem for the wave governed by the wave equation in a two layered medium is considered under the framework of the time domain enclosure method. The wave is generated by an initial data supported on a closed ball in the upper half-space, and observed on the same ball over a finite time interval. The unknown obstacle is penetrable and embedded in the lower half-space. It is assumed that the propagation speed of the wave in the upper half-space is greater than that of the wave in the lower half-space, which is excluded in the previous study: Ikehata and Kawashita, Inverse Problems and Imaging 12 (2018), no.5, 1173-1198. In the present case, when the reflected waves from the obstacle enter the upper half-space, the total reflection phenomena occur, which give singularities to the integral representation of the fundamental solution for the reduced transmission problem in the background medium. This fact makes the problem more complicated. However, it is shown that these waves do not have any influence on the leading profile of the indicator function of the time domain enclosure method.

An inverse obstacle scattering problem for the electromagnetic wave governed by the Maxwell system over a finite time interval is considered. It is assumed that the wave satisfies the Leontovich boundary condition on the surface of an unknown obstacle. The condition is described by using an unknown positive function on the surface of the obstacle which is called the surface admittance. The wave is generated at the initial time by a volumetric current source supported on a very small ball placed outside the obstacle and only the electric component of the wave is observed on the same ball over a finite time interval. It is shown that from the observed data one can extract information about the value of the surface admittance and the curvatures at the points on the surface nearest to the center of the ball. This shows that a single shot contains a meaningful information about the quantitative state of the surface of the obstacle.

EIT is a non-linear ill-posed inverse problem which requires sophisticated regularisation techniques to achieve good results. In this paper we consider the use of structural information in the form of edge directions coming from an auxiliary image of the same object being reconstructed. In order to allow for cases where the auxiliary image does not provide complete information we consider in addition a sparsity regularization for the edges appearing in the EIT image. The combination of these approaches is conveniently described through the parallel level sets approach. We present an overview of previous methods for structural regularisation and then provide a variational setting for our approach and explain the numerical implementation. We present results on simulations and experimental data for different cases with accurate and inaccurate prior information. The results demonstrate that the structural prior information improves the reconstruction accuracy, even in cases when there is reasonable uncertainty in the prior about the location of the edges or only partial edge information is available.

An inverse obstacle problem for the wave equation in a two layered medium is considered. It is assumed that the unknown obstacle is penetrable and embedded in the lower half-space. The wave as a solution of the wave equation is generated by an initial data whose support is in the upper half-space and observed at the same place as the support over a finite time interval. From the observed wave an indicator function in the time domain enclosure method is constructed. It is shown that, one can find some information about the geometry of the obstacle together with the qualitative property in the asymptotic behavior of the indicator function.

In this paper, we investigate the relations between the Radon and weighted divergent beam and cone transforms. Novel inversion formulas are derived for the latter two. The weighted cone transform arises, for instance, in image reconstruction from the data obtained by Compton cameras, which have promising applications in various fields, including biomedical and homeland security imaging and gamma ray astronomy. The inversion formulas are applicable for a wide variety of detector geometries in any dimension. The results of numerical implementation of some of the formulas in dimensions two and three are also provided.

An inverse obstacle scattering problem for the wave governed by the Maxwell system in the time domain, in particular, over a finite time interval is considered. It is assumed that the electric field \begin{document}$\boldsymbol{E}$\end{document} and magnetic field \begin{document}$\boldsymbol{ H}$\end{document} which are solutions of the Maxwell system are generated only by a current density at the initial time located not far a way from an unknown obstacle. The obstacle is embedded in a medium like air which has constant electric permittivity \begin{document}$ε$\end{document} and magnetic permeability \begin{document}$μ$\end{document}. It is assumed that the fields on the surface of the obstacle satisfy the Leontovich boundary condition \begin{document}$\boldsymbol{ ν}×\boldsymbol{H}-λ\,\boldsymbol{ ν}×(\boldsymbol{ E}×\boldsymbol{ ν})=\boldsymbol{ 0}$\end{document} with admittance \begin{document}$λ$\end{document} an unknown positive function and \begin{document}$\boldsymbol{ ν}$\end{document} the unit outward normal. The observation data are given by the electric field observed at the same place as the support of the current density over a finite time interval. It is shown that an indicator function computed from the electric fields corresponding two current densities enables us to know: the distance of the center of the common spherical support of the current densities to the obstacle; whether the value of the admittance \begin{document}$λ$\end{document} is greater or less than the special value \begin{document}$\sqrt{ε/μ}$\end{document}.