Registration-based segmentation of murine 4D cardiac micro-CT data using symmetric normalization

Affine medical image registration with fusion feature mapping in local and global

Objective. Medical image affine registration is a crucial basis before using deformable registration. On the one hand, the traditional affine registration methods based on step-by-step optimization are very time-consuming, so these methods are not compatible with most real-time medical applications. On the other hand, convolutional neural networks are limited in modeling long-range spatial relationships of the features due to inductive biases, such as weight sharing and locality. This is not conducive to affine registration tasks. Therefore, the evolution of real-time and high-accuracy affine medical image registration algorithms is necessary for registration applications.Approach. In this paper, we propose a deep learning-based coarse-to-fine global and local feature fusion architecture for fast affine registration, and we use an unsupervised approach for end-to-end training. We use multiscale convolutional kernels as our elemental convolutional blocks to enhance feature extraction. Then, to learn the long-range spatial relationships of the features, we propose a new affine registration framework with weighted global positional attention that fuses global feature mapping and local feature mapping. Moreover, the fusion regressor is designed to generate the affine parameters.Main results. The additive fusion method can be adaptive to global mapping and local mapping, which improves affine registration accuracy without the center of mass initialization. In addition, the max pooling layer and the multiscale convolutional kernel coding module increase the ability of the model in affine registration.Significance. We validate the effectiveness of our method on the OASIS dataset with 414 3D MRI brain maps. Comprehensive results demonstrate that our method achieves state-of-the-art affine registration accuracy and very efficient runtimes.

Four-dimensional diffusion-weighted MR imaging (4D-DWI): a feasibility study

PURPOSE

Diffusion-weighted Magnetic Resonance Imaging (DWI) has been shown to be a powerful tool for cancer detection with high tumor-to-tissue contrast. This study aims to investigate the feasibility of developing a four-dimensional DWI technique (4D-DWI) for imaging respiratory motion for radiation therapy applications.

MATERIALS/METHODS

Image acquisition was performed by repeatedly imaging a volume of interest (VOI) using an interleaved multislice single-shot echo-planar imaging (EPI) 2D-DWI sequence in the axial plane. Each 2D-DWI image was acquired with an intermediately low b-value (b = 500 s/mm² ) and with diffusion-encoding gradients in x, y, and z diffusion directions. Respiratory motion was simultaneously recorded using a respiratory bellow, and the synchronized respiratory signal was used to retrospectively sort the 2D images to generate 4D-DWI. Cine MRI using steady-state free precession was also acquired as a motion reference. As a preliminary feasibility study, this technique was implemented on a 4D digital human phantom (XCAT) with a simulated pancreas tumor. The respiratory motion of the phantom was controlled by regular sinusoidal motion profile. 4D-DWI tumor motion trajectories were extracted and compared with the input breathing curve. The mean absolute amplitude differences (D) were calculated in superior-inferior (SI) direction and anterior-posterior (AP) direction. The technique was then evaluated on two healthy volunteers. Finally, the effects of 4D-DWI on apparent diffusion coefficient (ADC) measurements were investigated for hypothetical heterogeneous tumors via simulations.

RESULTS

Tumor trajectories extracted from XCAT 4D-DWI were consistent with the input signal: the average D value was 1.9 mm (SI) and 0.4 mm (AP). The average D value was 2.6 mm (SI) and 1.7 mm (AP) for the two healthy volunteers.

CONCLUSION

A 4D-DWI technique has been developed and evaluated on digital phantom and human subjects. 4D-DWI can lead to more accurate respiratory motion measurement. This has a great potential to improve the visualization and delineation of cancer tumors for radiotherapy.

Accuracy of respiratory motion measurement of 4D-MRI: A comparison between cine and sequential acquisition

PURPOSE

The authors have recently developed a cine-mode T2*/T1-weighted 4D-MRI technique and a sequential-mode T2-weighted 4D-MRI technique for imaging respiratory motion. This study aims at investigating which 4D-MRI image acquisition mode, cine or sequential, provides more accurate measurement of organ motion during respiration.

METHODS

A 4D digital extended cardiac-torso (XCAT) human phantom with a hypothesized tumor was used to simulate the image acquisition and the 4D-MRI reconstruction. The respiratory motion was controlled by the given breathing signal profiles. The tumor was manipulated to move continuously with the surrounding tissue. The motion trajectories were measured from both sequential- and cine-mode 4D-MRI images. The measured trajectories were compared with the average trajectory calculated from the input profiles, which was used as references. The error in 4D-MRI tumor motion trajectory (E) was determined. In addition, the corresponding respiratory motion amplitudes of all the selected 2D images for 4D reconstruction were recorded. Each of the amplitude was compared with the amplitude of its associated bin on the average breathing curve. The mean differences from the average breathing curve across all slice positions (D) were calculated. A total of 500 simulated respiratory profiles with a wide range of irregularity (Ir) were used to investigate the relationship between D and Ir. Furthermore, statistical analysis of E and D using XCAT controlled by 20 cancer patients' breathing profiles was conducted. Wilcoxon Signed Rank test was conducted to compare two modes.

RESULTS

D increased faster for cine-mode (D = 1.17 × Ir + 0.23) than sequential-mode (D = 0.47 × Ir + 0.23) as irregularity increased. For the XCAT study using 20 cancer patients' breathing profiles, the median E values were significantly different: 0.12 and 0.10 cm for cine- and sequential-modes, respectively, with a p-value of 0.02. The median D values were significantly different: 0.47 and 0.24 cm for cine- and sequential-modes, respectively, with a p-value < 0.001.

CONCLUSIONS

Respiratory motion measurement may be more accurate and less susceptible to breathing irregularity in sequential-mode 4D-MRI than that in cine-mode 4D-MRI.

Development of computational small animal models and their applications in preclinical imaging and therapy research

The development of multimodality preclinical imaging techniques and the rapid growth of realistic computer simulation tools have promoted the construction and application of computational laboratory animal models in preclinical research. Since the early 1990s, over 120 realistic computational animal models have been reported in the literature and used as surrogates to characterize the anatomy of actual animals for the simulation of preclinical studies involving the use of bioluminescence tomography, fluorescence molecular tomography, positron emission tomography, single-photon emission computed tomography, microcomputed tomography, magnetic resonance imaging, and optical imaging. Other applications include electromagnetic field simulation, ionizing and nonionizing radiation dosimetry, and the development and evaluation of new methodologies for multimodality image coregistration, segmentation, and reconstruction of small animal images. This paper provides a comprehensive review of the history and fundamental technologies used for the development of computational small animal models with a particular focus on their application in preclinical imaging as well as nonionizing and ionizing radiation dosimetry calculations. An overview of the overall process involved in the design of these models, including the fundamental elements used for the construction of different types of computational models, the identification of original anatomical data, the simulation tools used for solving various computational problems, and the applications of computational animal models in preclinical research. The authors also analyze the characteristics of categories of computational models (stylized, voxel-based, and boundary representation) and discuss the technical challenges faced at the present time as well as research needs in the future.

New small-intestine modeling method for surface-based computational human phantoms

When converting voxel phantoms to a surface format, the small intestine (SI), which is usually not accurately represented in a voxel phantom due to its complex and irregular shape on one hand and the limited voxel resolutions on the other, cannot be directly converted to a high-quality surface model. Currently, stylized pipe models are used instead, but they are strongly influenced by developer's subjectivity, resulting in unacceptable geometric and dosimetric inconsistencies. In this paper, we propose a new method for the construction of SI models based on the Monte Carlo approach. In the present study, the proposed method was tested by constructing the SI model for the polygon-mesh version of the ICRP reference male phantom currently under development. We believe that the new SI model is anatomically more realistic than the stylized SI models. Furthermore, our simulation results show that the new SI model, for both external and internal photon exposures, leads to dose values that are more similar to those of the original ICRP male voxel phantom than does the previously constructed stylized SI model.

Minimally interactive segmentation of 4D dynamic upper airway MR images via fuzzy connectedness

PURPOSE

There are several disease conditions that lead to upper airway restrictive disorders. In the study of these conditions, it is important to take into account the dynamic nature of the upper airway. Currently, dynamic magnetic resonance imaging is the modality of choice for studying these diseases. Unfortunately, the contrast resolution obtainable in the images poses many challenges for an effective segmentation of the upper airway structures. No viable methods have been developed to date to solve this problem. In this paper, the authors demonstrate a practical solution by employing an iterative relative fuzzy connectedness delineation algorithm as a tool.

METHODS

3D dynamic images were collected at ten equally spaced instances over the respiratory cycle (i.e., 4D) in 20 female subjects with obstructive sleep apnea syndrome. The proposed segmentation approach consists of the following steps. First, image background nonuniformities are corrected which is then followed by a process to correct for the nonstandardness of MR image intensities. Next, standardized image intensity statistics are gathered for the nasopharynx and oropharynx portions of the upper airway as well as the surrounding soft tissue structures including air outside the body region, hard palate, soft palate, tongue, and other soft structures around the airway including tonsils (left and right) and adenoid. The affinity functions needed for fuzzy connectedness computation are derived based on these tissue intensity statistics. In the next step, seeds for fuzzy connectedness computation are specified for the airway and the background tissue components. Seed specification is needed in only the 3D image corresponding to the first time instance of the 4D volume; from this information, the 3D volume corresponding to the first time point is segmented. Seeds are automatically generated for the next time point from the segmentation of the 3D volume corresponding to the previous time point, and the process continues and runs without human interaction and completes in 10 s for segmenting the airway structure in the whole 4D volume.

RESULTS

Qualitative evaluations performed to examine smoothness and continuity of motions of the entire upper airway as well as its transverse sections at critical anatomic locations indicate that the segmentations are consistent. Quantitative evaluations of the separate 200 3D volumes and the 20 4D volumes yielded true positive and false positive volume fractions around 95% and 0.1%, respectively, and mean boundary placement errors under 0.5 mm. The method is robust to variations in the subjective action of seed specification. Compared with a segmentation approach based on a registration technique to propagate segmentations, the proposed method is more efficient, accurate, and less prone to error propagation from one respiratory time point to the next.

CONCLUSIONS

The proposed method is the first demonstration of a viable and practical approach for segmenting the upper airway structures in dynamic MR images. Compared to registration-based methods, it effectively reduces error propagation and consequently achieves not only more accurate segmentations but also more consistent motion representation in the segmentations. The method is practical, requiring minimal user interaction and computational time.

In Vivo Quantitative Assessment of Myocardial Structure, Function, Perfusion and Viability Using Cardiac Micro-computed Tomography

The use of Micro-Computed Tomography (MicroCT) for in vivo studies of small animals as models of human disease has risen tremendously due to the fact that MicroCT provides quantitative high-resolution three-dimensional (3D) anatomical data non-destructively and longitudinally. Most importantly, with the development of a novel preclinical iodinated contrast agent called eXIA160, functional and metabolic assessment of the heart became possible. However, prior to the advent of commercial MicroCT scanners equipped with X-ray flat-panel detector technology and easy-to-use cardio-respiratory gating, preclinical studies of cardiovascular disease (CVD) in small animals required a MicroCT technologist with advanced skills, and thus were impractical for widespread implementation. The goal of this work is to provide a practical guide to the use of the high-speed Quantum FX MicroCT system for comprehensive determination of myocardial global and regional function along with assessment of myocardial perfusion, metabolism and viability in healthy mice and in a cardiac ischemia mouse model induced by permanent occlusion of the left anterior descending coronary artery (LAD).

A fast algorithm to estimate inverse consistent image transformation based on corresponding landmarks

Inverse consistency is an important feature for non-rigid image transformation in medical imaging analysis. In this paper, a simple and efficient inverse consistent image transformation estimation algorithm is proposed to preserve correspondence of landmarks and accelerate convergence. The proposed algorithm estimates both the forward and backward transformations simultaneously in the way that they are inverse to each other based on the correspondence of landmarks. Instead of computing the inverse functions and the inverse consistent transformations, respectively, we combine them together, which can improve computation efficiency significantly. Moreover, radial basis functions (RBFs) based transformation is adopted in our algorithm, which can handle deformation with local or global support. Our algorithm maps one landmark to its corresponding position exactly using the forward and backward transformations. Moreover, our algorithm is employed to estimate the forward and backward transformations in robust point matching, as well to demonstrate the application of our algorithm in image registration. The experiment results of uniform grids and test images indicate the improvement of the proposed algorithm in the aspect of inverse consistency of transformations and the reduction of the computation time of the forward and the backward transformations. The performance of our algorithm applying to robust point matching is evaluated using both brain slices and lung slices. Our experiments show that by combing robust point matching with our algorithm, the registration accuracy can be improved and the smoothness of transformations can be preserved.

Anatomical and functional imaging of myocardial infarction in mice using micro-CT and eXIA 160 contrast agent

Noninvasive small animal imaging techniques are essential for evaluation of cardiac disease and potential therapeutics. A novel preclinical iodinated contrast agent called eXIA 160 has recently been developed, which has been evaluated for micro-CT cardiac imaging. eXIA 160 creates strong contrast between blood and tissue immediately after its injection and is subsequently taken up by the myocardium and other metabolically active tissues over time. We focus on these properties of eXIA and show its use in imaging myocardial infarction in mice. Five C57BL/6 mice were imaged ~2 weeks after left anterior descending coronary artery ligation. Six C57BL/6 mice were used as controls. Immediately after injection of eXIA 160, an enhancement difference between blood and myocardium of ~340 HU enabled cardiac function estimation via 4D micro-CT scanning with retrospective gating. Four hours post-injection, the healthy perfused myocardium had a contrast difference of ~140 HU relative to blood while the infarcted myocardium showed no enhancement. These differences allowed quantification of infarct size via dual-energy micro-CT. In vivo micro-SPECT imaging and ex vivo triphenyl tetrazolium chloride (TTC) staining provided validation for the micro-CT findings. Root mean squared error of infarct measurements was 2.7% between micro-CT and SPECT, and 4.7% between micro-CT and TTC. Thus, micro-CT with eXIA 160 can be used to provide both morphological and functional data for preclinical studies evaluating myocardial infarction and potential therapies. Further studies are warranted to study the potential use of eXIA 160 as a CT molecular imaging tool for other metabolically active tissues in the mouse.

Registration of challenging pre-clinical brain images

The size and complexity of brain imaging studies in pre-clinical populations are increasing, and automated image analysis pipelines are urgently required. Pre-clinical populations can be subjected to controlled interventions (e.g., targeted lesions), which significantly change the appearance of the brain obtained by imaging. Existing systems for registration (the systematic alignment of scans into a consistent anatomical coordinate system), which assume image similarity to a reference scan, may fail when applied to these images. However, affine registration is a particularly vital pre-processing step for subsequent image analysis which is assumed to be an effective procedure in recent literature describing sophisticated techniques such as manifold learning. Therefore, in this paper, we present an affine registration solution that uses a graphical model of a population to decompose difficult pairwise registrations into a composition of steps using other members of the population. We developed this methodology in the context of a pre-clinical model of stroke in which large, variable hyper-intense lesions significantly impact registration performance. We tested this technique systematically in a simulated human population of brain tumour images before applying it to pre-clinical models of Parkinson's disease and stroke.