Landmark optimization using local curvature for point-based nonlinear rodent brain image registration

Bayesian Landmark-based Shape Analysis of Tumor Pathology Images

Medical imaging is a form of technology that has revolutionized the medical field over the past decades. Digital pathology imaging, which captures histological details at the cellular level, is rapidly becoming a routine clinical procedure for cancer diagnosis support and treatment planning. Recent developments in deep-learning methods have facilitated tumor region segmentation from pathology images. The traditional shape descriptors that characterize tumor boundary roughness at the anatomical level are no longer suitable. New statistical approaches to model tumor shapes are in urgent need. In this paper, we consider the problem of modeling a tumor boundary as a closed polygonal chain. A Bayesian landmark-based shape analysis model is proposed. The model partitions the polygonal chain into mutually exclusive segments, accounting for boundary roughness. Our Bayesian inference framework provides uncertainty estimations on both the number and locations of landmarks, while outputting metrics that can be used to quantify boundary roughness. The performance of our model is comparable with that of a recently developed landmark detection model for planar elastic curves. In a case study of 143 consecutive patients with stage I to IV lung cancer, we demonstrated the heterogeneity of tumor boundary roughness derived from our model effectively predicted patient prognosis (p-value < 0.001).

Histological Validation of MRI: A Review of Challenges in Registration of Imaging and Whole-Mount Histopathology

Rigorous validation with ground truth information such as histology is needed to reliably assess the current and potential value of MRI techniques to characterize tissue and identify disease-related tissue alterations. Commonly used methods that aim to directly correlate histology and MRI data generally fall short of this goal due to spatial errors that preclude direct matching. Errors result from tissue deformation, differences in spatial resolution and slice thickness, non-coplanar and/or nonintersecting plane orientations, and different image contrast mechanisms. Some of these problems arise from limitations in standard protocols for clinical tissue processing and histology-based pathology reporting, and to some extent can be addressed by modifications to standard protocols without compromising the clinical process. Typical modifications include ex vivo specimen MRI, block-face photography, addition of fiducial markers, and 3D printed molds to constrain tissue deformation and guide sectioning. This review summarizes the advantages and limitations of MRI validation techniques based on coregistration of MRI with whole-mount histology of tissue specimens. LEVEL OF EVIDENCE: 4 TECHNICAL EFFICACY STAGE: 1.

Deformable image registration between pathological images and MR image via an optical macro image

Computed tomography (CT) and magnetic resonance (MR) imaging have been widely used for visualizing the inside of the human body. However, in many cases, pathological diagnosis is conducted through a biopsy or resection of an organ to evaluate the condition of tissues as definitive diagnosis. To provide more advanced information onto CT or MR image, it is necessary to reveal the relationship between tissue information and image signals. We propose a registration scheme for a set of PT images of divided specimens and a 3D-MR image by reference to an optical macro image (OM image) captured by an optical camera. We conducted a fundamental study using a resected human brain after the death of a brain cancer patient. We constructed two kinds of registration processes using the OM image as the base for both registrations to make conversion parameters between the PT and MR images. The aligned PT images had shapes similar to the OM image. On the other hand, the extracted cross-sectional MR image was similar to the OM image. From these resultant conversion parameters, the corresponding region on the PT image could be searched and displayed when an arbitrary pixel on the MR image was selected. The relationship between the PT and MR images of the whole brain can be analyzed using the proposed method. We confirmed that same regions between the PT and MR images could be searched and displayed using resultant information obtained by the proposed method. In terms of the accuracy of proposed method, the TREs were 0.56±0.39mm and 0.87±0.42mm. We can analyze the relationship between tissue information and MR signals using the proposed method.

A Learning Based Fiducial-driven Registration Scheme for Evaluating Laser Ablation Changes in Neurological Disorders

In this work, we present a novel learning based fiducial driven registration (LeFiR) scheme which utilizes a point matching technique to identify the optimal configuration of landmarks to better recover deformation between a target and a moving image. Moreover, we employ the LeFiR scheme to model the localized nature of deformation introduced by a new treatment modality - laser induced interstitial thermal therapy (LITT) for treating neurological disorders. Magnetic resonance (MR) guided LITT has recently emerged as a minimally invasive alternative to craniotomy for local treatment of brain diseases (such as glioblastoma multiforme (GBM), epilepsy). However, LITT is currently only practised as an investigational procedure world-wide due to lack of data on longer term patient outcome following LITT. There is thus a need to quantitatively evaluate treatment related changes between post- and pre-LITT in terms of MR imaging markers. In order to validate LeFiR, we tested the scheme on a synthetic brain dataset (SBD) and in two real clinical scenarios for treating GBM and epilepsy with LITT. Four experiments under different deformation profiles simulating localized ablation effects of LITT on MRI were conducted on 286 pairs of SBD images. The training landmark configurations were obtained through 2000 iterations of registration where the points with consistently best registration performance were selected. The estimated landmarks greatly improved the quality metrics compared to a uniform grid (UniG) placement scheme, a speeded-up robust features (SURF) based method, and a scale-invariant feature transform (SIFT) based method as well as a generic free-form deformation (FFD) approach. The LeFiR method achieved average 90% improvement in recovering the local deformation compared to 82% for the uniform grid placement, 62% for the SURF based approach, and 16% for the generic FFD approach. On the real GBM and epilepsy data, the quantitative results showed that LeFiR outperformed UniG by 28% improvement in average.

Optimal setting of image bounding box can improve registration accuracy of diffusion tensor tractography

PURPOSE

When we register diffusion tensor tractography (DTT) to anatomical images such as fast imaging employing steady-state acquisition (FIESTA), we register the B0 image to FIESTA. Precise registration of the DTT B0 image to FIESTA is possible with non-rigid registration compared to rigid registration, although the non-rigid methods lack convenience. We report the effect of image data bounding box settings on registration accuracy using a normalized mutual information (NMI) method METHODS: MRI scans of 10 patients were used in this study. Registration was performed without modification of the bounding box in the control group, and the results were compared with groups re-registered using multiple bounding boxes limited to the region of interest (ROI). The distance of misalignment after registration at 3 anatomical characteristic points that are common to both FIESTA and B0 images was used as an index of accuracy.

RESULTS

Mean ([Formula: see text]SD) misalignment at the 3 anatomical points decreased significantly from [Formula: see text] to [Formula: see text] mm, [Formula: see text]), [Formula: see text] to [Formula: see text] mm, ([Formula: see text], and [Formula: see text] to [Formula: see text] mm, ([Formula: see text], each showing improvement compared to the control group CONCLUSION: Narrowing the image data bounding box to the ROI improves the accuracy of registering B0 images to FIESTA by NMI method. With our proposed methodology, accuracy can be improved in extremely easy steps, and this methodology may prove useful for DTT registration to anatomical image.

3D reconstruction of 2D fluorescence histology images and registration with in vivo MR images: application in a rodent stroke model

To validate and add value to non-invasive imaging techniques, the corresponding histology is required to establish biological correlates. We present an efficient, semi-automated image-processing pipeline that uses immunohistochemically stained sections to reconstruct a 3D brain volume from 2D histological images before registering these with the corresponding 3D in vivo magnetic resonance images (MRI). A multistep registration procedure that first aligns the "global" volume by using the centre of mass and then applies a rigid and affine alignment based on signal intensities is described. This technique was applied to a training set of three rat brain volumes before being validated on three normal brains. Application of the approach to register "abnormal" images from a rat model of stroke allowed the neurobiological correlates of the variations in the hyper-intense MRI signal intensity caused by infarction to be investigated. For evaluation, the corresponding anatomical landmarks in MR and histology were defined to measure the registration accuracy. A registration error of 0.249 mm (approximately one in-plane voxel dimension) was evident in healthy rat brains and of 0.323 mm in a rodent model of stroke. The proposed reconstruction and registration pipeline allowed for the precise analysis of non-invasive MRI and corresponding microstructural histological features in 3D. We were thus able to interrogate histology to deduce the cause of MRI signal variations in the lesion cavity and the peri-infarct area.