Deformable image registration between pathological images and MR image via an optical macro image

Three-dimensional histology reveals dissociable human hippocampal long-axis gradients of Alzheimer's pathology

INTRODUCTION

Three-dimensional (3D) histology analyses are essential to overcome sampling variability and understand pathological differences beyond the dissection axis. We present Path2MR, the first pipeline allowing 3D reconstruction of sparse human histology without a magnetic resonance imaging (MRI) reference. We implemented Path2MR with post-mortem hippocampal sections to explore pathology gradients in Alzheimer's disease.

METHODS

Blockface photographs of brain hemisphere slices are used for 3D reconstruction, from which an MRI-like image is generated using machine learning. Histology sections are aligned to the reconstructed hemisphere and subsequently to an atlas in standard space.

RESULTS

Path2MR successfully registered histological sections to their anatomic position along the hippocampal longitudinal axis. Combined with histopathology quantification, we found an expected peak of tau pathology at the anterior end of the hippocampus, whereas amyloid-beta (Aβ) displayed a quadratic anterior-posterior distribution.

CONCLUSION

Path2MR, which enables 3D histology using any brain bank data set, revealed significant differences along the hippocampus between tau and Aβ.

HIGHLIGHTS

Path2MR enables three-dimensional (3D) brain reconstruction from blockface dissection photographs. This pipeline does not require dense specimen sampling or a subject-specific magnetic resonance (MR) image. Anatomically consistent mapping of hippocampal sections was obtained with Path2MR. Our analyses revealed an anterior-posterior gradient of hippocampal tau pathology. In contrast, the peak of amyloid-beta (Aβ) deposition was closer to the hippocampal body.

Three-dimensional histology reveals dissociable human hippocampal long axis gradients of Alzheimer's pathology

INTRODUCTION

Three-dimensional (3D) histology analyses are essential to overcome sampling variability and understand pathological differences beyond the dissection axis. We present Path2MR, the first pipeline allowing 3D reconstruction of sparse human histology without an MRI reference. We implemented Path2MR with post-mortem hippocampal sections to explore pathology gradients in Alzheimer's Disease.

METHODS

Blockface photographs of brain hemisphere slices are used for 3D reconstruction, from which an MRI-like image is generated using machine learning. Histology sections are aligned to the reconstructed hemisphere and subsequently to an atlas in standard space.

RESULTS

Path2MR successfully registered histological sections to their anatomical position along the hippocampal longitudinal axis. Combined with histopathology quantification, we found an expected peak of tau pathology at the anterior end of the hippocampus, while amyloid-β displayed a quadratic anterior-posterior distribution.

CONCLUSION

Path2MR, which enables 3D histology using any brain bank dataset, revealed significant differences along the hippocampus between tau and amyloid-β.

Tensor image registration library: Deformable registration of stand-alone histology images to whole-brain post-mortem MRI data

BACKGROUND

Accurate registration between microscopy and MRI data is necessary for validating imaging biomarkers against neuropathology, and to disentangle complex signal dependencies in microstructural MRI. Existing registration methods often rely on serial histological sampling or significant manual input, providing limited scope to work with a large number of stand-alone histology sections. Here we present a customisable pipeline to assist the registration of stand-alone histology sections to whole-brain MRI data.

METHODS

Our pipeline registers stained histology sections to whole-brain post-mortem MRI in 4 stages, with the help of two photographic intermediaries: a block face image (to undistort histology sections) and coronal brain slab photographs (to insert them into MRI space). Each registration stage is implemented as a configurable stand-alone Python script using our novel platform, Tensor Image Registration Library (TIRL), which provides flexibility for wider adaptation. We report our experience of registering 87 PLP-stained histology sections from 14 subjects and perform various experiments to assess the accuracy and robustness of each stage of the pipeline.

RESULTS

All 87 histology sections were successfully registered to MRI. Histology-to-block registration (Stage 1) achieved 0.2-0.4 mm accuracy, better than commonly used existing methods. Block-to-slice matching (Stage 2) showed great robustness in automatically identifying and inserting small tissue blocks into whole brain slices with 0.2 mm accuracy. Simulations demonstrated sub-voxel level accuracy (0.13 mm) of the slice-to-volume registration (Stage 3) algorithm, which was observed in over 200 actual brain slice registrations, compensating 3D slice deformations up to 6.5 mm. Stage 4 combined the previous stages and generated refined pixelwise aligned multi-modal histology-MRI stacks.

CONCLUSIONS

Our open-source pipeline provides robust automation tools for registering stand-alone histology sections to MRI data with sub-voxel level precision, and the underlying framework makes it readily adaptable to a diverse range of microscopy-MRI studies.

The Digital Brain Bank, an open access platform for post-mortem imaging datasets

Post-mortem magnetic resonance imaging (MRI) provides the opportunity to acquire high-resolution datasets to investigate neuroanatomy and validate the origins of image contrast through microscopy comparisons. We introduce the Digital Brain Bank (open.win.ox.ac.uk/DigitalBrainBank), a data release platform providing open access to curated, multimodal post-mortem neuroimaging datasets. Datasets span three themes-Digital Neuroanatomist: datasets for detailed neuroanatomical investigations; Digital Brain Zoo: datasets for comparative neuroanatomy; and Digital Pathologist: datasets for neuropathology investigations. The first Digital Brain Bank data release includes 21 distinctive whole-brain diffusion MRI datasets for structural connectivity investigations, alongside microscopy and complementary MRI modalities. This includes one of the highest-resolution whole-brain human diffusion MRI datasets ever acquired, whole-brain diffusion MRI in fourteen nonhuman primate species, and one of the largest post-mortem whole-brain cohort imaging studies in neurodegeneration. The Digital Brain Bank is the culmination of our lab's investment into post-mortem MRI methodology and MRI-microscopy analysis techniques. This manuscript provides a detailed overview of our work with post-mortem imaging to date, including the development of diffusion MRI methods to image large post-mortem samples, including whole, human brains. Taken together, the Digital Brain Bank provides cross-scale, cross-species datasets facilitating the incorporation of post-mortem data into neuroimaging studies.

Elastic transformation of histological slices allows precise co-registration with microCT data sets for a refined virtual histology approach

Although X-ray based 3D virtual histology is an emerging tool for the analysis of biological tissue, it falls short in terms of specificity when compared to conventional histology. Thus, the aim was to establish a novel approach that combines 3D information provided by microCT with high specificity that only (immuno-)histochemistry can offer. For this purpose, we developed a software frontend, which utilises an elastic transformation technique to accurately co-register various histological and immunohistochemical stainings with free propagation phase contrast synchrotron radiation microCT. We demonstrate that the precision of the overlay of both imaging modalities is significantly improved by performing our elastic registration workflow, as evidenced by calculation of the displacement index. To illustrate the need for an elastic co-registration approach we examined specimens from a mouse model of breast cancer with injected metal-based nanoparticles. Using the elastic transformation pipeline, we were able to co-localise the nanoparticles to specifically stained cells or tissue structures into their three-dimensional anatomical context. Additionally, we performed a semi-automated tissue structure and cell classification. This workflow provides new insights on histopathological analysis by combining CT specific three-dimensional information with cell/tissue specific information provided by classical histology.

DeepMapi: a Fully Automatic Registration Method for Mesoscopic Optical Brain Images Using Convolutional Neural Networks

The extreme complexity of mammalian brains requires a comprehensive deconstruction of neuroanatomical structures. Scientists normally use a brain stereotactic atlas to determine the locations of neurons and neuronal circuits. However, different brain images are normally not naturally aligned even when they are imaged with the same setup, let alone under the differing resolutions and dataset sizes used in mesoscopic imaging. As a result, it is difficult to achieve high-throughput automatic registration without manual intervention. Here, we propose a deep learning-based registration method called DeepMapi to predict a deformation field used to register mesoscopic optical images to an atlas. We use a self-feedback strategy to address the problem of imbalanced training sets (sampling at a fixed step size in nonuniform brains of structures and deformations) and use a dual-hierarchical network to capture the large and small deformations. By comparing DeepMapi with other registration methods, we demonstrate its superiority over a set of ground truth images, including both optical and MRI images. DeepMapi achieves fully automatic registration of mesoscopic micro-optical images, even macroscopic MRI datasets, in minutes, with an accuracy comparable to those of manual annotations by anatomists.

Micro-computed tomography utility for estimation of intraparenchymal spinal cord cystic lesions in small animals

Precise assessment of spinal cord cystic lesions is crucial to formulate effective therapeutic strategies, yet histological assessment of the lesion remains the primary method despite numerous studies showing inconsistent results regarding estimation of lesion size via histology. On the other hand, despite numerous advances in micro-computed tomography (micro-CT) imaging and analysis that have allowed precise measurements of lesion size, there is not enough published data on its application to estimate intraspinal lesion size in laboratory animal models. This work attempts to show that micro-CT can be valuable for spinal cord injury research by demonstrating accurate estimation of syrinx size and compares between micro-CT and traditional histological analysis. We used a post-traumatic syringomyelia rat model to compare micro-CT analysis to conventional histological analysis. The study showed that micro-CT can detect lesions within the spinal cord very similar to histology. Importantly, micro-CT appears to provide more accurate estimates of the lesions with more measures (e.g., surface area), can detect compounds within the cord, and can be done with the tissue of interest (spinal cord) intact. In summary, the experimental work presented here provides one of the first investigations of the use of micro-CT for estimating the size of intraparenchymal cysts and detecting materials within the spinal cord. All animal procedures were approved by the University of Akron Institutional Animal Care and Use Committee (IACUC) (protocol # LRE 16-05-09 approved on May 14, 2016).

Histological Validation of MRI: A Review of Challenges in Registration of Imaging and Whole-Mount Histopathology

Rigorous validation with ground truth information such as histology is needed to reliably assess the current and potential value of MRI techniques to characterize tissue and identify disease-related tissue alterations. Commonly used methods that aim to directly correlate histology and MRI data generally fall short of this goal due to spatial errors that preclude direct matching. Errors result from tissue deformation, differences in spatial resolution and slice thickness, non-coplanar and/or nonintersecting plane orientations, and different image contrast mechanisms. Some of these problems arise from limitations in standard protocols for clinical tissue processing and histology-based pathology reporting, and to some extent can be addressed by modifications to standard protocols without compromising the clinical process. Typical modifications include ex vivo specimen MRI, block-face photography, addition of fiducial markers, and 3D printed molds to constrain tissue deformation and guide sectioning. This review summarizes the advantages and limitations of MRI validation techniques based on coregistration of MRI with whole-mount histology of tissue specimens. LEVEL OF EVIDENCE: 4 TECHNICAL EFFICACY STAGE: 1.

A Robust Image Registration Interface for Large Volume Brain Atlas

Accurately mapping brain structures in three-dimensions is critical for an in-depth understanding of brain functions. Using the brain atlas as a hub, mapping detected datasets into a standard brain space enables efficient use of various datasets. However, because of the heterogeneous and nonuniform brain structure characteristics at the cellular level introduced by recently developed high-resolution whole-brain microscopy techniques, it is difficult to apply a single standard to robust registration of various large-volume datasets. In this study, we propose a robust Brain Spatial Mapping Interface (BrainsMapi) to address the registration of large-volume datasets by introducing extracted anatomically invariant regional features and a large-volume data transformation method. By performing validation on model data and biological images, BrainsMapi achieves accurate registration on intramodal, individual, and multimodality datasets and can also complete the registration of large-volume datasets (approximately 20 TB) within 1 day. In addition, it can register and integrate unregistered vectorized datasets into a common brain space. BrainsMapi will facilitate the comparison, reuse and integration of a variety of brain datasets.

A Practical Guide to Whole Slide Imaging: A White Paper From the Digital Pathology Association

Context.—

Whole slide imaging (WSI) represents a paradigm shift in pathology, serving as a necessary first step for a wide array of digital tools to enter the field. Its basic function is to digitize glass slides, but its impact on pathology workflows, reproducibility, dissemination of educational material, expansion of service to underprivileged areas, and intrainstitutional and interinstitutional collaboration exemplifies a significant innovative movement with far-reaching effects. Although the benefits of WSI to pathology practices, academic centers, and research institutions are many, the complexities of implementation remain an obstacle to widespread adoption. In the wake of the first regulatory clearance of WSI for primary diagnosis in the United States, some barriers to adoption have fallen. Nevertheless, implementation of WSI remains a difficult prospect for many institutions, especially those with stakeholders unfamiliar with the technologies necessary to implement a system or who cannot effectively communicate to executive leadership and sponsors the benefits of a technology that may lack clear and immediate reimbursement opportunity.

Objectives.—

To present an overview of WSI technology—present and future—and to demonstrate several immediate applications of WSI that support pathology practice, medical education, research, and collaboration.

Data Sources.—

Peer-reviewed literature was reviewed by pathologists, scientists, and technologists who have practical knowledge of and experience with WSI.

Conclusions.—

Implementation of WSI is a multifaceted and inherently multidisciplinary endeavor requiring contributions from pathologists, technologists, and executive leadership. Improved understanding of the current challenges to implementation, as well as the benefits and successes of the technology, can help prospective users identify the best path for success.

Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology

Context

Augmented reality (AR) devices such as the Microsoft HoloLens have not been well used in the medical field.

Objective

To test the HoloLens for clinical and nonclinical applications in pathology.

Design

A Microsoft HoloLens was tested for virtual annotation during autopsy, viewing 3D gross and microscopic pathology specimens, navigating whole slide images, telepathology, as well as real-time pathology-radiology correlation.

Results

Pathology residents performing an autopsy wearing the HoloLens were remotely instructed with real-time diagrams, annotations, and voice instruction. 3D-scanned gross pathology specimens could be viewed as holograms and easily manipulated. Telepathology was supported during gross examination and at the time of intraoperative consultation, allowing users to remotely access a pathologist for guidance and to virtually annotate areas of interest on specimens in real-time. The HoloLens permitted radiographs to be coregistered on gross specimens and thereby enhanced locating important pathologic findings. The HoloLens also allowed easy viewing and navigation of whole slide images, using an AR workstation, including multiple coregistered tissue sections facilitating volumetric pathology evaluation.

Conclusions

The HoloLens is a novel AR tool with multiple clinical and nonclinical applications in pathology. The device was comfortable to wear, easy to use, provided sufficient computing power, and supported high-resolution imaging. It was useful for autopsy, gross and microscopic examination, and ideally suited for digital pathology. Unique applications include remote supervision and annotation, 3D image viewing and manipulation, telepathology in a mixed-reality environment, and real-time pathology-radiology correlation.

Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation

Multi-modal image co-registration via optimizing mutual information (MI) is based on the assumption that intensity distributions of multi-modal images follow a consistent relationship. However, images with a substantial difference in appearance violate this assumption, thus MI directly based on image intensity alone may be inadequate to drive similarity based co-registration. To address this issue, we introduce a novel approach for multi-modal co-registration called Multi-scale Spectral Embedding Registration (MSERg). MSERg involves the construction of multi-scale spectral embedding (SE) representations from multimodal images via texture feature extraction, scale selection, independent component analysis (ICA) and SE to create orthogonal representations that decrease the dissimilarity between the fixed and moving images to facilitate better co-registration. To validate the MSERg method, we aligned 45 pairs of in vivo prostate MRI and corresponding ex vivo histopathology images. The dataset was split into a learning set and a testing set. In the learning set, length scales of 5 × 5, 7 × 7 and 17 × 17 were selected. In the independent testing set, we compared MSERg with intensity-based registration, multi-attribute combined mutual information (MACMI) registration and scale-invariant feature transform (SIFT) flow registration. Our results suggest that multi-scale SE representations generated by MSERg are found to be more appropriate for radiology-pathology co-registration.