Bi-channel image registration and deep-learning segmentation (BIRDS) for efficient, versatile 3D mapping of mouse brain

Connecto-informatics at the mesoscale: current advances in image processing and analysis for mapping the brain connectivity

Mapping neural connections within the brain has been a fundamental goal in neuroscience to understand better its functions and changes that follow aging and diseases. Developments in imaging technology, such as microscopy and labeling tools, have allowed researchers to visualize this connectivity through high-resolution brain-wide imaging. With this, image processing and analysis have become more crucial. However, despite the wealth of neural images generated, access to an integrated image processing and analysis pipeline to process these data is challenging due to scattered information on available tools and methods. To map the neural connections, registration to atlases and feature extraction through segmentation and signal detection are necessary. In this review, our goal is to provide an updated overview of recent advances in these image-processing methods, with a particular focus on fluorescent images of the mouse brain. Our goal is to outline a pathway toward an integrated image-processing pipeline tailored for connecto-informatics. An integrated workflow of these image processing will facilitate researchers' approach to mapping brain connectivity to better understand complex brain networks and their underlying brain functions. By highlighting the image-processing tools available for fluroscent imaging of the mouse brain, this review will contribute to a deeper grasp of connecto-informatics, paving the way for better comprehension of brain connectivity and its implications.

Rapid 3D isotropic imaging of whole organ with double-ring light-sheet microscopy and self-learning side-lobe elimination

Bessel-like plane illumination forms a new type of light-sheet microscopy with ultra-long optical sectioning distance that enables rapid 3D imaging of fine cellular structures across an entire large tissue. However, the side-lobe excitation of conventional Bessel light sheets severely impairs the quality of the reconstructed 3D image. Here, we propose a self-supervised deep learning (DL) approach that can completely eliminate the residual side lobes for a double-ring-modulated non-diffraction light-sheet microscope, thereby substantially improving the axial resolution of the 3D image. This lightweight DL model utilizes the own point spread function (PSF) of the microscope as prior information without the need for external high-resolution microscopy data. After a quick training process based on a small number of datasets, the grown-up model can restore sidelobe-free 3D images with near isotropic resolution for diverse samples. Using an advanced double-ring light-sheet microscope in conjunction with this efficient restoration approach, we demonstrate 5-minute rapid imaging of an entire mouse brain with a size of ∼12 mm × 8 mm  ×  6 mm and achieve uniform isotropic resolution of ∼4 µm (1.6-µm voxel) capable of discerning the single neurons and vessels across the whole brain.

D-LMBmap: a fully automated deep-learning pipeline for whole-brain profiling of neural circuitry

Recent proliferation and integration of tissue-clearing methods and light-sheet fluorescence microscopy has created new opportunities to achieve mesoscale three-dimensional whole-brain connectivity mapping with exceptionally high throughput. With the rapid generation of large, high-quality imaging datasets, downstream analysis is becoming the major technical bottleneck for mesoscale connectomics. Current computational solutions are labor intensive with limited applications because of the exhaustive manual annotation and heavily customized training. Meanwhile, whole-brain data analysis always requires combining multiple packages and secondary development by users. To address these challenges, we developed D-LMBmap, an end-to-end package providing an integrated workflow containing three modules based on deep-learning algorithms for whole-brain connectivity mapping: axon segmentation, brain region segmentation and whole-brain registration. D-LMBmap does not require manual annotation for axon segmentation and achieves quantitative analysis of whole-brain projectome in a single workflow with superior accuracy for multiple cell types in all of the modalities tested.

Tissue optical clearing and 3D imaging of virus infections

Imaging pathogens within 3D environment of biological tissues provides spatial information about their localization and interactions with the host. Technological advances in fluorescence microscopy and 3D image analysis now permit visualization and quantification of pathogens directly in large tissue volumes and in great detail. In recent years large volume imaging became an important tool in virology research helping to understand the properties of viruses and the host response to infection. In this chapter we give a review of fluorescence microscopy modalities and tissue optical clearing methods used for large volume tissue imaging. A summary of recent applications for virus research is provided with particular emphasis on studies using light sheet fluorescence microscopy. We describe the challenges and approaches for volumetric image analysis. Practical examples of volumetric imaging implemented in virology laboratories and addressing specialized research questions, such as virus tropism and immune host response are described. We conclude with an overview of the emerging technologies and their potential for virus research.

Localization and Registration of 2D Histological Mouse Brain Images in 3D Atlas Space

To accurately explore the anatomical organization of neural circuits in the brain, it is crucial to map the experimental brain data onto a standardized system of coordinates. Studying 2D histological mouse brain slices remains the standard procedure in many laboratories. Mapping these 2D brain slices is challenging; due to deformations, artifacts, and tilted angles introduced during the standard preparation and slicing process. In addition, analysis of experimental mouse brain slices can be highly dependent on the level of expertise of the human operator. Here we propose a computational tool for Accurate Mouse Brain Image Analysis (AMBIA), to map 2D mouse brain slices on the 3D brain model with minimal human intervention. AMBIA has a modular design that comprises a localization module and a registration module. The localization module is a deep learning-based pipeline that localizes a single 2D slice in the 3D Allen Brain Atlas and generates a corresponding atlas plane. The registration module is built upon the Ardent python package that performs deformable 2D registration between the brain slice to its corresponding atlas. By comparing AMBIA's performance in localization and registration to human ratings, we demonstrate that it performs at a human expert level. AMBIA provides an intuitive and highly efficient way for accurate registration of experimental 2D mouse brain images to 3D digital mouse brain atlas. Our tool provides a graphical user interface and it is designed to be used by researchers with minimal programming knowledge.

Normal vibration distribution search-based differential evolution algorithm for multimodal biomedical image registration

In linear registration, a floating image is spatially aligned with a reference image after performing a series of linear metric transformations. Additionally, linear registration is mainly considered a preprocessing version of nonrigid registration. To better accomplish the task of finding the optimal transformation in pairwise intensity-based medical image registration, in this work, we present an optimization algorithm called the normal vibration distribution search-based differential evolution algorithm (NVSA), which is modified from the Bernstein search-based differential evolution (BSD) algorithm. We redesign the search pattern of the BSD algorithm and import several control parameters as part of the fine-tuning process to reduce the difficulty of the algorithm. In this study, 23 classic optimization functions and 16 real-world patients (resulting in 41 multimodal registration scenarios) are used in experiments performed to statistically investigate the problem solving ability of the NVSA. Nine metaheuristic algorithms are used in the conducted experiments. When compared to the commonly utilized registration methods, such as ANTS, Elastix, and FSL, our method achieves better registration performance on the RIRE dataset. Moreover, we prove that our method can perform well with or without its initial spatial transformation in terms of different evaluation indicators, demonstrating its versatility and robustness for various clinical needs and applications. This study establishes the idea that metaheuristic-based methods can better accomplish linear registration tasks than the frequently used approaches; the proposed method demonstrates promise that it can solve real-world clinical and service problems encountered during nonrigid registration as a preprocessing approach.The source code of the NVSA is publicly available at https://github.com/PengGui-N/NVSA.

Cell-type-specific densities in mouse somatosensory cortex derived from scRNA-seq and in situ RNA hybridization

Cells in the mammalian cerebral cortex exhibit layer-dependent patterns in their distribution. Classical methods of determining cell type distributions typically employ a painstaking process of large-scale sampling and characterization of cellular composition. We found that by combining in situ hybridization (ISH) images with cell-type-specific transcriptomes, position-dependent cortical composition in P56 mouse could be estimated in the somatosensory cortex. The method uses ISH images from the Allen Institute for Brain Science. There are two novel aspects of the methodology. First, it is not necessary to select a subset of genes that are particular for a cell type of interest, nor is it necessary to only use ISH images with low variability among samples. Second, the method also compensated for differences in soma size and incompleteness of the transcriptomes. The soma size compensation is particularly important in order to obtain quantitative estimates since relying on bulk expression alone would overestimate the contribution of larger cells. Predicted distributions of broader classes of cell types agreed with literature distributions. The primary result is that there is a high degree of substructure in the distribution of transcriptomic types beyond the resolution of layers. Furthermore, transcriptomic cell types each exhibited characteristic soma size distributions. Results suggest that the method could also be employed to assign transcriptomic cell types to well-aligned image sets in the entire brain.

Anatomical Evidence for Parasympathetic Innervation of the Renal Vasculature and Pelvis

BACKGROUND

The kidneys critically contribute to body homeostasis under the control of the autonomic nerves, which enter the kidney along the renal vasculature. Although the renal sympathetic and sensory nerves have long been confirmed, no significant anatomic evidence exists for renal parasympathetic innervation.

METHODS

We identified cholinergic nerve varicosities associated with the renal vasculature and pelvis using various anatomic research methods, including a genetically modified mouse model and immunostaining. Single-cell RNA sequencing (scRNA-Seq) was used to analyze the expression of AChRs in the renal artery and its segmental branches. To assess the origins of parasympathetic projecting nerves of the kidney, we performed retrograde tracing using recombinant adeno-associated virus (AAV) and pseudorabies virus (PRV), followed by imaging of whole brains, spinal cords, and ganglia.

RESULTS

We found that cholinergic axons supply the main renal artery, segmental renal artery, and renal pelvis. On the renal artery, the newly discovered cholinergic nerve fibers are separated not only from the sympathetic nerves but also from the sensory nerves. We also found cholinergic ganglion cells within the renal nerve plexus. Moreover, the scRNA-Seq analysis suggested that acetylcholine receptors (AChRs) are expressed in the renal artery and its segmental branches. In addition, retrograde tracing suggested vagus afferents conduct the renal sensory pathway to the nucleus of the solitary tract (NTS), and vagus efferents project to the kidney.

CONCLUSIONS

Cholinergic nerves supply renal vasculature and renal pelvis, and a vagal brain-kidney axis is involved in renal innervation.

Progressive 3D biomedical image registration network based on deep self-calibration

Three dimensional deformable image registration (DIR) is a key enabling technique in building digital neuronal atlases of the brain, which can model the local non-linear deformation between a pair of biomedical images and align the anatomical structures of different samples into one spatial coordinate system. And thus, the DIR is always conducted following a preprocessing of global linear registration to remove the large global deformations. However, imperfect preprocessing may leave some large non-linear deformations that cannot be handled well by existing DIR methods. The recently proposed cascaded registration network gives a primary solution to deal with such large non-linear deformations, but still suffers from loss of image details caused by continuous interpolation (information loss problem). In this article, a progressive image registration strategy based on deep self-calibration is proposed to deal with the large non-linear deformations without causing information loss and introducing additional parameters. More importantly, we also propose a novel hierarchical registration strategy to quickly achieve accurate multi-scale progressive registration. In addition, our method can implicitly and reasonably implement dynamic dataset augmentation. We have evaluated the proposed method on both optical and MRI image datasets with obtaining promising results, which demonstrate the superior performance of the proposed method over several other state-of-the-art approaches for deformable image registration.

Mouse embryo phenotyping using X-ray microCT

Microscopic X-ray computed tomography (microCT) is a structural ex vivo imaging technique providing genuine isotropic 3D images from biological samples at micron resolution. MicroCT imaging is non-destructive and combines well with other modalities such as light and electron microscopy in correlative imaging workflows. Protocols for staining embryos with X-ray dense contrast agents enable the acquisition of high-contrast and high-resolution datasets of whole embryos and specific organ systems. High sample throughput is achieved with dedicated setups. Consequently, microCT has gained enormous importance for both qualitative and quantitative phenotyping of mouse development. We here summarize state-of-the-art protocols of sample preparation and imaging procedures, showcase contemporary applications, and discuss possible pitfalls and sources for artefacts. In addition, we give an outlook on phenotyping workflows using microscopic dual energy CT (microDECT) and tissue-specific contrast agents.

TISSUE CLEARING

Tissue clearing of gross anatomical samples was first described over a century ago and has only recently found widespread use in the field of microscopy. This renaissance has been driven by the application of modern knowledge of optical physics and chemical engineering to the development of robust and reproducible clearing techniques, the arrival of new microscopes that can image large samples at cellular resolution and computing infrastructure able to store and analyze large data volumes. Many biological relationships between structure and function require investigation in three dimensions and tissue clearing therefore has the potential to enable broad discoveries in the biological sciences. Unfortunately, the current literature is complex and could confuse researchers looking to begin a clearing project. The goal of this Primer is to outline a modular approach to tissue clearing that allows a novice researcher to develop a customized clearing pipeline tailored to their tissue of interest. Further, the Primer outlines the required imaging and computational infrastructure needed to perform tissue clearing at scale, gives an overview of current applications, discusses limitations and provides an outlook on future advances in the field.

Tissue clearing and 3D imaging in developmental biology

Tissue clearing increases the transparency of late developmental stages and enables deep imaging in fixed organisms. Successful implementation of these methodologies requires a good grasp of sample processing, imaging and the possibilities offered by image analysis. In this Primer, we highlight how tissue clearing can revolutionize the histological analysis of developmental processes and we advise on how to implement effective clearing protocols, imaging strategies and analysis methods for developmental biology.

Automatic Segmentation and Cardiac Mechanics Analysis of Evolving Zebrafish Using Deep Learning

Background: In the study of early cardiac development, it is essential to acquire accurate volume changes of the heart chambers. Although advanced imaging techniques, such as light-sheet fluorescent microscopy (LSFM), provide an accurate procedure for analyzing the heart structure, rapid, and robust segmentation is required to reduce laborious time and accurately quantify developmental cardiac mechanics. Methods: The traditional biomedical analysis involving segmentation of the intracardiac volume occurs manually, presenting bottlenecks due to enormous data volume at high axial resolution. Our advanced deep-learning techniques provide a robust method to segment the volume within a few minutes. Our U-net-based segmentation adopted manually segmented intracardiac volume changes as training data and automatically produced the other LSFM zebrafish cardiac motion images. Results: Three cardiac cycles from 2 to 5 days postfertilization (dpf) were successfully segmented by our U-net-based network providing volume changes over time. In addition to understanding each of the two chambers' cardiac function, the ventricle and atrium were separated by 3D erode morphology methods. Therefore, cardiac mechanical properties were measured rapidly and demonstrated incremental volume changes of both chambers separately. Interestingly, stroke volume (SV) remains similar in the atrium while that of the ventricle increases SV gradually. Conclusion: Our U-net-based segmentation provides a delicate method to segment the intricate inner volume of the zebrafish heart during development, thus providing an accurate, robust, and efficient algorithm to accelerate cardiac research by bypassing the labor-intensive task as well as improving the consistency in the results.

Three-Dimensional X-ray Imaging of β-Galactosidase Reporter Activity by Micro-CT: Implication for Quantitative Analysis of Gene Expression

Acquisition of detailed anatomical and molecular knowledge from intact biological samples while preserving their native three-dimensional structure is still a challenging issue for imaging studies aiming to unravel a system's functions. Three-dimensional micro-CT X-ray imaging with a high spatial resolution in minimally perturbed naive non-transparent samples has recently gained increased popularity and broad application in biomedical research. Here, we describe a novel X-ray-based methodology for analysis of β-galactosidase (lacZ) reporter-driven gene expression in an intact murine brain ex vivo by micro-CT. The method relies on detection of bromine molecules in the product of the enzymatic β-galactosidase reaction. Enhancement of the X-ray signal is observed specifically in the regions of the murine brain where expression of the lacZ reporter gene is also detected histologically. We performed quantitative analysis of the expression levels of lacZ reporter activity by relative radiodensity estimation of the β-galactosidase/X-gal precipitate in situ. To demonstrate the feasibility of the method, we performed expression analysis of the Tsen54-lacZ reporter gene in the murine brain in a semi-quantitative manner. Human mutations in the Tsen54 gene cause pontocerebellar hypoplasia (PCH), a group of severe neurodegenerative disorders with both mental and motor deficits. Comparing relative levels of Tsen54 gene expression, we demonstrate that the highest Tsen54 expression is observed in anatomical brain substructures important for the normal motor and memory functions in mice.