Cross-modal coherent registration of whole mouse brains

Graph-based cell pattern recognition for merging the multi-modal optical microscopic image of neurons

A deep understanding of neuron structure and function is crucial for elucidating brain mechanisms, diagnosing and treating diseases. Optical microscopy, pivotal in neuroscience, illuminates neuronal shapes, projections, and electrical activities. To explore the projection of specific functional neurons, scientists have been developing optical-based multimodal imaging strategies to simultaneously capture dynamic in vivo signals and static ex vivo structures from the same neuron. However, the original position of neurons is highly susceptible to displacement during ex vivo imaging, presenting a significant challenge for integrating multimodal information at the single-neuron level. This study introduces a graph-model-based approach for cell image matching, facilitating precise and automated pairing of sparsely labeled neurons across different optical microscopic images. It has been shown that utilizing neuron distribution as a matching feature can mitigate modal differences, the high-order graph model can address scale inconsistency, and the nonlinear iteration can resolve discrepancies in neuron density. This strategy was applied to the connectivity study of the mouse visual cortex, performing cell matching between the two-photon calcium image and the HD-fMOST brain-wide anatomical image sets. Experimental results demonstrate 96.67% precision, 85.29% recall rate, and 90.63% F1 Score, comparable to expert technicians. This study builds a bridge between functional and structural imaging, offering crucial technical support for neuron classification and circuitry analysis.

SOLID: minimizing tissue distortion for brain-wide profiling of diverse architectures

Brain-wide profiling of diverse biological components is fundamental for understanding complex brain pathology. Despite the availability in whole-brain imaging, it is still challenging to conduct multiplexed, brain-wide analysis with current tissue clearing techniques. Here, we propose SOLID, a hydrophobic tissue clearing method that can minimize tissue distortion while offering impressive clearing performance. SOLID achieves high-quality imaging of multi-color labeled mouse brain, and the acquired datasets can be effectively registered to the Allen Brain Atlas via commonly-used algorithms. SOLID enables generation of neural and vascular maps within one mouse brain, as well as tracing of specific neural projections labeled with viruses. SOLID also allows cross-channel investigations of β-amyloid plaques and neurovascular lesions in the reconstructed all-in-one panorama, providing quantitative insights into structural interactions at different stages of Alzheimer's disease. Altogether, SOLID provides a robust pipeline for whole-brain mapping, which may widen the utility of tissue clearing techniques in diverse neuroscience research.

Enhancing brain image quality with 3D U-net for stripe removal in light sheet fluorescence microscopy

Light Sheet Fluorescence Microscopy (LSFM) is increasingly popular in neuroimaging for its ability to capture high-resolution 3D neural data. However, the presence of stripe noise significantly degrades image quality, particularly in complex 3D stripes with varying widths and brightness, posing challenges in neuroscience research. Existing stripe removal algorithms excel in suppressing noise and preserving details in 2D images with simple stripes but struggle with the complexity of 3D stripes. To address this, we propose a novel 3D U-net model for Stripe Removal in Light sheet fluorescence microscopy (USRL). This approach directly learns and removes stripes in 3D space across different scales, employing a dual-resolution strategy to effectively handle stripes of varying complexities. Additionally, we integrate a nonlinear mapping technique to normalize high dynamic range and unevenly distributed data before applying the stripe removal algorithm. We validate our method on diverse datasets, demonstrating substantial improvements in peak signal-to-noise ratio (PSNR) compared to existing algorithms. Moreover, our algorithm exhibits robust performance when applied to real LSFM data. Through extensive validation experiments, both on test sets and real-world data, our approach outperforms traditional methods, affirming its effectiveness in enhancing image quality. Furthermore, the adaptability of our algorithm extends beyond LSFM applications to encompass other imaging modalities. This versatility underscores its potential to enhance image usability across various research disciplines.

Collaborative augmented reconstruction of 3D neuron morphology in mouse and human brains

Digital reconstruction of the intricate 3D morphology of individual neurons from microscopic images is a crucial challenge in both individual laboratories and large-scale projects focusing on cell types and brain anatomy. This task often fails in both conventional manual reconstruction and state-of-the-art artificial intelligence (AI)-based automatic reconstruction algorithms. It is also challenging to organize multiple neuroanatomists to generate and cross-validate biologically relevant and mutually agreed upon reconstructions in large-scale data production. Based on collaborative group intelligence augmented by AI, we developed a collaborative augmented reconstruction (CAR) platform for neuron reconstruction at scale. This platform allows for immersive interaction and efficient collaborative editing of neuron anatomy using a variety of devices, such as desktop workstations, virtual reality headsets and mobile phones, enabling users to contribute anytime and anywhere and to take advantage of several AI-based automation tools. We tested CAR's applicability for challenging mouse and human neurons toward scaled and faithful data production.

Virtual reality-empowered deep-learning analysis of brain cells

Automated detection of specific cells in three-dimensional datasets such as whole-brain light-sheet image stacks is challenging. Here, we present DELiVR, a virtual reality-trained deep-learning pipeline for detecting c-Fos+ cells as markers for neuronal activity in cleared mouse brains. Virtual reality annotation substantially accelerated training data generation, enabling DELiVR to outperform state-of-the-art cell-segmenting approaches. Our pipeline is available in a user-friendly Docker container that runs with a standalone Fiji plugin. DELiVR features a comprehensive toolkit for data visualization and can be customized to other cell types of interest, as we did here for microglia somata, using Fiji for dataset-specific training. We applied DELiVR to investigate cancer-related brain activity, unveiling an activation pattern that distinguishes weight-stable cancer from cancers associated with weight loss. Overall, DELiVR is a robust deep-learning tool that does not require advanced coding skills to analyze whole-brain imaging data in health and disease.

RDLR: A Robust Deep Learning-Based Image Registration Method for Pediatric Retinal Images

Retinal diseases stand as a primary cause of childhood blindness. Analyzing the progression of these diseases requires close attention to lesion morphology and spatial information. Standard image registration methods fail to accurately reconstruct pediatric fundus images containing significant distortion and blurring. To address this challenge, we proposed a robust deep learning-based image registration method (RDLR). The method consisted of two modules: registration module (RM) and panoramic view module (PVM). RM effectively integrated global and local feature information and learned prior information related to the orientation of images. PVM was capable of reconstructing spatial information in panoramic images. Furthermore, as the registration model was trained on over 280,000 pediatric fundus images, we introduced a registration annotation automatic generation process coupled with a quality control module to ensure the reliability of training data. We compared the performance of RDLR to the other methods, including conventional registration pipeline (CRP), voxel morph (WM), generalizable image matcher (GIM), and self-supervised techniques (SS). RDLR achieved significantly higher registration accuracy (average Dice score of 0.948) than the other methods (ranging from 0.491 to 0.802). The resulting panoramic retinal maps reconstructed by RDLR also demonstrated substantially higher fidelity (average Dice score of 0.960) compared to the other methods (ranging from 0.720 to 0.783). Overall, the proposed method addressed key challenges in pediatric retinal imaging, providing an effective solution to enhance disease diagnosis. Our source code is available at https://github.com/wuwusky/RobustDeepLeraningRegistration .

Connecto-informatics at the mesoscale: current advances in image processing and analysis for mapping the brain connectivity

Mapping neural connections within the brain has been a fundamental goal in neuroscience to understand better its functions and changes that follow aging and diseases. Developments in imaging technology, such as microscopy and labeling tools, have allowed researchers to visualize this connectivity through high-resolution brain-wide imaging. With this, image processing and analysis have become more crucial. However, despite the wealth of neural images generated, access to an integrated image processing and analysis pipeline to process these data is challenging due to scattered information on available tools and methods. To map the neural connections, registration to atlases and feature extraction through segmentation and signal detection are necessary. In this review, our goal is to provide an updated overview of recent advances in these image-processing methods, with a particular focus on fluorescent images of the mouse brain. Our goal is to outline a pathway toward an integrated image-processing pipeline tailored for connecto-informatics. An integrated workflow of these image processing will facilitate researchers' approach to mapping brain connectivity to better understand complex brain networks and their underlying brain functions. By highlighting the image-processing tools available for fluroscent imaging of the mouse brain, this review will contribute to a deeper grasp of connecto-informatics, paving the way for better comprehension of brain connectivity and its implications.

The cytoarchitectonic landscape revealed by deep learning method facilitated precise positioning in mouse neocortex

Neocortex is a complex structure with different cortical sublayers and regions. However, the precise positioning of cortical regions can be challenging due to the absence of distinct landmarks without special preparation. To address this challenge, we developed a cytoarchitectonic landmark identification pipeline. The fluorescence micro-optical sectioning tomography method was employed to image the whole mouse brain stained by general fluorescent nucleotide dye. A fast 3D convolution network was subsequently utilized to segment neuronal somas in entire neocortex. By approach, the cortical cytoarchitectonic profile and the neuronal morphology were analyzed in 3D, eliminating the influence of section angle. And the distribution maps were generated that visualized the number of neurons across diverse morphological types, revealing the cytoarchitectonic landscape which characterizes the landmarks of cortical regions, especially the typical signal pattern of barrel cortex. Furthermore, the cortical regions of various ages were aligned using the generated cytoarchitectonic landmarks suggesting the structural changes of barrel cortex during the aging process. Moreover, we observed the spatiotemporally gradient distributions of spindly neurons, concentrated in the deep layer of primary visual area, with their proportion decreased over time. These findings could improve structural understanding of neocortex, paving the way for further exploration with this method.

Photoacoustic Tomography with Temporal Encoding Reconstruction (PATTERN) for cross-modal individual analysis of the whole brain

Cross-modal analysis of the same whole brain is an ideal strategy to uncover brain function and dysfunction. However, it remains challenging due to the slow speed and destructiveness of traditional whole-brain optical imaging techniques. Here we develop a new platform, termed Photoacoustic Tomography with Temporal Encoding Reconstruction (PATTERN), for non-destructive, high-speed, 3D imaging of ex vivo rodent, ferret, and non-human primate brains. Using an optimally designed image acquisition scheme and an accompanying machine-learning algorithm, PATTERN extracts signals of genetically-encoded probes from photobleaching-based temporal modulation and enables reliable visualization of neural projection in the whole central nervous system with 3D isotropic resolution. Without structural and biological perturbation to the sample, PATTERN can be combined with other whole-brain imaging modalities to acquire the whole-brain image with both high resolution and morphological fidelity. Furthermore, cross-modal transcriptome analysis of an individual brain is achieved by PATTERN imaging. Together, PATTERN provides a compatible and versatile strategy for brain-wide cross-modal analysis at the individual level.

An Open Resource: MR and light sheet microscopy stereotaxic atlas of the mouse brain

We have combined MR histology and light sheet microscopy (LSM) of five postmortem C57BL/6J mouse brains in a stereotaxic space based on micro-CT yielding a multimodal 3D atlas with the highest spatial and contrast resolution yet reported. Brains were imaged in situ with multi gradient echo (mGRE) and diffusion tensor imaging (DTI) at 15 μm resolution (∼ 2.4 million times that of clinical MRI). Scalar images derived from the average DTI and mGRE provide unprecedented contrast in 14 complementary 3D volumes, each highlighting distinct histologic features. The same tissues scanned with LSM and registered into the stereotaxic space provide 17 different molecular cell type stains. The common coordinate framework labels (CCFv3) complete the multimodal atlas. The atlas has been used to correct distortions in the Allen Brain Atlas and harmonize it with Franklin Paxinos. It provides a unique resource for stereotaxic labeling of mouse brain images from many sources.

An MR-based brain template and atlas for optical projection tomography and light sheet fluorescence microscopy in neuroscience

Introduction

Optical Projection Tomography (OPT) and light sheet fluorescence microscopy (LSFM) are high resolution optical imaging techniques, ideally suited for ex vivo 3D whole mouse brain imaging. Although they exhibit high specificity for their targets, the anatomical detail provided by tissue autofluorescence remains limited.

Methods

T1-weighted images were acquired from 19 BABB or DBE cleared brains to create an MR template using serial longitudinal registration. Afterwards, fluorescent OPT and LSFM images were coregistered/normalized to the MR template to create fusion images.

Results

Volumetric calculations revealed a significant difference between BABB and DBE cleared brains, leading to develop two optimized templates, with associated tissue priors and brain atlas, for BABB (OCUM) and DBE (iOCUM). By creating fusion images, we identified virus infected brain regions, mapped dopamine transporter and translocator protein expression, and traced innervation from the eye along the optic tract to the thalamus and superior colliculus using cholera toxin B. Fusion images allowed for precise anatomical identification of fluorescent signal in the detailed anatomical context provided by MR.

Discussion

The possibility to anatomically map fluorescent signals on magnetic resonance (MR) images, widely used in clinical and preclinical neuroscience, would greatly benefit applications of optical imaging of mouse brain. These specific MR templates for cleared brains enable a broad range of neuroscientific applications integrating 3D optical brain imaging.

Non-homogenous axonal bouton distribution in whole-brain single-cell neuronal networks

We examined the distribution of pre-synaptic contacts in axons of mouse neurons and constructed whole-brain single-cell neuronal networks using an extensive dataset of 1,891 fully reconstructed neurons. We found that bouton locations were not homogeneous throughout the axon and among brain regions. As our algorithm was able to generate whole-brain single-cell connectivity matrices from full morphology reconstruction datasets, we further found that non-homogeneous bouton locations have a significant impact on network wiring, including degree distribution, triad census, and community structure. By perturbing neuronal morphology, we further explored the link between anatomical details and network topology. In our in silico exploration, we found that dendritic and axonal tree span would have the greatest impact on network wiring, followed by synaptic contact deletion. Our results suggest that neuroanatomical details must be carefully addressed in studies of whole-brain networks at the single-cell level.

A deep learning classification task for brain navigation in rodents using micro-Doppler ultrasound imaging

Positioning and navigation are essential components of neuroimaging as they improve the quality and reliability of data acquisition, leading to advances in diagnosis, treatment outcomes, and fundamental understanding of the brain. Functional ultrasound imaging is an emerging technology providing high-resolution images of the brain vasculature, allowing for the monitoring of brain activity. However, as the technology is relatively new, there is no standardized tool for inferring the position in the brain from the vascular images. In this study, we present a deep learning-based framework designed to address this challenge. Our approach uses an image classification task coupled with a regression on the resulting probabilities to determine the position of a single image. To evaluate its performance, we conducted experiments using a dataset of 51 rat brain scans. The training positions were extracted at intervals of 375 μm, resulting in a positioning error of 176 μm. Further GradCAM analysis revealed that the predictions were primarily driven by subcortical vascular structures. Finally, we assessed the robustness of our method in a cortical stroke where the brain vasculature is severely impaired. Remarkably, no specific increase in the number of misclassifications was observed, confirming the method's reliability in challenging conditions. Overall, our framework provides accurate and flexible positioning, not relying on a pre-registered reference but rather on conserved vascular patterns.

Meet the authors: Hanchuan Peng, Peng Xie, and Feng Xiong

In a recent paper at Patterns, Hanchuan Peng, Peng Xie, and Feng Xiong from Southeast University describe a deep learning method to characterize complete single-neuron morphologies, which can discover neuron projection patterns of diverse cells and learn neuronal morphology representation. In this interview, the authors shared the story behind the paper and their research experience. This interview is a companion to these authors' recent paper, "DSM: Deep sequential model for complete neuronal morphology representation and feature extraction."1.

DSM: Deep sequential model for complete neuronal morphology representation and feature extraction

The full morphology of single neurons is indispensable for understanding cell types, the basic building blocks in brains. Projecting trajectories are critical to extracting biologically relevant information from neuron morphologies, as they provide valuable information for both connectivity and cell identity. We developed an artificial intelligence method, deep sequential model (DSM), to extract concise, cell-type-defining features from projections across brain regions. DSM achieves more than 90% accuracy in classifying 12 major neuron projection types without compromising performance when spatial noise is present. Such remarkable robustness enabled us to efficiently manage and analyze several major full-morphology data sources, showcasing how characteristic long projections can define cell identities. We also succeeded in applying our model to both discovering previously unknown neuron subtypes and analyzing exceptional co-expressed genes involved in neuron projection circuits.

Preserving Derivative Information while Transforming Neuronal Curves

The international neuroscience community is building the first comprehensive atlases of brain cell types to understand how the brain functions from a higher resolution, and more integrated perspective than ever before. In order to build these atlases, subsets of neurons (e.g. serotonergic neurons, prefrontal cortical neurons etc.) are traced in individual brain samples by placing points along dendrites and axons. Then, the traces are mapped to common coordinate systems by transforming the positions of their points, which neglects how the transformation bends the line segments in between. In this work, we apply the theory of jets to describe how to preserve derivatives of neuron traces up to any order. We provide a framework to compute possible error introduced by standard mapping methods, which involves the Jacobian of the mapping transformation. We show how our first order method improves mapping accuracy in both simulated and real neuron traces under random diffeomorphisms. Our method is freely available in our open-source Python package brainlit.

An interactive image segmentation method for the anatomical structures of the main olfactory bulb with micro-level resolution

The main olfactory bulb is the key element of the olfactory pathway of rodents. To precisely dissect the neural pathway in the main olfactory bulb (MOB), it is necessary to construct the three-dimensional morphologies of the anatomical structures within it with micro-level resolution. However, the construction remains challenging due to the complicated shape of the anatomical structures in the main olfactory bulb and the high resolution of micro-optical images. To address these issues, we propose an interactive volume image segmentation method with micro-level resolution in the horizontal and axial direction. Firstly, we obtain the initial location of the anatomical structures by manual annotation and design a patch-based neural network to learn the complex texture feature of the anatomical structures. Then we randomly sample some patches to predict by the trained network and perform an annotation reconstruction based on intensity calculation to get the final location results of the anatomical structures. Our experiments were conducted using Nissl-stained brain images acquired by the Micro-optical sectioning tomography (MOST) system. Our method achieved a mean dice similarity coefficient (DSC) of 81.8% and obtain the best segmentation performance. At the same time, the experiment shows the three-dimensional morphology reconstruction results of the anatomical structures in the main olfactory bulb are smooth and consistent with their natural shapes, which addresses the possibility of constructing three-dimensional morphologies of the anatomical structures in the whole brain.

Whole-brain Optical Imaging: A Powerful Tool for Precise Brain Mapping at the Mesoscopic Level

The mammalian brain is a highly complex network that consists of millions to billions of densely-interconnected neurons. Precise dissection of neural circuits at the mesoscopic level can provide important structural information for understanding the brain. Optical approaches can achieve submicron lateral resolution and achieve "optical sectioning" by a variety of means, which has the natural advantage of allowing the observation of neural circuits at the mesoscopic level. Automated whole-brain optical imaging methods based on tissue clearing or histological sectioning surpass the limitation of optical imaging depth in biological tissues and can provide delicate structural information in a large volume of tissues. Combined with various fluorescent labeling techniques, whole-brain optical imaging methods have shown great potential in the brain-wide quantitative profiling of cells, circuits, and blood vessels. In this review, we summarize the principles and implementations of various whole-brain optical imaging methods and provide some concepts regarding their future development.

Waxholm Space atlas of the rat brain: a 3D atlas supporting data analysis and integration

Volumetric brain atlases are increasingly used to integrate and analyze diverse experimental neuroscience data acquired from animal models, but until recently a publicly available digital atlas with complete coverage of the rat brain has been missing. Here we present an update of the Waxholm Space rat brain atlas, a comprehensive open-access volumetric atlas resource. This brain atlas features annotations of 222 structures, of which 112 are new and 57 revised compared to previous versions. It provides a detailed map of the cerebral cortex, hippocampal region, striatopallidal areas, midbrain dopaminergic system, thalamic cell groups, the auditory system and main fiber tracts. We document the criteria underlying the annotations and demonstrate how the atlas with related tools and workflows can be used to support interpretation, integration, analysis and dissemination of experimental rat brain data.

D-LMBmap: a fully automated deep-learning pipeline for whole-brain profiling of neural circuitry

Recent proliferation and integration of tissue-clearing methods and light-sheet fluorescence microscopy has created new opportunities to achieve mesoscale three-dimensional whole-brain connectivity mapping with exceptionally high throughput. With the rapid generation of large, high-quality imaging datasets, downstream analysis is becoming the major technical bottleneck for mesoscale connectomics. Current computational solutions are labor intensive with limited applications because of the exhaustive manual annotation and heavily customized training. Meanwhile, whole-brain data analysis always requires combining multiple packages and secondary development by users. To address these challenges, we developed D-LMBmap, an end-to-end package providing an integrated workflow containing three modules based on deep-learning algorithms for whole-brain connectivity mapping: axon segmentation, brain region segmentation and whole-brain registration. D-LMBmap does not require manual annotation for axon segmentation and achieves quantitative analysis of whole-brain projectome in a single workflow with superior accuracy for multiple cell types in all of the modalities tested.

Developmental Mouse Brain Common Coordinate Framework

3D standard reference brains serve as key resources to understand the spatial organization of the brain and promote interoperability across different studies. However, unlike the adult mouse brain, the lack of standard 3D reference atlases for developing mouse brains has hindered advancement of our understanding of brain development. Here, we present a multimodal 3D developmental common coordinate framework (DevCCF) spanning mouse embryonic day (E) 11.5, E13.5, E15.5, E18.5, and postnatal day (P) 4, P14, and P56 with anatomical segmentations defined by a developmental ontology. At each age, the DevCCF features undistorted morphologically averaged atlas templates created from Magnetic Resonance Imaging and co-registered high-resolution templates from light sheet fluorescence microscopy. Expert-curated 3D anatomical segmentations at each age adhere to an updated prosomeric model and can be explored via an interactive 3D web-visualizer. As a use case, we employed the DevCCF to unveil the emergence of GABAergic neurons in embryonic brains. Moreover, we integrated the Allen CCFv3 into the P56 template with stereotaxic coordinates and mapped spatial transcriptome cell-type data with the developmental ontology. In summary, the DevCCF is an openly accessible resource that can be used for large-scale data integration to gain a comprehensive understanding of brain development.

Localization and Registration of 2D Histological Mouse Brain Images in 3D Atlas Space

To accurately explore the anatomical organization of neural circuits in the brain, it is crucial to map the experimental brain data onto a standardized system of coordinates. Studying 2D histological mouse brain slices remains the standard procedure in many laboratories. Mapping these 2D brain slices is challenging; due to deformations, artifacts, and tilted angles introduced during the standard preparation and slicing process. In addition, analysis of experimental mouse brain slices can be highly dependent on the level of expertise of the human operator. Here we propose a computational tool for Accurate Mouse Brain Image Analysis (AMBIA), to map 2D mouse brain slices on the 3D brain model with minimal human intervention. AMBIA has a modular design that comprises a localization module and a registration module. The localization module is a deep learning-based pipeline that localizes a single 2D slice in the 3D Allen Brain Atlas and generates a corresponding atlas plane. The registration module is built upon the Ardent python package that performs deformable 2D registration between the brain slice to its corresponding atlas. By comparing AMBIA's performance in localization and registration to human ratings, we demonstrate that it performs at a human expert level. AMBIA provides an intuitive and highly efficient way for accurate registration of experimental 2D mouse brain images to 3D digital mouse brain atlas. Our tool provides a graphical user interface and it is designed to be used by researchers with minimal programming knowledge.

Uncovering CNS access of lipidated exendin-4 analogues by quantitative whole-brain 3D light sheet imaging

Peptide-based drug development for CNS disorders is challenged by poor blood-brain barrier (BBB) penetrability of peptides. While acylation protractions (lipidation) have been successfully applied to increase circulating half-life of therapeutic peptides, little is known about the CNS accessibility of lipidated peptide drugs. Light-sheet fluorescence microscopy (LSFM) has emerged as a powerful method to visualize whole-brain 3D distribution of fluorescently labelled therapeutic peptides at single-cell resolution. Here, we applied LSFM to map CNS distribution of the clinically relevant GLP-1 receptor agonist (GLP-1RA) exendin-4 (Ex4) and lipidated analogues following peripheral administration. Mice received an intravenous dose (100 nmol/kg) of IR800 fluorophore-labelled Ex4 (Ex4), Ex4 acylated with a C16-monoacid (Ex4_C16MA) or C18-diacid (Ex4_C18DA). Other mice were administered C16MA-acylated exendin 9-39 (Ex9-39_C16MA), a selective GLP-1R antagonist, serving as negative control for GLP-1R mediated agonist internalization. Two hours post-dosing, brain distribution of Ex4 and analogues was predominantly restricted to the circumventricular organs, notably area postrema and nucleus of the solitary tract. Ex4_C16MA and Ex9-39_C16MA also distributed to the paraventricular hypothalamic nucleus and medial habenula. Notably, Ex4_C18DA was detected in deeper-lying brain structures such as dorsomedial/ventromedial hypothalamic nuclei and the dentate gyrus. Similar CNS distribution maps of Ex4-C16MA and Ex9-39_C16MA suggest that brain access of lipidated Ex4 analogues is independent on GLP-1 receptor internalization. The cerebrovasculature was devoid of specific labelling, hence not supporting a direct role of GLP-1 RAs in BBB function. In conclusion, peptide lipidation increases CNS accessibility of Ex4. Our fully automated LSFM pipeline is suitable for mapping whole-brain distribution of fluorescently labelled drugs.

A guide to the BRAIN Initiative Cell Census Network data ecosystem

Characterizing cellular diversity at different levels of biological organization and across data modalities is a prerequisite to understanding the function of cell types in the brain. Classification of neurons is also essential to manipulate cell types in controlled ways and to understand their variation and vulnerability in brain disorders. The BRAIN Initiative Cell Census Network (BICCN) is an integrated network of data-generating centers, data archives, and data standards developers, with the goal of systematic multimodal brain cell type profiling and characterization. Emphasis of the BICCN is on the whole mouse brain with demonstration of prototype feasibility for human and nonhuman primate (NHP) brains. Here, we provide a guide to the cellular and spatial approaches employed by the BICCN, and to accessing and using these data and extensive resources, including the BRAIN Cell Data Center (BCDC), which serves to manage and integrate data across the ecosystem. We illustrate the power of the BICCN data ecosystem through vignettes highlighting several BICCN analysis and visualization tools. Finally, we present emerging standards that have been developed or adopted toward Findable, Accessible, Interoperable, and Reusable (FAIR) neuroscience. The combined BICCN ecosystem provides a comprehensive resource for the exploration and analysis of cell types in the brain.

An anatomical and connectivity atlas of the marmoset cerebellum

The cerebellum is essential for motor control and cognitive functioning, engaging in bidirectional communication with the cerebral cortex. The common marmoset, a small non-human primate, offers unique advantages for studying cerebello-cerebral circuits. However, the marmoset cerebellum is not well described in published resources. In this study, we present a comprehensive atlas of the marmoset cerebellum comprising (1) fine-detailed anatomical atlases and surface-analysis tools of the cerebellar cortex based on ultra-high-resolution ex vivo MRI, (2) functional connectivity and gradient patterns of the cerebellar cortex revealed by awake resting-state fMRI, and (3) structural-connectivity mapping of cerebellar nuclei using high-resolution diffusion MRI tractography. The atlas elucidates the anatomical details of the marmoset cerebellum, reveals distinct gradient patterns of intra-cerebellar and cerebello-cerebral functional connectivity, and maps the topological relationship of cerebellar nuclei in cerebello-cerebral circuits. As version 5 of the Marmoset Brain Mapping project, this atlas is publicly available at https://marmosetbrainmapping.org/MBMv5.html.

Merged magnetic resonance and light sheet microscopy of the whole mouse brain

We have developed workflows to align 3D magnetic resonance histology (MRH) of the mouse brain with light sheet microscopy (LSM) and 3D delineations of the same specimen. We start with MRH of the brain in the skull with gradient echo and diffusion tensor imaging (DTI) at 15 μm isotropic resolution which is ~ 1,000 times higher than that of most preclinical MRI. Connectomes are generated with superresolution tract density images of ~5 μm. Brains are cleared, stained for selected proteins, and imaged by LSM at 1.8 μm/pixel. LSM data are registered into the reference MRH space with labels derived from the ABA common coordinate framework. The result is a high-dimensional integrated volume with registration (HiDiver) with alignment precision better than 50 µm. Throughput is sufficiently high that HiDiver is being used in quantitative studies of the impact of gene variants and aging on mouse brain cytoarchitecture and connectomics.

CRYAA and GJA8 promote visual development after whisker tactile deprivation

Deprivation of one sense can be followed by enhanced development of other senses via cross-modal plasticity mechanisms. To study the effect of whisker tactile deprivation on vision during the early stages of development, we clipped the bilateral whiskers of young mice and found that their vision was impaired but later recovered to normal levels. Our results demonstrate that inhibition of the PI3K/AKT/ERK signaling pathway caused short-term visual impairment during early development, while high expression levels of Crystallin Alpha A (CRYAA) and Gap Junction Protein Alpha 8 (GJA8) in the retina led to the recovery of developmental visual acuity. Interestingly, analysis of single-cell sequencing results from human embryonic retinas at 9-19 gestational weeks (GW) revealed that CRYAA and GJA8 display stage-specific peak expression during human embryonic retinal development, suggesting potential functions in visual development. Our data show that high expression levels of CRYAA and GJA8 in the retina after whisker deprivation rescue impaired visual development, which may provide a foundation for further research on the mechanisms of cross-modal plasticity and in particular, offer new insights into the mechanisms underlying tactile-visual cross-modal development.

Multimodal 3D Mouse Brain Atlas Framework with the Skull-Derived Coordinate System

Magnetic resonance imaging (MRI) and light-sheet fluorescence microscopy (LSFM) are technologies that enable non-disruptive 3-dimensional imaging of whole mouse brains. A combination of complementary information from both modalities is desirable for studying neuroscience in general, disease progression and drug efficacy. Although both technologies rely on atlas mapping for quantitative analyses, the translation of LSFM recorded data to MRI templates has been complicated by the morphological changes inflicted by tissue clearing and the enormous size of the raw data sets. Consequently, there is an unmet need for tools that will facilitate fast and accurate translation of LSFM recorded brains to in vivo, non-distorted templates. In this study, we have developed a bidirectional multimodal atlas framework that includes brain templates based on both imaging modalities, region delineations from the Allen's Common Coordinate Framework, and a skull-derived stereotaxic coordinate system. The framework also provides algorithms for bidirectional transformation of results obtained using either MR or LSFM (iDISCO cleared) mouse brain imaging while the coordinate system enables users to easily assign in vivo coordinates across the different brain templates.

Review of Generative Adversarial Networks in mono- and cross-modal biomedical image registration

Biomedical image registration refers to aligning corresponding anatomical structures among different images, which is critical to many tasks, such as brain atlas building, tumor growth monitoring, and image fusion-based medical diagnosis. However, high-throughput biomedical image registration remains challenging due to inherent variations in the intensity, texture, and anatomy resulting from different imaging modalities, different sample preparation methods, or different developmental stages of the imaged subject. Recently, Generative Adversarial Networks (GAN) have attracted increasing interest in both mono- and cross-modal biomedical image registrations due to their special ability to eliminate the modal variance and their adversarial training strategy. This paper provides a comprehensive survey of the GAN-based mono- and cross-modal biomedical image registration methods. According to the different implementation strategies, we organize the GAN-based mono- and cross-modal biomedical image registration methods into four categories: modality translation, symmetric learning, adversarial strategies, and joint training. The key concepts, the main contributions, and the advantages and disadvantages of the different strategies are summarized and discussed. Finally, we analyze the statistics of all the cited works from different points of view and reveal future trends for GAN-based biomedical image registration studies.

mBrainAligner-Web: a web server for cross-modal coherent registration of whole mouse brains

SUMMARY

Recent whole-brain mapping projects are collecting increasingly larger sets of high-resolution brain images using a variety of imaging, labeling and sample preparation techniques. Both mining and analysis of these data require reliable and robust cross-modal registration tools. We recently developed the mBrainAligner, a pipeline for performing cross-modal registration of the whole mouse brain. However, using this tool requires scripting or command-line skills to assemble and configure the different modules of mBrainAligner for accommodating different registration requirements and platform settings. In this application note, we present mBrainAligner-Web, a web server with a user-friendly interface that allows to configure and run mBrainAligner locally or remotely across platforms.

AVAILABILITY AND IMPLEMENTATION

mBrainAligner-Web is available at http://mbrainaligner.ahu.edu.cn/ with source code at https://github.com/reaneyli/mBrainAligner-web.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Fluorescent transgenic mouse models for whole-brain imaging in health and disease

A paradigm shift is occurring in neuroscience and in general in life sciences converting biomedical research from a descriptive discipline into a quantitative, predictive, actionable science. Living systems are becoming amenable to quantitative description, with profound consequences for our ability to predict biological phenomena. New experimental tools such as tissue clearing, whole-brain imaging, and genetic engineering technologies have opened the opportunity to embrace this new paradigm, allowing to extract anatomical features such as cell number, their full morphology, and even their structural connectivity. These tools will also allow the exploration of new features such as their geometrical arrangement, within and across brain regions. This would be especially important to better characterize brain function and pathological alterations in neurological, neurodevelopmental, and neurodegenerative disorders. New animal models for mapping fluorescent protein-expressing neurons and axon pathways in adult mice are key to this aim. As a result of both developments, relevant cell populations with endogenous fluorescence signals can be comprehensively and quantitatively mapped to whole-brain images acquired at submicron resolution. However, they present intrinsic limitations: weak fluorescent signals, unequal signal strength across the same cell type, lack of specificity of fluorescent labels, overlapping signals in cell types with dense labeling, or undetectable signal at distal parts of the neurons, among others. In this review, we discuss the recent advances in the development of fluorescent transgenic mouse models that overcome to some extent the technical and conceptual limitations and tradeoffs between different strategies. We also discuss the potential use of these strains for understanding disease.

FCE-Net: a fast image contrast enhancement method based on deep learning for biomedical optical images

Optical imaging is an important tool for exploring and understanding structures of biological tissues. However, due to the heterogeneity of biological tissues, the intensity distribution of the signal is not uniform and contrast is normally degraded in the raw image. It is difficult to be used for subsequent image analysis and information extraction directly. Here, we propose a fast image contrast enhancement method based on deep learning called Fast Contrast Enhancement Network (FCE-Net). We divided network into dual-path to simultaneously obtain spatial information and large receptive field. And we introduced the spatial attention mechanism to enhance the inter-spatial relationship. We showed that the cell counting task of mouse brain images processed by FCE-Net was with average precision rate of 97.6% ± 1.6%, and average recall rate of 98.4% ± 1.4%. After processing with FCE-Net, the images from vascular extraction (DRIVE) dataset could be segmented with spatial attention U-Net (SA-UNet) to achieve state-of-the-art performance. By comparing FCE-Net with previous methods, we demonstrated that FCE-Net could obtain higher accuracy while maintaining the processing speed. The images with size of 1024 × 1024 pixels could be processed by FCE-Net with 37fps based on our workstation. Our method has great potential for further image analysis and information extraction from large-scale or dynamic biomedical optical images.

Smart imaging to empower brain-wide neuroscience at single-cell levels

A deep understanding of the neuronal connectivity and networks with detailed cell typing across brain regions is necessary to unravel the mechanisms behind the emotional and memorial functions as well as to find the treatment of brain impairment. Brain-wide imaging with single-cell resolution provides unique advantages to access morphological features of a neuron and to investigate the connectivity of neuron networks, which has led to exciting discoveries over the past years based on animal models, such as rodents. Nonetheless, high-throughput systems are in urgent demand to support studies of neural morphologies at larger scale and more detailed level, as well as to enable research on non-human primates (NHP) and human brains. The advances in artificial intelligence (AI) and computational resources bring great opportunity to 'smart' imaging systems, i.e., to automate, speed up, optimize and upgrade the imaging systems with AI and computational strategies. In this light, we review the important computational techniques that can support smart systems in brain-wide imaging at single-cell resolution.