Multimodal image registration and connectivity analysis for integration of connectomic data from microscopy to MRI

descSPIM: an affordable and easy-to-build light-sheet microscope optimized for tissue clearing techniques

Despite widespread adoption of tissue clearing techniques in recent years, poor access to suitable light-sheet fluorescence microscopes remains a major obstacle for biomedical end-users. Here, we present descSPIM (desktop-equipped SPIM for cleared specimens), a low-cost ($20,000-50,000), low-expertise (one-day installation by a non-expert), yet practical do-it-yourself light-sheet microscope as a solution for this bottleneck. Even the most fundamental configuration of descSPIM enables multi-color imaging of whole mouse brains and a cancer cell line-derived xenograft tumor mass for the visualization of neurocircuitry, assessment of drug distribution, and pathological examination by false-colored hematoxylin and eosin staining in a three-dimensional manner. Academically open-sourced ( https://github.com/dbsb-juntendo/descSPIM ), descSPIM allows routine three-dimensional imaging of cleared samples in minutes. Thus, the dissemination of descSPIM will accelerate biomedical discoveries driven by tissue clearing technologies.

Connecto-informatics at the mesoscale: current advances in image processing and analysis for mapping the brain connectivity

Mapping neural connections within the brain has been a fundamental goal in neuroscience to understand better its functions and changes that follow aging and diseases. Developments in imaging technology, such as microscopy and labeling tools, have allowed researchers to visualize this connectivity through high-resolution brain-wide imaging. With this, image processing and analysis have become more crucial. However, despite the wealth of neural images generated, access to an integrated image processing and analysis pipeline to process these data is challenging due to scattered information on available tools and methods. To map the neural connections, registration to atlases and feature extraction through segmentation and signal detection are necessary. In this review, our goal is to provide an updated overview of recent advances in these image-processing methods, with a particular focus on fluorescent images of the mouse brain. Our goal is to outline a pathway toward an integrated image-processing pipeline tailored for connecto-informatics. An integrated workflow of these image processing will facilitate researchers' approach to mapping brain connectivity to better understand complex brain networks and their underlying brain functions. By highlighting the image-processing tools available for fluroscent imaging of the mouse brain, this review will contribute to a deeper grasp of connecto-informatics, paving the way for better comprehension of brain connectivity and its implications.

Automated identification of protein expression intensity and classification of protein cellular locations in mouse brain regions from immunofluorescence images

Knowledge of protein expression in mammalian brains at regional and cellular levels can facilitate understanding of protein functions and associated diseases. As the mouse brain is a typical mammalian brain considering cell type and structure, several studies have been conducted to analyze protein expression in mouse brains. However, labeling protein expression using biotechnology is costly and time-consuming. Therefore, automated models that can accurately recognize protein expression are needed. Here, we constructed machine learning models to automatically annotate the protein expression intensity and cellular location in different mouse brain regions from immunofluorescence images. The brain regions and sub-regions were segmented through learning image features using an autoencoder and then performing K-means clustering and registration to align with the anatomical references. The protein expression intensities for those segmented structures were computed on the basis of the statistics of the image pixels, and patch-based weakly supervised methods and multi-instance learning were used to classify the cellular locations. Results demonstrated that the models achieved high accuracy in the expression intensity estimation, and the F1 score of the cellular location prediction was 74.5%. This work established an automated pipeline for analyzing mouse brain images and provided a foundation for further study of protein expression and functions.

An Open Resource: MR and light sheet microscopy stereotaxic atlas of the mouse brain

We have combined MR histology and light sheet microscopy (LSM) of five postmortem C57BL/6J mouse brains in a stereotaxic space based on micro-CT yielding a multimodal 3D atlas with the highest spatial and contrast resolution yet reported. Brains were imaged in situ with multi gradient echo (mGRE) and diffusion tensor imaging (DTI) at 15 μm resolution (∼ 2.4 million times that of clinical MRI). Scalar images derived from the average DTI and mGRE provide unprecedented contrast in 14 complementary 3D volumes, each highlighting distinct histologic features. The same tissues scanned with LSM and registered into the stereotaxic space provide 17 different molecular cell type stains. The common coordinate framework labels (CCFv3) complete the multimodal atlas. The atlas has been used to correct distortions in the Allen Brain Atlas and harmonize it with Franklin Paxinos. It provides a unique resource for stereotaxic labeling of mouse brain images from many sources.

Development and advancements in rodent MRI-based brain atlases

Rodents, particularly mice and rats, are extensively utilized in fundamental neuroscience research. Brain atlases have played a pivotal role in this field, evolving from traditional printed histology atlases to digital atlases incorporating diverse imaging datasets. Magnetic resonance imaging (MRI)-based brain atlases, also known as brain maps, have been employed in specific studies. However, the existence of numerous versions of MRI-based brain atlases has impeded their standardized application and widespread use, despite the consensus within the academic community regarding their significance in mice and rats. Furthermore, there is a dearth of comprehensive and systematic reviews on MRI-based brain atlases for rodents. This review aims to bridge this gap by providing a comprehensive overview of the advancements in MRI-based brain atlases for rodents, with a specific focus on mice and rats. It seeks to explore the advantages and disadvantages of histologically printed brain atlases in comparison to MRI brain atlases, delineate the standardized methods for creating MRI brain atlases, and summarize their primary applications in neuroscience research. Additionally, this review aims to assist researchers in selecting appropriate versions of MRI brain atlases for their studies or refining existing MRI brain atlas resources, thereby facilitating the development and widespread adoption of standardized MRI-based brain atlases in rodents.

An MR-based brain template and atlas for optical projection tomography and light sheet fluorescence microscopy in neuroscience

Introduction

Optical Projection Tomography (OPT) and light sheet fluorescence microscopy (LSFM) are high resolution optical imaging techniques, ideally suited for ex vivo 3D whole mouse brain imaging. Although they exhibit high specificity for their targets, the anatomical detail provided by tissue autofluorescence remains limited.

Methods

T1-weighted images were acquired from 19 BABB or DBE cleared brains to create an MR template using serial longitudinal registration. Afterwards, fluorescent OPT and LSFM images were coregistered/normalized to the MR template to create fusion images.

Results

Volumetric calculations revealed a significant difference between BABB and DBE cleared brains, leading to develop two optimized templates, with associated tissue priors and brain atlas, for BABB (OCUM) and DBE (iOCUM). By creating fusion images, we identified virus infected brain regions, mapped dopamine transporter and translocator protein expression, and traced innervation from the eye along the optic tract to the thalamus and superior colliculus using cholera toxin B. Fusion images allowed for precise anatomical identification of fluorescent signal in the detailed anatomical context provided by MR.

Discussion

The possibility to anatomically map fluorescent signals on magnetic resonance (MR) images, widely used in clinical and preclinical neuroscience, would greatly benefit applications of optical imaging of mouse brain. These specific MR templates for cleared brains enable a broad range of neuroscientific applications integrating 3D optical brain imaging.

Out of the core: the impact of focal ischemia in regions beyond the penumbra

The changes in the necrotic core and the penumbra following induction of focal ischemia have been the focus of attention for some time. However, evidence shows, that ischemic injury is not confined to the primarily affected structures and may influence the remote areas as well. Yet many studies fail to probe into the structures beyond the penumbra, and possibly do not even find any significant results due to their short-term design, as secondary damage occurs later. This slower reaction can be perceived as a therapeutic opportunity, in contrast to the ischemic core defined as irreversibly damaged tissue, where the window for salvation is comparatively short. The pathologies in remote structures occur relatively frequently and are clearly linked to the post-stroke neurological outcome. In order to develop efficient therapies, a deeper understanding of what exactly happens in the exo-focal regions is necessary. The mechanisms of glia contribution to the ischemic damage in core/penumbra are relatively well described and include impaired ion homeostasis, excessive cell swelling, glutamate excitotoxic mechanism, release of pro-inflammatory cytokines and phagocytosis or damage propagation via astrocytic syncytia. However, little is known about glia involvement in post-ischemic processes in remote areas. In this literature review, we discuss the definitions of the terms "ischemic core", "penumbra" and "remote areas." Furthermore, we present evidence showing the array of structural and functional changes in the more remote regions from the primary site of focal ischemia, with a special focus on glia and the extracellular matrix. The collected information is compared with the processes commonly occurring in the ischemic core or in the penumbra. Moreover, the possible causes of this phenomenon and the approaches for investigation are described, and finally, we evaluate the efficacy of therapies, which have been studied for their anti-ischemic effect in remote areas in recent years.

Between neurons and networks: investigating mesoscale brain connectivity in neurological and psychiatric disorders

The study of brain connectivity has been a cornerstone in understanding the complexities of neurological and psychiatric disorders. It has provided invaluable insights into the functional architecture of the brain and how it is perturbed in disorders. However, a persistent challenge has been achieving the proper spatial resolution, and developing computational algorithms to address biological questions at the multi-cellular level, a scale often referred to as the mesoscale. Historically, neuroimaging studies of brain connectivity have predominantly focused on the macroscale, providing insights into inter-regional brain connections but often falling short of resolving the intricacies of neural circuitry at the cellular or mesoscale level. This limitation has hindered our ability to fully comprehend the underlying mechanisms of neurological and psychiatric disorders and to develop targeted interventions. In light of this issue, our review manuscript seeks to bridge this critical gap by delving into the domain of mesoscale neuroimaging. We aim to provide a comprehensive overview of conditions affected by aberrant neural connections, image acquisition techniques, feature extraction, and data analysis methods that are specifically tailored to the mesoscale. We further delineate the potential of brain connectivity research to elucidate complex biological questions, with a particular focus on schizophrenia and epilepsy. This review encompasses topics such as dendritic spine quantification, single neuron morphology, and brain region connectivity. We aim to showcase the applicability and significance of mesoscale neuroimaging techniques in the field of neuroscience, highlighting their potential for gaining insights into the complexities of neurological and psychiatric disorders.

A multimodal pipeline for image correction and registration of mass spectrometry imaging with microscopy

The integration of matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI MSI) and histology plays a pivotal role in advancing our understanding of complex heterogeneous tissues, which provides a comprehensive description of biological tissue with both wide molecule coverage and high lateral resolution. Herein, we proposed a novel strategy for the correction and registration of MALDI MSI data with hematoxylin & eosin (H&E) staining images. To overcome the challenges of discrepancies in spatial resolution towards the unification of the two imaging modalities, a deep learning-based interpolation algorithm for MALDI MSI data was constructed, which enables spatial coherence and the following orientation matching between images. Coupled with the affine transformation (AT) and the subsequent moving least squares algorithm, the two types of images from one rat brain tissue section were aligned automatically with high accuracy. Moreover, we demonstrated the practicality of the developed pipeline by projecting it to a rat cerebral ischemia-reperfusion injury model, which would help decipher the link between molecular metabolism and pathological interpretation towards microregion. This new approach offers the chance for other types of bioimaging to boost the field of multimodal image fusion.

A high-throughput big-data orchestration and processing system for the High Energy Photon Source

High-data-throughput and multimodal-acquisition experiments will prevail in next-generation synchrotron beamlines. Orchestrating dataflow pipelines connecting the data acquisition, processing, visualization and storage ends are becoming increasingly complex and essential for enhancing beamline performance. Mamba Data Worker (MDW) has been developed to address the data challenges for the forthcoming High Energy Photon Source (HEPS). It is an important component of the Mamba experimental control and data acquisition software ecosystem, which enables fast data acquisition and transmission, dynamic configuration of data processing pipelines, data multiplex in streaming, and customized data and metadata assembly. This paper presents the architecture and development plan of MDW, outlines the essential technologies involved, and illustrates its current application at the Beijing Synchrotron Radiation Facility (BSRF).

UNRAVELing the synergistic effects of psilocybin and environment on brain-wide immediate early gene expression in mice

The effects of context on the subjective experience of serotonergic psychedelics have not been fully examined in human neuroimaging studies, partly due to limitations of the imaging environment. Here, we administered saline or psilocybin to mice in their home cage or an enriched environment, immunofluorescently-labeled brain-wide c-Fos, and imaged iDISCO+ cleared tissue with light sheet fluorescence microscopy (LSFM) to examine the impact of environmental context on psilocybin-elicited neural activity at cellular resolution. Voxel-wise analysis of c-Fos-immunofluorescence revealed clusters of neural activity associated with main effects of context and psilocybin-treatment, which were validated with c-Fos+ cell density measurements. Psilocybin increased c-Fos expression in subregions of the neocortex, caudoputamen, central amygdala, and parasubthalamic nucleus while it decreased c-Fos in the hypothalamus, cortical amygdala, striatum, and pallidum in a predominantly context-independent manner. To gauge feasibility of future mechanistic studies on ensembles activated by psilocybin, we confirmed activity- and Cre-dependent genetic labeling in a subset of these neurons using TRAP2+/-;Ai14+ mice. Network analyses treating each psilocybin-sensitive cluster as a node indicated that psilocybin disrupted co-activity between highly correlated regions, reduced brain modularity, and dramatically attenuated intermodular co-activity. Overall, our results indicate that main effects of context and psilocybin were robust, widespread, and reorganized network architecture, whereas context×psilocybin interactions were surprisingly sparse.

D-LMBmap: a fully automated deep-learning pipeline for whole-brain profiling of neural circuitry

Recent proliferation and integration of tissue-clearing methods and light-sheet fluorescence microscopy has created new opportunities to achieve mesoscale three-dimensional whole-brain connectivity mapping with exceptionally high throughput. With the rapid generation of large, high-quality imaging datasets, downstream analysis is becoming the major technical bottleneck for mesoscale connectomics. Current computational solutions are labor intensive with limited applications because of the exhaustive manual annotation and heavily customized training. Meanwhile, whole-brain data analysis always requires combining multiple packages and secondary development by users. To address these challenges, we developed D-LMBmap, an end-to-end package providing an integrated workflow containing three modules based on deep-learning algorithms for whole-brain connectivity mapping: axon segmentation, brain region segmentation and whole-brain registration. D-LMBmap does not require manual annotation for axon segmentation and achieves quantitative analysis of whole-brain projectome in a single workflow with superior accuracy for multiple cell types in all of the modalities tested.

A systematic review of the relationship between magnetic resonance imaging based resting-state and structural networks in the rodent brain

Recent developments in rodent brain imaging have enabled translational characterization of functional and structural connectivity at the whole brain level in vivo. Nevertheless, fundamental questions about the link between structural and functional networks remain unsolved. In this review, we systematically searched for experimental studies in rodents investigating both structural and functional network measures, including studies correlating functional connectivity using resting-state functional MRI with diffusion tensor imaging or viral tracing data. We aimed to answer whether functional networks reflect the architecture of the structural connectome, how this reciprocal relationship changes throughout a disease, how structural and functional changes relate to each other, and whether changes follow the same timeline. We present the knowledge derived exclusively from studies that included in vivo imaging of functional and structural networks. The limited number of available reports makes it difficult to draw general conclusions besides finding a spatial and temporal decoupling between structural and functional networks during brain disease. Data suggest that when overcoming the currently limited evidence through future studies with combined imaging in various disease models, it will be possible to explore the interaction between both network systems as a disease or recovery biomarker.

Mouse brain MR super-resolution using a deep learning network trained with optical imaging data

Introduction

The resolution of magnetic resonance imaging is often limited at the millimeter level due to its inherent signal-to-noise disadvantage compared to other imaging modalities. Super-resolution (SR) of MRI data aims to enhance its resolution and diagnostic value. While deep learning-based SR has shown potential, its applications in MRI remain limited, especially for preclinical MRI, where large high-resolution MRI datasets for training are often lacking.

Methods

In this study, we first used high-resolution mouse brain auto-fluorescence (AF) data acquired using serial two-photon tomography (STPT) to examine the performance of deep learning-based SR for mouse brain images.

Results

We found that the best SR performance was obtained when the resolutions of training and target data were matched. We then applied the network trained using AF data to MRI data of the mouse brain, and found that the performance of the SR network depended on the tissue contrast presented in the MRI data. Using transfer learning and a limited set of high-resolution mouse brain MRI data, we were able to fine-tune the initial network trained using AF to enhance the resolution of MRI data.

Discussion

Our results suggest that deep learning SR networks trained using high-resolution data of a different modality can be applied to MRI data after transfer learning.

Using light and X-ray scattering to untangle complex neuronal orientations and validate diffusion MRI

Disentangling human brain connectivity requires an accurate description of nerve fiber trajectories, unveiled via detailed mapping of axonal orientations. However, this is challenging because axons can cross one another on a micrometer scale. Diffusion magnetic resonance imaging (dMRI) can be used to infer axonal connectivity because it is sensitive to axonal alignment, but it has limited spatial resolution and specificity. Scattered light imaging (SLI) and small-angle X-ray scattering (SAXS) reveal axonal orientations with microscopic resolution and high specificity, respectively. Here, we apply both scattering techniques on the same samples and cross-validate them, laying the groundwork for ground-truth axonal orientation imaging and validating dMRI. We evaluate brain regions that include unidirectional and crossing fibers in human and vervet monkey brain sections. SLI and SAXS quantitatively agree regarding in-plane fiber orientations including crossings, while dMRI agrees in the majority of voxels with small discrepancies. We further use SAXS and dMRI to confirm theoretical predictions regarding SLI determination of through-plane fiber orientations. Scattered light and X-ray imaging can provide quantitative micrometer 3D fiber orientations with high resolution and specificity, facilitating detailed investigations of complex fiber architecture in the animal and human brain.

Adeno-associated virus 2 infection in children with non-A-E hepatitis

An outbreak of acute hepatitis of unknown aetiology in children was reported in Scotland1 in April 2022 and has now been identified in 35 countries2. Several recent studies have suggested an association with human adenovirus with this outbreak, a virus not commonly associated with hepatitis. Here we report a detailed case-control investigation and find an association between adeno-associated virus 2 (AAV2) infection and host genetics in disease susceptibility. Using next-generation sequencing, PCR with reverse transcription, serology and in situ hybridization, we detected recent infection with AAV2 in plasma and liver samples in 26 out of 32 (81%) cases of hepatitis compared with 5 out of 74 (7%) of samples from unaffected individuals. Furthermore, AAV2 was detected within ballooned hepatocytes alongside a prominent T cell infiltrate in liver biopsy samples. In keeping with a CD4+ T-cell-mediated immune pathology, the human leukocyte antigen (HLA) class II HLA-DRB1*04:01 allele was identified in 25 out of 27 cases (93%) compared with a background frequency of 10 out of 64 (16%; P = 5.49 × 10-12). In summary, we report an outbreak of acute paediatric hepatitis associated with AAV2 infection (most likely acquired as a co-infection with human adenovirus that is usually required as a 'helper virus' to support AAV2 replication) and disease susceptibility related to HLA class II status.

Merged magnetic resonance and light sheet microscopy of the whole mouse brain

We have developed workflows to align 3D magnetic resonance histology (MRH) of the mouse brain with light sheet microscopy (LSM) and 3D delineations of the same specimen. We start with MRH of the brain in the skull with gradient echo and diffusion tensor imaging (DTI) at 15 μm isotropic resolution which is ~ 1,000 times higher than that of most preclinical MRI. Connectomes are generated with superresolution tract density images of ~5 μm. Brains are cleared, stained for selected proteins, and imaged by LSM at 1.8 μm/pixel. LSM data are registered into the reference MRH space with labels derived from the ABA common coordinate framework. The result is a high-dimensional integrated volume with registration (HiDiver) with alignment precision better than 50 µm. Throughput is sufficiently high that HiDiver is being used in quantitative studies of the impact of gene variants and aging on mouse brain cytoarchitecture and connectomics.

Correlative Chemical Imaging and Spatial Chemometrics Delineate Alzheimer Plaque Heterogeneity at High Spatial Resolution

We present a novel, correlative chemical imaging strategy based on multimodal matrix-assisted laser desorption/ionization (MALDI) mass spectrometry imaging (MSI), hyperspectral microscopy, and spatial chemometrics. Our workflow overcomes challenges associated with correlative MSI data acquisition and alignment by implementing 1 + 1-evolutionary image registration for precise geometric alignment of multimodal imaging data and their integration in a common, truly multimodal imaging data matrix with maintained MSI resolution (10 μm). This enabled multivariate statistical modeling of multimodal imaging data using a novel multiblock orthogonal component analysis approach to identify covariations of biochemical signatures between and within imaging modalities at MSI pixel resolution. We demonstrate the method's potential through its application toward delineating chemical traits of Alzheimer's disease (AD) pathology. Here, trimodal MALDI MSI of transgenic AD mouse brain delineates beta-amyloid (Aβ) plaque-associated co-localization of lipids and Aβ peptides. Finally, we establish an improved image fusion approach for correlative MSI and functional fluorescence microscopy. This allowed for high spatial resolution (300 nm) prediction of correlative, multimodal MSI signatures toward distinct amyloid structures within single plaque features critically implicated in Aβ pathogenicity.

Cardiogenic control of affective behavioural state

Emotional states influence bodily physiology, as exemplified in the top-down process by which anxiety causes faster beating of the heart1-3. However, whether an increased heart rate might itself induce anxiety or fear responses is unclear3-8. Physiological theories of emotion, proposed over a century ago, have considered that in general, there could be an important and even dominant flow of information from the body to the brain9. Here, to formally test this idea, we developed a noninvasive optogenetic pacemaker for precise, cell-type-specific control of cardiac rhythms of up to 900 beats per minute in freely moving mice, enabled by a wearable micro-LED harness and the systemic viral delivery of a potent pump-like channelrhodopsin. We found that optically evoked tachycardia potently enhanced anxiety-like behaviour, but crucially only in risky contexts, indicating that both central (brain) and peripheral (body) processes may be involved in the development of emotional states. To identify potential mechanisms, we used whole-brain activity screening and electrophysiology to find brain regions that were activated by imposed cardiac rhythms. We identified the posterior insular cortex as a potential mediator of bottom-up cardiac interoceptive processing, and found that optogenetic inhibition of this brain region attenuated the anxiety-like behaviour that was induced by optical cardiac pacing. Together, these findings reveal that cells of both the body and the brain must be considered together to understand the origins of emotional or affective states. More broadly, our results define a generalizable approach for noninvasive, temporally precise functional investigations of joint organism-wide interactions among targeted cells during behaviour.

UNRAVELing the synergistic effects of psilocybin and environment on brain-wide immediate early gene expression in mice

The effects of context on the subjective experience of serotonergic psychedelics have not been fully examined in human neuroimaging studies, partly due to limitations of the imaging environment. Here, we administered saline or psilocybin to mice in their home cage or an enriched environment, immunofluorescently-labeled brain-wide c-Fos, and imaged cleared tissue with light sheet microscopy to examine the impact of context on psilocybin-elicited neural activity at cellular resolution. Voxel-wise analysis of c-Fos-immunofluorescence revealed differential neural activity, which we validated with c-Fos + cell density measurements. Psilocybin increased c-Fos expression in the neocortex, caudoputamen, central amygdala, and parasubthalamic nucleus and decreased c-Fos in the hypothalamus, cortical amygdala, striatum, and pallidum. Main effects of context and psilocybin-treatment were robust, widespread, and spatially distinct, whereas interactions were surprisingly sparse.

Multimodal 3D Mouse Brain Atlas Framework with the Skull-Derived Coordinate System

Magnetic resonance imaging (MRI) and light-sheet fluorescence microscopy (LSFM) are technologies that enable non-disruptive 3-dimensional imaging of whole mouse brains. A combination of complementary information from both modalities is desirable for studying neuroscience in general, disease progression and drug efficacy. Although both technologies rely on atlas mapping for quantitative analyses, the translation of LSFM recorded data to MRI templates has been complicated by the morphological changes inflicted by tissue clearing and the enormous size of the raw data sets. Consequently, there is an unmet need for tools that will facilitate fast and accurate translation of LSFM recorded brains to in vivo, non-distorted templates. In this study, we have developed a bidirectional multimodal atlas framework that includes brain templates based on both imaging modalities, region delineations from the Allen's Common Coordinate Framework, and a skull-derived stereotaxic coordinate system. The framework also provides algorithms for bidirectional transformation of results obtained using either MR or LSFM (iDISCO cleared) mouse brain imaging while the coordinate system enables users to easily assign in vivo coordinates across the different brain templates.

Restoring morphology of light sheet microscopy data based on magnetic resonance histology

The combination of cellular-resolution whole brain light sheet microscopy (LSM) images with an annotated atlas enables quantitation of cellular features in specific brain regions. However, most existing methods register LSM data with existing canonical atlases, e.g., The Allen Brain Atlas (ABA), which have been generated from tissue that has been distorted by removal from the skull, fixation and physical handling. This limits the accuracy of the regional morphologic measurement. Here, we present a method to combine LSM data with magnetic resonance histology (MRH) of the same specimen to restore the morphology of the LSM images to the in-skull geometry. Our registration pipeline which maps 3D LSM big data (terabyte per dataset) to MRH of the same mouse brain provides registration with low displacement error in ∼10 h with limited manual input. The registration pipeline is optimized using multiple stages of transformation at multiple resolution scales. A three-step procedure including pointset initialization, automated ANTs registration with multiple optimized transformation stages, and finalized application of the transforms on high-resolution LSM data has been integrated into a simple, structured, and robust workflow. Excellent agreement has been seen between registered LSM data and reference MRH data both locally and globally. This workflow has been applied to a collection of datasets with varied combinations of MRH contrasts from diffusion tensor images and LSM with varied immunohistochemistry, providing a routine method for streamlined registration of LSM images to MRH. Lastly, the method maps a reduced set of the common coordinate framework (CCFv3) labels from the Allen Brain Atlas onto the geometrically corrected full resolution LSM data. The pipeline maintains the individual brain morphology and allows more accurate regional annotations and measurements of volumes and cell density.

Projective Diffeomorphic Mapping of Molecular Digital Pathology with Tissue MRI

Reconstructing dense 3D anatomical coordinates from 2D projective measurements has become a central problem in digital pathology for both animal models and human studies. Here we describe Projective Large Deformation Diffeomorphic Metric Mapping (LDDMM), a technique which projects diffeomorphic mappings of dense human magnetic resonance imaging (MRI) atlases at tissue scales onto sparse measurements at micrometre scales associated with histological and more general optical imaging modalities. We solve the problem of dense mapping surjectively onto histological sections by incorporating technologies for crossing modalities that use nonlinear scattering transforms to represent multiple radiomic-like textures at micron scales, together with a Gaussian mixture-model framework for modelling tears and distortions associated to each section. We highlight the significance of our method through incorporation of neuropathological measures and MRI, of relevance to the development of biomarkers for Alzheimer's disease and one instance of the integration of imaging data across the scales of clinical imaging and digital pathology.

Characterization of perivascular space pathology in a rat model of cerebral small vessel disease by in vivo magnetic resonance imaging

One of the most common causes of dementia is cerebral small vessel disease (SVD), which is associated with enlarged perivascular spaces (PVS). Clinically, PVS are visible as hyperintensities on T2-weighted (T2w) magnetic resonance images (MRI). While rodent SVD models exhibit arteriolosclerosis, PVS have not been robustly documented by MRI casting doubts on their clinical relevance. Here we established that the severity of SVD in spontaneously hypertensive stroke prone (SHRSP) rats correlated to 'moderate' SVD in human post-mortem tissue. We then developed two approaches for detecting PVS in SHRSP rats: 1) T2w imaging and 2) T1-weighted imaging with administration of gadoteric acid into cerebrospinal fluid. We applied the two protocols to six Wistar-Kyoto (WKY) control rats and thirteen SHRSP rats at ∼12 month of age. The primary endpoint was the number of hyperintense lesions. We found more hyperintensities on T2w MRI in the SHRSP compared to WKY rats (p-value = 0.023). CSF enhancement with gadoteric acid increased the visibility of PVS-like lesions in SHRSP rats. In some of the SHRSP rats, the MRI hyperintensities corresponded to enlarged PVS on histopathology. The finding of PVS-like hyperintensities on T2w MRI support the SHRSP rat's clinical relevance for studying the underlying pathophysiology of SVD.

mBrainAligner-Web: a web server for cross-modal coherent registration of whole mouse brains

SUMMARY

Recent whole-brain mapping projects are collecting increasingly larger sets of high-resolution brain images using a variety of imaging, labeling and sample preparation techniques. Both mining and analysis of these data require reliable and robust cross-modal registration tools. We recently developed the mBrainAligner, a pipeline for performing cross-modal registration of the whole mouse brain. However, using this tool requires scripting or command-line skills to assemble and configure the different modules of mBrainAligner for accommodating different registration requirements and platform settings. In this application note, we present mBrainAligner-Web, a web server with a user-friendly interface that allows to configure and run mBrainAligner locally or remotely across platforms.

AVAILABILITY AND IMPLEMENTATION

mBrainAligner-Web is available at http://mbrainaligner.ahu.edu.cn/ with source code at https://github.com/reaneyli/mBrainAligner-web.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Progressive 3D biomedical image registration network based on deep self-calibration

Three dimensional deformable image registration (DIR) is a key enabling technique in building digital neuronal atlases of the brain, which can model the local non-linear deformation between a pair of biomedical images and align the anatomical structures of different samples into one spatial coordinate system. And thus, the DIR is always conducted following a preprocessing of global linear registration to remove the large global deformations. However, imperfect preprocessing may leave some large non-linear deformations that cannot be handled well by existing DIR methods. The recently proposed cascaded registration network gives a primary solution to deal with such large non-linear deformations, but still suffers from loss of image details caused by continuous interpolation (information loss problem). In this article, a progressive image registration strategy based on deep self-calibration is proposed to deal with the large non-linear deformations without causing information loss and introducing additional parameters. More importantly, we also propose a novel hierarchical registration strategy to quickly achieve accurate multi-scale progressive registration. In addition, our method can implicitly and reasonably implement dynamic dataset augmentation. We have evaluated the proposed method on both optical and MRI image datasets with obtaining promising results, which demonstrate the superior performance of the proposed method over several other state-of-the-art approaches for deformable image registration.

Advances of functional nanomaterials for magnetic resonance imaging and biomedical engineering applications

Functional nanomaterials have been widely used in biomedical fields due to their good biocompatibility, excellent physicochemical properties, easy surface modification, and easy regulation of size and morphology. Functional nanomaterials for magnetic resonance imaging (MRI) can target specific sites in vivo and more easily detect disease-related specific biomarkers at the molecular and cellular levels than traditional contrast agents, achieving a broad application prospect in MRI. This review focuses on the basic principles of MRI, the classification, synthesis and surface modification methods of contrast agents, and their clinical applications to provide guidance for designing novel contrast agents and optimizing the contrast effect. Furthermore, the latest biomedical advances of functional nanomaterials in medical diagnosis and disease detection, disease treatment, the combination of diagnosis and treatment (theranostics), multi-model imaging and nanozyme are also summarized and discussed. Finally, the bright application prospects of functional nanomaterials in biomedicine are emphasized and the urgent need to achieve significant breakthroughs in the industrial transformation and the clinical translation is proposed. This article is categorized under: Nanotechnology Approaches to Biology > Nanoscale Systems in Biology Diagnostic Tools > Diagnostic Nanodevices Therapeutic Approaches and Drug Discovery > Nanomedicine for Oncologic Disease.

Light-Weight Deformable Registration Using Adversarial Learning With Distilling Knowledge

Deformable registration is a crucial step in many medical procedures such as image-guided surgery and radiation therapy. Most recent learning-based methods focus on improving the accuracy by optimizing the non-linear spatial correspondence between the input images. Therefore, these methods are computationally expensive and require modern graphic cards for real-time deployment. In this paper, we introduce a new Light-weight Deformable Registration network that significantly reduces the computational cost while achieving competitive accuracy. In particular, we propose a new adversarial learning with distilling knowledge algorithm that successfully leverages meaningful information from the effective but expensive teacher network to the student network. We design the student network such as it is light-weight and well suitable for deployment on a typical CPU. The extensively experimental results on different public datasets show that our proposed method achieves state-of-the-art accuracy while significantly faster than recent methods. We further show that the use of our adversarial learning algorithm is essential for a time-efficiency deformable registration method. Finally, our source code and trained models are available at https://github.com/aioz-ai/LDR_ALDK.

The brainstem connectome database

Connectivity data of the nervous system and subdivisions, such as the brainstem, cerebral cortex and subcortical nuclei, are necessary to understand connectional structures, predict effects of connectional disorders and simulate network dynamics. For that purpose, a database was built and analyzed which comprises all known directed and weighted connections within the rat brainstem. A longterm metastudy of original research publications describing tract tracing results form the foundation of the brainstem connectome (BC) database which can be analyzed directly in the framework neuroVIISAS. The BC database can be accessed directly by connectivity tables, a web-based tool and the framework. Analysis of global and local network properties, a motif analysis, and a community analysis of the brainstem connectome provides insight into its network organization. For example, we found that BC is a scale-free network with a small-world connectivity. The Louvain modularity and weighted stochastic block matching resulted in partially matching of functions and connectivity. BC modeling was performed to demonstrate signal propagation through the somatosensory pathway which is affected in Multiple sclerosis.

Measurement(s)	brainstem
Technology Type(s)	tract tracing metastudy
Factor Type(s)	brain region
Sample Characteristic - Organism	Rattus rattus
Sample Characteristic - Environment	Experimental setup
Sample Characteristic - Location	Germany

Statistical Considerations and Tools to Improve Histopathologic Protocols with Spectroscopic Imaging

Advances in infrared (IR) spectroscopic imaging instrumentation and data science now present unique opportunities for large validation studies of the concept of histopathology using spectral data. In this study, we examine the discrimination potential of IR metrics for different histologic classes to estimate the sample size needed for designing validation studies to achieve a given statistical power and statistical significance. Next, we present an automated annotation transfer tool that can allow large-scale training/validation, overcoming the limitations of sparse ground truth data with current manual approaches by providing a tool to transfer pathologist annotations from stained images to IR images across diagnostic categories. Finally, the results of a combination of supervised and unsupervised analysis provide a scheme to identify diagnostic groups/patterns and isolating pure chemical pixels for each class to better train complex histopathological models. Together, these methods provide essential tools to take advantage of the emerging capabilities to record and utilize large spectroscopic imaging datasets.

SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images

We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at doic https://w3id.org/synthmorph.

Seeing the Forest and Its Trees Together: Implementing 3D Light Microscopy Pipelines for Cell Type Mapping in the Mouse Brain

The brain is composed of diverse neuronal and non-neuronal cell types with complex regional connectivity patterns that create the anatomical infrastructure underlying cognition. Remarkable advances in neuroscience techniques enable labeling and imaging of these individual cell types and their interactions throughout intact mammalian brains at a cellular resolution allowing neuroscientists to examine microscopic details in macroscopic brain circuits. Nevertheless, implementing these tools is fraught with many technical and analytical challenges with a need for high-level data analysis. Here we review key technical considerations for implementing a brain mapping pipeline using the mouse brain as a primary model system. Specifically, we provide practical details for choosing methods including cell type specific labeling, sample preparation (e.g., tissue clearing), microscopy modalities, image processing, and data analysis (e.g., image registration to standard atlases). We also highlight the need to develop better 3D atlases with standardized anatomical labels and nomenclature across species and developmental time points to extend the mapping to other species including humans and to facilitate data sharing, confederation, and integrative analysis. In summary, this review provides key elements and currently available resources to consider while developing and implementing high-resolution mapping methods.

Common principles in the lateralisation of auditory cortex structure and function for vocal communication in primates and rodents

This review summarises recent findings on the lateralisation of communicative sound processing in the auditory cortex (AC) of humans, non-human primates, and rodents. Functional imaging in humans has demonstrated a left hemispheric preference for some acoustic features of speech, but it is unclear to which degree this is caused by bottom-up acoustic feature selectivity or top-down modulation from language areas. Although non-human primates show a less pronounced functional lateralisation in AC, the properties of AC fields and behavioral asymmetries are qualitatively similar. Rodent studies demonstrate microstructural circuits that might underlie bottom-up acoustic feature selectivity in both hemispheres. Functionally, the left AC in the mouse appears to be specifically tuned to communication calls, whereas the right AC may have a more 'generalist' role. Rodents also show anatomical AC lateralisation, such as differences in size and connectivity. Several of these functional and anatomical characteristics are also lateralized in human AC. Thus, complex vocal communication processing shares common features among rodents and primates. We argue that a synthesis of results from humans, non-human primates, and rodents is necessary to identify the neural circuitry of vocal communication processing. However, data from different species and methods are often difficult to compare. Recent advances may enable better integration of methods across species. Efforts to standardise data formats and analysis tools would benefit comparative research and enable synergies between psychological and biological research in the area of vocal communication processing.

Mesoscale microscopy and image analysis tools for understanding the brain

Over the last ten years, developments in whole-brain microscopy now allow for high-resolution imaging of intact brains of small animals such as mice. These complex images contain a wealth of information, but many neuroscience laboratories do not have all of the computational knowledge and tools needed to process these data. We review recent open source tools for registration of images to atlases, and the segmentation, visualisation and analysis of brain regions and labelled structures such as neurons. Since the field lacks fully integrated analysis pipelines for all types of whole-brain microscopy analysis, we propose a pathway for tool developers to work together to meet this challenge.

Cross-modal coherent registration of whole mouse brains

Recent whole-brain mapping projects are collecting large-scale three-dimensional images using modalities such as serial two-photon tomography, fluorescence micro-optical sectioning tomography, light-sheet fluorescence microscopy, volumetric imaging with synchronous on-the-fly scan and readout or magnetic resonance imaging. Registration of these multi-dimensional whole-brain images onto a standard atlas is essential for characterizing neuron types and constructing brain wiring diagrams. However, cross-modal image registration is challenging due to intrinsic variations of brain anatomy and artifacts resulting from different sample preparation methods and imaging modalities. We introduce a cross-modal registration method, mBrainAligner, which uses coherent landmark mapping and deep neural networks to align whole mouse brain images to the standard Allen Common Coordinate Framework atlas. We build a brain atlas for the fluorescence micro-optical sectioning tomography modality to facilitate single-cell mapping, and used our method to generate a whole-brain map of three-dimensional single-neuron morphology and neuron cell types.

Automatic Multi-Stain Registration of Whole Slide Images in Histopathology

Joint analysis of multiple biomarker images and tissue morphology is important for disease diagnosis, treatment planning and drug development. It requires cross-staining comparison among Whole Slide Images (WSIs) of immune-histochemical and hematoxylin and eosin (H&E) microscopic slides. However, automatic, and fast cross-staining alignment of enormous gigapixel WSIs at single-cell precision is challenging. In addition to morphological deformations introduced during slide preparation, there are large variations in cell appearance and tissue morphology across different staining. In this paper, we propose a two-step automatic feature-based cross-staining WSI alignment to assist localization of even tiny metastatic foci in the assessment of lymph node. Image pairs were aligned allowing for translation, rotation, and scaling. The registration was performed automatically by first detecting landmarks in both images, using the scale-invariant image transform (SIFT), followed by the fast sample consensus (FSC) protocol for finding point correspondences and finally aligned the images. The Registration results were evaluated using both visual and quantitative criteria using the Jaccard index. The average Jaccard similarity index of the results produced by the proposed system is 0.942 when compared with the manual registration.

Diffusion MRI tractography for neurosurgery: the basics, current state, technical reliability and challenges

Diffusion magnetic resonance imaging (dMRI) tractography is currently the only imaging technique that allows for non-invasive delineation and visualisation of white matter (WM) tractsin vivo,prompting rapid advances in related fields of brain MRI research in recent years. One of its major clinical applications is for pre-surgical planning and intraoperative image guidance in neurosurgery, where knowledge about the location of WM tracts nearby the surgical target can be helpful to guide surgical resection and optimise post-surgical outcomes. Surgical injuries to these WM tracts can lead to permanent neurological and functional deficits, making the accuracy of tractography reconstructions paramount. The quality of dMRI tractography is influenced by many modifiable factors, ranging from MRI data acquisition through to the post-processing of tractography output, with the potential of error propagation based on decisions made at each and subsequent processing steps. Research over the last 25 years has significantly improved the anatomical accuracy of tractography. An updated review about tractography methodology in the context of neurosurgery is now timely given the thriving research activities in dMRI, to ensure more appropriate applications in the clinical neurosurgical realm. This article aims to review the dMRI physics, and tractography methodologies, highlighting recent advances to provide the key concepts of tractography-informed neurosurgery, with a focus on the general considerations, the current state of practice, technical challenges, potential advances, and future demands to this field.

Recent advances in intravital microscopy for preclinical research

Intravital microscopy (IVM) has revolutionized our understanding of single-cell behavior in complex tissues by enabling real-time observation of molecular and cellular processes in their natural environment. In preclinical research, IVM has emerged as a standard tool for mechanistic studies of therapy response and the rational design of new treatment strategies. Technological developments keep expanding the imaging depth and quality that can be achieved in living tissue, and the maturation of imaging modalities such as fluorescence and phosphorescence lifetime imaging facilitates co-registration of individual cell dynamics with metabolic tissue states. Correlation of IVM with mesoscopic and macroscopic imaging modalities further promotes the translation of mechanistic insights gained by IVM into clinically relevant information. This review highlights some of the recent advances in IVM that have made the transition from experimental optical techniques to practical applications in basic and preclinical research.

Intravenous and Non-invasive Drug Delivery to the Mouse Basal ForebrainUsing MRI-guided Focused Ultrasound

Basal forebrain cholinergic neurons (BFCNs) regulate circuit dynamics underlying cognitive processing, including attention, memory, and cognitive flexibility. In Alzheimer's disease and related neurodegenerative conditions, the degeneration of BFCNs has long been considered a key player in cognitive decline. The cholinergic system thus represents a key therapeutic target. A long-standing obstacle for the development of effective cholinergic-based therapies is not only the production of biologically active compounds but also a platform for safe and efficient drug delivery to the basal forebrain. The blood-brain barrier (BBB) presents a significant challenge for drug delivery to the brain, excluding approximately 98% of small-molecule biologics and nearly 100% of large-molecule therapeutic agents from entry into the brain parenchyma. Current modalities to achieve effective drug delivery to deep brain structures, such as the basal forebrain, are particularly limited. Direct intracranial injection via a needle or catheter carries risks associated with invasive neurosurgery. Intra-arterial injection of hyperosmotic solutions or therapeutics modified to penetrate the BBB using endogenous transport systems lack regional specificity, which may not always be desirable. Intranasal, intrathecal, and intraventricular administration have limited drug distribution beyond the brain surface. Here, we present a protocol for non-invasively, locally, and transiently increasing BBB permeability using MRI-guided focused ultrasound (MRIgFUS) in the murine basal forebrain for delivery of therapeutic agents targeting the cholinergic system. Ongoing work in preclinical models and clinical trials supports the safety and feasibility of MRIgFUS-mediated BBB modulation as a promising drug delivery modality for the treatment of debilitating neurological diseases.

A deep learning algorithm for 3D cell detection in whole mouse brain image datasets

Understanding the function of the nervous system necessitates mapping the spatial distributions of its constituent cells defined by function, anatomy or gene expression. Recently, developments in tissue preparation and microscopy allow cellular populations to be imaged throughout the entire rodent brain. However, mapping these neurons manually is prone to bias and is often impractically time consuming. Here we present an open-source algorithm for fully automated 3D detection of neuronal somata in mouse whole-brain microscopy images using standard desktop computer hardware. We demonstrate the applicability and power of our approach by mapping the brain-wide locations of large populations of cells labeled with cytoplasmic fluorescent proteins expressed via retrograde trans-synaptic viral infection.

Tissue Probability Based Registration of Diffusion-Weighted Magnetic Resonance Imaging

BACKGROUND

Current registration methods for diffusion-MRI (dMRI) data mostly focus on white matter (WM) areas. Recently, dMRI has been employed for the characterization of gray matter (GM) microstructure, emphasizing the need for registration methods that consider all tissue types.

PURPOSE

To develop a dMRI registration method based on GM, WM, and cerebrospinal fluid (CSF) tissue probability maps (TPMs).

STUDY TYPE

Retrospective longitudinal study.

POPULATION

Thirty-two healthy participants were scanned twice (legacy data), divided into a training-set (n = 16) and a test-set (n = 16), and 35 randomly-selected participants from the Human Connectome Project.

FIELD STRENGTH/SEQUENCE

3.0T, diffusion-weighted spin-echo echo-planar sequence; T1-weighted spoiled gradient-recalled echo (SPGR) sequence.

ASSESSMENT

A joint segmentation-registration approach was implemented: Diffusion tensor imaging (DTI) maps were classified into TPMs using machine-learning approaches. The resulting GM, WM, and CSF probability maps were employed as features for image alignment. Validation was performed on the test dataset and the HCP dataset. Registration performance was compared with current mainstream registration tools.

STATISTICAL TESTS

Classifiers used for segmentation were evaluated using leave-one-out cross-validation and scored using Dice-index. Registration success was evaluated by voxel-wise variance, normalized cross-correlation of registered DTI maps, intra- and inter-subject similarity of the registered TPMs, and region-based intra-subject similarity using an anatomical atlas. One-way ANOVAs were performed to compare between our method and other registration tools.

RESULTS

The proposed method outperformed mainstream registration tools as indicated by lower voxel-wise variance of registered DTI maps (SD decrease of 10%) and higher similarity between registered TPMs within and across participants, for all tissue types (Dice increase of 0.1-0.2; P < 0.05).

DATA CONCLUSION

A joint segmentation-registration approach based on diffusion-driven TPMs provides a more accurate registration of dMRI data, outperforming other registration tools. Our method offers a "translation" of diffusion data into structural information in the form of TPMs, allowing to directly align diffusion and structural images.

LEVEL OF EVIDENCE

1 Technical Efficacy Stage: 1.

Reduced Retinal Microvascular Perfusion in Patients With Stroke Detected by Optical Coherence Tomography Angiography

Currently there is a shortage of biomarkers for stroke, one of the leading causes of death and disability in aging populations. Retinal vessels offer a unique and accessible “window” to study the microvasculature in vivo. However, the relationship between the retinal microvasculature and stroke is not entirely clear. To investigate the retinal microvascular characteristics in stroke, we recruited patients with stroke and age-matched control subjects from a tertiary hospital in China. The macular vessel density (VD) in the superficial capillary plexus (SCP) and deep capillary plexus (DCP), foveal avascular zone (FAZ) metrics, and optical coherence tomography angiography (OCTA) measured optic disc VD were recorded for analysis. A total of 189 patients with stroke and 195 control subjects were included. After adjusting for sex, visual acuity, systolic and diastolic blood pressure, a history of smoking, levels of hemoglobulin (HbA1c), cholesterol, and high-density lipoprotein (HDL), the macular VD of SCP and DCP in all sectors was decreased in patients with stroke. In the stroke group, the VD around the FAZ and the VD of the optic disk were lower. Logistic regression found the parafovea-superior-hemi VD of DCP > 54.53% [odds ratio (OR): 0.169] as a protective factor of stroke. Using the integration of all OCTA parameters and traditional risk factors, the area under the receiver operating characteristic (AUC) curve of distinguishing patients with stroke was 0.962, with a sensitivity of 0.944 and a specificity of 0.871. Our study demonstrates that the retinal VD is decreased in patients with stroke independently of the traditional risk factors of stroke, which may shed light on the monitoring of stroke using the retinal microvascular parameters.

Frontoinsular cortical microstructure is linked to life satisfaction in young adulthood

Life satisfaction is a component of subjective well-being that reflects a global judgement of the quality of life according to an individual's own needs and expectations. As a psychological construct, it has attracted attention due to its relationship to mental health, resilience to stress, and other factors. Neuroimaging studies have identified neurobiological correlates of life satisfaction; however, they are limited to functional connectivity and gray matter morphometry. We explored features of gray matter microstructure obtained through compartmental modeling of multi-shell diffusion MRI data, and we examined cortical microstructure in frontoinsular cortex in a cohort of 807 typical young adults scanned as part of the Human Connectome Project. Our experiments identified the orientation dispersion index (ODI), and analogously fractional anisotropy (FA), of frontoinsular cortex as a robust set of anatomically-specific lateralized diffusion MRI microstructure features that are linked to life satisfaction, independent of other demographic, socioeconomic, and behavioral factors. We further validated our findings in a secondary test-retest dataset and found high reliability of our imaging metrics and reproducibility of outcomes. In our analysis of twin and non-twin siblings, we found basic microstructure in frontoinsular cortex to be strongly genetically determined. We also found a more moderate but still very significant genetic role in determining microstructure as it relates to life satisfaction in frontoinsular cortex. Our findings suggest a potential linkage between well-being and microscopic features of frontoinsular cortex, which may reflect cellular morphology and architecture and may more broadly implicate the integrity of the homeostatic processing performed by frontoinsular cortex as an important component of an individual's judgements of life satisfaction.

Visualizing anatomically registered data with brainrender

Three-dimensional (3D) digital brain atlases and high-throughput brain-wide imaging techniques generate large multidimensional datasets that can be registered to a common reference frame. Generating insights from such datasets depends critically on visualization and interactive data exploration, but this a challenging task. Currently available software is dedicated to single atlases, model species or data types, and generating 3D renderings that merge anatomically registered data from diverse sources requires extensive development and programming skills. Here, we present brainrender: an open-source Python package for interactive visualization of multidimensional datasets registered to brain atlases. Brainrender facilitates the creation of complex renderings with different data types in the same visualization and enables seamless use of different atlas sources. High-quality visualizations can be used interactively and exported as high-resolution figures and animated videos. By facilitating the visualization of anatomically registered data, brainrender should accelerate the analysis, interpretation, and dissemination of brain-wide multidimensional data.

Flexible annotation atlas of the mouse brain: combining and dividing brain structures of the Allen Brain Atlas while maintaining anatomical hierarchy

A brain atlas is necessary for analyzing structure and function in neuroimaging research. Although various annotation volumes (AVs) for the mouse brain have been proposed, it is common in magnetic resonance imaging (MRI) of the mouse brain that regions-of-interest (ROIs) for brain structures (nodes) are created arbitrarily according to each researcher's necessity, leading to inconsistent ROIs among studies. One reason for such a situation is the fact that earlier AVs were fixed, i.e. combination and division of nodes were not implemented. This report presents a pipeline for constructing a flexible annotation atlas (FAA) of the mouse brain by leveraging public resources of the Allen Institute for Brain Science on brain structure, gene expression, and axonal projection. A mere two-step procedure with user-specified, text-based information and Python codes constructs FAA with nodes which can be combined or divided objectively while maintaining anatomical hierarchy of brain structures. Four FAAs with total node count of 4, 101, 866, and 1381 were demonstrated. Unique characteristics of FAA realized analysis of resting-state functional connectivity (FC) across the anatomical hierarchy and among cortical layers, which were thin but large brain structures. FAA can improve the consistency of whole brain ROI definition among laboratories by fulfilling various requests from researchers with its flexibility and reproducibility.

Bi-channel image registration and deep-learning segmentation (BIRDS) for efficient, versatile 3D mapping of mouse brain

We have developed an open-source software called bi-channel image registration and deep-learning segmentation (BIRDS) for the mapping and analysis of 3D microscopy data and applied this to the mouse brain. The BIRDS pipeline includes image preprocessing, bi-channel registration, automatic annotation, creation of a 3D digital frame, high-resolution visualization, and expandable quantitative analysis. This new bi-channel registration algorithm is adaptive to various types of whole-brain data from different microscopy platforms and shows dramatically improved registration accuracy. Additionally, as this platform combines registration with neural networks, its improved function relative to the other platforms lies in the fact that the registration procedure can readily provide training data for network construction, while the trained neural network can efficiently segment-incomplete/defective brain data that is otherwise difficult to register. Our software is thus optimized to enable either minute-timescale registration-based segmentation of cross-modality, whole-brain datasets or real-time inference-based image segmentation of various brain regions of interest. Jobs can be easily submitted and implemented via a Fiji plugin that can be adapted to most computing environments.

PREEMACS: Pipeline for preprocessing and extraction of the macaque brain surface

Accurate extraction of the cortical brain surface is critical for cortical thickness estimation and a key element to perform multimodal imaging analysis, where different metrics are integrated and compared in a common space. While brain surface extraction has become widespread practice in human studies, several challenges unique to neuroimaging of non-human primates (NHP) have hindered its adoption for the study of macaques. Although, some of these difficulties can be addressed at the acquisition stage, several common artifacts can be minimized through image preprocessing. Likewise, there are several image analysis pipelines for human MRIs, but very few automated methods for extraction of cortical surfaces have been reported for NHPs and none have been tested on data from diverse sources. We present PREEMACS, a pipeline that standardizes the preprocessing of structural MRI images (T1- and T2-weighted) and carries out an automatic surface extraction of the macaque brain. Building upon and extending pre-existing tools, the first module performs volume orientation, image cropping, intensity non-uniformity correction, and volume averaging, before skull-stripping through a convolutional neural network. The second module performs quality control using an adaptation of MRIqc method to extract objective quality metrics that are then used to determine the likelihood of accurate brain surface estimation. The third and final module estimates the white matter (wm) and pial surfaces from the T1-weighted volume (T1w) using an NHP customized version of FreeSurfer aided by the T2-weighted volumes (T2w). To evaluate the generalizability of PREEMACS, we tested the pipeline using 57 T1w/T2w NHP volumes acquired at 11 different sites from the PRIME-DE public dataset. Results showed an accurate and robust automatic brain surface extraction from images that passed the quality control segment of our pipeline. This work offers a robust, efficient and generalizable pipeline for the automatic standardization of MRI surface analysis on NHP.

Combining Sparse and Dense Features to Improve Multi-Modal Registration for Brain DTI Images

A new solution to overcome the constraints of multimodality medical intra-subject image registration is proposed, using the mutual information (MI) of image histogram-oriented gradients as a new matching criterion. We present a rigid, multi-modal image registration algorithm based on linear transformation and oriented gradients for the alignment of T2-weighted (T2w) images (as a fixed reference) and diffusion tensor imaging (DTI) (b-values of 500 and 1250 s/mm2) as floating images of three patients to compensate for the motion during the acquisition process. Diffusion MRI is very sensitive to motion, especially when the intensity and duration of the gradient pulses (characterized by the b-value) increases. The proposed method relies on the whole brain surface and addresses the variability of anatomical features into an image stack. The sparse features refer to corners detected using the Harris corner detector operator, while dense features use all image pixels through the image histogram of oriented gradients (HOG) as a measure of the degree of statistical dependence between a pair of registered images. HOG as a dense feature is focused on the structure and extracts the oriented gradient image in the x and y directions. MI is used as an objective function for the optimization process. The entropy functions and joint entropy function are determined using the HOGs data. To determine the best image transformation, the fiducial registration error (FRE) measure is used. We compare the results against the MI-based intensities results computed using a statistical intensity relationship between corresponding pixels in source and target images. Our approach, which is devoted to the whole brain, shows improved registration accuracy, robustness, and computational cost compared with the registration algorithms, which use anatomical features or regions of interest areas with specific neuroanatomy. Despite the supplementary HOG computation task, the computation time is comparable for MI-based intensities and MI-based HOG methods.