Multimodal neuroimaging computing: the workflows, methods, and platforms

Enlarged perivascular spaces in the basal ganglia are associated with arteries not veins

Enlarged perivascular spaces (EPVS) are common in cerebral small vessel disease (CSVD) and have been identified as a marker of dysfunctional brain clearance. However, it remains unknown if the enlargement occurs predominantly around arteries or veins. We combined in vivo ultra-high-resolution MRI and histopathology to investigate the spatial relationship of veins and arteries with EPVS within the basal ganglia (BG). Furthermore, we assessed the relationship between the EPVS and measures of blood-flow (blood-flow velocity, pulsatility index) in the small arteries of the BG. Twenty-four healthy controls, twelve non-CAA CSVD patients, and five probable CAA patients underwent a 3 tesla [T] and 7T MRI-scan, and EPVS, arteries, and veins within the BG were manually segmented. Furthermore, the scans were co-registered. Six autopsy-cases were also assessed. In the BG, EPVS were significantly closer to and overlapped more frequently with arteries than with veins. Histological analysis showed a higher proportion of BG EPVS surrounding arteries than veins. Finally, the pulsatility index of BG arteries correlated with EPVS volume. Our results are in line with previous works and establish a pathophysiological relationship between arteries and EPVS, contributing to elucidating perivascular clearance routes in the human brain.

Causal functional connectivity in Alzheimer's disease computed from time series fMRI data

Functional connectivity between brain regions is known to be altered in Alzheimer's disease and promises to be a biomarker for early diagnosis. Several approaches for functional connectivity obtain an un-directed network representing stochastic associations (correlations) between brain regions. However, association does not necessarily imply causation. In contrast, Causal Functional Connectivity (CFC) is more informative, providing a directed network representing causal relationships between brain regions. In this paper, we obtained the causal functional connectome for the whole brain from resting-state functional magnetic resonance imaging (rs-fMRI) recordings of subjects from three clinical groups: cognitively normal, mild cognitive impairment, and Alzheimer's disease. We applied the recently developed Time-aware PC (TPC) algorithm to infer the causal functional connectome for the whole brain. TPC supports model-free estimation of whole brain CFC based on directed graphical modeling in a time series setting. We compared the CFC outcome of TPC with that of other related approaches in the literature. Then, we used the CFC outcomes of TPC and performed an exploratory analysis of the difference in strengths of CFC edges between Alzheimer's and cognitively normal groups, based on edge-wise p-values obtained by Welch's t-test. The brain regions thus identified are found to be in agreement with literature on brain regions impacted by Alzheimer's disease, published by researchers from clinical/medical institutions.

Increased functional connectivity patterns in mild Alzheimer's disease: A rsfMRI study

Background

Alzheimer's disease (AD) is the most common age-related neurodegenerative disorder. In view of our rapidly aging population, there is an urgent need to identify Alzheimer's disease (AD) at an early stage. A potential way to do so is by assessing the functional connectivity (FC), i.e., the statistical dependency between two or more brain regions, through novel analysis techniques.

Methods

In the present study, we assessed the static and dynamic FC using different approaches. A resting state (rs)fMRI dataset from the Alzheimer's disease neuroimaging initiative (ADNI) was used (n = 128). The blood-oxygen-level-dependent (BOLD) signals from 116 regions of 4 groups of participants, i.e., healthy controls (HC; n = 35), early mild cognitive impairment (EMCI; n = 29), late mild cognitive impairment (LMCI; n = 30), and Alzheimer's disease (AD; n = 34) were extracted and analyzed. FC and dynamic FC were extracted using Pearson's correlation, sliding-windows correlation analysis (SWA), and the point process analysis (PPA). Additionally, graph theory measures to explore network segregation and integration were computed.

Results

Our results showed a longer characteristic path length and a decreased degree of EMCI in comparison to the other groups. Additionally, an increased FC in several regions in LMCI and AD in contrast to HC and EMCI was detected. These results suggest a maladaptive short-term mechanism to maintain cognition.

Conclusion

The increased pattern of FC in several regions in LMCI and AD is observable in all the analyses; however, the PPA enabled us to reduce the computational demands and offered new specific dynamic FC findings.

Near-channel classifier: symbiotic communication and classification in high-dimensional space

Brain-inspired high-dimensional (HD) computing represents and manipulates data using very long, random vectors with dimensionality in the thousands. This representation provides great robustness for various classification tasks where classifiers operate at low signal-to-noise ratio (SNR) conditions. Similarly, hyperdimensional modulation (HDM) leverages the robustness of complex-valued HD representations to reliably transmit information over a wireless channel, achieving a similar SNR gain compared to state-of-the-art codes. Here, we first propose methods to improve HDM in two ways: (1) reducing the complexity of encoding and decoding operations by generating, manipulating, and transmitting bipolar or integer vectors instead of complex vectors; (2) increasing the SNR gain by 0.2 dB using a new soft-feedback decoder; it can also increase the additive superposition capacity of HD vectors up to 1.7\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\times$$\end{document}× in noise-free cases. Secondly, we propose to combine encoding/decoding aspects of communication with classification into a single framework by relying on multifaceted HD representations. This leads to a near-channel classification (NCC) approach that avoids transformations between different representations and the overhead of multiple layers of encoding/decoding, hence reducing latency and complexity of a wireless smart distributed system while providing robustness against noise and interference from other nodes. We provide a use-case for wearable hand gesture recognition with 5 classes from 64 EMG sensors, where the encoded vectors are transmitted to a remote node for either performing NCC, or reconstruction of the encoded data. In NCC mode, the original classification accuracy of 94% is maintained, even in the channel at SNR of 0 dB, by transmitting 10,000-bit vectors. We remove the redundancy by reducing the vector dimensionality to 2048-bit that still exhibits a graceful degradation: less than 6% accuracy loss is occurred in the channel at − 5 dB, and with the interference from 6 nodes that simultaneously transmit their encoded vectors. In the reconstruction mode, it improves the mean-squared error by up to 20 dB, compared to standard decoding, when transmitting 2048-dimensional vectors.

Dyconnmap: Dynamic connectome mapping-A neuroimaging python module

Despite recent progress in the analysis of neuroimaging data sets, our comprehension of the main mechanisms and principles which govern human brain cognition and function remains incomplete. Network neuroscience makes substantial efforts to manipulate these challenges and provide real answers. For the last decade, researchers have been modelling brain structure and function via a graph or network that comprises brain regions that are either anatomically connected via tracts or functionally via a more extensive repertoire of functional associations. Network neuroscience is a relatively new multidisciplinary scientific avenue of the study of complex systems by pursuing novel ways to analyze, map, store and model the essential elements and their interactions in complex neurobiological systems, particularly the human brain, the most complex system in nature. Due to a rapid expansion of neuroimaging data sets' size and complexity, it is essential to propose and adopt new empirical tools to track dynamic patterns between neurons and brain areas and create comprehensive maps. In recent years, there is a rapid growth of scientific interest in moving functional neuroimaging analysis beyond simplified group or time‐averaged approaches and sophisticated algorithms that can capture the time‐varying properties of functional connectivity. We describe algorithms and network metrics that can capture the dynamic evolution of functional connectivity under this perspective. We adopt the word ‘chronnectome’ (integration of the Greek word ‘Chronos’, which means time, and connectome) to describe this specific branch of network neuroscience that explores how mutually informed brain activity correlates across time and brain space in a functional way. We also describe how good temporal mining of temporally evolved dynamic functional networks could give rise to the detection of specific brain states over which our brain evolved. This characteristic supports our complex human mind. The temporal evolution of these brain states and well‐known network metrics could give rise to new analytic trends. Functional brain networks could also increase the multi‐faced nature of the dynamic networks revealing complementary information. Finally, we describe a python module (https://github.com/makism/dyconnmap) which accompanies this article and contains a collection of dynamic complex network analytics and measures and demonstrates its great promise for the study of a healthy subject's repeated fMRI scans.

NEURO-LEARN: a Solution for Collaborative Pattern Analysis of Neuroimaging Data

The development of neuroimaging instrumentation has boosted neuroscience researches. Consequently, both the fineness and the cost of data acquisition have profoundly increased, leading to the main bottleneck of this field: limited sample size and high dimensionality of neuroimaging data. Therefore, the emphasis of ideas of data pooling and research collaboration has increased over the past decade. Collaborative analysis techniques emerge as the idea developed. In this paper, we present NEURO-LEARN, a solution for collaborative pattern analysis of neuroimaging data. Its collaboration scheme consists of four parts: projects, data, analysis, and reports. While data preparation workflows defined in projects reduce the high dimensionality of neuroimaging data by collaborative computation, pooling of derived data and sharing of pattern analysis workflows along with generated reports on the Web enlarge the sample size and ensure the reliability and reproducibility of pattern analysis. Incorporating this scheme, NEURO-LEARN provides an easy-to-use Web application that allows users from different sites to share projects and processed data, perform pattern analysis, and obtain result reports. We anticipate that this solution will help neuroscientists to enlarge sample size, conquer the curse of dimensionality and conduct reproducible studies on neuroimaging data with efficiency and validity.

Multi-modal brain fingerprinting: A manifold approximation based framework

This work presents an efficient framework, based on manifold approximation, for generating brain fingerprints from multi-modal data. The proposed framework represents images as bags of local features which are used to build a subject proximity graph. Compact fingerprints are obtained by projecting this graph in a low-dimensional manifold using spectral embedding. Experiments using the T1/T2-weighted MRI, diffusion MRI, and resting-state fMRI data of 945 Human Connectome Project subjects demonstrate the benefit of combining multiple modalities, with multi-modal fingerprints more discriminative than those generated from individual modalities. Results also highlight the link between fingerprint similarity and genetic proximity, monozygotic twins having more similar fingerprints than dizygotic or non-twin siblings. This link is also reflected in the differences of feature correspondences between twin/sibling pairs, occurring in major brain structures and across hemispheres. The robustness of the proposed framework to factors like image alignment and scan resolution, as well as the reproducibility of results on retest scans, suggest the potential of multi-modal brain fingerprinting for characterizing individuals in a large cohort analysis.

A Hitchhiker's Guide to Functional Magnetic Resonance Imaging

Functional Magnetic Resonance Imaging (fMRI) studies have become increasingly popular both with clinicians and researchers as they are capable of providing unique insights into brain functions. However, multiple technical considerations (ranging from specifics of paradigm design to imaging artifacts, complex protocol definition, and multitude of processing and methods of analysis, as well as intrinsic methodological limitations) must be considered and addressed in order to optimize fMRI analysis and to arrive at the most accurate and grounded interpretation of the data. In practice, the researcher/clinician must choose, from many available options, the most suitable software tool for each stage of the fMRI analysis pipeline. Herein we provide a straightforward guide designed to address, for each of the major stages, the techniques, and tools involved in the process. We have developed this guide both to help those new to the technique to overcome the most critical difficulties in its use, as well as to serve as a resource for the neuroimaging community.

Task and Resting-State fMRI Reveal Altered Salience Responses to Positive Stimuli in Patients with Major Depressive Disorder

Altered brain function in patients with major depressive disorder (MDD) has been repeatedly demonstrated by task-based and resting-state studies, respectively. However, less is known concerning whether overlapped abnormalities in functional activities across modalities exist in MDD patients. To find out the answer, we implemented an fMRI experiment and collected both task and resting-state data from 19 MDD patients and 19 matched, healthy, controls. A distraction paradigm involving emotionally valenced pictures was applied to induce affective responses in subjects. As a result, concurrent deficits were found in arousing activation during a positive task in both the reward circuit and salience network (SN) that is composed of the dorsal part of anterior cingulate cortex (dACC) and bilateral anterior insulae (AI) in only the MDD group. Subsequent amplitude of low frequency fluctuations (ALFF) and functional connectivity analyses based on resting-state data exhibited consistent alterations in the bilateral AI of MDD patients, and indicated patients' difficulties in regulating the balance between central executive network (CEN) and default mode network (DMN) due to altered connectivity among the CEN, DMN, and SN. Our findings provide new evidence demonstrating impaired salience processing and resulting alterations in responses to positive stimuli in MDD patients. Furthermore, brain abnormalities synchronized across functional states in MDD patients can be evidenced by a combination of task and resting-state fMRI analyses.

Cross-View Neuroimage Pattern Analysis in Alzheimer's Disease Staging

The research on staging of pre-symptomatic and prodromal phase of neurological disorders, e.g., Alzheimer's disease (AD), is essential for prevention of dementia. New strategies for AD staging with a focus on early detection, are demanded to optimize potential efficacy of disease-modifying therapies that can halt or slow the disease progression. Recently, neuroimaging are increasingly used as additional research-based markers to detect AD onset and predict conversion of MCI and normal control (NC) to AD. Researchers have proposed a variety of neuroimaging biomarkers to characterize the patterns of the pathology of AD and MCI, and suggested that multi-view neuroimaging biomarkers could lead to better performance than single-view biomarkers in AD staging. However, it is still unclear what leads to such synergy and how to preserve or maximize. In an attempt to answer these questions, we proposed a cross-view pattern analysis framework for investigating the synergy between different neuroimaging biomarkers. We quantitatively analyzed nine types of biomarkers derived from FDG-PET and T1-MRI, and evaluated their performance in a task of classifying AD, MCI, and NC subjects obtained from the ADNI baseline cohort. The experiment results showed that these biomarkers could depict the pathology of AD from different perspectives, and output distinct patterns that are significantly associated with the disease progression. Most importantly, we found that these features could be separated into clusters, each depicting a particular aspect; and the inter-cluster features could always achieve better performance than the intra-cluster features in AD staging.

Automated identification of dementia using medical imaging: a survey from a pattern classification perspective

In this review paper, we summarized the automated dementia identification algorithms in the literature from a pattern classification perspective. Since most of those algorithms consist of both feature extraction and classification, we provide a survey on three categories of feature extraction methods, including the voxel-, vertex- and ROI-based ones, and four categories of classifiers, including the linear discriminant analysis, Bayes classifiers, support vector machines, and artificial neural networks. We also compare the reported performance of many recently published dementia identification algorithms. Our comparison shows that many algorithms can differentiate the Alzheimer’s disease (AD) from elderly normal with a largely satisfying accuracy, whereas distinguishing the mild cognitive impairment from AD or elderly normal still remains a major challenge.

A semi-automated workflow solution for multimodal neuroimaging: application to patients with traumatic brain injury

Traumatic brain injury (TBI) is a major cause of mortality and morbidity, placing a significant financial burden on the healthcare system worldwide. Non-invasive neuroimaging technologies have been playing a pivotal role in the study of TBI, providing important information for surgical planning and patient management. Advances in understanding the basic mechanisms and pathophysiology of the brain following TBI are hindered by a lack of reliable image analysis methods for accurate quantitative assessment of TBI-induced structural and pathophysiological changes seen on anatomical and functional images obtained from multiple imaging modalities. Conventional region-of-interest (ROI) analysis based on manual labeling of brain regions is time-consuming and the results could be inconsistent within and among investigators. In this study, we propose a workflow solution framework that combined the use of non-linear spatial normalization of structural brain images and template-based anatomical labeling to automate the ROI analysis process. The proposed workflow solution is applied to dynamic PET scanning with ¹⁵O-water (0–10 min) and ¹⁸F-FDDNP (0–6 min) for measuring cerebral blood flow in patients with TBI.

Dictionary Pruning with Visual Word Significance for Medical Image Retrieval

Content-based medical image retrieval (CBMIR) is an active research area for disease diagnosis and treatment but it can be problematic given the small visual variations between anatomical structures. We propose a retrieval method based on a bag-of-visual-words (BoVW) to identify discriminative characteristics between different medical images with Pruned Dictionary based on Latent Semantic Topic description. We refer to this as the PD-LST retrieval. Our method has two main components. First, we calculate a topic-word significance value for each visual word given a certain latent topic to evaluate how the word is connected to this latent topic. The latent topics are learnt, based on the relationship between the images and words, and are employed to bridge the gap between low-level visual features and high-level semantics. These latent topics describe the images and words semantically and can thus facilitate more meaningful comparisons between the words. Second, we compute an overall-word significance value to evaluate the significance of a visual word within the entire dictionary. We designed an iterative ranking method to measure overall-word significance by considering the relationship between all latent topics and words. The words with higher values are considered meaningful with more significant discriminative power in differentiating medical images. We evaluated our method on two public medical imaging datasets and it showed improved retrieval accuracy and efficiency.

Pairwise Latent Semantic Association for Similarity Computation in Medical Imaging

Retrieving medical images that present similar diseases is an active research area for diagnostics and therapy. However, it can be problematic given the visual variations between anatomical structures. In this paper, we propose a new feature extraction method for similarity computation in medical imaging. Instead of the low-level visual appearance, we design a CCA-PairLDA feature representation method to capture the similarity between images with high-level semantics. First, we extract the PairLDA topics to represent an image as a mixture of latent semantic topics in an image pair context. Second, we generate a CCA-correlation model to represent the semantic association between an image pair for similarity computation. While PairLDA adjusts the latent topics for all image pairs, CCA-correlation helps to associate an individual image pair. In this way, the semantic descriptions of an image pair are closely correlated, and naturally correspond to similarity computation between images. We evaluated our method on two public medical imaging datasets for image retrieval and showed improved performance.

Multimodal neuroimaging computing: a review of the applications in neuropsychiatric disorders

Multimodal neuroimaging is increasingly used in neuroscience research, as it overcomes the limitations of individual modalities. One of the most important applications of multimodal neuroimaging is the provision of vital diagnostic data for neuropsychiatric disorders. Multimodal neuroimaging computing enables the visualization and quantitative analysis of the alterations in brain structure and function, and has reshaped how neuroscience research is carried out. Research in this area is growing exponentially, and so it is an appropriate time to review the current and future development of this emerging area. Hence, in this paper, we review the recent advances in multimodal neuroimaging (MRI, PET) and electrophysiological (EEG, MEG) technologies, and their applications to the neuropsychiatric disorders. We also outline some future directions for multimodal neuroimaging where researchers will design more advanced methods and models for neuropsychiatric research.