Decoding brain states from fMRI connectivity graphs

Advancements in nanotheranostics for glioma therapy

Gliomas are brain tumors mainly derived from glial cells that are difficult to treat and cause high mortality. Radiation, chemotherapy, and surgical excision are the conventional treatments for gliomas. Patients who have surgery or have undergone chemotherapy for glioma treatment have poor prognosis with tumor recurrence. In particular, for glioblastoma, the 5-year average survival rate is 4-7%, and the median survival is 12-18 months. A number of issues hinder effective treatment such as, poor surgical resection, tumor heterogeneity, insufficient drug penetration across the blood-brain barrier, multidrug resistance, and difficulties with drug specificity. Nanotheranostic-mediated drug delivery is becoming a well-researched consideration, and an efficient non-invasive method for delivering chemotherapeutic drugs to the target area. Theranostic nanomedicines, which incorporate therapeutic drugs and imaging agents for personalized therapies, can be used for preventing overdose of non-responders. Through the identification of massive and complicated information from next-generation sequencing, machine learning enables for precise prediction of therapeutic outcomes and post-treatment management for patients with cancer. This article gives a thorough overview of nanocarrier-mediated drug delivery with a brief introduction to drug delivery challenges. In addition, this assessment offers a current summary of preclinical and clinical research on nanomedicines for gliomas. In the future, nanotheranostics will provide personalized treatment for gliomas and other treatable cancers.

Increasing the representation of minoritized youth for inclusive and reproducible brain-behavior associations

Population neuroscience datasets allow researchers to estimate reliable effect sizes for brain-behavior associations because of their large sample sizes. However, these datasets undergo strict quality control to mitigate sources of noise, such as head motion. This practice often excludes a disproportionate number of minoritized individuals. We employ motion-ordering and motion-ordering+resampling (bagging) to test if these methods preserve functional MRI (fMRI) data in the Adolescent Brain Cognitive Development Study ( N = 5,733 ). Black and Hispanic youth exhibited excess head motion relative to data collected from White youth, and were discarded disproportionately when using conventional approaches. Both methods retained more than 99% of Black and Hispanic youth. They produced reproducible brain-behavior associations across low-/high-motion racial/ethnic groups based on motion-limited fMRI data. The motion-ordering and bagging methods are two feasible approaches that can enhance sample representation for testing brain-behavior associations and fulfill the promise of consortia datasets to produce generalizable effect sizes across diverse populations.

A Bayesian Multiplex Graph Classifier of Functional Brain Connectivity Across Diverse Tasks of Cognitive Control

This article seeks to investigate the impact of aging on functional connectivity across different cognitive control scenarios, particularly emphasizing the identification of brain regions significantly associated with early aging. By conceptualizing functional connectivity within each cognitive control scenario as a graph, with brain regions as nodes, the statistical challenge revolves around devising a regression framework to predict a binary scalar outcome (aging or normal) using multiple graph predictors. Popular regression methods utilizing multiplex graph predictors often face limitations in effectively harnessing information within and across graph layers, leading to potentially less accurate inference and predictive accuracy, especially for smaller sample sizes. To address this challenge, we propose the Bayesian Multiplex Graph Classifier (BMGC). Accounting for multiplex graph topology, our method models edge coefficients at each graph layer using bilinear interactions between the latent effects associated with the two nodes connected by the edge. This approach also employs a variable selection framework on node-specific latent effects from all graph layers to identify influential nodes linked to observed outcomes. Crucially, the proposed framework is computationally efficient and quantifies the uncertainty in node identification, coefficient estimation, and binary outcome prediction. BMGC outperforms alternative methods in terms of the aforementioned metrics in simulation studies. An additional BMGC validation was completed using an fMRI study of brain networks in adults. The proposed BMGC technique identified that sensory motor brain network obeys certain lateral symmetries, whereas the default mode network exhibits significant brain asymmetries associated with early aging.

Developing the Lung Graph-Based Machine Learning Model for Identification of Fibrotic Interstitial Lung Diseases

Accurate detection of fibrotic interstitial lung disease (f-ILD) is conducive to early intervention. Our aim was to develop a lung graph-based machine learning model to identify f-ILD. A total of 417 HRCTs from 279 patients with confirmed ILD (156 f-ILD and 123 non-f-ILD) were included in this study. A lung graph-based machine learning model based on HRCT was developed for aiding clinician to diagnose f-ILD. In this approach, local radiomics features were extracted from an automatically generated geometric atlas of the lung and used to build a series of specific lung graph models. Encoding these lung graphs, a lung descriptor was gained and became as a characterization of global radiomics feature distribution to diagnose f-ILD. The Weighted Ensemble model showed the best predictive performance in cross-validation. The classification accuracy of the model was significantly higher than that of the three radiologists at both the CT sequence level and the patient level. At the patient level, the diagnostic accuracy of the model versus radiologists A, B, and C was 0.986 (95% CI 0.959 to 1.000), 0.918 (95% CI 0.849 to 0.973), 0.822 (95% CI 0.726 to 0.904), and 0.904 (95% CI 0.836 to 0.973), respectively. There was a statistically significant difference in AUC values between the model and 3 physicians (p < 0.05). The lung graph-based machine learning model could identify f-ILD, and the diagnostic performance exceeded radiologists which could aid clinicians to assess ILD objectively.

Extracting transition features among brain states based on coarse-grained similarity measurement for autism spectrum disorder analysis

BACKGROUND

The abnormal brain functional connectivity (FC) of patients with mental diseases is closely linked to the transition features among brain states. However, the current research on state transition will produce certain division deviations in the measurement method of state division, and also ignore the transition features among multiple states that contain more abundant information for analyzing brain diseases.

PURPOSE

To investigate the potential of the proposed method based on coarse-grained similarity measurement to solve the problem of state division, and consider the transition features among multiple states to analyze the FC abnormalities of autism spectrum disorder (ASD) patients.

METHODS

We used resting-state functional magnetic resonance imaging to examine 45 ASD and 47 healthy controls (HC). The FC between brain regions was calculated by the sliding window and correlation algorithm, and a novel coarse-grained similarity measure method was used to cluster the FC networks into five states, and then extract the features both of the state itself and the transition features among multiple states for analysis and diagnosis.

RESULTS

(1) The state as divided by the coarse-grained measurement method improves the diagnostic performance of individuals with ASD compared with previous methods. (2) The transition features among multiple states can provide complementary information to the features of the state itself in the ASD analysis and diagnosis. (3) ASD individuals have different brain state transitions than HC. Specifically, the abnormalities in intra- and inter-network connectivity of ASD patients mainly occur in the default mode network, the visual network, and the cerebellum.

CONCLUSIONS

Such results demonstrate that our approach with new measurements and new features is effective and promising in brain state analysis and ASD diagnosis.

Topological data analysis for revealing dynamic brain reconfiguration in MEG data

In recent years, the focus of the functional connectivity community has shifted from stationary approaches to the ones that include temporal dynamics. Especially, non-invasive electrophysiological data (magnetoencephalography/electroencephalography (MEG/EEG)) with high temporal resolution and good spatial coverage have made it possible to measure the fast alterations in the neural activity in the brain during ongoing cognition. In this article, we analyze dynamic brain reconfiguration using MEG images collected from subjects during the rest and the cognitive tasks. Our proposed topological data analysis method, called Mapper, produces biomarkers that differentiate cognitive tasks without prior spatial and temporal collapse of the data. The suggested method provides an interactive visualization of the rapid fluctuations in electrophysiological data during motor and cognitive tasks; hence, it has the potential to extract clinically relevant information at an individual level without temporal and spatial collapse.

Diverse Task Classification from Activation Patterns of Functional Neuro-Images Using Feature Fusion Module

One of the emerging fields in functional magnetic resonance imaging (fMRI) is the decoding of different stimulations. The underlying idea is to reveal the hidden representative signal patterns of various fMRI tasks for achieving high task-classification performance. Unfortunately, when multiple tasks are processed, performance remains limited due to several challenges, which are rarely addressed since the majority of the state-of-the-art studies cover a single neuronal activity task. Accordingly, the first contribution of this study is the collection and release of a rigorously acquired dataset, which contains cognitive, behavioral, and affective fMRI tasks together with resting state. After a comprehensive analysis of the pitfalls of existing systems on this new dataset, we propose an automatic multitask classification (MTC) strategy using a feature fusion module (FFM). FFM aims to create a unique signature for each task by combining deep features with time-frequency representations. We show that FFM creates a feature space that is superior for representing task characteristics compared to their individual use. Finally, for MTC, we test a diverse set of deep-models and analyze their complementarity. Our results reveal higher classification accuracy compared to benchmarks. Both the dataset and the code are accessible to researchers for further developments.

SynBOLD-DisCo: Synthetic BOLD images for distortion correction of fMRI without additional calibration scans

The blood oxygen level dependent (BOLD) signal from functional magnetic resonance imaging (fMRI) is a noninvasive technique that has been widely used in research to study brain function. However, fMRI suffers from susceptibility-induced off resonance fields which may cause geometric distortions and mismatches with anatomical images. State-of-the-art correction methods require acquiring reverse phase encoded images or additional field maps to enable distortion correction. However, not all imaging protocols include these additional scans and thus cannot take advantage of these susceptibility correction capabilities. As such, in this study we aim to enable state-of-the-art distortion correction with FSL's topup algorithm of historical and/or limited fMRI data that include only a structural image and single phase encoded fMRI. To do this, we use 3D U-net models to synthesize undistorted fMRI BOLD contrast images from the structural image and use this undistorted synthetic image as an anatomical target for distortion correction with topup. We evaluate the efficacy of this approach, named SynBOLD-DisCo (synthetic BOLD images for distortion correction), and show that BOLD images corrected using our approach are geometrically more similar to structural images than the distorted BOLD data and are practically equivalent to state-of-the-art correction methods which require reverse phase encoded data. Future directions include additional validation studies, integration with other preprocessing operations, retraining with broader pathologies, and investigating the effects of spin echo versus gradient echo images for training and distortion correction. In summary, we demonstrate SynBOLD-DisCo corrects distortion of fMRI when reverse phase encoding scans or field maps are not available.

Application of nanomaterials in diagnosis and treatment of glioblastoma

Diagnosing and treating glioblastoma patients is currently hindered by several obstacles, such as tumor heterogeneity, the blood-brain barrier, tumor complexity, drug efflux pumps, and tumor immune escape mechanisms. Combining multiple methods can increase benefits against these challenges. For example, nanomaterials can improve the curative effect of glioblastoma treatments, and the synergistic combination of different drugs can markedly reduce their side effects. In this review, we discuss the progression and main issues regarding glioblastoma diagnosis and treatment, the classification of nanomaterials, and the delivery mechanisms of nanomedicines. We also examine tumor targeting and promising nano-diagnosis or treatment principles based on nanomedicine. We also summarize the progress made on the advanced application of combined nanomaterial-based diagnosis and treatment tools and discuss their clinical prospects. This review aims to provide a better understanding of nano-drug combinations, nano-diagnosis, and treatment options for glioblastoma, as well as insights for developing new tools.

Advancing brain network models to reconcile functional neuroimaging and clinical research

Functional magnetic resonance imaging (fMRI) captures information on brain function beyond the anatomical alterations that are traditionally visually examined by neuroradiologists. However, the fMRI signals are complex in addition to being noisy, so fMRI still faces limitations for clinical applications. Here we review methods that have been proposed as potential solutions so far, namely statistical, biophysical and decoding models, with their strengths and weaknesses. We especially evaluate the ability of these models to directly predict clinical variables from their parameters (predictability) and to extract clinically relevant information regarding biological mechanisms and relevant features for classification and prediction (interpretability). We then provide guidelines for useful applications and pitfalls of such fMRI-based models in a clinical research context, looking beyond the current state of the art. In particular, we argue that the clinical relevance of fMRI calls for a new generation of models for fMRI data, which combine the strengths of both biophysical and decoding models. This leads to reliable and biologically meaningful model parameters, which thus fulfills the need for simultaneous interpretability and predictability. In our view, this synergy is fundamental for the discovery of new pharmacological and interventional targets, as well as the use of models as biomarkers in neurology and psychiatry.

Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network

Brain decoding is to predict the external stimulus information from the collected brain response activities, and visual information is one of the most important sources of external stimulus information. Decoding functional magnetic resonance imaging (fMRI) based on visual stimulation is helpful in understanding the working mechanism of the brain visual function regions. Traditional brain decoding algorithms cannot accurately extract stimuli features from fMRI. To address these shortcomings, this paper proposed a brain decoding algorithm based on a graph convolution network (GCN). Firstly, 11 regions of interest (ROI) were selected according to the human brain visual function regions, which can avoid the noise interference of the non-visual regions of the human brain; then, a deep three-dimensional convolution neural network was specially designed to extract the features of these 11 regions; next, the GCN was used to extract the functional correlation features between the different human brain visual regions. Furthermore, to avoid the problem of gradient disappearance when there were too many layers of graph convolutional neural network, the residual connections were adopted in our algorithm, which helped to integrate different levels of features in order to improve the accuracy of the proposed GCN. The proposed algorithm was tested on the public dataset, and the recognition accuracy reached 98.67%. Compared with the other state-of-the-art algorithms, the proposed algorithm performed the best.

Divergences Between Resting State Networks and Meta-Analytic Maps Of Task-Evoked Brain Activity

Background:

Spontaneous human neural activity is organized into resting state networks, complex patterns of synchronized activity that account for the major part of brain metabolism. The correspondence between these patterns and those elicited by the performance of cognitive tasks would suggest that spontaneous brain activity originates from the stream of ongoing cognitive processing.

Objective:

To investigate a large number of meta-analytic activation maps obtained from Neurosynth (www.neurosynth.org), establishing the extent of task-rest similarity in large-scale human brain activity.

Methods:

We applied a hierarchical module detection algorithm to the Neurosynth activation map similarity network, and then compared the average activation maps for each module with a set of resting state networks by means of spatial correlations.

Results:

We found that the correspondence between resting state networks and task-evoked activity tended to hold only for the largest spatial scales. We also established that this correspondence could be biased by the inclusion of maps related to neuroanatomical terms in the database (e.g. “parietal”, “occipital”, “cingulate”, etc.).

Conclusion:

Our results establish divergences between brain activity patterns related to spontaneous cognition and the spatial configuration of RSN, suggesting that anatomically-constrained homeostatic processes could play an important role in the inception and shaping of human resting state activity fluctuations.

Multi-centre classification of functional neurological disorders based on resting-state functional connectivity

•

Using machine learning on multi-centre data, FND patients were successfully classified with an accuracy of 72%.

•

The angular- and supramarginal gyri, cingular- and insular cortex, and the hippocampus were the most discriminant regions.

•

To provide diagnostic utility, future studies must include patients with similar symptoms but different diagnoses.

Background

Patients suffering from functional neurological disorder (FND) experience disabling neurological symptoms not caused by an underlying classical neurological disease (such as stroke or multiple sclerosis). The diagnosis is made based on reliable positive clinical signs, but clinicians often require additional time- and cost consuming medical tests and examinations. Resting-state functional connectivity (RS FC) showed its potential as an imaging-based adjunctive biomarker to help distinguish patients from healthy controls and could represent a “rule-in” procedure to assist in the diagnostic process. However, the use of RS FC depends on its applicability in a multi-centre setting, which is particularly susceptible to inter-scanner variability. The aim of this study was to test the robustness of a classification approach based on RS FC in a multi-centre setting.

Methods

This study aimed to distinguish 86 FND patients from 86 healthy controls acquired in four different centres using a multivariate machine learning approach based on whole-brain resting-state functional connectivity. First, previously published results were replicated in each centre individually (intra-centre cross-validation) and its robustness across inter-scanner variability was assessed by pooling all the data (pooled cross-validation). Second, we evaluated the generalizability of the method by using data from each centre once as a test set, and the data from the remaining centres as a training set (inter-centre cross-validation).

Results

FND patients were successfully distinguished from healthy controls in the replication step (accuracy of 74%) as well as in each individual additional centre (accuracies of 73%, 71% and 70%). The pooled cross validation confirmed that the classifier was robust with an accuracy of 72%. The results survived post-hoc adjustment for anxiety, depression, psychotropic medication intake, and symptom severity. The most discriminant features involved the angular- and supramarginal gyri, sensorimotor cortex, cingular- and insular cortex, and hippocampal regions. The inter-centre validation step did not exceed chance level (accuracy below 50%).

Conclusions

The results demonstrate the applicability of RS FC to correctly distinguish FND patients from healthy controls in different centres and its robustness against inter-scanner variability. In order to generalize its use across different centres and aim for clinical application, future studies should work towards optimization of acquisition parameters and include neurological and psychiatric control groups presenting with similar symptoms.

Digital Analysis of Smart Registration Methods for Magnetic Resonance Images in Public Healthcare

Brain development and atrophy accompany people's life. Brain development diseases, such as autism and Alzheimer's disease, affect a large part of the population. Analyzing brain development is very important in public healthcare, and image registration is essential in medical brain image analysis. Many previous studies investigate registration accuracy by the “ground truth” dataset, marker-based similarity calculation, and expert check to find the best registration algorithms. But the evaluation of image registration technology only at the accuracy level is not comprehensive. Here, we compare the performance of three publicly available registration techniques in brain magnetic resonance imaging (MRI) analysis based on some key features widely used in previous MRI studies for classification and detection tasks. According to the analysis results, SPM12 has a stable speed and success rate, and it always works as a guiding tool for newcomers to medical image analysis. It can preserve maximum contrast information, which will facilitate studies such as tumor diagnosis. FSL is a mature and widely applicable toolkit for users, with a relatively stable success rate and good performance. It has complete functions and its function-based integrated toolbox can meet the requirements of different researchers. AFNI is a flexible and complex tool that is more suitable for professional researchers. It retains most details in medical image analysis, which makes it useful in fine-grained analysis such as volume estimation. Our study provides a new idea for comparing registration tools, where tool selection strategy mainly depends on the research task in which the selected tool can leverage its unique advantages.

Preparing for a Second Attack: A Lesion Simulation Study on Network Resilience After Stroke

Background:

Does the brain become more resilient after a first stroke to reduce the consequences of a new lesion? Although recurrent strokes are a major clinical issue, whether and how the brain prepares for a second attack is unknown. This is due to the difficulties to obtain an appropriate dataset of stroke patients with comparable lesions, imaged at the same interval after onset. Furthermore, timing of the recurrent event remains unpredictable.

Methods:

Here, we used a novel clinical lesion simulation approach to test the hypothesis that resilience in brain networks increases during stroke recovery. Sixteen highly selected patients with a lesion restricted to the primary motor cortex were recruited. At 3 time points of the index event (10 days, 3 weeks, 3 months), we mimicked recurrent infarcts by deletion of nodes in brain networks (resting-state functional magnetic resonance imaging). Graph measures were applied to determine resilience (global efficiency after attack) and wiring cost (mean degree) of the network.

Results:

At 10 days and 3 weeks after stroke, resilience was similar in patients and controls. However, at 3 months, although motor function had fully recovered, resilience to clinically representative simulated lesions was higher compared to controls (cortical lesion P =0.012; subcortical: P =0.009; cortico-subcortical: P =0.009). Similar results were found after random ( P =0.012) and targeted ( P =0.015) attacks.

Conclusions:

Our results suggest that, in this highly selected cohort of patients with lesions restricted to the primary motor cortex, brain networks reconfigure to increase resilience to future insults. Lesion simulation is an innovative approach, which may have major implications for stroke therapy. Individualized neuromodulation strategies could be developed to foster resilient network reconfigurations after a first stroke to limit the consequences of future attacks.

Hypothesis of Cyclic Structures of Pre- and Consciousness as a Transition in Neuron-like Graphs to a Special Type of Symmetry

We study the proposed statistical kinetic model for describing the pre- and consciousness structures based on the cognitive neural networks. The method of statistics of the growth graph systems and a possible transition to symmetric structures (a kind of phase transition) is applied. With the complication of a random Erdőos-Rényi (ER) graph during the percolation transition from the tree structure to the large cluster structures is obtained. In the evolutionary model two classes of algorithms have been developed. The differences between the cycle parameters in the obtained neural network models can reach thousands or more times. This is due to the tree-like architecture of the neural graph, which mimics the columnar structures of the neocortex. These cluster and cyclic structures can be interpreted as the primary elements of consciousness and as a necessary condition for the effect of consciousness itself. The comparison with other known theoretical mainly statistical models of consciousness is discussed. The presented results are promising in neurocomputer interfaces, man-machine systems and artificial intelligence systems.

Modernistic and Emerging Developments of Nanotechnology in Glioblastoma-Targeted Theranostic Applications

Brain tumors such as glioblastoma are typically associated with an unstoppable cell proliferation with aggressive infiltration behavior and a shortened life span. Though treatment options such as chemotherapy and radiotherapy are available in combating glioblastoma, satisfactory therapeutics are still not available due to the high impermeability of the blood–brain barrier. To address these concerns, recently, multifarious theranostics based on nanotechnology have been developed, which can deal with diagnosis and therapy together. The multifunctional nanomaterials find a strategic path against glioblastoma by adjoining novel thermal and magnetic therapy approaches. Their convenient combination of specific features such as real-time tracking, in-depth tissue penetration, drug-loading capacity, and contrasting performance is of great demand in the clinical investigation of glioblastoma. The potential benefits of nanomaterials including specificity, surface tunability, biodegradability, non-toxicity, ligand functionalization, and near-infrared (NIR) and photoacoustic (PA) imaging are sufficient in developing effective theranostics. This review discusses the recent developments in nanotechnology toward the diagnosis, drug delivery, and therapy regarding glioblastoma.

Analyzing Complex Problem Solving by Dynamic Brain Networks

Complex problem solving is a high level cognitive task of the human brain, which has been studied over the last decade. Tower of London (TOL) is a game that has been widely used to study complex problem solving. In this paper, we aim to explore the underlying cognitive network structure among anatomical regions of complex problem solving and its subtasks, namely planning and execution. A new computational model for estimating a brain network at each time instant of fMRI recordings is proposed. The suggested method models the brain network as an Artificial Neural Network, where the weights correspond to the relationships among the brain anatomic regions. The first step of the model is preprocessing that manages to decrease the spatial redundancy while increasing the temporal resolution of the fMRI recordings. Then, dynamic brain networks are estimated using the preprocessed fMRI signal to train the Artificial Neural Network. The properties of the estimated brain networks are studied in order to identify regions of interest, such as hubs and subgroups of densely connected brain regions. The representation power of the suggested brain network is shown by decoding the planning and execution subtasks of complex problem solving. Our findings are consistent with the previous results of experimental psychology. Furthermore, it is observed that there are more hubs during the planning phase compared to the execution phase, and the clusters are more strongly connected during planning compared to execution.

Rapid encoding of musical tones discovered in whole-brain connectivity

Information encoding has received a wide neuroscientific attention, but the underlying rapid spatiotemporal brain dynamics remain largely unknown. Here, we investigated the rapid brain mechanisms for encoding of sounds forming a complex temporal sequence. Specifically, we used magnetoencephalography (MEG) to record the brain activity of 68 participants while they listened to a highly structured musical prelude. Functional connectivity analyses performed using phase synchronisation and graph theoretical measures showed a large network of brain areas recruited during encoding of sounds, comprising primary and secondary auditory cortices, frontal operculum, insula, hippocampus and basal ganglia. Moreover, our results highlighted the rapid transition of brain activity from primary auditory cortex to higher order association areas including insula and superior temporal pole within a whole-brain network, occurring during the first 220 ms of the encoding process. Further, we discovered that individual differences along cognitive abilities and musicianship modulated the degree centrality of the brain areas implicated in the encoding process. Indeed, participants with higher musical expertise presented a stronger centrality of superior temporal gyrus and insula, while individuals with high working memory abilities showed a stronger centrality of frontal operculum. In conclusion, our study revealed the rapid unfolding of brain network dynamics responsible for the encoding of sounds and their relationship with individual differences, showing a complex picture which extends beyond the well-known involvement of auditory areas. Indeed, our results expanded our understanding of the general mechanisms underlying auditory pattern encoding in the human brain.

Classification of emotion categories based on functional connectivity patterns of the human brain

Neurophysiological and psychological models posit that emotions depend on connections across wide-spread corticolimbic circuits. While previous studies using pattern recognition on neuroimaging data have shown differences between various discrete emotions in brain activity patterns, less is known about the differences in functional connectivity. Thus, we employed multivariate pattern analysis on functional magnetic resonance imaging data (i) to develop a pipeline for applying pattern recognition in functional connectivity data, and (ii) to test whether connectivity patterns differ across emotion categories. Six emotions (anger, fear, disgust, happiness, sadness, and surprise) and a neutral state were induced in 16 participants using one-minute-long emotional narratives with natural prosody while brain activity was measured with functional magnetic resonance imaging (fMRI). We computed emotion-wise connectivity matrices both for whole-brain connections and for 10 previously defined functionally connected brain subnetworks and trained an across-participant classifier to categorize the emotional states based on whole-brain data and for each subnetwork separately. The whole-brain classifier performed above chance level with all emotions except sadness, suggesting that different emotions are characterized by differences in large-scale connectivity patterns. When focusing on the connectivity within the 10 subnetworks, classification was successful within the default mode system and for all emotions. We thus show preliminary evidence for consistently different sustained functional connectivity patterns for instances of emotion categories particularly within the default mode system.

Periinfarct rewiring supports recovery after primary motor cortex stroke

After stroke restricted to the primary motor cortex (M1), it is uncertain whether network reorganization associated with recovery involves the periinfarct or more remote regions. We studied 16 patients with focal M1 stroke and hand paresis. Motor function and resting-state MRI functional connectivity (FC) were assessed at three time points: acute (<10 days), early subacute (3 weeks), and late subacute (3 months). FC correlates of recovery were investigated at three spatial scales, (i) ipsilesional non-infarcted M1, (ii) core motor network (M1, premotor cortex (PMC), supplementary motor area (SMA), and primary somatosensory cortex), and (iii) extended motor network including all regions structurally connected to the upper limb representation of M1. Hand dexterity was impaired only in the acute phase (P = 0.036). At a small spatial scale, clinical recovery was more frequently associated with connections involving ipsilesional non-infarcted M1 (Odds Ratio = 6.29; P = 0.036). At a larger scale, recovery correlated with increased FC strength in the core network compared to the extended motor network (rho = 0.71;P = 0.006). These results suggest that FC changes associated with motor improvement involve the perilesional M1 and do not extend beyond the core motor network. Core motor regions, and more specifically ipsilesional non-infarcted M1, could hence become primary targets for restorative therapies.

Learning brain dynamics for decoding and predicting individual differences

Insights from functional Magnetic Resonance Imaging (fMRI), as well as recordings of large numbers of neurons, reveal that many cognitive, emotional, and motor functions depend on the multivariate interactions of brain signals. To decode brain dynamics, we propose an architecture based on recurrent neural networks to uncover distributed spatiotemporal signatures. We demonstrate the potential of the approach using human fMRI data during movie-watching data and a continuous experimental paradigm. The model was able to learn spatiotemporal patterns that supported 15-way movie-clip classification (∼90%) at the level of brain regions, and binary classification of experimental conditions (∼60%) at the level of voxels. The model was also able to learn individual differences in measures of fluid intelligence and verbal IQ at levels comparable to that of existing techniques. We propose a dimensionality reduction approach that uncovers low-dimensional trajectories and captures essential informational (i.e., classification related) properties of brain dynamics. Finally, saliency maps and lesion analysis were employed to characterize brain-region/voxel importance, and uncovered how dynamic but consistent changes in fMRI activation influenced decoding performance. When applied at the level of voxels, our framework implements a dynamic version of multivariate pattern analysis. Our approach provides a framework for visualizing, analyzing, and discovering dynamic spatially distributed brain representations during naturalistic conditions.

Principles and open questions in functional brain network reconstruction

Graph theory is now becoming a standard tool in system-level neuroscience. However, endowing observed brain anatomy and dynamics with a complex network representation involves often covert theoretical assumptions and methodological choices which affect the way networks are reconstructed from experimental data, and ultimately the resulting network properties and their interpretation. Here, we review some fundamental conceptual underpinnings and technical issues associated with brain network reconstruction, and discuss how their mutual influence concurs in clarifying the organization of brain function.

Resample aggregating improves the generalizability of connectome predictive modeling

It is a longstanding goal of neuroimaging to produce reliable, generalizable models of brain behavior relationships. More recently, data driven predictive models have become popular. However, overfitting is a common problem with statistical models, which impedes model generalization. Cross validation (CV) is often used to estimate expected model performance within sample. Yet, the best way to generate brain behavior models, and apply them out-of-sample, on an unseen dataset, is unclear. As a solution, this study proposes an ensemble learning method, in this case resample aggregating, encompassing both model parameter estimation and feature selection. Here we investigate the use of resampled aggregated models when used to estimate fluid intelligence (fIQ) from fMRI based functional connectivity (FC) data. We take advantage of two large openly available datasets, the Human Connectome Project (HCP), and the Philadelphia Neurodevelopmental Cohort (PNC). We generate aggregated and non-aggregated models of fIQ in the HCP, using the Connectome Prediction Modelling (CPM) framework. Over various test-train splits, these models are evaluated in sample, on left-out HCP data, and out-of-sample, on PNC data. We find that a resample aggregated model performs best both within- and out-of-sample. We also find that feature selection can vary substantially within-sample. More robust feature selection methods, as detailed here, are needed to improve cross sample performance of CPM based brain behavior models.

Thoughts on neurophysiological signal analysis and classification

Neurophysiological signals are crucial intermediaries, through which brain activity can be quantitatively measured and brain mechanisms are able to be revealed. In particular, non‐invasive neurophysiological signals, such as electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), are welcomed and frequently utilised in various studies since these signals can be non‐invasively recorded without harming the human brain while they convey abundant information pertaining to brain activity. The recorded neurophysiological signals are analysed to mine meaningful information for the understanding of brain mechanisms or are classified to distinguish different patterns (e.g., different cognitive states, brain diseases versus healthy controls). To date, remarkable progress has been made in both the analysis and classification of neurophysiological signals, but scholars are not feeling complacent. Consistent effort ought to be paid to advance the research of analysis and classification based on neurophysiological signals. In this paper, I express my thoughts regarding promising future directions in neurophysiological signal analysis and classification based on current developments and accomplishments. I will elucidate the thoughts after brief summaries of relevant backgrounds, accomplishments, and tendencies. According to my personal selection and preference, I mainly focus on brain connectivity, multidimensional array (tensor), multi‐modality, multiple task classification, deep learning, big data, and naturalistic experiment. Hopefully, my thoughts could give a little help to inspire new ideas and contribute to the research of the analysis and classification of neurophysiological signals in some way.

The development of brain functional connectome during text reading

Reading is an important skill for human beings to obtain information, whose acquisition is a major learning task for children. Especially, compared with single word reading, text reading requires an integration of multiple cognitive processes, which makes its underlying neural developmental mechanism not only extremely complicated but also remained poorly understood. Employing the graph theory analysis method, the present study explored the development of brain in the context of story reading from the perspective of connectomics. Forty-two primary school students and thirty-two adults read the stories in the functional magnetic resonance imaging (fMRI) experiment. We found that compared with children, adults had increased connectivity strength, nodal degree, and modular interactions for vision-related and semantics-related brain regions while decreased connectivity strength, nodal degree, and modular interactions for phonology-related brain regions. Brain-behavior association analysis suggested that the transmission to vision-related brain circuits would enhance the reading performance in adults, whereas phonology-related brain circuits played important roles in children’s reading before they develop into fluent readers. Collectivity, we highlight a shift from reliance on phonology-related networks to semantics-related and vision-related networks with age for text reading, which provides insights into the underlying neural signature of developmental cognitive mechanisms.

Temporal complexity of fMRI is reproducible and correlates with higher order cognition

It has been hypothesized that resting state networks (RSNs), extracted from resting state functional magnetic resonance imaging (rsfMRI), likely display unique temporal complexity fingerprints, quantified by their multiscale entropy patterns (McDonough and Nashiro, 2014). This is a hypothesis with a potential capacity for developing digital biomarkers of normal brain function, as well as pathological brain dysfunction. Nevertheless, a limitation of McDonough and Nashiro (2014) was that rsfMRI data from only 20 healthy individuals was used for the analysis. To validate this hypothesis in a larger cohort, we used rsfMRI datasets of 987 healthy young adults from the Human Connectome Project (HCP), aged 22-35, each with four 14.4-min rsfMRI recordings and parcellated into 379 brain regions. We quantified multiscale entropy of rsfMRI time series averaged at different cortical and sub-cortical regions. We performed effect-size analysis on the data in 8 RSNs. Given that the morphology of multiscale entropy is affected by the choice of its tolerance parameter (r) and embedding dimension (m), we repeated the analyses at multiple values of r and m including the values used in McDonough and Nashiro (2014). Our results reinforced high temporal complexity in the default mode and frontoparietal networks. Lowest temporal complexity was observed in the subcortical areas and limbic system. We investigated the effect of temporal resolution (determined by the repetition time T_R) after downsampling of rsfMRI time series at two rates. At a low temporal resolution, we observed increased entropy and variance across datasets. Test-retest analysis showed that findings were likely reproducible across individuals over four rsfMRI runs, especially when the tolerance parameter r is equal to 0.5. The results confirmed that the relationship between functional brain connectivity strengths and rsfMRI temporal complexity changes over time scales. Finally, a non-random correlation was observed between temporal complexity of RSNs and fluid intelligence suggesting that complex dynamics of the human brain is an important attribute of high-level brain function.

Quantitative Identification of Functional Connectivity Disturbances in Neuropsychiatric Lupus Based on Resting-State fMRI: A Robust Machine Learning Approach

Neuropsychiatric systemic lupus erythematosus (NPSLE) is an autoimmune entity comprised of heterogenous syndromes affecting both the peripheral and central nervous system. Research on the pathophysiological substrate of NPSLE manifestations, including functional neuroimaging studies, is extremely limited. The present study examined person-specific patterns of whole-brain functional connectivity in NPSLE patients (n = 44) and age-matched healthy control participants (n = 39). Static functional connectivity graphs were calculated comprised of connection strengths between 90 brain regions. These connections were subsequently filtered through rigorous surrogate analysis, a technique borrowed from physics, novel to neuroimaging. Next, global as well as nodal network metrics were estimated for each individual functional brain network and were input to a robust machine learning algorithm consisting of a random forest feature selection and nested cross-validation strategy. The proposed pipeline is data-driven in its entirety, and several tests were performed in order to ensure model robustness. The best-fitting model utilizing nodal graph metrics for 11 brain regions was associated with 73.5% accuracy (74.5% sensitivity and 73% specificity) in discriminating NPSLE from healthy individuals with adequate statistical power. Closer inspection of graph metric values suggested an increased role within the functional brain network in NSPLE (indicated by higher nodal degree, local efficiency, betweenness centrality, or eigenvalue efficiency) as compared to healthy controls for seven brain regions and a reduced role for four areas. These findings corroborate earlier work regarding hemodynamic disturbances in these brain regions in NPSLE. The validity of the results is further supported by significant associations of certain selected graph metrics with accumulated organ damage incurred by lupus, with visuomotor performance and mental flexibility scores obtained independently from NPSLE patients.

Sustained effects of pleasant and unpleasant smells on resting state brain activity

Research suggests that transient emotional episodes produces sustained effects on psychological functions and brain activity during subsequent resting state. In this fMRI study we investigated whether transient emotions induced by smells could impact brain connectivity at rest in a valence-specific manner. The results suggest a sustained reconfiguration of parts of the default mode network which become more connected with areas implicated in olfactory processing, emotional learning, and action control. We found lingering effects of odorants on subsequent resting state that predominantly involved connections of the precuneus with a network comprising the insula, amygdala, medial orbital gyrus. Unpleasant smells in particular predicted greater coupling between insula, hippocampal structures, and prefrontal cortex, possible reflecting enhanced aversive learning and avoidance motivation. More broadly, our study illustrates a novel approach to characterize the impact of smells on brain function and differentiate the neural signatures of their valence, during task-free rest conditions.

Fine-grain atlases of functional modes for fMRI analysis

Population imaging markedly increased the size of functional-imaging datasets, shedding new light on the neural basis of inter-individual differences. Analyzing these large data entails new scalability challenges, computational and statistical. For this reason, brain images are typically summarized in a few signals, for instance reducing voxel-level measures with brain atlases or functional modes. A good choice of the corresponding brain networks is important, as most data analyses start from these reduced signals. We contribute finely-resolved atlases of functional modes, comprising from 64 to 1024 networks. These dictionaries of functional modes (DiFuMo) are trained on millions of fMRI functional brain volumes of total size 2.4 ​TB, spanned over 27 studies and many research groups. We demonstrate the benefits of extracting reduced signals on our fine-grain atlases for many classic functional data analysis pipelines: stimuli decoding from 12,334 brain responses, standard GLM analysis of fMRI across sessions and individuals, extraction of resting-state functional-connectomes biomarkers for 2500 individuals, data compression and meta-analysis over more than 15,000 statistical maps. In each of these analysis scenarii, we compare the performance of our functional atlases with that of other popular references, and to a simple voxel-level analysis. Results highlight the importance of using high-dimensional "soft" functional atlases, to represent and analyze brain activity while capturing its functional gradients. Analyses on high-dimensional modes achieve similar statistical performance as at the voxel level, but with much reduced computational cost and higher interpretability. In addition to making them available, we provide meaningful names for these modes, based on their anatomical location. It will facilitate reporting of results.

Tools of the Trade Multivoxel pattern analysis in fMRI: a practical introduction for social and affective neuroscientists

The family of neuroimaging analytical techniques known as multivoxel pattern analysis (MVPA) has dramatically increased in popularity over the past decade, particularly in social and affective neuroscience research using functional magnetic resonance imaging (fMRI). MVPA examines patterns of neural responses, rather than analyzing single voxel- or region-based values, as is customary in conventional univariate analyses. Here, we provide a practical introduction to MVPA and its most popular variants (namely, representational similarity analysis (RSA) and decoding analyses, such as classification using machine learning) for social and affective neuroscientists of all levels, particularly those new to such methods. We discuss how MVPA differs from traditional mass-univariate analyses, the benefits MVPA offers to social neuroscientists, experimental design and analysis considerations, step-by-step instructions for how to implement specific analyses in one's own dataset and issues that are currently facing research using MVPA methods.

Accurate prediction of individual subject identity and task, but not autism diagnosis, from functional connectomes

Despite enthusiasm about the potential for using fMRI-based functional connectomes in the development of biomarkers for autism spectrum disorder (ASD), the literature is full of negative findings-failures to distinguish ASD functional connectomes from those of typically developing controls (TD)-and positive findings that are inconsistent across studies. Here, we report on a new study designed to either better differentiate ASD from TD functional connectomes-or, alternatively, to refine our understanding of the factors underlying the current state of affairs. We scanned individuals with ASD and controls both at rest and while watching videos with social content. Using multiband fMRI across repeat sessions, we improved both data quantity and scanning duration by collecting up to 2 hr of data per individual. This is about 50 times the typical number of temporal samples per individual in ASD fcMRI studies. We obtained functional connectomes that were discriminable, allowing for near-perfect individual identification regardless of diagnosis, and equally reliable in both groups. However, contrary to what one might expect, we did not consistently or robustly observe in the ASD group either reductions in similarity to TD functional connectivity (FC) patterns or shared atypical FC patterns. Accordingly, FC-based predictions of diagnosis group achieved accuracy levels around chance. However, using the same approaches to predict scan type (rest vs. video) achieved near-perfect accuracy. Our findings suggest that neither the limitations of resting state as a "task," data resolution, data quantity, or scan duration can be considered solely responsible for failures to differentiate ASD from TD functional connectomes.

Resting-State Brain Activity for Early Prediction Outcome in Postanoxic Patients in a Coma with Indeterminate Clinical Prognosis

BACKGROUND AND PURPOSE

Early outcome prediction of postanoxic patients in a coma after cardiac arrest proves challenging. Current prognostication relies on multimodal testing, using clinical examination, electrophysiologic testing, biomarkers, and structural MR imaging. While this multimodal prognostication is accurate for predicting poor outcome (ie, death), it is not sensitive enough to identify good outcome (ie, consciousness recovery), thus leaving many patients with indeterminate prognosis. We specifically assessed whether resting-state fMRI provides prognostic information, notably in postanoxic patients in a coma with indeterminate prognosis early after cardiac arrest, specifically for good outcome.

MATERIALS AND METHODS

We used resting-state fMRI in a prospective study to compare whole-brain functional connectivity between patients with good and poor outcomes, implementing support vector machine learning. Then, we automatically predicted coma outcome using resting-state fMRI and also compared the prediction based on resting-state fMRI with the outcome prediction based on DWI.

RESULTS

Of 17 eligible patients who completed the study procedure (among 351 patients screened), 9 regained consciousness and 8 remained comatose. We found higher functional connectivity in patients recovering consciousness, with greater changes occurring within and between the occipitoparietal and temporofrontal regions. Coma outcome prognostication based on resting-state fMRI machine learning was very accurate, notably for identifying patients with good outcome (accuracy, 94.4%; area under the receiver operating curve, 0.94). Outcome predictors using resting-state fMRI performed significantly better (P < .05) than DWI (accuracy, 60.0%; area under the receiver operating curve, 0.63).

CONCLUSIONS

Indeterminate prognosis might lead to major clinical uncertainty and significant variations in life-sustaining treatments. Resting-state fMRI might bridge the gap left in early prognostication of postanoxic patients in a coma by identifying those with both good and poor outcomes.

The Development of a Practical Artificial Intelligence Tool for Diagnosing and Evaluating Autism Spectrum Disorder: Multicenter Study

Background

Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder with an unknown etiology. Early diagnosis and intervention are key to improving outcomes for patients with ASD. Structural magnetic resonance imaging (sMRI) has been widely used in clinics to facilitate the diagnosis of brain diseases such as brain tumors. However, sMRI is less frequently used to investigate neurological and psychiatric disorders, such as ASD, owing to the subtle, if any, anatomical changes of the brain.

Objective

This study aimed to investigate the possibility of identifying structural patterns in the brain of patients with ASD as potential biomarkers in the diagnosis and evaluation of ASD in clinics.

Methods

We developed a novel 2-level histogram-based morphometry (HBM) classification framework in which an algorithm based on a 3D version of the histogram of oriented gradients (HOG) was used to extract features from sMRI data. We applied this framework to distinguish patients with ASD from healthy controls using 4 datasets from the second edition of the Autism Brain Imaging Data Exchange, including the ETH Zürich (ETH), NYU Langone Medical Center: Sample 1, Oregon Health and Science University, and Stanford University (SU) sites. We used a stratified 10-fold cross-validation method to evaluate the model performance, and we applied the Naive Bayes approach to identify the predictive ASD-related brain regions based on classification contributions of each HOG feature.

Results

On the basis of the 3D HOG feature extraction method, our proposed HBM framework achieved an area under the curve (AUC) of >0.75 in each dataset, with the highest AUC of 0.849 in the ETH site. We compared the 3D HOG algorithm with the original 2D HOG algorithm, which showed an accuracy improvement of >4% in each dataset, with the highest improvement of 14% (6/42) in the SU site. A comparison of the 3D HOG algorithm with the scale-invariant feature transform algorithm showed an AUC improvement of >18% in each dataset. Furthermore, we identified ASD-related brain regions based on the sMRI images. Some of these regions (eg, frontal gyrus, temporal gyrus, cingulate gyrus, postcentral gyrus, precuneus, caudate, and hippocampus) are known to be implicated in ASD in prior neuroimaging literature. We also identified less well-known regions that may play unrecognized roles in ASD and be worth further investigation.

Conclusions

Our research suggested that it is possible to identify neuroimaging biomarkers that can distinguish patients with ASD from healthy controls based on the more cost-effective sMRI images of the brain. We also demonstrated the potential of applying data-driven artificial intelligence technology in the clinical setting of neurological and psychiatric disorders, which usually harbor subtle anatomical changes in the brain that are often invisible to the human eye.

Working memory load-dependent changes in cortical network connectivity estimated by machine learning

Working memory engages multiple distributed brain networks to support goal-directed behavior and higher order cognition. Dysfunction in working memory has been associated with cognitive impairment in neuropsychiatric disorders. It is important to characterize the interactions among cortical networks that are sensitive to working memory load since such interactions can also hint at the impaired dynamics in patients with poor working memory performance. Functional connectivity is a powerful tool used to investigate coordinated activity among local and distant brain regions. Here, we identified connectivity footprints that differentiate task states representing distinct working memory load levels. We employed linear support vector machines to decode working memory load from task-based functional connectivity matrices in 177 healthy adults. Using neighborhood component analysis, we also identified the most important connectivity pairs in classifying high and low working memory loads. We found that between-network coupling among frontoparietal, ventral attention and default mode networks, and within-network connectivity in ventral attention network are the most important factors in classifying low vs. high working memory load. Task-based within-network connectivity profiles at high working memory load in ventral attention and default mode networks were the most predictive of load-related increases in response times. Our findings reveal the large-scale impact of working memory load on the cerebral cortex and highlight the complex dynamics of intrinsic brain networks during active task states.

Construction, comparison and evolution of networks in life sciences and other disciplines

Network approaches have become pervasive in many research fields. They allow for a more comprehensive understanding of complex relationships between entities as well as their group-level properties and dynamics. Many networks change over time, be it within seconds or millions of years, depending on the nature of the network. Our focus will be on comparative network analyses in life sciences, where deciphering temporal network changes is a core interest of molecular, ecological, neuropsychological and evolutionary biologists. Further, we will take a journey through different disciplines, such as social sciences, finance and computational gastronomy, to present commonalities and differences in how networks change and can be analysed. Finally, we envision how borrowing ideas from these disciplines could enrich the future of life science research.

Neural circuits of idiopathic Normal Pressure Hydrocephalus: A perspective review of brain connectivity and symptoms meta-analysis

Idiopathic normal pressure hydrocephalus (iNPH) is a prevalent reversible neurological disorder characterized by impaired locomotion, cognition and urinary control with ventriculomegaly. Symptoms can be relieved with cerebrospinal fluid drainage, which makes iNPH the leading cause of reversible dementia. Because of a limited understanding of pathophysiological mechanisms, unspecific symptoms and the high prevalence of comorbidity (i.e. Alzheimer's disease), iNPH is largely underdiagnosed. For these reasons, there is an urgent need for developing noninvasive quantitative biomarkers for iNPH diagnosis and prognosis. Structural and functional changes of brain circuits in relation to symptoms and treatment response are expected to deliver major advances in this direction. We review structural and functional brain connectivity findings in iNPH and complement those findings with iNPH symptom meta-analyses in healthy populations. Our goal is to reinforce our conceptualization of iNPH as to brain network mechanisms and foster the development of new hypotheses for future research and treatment options.

Machine learning in resting-state fMRI analysis

Machine learning techniques have gained prominence for the analysis of resting-state functional Magnetic Resonance Imaging (rs-fMRI) data. Here, we present an overview of various unsupervised and supervised machine learning applications to rs-fMRI. We offer a methodical taxonomy of machine learning methods in resting-state fMRI. We identify three major divisions of unsupervised learning methods with regard to their applications to rs-fMRI, based on whether they discover principal modes of variation across space, time or population. Next, we survey the algorithms and rs-fMRI feature representations that have driven the success of supervised subject-level predictions. The goal is to provide a high-level overview of the burgeoning field of rs-fMRI from the perspective of machine learning applications.

Integrating functional connectivity and MVPA through a multiple constraint network analysis

Traditional general linear model-based brain mapping efforts using functional neuroimaging are complemented by more recent multivariate pattern analyses (MVPA) that apply machine learning techniques to identify the cognitive states associated with regional BOLD activation patterns, and by connectivity analyses that identify networks of interacting regions that support particular cognitive processes. We introduce a novel analysis representing the union of these approaches, and explore the insights gained when MVPA and functional connectivity analyses are allowed to mutually constrain each other within a single model. We explored multisensory semantic representations of concrete object concepts using a self-paced multisensory imagery task. Multilayer neural networks learned the real-world categories associated with macro-scale cortical BOLD activity patterns from the task, with some models additionally encoding regional functional connectivity. Models trained to encode functional connections demonstrated superior classification accuracy and more pronounced lesion-site appropriate category-specific impairments. We replicated these results in a data set from the openneuro.org open fMRI data repository. We conclude that mutually constrained network analyses encourage parsimonious models that may benefit from improved biological plausibility and facilitate discovery.

Interpretable, highly accurate brain decoding of subtly distinct brain states from functional MRI using intrinsic functional networks and long short-term memory recurrent neural networks

Decoding brain functional states underlying cognitive processes from functional MRI (fMRI) data using multivariate pattern analysis (MVPA) techniques has achieved promising performance for characterizing brain activation patterns and providing neurofeedback signals. However, it remains challenging to decode subtly distinct brain states for individual fMRI data points due to varying temporal durations and dependency among different cognitive processes. In this study, we develop a deep learning based framework for brain decoding by leveraging recent advances in intrinsic functional network modeling and sequence modeling using long short-term memory (LSTM) recurrent neural networks (RNNs). Particularly, subject-specific intrinsic functional networks (FNs) are computed from resting-state fMRI data and are used to characterize functional signals of task fMRI data with a compact representation for building brain decoding models, and LSTM RNNs are adopted to learn brain decoding mappings between functional profiles and brain states. Validation results on fMRI data from the HCP dataset have demonstrated that brain decoding models built on training data using the proposed method could learn discriminative latent feature representations and effectively distinguish subtly distinct working memory tasks of different subjects with significantly higher accuracy than conventional decoding models. Informative FNs of the brain decoding models identified as brain activation patterns of working memory tasks were largely consistent with the literature. The method also obtained promising decoding performance on motor and social cognition tasks. Our results suggest that LSTM RNNs in conjunction with FNs could build interpretable, highly accurate brain decoding models.

Implementation of High-Performance Correlation and Mapping Engine for Rapid Generation of Brain Connectivity Networks from Big fMRI Data

With the emergence of the dynamic functional connectivity analysis, and the studies relying on real-time neurological feedback, the need for rapid processing methods becomes even more critical. Seed-based Correlation Analysis (SCA) of fMRI data has been used to create brain connectivity networks. With close to a million voxels in a fMRI dataset, the number of calculations involved in SCA becomes high. This work aims to demonstrate a new approach which produces high-resolution brain connectivity maps rapidly. The results show that HPCME with four FPGAs can improve the SCA processing speed by a factor of 40 or more over that of a PC workstation with a multicore CPU.

NETWORK CLASSIFICATION WITH APPLICATIONS TO BRAIN CONNECTOMICS

While statistical analysis of a single network has received a lot of attention in recent years, with a focus on social networks, analysis of a sample of networks presents its own challenges which require a different set of analytic tools. Here we study the problem of classification of networks with labeled nodes, motivated by applications in neuroimaging. Brain networks are constructed from imaging data to represent functional connectivity between regions of the brain, and previous work has shown the potential of such networks to distinguish between various brain disorders, giving rise to a network classification problem. Existing approaches tend to either treat all edge weights as a long vector, ignoring the network structure, or focus on graph topology as represented by summary measures while ignoring the edge weights. Our goal is to design a classification method that uses both the individual edge information and the network structure of the data in a computationally efficient way, and that can produce a parsimonious and interpretable representation of differences in brain connectivity patterns between classes. We propose a graph classification method that uses edge weights as predictors but incorporates the network nature of the data via penalties that promote sparsity in the number of nodes, in addition to the usual sparsity penalties that encourage selection of edges. We implement the method via efficient convex optimization and provide a detailed analysis of data from two fMRI studies of schizophrenia.

Decoding disparity categories in 3-dimensional images from fMRI data using functional connectivity patterns

Humans use binocular disparity to extract depth information from two-dimensional retinal images in a process called stereopsis. Previous studies usually introduce the standard univariate analysis to describe the correlation between disparity level and brain activity within a given brain region based on functional magnetic resonance imaging (fMRI) data. Recently, multivariate pattern analysis has been developed to extract activity patterns across multiple voxels for deciphering categories of binocular disparity. However, the functional connectivity (FC) of patterns based on regions of interest or voxels and their mapping onto disparity category perception remain unknown. The present study extracted functional connectivity patterns for three disparity conditions (crossed disparity, uncrossed disparity, and zero disparity) at distinct spatial scales to decode the binocular disparity. Results of 27 subjects' fMRI data demonstrate that FC features are more discriminatory than traditional voxel activity features in binocular disparity classification. The average binary classification of the whole brain and visual areas are respectively 87% and 79% at single subject level, and thus above the chance level (50%). Our research highlights the importance of exploring functional connectivity patterns to achieve a novel understanding of 3D image processing.

Functional and effective connectivity based features of EEG signals for object recognition

Classifying different object categories is one of the most important aims of brain-computer interface researches. Recently, interactions between brain regions were studied using different methods, such as functional and effective connectivity techniques. Functional and effective connectivity techniques are applied to estimate human brain areas connectivity. The main purpose of this study is to compare classification accuracy of the most advanced functional and effective methods in order to classify 12 basic object categories using Electroencephalography (EEG) signals. In this paper, 19 channels EEG signals were collected from 10 healthy subjects; when they were visiting color images and instructed to select the target images among others. Correlation, magnitude square coherence, wavelet coherence (WC), phase synchronization and mutual information were applied to estimate functional cortical connectivity. On the other hand, directed transfer function, partial directed coherence, generalized partial directed coherence (GPDC) were used to obtain effective cortical connectivity. After feature extraction, the scalar feature selection methods including T-test and one-sided-anova were applied to rank and select the most informative features. The selected features were classified by a one-against-one support vector machine classifier. The results indicated that the use of different techniques led to different classifying accuracy and brain lobes analysis. WC and GPDC are the most accurate methods with performances of 80.15% and 64.43%, respectively.

Modeling the Switching Behavior of Functional Connectivity Microstates (FCμstates) as a Novel Biomarker for Mild Cognitive Impairment

The need for designing and validating novel biomarkers for the detection of mild cognitive impairment (MCI) is evident. MCI patients have a high risk of developing Alzheimer's disease (AD), and for that reason the introduction of novel and reliable biomarkers is of significant clinical importance. Motivated by recent findings on the rich information of dynamic functional connectivity graphs (DFCGs) about brain (dys) function, we introduced a novel approach of identifying MCI based on magnetoencephalographic (MEG) resting state recordings. The activity of different brain rhythms {δ, 𝜃, α1, α2, β1, β2, γ1, γ2} was first beamformed with linear constrained minimum norm variance in the MEG data to determine 90 anatomical regions of interest (ROIs). A DFCG was then estimated using the imaginary part of phase lag value (iPLV) for both intra-frequency coupling (8) and cross-frequency coupling pairs (28). We analyzed DFCG profiles of neuromagnetic resting state recordings of 18 MCI patients and 22 healthy controls. We followed our model of identifying the dominant intrinsic coupling mode (DICM) across MEG sources and temporal segments, which further leads to the construction of an integrated DFCG (iDFCG). We then filtered statistically and topologically every snapshot of the iDFCG with data-driven approaches. An estimation of the normalized Laplacian transformation for every temporal segment of the iDFCG and the related eigenvalues created a 2D map based on the network metric time series of the eigenvalues (NMTSeigs). The NMTSeigs preserves the non-stationarity of the fluctuated synchronizability of iDCFG for each subject. Employing the initial set of 20 healthy elders and 20 MCI patients, as training set, we built an overcomplete dictionary set of network microstates (n μstates). Afterward, we tested the whole procedure in an extra blind set of 20 subjects for external validation. We succeeded in gaining a high classification accuracy on the blind dataset (85%), which further supports the proposed Markovian modeling of the evolution of brain states. The adaptation of appropriate neuroinformatic tools that combine advanced signal processing and network neuroscience tools could properly manipulate the non-stationarity of time-resolved FC patterns revealing a robust biomarker for MCI.

System-level matching of structural and functional connectomes in the human brain

The brain can be considered as an information processing network, where complex behavior manifests as a result of communication between large-scale functional systems such as visual and default mode networks. As the communication between brain regions occurs through underlying anatomical pathways, it is important to define a "traffic pattern" that properly describes how the regions exchange information. Empirically, the choice of the traffic pattern can be made based on how well the functional connectivity between regions matches the structural pathways equipped with that traffic pattern. In this paper, we present a multimodal connectomics paradigm utilizing graph matching to measure similarity between structural and functional connectomes (derived from dMRI and fMRI data) at node, system, and connectome level. Through an investigation of the brain's structure-function relationship over a large cohort of 641 healthy developmental participants aged 8-22 years, we demonstrate that communicability as the traffic pattern describes the functional connectivity of the brain best, with large-scale systems having significant agreement between their structural and functional connectivity patterns. Notably, matching between structural and functional connectivity for the functionally specialized modular systems such as visual and motor networks are higher as compared to other more integrated systems. Additionally, we show that the negative functional connectivity between the default mode network (DMN) and motor, frontoparietal, attention, and visual networks is significantly associated with its underlying structural connectivity, highlighting the counterbalance between functional activation patterns of DMN and other systems. Finally, we investigated sex difference and developmental changes in brain and observed that similarity between structure and function changes with development.

Ranking Regions, Edges and Classifying Tasks in Functional Brain Graphs by Sub-Graph Entropy

This paper considers analysis of human brain networks or graphs constructed from time-series collected from functional magnetic resonance imaging (fMRI). In the network of time-series, the nodes describe the regions and the edge weights correspond to the absolute values of correlation coefficients of the time-series of the two nodes associated with the edges. The paper introduces a novel information-theoretic metric, referred as sub-graph entropy, to measure uncertainty associated with a sub-graph. Nodes and edges constitute two special cases of sub-graph structures. Node and edge entropies are used in this paper to rank regions and edges in a functional brain network. The paper analyzes task-fMRI data collected from 475 subjects in the Human Connectome Project (HCP) study for gambling and emotion tasks. The proposed approach is used to rank regions and edges associated with these tasks. The differential node (edge) entropy metric is defined as the difference of the node (edge) entropy corresponding to two different networks belonging to two different classes. Differential entropy of nodes and edges are used to rank top regions and edges associated with the two classes of data. Using top node and edge entropy features separately, two-class classifiers are designed using support vector machine (SVM) with radial basis function (RBF) kernel and leave-one-out method to classify time-series for emotion task vs. no-task, gambling task vs. no-task and emotion task vs. gambling task. Using node entropies, the SVM classifier achieves classification accuracies of 0.96, 0.97 and 0.98, respectively. Using edge entropies, the classifier achieves classification accuracies of 0.91, 0.96 and 0.94, respectively.