Deep learning for brain disorder diagnosis based on fMRI images

Decoding the application of deep learning in neuroscience: a bibliometric analysis

The application of deep learning in neuroscience holds unprecedented potential for unraveling the complex dynamics of the brain. Our bibliometric analysis, spanning from 2012 to 2023, delves into the integration of deep learning in neuroscience, shedding light on the evolutionary trends and identifying pivotal research hotspots. Through the examination of 421 articles, this study unveils a significant growth in interdisciplinary research, marked by the burgeoning application of deep learning techniques in understanding neural mechanisms and addressing neurological disorders. Central to our findings is the critical role of classification algorithms, models, and neural networks in advancing neuroscience, highlighting their efficacy in interpreting complex neural data, simulating brain functions, and translating theoretical insights into practical diagnostics and therapeutic interventions. Additionally, our analysis delineates a thematic evolution, showcasing a shift from foundational methodologies toward more specialized and nuanced approaches, particularly in areas like EEG analysis and convolutional neural networks. This evolution reflects the field's maturation and its adaptation to technological advancements. The study further emphasizes the importance of interdisciplinary collaborations and the adoption of cutting-edge technologies to foster innovation in decoding the cerebral code. The current study provides a strategic roadmap for future explorations, urging the scientific community toward areas ripe for breakthrough discoveries and practical applications. This analysis not only charts the past and present landscape of deep learning in neuroscience but also illuminates pathways for future research, underscoring the transformative impact of deep learning on our understanding of the brain.

Contrastive voxel clustering for multiscale modeling of brain network

Resting-state functional magnetic resonance imaging (fMRI) provides an efficient way to analyze the functional connectivity between brain regions. A comprehensive understanding of brain functionality requires a unified description of multi-scale layers of neural structure. However, existing brain network modeling methods often simplify this property by averaging Blood oxygen level dependent (BOLD) signals at the brain region level for fMRI-based analysis with the assumption that BOLD signals are homogeneous within each brain region, which ignores the heterogeneity of voxels within each Region of Interest (ROI). This study introduces a novel multi-stage self-supervised learning framework for multiscale brain network analysis, which effectively delineates brain functionality from voxel to ROIs and up to sample level. A Contrastive Voxel Clustering (CVC) module is proposed to simultaneously learn the voxel-level features and clustering assignments, which ensures the retention of informative clustering features at the finest voxel-level and concurrently preserves functional connectivity characteristics. Additionally, based on the extracted features and clustering assignments at the voxel level by CVC, a Brain ROI-based Graph Neural Network (BR-GNN) is built to extract functional connectivity features at the brain ROI-level and used for sample-level prediction, which integrates the functional clustering maps with the pre-established structural ROI maps and creates a more comprehensive and effective analytical tool. Experiments are performed on two datasets, which illustrate the effectiveness and generalization ability of the proposed method by analyzing voxel-level clustering results and brain ROIs-level functional characteristics. The proposed method provides a multiscale modeling framework for brain functional connectivity analysis, which will be further used for other brain disease identification. Code is available at https://github.com/yanliugroup/fmri-cvc.

Leveraging Brain Modularity Prior for Interpretable Representation Learning of fMRI

Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in the brain and is widely used for brain disorder analysis. Previous studies focus on extracting fMRI representations using machine/deep learning methods, but these features typically lack biological interpretability. The human brain exhibits a remarkable modular structure in spontaneous brain functional networks, with each module comprised of functionally interconnected brain regions-of-interest (ROIs). However, existing learning-based methods cannot adequately utilize such brain modularity prior. In this paper, we propose a brain modularity-constrained dynamic representation learning framework for interpretable fMRI analysis, consisting of dynamic graph construction, dynamic graph learning via a novel modularity-constrained graph neural network (MGNN), and prediction and biomarker detection. The designed MGNN is constrained by three core neurocognitive modules (i.e., salience network, central executive network, and default mode network), encouraging ROIs within the same module to share similar representations. To further enhance discriminative ability of learned features, we encourage the MGNN to preserve network topology of input graphs via a graph topology reconstruction constraint. Experimental results on 534 subjects with rs-fMRI scans from two datasets validate the effectiveness of the proposed method. The identified discriminative brain ROIs and functional connectivities can be regarded as potential fMRI biomarkers to aid in clinical diagnosis.

A review of ADHD detection studies with machine learning methods using rsfMRI data

Attention deficit hyperactivity disorder (ADHD) is a common mental health condition that significantly affects school-age children, causing difficulties with learning and daily functioning. Early identification is crucial, and reliable and objective diagnostic tools are necessary. However, current clinical evaluations of behavioral symptoms can be inconsistent and subjective. Functional magnetic resonance imaging (fMRI) is a non-invasive technique that has proven effective in detecting brain abnormalities in individuals with ADHD. Recent studies have shown promising outcomes in using resting state fMRI (rsfMRI)-based brain functional networks to diagnose various brain disorders, including ADHD. Several review papers have examined the detection of other diseases using fMRI data and machine learning or deep learning methods. However, no review paper has specifically addressed ADHD. Therefore, this study aims to contribute to the literature by reviewing the use of rsfMRI data and machine learning methods for detection of ADHD. The study provides general information about fMRI databases and detailed knowledge of the ADHD-200 database, which is commonly used for ADHD detection. It also emphasizes the importance of examining all stages of the process, including network and atlas selection, feature extraction, and feature selection, before the classification stage. The study compares the performance, advantages, and disadvantages of previous studies in detail. This comprehensive approach may be a useful starting point for new researchers in this area.

Extracting interpretable signatures of whole-brain dynamics through systematic comparison

The brain's complex distributed dynamics are typically quantified using a limited set of manually selected statistical properties, leaving the possibility that alternative dynamical properties may outperform those reported for a given application. Here, we address this limitation by systematically comparing diverse, interpretable features of both intra-regional activity and inter-regional functional coupling from resting-state functional magnetic resonance imaging (rs-fMRI) data, demonstrating our method using case-control comparisons of four neuropsychiatric disorders. Our findings generally support the use of linear time-series analysis techniques for rs-fMRI case-control analyses, while also identifying new ways to quantify informative dynamical fMRI structures. While simple statistical representations of fMRI dynamics performed surprisingly well (e.g., properties within a single brain region), combining intra-regional properties with inter-regional coupling generally improved performance, underscoring the distributed, multifaceted changes to fMRI dynamics in neuropsychiatric disorders. The comprehensive, data-driven method introduced here enables systematic identification and interpretation of quantitative dynamical signatures of multivariate time-series data, with applicability beyond neuroimaging to diverse scientific problems involving complex time-varying systems.

Assistive tools for classifying neurological disorders using fMRI and deep learning: A guide and example

BACKGROUND

Deep-learning (DL) methods are rapidly changing the way researchers classify neurological disorders. For example, combining functional magnetic resonance imaging (fMRI) and DL has helped researchers identify functional biomarkers of neurological disorders (e.g., brain activation and connectivity) and pilot innovative diagnostic models. However, the knowledge required to perform DL analyses is often domain-specific and is not widely taught in the brain sciences (e.g., psychology, neuroscience, and cognitive science). Conversely, neurological diagnoses and neuroimaging training (e.g., fMRI) are largely restricted to the brain and medical sciences. In turn, these disciplinary knowledge barriers and distinct specializations can act as hurdles that prevent the combination of fMRI and DL pipelines. The complexity of fMRI and DL methods also hinders their clinical adoption and generalization to real-world diagnoses. For example, most current models are not designed for clinical settings or use by nonspecialized populations such as students, clinicians, and healthcare workers. Accordingly, there is a growing area of assistive tools (e.g., software and programming packages) that aim to streamline and increase the accessibility of fMRI and DL pipelines for the diagnoses of neurological disorders.

OBJECTIVES AND METHODS

In this study, we present an introductory guide to some popular DL and fMRI assistive tools. We also create an example autism spectrum disorder (ASD) classification model using assistive tools (e.g., Optuna, GIFT, and the ABIDE preprocessed repository), fMRI, and a convolutional neural network.

RESULTS

In turn, we provide researchers with a guide to assistive tools and give an example of a streamlined fMRI and DL pipeline.

CONCLUSIONS

We are confident that this study can help more researchers enter the field and create accessible fMRI and deep-learning diagnostic models for neurological disorders.

Intra and inter-regional functional connectivity of the human brain due to Task-Evoked fMRI Data classification through CNN & LSTM

BACKGROUND AND PURPOSE

Olfaction is an early marker of neurodegenerative disease. Standard olfactory function is essential due to the importance of olfaction in human life. The psychophysical evaluation assesses the olfactory function commonly. It is patient-reported, and results rely on the patient's answers and collaboration. However, methodological difficulties attributed to the psychophysical evaluation of olfactory-related cerebral areas led to limited assessment of olfactory function in the human brain.

MATERIALS AND METHODS

The current study utilized clustering approaches to assess olfactory function in fMRI data and used brain activity to parcellate the brain with homogeneous properties. Deep neural network architecture based on ResNet convolutional neural networks (CNN) and Long Short-Term Model (LSTM) designed to classify healthy with olfactory disorders subjects.

RESULTS

The fMRI result obtained by k-means unsupervised machine learning model was within the expected outcome and similar to those found with the conn toolbox in detecting active areas. There was no significant difference between the means of subjects and every subject. Proposing a CRNN deep learning model to classify fMRI data in two different healthy and with olfactory disorders groups leads to an accuracy score of 97 %.

CONCLUSIONS

The K-means unsupervised algorithm can detect the active regions in the brain and analyze olfactory function. Classification results prove the CNN-LSTM architecture using ResNet provides the best accuracy score in olfactory fMRI data. It is the first attempt conducted on olfactory fMRI data in detail until now.

U-shaped convolutional transformer GAN with multi-resolution consistency loss for restoring brain functional time-series and dementia diagnosis

Introduction

The blood oxygen level-dependent (BOLD) signal derived from functional neuroimaging is commonly used in brain network analysis and dementia diagnosis. Missing the BOLD signal may lead to bad performance and misinterpretation of findings when analyzing neurological disease. Few studies have focused on the restoration of brain functional time-series data.

Methods

In this paper, a novel U-shaped convolutional transformer GAN (UCT-GAN) model is proposed to restore the missing brain functional time-series data. The proposed model leverages the power of generative adversarial networks (GANs) while incorporating a U-shaped architecture to effectively capture hierarchical features in the restoration process. Besides, the multi-level temporal-correlated attention and the convolutional sampling in the transformer-based generator are devised to capture the global and local temporal features for the missing time series and associate their long-range relationship with the other brain regions. Furthermore, by introducing multi-resolution consistency loss, the proposed model can promote the learning of diverse temporal patterns and maintain consistency across different temporal resolutions, thus effectively restoring complex brain functional dynamics.

Results

We theoretically tested our model on the public Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, and our experiments demonstrate that the proposed model outperforms existing methods in terms of both quantitative metrics and qualitative assessments. The model's ability to preserve the underlying topological structure of the brain functional networks during restoration is a particularly notable achievement.

Conclusion

Overall, the proposed model offers a promising solution for restoring brain functional time-series and contributes to the advancement of neuroscience research by providing enhanced tools for disease analysis and interpretation.

Deep social neuroscience: the promise and peril of using artificial neural networks to study the social brain

This review offers an accessible primer to social neuroscientists interested in neural networks. It begins by providing an overview of key concepts in deep learning. It then discusses three ways neural networks can be useful to social neuroscientists: (i) building statistical models to predict behavior from brain activity; (ii) quantifying naturalistic stimuli and social interactions; and (iii) generating cognitive models of social brain function. These applications have the potential to enhance the clinical value of neuroimaging and improve the generalizability of social neuroscience research. We also discuss the significant practical challenges, theoretical limitations and ethical issues faced by deep learning. If the field can successfully navigate these hazards, we believe that artificial neural networks may prove indispensable for the next stage of the field's development: deep social neuroscience.

Modeling default mode network patterns via a universal spatio-temporal brain attention skip network

Designing a comprehensive four-dimensional resting-state functional magnetic resonance imaging (4D Rs-fMRI) based default mode network (DMN) modeling methodology to reveal the spatio-temporal patterns of individual DMN, is crucial for understanding the cognitive mechanisms of the brain and the pathogenesis of psychiatric disorders. However, there are still two limitations of existing approaches for DMN modeling. The approaches either (1) simply split the spatio-temporal components and ignore the overall character of the spatio-temporal patterns or (2) are biased in the process of feature extraction for DMN modeling, and their spatio-temporal accuracy is thus not warranted. To this end, we propose a novel Spatio-Temporal Brain Attention Skip Network (STBAS-Net) to model the personalized spatio-temporal patterns of the DMN. STBAS-Net consists of spatial and temporal components, where the multi-head attention skip connection block in the spatial component achieves detailed feature extraction and enhancement in the shallow stage. Under the guidance of spatial information, we technically fuse multiple spatio-temporal information in the temporal component, which dexterously exploits the overall spatio-temporal features and achieves mutual constraints of spatio-temporal patterns to characterize the spatio-temporal patterns of the DMN. We verify the proposed STBAS-Net on a publicly released 4D Rs-fMRI dataset and an EMCI dataset. The experimental results show that compared with existing advanced methods, the proposed network can more accurately model the personalized spatio-temporal patterns of the human brain DMN and successfully identify abnormal spatio-temporal patterns in EMCI patients. This study provides a potential tool for revealing the spatio-temporal patterns of the human brain DMN and is expected to provide an effective methodological framework for future exploration of abnormal brain spatio-temporal patterns and modeling of other functional brain networks.

Adaptive 3DCNN-based Interpretable Ensemble Model for Early Diagnosis of Alzheimer's Disease

Adaptive interpretable ensemble model based on three-dimensional Convolutional Neural Network (3DCNN) and Genetic Algorithm (GA), i.e., 3DCNN+EL+GA, was proposed to differentiate the subjects with Alzheimer's Disease (AD) or Mild Cognitive Impairment (MCI) and further identify the discriminative brain regions significantly contributing to the classifications in a data-driven way. Plus, the discriminative brain sub-regions at a voxel level were further located in these achieved brain regions, with a gradient-based attribution method designed for CNN. Besides disclosing the discriminative brain sub-regions, the testing results on the datasets from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and the Open Access Series of Imaging Studies (OASIS) indicated that 3DCNN+EL+GA outperformed other state-of-the-art deep learning algorithms and that the achieved discriminative brain regions (e.g., the rostral hippocampus, caudal hippocampus, and medial amygdala) were linked to emotion, memory, language, and other essential brain functions impaired early in the AD process. Future research is needed to examine the generalizability of the proposed method and ideas to discern discriminative brain regions for other brain disorders, such as severe depression, schizophrenia, autism, and cerebrovascular diseases, using neuroimaging.

Deep learning-based multimodality classification of chronic mild traumatic brain injury using resting-state functional MRI and PET imaging

Mild traumatic brain injury (mTBI) is a public health concern. The present study aimed to develop an automatic classifier to distinguish between patients with chronic mTBI (n = 83) and healthy controls (HCs) (n = 40). Resting-state functional MRI (rs-fMRI) and positron emission tomography (PET) imaging were acquired from the subjects. We proposed a novel deep-learning-based framework, including an autoencoder (AE), to extract high-level latent and rectified linear unit (ReLU) and sigmoid activation functions. Single and multimodality algorithms integrating multiple rs-fMRI metrics and PET data were developed. We hypothesized that combining different imaging modalities provides complementary information and improves classification performance. Additionally, a novel data interpretation approach was utilized to identify top-performing features learned by the AEs. Our method delivered a classification accuracy within the range of 79-91.67% for single neuroimaging modalities. However, the performance of classification improved to 95.83%, thereby employing the multimodality model. The models have identified several brain regions located in the default mode network, sensorimotor network, visual cortex, cerebellum, and limbic system as the most discriminative features. We suggest that this approach could be extended to the objective biomarkers predicting mTBI in clinical settings.

An Umbrella Review of the Fusion of fMRI and AI in Autism

The role of functional magnetic resonance imaging (fMRI) is assuming an increasingly central role in autism diagnosis. The integration of Artificial Intelligence (AI) into the realm of applications further contributes to its development. This study's objective is to analyze emerging themes in this domain through an umbrella review, encompassing systematic reviews. The research methodology was based on a structured process for conducting a literature narrative review, using an umbrella review in PubMed and Scopus. Rigorous criteria, a standard checklist, and a qualification process were meticulously applied. The findings include 20 systematic reviews that underscore key themes in autism research, particularly emphasizing the significance of technological integration, including the pivotal roles of fMRI and AI. This study also highlights the enigmatic role of oxytocin. While acknowledging the immense potential in this field, the outcome does not evade acknowledging the significant challenges and limitations. Intriguingly, there is a growing emphasis on research and innovation in AI, whereas aspects related to the integration of healthcare processes, such as regulation, acceptance, informed consent, and data security, receive comparatively less attention. Additionally, the integration of these findings into Personalized Medicine (PM) represents a promising yet relatively unexplored area within autism research. This study concludes by encouraging scholars to focus on the critical themes of health domain integration, vital for the routine implementation of these applications.

Enhanced Dynamic Laterality Based on Functional Subnetworks in Patients with Bipolar Disorder

An ocean of studies have pointed to abnormal brain laterality changes in patients with bipolar disorder (BD). Determining the altered brain lateralization will help us to explore the pathogenesis of BD. Our study will fill the gap in the study of the dynamic changes of brain laterality in BD patients and thus provide new insights into BD research. In this work, we used fMRI data from 48 BD patients and 48 normal controls (NC). We constructed the dynamic laterality time series by extracting the dynamic laterality index (DLI) at each sliding window. We then used k-means clustering to partition the laterality states and the Arenas-Fernandez-Gomez (AFG) community detection algorithm to determine the number of states. We characterized subjects' laterality characteristics using the mean laterality index (MLI) and laterality fluctuation (LF). Compared with NC, in all windows and state 1, BD patients showed higher MLI in the attention network (AN) of the right hemisphere, and AN in the left hemisphere showed more frequent laterality fluctuations. AN in the left hemisphere of BD patients showed higher MLI in all windows and state 3 compared to NC. In addition, in the AN of the right hemisphere in state 1, higher MLI in BD patients was significantly associated with patient symptoms. Our study provides new insights into the understanding of BD neuropathology in terms of brain dynamic laterality.

Accelerated preprocessing of large numbers of brain images by parallel computing on supercomputers

"Preprocessing" is the first step required in brain image analysis that improves the overall quality and reliability of the results. However, it is computationally demanding and time-consuming, particularly to handle and parcellate complicatedly folded cortical ribbons of the human brain. In this study, we aimed to shorten the analysis time for data preprocessing of 1410 brain images simultaneously on one of the world's highest-performing supercomputers, "Fugaku." The FreeSurfer was used as a benchmark preprocessing software for cortical surface reconstruction. All the brain images were processed simultaneously and successfully analyzed in a calculation time of 17.33 h. This result indicates that using a supercomputer for brain image preprocessing allows big data analysis to be completed shortly and flexibly, thus suggesting the possibility of supercomputers being used for expanding large data analysis and parameter optimization of preprocessing in the future.

Classification of recurrent major depressive disorder using a new time series feature extraction method through multisite rs-fMRI data

BACKGROUND

Major depressive disorder (MDD) has a high rate of recurrence. Identifying patients with recurrent MDD is advantageous in adopting prevention strategies to reduce the disabling effects of depression.

METHOD

We propose a novel feature extraction method that includes dynamic temporal information, and inputs the extracted features into a graph convolutional network (GCN) to achieve classification of recurrent MDD. We extract the average time series using an atlas from resting-state functional magnetic resonance imaging (fMRI) data. Pearson correlation was calculated between brain region sequences at each time point, representing the functional connectivity at each time point. The connectivity is used as the adjacency matrix and the brain region sequences as node features for a GCN model to classify recurrent MDD. Gradient-weighted Class Activation Mapping (Grad-CAM) was used to analyze the contribution of different brain regions to the model. Brain regions making greater contribution to classification were considered to be the regions with altered brain function in recurrent MDD.

RESULT

We achieved a classification accuracy of 75.8 % for recurrent MDD on the multi-site dataset, the Rest-meta-MDD. The brain regions closely related to recurrent MDD have been identified.

LIMITATION

The pre-processing stage may affect the final classification performance and harmonizing site differences may improve the classification performance.

CONCLUSION

The experimental results demonstrate that the proposed method can effectively classify recurrent MDD and extract dynamic changes of brain activity patterns in recurrent depression.

Gender and cytoarchitecture differences: Functional connectivity of the hippocampal sub-regions

Introduction

The hippocampus plays a significant role in learning, memory encoding, and spatial navigation. Typically, the hippocampus is investigated as a whole region of interest. However, recent work has developed fully detailed atlases based on cytoarchitecture properties of brain regions, and the hippocampus has been sub-divided into seven sub-areas that have structural differences in terms of distinct numbers of cells, neurons, and other structural and chemical properties. Moreover, gender differences are of increasing concern in neuroscience research. Several neuroscience studies have found structural and functional variations between the brain regions of females and males, and the hippocampus is one of these regions.

Aim

The aim of this study to explore whether the cytoarchitecturally distinct sub-regions of the hippocampus have varying patterns of functional connectivity with different networks of the brain and how these functional connections differ in terms of gender differences.

Method

This study investigated 200 healthy participants using seed-based resting-state functional magnetic resonance imaging (rsfMRI). The primary aim of this study was to explore the resting connectivity and gender distinctions associated with specific sub-regions of the hippocampus and their relationship with major functional brain networks.

Results

The findings revealed that the majority of the seven hippocampal sub-regions displayed functional connections with key brain networks, and distinct patterns of functional connectivity were observed between the hippocampal sub-regions and various functional networks within the brain. Notably, the default and visual networks exhibited the most consistent functional connections. Additionally, gender-based analysis highlighted evident functional resemblances and disparities, particularly concerning the anterior section of the hippocampus.

Conclusion

This study highlighted the functional connectivity patterns and involvement of the hippocampal sub-regions in major brain functional networks, indicating that the hippocampus should be investigated as a region of multiple distinct functions and should always be examined as sub-regions of interest. The results also revealed clear gender differences in functional connectivity.

Single-label machine learning classification revealed some hidden but inter-related causes of five psychotic disorder diseases

Psychotic disorder diseases (PDD) or mental illnesses are group of illnesses that affect the minds and impair the cognitive ability, retard emotional ability and obstruct the process of communication and relationship with others and are characterized by delusions, hallucinations and disoriented or disordered pattern of thinking. Prognosis of PDD is not sufficient because of the nature of the diseases and as such adequate form of diagnosis is required to detect, manage and treat the illness. This paper applied the single-label classification (SLC) machine learning approach in mining of electronic health records of people with PDD in Nigeria using eleven independent (demographic) variables and five PDD as target variables. The five PDDs are Insomnia, Schizophrenia, Minimal Brain dysfunction (MBD), which is also known as Attention-Deficit/Hyperactivity Disorder (ADHD), Vascular Dementia (VD) and Bipolar Disorder (BD). The aim of using SLC is that it would be easier to detect some PDDs that are related to each other without the loss of information, which is a plus over multi-label classification (MLC). ReliefF algorithm was used at each experiment to precipitate the order of importance of the independent variables and redundant variables were excluded from the analysis. The order of the variables in feature selection was matched with feature importance after the classifications and quantified using the Spearman rank correlation coefficient. The data was divided into: 70% for training and 30% for testing. Four new performance metrics adapted from the root mean square (RMSE) were proposed and used to measure the differences between the performance results of the 10 Machine learning models in terms of the training and testing and secondly, feature and without feature selection. The new metrics are close to zero which is an indication that the use of feature selection and cross validation may not greatly affects the accuracy of the SLC. When the PDDs are included as predictors for classifying others, there was a tremendous improvement as revealed by the four new metrics for classification accuracy (CA), precision and recall. Analysis of variance showed the four different metrics differs significantly for classification accuracy (CA) and precision. However, there were no significant difference between the CA and precision when the duo are compared together across the four evaluation metrics at p value less than 0.05.

Dynamic weighted hypergraph convolutional network for brain functional connectome analysis

The hypergraph structure has been utilized to characterize the brain functional connectome (FC) by capturing the high order relationships among multiple brain regions of interest (ROIs) compared with a simple graph. Accordingly, hypergraph neural network (HGNN) models have emerged and provided efficient tools for hypergraph embedding learning. However, most existing HGNN models can only be applied to pre-constructed hypergraphs with a static structure during model training, which might not be a sufficient representation of the complex brain networks. In this study, we propose a dynamic weighted hypergraph convolutional network (dwHGCN) framework to consider a dynamic hypergraph with learnable hyperedge weights. Specifically, we generate hyperedges based on sparse representation and calculate the hyper similarity as node features. The hypergraph and node features are fed into a neural network model, where the hyperedge weights are updated adaptively during training. The dwHGCN facilitates the learning of brain FC features by assigning larger weights to hyperedges with higher discriminative power. The weighting strategy also improves the interpretability of the model by identifying the highly active interactions among ROIs shared by a common hyperedge. We validate the performance of the proposed model on two classification tasks with three paradigms functional magnetic resonance imaging (fMRI) data from Philadelphia Neurodevelopmental Cohort. Experimental results demonstrate the superiority of our proposed method over existing hypergraph neural networks. We believe our model can be applied to other applications in neuroimaging for its strength in representation learning and interpretation.

Evaluation of boundaries between mood and psychosis disorder using dynamic functional network connectivity (dFNC) via deep learning classification

The validity and reliability of diagnoses in psychiatry is a challenging topic in mental health. The current mental health categorization is based primarily on symptoms and clinical course and is not biologically validated. Among multiple ongoing efforts, neurological observations alongside clinical evaluations are considered to be potential solutions to address diagnostic problems. The Bipolar-Schizophrenia Network on Intermediate Phenotypes (B-SNIP) has published multiple papers attempting to reclassify psychotic illnesses based on biological rather than symptomatic measures. However, the effort to investigate the relationship between this new categorization approach and other neuroimaging techniques, including resting-state fMRI data, is still limited. This study focused on investigating the relationship between different psychotic disorders categorization methods and resting-state fMRI-based measures called dynamic functional network connectivity (dFNC) using state-of-the-art artificial intelligence (AI) approaches. We applied our method to 613 subjects, including individuals with psychosis and healthy controls, which were classified using both the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) and the B-SNIP biomarker-based (Biotype) approach. Statistical group differences and cross-validated classifiers were performed within each framework to assess how different categories. Results highlight interesting differences in occupancy in both DSM-IV and Biotype categorizations compared to healthy individuals, which are distributed across specific transient connectivity states. Biotypes tended to show less distinctiveness in occupancy level and included fewer cellwise differences. Classification accuracy obtained by DSM-IV and Biotype categories were both well above chance. Results provided new insights and highlighted the benefits of both DSM-IV and biology-based categories while also emphasizing the importance of future work in this direction, including employing further data types.

Sparse non-convex regularization based explainable DBN in the analysis of brain abnormalities in schizophrenia

Deep belief networks have been widely used in medical image analysis. However, the high-dimensional but small-sample-size characteristic of medical image data makes the model prone to dimensional disaster and overfitting. Meanwhile, the traditional DBN is driven by performance and ignores the explainability which is important for medical image analysis. In this paper, a sparse non-convex based explainable deep belief network is proposed by combining DBN with non-convex sparsity learning. For sparsity, the non-convex regularization and Kullback-Leibler divergence penalty are embedded into DBN to obtain the sparse connection and sparse response representation of the network. It effectively reduces the complexity of the model and improves the generalization ability of the model. Considering explainability, the crucial features for decision-making are selected through the feature back-selection based on the row norm of each layer's weight after network training. We apply the model to schizophrenia data and demonstrate it achieves the best performance among several typical feature selection models. It reveals 28 functional connections highly correlated with schizophrenia, which provides an effective foundation for the treatment and prevention of schizophrenia and methodological assurance for similar brain disorders.

Small hand-designed convolutional neural networks outperform transfer learning in automated cell shape detection in confluent tissues

Mechanical cues such as stresses and strains are now recognized as essential regulators in many biological processes like cell division, gene expression or morphogenesis. Studying the interplay between these mechanical cues and biological responses requires experimental tools to measure these cues. In the context of large scale tissues, this can be achieved by segmenting individual cells to extract their shapes and deformations which in turn inform on their mechanical environment. Historically, this has been done by segmentation methods which are well known to be time consuming and error prone. In this context however, one doesn't necessarily require a cell-level description and a coarse-grained approach can be more efficient while using tools different from segmentation. The advent of machine learning and deep neural networks has revolutionized the field of image analysis in recent years, including in biomedical research. With the democratization of these techniques, more and more researchers are trying to apply them to their own biological systems. In this paper, we tackle a problem of cell shape measurement thanks to a large annotated dataset. We develop simple Convolutional Neural Networks (CNNs) which we thoroughly optimize in terms of architecture and complexity to question construction rules usually applied. We find that increasing the complexity of the networks rapidly no longer yields improvements in performance and that the number of kernels in each convolutional layer is the most important parameter to achieve good results. In addition, we compare our step-by-step approach with transfer learning and find that our simple, optimized CNNs give better predictions, are faster in training and analysis and don't require more technical knowledge to be implemented. Overall, we offer a roadmap to develop optimized models and argue that we should limit the complexity of such models. We conclude by illustrating this strategy on a similar problem and dataset.

Can MRI Be Used as a Sensor to Record Neural Activity?

Magnetic resonance provides exquisite anatomical images and functional MRI monitors physiological activity by recording blood oxygenation. This review attempts to answer the following question: Can MRI be used as a sensor to directly record neural behavior? It considers MRI sensing of electrical activity in the heart and in peripheral nerves before turning to the central topic: recording of brain activity. The primary hypothesis is that bioelectric current produced by a nerve or muscle creates a magnetic field that influences the magnetic resonance signal, although other mechanisms for detection are also considered. Recent studies have provided evidence that using MRI to sense neural activity is possible under ideal conditions. Whether it can be used routinely to provide functional information about brain processes in people remains an open question. The review concludes with a survey of artificial intelligence techniques that have been applied to functional MRI and may be appropriate for MRI sensing of neural activity.

Prediction of Tinnitus Treatment Outcomes Based on EEG Sensors and TFI Score Using Deep Learning

Tinnitus is a hearing disorder that is characterized by the perception of sounds in the absence of an external source. Currently, there is no pharmaceutical cure for tinnitus, however, multiple therapies and interventions have been developed that improve or control associated distress and anxiety. We propose a new Artificial Intelligence (AI) algorithm as a digital prognostic health system that models electroencephalographic (EEG) data in order to predict patients' responses to tinnitus therapies. The EEG data was collected from patients prior to treatment and 3-months following a sound-based therapy. Feature selection techniques were utilised to identify predictive EEG variables with the best accuracy. The patients' EEG features from both the frequency and functional connectivity domains were entered as inputs that carry knowledge extracted from EEG into AI algorithms for training and predicting therapy outcomes. The AI models differentiated the patients' outcomes into either therapy responder or non-responder, as defined by their Tinnitus Functional Index (TFI) scores, with accuracies ranging from 98%-100%. Our findings demonstrate the potential use of AI, including deep learning, for predicting therapy outcomes in tinnitus. The research suggests an optimal configuration of the EEG sensors that are involved in measuring brain functional changes in response to tinnitus treatments. It identified which EEG electrodes are the most informative sensors and how the EEG frequency and functional connectivity can better classify patients into the responder and non-responder groups. This has potential for real-time monitoring of patient therapy outcomes at home.

A transformer model for learning spatiotemporal contextual representation in fMRI data

Representation learning is a core component in data-driven modeling of various complex phenomena. Learning a contextually informative representation can especially benefit the analysis of fMRI data because of the complexities and dynamic dependencies present in such datasets. In this work, we propose a framework based on transformer models to learn an embedding of the fMRI data by taking the spatiotemporal contextual information in the data into account. This approach takes the multivariate BOLD time series of the regions of the brain as well as their functional connectivity network simultaneously as the input to create a set of meaningful features that can in turn be used in various downstream tasks such as classification, feature extraction, and statistical analysis. The proposed spatiotemporal framework uses the attention mechanism as well as the graph convolution neural network to jointly inject the contextual information regarding the dynamics in time series data and their connectivity into the representation. We demonstrate the benefits of this framework by applying it to two resting-state fMRI datasets, and provide further discussion on various aspects and advantages of it over a number of other commonly adopted architectures.

On the benefits of self-taught learning for brain decoding

CONTEXT

We study the benefits of using a large public neuroimaging database composed of functional magnetic resonance imaging (fMRI) statistic maps, in a self-taught learning framework, for improving brain decoding on new tasks. First, we leverage the NeuroVault database to train, on a selection of relevant statistic maps, a convolutional autoencoder to reconstruct these maps. Then, we use this trained encoder to initialize a supervised convolutional neural network to classify tasks or cognitive processes of unseen statistic maps from large collections of the NeuroVault database.

RESULTS

We show that such a self-taught learning process always improves the performance of the classifiers, but the magnitude of the benefits strongly depends on the number of samples available both for pretraining and fine-tuning the models and on the complexity of the targeted downstream task.

CONCLUSION

The pretrained model improves the classification performance and displays more generalizable features, less sensitive to individual differences.

Decoding degeneration: the implementation of machine learning for clinical detection of neurodegenerative disorders

Machine learning represents a growing subfield of artificial intelligence with much promise in the diagnosis, treatment, and tracking of complex conditions, including neurodegenerative disorders such as Alzheimer's and Parkinson's diseases. While no definitive methods of diagnosis or treatment exist for either disease, researchers have implemented machine learning algorithms with neuroimaging and motion-tracking technology to analyze pathologically relevant symptoms and biomarkers. Deep learning algorithms such as neural networks and complex combined architectures have proven capable of tracking disease-linked changes in brain structure and physiology as well as patient motor and cognitive symptoms and responses to treatment. However, such techniques require further development aimed at improving transparency, adaptability, and reproducibility. In this review, we provide an overview of existing neuroimaging technologies and supervised and unsupervised machine learning techniques with their current applications in the context of Alzheimer's and Parkinson's diseases.

An automatic and intelligent brain tumor detection using Lee sigma filtered histogram segmentation model

Brain tumors are the second important origin of death worldwide. The early and exact identification of brain tumors is significant for the healing process. With accelerating diagnoses, medicine as well as pricing, quantum computing permits disruptive cases to providers. Quantum improved deep learning was especially significant to the sector. However, the conventional machine learning method faces main challenges to achieve accurate brain tumor detection with MRI images. Therefore, this paper proposes a novel technique called Lee sigma filtered histogram segmentation (LSFHS) for accurately detecting brain tumors with minimal time consumption. LSFHS technique is based on preprocessing, segmentation, feature extraction and classification. Input MRI image is preprocessed using adaptive Lee sigma filter in the first hidden layer to minimize noise significantly. In hidden layer 2, gray bimodal histogram segmentation is performed to partition a preprocessed image into a number of segments. Multiple features are extracted from the input image in the third hidden layer. Output layer uses the TanH activation function to match extracted features with disease features for detecting brain tumors. Experimental evaluation is carried out on factors, namely peak signal-to-noise ratio, tumor detection accuracy, error rate and tumor detection with a number of MRI images. The results illustrate LSFHS technique increases tumor detection accuracy by 14% and 25% faster tumor detection time, and reduces the error rate by 58% compared to state-of-the-art works. Qualitative and quantitative results illustrate that our proposed LSFHS technique attains greater performance than state-of-the-art methods. LSFHS technique is designed to detect brain tumors at an earlier stage with higher tumor detection accuracy and less time.

Attention module improves both performance and interpretability of four-dimensional functional magnetic resonance imaging decoding neural network

Decoding brain cognitive states from neuroimaging signals is an important topic in neuroscience. In recent years, deep neural networks (DNNs) have been recruited for multiple brain state decoding and achieved good performance. However, the open question of how to interpret the DNN black box remains unanswered. Capitalizing on advances in machine learning, we integrated attention modules into brain decoders to facilitate an in‐depth interpretation of DNN channels. A four‐dimensional (4D) convolution operation was also included to extract temporo‐spatial interaction within the fMRI signal. The experiments showed that the proposed model obtains a very high accuracy (97.4%) and outperforms previous researches on the seven different task benchmarks from the Human Connectome Project (HCP) dataset. The visualization analysis further illustrated the hierarchical emergence of task‐specific masks with depth. Finally, the model was retrained to regress individual traits within the HCP and to classify viewing images from the BOLD5000 dataset, respectively. Transfer learning also achieves good performance. Further visualization analysis shows that, after transfer learning, low‐level attention masks remained similar to the source domain, whereas high‐level attention masks changed adaptively. In conclusion, the proposed 4D model with attention module performed well and facilitated interpretation of DNNs, which is helpful for subsequent research.

Identification of Autism Subtypes Based on Wavelet Coherence of BOLD FMRI Signals Using Convolutional Neural Network

The functional connectivity (FC) patterns of resting-state functional magnetic resonance imaging (rs-fMRI) play an essential role in the development of autism spectrum disorders (ASD) classification models. There are available methods in literature that have used FC patterns as inputs for binary classification models, but the results barely reach an accuracy of 80%. Additionally, the generalizability across multiple sites of the models has not been investigated. Due to the lack of ASD subtypes identification model, the multi-class classification is proposed in the present study. This study aims to develop automated identification of autism spectrum disorder (ASD) subtypes using convolutional neural networks (CNN) using dynamic FC as its inputs. The rs-fMRI dataset used in this study consists of 144 individuals from 8 independent sites, labeled based on three ASD subtypes, namely autistic disorder (ASD), Asperger’s disorder (APD), and pervasive developmental disorder not otherwise specified (PDD-NOS). The blood-oxygen-level-dependent (BOLD) signals from 116 brain nodes of automated anatomical labeling (AAL) atlas are used, where the top-ranked node is determined based on one-way analysis of variance (ANOVA) of the power spectral density (PSD) values. Based on the statistical analysis of the PSD values of 3-level ASD and normal control (NC), putamen_R is obtained as the top-ranked node and used for the wavelet coherence computation. With good resolution in time and frequency domain, scalograms of wavelet coherence between the top-ranked node and the rest of the nodes are used as dynamic FC feature input to the convolutional neural networks (CNN). The dynamic FC patterns of wavelet coherence scalogram represent phase synchronization between the pairs of BOLD signals. Classification algorithms are developed using CNN and the wavelet coherence scalograms for binary and multi-class identification were trained and tested using cross-validation and leave-one-out techniques. Results of binary classification (ASD vs. NC) and multi-class classification (ASD vs. APD vs. PDD-NOS vs. NC) yielded, respectively, 89.8% accuracy and 82.1% macro-average accuracy, respectively. Findings from this study have illustrated the good potential of wavelet coherence technique in representing dynamic FC between brain nodes and open possibilities for its application in computer aided diagnosis of other neuropsychiatric disorders, such as depression or schizophrenia.