Multimodal classification of drug-naïve first-episode schizophrenia combining anatomical, diffusion and resting state functional resonance imaging

The network characteristics in schizophrenia with prominent negative symptoms: a multimodal fusion study

Previous studies on putative neural mechanisms of negative symptoms in schizophrenia mainly used single modal imaging data, and seldom utilized schizophrenia patients with prominent negative symptoms (PNS).This study adopted the multimodal fusion method and recruited a homogeneous sample with PNS. We aimed to identify negative symptoms-related structural and functional neural correlates of schizophrenia. Structural magnetic resonance imaging (sMRI) and resting-state functional MRI (rs-fMRI) were performed in 31 schizophrenia patients with PNS and 33 demographically matched healthy controls.Compared to healthy controls, schizophrenia patients with PNS exhibited significantly altered functional activations in the default mode network (DMN) and had structural gray matter volume (GMV) alterations in the cerebello-thalamo-cortical network. Correlational analyses showed that negative symptoms severity was significantly correlated with the cerebello-thalamo-cortical structural network, but not with the DMN network in schizophrenia patients with PNS.Our findings highlight the important role of the cerebello-thalamo-cortical structural network underpinning the neuropathology of negative symptoms in schizophrenia. Future research should recruit a large sample and schizophrenia patients without PNS, and apply adjustments for multiple comparison, to verify our preliminary findings.

A meta-analysis and systematic review of single vs. multimodal neuroimaging techniques in the classification of psychosis

BACKGROUND

Psychotic disorders are characterized by structural and functional abnormalities in brain networks. Neuroimaging techniques map and characterize such abnormalities using unique features (e.g., structural integrity, coactivation). However, it is unclear if a specific method, or a combination of modalities, is particularly effective in identifying differences in brain networks of someone with a psychotic disorder.

METHODS

A systematic meta-analysis evaluated machine learning classification of schizophrenia spectrum disorders in comparison to healthy control participants using various neuroimaging modalities (i.e., T1-weighted imaging (T1), diffusion tensor imaging (DTI), resting state functional connectivity (rs-FC), or some combination (multimodal)). Criteria for manuscript inclusion included whole-brain analyses and cross-validation to provide a complete picture regarding the predictive ability of large-scale brain systems in psychosis. For this meta-analysis, we searched Ovid MEDLINE, PubMed, PsychInfo, Google Scholar, and Web of Science published between inception and March 13th 2023. Prediction results were averaged for studies using the same dataset, but parallel analyses were run that included studies with pooled sample across many datasets. We assessed bias through funnel plot asymmetry. A bivariate regression model determined whether differences in imaging modality, demographics, and preprocessing methods moderated classification. Separate models were run for studies with internal prediction (via cross-validation) and external prediction.

RESULTS

93 studies were identified for quantitative review (30 T1, 9 DTI, 40 rs-FC, and 14 multimodal). As a whole, all modalities reliably differentiated those with schizophrenia spectrum disorders from controls (OR = 2.64 (95%CI = 2.33 to 2.95)). However, classification was relatively similar across modalities: no differences were seen across modalities in the classification of independent internal data, and a small advantage was seen for rs-FC studies relative to T1 studies in classification in external datasets. We found large amounts of heterogeneity across results resulting in significant signs of bias in funnel plots and Egger's tests. Results remained similar, however, when studies were restricted to those with less heterogeneity, with continued small advantages for rs-FC relative to structural measures. Notably, in all cases, no significant differences were seen between multimodal and unimodal approaches, with rs-FC and unimodal studies reporting largely overlapping classification performance. Differences in demographics and analysis or denoising were not associated with changes in classification scores.

CONCLUSIONS

The results of this study suggest that neuroimaging approaches have promise in the classification of psychosis. Interestingly, at present most modalities perform similarly in the classification of psychosis, with slight advantages for rs-FC relative to structural modalities in some specific cases. Notably, results differed substantially across studies, with suggestions of biased effect sizes, particularly highlighting the need for more studies using external prediction and large sample sizes. Adopting more rigorous and systematized standards will add significant value toward understanding and treating this critical population.

Constructing the Schizophrenia Recognition Method Employing GLCM Features from Multiple Brain Regions and Machine Learning Techniques

Accurately diagnosing schizophrenia, a complex psychiatric disorder, is crucial for effectively managing the treatment process and methods. Various types of magnetic resonance (MR) images have the potential to serve as biomarkers for schizophrenia. The aim of this study is to numerically analyze differences in the textural characteristics that may occur in the bilateral amygdala, caudate, pallidum, putamen, and thalamus regions of the brain between individuals with schizophrenia and healthy controls via structural MR images. Towards this aim, Gray Level Co-occurence Matrix (GLCM) features obtained from five regions of the right, left, and bilateral brain were classified using machine learning methods. In addition, it was analyzed in which hemisphere these features were more distinctive and which method among Adaboost, Gradient Boost, eXtreme Gradient Boosting, Random Forest, k-Nearest Neighbors, Linear Discriminant Analysis (LDA), and Naive Bayes had higher classification success. When the results were examined, it was demonstrated that the GLCM features of these five regions in the left hemisphere could be classified as having higher performance in schizophrenia compared to healthy individuals. Using the LDA algorithm, classification success was achieved with a 100% AUC, 94.4% accuracy, 92.31% sensitivity, 100% specificity, and an F1 score of 91.9% in healthy and schizophrenic individuals. Thus, it has been revealed that the textural characteristics of the five predetermined regions, instead of the whole brain, are an important indicator in identifying schizophrenia.

Neuronal dysfunction in individuals at early stage of schizophrenia, A resting-state fMRI study

Schizophrenia has been associated with abnormal intrinsic brain activity, involving various cognitive impairments. Qualitatively similar abnormalities are seen in individuals at ultra-high risk (UHR) for psychosis. In this study, resting-state fMRI (rs-fMRI) data were collected from 44 drug-naïve first-episode schizophrenia (Dn-FES) patients, 48 UHR individuals, and 40 healthy controls (HCs). The fractional amplitude of low-frequency fluctuations (fALFF), regional homogeneity (ReHo), and functional connectivity (FC), were performed to evaluate resting brain function. A support vector machine (SVM) was applied for classification analysis. Compared to HCs, both clinical groups showed increased fALFF in the central executive network (CEN), decreased ReHo in the ventral visual pathway (VVP) and decreased FC in temporal-sensorimotor regions. Excellent performance was achieved by using fALFF value in distinguishing both FES (sensitivity=83.21%, specificity=80.58%, accuracy=81.37%, p=0.009) and UHR (sensitivity=75.88%, specificity=85.72%, accuracy=80.72%, p<0.001) from HC group. Moreover, the study highlighted the importance of frontal and temporal alteration in the pathogenesis of schizophrenia. However, no fMRI features were observed that could well distinguish Dn-FES from UHR group. To conclude, fALFF in the CEN may provide potential power for identifying individuals at the early stage of schizophrenia and the alteration in the frontal and temporal lobe may be important to these individuals.

Classification of Preschoolers with Low-Functioning Autism Spectrum Disorder Using Multimodal MRI Data

Multimodal imaging studies targeting preschoolers and low-functioning autism spectrum disorder (ASD) patients are scarce. We applied machine learning classifiers to parameters from T1-weighted MRI and DTI data of 58 children with ASD (age 3-6 years) and 48 typically developing controls (TDC). Classification performance reached an accuracy, sensitivity, and specificity of 88.8%, 93.0%, and 83.8%, respectively. The most prominent features were the cortical thickness of the right inferior occipital gyrus, mean diffusivity of the middle cerebellar peduncle, and nodal efficiency of the left posterior cingulate gyrus. Machine learning-based analysis of MRI data was useful in distinguishing low-functioning ASD preschoolers from TDCs. Combination of T1 and DTI improved classification accuracy about 10%, and large-scale multi-modal MRI studies are warranted for external validation.

Multimodal Triplet Attention Network for Brain Disease Diagnosis

Multi-modal imaging data fusion has attracted much attention in medical data analysis because it can provide complementary information for more accurate analysis. Integrating functional and structural multi-modal imaging data has been increasingly used in the diagnosis of brain diseases, such as epilepsy. Most of the existing methods focus on the feature space fusion of different modalities but ignore the valuable high-order relationships among samples and the discriminative fused features for classification. In this paper, we propose a novel framework by fusing data from two modalities of functional MRI (fMRI) and diffusion tensor imaging (DTI) for epilepsy diagnosis, which effectively captures the complementary information and discriminative features from different modalities by high-order feature extraction with the attention mechanism. Specifically, we propose a triple network to explore the discriminative information from the high-order representation feature space learned from multi-modal data. Meanwhile, self-attention is introduced to adaptively estimate the degree of importance between brain regions, and the cross-attention mechanism is utilized to extract complementary information from fMRI and DTI. Finally, we use the triple loss function to adjust the distance between samples in the common representation space. We evaluate the proposed method on the epilepsy dataset collected from Jinling Hospital, and the experiment results demonstrate that our method is significantly superior to several state-of-the-art diagnosis approaches.

Exploring Brain Structural and Functional Biomarkers in Schizophrenia via Brain-Network-Constrained Multi-View SCCA

Recent studies have proved that dynamic regional measures extracted from the resting-state functional magnetic resonance imaging, such as the dynamic fractional amplitude of low-frequency fluctuation (d-fALFF), could provide a great insight into brain dynamic characteristics of the schizophrenia. However, the unimodal feature is limited for delineating the complex patterns of brain deficits. Thus, functional and structural imaging data are usually analyzed together for uncovering the neural mechanism of schizophrenia. Investigation of neural function-structure coupling enables to find the potential biomarkers and further helps to understand the biological basis of schizophrenia. Here, a brain-network-constrained multi-view sparse canonical correlation analysis (BN-MSCCA) was proposed to explore the intrinsic associations between brain structure and dynamic brain function. Specifically, the d-fALFF was first acquired based on the sliding window method, whereas the gray matter map was computed based on voxel-based morphometry analysis. Then, the region-of-interest (ROI)-based features were extracted and further selected by performing the multi-view sparse canonical correlation analysis jointly with the diagnosis information. Moreover, the brain-network-based structural constraint was introduced to prompt the detected biomarkers more interpretable. The experiments were conducted on 191 patients with schizophrenia and 191 matched healthy controls. Results showed that the BN-MSCCA could identify the critical ROIs with more sparse canonical weight patterns, which are corresponding to the specific brain networks. These are biologically meaningful findings and could be treated as the potential biomarkers. The proposed method also obtained a higher canonical correlation coefficient for the testing data, which is more consistent with the results on training data, demonstrating its promising capability for the association identification. To demonstrate the effectiveness of the potential clinical applications, the detected biomarkers were further analyzed on a schizophrenia-control classification task and a correlation analysis task. The experimental results showed that our method had a superior performance with a 5–8% increment in accuracy and 6–10% improvement in area under the curve. Furthermore, two of the top-ranked biomarkers were significantly negatively correlated with the positive symptom score of Positive and Negative Syndrome Scale (PANSS). Overall, the proposed method could find the association between brain structure and dynamic brain function, and also help to identify the biological meaningful biomarkers of schizophrenia. The findings enable our further understanding of this disease.

Multi-centre classification of functional neurological disorders based on resting-state functional connectivity

•

Using machine learning on multi-centre data, FND patients were successfully classified with an accuracy of 72%.

•

The angular- and supramarginal gyri, cingular- and insular cortex, and the hippocampus were the most discriminant regions.

•

To provide diagnostic utility, future studies must include patients with similar symptoms but different diagnoses.

Background

Patients suffering from functional neurological disorder (FND) experience disabling neurological symptoms not caused by an underlying classical neurological disease (such as stroke or multiple sclerosis). The diagnosis is made based on reliable positive clinical signs, but clinicians often require additional time- and cost consuming medical tests and examinations. Resting-state functional connectivity (RS FC) showed its potential as an imaging-based adjunctive biomarker to help distinguish patients from healthy controls and could represent a “rule-in” procedure to assist in the diagnostic process. However, the use of RS FC depends on its applicability in a multi-centre setting, which is particularly susceptible to inter-scanner variability. The aim of this study was to test the robustness of a classification approach based on RS FC in a multi-centre setting.

Methods

This study aimed to distinguish 86 FND patients from 86 healthy controls acquired in four different centres using a multivariate machine learning approach based on whole-brain resting-state functional connectivity. First, previously published results were replicated in each centre individually (intra-centre cross-validation) and its robustness across inter-scanner variability was assessed by pooling all the data (pooled cross-validation). Second, we evaluated the generalizability of the method by using data from each centre once as a test set, and the data from the remaining centres as a training set (inter-centre cross-validation).

Results

FND patients were successfully distinguished from healthy controls in the replication step (accuracy of 74%) as well as in each individual additional centre (accuracies of 73%, 71% and 70%). The pooled cross validation confirmed that the classifier was robust with an accuracy of 72%. The results survived post-hoc adjustment for anxiety, depression, psychotropic medication intake, and symptom severity. The most discriminant features involved the angular- and supramarginal gyri, sensorimotor cortex, cingular- and insular cortex, and hippocampal regions. The inter-centre validation step did not exceed chance level (accuracy below 50%).

Conclusions

The results demonstrate the applicability of RS FC to correctly distinguish FND patients from healthy controls in different centres and its robustness against inter-scanner variability. In order to generalize its use across different centres and aim for clinical application, future studies should work towards optimization of acquisition parameters and include neurological and psychiatric control groups presenting with similar symptoms.

Decomposition-Based Correlation Learning for Multi-Modal MRI-Based Classification of Neuropsychiatric Disorders

Multi-modal magnetic resonance imaging (MRI) is widely used for diagnosing brain disease in clinical practice. However, the high-dimensionality of MRI images is challenging when training a convolution neural network. In addition, utilizing multiple MRI modalities jointly is even more challenging. We developed a method using decomposition-based correlation learning (DCL). To overcome the above challenges, we used a strategy to capture the complex relationship between structural MRI and functional MRI data. Under the guidance of matrix decomposition, DCL takes into account the spike magnitude of leading eigenvalues, the number of samples, and the dimensionality of the matrix. A canonical correlation analysis (CCA) was used to analyze the correlation and construct matrices. We evaluated DCL in the classification of multiple neuropsychiatric disorders listed in the Consortium for Neuropsychiatric Phenomics (CNP) dataset. In experiments, our method had a higher accuracy than several existing methods. Moreover, we found interesting feature connections from brain matrices based on DCL that can differentiate disease and normal cases and different subtypes of the disease. Furthermore, we extended experiments on a large sample size dataset and a small sample size dataset, compared with several other well-established methods that were designed for the multi neuropsychiatric disorder classification; our proposed method achieved state-of-the-art performance on all three datasets.

Multi-Modal Neuroimaging Neural Network-Based Feature Detection for Diagnosis of Alzheimer’s Disease

Alzheimer’s disease (AD) is a neurodegenerative brain disease, and it is challenging to mine features that distinguish AD and healthy control (HC) from multiple datasets. Brain network modeling technology in AD using single-modal images often lacks supplementary information regarding multi-source resolution and has poor spatiotemporal sensitivity. In this study, we proposed a novel multi-modal LassoNet framework with a neural network for AD-related feature detection and classification. Specifically, data including two modalities of resting-state functional magnetic resonance imaging (rs-fMRI) and diffusion tensor imaging (DTI) were adopted for predicting pathological brain areas related to AD. The results of 10 repeated experiments and validation experiments in three groups prove that our proposed framework outperforms well in classification performance, generalization, and reproducibility. Also, we found discriminative brain regions, such as Hippocampus, Frontal_Inf_Orb_L, Parietal_Sup_L, Putamen_L, Fusiform_R, etc. These discoveries provide a novel method for AD research, and the experimental study demonstrates that the framework will further improve our understanding of the mechanisms underlying the development of AD.

Cerebello-Thalamo-Cortical Hyperconnectivity Classifies Patients and Predicts Long-Term Treatment Outcome in First-Episode Schizophrenia

It has previously been shown that cerebello-thalamo-cortical (CTC) hyperconnectivity is likely a state-independent neural signature for psychosis. However, the potential clinical utility of this change has not yet been evaluated. Here, using fMRI and clinical data acquired from 214 untreated first-episode patients with schizophrenia (62 of whom were clinically followed-up at least once at the 12th and 24th months after treatment initiation) and 179 healthy controls, we investigated whether CTC hyperconnectivity would serve as an individualized biomarker for diagnostic classification and prediction of long-term treatment outcome. Cross-validated LASSO regression was conducted to estimate the accuracy of baseline CTC connectivity for patient-control classification, with the generalizability of classification performance tested in an independent sample including 42 untreated first-episode patients and 65 controls. Associations between baseline CTC connectivity and clinical outcomes were evaluated using linear mixed model and leave-one-out cross validation. We found significantly increased baseline CTC connectivity in patients (P = .01), which remained stable after treatment. Measures of CTC connectivity discriminated patients from controls with moderate classification accuracy (AUC = 0.68, P < .001), and the classification model had good generalizability in the independent sample (AUC = 0.70, P < .001). Higher CTC connectivity at baseline significantly predicted poorer long-term symptom reduction in negative symptoms (R = 0.31, P = .01) but not positive or general symptoms. These findings provide initial evidence for the putative "CTC hyperconnectivity" anomaly as an individualized diagnostic and prognostic biomarker for schizophrenia, and highlight the potential of this measure in precision psychiatry.

Effects of Brain Atlases and Machine Learning Methods on the Discrimination of Schizophrenia Patients: A Multimodal MRI Study

Recently, machine learning techniques have been widely applied in discriminative studies of schizophrenia (SZ) patients with multimodal magnetic resonance imaging (MRI); however, the effects of brain atlases and machine learning methods remain largely unknown. In this study, we collected MRI data for 61 first-episode SZ patients (FESZ), 79 chronic SZ patients (CSZ) and 205 normal controls (NC) and calculated 4 MRI measurements, including regional gray matter volume (GMV), regional homogeneity (ReHo), amplitude of low-frequency fluctuation and degree centrality. We systematically analyzed the performance of two classifications (SZ vs NC; FESZ vs CSZ) based on the combinations of three brain atlases, five classifiers, two cross validation methods and 3 dimensionality reduction algorithms. Our results showed that the groupwise whole-brain atlas with 268 ROIs outperformed the other two brain atlases. In addition, the leave-one-out cross validation was the best cross validation method to select the best hyperparameter set, but the classification performances by different classifiers and dimensionality reduction algorithms were quite similar. Importantly, the contributions of input features to both classifications were higher with the GMV and ReHo features of brain regions in the prefrontal and temporal gyri. Furthermore, an ensemble learning method was performed to establish an integrated model, in which classification performance was improved. Taken together, these findings indicated the effects of these factors in constructing effective classifiers for psychiatric diseases and showed that the integrated model has the potential to improve the clinical diagnosis and treatment evaluation of SZ.

An integrated machine learning framework for a discriminative analysis of schizophrenia using multi-biological data

Finding effective and objective biomarkers to inform the diagnosis of schizophrenia is of great importance yet remains challenging. Relatively little work has been conducted on multi-biological data for the diagnosis of schizophrenia. In this cross-sectional study, we extracted multiple features from three types of biological data, including gut microbiota data, blood data, and electroencephalogram data. Then, an integrated framework of machine learning consisting of five classifiers, three feature selection algorithms, and four cross validation methods was used to discriminate patients with schizophrenia from healthy controls. Our results show that the support vector machine classifier without feature selection using the input features of multi-biological data achieved the best performance, with an accuracy of 91.7% and an AUC of 96.5% (p < 0.05). These results indicate that multi-biological data showed better discriminative capacity for patients with schizophrenia than single biological data. The top 5% discriminative features selected from the optimal model include the gut microbiota features (Lactobacillus, Haemophilus, and Prevotella), the blood features (superoxide dismutase level, monocyte-lymphocyte ratio, and neutrophil count), and the electroencephalogram features (nodal local efficiency, nodal efficiency, and nodal shortest path length in the temporal and frontal-parietal brain areas). The proposed integrated framework may be helpful for understanding the pathophysiology of schizophrenia and developing biomarkers for schizophrenia using multi-biological data.

Machine Learning in Neuroimaging: A New Approach to Understand Acupuncture for Neuroplasticity

The effects of acupuncture facilitating neural plasticity for treating diseases have been identified by clinical and experimental studies. In the last two decades, the application of neuroimaging techniques in acupuncture research provided visualized evidence for acupuncture promoting neuroplasticity. Recently, the integration of machine learning (ML) and neuroimaging techniques becomes a focus in neuroscience and brings a new and promising approach to understand the facilitation of acupuncture on neuroplasticity at the individual level. This review is aimed at providing an overview of this rapidly growing field by introducing the commonly used ML algorithms in neuroimaging studies briefly and analyzing the characteristics of the acupuncture studies based on ML and neuroimaging, so as to provide references for future research.

Application of Support Vector Machine on fMRI Data as Biomarkers in Schizophrenia Diagnosis: A Systematic Review

Non-invasive measurements of brain function and structure as neuroimaging in patients with mental illnesses are useful and powerful tools for studying discriminatory biomarkers. To date, functional MRI (fMRI), structural MRI (sMRI) represent the most used techniques to provide multiple perspectives on brain function, structure, and their connectivity. Recently, there has been rising attention in using machine-learning (ML) techniques, pattern recognition methods, applied to neuroimaging data to characterize disease-related alterations in brain structure and function and to identify phenotypes, for example, for translation into clinical and early diagnosis. Our aim was to provide a systematic review according to the PRISMA statement of Support Vector Machine (SVM) techniques in making diagnostic discrimination between SCZ patients from healthy controls using neuroimaging data from functional MRI as input. We included studies using SVM as ML techniques with patients diagnosed with Schizophrenia. From an initial sample of 660 papers, at the end of the screening process, 22 articles were selected, and included in our review. This technique can be a valid, inexpensive, and non-invasive support to recognize and detect patients at an early stage, compared to any currently available assessment or clinical diagnostic methods in order to save crucial time. The higher accuracy of SVM models and the new integrated methods of ML techniques could play a decisive role to detect patients with SCZ or other major psychiatric disorders in the early stages of the disease or to potentially determine their neuroimaging risk factors in the near future.