Multimodal fusion of structural and functional brain imaging in depression using linked independent component analysis

Optimizing Antidepressant Efficacy: Generalizable Multimodal Neuroimaging Biomarkers for Prediction of Treatment Response

Major depressive disorder (MDD) is a common and often severe condition that profoundly diminishes quality of life for individuals across ages and demographic groups. Unfortunately, current antidepressant and psychotherapeutic treatments exhibit limited efficacy and unsatisfactory response rates in a substantial number of patients. The development of effective therapies for MDD is hindered by the insufficiently understood heterogeneity within the disorder and its elusive underlying mechanisms. To address these challenges, we present a target-oriented multimodal fusion framework that robustly predicts antidepressant response by integrating structural and functional connectivity data (sertraline: R-squared = 0.31; placebo: R-squared = 0.22). Remarkably, the sertraline response biomarker is further tested on an independent escitalopram-medicated cohort of MDD patients, validating its generalizability (p = 0.01) and suggesting an overlap of psychopharmacological mechanisms across selective serotonin reuptake inhibitors. Through the model, we identify multimodal neuroimaging biomarkers of antidepressant response and observe that sertraline and placebo show distinct predictive patterns. We further decompose the overall predictive patterns into constitutive network constellations with generalizable structural-functional co-variation, which exhibit treatment-specific association with personality traits and behavioral/cognitive task performance. Our innovative and interpretable multimodal framework provides novel and reliable insights into the intricate neuropsychopharmacology of antidepressant treatment, paving the way for advances in precision medicine and development of more targeted antidepressant therapeutics.

Association of Normative and Non-Normative Brain Networks With Cognitive Function in Patients With Temporal Lobe Epilepsy

BACKGROUND AND OBJECTIVES

Despite their temporal lobe pathology, a significant subgroup of patients with temporal lobe epilepsy (TLE) is able to maintain normative cognitive functioning. In this study, we identify patients with TLE with intact vs impaired neurocognitive profiles and interrogate for the presence of both normative and highly individual intrinsic connectivity networks (ICNs)-all toward understanding the transition from impaired to intact neurocognitive status.

METHODS

This retrospective cross-sectional study included patients with TLE and matched healthy controls (HCs) from the Thomas Jefferson Comprehensive Epilepsy Center. Functional MRI data were decomposed using independent component analysis to obtain individualized ICNs. In this article, we calculated the degree of match between individualized ICNs and canonical ICNs (e.g., 17 resting-state networks by Yeo et al.) and divided each participant's ICNs into normative or non-normative status based on the degree of match.

RESULTS

100 patients with TLE (mean age 42.0 [SD: 13.7] years, 47 women) and 92 HCs were included in this study. We found that the individualized networks matched to the canonical networks less well in the cognitively impaired (n = 24) compared with the cognitively intact (n = 63) patients with TLE by 2-way mixed-measures analysis of variance (impaired vs intact mean difference [MD] -0.165 [-0.317, -0.013], p = 0.028). The cognitively impaired patients showed significant abnormalities in the profiles of both normative (impaired vs intact MD -0.537 [-0.998, -0.076], p = 0.017, intact vs HC MD -0.221 [-0.536, 0.924], p = 0.220, and impaired vs HC MD -0.759 [-1.200, -0.319], p < 0.001) and non-normative networks (impaired vs intact MD 0.484 [0.030, 0.937], p = 0.033, intact vs HC MD 0.369 [0.059, 0.678], p = 0.014, and impaired vs HC MD 0.853 [0.419, 1.286], p < 0.001) while the intact patients showed abnormalities only in non-normative networks. At the same time, we found that normative networks held a strong, positive association with the neuropsychological measures, with this association negative in non-normative networks.

DISCUSSION

Our data demonstrated that significant cognitive deficits are associated with the status of both canonical and highly individual ICNs, making clear that the transition from intact to impaired cognitive status is not simply the result of disruption to normative brain networks.

Abnormal multimodal neuroimaging patterns associated with social deficits in male autism spectrum disorder

Atypical social impairments (i.e., impaired social cognition and social communication) are vital manifestations of autism spectrum disorder (ASD) patients, and the incidence rate of ASD is significantly higher in males than in females. Characterizing the atypical brain patterns underlying social deficits of ASD is significant for understanding the pathogenesis. However, there are no robust imaging biomarkers that are specific to ASD, which may be due to neurobiological complexity and limitations of single-modality research. To describe the multimodal brain patterns related to social deficits in ASD, we highlighted the potential functional role of white matter (WM) and incorporated WM functional activity and gray matter structure into multimodal fusion. Gray matter volume (GMV) and fractional amplitude of low-frequency fluctuations of WM (WM-fALFF) were combined by fusion analysis model adopting the social behavior. Our results revealed multimodal spatial patterns associated with Social Responsiveness Scale multiple scores in ASD. Specifically, GMV exhibited a consistent brain pattern, in which salience network and limbic system were commonly identified associated with all multiple social impairments. More divergent brain patterns in WM-fALFF were explored, suggesting that WM functional activity is more sensitive to ASD's complex social impairments. Moreover, brain regions related to social impairment may be potentially interconnected across modalities. Cross-site validation established the repeatability of our results. Our research findings contribute to understanding the neural mechanisms underlying social disorders in ASD and affirm the feasibility of identifying biomarkers from functional activity in WM.

Group independent components underpin responses to items from a depression scale

OBJECTIVE

The aim of the present study is to investigate the brain circuits or networks that underpin diagnostically specific tasks by means of group independent component analysis for FMRI toolbox (GIFT). We hypothesised that there will be neural network patterns of activation and deactivation, which correspond to real-time performance on clinical self-evaluation scales.

METHODS

In total, 20 healthy controls (HC) and 22 patients with major depressive episode have been included. All subjects were scanned with functional magnetic resonance imaging (fMRI) with paradigm composed of diagnostic clinical self-assessment depression scale contrasted to neutral scale. The data were processed with group independent component analysis for functional MRI toolbox and statistical parametric mapping.

RESULTS

The results have demonstrated that there exist positively or negatively modulated brain networks during processing of diagnostic specific task questions for depressive disorder. There have also been confirmed differences in the networks processing diagnostic versus off blocks between patients and controls in anterior cingulate cortex and middle frontal gyrus. Diagnostic conditions (depression scale) when contrasted to neutral conditions demonstrate differential activity of right superior frontal gyrus and right middle cingulate cortex in the comparison of patients with HC.

CONCLUSION

Potential neuroimaging of state-dependent biomarkers has been directly linked with clinical assessment self-evaluation scale, administered as stimuli simultaneously with the fMRI acquisition. It may be regarded as further evidence in support of the convergent capacity of both methods to distinguish groups by means of incremental translational cross-validation.

Cross-Domain Identification of Multisite Major Depressive Disorder Using End-to-End Brain Dynamic Attention Network

Establishing objective and quantitative imaging markers at individual level can assist in accurate diagnosis of Major Depressive Disorder (MDD). However, the clinical heterogeneity of MDD and the shift to multisite data decreased identification accuracy. To address these issues, the Brain Dynamic Attention Network (BDANet) is innovatively proposed, and analyzed bimodal scans from 2055 participants of the Rest-meta-MDD consortium. The end-to-end BDANet contains two crucial components. The Dynamic BrainGraph Generator dynamically focuses and represents topological relationships between Regions of Interest, overcoming limitations of static methods. The Ensemble Classifier is constructed to obfuscate domain sources to achieve inter-domain alignment. Finally, BDANet dynamically generates sample-specific brain graphs by downstream recognition tasks. The proposed BDANet achieved an accuracy of 81.6%. The regions with high attribution for classification were mainly located in the insula, cingulate cortex and auditory cortex. The level of brain connectivity in p24 region was negatively correlated ( [Formula: see text]) with the severity of MDD. Additionally, sex differences in connectivity strength were observed in specific brain regions and functional subnetworks ( [Formula: see text] or [Formula: see text]). These findings based on a large multisite dataset support the conclusion that BDANet can better solve the problem of the clinical heterogeneity of MDD and the shift of multisite data. It also illustrates the potential utility of BDANet for personalized accurate identification, treatment and intervention of MDD.

Novel machine learning approaches for improving the reproducibility and reliability of functional and effective connectivity from functional MRI

Objective.New measures of human brain connectivity are needed to address gaps in the existing measures and facilitate the study of brain function, cognitive capacity, and identify early markers of human disease. Traditional approaches to measure functional connectivity (FC) between pairs of brain regions in functional MRI, such as correlation and partial correlation, fail to capture nonlinear aspects in the regional associations. We propose a new machine learning based measure of FC (ML.FC) which efficiently captures linear and nonlinear aspects.Approach.To capture directed information flow between brain regions, effective connectivity (EC) metrics, including dynamic causal modeling and structural equation modeling have been used. However, these methods are impractical to compute across the many regions of the whole brain. Therefore, we propose two new EC measures. The first, a machine learning based measure of effective connectivity (ML.EC), measures nonlinear aspects across the entire brain. The second, Structurally Projected Granger Causality (SP.GC) adapts Granger Causal connectivity to efficiently characterize and regularize the whole brain EC connectome to respect underlying biological structural connectivity. The proposed measures are compared to traditional measures in terms ofreproducibilityand theability to predict individual traitsin order to demonstrate these measures' internal validity. We use four repeat scans of the same individuals from the Human Connectome Project and measure the ability of the measures to predict individual subject physiologic and cognitive traits.Main results.The proposed new FC measure ofML.FCattains high reproducibility (mean intra-subjectR2of 0.44), while the proposed EC measure ofSP.GCattains the highest predictive power (meanR2across prediction tasks of 0.66).Significance.The proposed methods are highly suitable for achieving high reproducibility and predictiveness and demonstrate their strong potential for future neuroimaging studies.

Data-driven multimodal fusion: approaches and applications in psychiatric research

In the era of big data, where vast amounts of information are being generated and collected at an unprecedented rate, there is a pressing demand for innovative data-driven multi-modal fusion methods. These methods aim to integrate diverse neuroimaging perspectives to extract meaningful insights and attain a more comprehensive understanding of complex psychiatric disorders. However, analyzing each modality separately may only reveal partial insights or miss out on important correlations between different types of data. This is where data-driven multi-modal fusion techniques come into play. By combining information from multiple modalities in a synergistic manner, these methods enable us to uncover hidden patterns and relationships that would otherwise remain unnoticed. In this paper, we present an extensive overview of data-driven multimodal fusion approaches with or without prior information, with specific emphasis on canonical correlation analysis and independent component analysis. The applications of such fusion methods are wide-ranging and allow us to incorporate multiple factors such as genetics, environment, cognition, and treatment outcomes across various brain disorders. After summarizing the diverse neuropsychiatric magnetic resonance imaging fusion applications, we further discuss the emerging neuroimaging analyzing trends in big data, such as N-way multimodal fusion, deep learning approaches, and clinical translation. Overall, multimodal fusion emerges as an imperative approach providing valuable insights into the underlying neural basis of mental disorders, which can uncover subtle abnormalities or potential biomarkers that may benefit targeted treatments and personalized medical interventions.

Diagnosis of Major Depressive Disorder Using Machine Learning Based on Multisequence MRI Neuroimaging Features

BACKGROUND

Previous studies have found qualitative structural and functional brain changes in major depressive disorder (MDD) patients. However, most studies ignored the complementarity of multisequence MRI neuroimaging features and cannot determine accurate biomarkers.

PURPOSE

To evaluate machine-learning models combined with multisequence MRI neuroimaging features to diagnose patients with MDD.

STUDY TYPE

Prospective.

SUBJECTS

A training cohort including 111 patients and 90 healthy controls (HCs) and a test cohort including 28 patients and 22 HCs.

FIELD STRENGTH/SEQUENCE

A 3.0 T/T1-weighted imaging, resting-state functional MRI with echo-planar sequence, and single-shot echo-planar diffusion tensor imaging.

ASSESSMENT

Recruitment and integration were used to reflect the dynamic changes of functional networks, while gray matter volume and fractional anisotropy were used to reflect the changes in the morphological and anatomical network. We then fused features with significant differences in functional, morphological, and anatomical networks to evaluate a random forest (RF) classifier to diagnose patients with MDD. Furthermore, a support vector machine (SVM) classifier was used to verify the stability of neuroimaging features. Linear regression analyses were conducted to investigate the relationships among multisequence neuroimaging features and the suicide risk of patients.

STATISTICAL TESTS

The comparison of functional network attributes between patients and controls by two-sample t-test. Network-based statistical analysis was used to identify structural and anatomical connectivity changes between MDD and HCs. The performance of the model was evaluated by receiver operating characteristic (ROC) curves.

RESULTS

The performance of the RF model integrating multisequence neuroimaging features in the diagnosis of depression was significantly improved, with an AUC of 93.6%. In addition, we found that multisequence neuroimaging features could accurately predict suicide risk in patients with MDD (r = 0.691).

DATA CONCLUSION

The RF model fusing functional, morphological, and anatomical network features performed well in diagnosing patients with MDD and provided important insights into the pathological mechanisms of MDD.

EVIDENCE LEVEL

1.

TECHNICAL EFFICACY

Stage 2.

Brain-based Sex Differences in Depression: A Systematic Review of Neuroimaging Studies

Major depressive disorder (MDD) is a common psychiatric illness with a wide range of symptoms such as mood decline, loss of interest, and feelings of guilt and worthlessness. Women develop depression more often than men, and the diagnostic criteria for depression mainly rely on female patients' symptoms. By contrast, male depression usually manifests as anger attacks, aggression, substance use, and risk-taking behaviors. Various studies have focused on the neuroimaging findings in psychiatric disorders for a better understanding of their underlying mechanisms. With this review, we aimed to summarize the existing literature on the neuroimaging findings in depression, separated by male and female subjects. A search was conducted on PubMed and Scopus for magnetic resonance imaging (MRI), functional MRI (fMRI), and diffusion tensor imaging (DTI) studies of depression. After screening the search results, 15 MRI, 12 fMRI, and 4 DTI studies were included. Sex differences were mainly reflected in the following regions: 1) total brain, hippocampus, amygdala, habenula, anterior cingulate cortex, and corpus callosum volumes, 2) frontal and temporal gyri functions, along with functions of the caudate nucleus and prefrontal cortex, and 3) frontal fasciculi and frontal projections of corpus callosum microstructural alterations. Our review faces limitations such as small sample sizes and heterogeneity in populations and modalities. But in conclusion, it reflects the possible roles of sex-based hormonal and social factors in the depression pathophysiology.

Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry

BACKGROUND

The development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation.

METHODS

Here, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses.

RESULTS

A global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β =  - 2.75, p < .001, R²_adj = 0.40; r =  - .84, 95% CI: - .41 to - .97), and was plausibly predictable for model performance, with higher sampling inequality for reporting higher classification accuracy. Further analyses showed that lack of independent testing (84.24% of models, 95% CI: 81.0-87.5%), improper cross-validation (51.68% of models, 95% CI: 47.2-56.2%), and poor technical transparency (87.8% of models, 95% CI: 84.9-90.8%)/availability (80.88% of models, 95% CI: 77.3-84.4%) are prevailing in current diagnostic classifiers despite improvements over time. Relating to these observations, model performances were found decreased in studies with independent cross-country sampling validations (all p < .001, BF₁₀ > 15). In light of this, we proposed a purpose-built quantitative assessment checklist, which demonstrated that the overall ratings of these models increased by publication year but were negatively associated with model performance.

CONCLUSIONS

Together, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.

Brain morphometry points to emerging patterns of psychosis, depression, and anxiety vulnerability over a 2-year period in childhood

BACKGROUND

Gray matter morphometry studies have lent seminal insights into the etiology of mental illness. Existing research has primarily focused on adults and then, typically on a single disorder. Examining brain characteristics in late childhood, when the brain is preparing to undergo significant adolescent reorganization and various forms of serious psychopathology are just first emerging, may allow for a unique and highly important perspective of overlapping and unique pathogenesis.

METHODS

A total of 8645 youth were recruited as part of the Adolescent Brain and Cognitive Development study. Magnetic resonance imaging scans were collected, and psychotic-like experiences (PLEs), depressive, and anxiety symptoms were assessed three times over a 2-year period. Cortical thickness, surface area, and subcortical volume were used to predict baseline symptomatology and symptom progression over time.

RESULTS

Some features could possibly signal common vulnerability, predicting progression across forms of psychopathology (e.g. superior frontal and middle temporal regions). However, there was a specific predictive value for emerging PLEs (lateral occipital and precentral thickness), anxiety (parietal thickness/area and cingulate), and depression (e.g. parahippocampal and inferior temporal).

CONCLUSION

Findings indicate common and distinct patterns of vulnerability for varying forms of psychopathology are present during late childhood, before the adolescent reorganization, and have direct relevance for informing novel conceptual models along with early prevention and intervention efforts.

Biotypes of major depressive disorder identified by a multiview clustering framework

BACKGROUND

The advances in resting-state functional magnetic resonance imaging techniques motivate parsing heterogeneity in major depressive disorder (MDD) through neurophysiological subtypes (i.e., biotypes). Based on graph theories, researchers have observed the functional organization of the human brain as a complex system with modular structures and have found wide-spread but variable MDD-related abnormality regarding the modules. The evidence implies the possibility of identifying biotypes using high-dimensional functional connectivity (FC) data in ways that suit the potentially multifaceted biotypes taxonomy.

METHODS

We proposed a multiview biotype discovery framework that involves theory-driven feature subspace partition (i.e., "view") and independent subspace clustering. Six views were defined using intra- and intermodule FC regarding three MDD focal modules (i.e., the sensory-motor system, default mode network, and subcortical network). For robust biotypes, the framework was applied to a large multisite sample (805 MDD participants and 738 healthy controls).

RESULTS

Two biotypes were stably obtained in each view, respectively characterized by significantly increased and decreased FC compared to healthy controls. These view-specific biotypes promoted the diagnosis of MDD and showed different symptom profiles. By integrating the view-specific biotypes into biotype profiles, a broad spectrum in the neural heterogeneity of MDD and its separation from symptom-based subtypes was further revealed.

LIMITATIONS

The power of clinical effects is limited and the cross-sectional nature cannot predict the treatment effects of the biotypes.

CONCLUSIONS

Our findings not only contribute to the understanding of heterogeneity in MDD, but also provide a novel subtyping framework that could transcend current diagnostic boundaries and data modality.

Independent component analysis for internet gaming disorder

Introduction: There is a growing interest in the study of the neurobiological correlates of internet gaming disorder (IGD), and new techniques are beginning to be implemented for this purpose, such as independent component analysis (ICA). Aims: The present narrative review aimed to explore the studies that had used ICA for the study of the different brain networks possibly associated with IGD. Methods: We specifically focussed on three of the main networks: default-mode network, executive-control and salience networks. Results: Most studies have identified alterations in these three brain networks in individuals with IGD, which may be involved in the development and maintenance of this disorder. Conclusion: More studies are needed to deepen an understanding of the specific role of each in the symptomatology and treatment of IGD.

Methodological and Quality Flaws in the Use of Artificial Intelligence in Mental Health Research: Systematic Review

BACKGROUND

Artificial intelligence (AI) is giving rise to a revolution in medicine and health care. Mental health conditions are highly prevalent in many countries, and the COVID-19 pandemic has increased the risk of further erosion of the mental well-being in the population. Therefore, it is relevant to assess the current status of the application of AI toward mental health research to inform about trends, gaps, opportunities, and challenges.

OBJECTIVE

This study aims to perform a systematic overview of AI applications in mental health in terms of methodologies, data, outcomes, performance, and quality.

METHODS

A systematic search in PubMed, Scopus, IEEE Xplore, and Cochrane databases was conducted to collect records of use cases of AI for mental health disorder studies from January 2016 to November 2021. Records were screened for eligibility if they were a practical implementation of AI in clinical trials involving mental health conditions. Records of AI study cases were evaluated and categorized by the International Classification of Diseases 11th Revision (ICD-11). Data related to trial settings, collection methodology, features, outcomes, and model development and evaluation were extracted following the CHARMS (Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies) guideline. Further, evaluation of risk of bias is provided.

RESULTS

A total of 429 nonduplicated records were retrieved from the databases and 129 were included for a full assessment-18 of which were manually added. The distribution of AI applications in mental health was found unbalanced between ICD-11 mental health categories. Predominant categories were Depressive disorders (n=70) and Schizophrenia or other primary psychotic disorders (n=26). Most interventions were based on randomized controlled trials (n=62), followed by prospective cohorts (n=24) among observational studies. AI was typically applied to evaluate quality of treatments (n=44) or stratify patients into subgroups and clusters (n=31). Models usually applied a combination of questionnaires and scales to assess symptom severity using electronic health records (n=49) as well as medical images (n=33). Quality assessment revealed important flaws in the process of AI application and data preprocessing pipelines. One-third of the studies (n=56) did not report any preprocessing or data preparation. One-fifth of the models were developed by comparing several methods (n=35) without assessing their suitability in advance and a small proportion reported external validation (n=21). Only 1 paper reported a second assessment of a previous AI model. Risk of bias and transparent reporting yielded low scores due to a poor reporting of the strategy for adjusting hyperparameters, coefficients, and the explainability of the models. International collaboration was anecdotal (n=17) and data and developed models mostly remained private (n=126).

CONCLUSIONS

These significant shortcomings, alongside the lack of information to ensure reproducibility and transparency, are indicative of the challenges that AI in mental health needs to face before contributing to a solid base for knowledge generation and for being a support tool in mental health management.

BrainGB: A Benchmark for Brain Network Analysis With Graph Neural Networks

Mapping the connectome of the human brain using structural or functional connectivity has become one of the most pervasive paradigms for neuroimaging analysis. Recently, Graph Neural Networks (GNNs) motivated from geometric deep learning have attracted broad interest due to their established power for modeling complex networked data. Despite their superior performance in many fields, there has not yet been a systematic study of how to design effective GNNs for brain network analysis. To bridge this gap, we present BrainGB, a benchmark for brain network analysis with GNNs. BrainGB standardizes the process by (1) summarizing brain network construction pipelines for both functional and structural neuroimaging modalities and (2) modularizing the implementation of GNN designs. We conduct extensive experiments on datasets across cohorts and modalities and recommend a set of general recipes for effective GNN designs on brain networks. To support open and reproducible research on GNN-based brain network analysis, we host the BrainGB website at https://braingb.us with models, tutorials, examples, as well as an out-of-box Python package. We hope that this work will provide useful empirical evidence and offer insights for future research in this novel and promising direction.

Multimodal fusion analysis of functional, cerebrovascular and structural neuroimaging in healthy aging subjects

Brain aging is a complex process that requires a multimodal approach. Neuroimaging can provide insights into brain morphology, functional organization, and vascular dynamics. However, most neuroimaging studies of aging have focused on each imaging modality separately, limiting the understanding of interrelations between processes identified by different modalities and their relevance to cognitive decline in aging. Here, we used a data-driven multimodal approach, linked independent component analysis (ICA), to jointly analyze magnetic resonance imaging (MRI) of grey matter volume, cerebrovascular, and functional network topographies in relation to measures of fluid intelligence. Neuroimaging and cognitive data from the Cambridge Centre for Ageing and Neuroscience study were used, with healthy participants aged 18-88 years (main dataset n = 215 and secondary dataset n = 433). Using linked ICA, functional network activities were characterized in independent components but not captured in the same component as structural and cerebrovascular patterns. Split-sample (n = 108/107) and out-of-sample (n = 433) validation analyses using linked ICA were also performed. Global grey matter volume with regional cerebrovascular changes and the right frontoparietal network activity were correlated with age-related and individual differences in fluid intelligence. This study presents the insights from linked ICA to bring together measurements from multiple imaging modalities, with independent and additive information. We propose that integrating multiple neuroimaging modalities allows better characterization of brain pattern variability and changes associated with healthy aging.

Ability of an altered functional coupling between resting-state networks to predict behavioral outcomes in subcortical ischemic stroke: A longitudinal study

Stroke can be viewed as an acute disruption of an individual's connectome caused by a focal or widespread loss of blood flow. Although individuals exhibit connectivity changes in multiple functional networks after stroke, the neural mechanisms that underlie the longitudinal reorganization of the connectivity patterns are still unclear. The study aimed to determine whether brain network connectivity patterns after stroke can predict longitudinal behavioral outcomes. Nineteen patients with stroke with subcortical lesions underwent two sessions of resting-state functional magnetic resonance imaging scanning at a 1-month interval. By independent component analysis, the functional connectivity within and between multiple brain networks (including the default mode network, the dorsal attention network, the limbic network, the visual network, and the frontoparietal network) was disrupted after stroke and partial recovery at the second time point. Additionally, regression analyses revealed that the connectivity between the limbic and dorsal attention networks at the first time point showed sufficient reliability in predicting the clinical scores (Fugl-Meyer Assessment and Neurological Deficit Scores) at the second time point. The overall findings suggest that functional coupling between the dorsal attention and limbic networks after stroke can be regarded as a biomarker to predict longitudinal clinical outcomes in motor function and the degree of neurological functional deficit. Overall, the present study provided a novel opportunity to improve prognostic ability after subcortical strokes.

Personalized Diagnosis and Treatment for Neuroimaging in Depressive Disorders

Depressive disorders are highly heterogeneous in nature. Previous studies have not been useful for the clinical diagnosis and prediction of outcomes of major depressive disorder (MDD) at the individual level, although they provide many meaningful insights. To make inferences beyond group-level analyses, machine learning (ML) techniques can be used for the diagnosis of subtypes of MDD and the prediction of treatment responses. We searched PubMed for relevant studies published until December 2021 that included depressive disorders and applied ML algorithms in neuroimaging fields for depressive disorders. We divided these studies into two sections, namely diagnosis and treatment outcomes, for the application of prediction using ML. Structural and functional magnetic resonance imaging studies using ML algorithms were included. Thirty studies were summarized for the prediction of an MDD diagnosis. In addition, 19 studies on the prediction of treatment outcomes for MDD were reviewed. We summarized and discussed the results of previous studies. For future research results to be useful in clinical practice, ML enabling individual inferences is important. At the same time, there are important challenges to be addressed in the future.

An insight into diagnosis of depression using machine learning techniques: a systematic review

BACKGROUND

In this modern era, depression is one of the most prevalent mental disorders from which millions of individuals are affected today. The symptoms of depression are heterogeneous and often coincide with other disorders such as bipolar disorder, Parkinson's, schizophrenia, etc. It is a serious mental illness that may lead to other health problems if left untreated. Currently, identifying individuals with depression is totally based on the expertise of the clinician's experience. In order to assist clinicians in identifying the characteristics and classifying depressed people, different types of data modalities and machine learning techniques have been incorporated by researchers in this field. This study aims to find the answers to some important questions related to the trend of publications, data modality, machine learning models, dataset usage, pre-processing techniques and feature extraction and selection techniques that are prevalent and guide the direction of future research on depression diagnosis.

METHODS

This systematic review was conducted using a broad range of articles from two major databases: IEEE Xplore and PubMed. Studies ranging from the years 2011 to April 2021 were retrieved from the databases resulting in a total of 590 articles (53 articles from the IEEE Xplore database and 537 articles from the PubMed database). Out of those, the articles which satisfied the defined inclusion criteria were investigated for further analysis.

RESULTS

A total of 135 articles were identified and analysed for this review. High growth in the number of publications has been observed in recent years. Furthermore, significant diversity in the use of data modalities and machine learning classifiers has also been noted in this study. fMRI data with an SVM classifier was found to be the most popular choice among researchers. In most of the studies, data scarcity and small sample size, particularly for neuroimaging data are major concerns. The use of identical data pre-processing tools for similar data modalities can be seen. This study also provides statistical analysis of the current framework with respect to the modality, machine learning classifier, sample size and accuracy by applying one-way ANOVA and the Tukey - Kramer test.

CONCLUSION

The results indicate that an effective fusion of machine learning techniques with a potential data modality has a promising future for assisting clinicians in automatic depression diagnosis.

Adaptive Multimodal Neuroimage Integration for Major Depression Disorder Detection

Major depressive disorder (MDD) is one of the most common mental health disorders that can affect sleep, mood, appetite, and behavior of people. Multimodal neuroimaging data, such as functional and structural magnetic resonance imaging (MRI) scans, have been widely used in computer-aided detection of MDD. However, previous studies usually treat these two modalities separately, without considering their potentially complementary information. Even though a few studies propose integrating these two modalities, they usually suffer from significant inter-modality data heterogeneity. In this paper, we propose an adaptive multimodal neuroimage integration (AMNI) framework for automated MDD detection based on functional and structural MRIs. The AMNI framework consists of four major components: (1) a graph convolutional network to learn feature representations of functional connectivity networks derived from functional MRIs, (2) a convolutional neural network to learn features of T1-weighted structural MRIs, (3) a feature adaptation module to alleviate inter-modality difference, and (4) a feature fusion module to integrate feature representations extracted from two modalities for classification. To the best of our knowledge, this is among the first attempts to adaptively integrate functional and structural MRIs for neuroimaging-based MDD analysis by explicitly alleviating inter-modality heterogeneity. Extensive evaluations are performed on 533 subjects with resting-state functional MRI and T1-weighted MRI, with results suggesting the efficacy of the proposed method.

From genetics to systems biology of stress-related mental disorders

Many individuals will be exposed to some form of traumatic stress in their lifetime which, in turn, increases the likelihood of developing stress-related disorders such as post-traumatic stress disorder (PTSD), major depressive disorder (MDD) and anxiety disorders (ANX). The development of these disorders is also influenced by genetics and have heritability estimates ranging between ∼30 and 70%. In this review, we provide an overview of the findings of genome-wide association studies for PTSD, depression and ANX, and we observe a clear genetic overlap between these three diagnostic categories. We go on to highlight the results from transcriptomic and epigenomic studies, and, given the multifactorial nature of stress-related disorders, we provide an overview of the gene-environment studies that have been conducted to date. Finally, we discuss systems biology approaches that are now seeing wider utility in determining a more holistic view of these complex disorders.

Research on Extraction of Useful Tourism Online Reviews Based on Multimodal Feature Fusion

To effectively identify the influencing factors of the perceived usefulness of multimodal data in online reviews of tourism products, this article explores the optimization method of online tourism products based on user-generated content and conducts feature fusion of multimodal data in online reviews of tourism products from the perspective of data fusion analysis. Therefore, based on the word vector model, this article proposes a method to select the seed word set of emotion dictionary. In this method, emotional words are represented in vector form and the distance between word vectors is calculated to form the selection criteria and classification basis of seed word set, and then the sentiment dictionary of online review is formed by category judgment. This article takes the real online review data of tourism products as the research object, carries out descriptive statistical analysis, uses machine learning and deep learning methods, carries out text vector embedding and image content recognition, integrates image and text feature vector, constructs multimodal online review usefulness classification model, and conducts model test. The experimental results show that, compared with the single-mode reviews containing only text or pictures, the multimodal reviews combined with text and pictures can better predict the usefulness of online reviews, improve the quality of online reviews, give full play to the potential value of user-generated content, provide optimization ideas for product providers, and provide decision support for product consumers.

Progress towards a cellularly resolved mouse mesoconnectome is empowered by data fusion and new neuroanatomy techniques

Over the past decade there has been a rapid improvement in techniques for obtaining large-scale cellular level data related to the mouse brain connectome. However, a detailed mapping of cell-type-specific projection patterns is lacking, which would, for instance, allow us to study the role of circuit motifs in cognitive processes. In this work, we review advanced neuroanatomical and data fusion techniques within the context of a proposed Multimodal Connectomic Integration Framework for augmenting the cellularly resolved mouse mesoconnectome. First, we emphasize the importance of registering data modalities to a common reference atlas. We then review a number of novel experimental techniques that can provide data for characterizing cell-types in the mouse brain. Furthermore, we examine a number of data integration strategies, which involve fine-grained cell-type classification, spatial inference of cell densities, latent variable models for the mesoconnectome and multi-modal factorisation. Finally, we discuss a number of use cases which depend on connectome augmentation techniques, such as model simulations of functional connectivity and generating mechanistic hypotheses for animal disease models.

Uncovering Statistical Links Between Gene Expression and Structural Connectivity Patterns in the Mouse Brain

Finding links between genes and structural connectivity is of the utmost importance for unravelling the underlying mechanism of the brain connectome. In this study we identify links between the gene expression and the axonal projection density in the mouse brain, by applying a modified version of the Linked ICA method to volumetric data from the Allen Institute for Brain Science for identifying independent sources of information that link both modalities at the voxel level. We performed separate analyses on sets of projections from the visual cortex, the caudoputamen and the midbrain reticular nucleus, and we determined those brain areas, injections and genes that were most involved in independent components that link both gene expression and projection density data, while we validated their biological context through enrichment analysis. We identified representative and literature-validated cortico-midbrain and cortico-striatal projections, whose gene subsets were enriched with annotations for neuronal and synaptic function and related developmental and metabolic processes. The results were highly reproducible when including all available projections, as well as consistent with factorisations obtained using the Dictionary Learning and Sparse Coding technique. Hence, Linked ICA yielded reproducible independent components that were preserved under increasing data variance. Taken together, we have developed and validated a novel paradigm for linking gene expression and structural projection patterns in the mouse mesoconnectome, which can power future studies aiming to relate genes to brain function.

Promises and pitfalls of deep neural networks in neuroimaging-based psychiatric research

By promising more accurate diagnostics and individual treatment recommendations, deep neural networks and in particular convolutional neural networks have advanced to a powerful tool in medical imaging. Here, we first give an introduction into methodological key concepts and resulting methodological promises including representation and transfer learning, as well as modelling domain-specific priors. After reviewing recent applications within neuroimaging-based psychiatric research, such as the diagnosis of psychiatric diseases, delineation of disease subtypes, normative modeling, and the development of neuroimaging biomarkers, we discuss current challenges. This includes for example the difficulty of training models on small, heterogeneous and biased data sets, the lack of validity of clinical labels, algorithmic bias, and the influence of confounding variables.

Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation

Multimodal fusion in neuroimaging combines data from multiple imaging modalities to overcome the fundamental limitations of individual modalities. Neuroimaging fusion can achieve higher temporal and spatial resolution, enhance contrast, correct imaging distortions, and bridge physiological and cognitive information. In this study, we analyzed over 450 references from PubMed, Google Scholar, IEEE, ScienceDirect, Web of Science, and various sources published from 1978 to 2020. We provide a review that encompasses (1) an overview of current challenges in multimodal fusion (2) the current medical applications of fusion for specific neurological diseases, (3) strengths and limitations of available imaging modalities, (4) fundamental fusion rules, (5) fusion quality assessment methods, and (6) the applications of fusion for atlas-based segmentation and quantification. Overall, multimodal fusion shows significant benefits in clinical diagnosis and neuroscience research. Widespread education and further research amongst engineers, researchers and clinicians will benefit the field of multimodal neuroimaging.

Differences in directed functional brain connectivity related to age, sex and mental health

Functional interconnections between brain regions define the "connectome" which is of central interest for understanding human brain function. Resting-state functional magnetic resonance (rsfMRI) work has revealed changes in static connectivity related to age, sex, cognitive abilities and psychiatric symptoms, yet little is known how these factors may alter the information flow. The commonly used approach infers functional brain connectivity using stationary coefficients yielding static estimates of the undirected connection strength between brain regions. Dynamic graphical models (DGMs) are a multivariate model with dynamic coefficients reflecting directed temporal associations between nodes, and can yield novel insight into directed functional connectivity. Here, we leveraged this approach to test for associations between edge-wise estimates of direction flow across the functional connectome and age, sex, intellectual abilities and mental health. We applied DGM to investigate patterns of information flow in data from 984 individuals from the Human Connectome Project (HCP) and 10,249 individuals from the UK Biobank. Our analysis yielded patterns of directed connectivity in independent HCP and UK Biobank data similar to those previously reported, including that the cerebellum consistently receives information from other networks. We show robust associations between information flow and age and sex for several connections, with strongest effects of age observed in the sensorimotor network. Visual, auditory and sensorimotor nodes were also linked to mental health. Our findings support the use of DGM as a measure of directed connectivity in rsfMRI data and provide new insight into the shaping of the connectome during aging.

Multimodal fusion of structural and functional brain imaging in depression using linked independent component analysis

Previous structural and functional neuroimaging studies have implicated distributed brain regions and networks in depression. However, there are no robust imaging biomarkers that are specific to depression, which may be due to clinical heterogeneity and neurobiological complexity. A dimensional approach and fusion of imaging modalities may yield a more coherent view of the neuronal correlates of depression. We used linked independent component analysis to fuse cortical macrostructure (thickness, area, gray matter density), white matter diffusion properties and resting-state functional magnetic resonance imaging default mode network amplitude in patients with a history of depression (n = 170) and controls (n = 71). We used univariate and machine learning approaches to assess the relationship between age, sex, case-control status, and symptom loads for depression and anxiety with the resulting brain components. Univariate analyses revealed strong associations between age and sex with mainly global but also regional specific brain components, with varying degrees of multimodal involvement. In contrast, there were no significant associations with case-control status, nor symptom loads for depression and anxiety with the brain components, nor any interaction effects with age and sex. Machine learning revealed low model performance for classifying patients from controls and predicting symptom loads for depression and anxiety, but high age prediction accuracy. Multimodal fusion of brain imaging data alone may not be sufficient for dissecting the clinical and neurobiological heterogeneity of depression. Precise clinical stratification and methods for brain phenotyping at the individual level based on large training samples may be needed to parse the neuroanatomy of depression.

Structural and Functional Abnormities of Amygdala and Prefrontal Cortex in Major Depressive Disorder With Suicide Attempts

Finding neural features of suicide attempts (SA) in major depressive disorder (MDD) may be helpful in preventing suicidal behavior. The ventral and medial prefrontal cortex (PFC), as well as the amygdala form a circuit implicated in emotion regulation and the pathogenesis of MDD. The aim of this study was to identify whether patients with MDD who had a history of SA show structural and functional connectivity abnormalities in the amygdala and PFC relative to MDD patients without a history of SA. We measured gray matter volume in the amygdala and PFC and amygdala-PFC functional connectivity using structural and functional magnetic resonance imaging (MRI) in 158 participants [38 MDD patients with a history of SA, 60 MDD patients without a history of SA, and 60 healthy control (HC)]. MDD patients with a history of SA had decreased gray matter volume in the right and left amygdala (F = 30.270, P = 0.000), ventral/medial/dorsal PFC (F = 15.349, P = 0.000), and diminished functional connectivity between the bilateral amygdala and ventral and medial PFC regions (F = 22.467, P = 0.000), compared with individuals who had MDD without a history of SA, and the HC group. These findings provide evidence that the amygdala and PFC may be closely related to the pathogenesis of suicidal behavior in MDD and implicate the amygdala-ventral/medial PFC circuit as a potential target for suicide intervention.