1
|
Dini H, Bruni LE, Ramsøy TZ, Calhoun VD, Sendi MSE. The overlap across psychotic disorders: A functional network connectivity analysis. Int J Psychophysiol 2024; 201:112354. [PMID: 38670348 PMCID: PMC11163820 DOI: 10.1016/j.ijpsycho.2024.112354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 03/20/2024] [Accepted: 04/20/2024] [Indexed: 04/28/2024]
Abstract
Functional network connectivity (FNC) has previously been shown to distinguish patient groups from healthy controls (HC). However, the overlap across psychiatric disorders such as schizophrenia (SZ), bipolar (BP), and schizoaffective disorder (SAD) is not evident yet. This study focuses on studying the overlap across these three psychotic disorders in both dynamic and static FNC (dFNC/sFNC). We used resting-state fMRI, demographics, and clinical information from the Bipolar-Schizophrenia Network on Intermediate Phenotypes cohort (BSNIP). The data includes three groups of patients with schizophrenia (SZ, N = 181), bipolar (BP, N = 163), and schizoaffective (SAD, N = 130) and HC (N = 238) groups. After estimating each individual's dFNC, we group them into three distinct states. We evaluated two dFNC features, including occupancy rate (OCR) and distance travelled over time. Finally, the extracted features, including both sFNC and dFNC, are tested statistically across patients and HC groups. In addition, we explored the link between the clinical scores and the extracted features. We evaluated the connectivity patterns and their overlap among SZ, BP, and SAD disorders (false discovery rate or FDR corrected p < 0.05). Results showed dFNC captured unique information about overlap across disorders where all disorder groups showed similar pattern of activity in state 2. Moreover, the results showed similar patterns between SZ and SAD in state 1 which was different than BP. Finally, the distance travelled feature of SZ (average R = 0.245, p < 0.01) and combined distance travelled from all disorders was predictive of the PANSS symptoms scores (average R = 0.147, p < 0.01).
Collapse
Affiliation(s)
- Hossein Dini
- Augmented Cognition Lab, Department of Architecture, Design and Media Technology, Aalborg University, Copenhagen, Denmark
| | - Luis E Bruni
- Augmented Cognition Lab, Department of Architecture, Design and Media Technology, Aalborg University, Copenhagen, Denmark
| | - Thomas Z Ramsøy
- Department of Applied Neuroscience, Neurons Inc., Taastrup, Denmark; Faculty of Neuroscience, Singularity University, Santa Clara, CA, United States
| | - Vince D Calhoun
- Wallace H. Coulter Department of Biomedical Engineering at, Georgia Institute of Technology and Emory University, Atlanta, GA, United States; Department of Electrical and Computer Engineering at, Georgia Institute of Technology, Atlanta, GA, United States; Tri-Institutional Center for Translational Research in Neuroimaging and Data Science, Georgia Institute of Technology, Georgia State University, Emory University, Atlanta, GA, United States
| | - Mohammad S E Sendi
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science, Georgia Institute of Technology, Georgia State University, Emory University, Atlanta, GA, United States; McLean Hospital and Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
2
|
Chen Z, Ge R, Wang C, Elazab A, Fu X, Min W, Qin F, Jia G, Fan X. Identification of important gene signatures in schizophrenia through feature fusion and genetic algorithm. Mamm Genome 2024; 35:241-255. [PMID: 38512459 DOI: 10.1007/s00335-024-10034-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 02/07/2024] [Indexed: 03/23/2024]
Abstract
Schizophrenia is a debilitating psychiatric disorder that can significantly affect a patient's quality of life and lead to permanent brain damage. Although medical research has identified certain genetic risk factors, the specific pathogenesis of the disorder remains unclear. Despite the prevalence of research employing magnetic resonance imaging, few studies have focused on the gene level and gene expression profile involving a large number of screened genes. However, the high dimensionality of genetic data presents a great challenge to accurately modeling the data. To tackle the current challenges, this study presents a novel feature selection strategy that utilizes heuristic feature fusion and a multi-objective optimization genetic algorithm. The goal is to improve classification performance and identify the key gene subset for schizophrenia diagnostics. Traditional gene screening techniques are inadequate for accurately determining the precise number of key genes associated with schizophrenia. Our innovative approach integrates a filter-based feature selection method to reduce data dimensionality and a multi-objective optimization genetic algorithm for improved classification tasks. By combining the filtering and wrapper methods, our strategy leverages their respective strengths in a deliberate manner, leading to superior classification accuracy and a more efficient selection of relevant genes. This approach has demonstrated significant improvements in classification results across 11 out of 14 relevant datasets. The performance on the remaining three datasets is comparable to the existing methods. Furthermore, visual and enrichment analyses have confirmed the practicality of our proposed method as a promising tool for the early detection of schizophrenia.
Collapse
Affiliation(s)
| | - Ruiquan Ge
- Hangzhou Dianzi University, Hangzhou, China.
- Hangzhou Institute of Advanced Technology, Hangzhou, China.
- Key Laboratory of Discrete Industrial Internet of Things of Zhejiang Province, Hangzhou, China.
| | - Changmiao Wang
- Shenzhen Research Institute of Big Data, Shenzhen, China
| | - Ahmed Elazab
- Computer Science Department, Misr Higher Institute for Commerce and Computers, Mansoura, Egypt
| | - Xianjun Fu
- School of Artificial Intelligence, Zhejiang College of Security Technology, Wenzhou, China
| | - Wenwen Min
- School of Information Science and Engineering, Yunnan University, Kunming, China
| | - Feiwei Qin
- Hangzhou Dianzi University, Hangzhou, China
| | | | - Xiaopeng Fan
- Hangzhou Institute of Advanced Technology, Hangzhou, China
| |
Collapse
|
3
|
Shao X, Chen Z, Yu J, Lu F, Chen S, Xu J, Yao Y, Liu B, Yang P, Jiang Q, Hu B. Ultralow-cost piezoelectric sensor constructed by thermal compression bonding for long-term biomechanical signal monitoring in chronic mental disorders. NANOSCALE 2024; 16:2974-2982. [PMID: 38258372 DOI: 10.1039/d3nr06297j] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Wearable bioelectronic devices, which circumvent issues related to the large size and high cost of clinical equipment, have emerged as powerful tools for the auxiliary diagnosis and long-term monitoring of chronic psychiatric diseases. Current devices often integrate multiple intricate and expensive devices to ensure accurate diagnosis. However, their high cost and complexity hinder widespread clinical application and long-term user compliance. Herein, we developed an ultralow-cost poly(vinylidene fluoride)/zinc oxide nanofiber film-based piezoelectric sensor in a thermal compression bonding process. Our piezoelectric sensor exhibits remarkable sensitivity (13.4 mV N-1), rapid response (8 ms), and exceptional stability over 2000 compression/release cycles, all at a negligibly low fabrication cost. We demonstrate that pulse wave, blink, and speech signals can be acquired by the sensor, proposing a single biomechanical modality to monitor multiple physiological traits associated with bipolar disorder. This ultralow-cost and mass-producible piezoelectric sensor paves the way for extensive long-term monitoring and immediate feedback for bipolar disorder management.
Collapse
Affiliation(s)
- Xiaodong Shao
- The Affiliated Eye Hospital of Nanjing Medical University, Nanjing Medical University, Nanjing 210029, China.
| | - Zenan Chen
- School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing 211166, China
| | - Junxiao Yu
- The Affiliated Changzhou Second People's Hospital of Nanjing Medical University, Changzhou Second People's Hospital, Changzhou Medical Center, Nanjing Medical University, Changzhou 213161, China
| | - Fangzhou Lu
- School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing 211166, China
| | - Shisheng Chen
- School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing 211166, China
| | - Jingfeng Xu
- School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing 211166, China
| | - Yihao Yao
- School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing 211166, China
| | - Bin Liu
- School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing 211166, China
| | - Ping Yang
- School of Materials and Engineering, Nanjing Institute of Technology, Nanjing 211167, China
| | - Qin Jiang
- The Affiliated Eye Hospital of Nanjing Medical University, Nanjing Medical University, Nanjing 210029, China.
| | - Benhui Hu
- The Affiliated Eye Hospital of Nanjing Medical University, Nanjing Medical University, Nanjing 210029, China.
- School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing 211166, China
- Jiangsu Province Hospital, Nanjing Medical University First Affiliated Hospital, Nanjing 210029, China
| |
Collapse
|
4
|
Voineskos AN, Hawco C, Neufeld NH, Turner JA, Ameis SH, Anticevic A, Buchanan RW, Cadenhead K, Dazzan P, Dickie EW, Gallucci J, Lahti AC, Malhotra AK, Öngür D, Lencz T, Sarpal DK, Oliver LD. Functional magnetic resonance imaging in schizophrenia: current evidence, methodological advances, limitations and future directions. World Psychiatry 2024; 23:26-51. [PMID: 38214624 PMCID: PMC10786022 DOI: 10.1002/wps.21159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/13/2024] Open
Abstract
Functional neuroimaging emerged with great promise and has provided fundamental insights into the neurobiology of schizophrenia. However, it has faced challenges and criticisms, most notably a lack of clinical translation. This paper provides a comprehensive review and critical summary of the literature on functional neuroimaging, in particular functional magnetic resonance imaging (fMRI), in schizophrenia. We begin by reviewing research on fMRI biomarkers in schizophrenia and the clinical high risk phase through a historical lens, moving from case-control regional brain activation to global connectivity and advanced analytical approaches, and more recent machine learning algorithms to identify predictive neuroimaging features. Findings from fMRI studies of negative symptoms as well as of neurocognitive and social cognitive deficits are then reviewed. Functional neural markers of these symptoms and deficits may represent promising treatment targets in schizophrenia. Next, we summarize fMRI research related to antipsychotic medication, psychotherapy and psychosocial interventions, and neurostimulation, including treatment response and resistance, therapeutic mechanisms, and treatment targeting. We also review the utility of fMRI and data-driven approaches to dissect the heterogeneity of schizophrenia, moving beyond case-control comparisons, as well as methodological considerations and advances, including consortia and precision fMRI. Lastly, limitations and future directions of research in the field are discussed. Our comprehensive review suggests that, in order for fMRI to be clinically useful in the care of patients with schizophrenia, research should address potentially actionable clinical decisions that are routine in schizophrenia treatment, such as which antipsychotic should be prescribed or whether a given patient is likely to have persistent functional impairment. The potential clinical utility of fMRI is influenced by and must be weighed against cost and accessibility factors. Future evaluations of the utility of fMRI in prognostic and treatment response studies may consider including a health economics analysis.
Collapse
Affiliation(s)
- Aristotle N Voineskos
- Campbell Family Mental Health Research Institute and Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Colin Hawco
- Campbell Family Mental Health Research Institute and Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Nicholas H Neufeld
- Campbell Family Mental Health Research Institute and Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Jessica A Turner
- Department of Psychiatry and Behavioral Health, Wexner Medical Center, Ohio State University, Columbus, OH, USA
| | - Stephanie H Ameis
- Campbell Family Mental Health Research Institute and Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
- Cundill Centre for Child and Youth Depression and McCain Centre for Child, Youth and Family Mental Health, Centre for Addiction and Mental Health, Toronto, ON, Canada
| | - Alan Anticevic
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT, USA
- Department of Psychiatry, Yale University, New Haven, CT, USA
| | - Robert W Buchanan
- Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Kristin Cadenhead
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA
| | - Paola Dazzan
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Erin W Dickie
- Campbell Family Mental Health Research Institute and Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Julia Gallucci
- Campbell Family Mental Health Research Institute and Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, ON, Canada
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada
| | - Adrienne C Lahti
- Department of Psychiatry and Behavioral Neurobiology, University of Alabama at Birmingham, Birmingham, AL, USA
| | - Anil K Malhotra
- Institute for Behavioral Science, Feinstein Institutes for Medical Research, Manhasset, NY, USA
- Department of Psychiatry, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
- Department of Molecular Medicine, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
- Department of Psychiatry, Zucker Hillside Hospital Division of Northwell Health, Glen Oaks, NY, USA
| | - Dost Öngür
- McLean Hospital/Harvard Medical School, Belmont, MA, USA
| | - Todd Lencz
- Institute for Behavioral Science, Feinstein Institutes for Medical Research, Manhasset, NY, USA
- Department of Psychiatry, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
- Department of Molecular Medicine, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
- Department of Psychiatry, Zucker Hillside Hospital Division of Northwell Health, Glen Oaks, NY, USA
| | - Deepak K Sarpal
- Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Lindsay D Oliver
- Campbell Family Mental Health Research Institute and Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, ON, Canada
| |
Collapse
|
5
|
Wu X, Zhang X, Du Z, Yang D, Xu B, Ma R, Luo H, Liu H, Zhang Y. Raman spectroscopy combined with multiple one-dimensional deep learning models for simultaneous quantification of multiple components in blended olive oil. Food Chem 2024; 431:137109. [PMID: 37582325 DOI: 10.1016/j.foodchem.2023.137109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Revised: 07/25/2023] [Accepted: 08/04/2023] [Indexed: 08/17/2023]
Abstract
Blended vegetable oils are highly prized by consumers for their comprehensive nutritional profile. Therefore, there is an urgent need for a rapid and accurate method to identify the true content of blended oils. This study combined Raman spectroscopy with three deep learning models (CNN-LSTM, improved AlexNet, and ResNet) to simultaneously quantify extra virgin olive oil (EVOO), soybean oil, and sunflower oil in olive blended oil. The results demonstrate that all three deep learning models exhibited superior predictive ability compared to traditional chemometric methods. Specifically, the CNN-LSTM model achieved a coefficient of determination (R2p) of over 0.995 for each oil in the quantitative analysis of three-component blended oils, with a mean square error of prediction (RMSEP) of less than 2%. This study presents a novel approach for the simultaneous quantitative analysis of multi-component blended oils, providing a rapid and accurate method for the identification of falsely labeled blended oils.
Collapse
Affiliation(s)
- Xijun Wu
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
| | - Xin Zhang
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China.
| | - Zherui Du
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
| | - Daolin Yang
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
| | - Baoran Xu
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
| | - Renqi Ma
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
| | - Hao Luo
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
| | - Hailong Liu
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
| | - Yungang Zhang
- Measurement Technology & Instrumentation Key Laboratory of Hebei Province, Institute of Electrical Engineering, Yanshan University, Qinhuangdao 066004, China
| |
Collapse
|
6
|
Chen Z, Hu B, Liu X, Becker B, Eickhoff SB, Miao K, Gu X, Tang Y, Dai X, Li C, Leonov A, Xiao Z, Feng Z, Chen J, Chuan-Peng H. Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry. BMC Med 2023; 21:241. [PMID: 37400814 DOI: 10.1186/s12916-023-02941-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 06/13/2023] [Indexed: 07/05/2023] Open
Abstract
BACKGROUND The development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation. METHODS Here, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses. RESULTS A global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β = - 2.75, p < .001, R2adj = 0.40; r = - .84, 95% CI: - .41 to - .97), and was plausibly predictable for model performance, with higher sampling inequality for reporting higher classification accuracy. Further analyses showed that lack of independent testing (84.24% of models, 95% CI: 81.0-87.5%), improper cross-validation (51.68% of models, 95% CI: 47.2-56.2%), and poor technical transparency (87.8% of models, 95% CI: 84.9-90.8%)/availability (80.88% of models, 95% CI: 77.3-84.4%) are prevailing in current diagnostic classifiers despite improvements over time. Relating to these observations, model performances were found decreased in studies with independent cross-country sampling validations (all p < .001, BF10 > 15). In light of this, we proposed a purpose-built quantitative assessment checklist, which demonstrated that the overall ratings of these models increased by publication year but were negatively associated with model performance. CONCLUSIONS Together, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.
Collapse
Affiliation(s)
- Zhiyi Chen
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China.
- Faculty of Psychology, Southwest University, Chongqing, China.
| | - Bowen Hu
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Xuerong Liu
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Benjamin Becker
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, Chengdu, China
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Simon B Eickhoff
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Kuan Miao
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Xingmei Gu
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Yancheng Tang
- School of Business and Management, Shanghai International Studies University, Shanghai, China
| | - Xin Dai
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Chao Li
- Department of Radiology, The Third Affiliated Hospital, Sun Yat-Sen University, Guangdong, China
| | - Artemiy Leonov
- School of Psychology, Clark University, Worcester, MA, USA
| | - Zhibing Xiao
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Zhengzhi Feng
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Ji Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China.
- Department of Psychiatry, The Fourth Affiliated Hospital, Zhejiang University School of Medicine, Yiwu, Zhejiang, China.
| | - Hu Chuan-Peng
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
7
|
Yan W, Yu L, Liu D, Sui J, Calhoun VD, Lin Z. Multi-scale convolutional recurrent neural network for psychiatric disorder identification in resting-state EEG. Front Psychiatry 2023; 14:1202049. [PMID: 37441141 PMCID: PMC10333510 DOI: 10.3389/fpsyt.2023.1202049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Accepted: 06/12/2023] [Indexed: 07/15/2023] Open
Abstract
Background Accurate classification based on affordable objective neuroimaging biomarkers are important steps toward designing individualized treatment. Methods In this work, we investigated a deep learning classification model, multi-scale convolutional recurrent neural network (MCRNN), to explore psychiatric disorder-related biomarkers by leveraging the spatiotemporal information of resting-state EEG (rsEEG) using a multiple psychiatric disorder database containing 327 individuals diagnosed with schizophrenia, bipolar, major depressive disorders, and healthy controls. All subjects were mapped to a shared low-dimensional subspace for intuitively interpreting the inter-relationship and separation of psychiatric disorders. Results Psychiatric disorders were identified using rsEEG with high accuracy ranged from 78.6 to 91.3% in patient vs. controls two-class classification, and 68.2% in four-class classification. The control-to-schizophrenia trajectory interpretated by the model was consistent with the disease severity in clinical observation. Conclusion The MsRNN demonstrated a capability in extracting discriminative rsEEG biomarkers for psychiatric disorder classification, indicating its potential to facilitate our understanding of psychiatric disorders and monitoring interventions.
Collapse
Affiliation(s)
- Weizheng Yan
- Department of Psychiatry, Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
| | - Linzhen Yu
- Department of Psychiatry, Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Dandan Liu
- Department of Psychiatry, Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Jing Sui
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
| | - Vince D. Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, United States
| | - Zheng Lin
- Department of Psychiatry, Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| |
Collapse
|
8
|
Dhamala E, Yeo BTT, Holmes AJ. One Size Does Not Fit All: Methodological Considerations for Brain-Based Predictive Modeling in Psychiatry. Biol Psychiatry 2023; 93:717-728. [PMID: 36577634 DOI: 10.1016/j.biopsych.2022.09.024] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Revised: 09/07/2022] [Accepted: 09/23/2022] [Indexed: 12/30/2022]
Abstract
Psychiatric illnesses are heterogeneous in nature. No illness manifests in the same way across individuals, and no two patients with a shared diagnosis exhibit identical symptom profiles. Over the last several decades, group-level analyses of in vivo neuroimaging data have led to fundamental advances in our understanding of the neurobiology of psychiatric illnesses. More recently, access to computational resources and large, publicly available datasets alongside the rise of predictive modeling and precision medicine approaches have facilitated the study of psychiatric illnesses at an individual level. Data-driven machine learning analyses can be applied to identify disease-relevant biological subtypes, predict individual symptom profiles, and recommend personalized therapeutic interventions. However, when developing these predictive models, methodological choices must be carefully considered to ensure accurate, robust, and interpretable results. Choices pertaining to algorithms, neuroimaging modalities and states, data transformation, phenotypes, parcellations, sample sizes, and populations we are specifically studying can influence model performance. Here, we review applications of neuroimaging-based machine learning models to study psychiatric illnesses and discuss the effects of different methodological choices on model performance. An understanding of these effects is crucial for the proper implementation of predictive models in psychiatry and will facilitate more accurate diagnoses, prognoses, and therapeutics.
Collapse
Affiliation(s)
- Elvisha Dhamala
- Department of Psychology, Yale University, New Haven, Connecticut; Kavli Institute for Neuroscience, Yale University, New Haven, Connecticut.
| | - B T Thomas Yeo
- Centre for Sleep & Cognition & Centre for Translational Magnetic Resonance Research, Yong Loo Lin School of Medicine, Singapore, National University of Singapore, Singapore; Department of Electrical and Computer Engineering, National University of Singapore, Singapore; N.1 Institute for Health & Institute for Digital Medicine, National University of Singapore, Singapore; Integrative Sciences and Engineering Programme, National University of Singapore, Singapore; Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts
| | - Avram J Holmes
- Department of Psychology, Yale University, New Haven, Connecticut; Kavli Institute for Neuroscience, Yale University, New Haven, Connecticut; Department of Psychiatry, Yale University, New Haven, Connecticut; Wu Tsai Institute, Yale University, New Haven, Connecticut.
| |
Collapse
|
9
|
Uscătescu LC, Kronbichler M, Said-Yürekli S, Kronbichler L, Calhoun V, Corbera S, Bell M, Pelphrey K, Pearlson G, Assaf M. Intrinsic neural timescales in autism spectrum disorder and schizophrenia. A replication and direct comparison study. SCHIZOPHRENIA (HEIDELBERG, GERMANY) 2023; 9:18. [PMID: 36997542 PMCID: PMC10063601 DOI: 10.1038/s41537-023-00344-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/27/2022] [Accepted: 03/06/2023] [Indexed: 04/03/2023]
Abstract
Intrinsic neural timescales (INT) reflect the duration for which brain areas store information. A posterior-anterior hierarchy of increasingly longer INT has been revealed in both typically developed individuals (TD), as well as persons diagnosed with autism spectrum disorder (ASD) and schizophrenia (SZ), though INT are, overall, shorter in both patient groups. In the present study, we aimed to replicate previously reported group differences by comparing INT of TD to ASD and SZ. We partially replicated the previously reported result, showing reduced INT in the left lateral occipital gyrus and the right post-central gyrus in SZ compared to TD. We also directly compared the INT of the two patient groups and found that these same two areas show significantly reduced INT in SZ compared to ASD. Previously reported correlations between INT and symptom severity were not replicated in the current project. Our findings serve to circumscribe the brain areas that can potentially play a determinant role in observed sensory peculiarities in ASD and SZ.
Collapse
Affiliation(s)
| | - Martin Kronbichler
- Centre for Cognitive Neuroscience & Department of Psychology, Paris-Lodron University of Salzburg, Salzburg, Austria
- Neuroscience Institute, Christian-Doppler Medical University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Sarah Said-Yürekli
- Centre for Cognitive Neuroscience & Department of Psychology, Paris-Lodron University of Salzburg, Salzburg, Austria
- Neuroscience Institute, Christian-Doppler Medical University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Lisa Kronbichler
- Centre for Cognitive Neuroscience & Department of Psychology, Paris-Lodron University of Salzburg, Salzburg, Austria
- Neuroscience Institute, Christian-Doppler Medical University Hospital, Paracelsus Medical University, Salzburg, Austria
- Department of Psychiatry, Psychotherapy & Psychosomatics, Christian-Doppler University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Vince Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS) Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Silvia Corbera
- Central Connecticut State University, Department of Psychological Science, New Britain, CT, USA
| | - Morris Bell
- Yale University, School of Medicine, Department of Psychiatry, New Haven, CT, USA
| | - Kevin Pelphrey
- University of Virginia, Department of Neurology, Charlottesville, VA, USA
| | - Godfrey Pearlson
- Olin Neuropsychiatry Research Center, Institute of Living, Hartford, CT, USA
- Yale University, School of Medicine, Department of Psychiatry, New Haven, CT, USA
| | - Michal Assaf
- Olin Neuropsychiatry Research Center, Institute of Living, Hartford, CT, USA
- Yale University, School of Medicine, Department of Psychiatry, New Haven, CT, USA
| |
Collapse
|
10
|
Yang H, Vu T, Long Q, Calhoun V, Adali T. Identification of Homogeneous Subgroups from Resting-State fMRI Data. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23063264. [PMID: 36991975 PMCID: PMC10051904 DOI: 10.3390/s23063264] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 03/04/2023] [Accepted: 03/14/2023] [Indexed: 06/12/2023]
Abstract
The identification of homogeneous subgroups of patients with psychiatric disorders can play an important role in achieving personalized medicine and is essential to provide insights for understanding neuropsychological mechanisms of various mental disorders. The functional connectivity profiles obtained from functional magnetic resonance imaging (fMRI) data have been shown to be unique to each individual, similar to fingerprints; however, their use in characterizing psychiatric disorders in a clinically useful way is still being studied. In this work, we propose a framework that makes use of functional activity maps for subgroup identification using the Gershgorin disc theorem. The proposed pipeline is designed to analyze a large-scale multi-subject fMRI dataset with a fully data-driven method, a new constrained independent component analysis algorithm based on entropy bound minimization (c-EBM), followed by an eigenspectrum analysis approach. A set of resting-state network (RSN) templates is generated from an independent dataset and used as constraints for c-EBM. The constraints present a foundation for subgroup identification by establishing a connection across the subjects and aligning subject-wise separate ICA analyses. The proposed pipeline was applied to a dataset comprising 464 psychiatric patients and discovered meaningful subgroups. Subjects within the identified subgroups share similar activation patterns in certain brain areas. The identified subgroups show significant group differences in multiple meaningful brain areas including dorsolateral prefrontal cortex and anterior cingulate cortex. Three sets of cognitive test scores were used to verify the identified subgroups, and most of them showed significant differences across subgroups, which provides further confirmation of the identified subgroups. In summary, this work represents an important step forward in using neuroimaging data to characterize mental disorders.
Collapse
Affiliation(s)
- Hanlu Yang
- Department of Computer Science and Electrical Engineering, University of Maryland Baltimore County, Baltimore, MD 21250, USA
| | - Trung Vu
- Department of Computer Science and Electrical Engineering, University of Maryland Baltimore County, Baltimore, MD 21250, USA
| | - Qunfang Long
- Department of Computer Science and Electrical Engineering, University of Maryland Baltimore County, Baltimore, MD 21250, USA
| | - Vince Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, and Emory University, Atlanta, GA 30303, USA
| | - Tülay Adali
- Department of Computer Science and Electrical Engineering, University of Maryland Baltimore County, Baltimore, MD 21250, USA
| |
Collapse
|
11
|
Tandon R. Computational psychiatry and the psychopathology of psychosis: Promising leads and blind alleys. Schizophr Res 2023; 254:143-145. [PMID: 36889180 DOI: 10.1016/j.schres.2023.02.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 02/03/2023] [Accepted: 02/04/2023] [Indexed: 03/10/2023]
Affiliation(s)
- Rajiv Tandon
- Department of Psychiatry, WMU Homer Stryker School of Medicine, Kalamazoo, MI, United States of America.
| |
Collapse
|
12
|
Chen Z, Liu X, Yang Q, Wang YJ, Miao K, Gong Z, Yu Y, Leonov A, Liu C, Feng Z, Chuan-Peng H. Evaluation of Risk of Bias in Neuroimaging-Based Artificial Intelligence Models for Psychiatric Diagnosis: A Systematic Review. JAMA Netw Open 2023; 6:e231671. [PMID: 36877519 PMCID: PMC9989906 DOI: 10.1001/jamanetworkopen.2023.1671] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/07/2023] Open
Abstract
IMPORTANCE Neuroimaging-based artificial intelligence (AI) diagnostic models have proliferated in psychiatry. However, their clinical applicability and reporting quality (ie, feasibility) for clinical practice have not been systematically evaluated. OBJECTIVE To systematically assess the risk of bias (ROB) and reporting quality of neuroimaging-based AI models for psychiatric diagnosis. EVIDENCE REVIEW PubMed was searched for peer-reviewed, full-length articles published between January 1, 1990, and March 16, 2022. Studies aimed at developing or validating neuroimaging-based AI models for clinical diagnosis of psychiatric disorders were included. Reference lists were further searched for suitable original studies. Data extraction followed the CHARMS (Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies) and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. A closed-loop cross-sequential design was used for quality control. The PROBAST (Prediction Model Risk of Bias Assessment Tool) and modified CLEAR (Checklist for Evaluation of Image-Based Artificial Intelligence Reports) benchmarks were used to systematically evaluate ROB and reporting quality. FINDINGS A total of 517 studies presenting 555 AI models were included and evaluated. Of these models, 461 (83.1%; 95% CI, 80.0%-86.2%) were rated as having a high overall ROB based on the PROBAST. The ROB was particular high in the analysis domain, including inadequate sample size (398 of 555 models [71.7%; 95% CI, 68.0%-75.6%]), poor model performance examination (with 100% of models lacking calibration examination), and lack of handling data complexity (550 of 555 models [99.1%; 95% CI, 98.3%-99.9%]). None of the AI models was perceived to be applicable to clinical practices. Overall reporting completeness (ie, number of reported items/number of total items) for the AI models was 61.2% (95% CI, 60.6%-61.8%), and the completeness was poorest for the technical assessment domain with 39.9% (95% CI, 38.8%-41.1%). CONCLUSIONS AND RELEVANCE This systematic review found that the clinical applicability and feasibility of neuroimaging-based AI models for psychiatric diagnosis were challenged by a high ROB and poor reporting quality. Particularly in the analysis domain, ROB in AI diagnostic models should be addressed before clinical application.
Collapse
Affiliation(s)
- Zhiyi Chen
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Xuerong Liu
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Qingwu Yang
- Department of Neurology, Daping Hospital, Third Military Medical University, Chongqing, China
| | - Yan-Jiang Wang
- Department of Neurology, Daping Hospital, Third Military Medical University, Chongqing, China
| | - Kuan Miao
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Zheng Gong
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Yang Yu
- School of Psychology, Third Military Medical University, Chongqing, China
| | - Artemiy Leonov
- Department of Psychology, Clark University, Worcester, Massachusetts
| | - Chunlei Liu
- School of Psychology, Qufu Normal University, Qufu, China
| | - Zhengzhi Feng
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Hu Chuan-Peng
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
13
|
Liang C, Pearlson G, Bustillo J, Kochunov P, Turner JA, Wen X, Jiang R, Fu Z, Zhang X, Li K, Xu X, Zhang D, Qi S, Calhoun VD. Psychotic Symptom, Mood, and Cognition-associated Multimodal MRI Reveal Shared Links to the Salience Network Within the Psychosis Spectrum Disorders. Schizophr Bull 2023; 49:172-184. [PMID: 36305162 PMCID: PMC9810025 DOI: 10.1093/schbul/sbac158] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
Schizophrenia (SZ), schizoaffective disorder (SAD), and psychotic bipolar disorder share substantial overlap in clinical phenotypes, associated brain abnormalities and risk genes, making reliable diagnosis among the three illness challenging, especially in the absence of distinguishing biomarkers. This investigation aims to identify multimodal brain networks related to psychotic symptom, mood, and cognition through reference-guided fusion to discriminate among SZ, SAD, and BP. Psychotic symptom, mood, and cognition were used as references to supervise functional and structural magnetic resonance imaging (MRI) fusion to identify multimodal brain networks for SZ, SAD, and BP individually. These features were then used to assess the ability in discriminating among SZ, SAD, and BP. We observed shared links to functional and structural covariation in prefrontal, medial temporal, anterior cingulate, and insular cortices among SZ, SAD, and BP, although they were linked with different clinical domains. The salience (SAN), default mode (DMN), and fronto-limbic (FLN) networks were the three identified multimodal MRI features within the psychosis spectrum disorders from psychotic symptom, mood, and cognition associations. In addition, using these networks, we can classify patients and controls and distinguish among SZ, SAD, and BP, including their first-degree relatives. The identified multimodal SAN may be informative regarding neural mechanisms of comorbidity for psychosis spectrum disorders, along with DMN and FLN may serve as potential biomarkers in discriminating among SZ, SAD, and BP, which may help investigators better understand the underlying mechanisms of psychotic comorbidity from three different disorders via a multimodal neuroimaging perspective.
Collapse
Affiliation(s)
- Chuang Liang
- Department of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Godfrey Pearlson
- Department of Psychiatry and Neuroscience, Yale School of Medicine, New Haven, CT, USA
| | - Juan Bustillo
- Departments of Neurosciences and Psychiatry and Behavioral Sciences, University of New Mexico, Albuquerque, NM, USA
| | - Peter Kochunov
- Department of Psychiatry, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Jessica A Turner
- Department of Psychology, Georgia State University, Atlanta, GA, USA
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS) Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Xuyun Wen
- Department of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Rongtao Jiang
- Department of Psychiatry and Neuroscience, Yale School of Medicine, New Haven, CT, USA
| | - Zening Fu
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS) Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Xiao Zhang
- Department of Psychiatry, Peking University Sixth Hospital/Institute of Mental Health, Beijing, China
| | - Kaicheng Li
- Department of Radiology, The Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, China
| | - Xijia Xu
- Department of Psychiatry, Affiliated Nanjing Brain Hospital, Nanjing Medical University, Nanjing, China
| | - Daoqiang Zhang
- Department of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Shile Qi
- Department of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Vince D Calhoun
- Department of Psychology, Georgia State University, Atlanta, GA, USA
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS) Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
- Department of Electrical and Computer Engineering, Georgia Tech University, Atlanta, GA, USA
| |
Collapse
|
14
|
Chen J, Patil KR, Yeo BTT, Eickhoff SB. Leveraging Machine Learning for Gaining Neurobiological and Nosological Insights in Psychiatric Research. Biol Psychiatry 2023; 93:18-28. [PMID: 36307328 DOI: 10.1016/j.biopsych.2022.07.025] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Revised: 07/06/2022] [Accepted: 07/28/2022] [Indexed: 11/18/2022]
Abstract
Much attention is currently devoted to developing diagnostic classifiers for mental disorders. Complementing these efforts, we highlight the potential of machine learning to gain biological insights into the psychopathology and nosology of mental disorders. Studies to this end have mainly used brain imaging data, which can be obtained noninvasively from large cohorts and have repeatedly been argued to reveal potentially intermediate phenotypes. This may become particularly relevant in light of recent efforts to identify magnetic resonance imaging-derived biomarkers that yield insight into pathophysiological processes as well as to refine the taxonomy of mental illness. In particular, the accuracy of machine learning models may be used as dependent variables to identify features relevant to pathophysiology. Moreover, such approaches may help disentangle the dimensional (within diagnosis) and often overlapping (across diagnoses) symptomatology of psychiatric illness. We also point out a multiview perspective that combines data from different sources, bridging molecular and system-level information. Finally, we summarize recent efforts toward a data-driven definition of subtypes or disease entities through unsupervised and semisupervised approaches. The latter, blending unsupervised and supervised concepts, may represent a particularly promising avenue toward dissecting heterogeneous categories. Finally, we raise several technical and conceptual aspects related to the reviewed approaches. In particular, we discuss common pitfalls pertaining to flawed input data or analytic procedures that would likely lead to unreliable outputs.
Collapse
Affiliation(s)
- Ji Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China; Department of Psychiatry, The Fourth Affiliated Hospital, Zhejiang University School of Medicine, Yiwu, Zhejiang, China; Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.
| | - Kaustubh R Patil
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany; Institute of Systems Neuroscience, Medical Faculty, Heinrich-Heine-universität Düsseldorf, Düsseldorf, Germany
| | - B T Thomas Yeo
- Centre for Sleep and Cognition & Centre for Translational MR Research, Yong Loo Lin School of Medicine, National University of Singapore, Singapore; Department of Electrical and Computer Engineering, National University of Singapore, Singapore; Integrative Sciences & Engineering Programme, National University of Singapore, Singapore; Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts
| | - Simon B Eickhoff
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany; Institute of Systems Neuroscience, Medical Faculty, Heinrich-Heine-universität Düsseldorf, Düsseldorf, Germany
| |
Collapse
|
15
|
Zhu Q, Wang H, Xu B, Zhang Z, Shao W, Zhang D. Multimodal Triplet Attention Network for Brain Disease Diagnosis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:3884-3894. [PMID: 35969575 DOI: 10.1109/tmi.2022.3199032] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Multi-modal imaging data fusion has attracted much attention in medical data analysis because it can provide complementary information for more accurate analysis. Integrating functional and structural multi-modal imaging data has been increasingly used in the diagnosis of brain diseases, such as epilepsy. Most of the existing methods focus on the feature space fusion of different modalities but ignore the valuable high-order relationships among samples and the discriminative fused features for classification. In this paper, we propose a novel framework by fusing data from two modalities of functional MRI (fMRI) and diffusion tensor imaging (DTI) for epilepsy diagnosis, which effectively captures the complementary information and discriminative features from different modalities by high-order feature extraction with the attention mechanism. Specifically, we propose a triple network to explore the discriminative information from the high-order representation feature space learned from multi-modal data. Meanwhile, self-attention is introduced to adaptively estimate the degree of importance between brain regions, and the cross-attention mechanism is utilized to extract complementary information from fMRI and DTI. Finally, we use the triple loss function to adjust the distance between samples in the common representation space. We evaluate the proposed method on the epilepsy dataset collected from Jinling Hospital, and the experiment results demonstrate that our method is significantly superior to several state-of-the-art diagnosis approaches.
Collapse
|
16
|
Avberšek LK, Repovš G. Deep learning in neuroimaging data analysis: Applications, challenges, and solutions. FRONTIERS IN NEUROIMAGING 2022; 1:981642. [PMID: 37555142 PMCID: PMC10406264 DOI: 10.3389/fnimg.2022.981642] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 10/10/2022] [Indexed: 08/10/2023]
Abstract
Methods for the analysis of neuroimaging data have advanced significantly since the beginning of neuroscience as a scientific discipline. Today, sophisticated statistical procedures allow us to examine complex multivariate patterns, however most of them are still constrained by assuming inherent linearity of neural processes. Here, we discuss a group of machine learning methods, called deep learning, which have drawn much attention in and outside the field of neuroscience in recent years and hold the potential to surpass the mentioned limitations. Firstly, we describe and explain the essential concepts in deep learning: the structure and the computational operations that allow deep models to learn. After that, we move to the most common applications of deep learning in neuroimaging data analysis: prediction of outcome, interpretation of internal representations, generation of synthetic data and segmentation. In the next section we present issues that deep learning poses, which concerns multidimensionality and multimodality of data, overfitting and computational cost, and propose possible solutions. Lastly, we discuss the current reach of DL usage in all the common applications in neuroimaging data analysis, where we consider the promise of multimodality, capability of processing raw data, and advanced visualization strategies. We identify research gaps, such as focusing on a limited number of criterion variables and the lack of a well-defined strategy for choosing architecture and hyperparameters. Furthermore, we talk about the possibility of conducting research with constructs that have been ignored so far or/and moving toward frameworks, such as RDoC, the potential of transfer learning and generation of synthetic data.
Collapse
Affiliation(s)
- Lev Kiar Avberšek
- Department of Psychology, Faculty of Arts, University of Ljubljana, Ljubljana, Slovenia
| | | |
Collapse
|
17
|
Chang Z, Wang X, Wu Y, Lin P, Wang R. Segregation, integration and balance in resting-state brain functional networks associated with bipolar disorder symptoms. Hum Brain Mapp 2022; 44:599-611. [PMID: 36161679 PMCID: PMC9842930 DOI: 10.1002/hbm.26087] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 08/19/2022] [Accepted: 09/02/2022] [Indexed: 01/25/2023] Open
Abstract
Bipolar disorder (BD) is a serious mental disorder involving widespread abnormal interactions between brain regions, and it is believed to be associated with imbalanced functions in the brain. However, how this brain imbalance underlies distinct BD symptoms remains poorly understood. Here, we used a nested-spectral partition (NSP) method to study the segregation, integration, and balance in resting-state brain functional networks in BD patients and healthy controls (HCs). We first confirmed that there was a high deviation in the brain functional network toward more segregation in BD patients than in HCs and that the limbic system had the largest alteration. Second, we demonstrated a network balance of segregation and integration that corresponded to lower anxiety in BD patients but was not related to other symptoms. Subsequently, based on a machine-learning approach, we identified different system-level mechanisms underlying distinct BD symptoms and found that the features related to the brain network balance could predict BD symptoms better than graph theory analyses. Finally, we studied attention-deficit/hyperactivity disorder (ADHD) symptoms in BD patients and identified specific patterns that distinctly predicted ADHD and BD scores, as well as their shared common domains. Our findings supported an association of brain imbalance with anxiety symptom in BD patients and provided a potential network signature for diagnosing BD. These results contribute to further understanding the neuropathology of BD and to screening ADHD in BD patients.
Collapse
Affiliation(s)
- Zhao Chang
- College of ScienceXi'an University of Science and TechnologyXi'anChina
| | - Xinrui Wang
- College of ScienceXi'an University of Science and TechnologyXi'anChina
| | - Ying Wu
- State Key Laboratory for Strength and Vibration of Mechanical StructuresSchool of Aerospace Engineering, Xi'an Jiaotong UniversityXi'anChina,National Demonstration Center for Experimental Mechanics EducationXi'an Jiaotong UniversityXi'anChina
| | - Pan Lin
- Center for Mind & Brain Sciences and Cognition and Human Behavior Key Laboratory of Hunan ProvinceHunan Normal UniversityChangshaHunanChina
| | - Rong Wang
- College of ScienceXi'an University of Science and TechnologyXi'anChina,State Key Laboratory for Strength and Vibration of Mechanical StructuresSchool of Aerospace Engineering, Xi'an Jiaotong UniversityXi'anChina,National Demonstration Center for Experimental Mechanics EducationXi'an Jiaotong UniversityXi'anChina
| |
Collapse
|
18
|
Zhao M, Yan W, Luo N, Zhi D, Fu Z, Du Y, Yu S, Jiang T, Calhoun VD, Sui J. An attention-based hybrid deep learning framework integrating brain connectivity and activity of resting-state functional MRI data. Med Image Anal 2022; 78:102413. [PMID: 35305447 PMCID: PMC9035078 DOI: 10.1016/j.media.2022.102413] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 10/27/2021] [Accepted: 03/01/2022] [Indexed: 12/30/2022]
Abstract
Functional magnetic resonance imaging (fMRI) as a promising tool to investigate psychotic disorders can be decomposed into useful imaging features such as time courses (TCs) of independent components (ICs) and functional network connectivity (FNC) calculated by TC cross-correlation. TCs reflect the temporal dynamics of brain activity and the FNC characterizes temporal coherence across intrinsic brain networks. Both features have been used as input to deep learning approaches with decent results. However, few studies have tried to leverage their complementary information to learn optimal representations at multiple facets. Motivated by this, we proposed a Hybrid Deep Learning Framework integrating brain Connectivity and Activity (HDLFCA) together by combining convolutional recurrent neural network (C-RNN) and deep neural network (DNN), aiming to improve classification accuracy and interpretability simultaneously. Specifically, C-RNNAM was proposed to extract temporal dynamic dependencies with an attention module (AM) to automatically learn discriminative knowledge from TC nodes, while DNN was applied to identify the most group-discriminative FNC patterns with layer-wise relevance propagation (LRP). Then, both prediction outputs were concatenated to build a new feature matrix, generating the final decision by logistic regression. The effectiveness of HDLFCA was validated on both multi-site schizophrenia (SZ, n ∼ 1100) and public autism datasets (ABIDE, n ∼ 1522) by outperforming 12 alternative models at 2.8-8.9% accuracy, including 8 models using either static FNC or TCs and 4 models using dynamic FNC. Appreciable classification accuracy was achieved for HC vs. SZ (85.3%) and HC vs. Autism (72.4%) respectively. More importantly, the most group-discriminative brain regions can be easily attributed and visualized, providing meaningful biological interpretability and highlighting the great potential of the proposed HDLFCA model in the identification of valid neuroimaging biomarkers.
Collapse
Affiliation(s)
- Min Zhao
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Weizheng Yan
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Na Luo
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Dongmei Zhi
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Zening Fu
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Yuhui Du
- School of Computer and Information Technology, Shanxi University, Taiyuan, China
| | - Shan Yu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Tianzi Jiang
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Vince D Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Jing Sui
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA; State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China.
| |
Collapse
|
19
|
Shoeibi A, Sadeghi D, Moridian P, Ghassemi N, Heras J, Alizadehsani R, Khadem A, Kong Y, Nahavandi S, Zhang YD, Gorriz JM. Automatic Diagnosis of Schizophrenia in EEG Signals Using CNN-LSTM Models. Front Neuroinform 2021; 15:777977. [PMID: 34899226 PMCID: PMC8657145 DOI: 10.3389/fninf.2021.777977] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 10/22/2021] [Indexed: 11/13/2022] Open
Abstract
Schizophrenia (SZ) is a mental disorder whereby due to the secretion of specific chemicals in the brain, the function of some brain regions is out of balance, leading to the lack of coordination between thoughts, actions, and emotions. This study provides various intelligent deep learning (DL)-based methods for automated SZ diagnosis via electroencephalography (EEG) signals. The obtained results are compared with those of conventional intelligent methods. To implement the proposed methods, the dataset of the Institute of Psychiatry and Neurology in Warsaw, Poland, has been used. First, EEG signals were divided into 25 s time frames and then were normalized by z-score or norm L2. In the classification step, two different approaches were considered for SZ diagnosis via EEG signals. In this step, the classification of EEG signals was first carried out by conventional machine learning methods, e.g., support vector machine, k-nearest neighbors, decision tree, naïve Bayes, random forest, extremely randomized trees, and bagging. Various proposed DL models, namely, long short-term memories (LSTMs), one-dimensional convolutional networks (1D-CNNs), and 1D-CNN-LSTMs, were used in the following. In this step, the DL models were implemented and compared with different activation functions. Among the proposed DL models, the CNN-LSTM architecture has had the best performance. In this architecture, the ReLU activation function with the z-score and L2-combined normalization was used. The proposed CNN-LSTM model has achieved an accuracy percentage of 99.25%, better than the results of most former studies in this field. It is worth mentioning that to perform all simulations, the k-fold cross-validation method with k = 5 has been used.
Collapse
Affiliation(s)
- Afshin Shoeibi
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Delaram Sadeghi
- Department of Medical Engineering, Islamic Azad University of Mashhad, Mashhad, Iran
| | - Parisa Moridian
- Faculty of Engineering, Islamic Azad University of Science and Research, Tehran, Iran
| | - Navid Ghassemi
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Jónathan Heras
- Department of Mathematics and Computer Science, University of La Rioja, Logroño, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Ali Khadem
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yinan Kong
- School of Engineering, Macquarie University, Sydney, NSW, Australia
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Yu-Dong Zhang
- Department of Informatics, University of Leicester, Leicester, United Kingdom
| | - Juan Manuel Gorriz
- Department of Signal Theory, Telematics and Communications, ETS of Computer and Telecommunications Engineering, University of Granada, Granada, Spain
| |
Collapse
|