1
|
Song R, Cao P, Wen G, Zhao P, Huang Z, Zhang X, Yang J, Zaiane OR. BrainDAS: Structure-aware domain adaptation network for multi-site brain network analysis. Med Image Anal 2024; 96:103211. [PMID: 38796945 DOI: 10.1016/j.media.2024.103211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 01/31/2024] [Accepted: 05/15/2024] [Indexed: 05/29/2024]
Abstract
In the medical field, datasets are mostly integrated across sites due to difficult data acquisition and insufficient data at a single site. The domain shift problem caused by the heterogeneous distribution among multi-site data makes autism spectrum disorder (ASD) hard to identify. Recently, domain adaptation has received considerable attention as a promising solution. However, domain adaptation on graph data like brain networks has not been fully studied. It faces two major challenges: (1) complex graph structure; and (2) multiple source domains. To overcome the issues, we propose an end-to-end structure-aware domain adaptation framework for brain network analysis (BrainDAS) using resting-state functional magnetic resonance imaging (rs-fMRI). The proposed approach contains two stages: supervision-guided multi-site graph domain adaptation with dynamic kernel generation and graph classification with attention-based graph pooling. We evaluate our BrainDAS on a public dataset provided by Autism Brain Imaging Data Exchange (ABIDE) which includes 871 subjects from 17 different sites, surpassing state-of-the-art algorithms in several different evaluation settings. Furthermore, our promising results demonstrate the interpretability and generalization of the proposed method. Our code is available at https://github.com/songruoxian/BrainDAS.
Collapse
Affiliation(s)
- Ruoxian Song
- Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Peng Cao
- Computer Science and Engineering, Northeastern University, Shenyang, China; Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, China.
| | - Guangqi Wen
- Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Pengfei Zhao
- Early Intervention Unit, Department of Psychiatry, Affiliated Nanjing Brain Hospital, Nanjing, China
| | - Ziheng Huang
- College of Software, Northeastern University, Shenyang, China
| | - Xizhe Zhang
- Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, China
| | - Jinzhu Yang
- Computer Science and Engineering, Northeastern University, Shenyang, China; Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, China.
| | | |
Collapse
|
2
|
Ma C, Li W, Ke S, Lv J, Zhou T, Zou L. Identification of autism spectrum disorder using multiple functional connectivity-based graph convolutional network. Med Biol Eng Comput 2024; 62:2133-2144. [PMID: 38457067 DOI: 10.1007/s11517-024-03060-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Accepted: 02/23/2024] [Indexed: 03/09/2024]
Abstract
Presently, the combination of graph convolutional networks (GCN) with resting-state functional magnetic resonance imaging (rs-fMRI) data is a promising approach for early diagnosis of autism spectrum disorder (ASD). However, the prevalent approach involves exclusively full-brain functional connectivity data for disease classification using GCN, while overlooking the prior information related to the functional connectivity of brain subnetworks associated with ASD. Therefore, in this study, the multiple functional connectivity-based graph convolutional network (MFC-GCN) framework is proposed, using not only full brain functional connectivity data but also the established functional connectivity data from networks of key brain subnetworks associated with ASD, and the GCN is adopted to acquire complementary feature information for the final classification task. Given the heterogeneity within the Autism Brain Imaging Data Exchange (ABIDE) dataset, a novel External Attention Network Readout (EANReadout) is introduced. This design enables the exploration of potential subject associations, effectively addressing the dataset's heterogeneity. Experiments were conducted on the ABIDE dataset using the proposed framework, involving 714 subjects, and the average accuracy of the framework was 70.31%. The experimental results show that the proposed EANReadout outperforms the best traditional readout layer and improves the average accuracy of the framework by 4.32%.
Collapse
Affiliation(s)
- Chaoran Ma
- School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou, 213164, Jiangsu, China
| | - Wenjie Li
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, 213164, Jiangsu, China
| | - Sheng Ke
- School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou, 213164, Jiangsu, China
| | - Jidong Lv
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, 213164, Jiangsu, China
| | - Tiantong Zhou
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, 213164, Jiangsu, China
| | - Ling Zou
- School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou, 213164, Jiangsu, China.
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, 213164, Jiangsu, China.
| |
Collapse
|
3
|
Zhu QQ, Tian S, Zhang L, Ding HY, Gao YX, Tang Y, Yang X, Zhu Y, Qi M. Altered dynamic amplitude of low-frequency fluctuation in individuals at high risk for Alzheimer's disease. Eur J Neurosci 2024; 59:2391-2402. [PMID: 38314647 DOI: 10.1111/ejn.16267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 01/12/2024] [Accepted: 01/14/2024] [Indexed: 02/06/2024]
Abstract
The brain's dynamic spontaneous neural activity is significant in supporting cognition; however, how brain dynamics go awry in subjective cognitive decline (SCD) and mild cognitive impairment (MCI) remains unclear. Thus, the current study aimed to investigate the dynamic amplitude of low-frequency fluctuation (dALFF) alterations in patients at high risk for Alzheimer's disease and to explore its correlation with clinical cognitive assessment scales, to identify an early imaging sign for these special populations. A total of 152 participants, including 72 SCD patients, 44 MCI patients and 36 healthy controls (HCs), underwent a resting-state functional magnetic resonance imaging and were assessed with various neuropsychological tests. The dALFF was measured using sliding-window analysis. We employed canonical correlation analysis (CCA) to examine the bi-multivariate correlations between neuropsychological scales and altered dALFF among multiple regions in SCD and MCI patients. Compared to those in the HC group, both the MCI and SCD groups showed higher dALFF values in the right opercular inferior frontal gyrus (voxel P < .001, cluster P < .05, correction). Moreover, the CCA models revealed that behavioural tests relevant to inattention correlated with the dALFF of the right middle frontal gyrus and right opercular inferior frontal gyrus, which are involved in frontoparietal networks (R = .43, P = .024). In conclusion, the brain dynamics of neural activity in frontal areas provide insights into the shared neural basis underlying SCD and MCI.
Collapse
Affiliation(s)
- Qin-Qin Zhu
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Shui Tian
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Ling Zhang
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Hong-Yuan Ding
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Ya-Xin Gao
- Rehabilitation Center, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou Municipal Hospital, Suzhou, China
| | - Yin Tang
- Department of Medical imaging, Jingjiang People's Hospital, Jingjiang, China
| | - Xi Yang
- School of Rehabilitation Medicine, Nanjing Medical University, Nanjing, China
| | - Yi Zhu
- Rehabilitation Center, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Ming Qi
- Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, China
| |
Collapse
|
4
|
Xia Z, Zhou T, Mamoon S, Lu J. Inferring brain causal and temporal-lag networks for recognizing abnormal patterns of dementia. Med Image Anal 2024; 94:103133. [PMID: 38458094 DOI: 10.1016/j.media.2024.103133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2022] [Revised: 11/21/2022] [Accepted: 03/01/2024] [Indexed: 03/10/2024]
Abstract
Brain functional network analysis has become a popular method to explore the laws of brain organization and identify biomarkers of neurological diseases. However, it is still a challenging task to construct an ideal brain network due to the limited understanding of the human brain. Existing methods often ignore the impact of temporal-lag on the results of brain network modeling, which may lead to some unreliable conclusions. To overcome this issue, we propose a novel brain functional network estimation method, which can simultaneously infer the causal mechanisms and temporal-lag values among brain regions. Specifically, our method converts the lag learning into an instantaneous effect estimation problem, and further embeds the search objectives into a deep neural network model as parameters to be learned. To verify the effectiveness of the proposed estimation method, we perform experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) database by comparing the proposed model with several existing methods, including correlation-based and causality-based methods. The experimental results show that our brain networks constructed by the proposed estimation method can not only achieve promising classification performance, but also exhibit some characteristics of physiological mechanisms. Our approach provides a new perspective for understanding the pathogenesis of brain diseases. The source code is released at https://github.com/NJUSTxiazw/CTLN.
Collapse
Affiliation(s)
- Zhengwang Xia
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
| | - Tao Zhou
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
| | - Saqib Mamoon
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
| | - Jianfeng Lu
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China.
| |
Collapse
|
5
|
Xu Y, Guo J, Yang N, Zhu C, Zheng T, Zhao W, Liu J, Song J. Predicting rectal cancer prognosis from histopathological images and clinical information using multi-modal deep learning. Front Oncol 2024; 14:1353446. [PMID: 38690169 PMCID: PMC11060749 DOI: 10.3389/fonc.2024.1353446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 04/01/2024] [Indexed: 05/02/2024] Open
Abstract
Objective The objective of this study was to provide a multi-modal deep learning framework for forecasting the survival of rectal cancer patients by utilizing both digital pathological images data and non-imaging clinical data. Materials and methods The research included patients diagnosed with rectal cancer by pathological confirmation from January 2015 to December 2016. Patients were allocated to training and testing sets in a randomized manner, with a ratio of 4:1. The tissue microarrays (TMAs) and clinical indicators were obtained. Subsequently, we selected distinct deep learning models to individually forecast patient survival. We conducted a scanning procedure on the TMAs in order to transform them into digital pathology pictures. Additionally, we performed pre-processing on the clinical data of the patients. Subsequently, we selected distinct deep learning algorithms to conduct survival prediction analysis using patients' pathological images and clinical data, respectively. Results A total of 292 patients with rectal cancer were randomly allocated into two groups: a training set consisting of 234 cases, and a testing set consisting of 58 instances. Initially, we make direct predictions about the survival status by using pre-processed Hematoxylin and Eosin (H&E) pathological images of rectal cancer. We utilized the ResNest model to extract data from histopathological images of patients, resulting in a survival status prediction with an AUC (Area Under the Curve) of 0.797. Furthermore, we employ a multi-head attention fusion (MHAF) model to combine image features and clinical features in order to accurately forecast the survival rate of rectal cancer patients. The findings of our experiment show that the multi-modal structure works better than directly predicting from histopathological images. It achieves an AUC of 0.837 in predicting overall survival (OS). Conclusions Our study highlights the potential of multi-modal deep learning models in predicting survival status from histopathological images and clinical information, thus offering valuable insights for clinical applications.
Collapse
Affiliation(s)
- Yixin Xu
- Department of General Surgery, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
| | - Jiedong Guo
- Department of General Surgery, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
| | - Na Yang
- Artificial Intelligence Unit, Department of Medical Equipment Management, Affiliated Hospital of Xuzhou Medical University, Xuzhou, China
| | - Can Zhu
- Department of General Surgery, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
| | - Tianlei Zheng
- Artificial Intelligence Unit, Department of Medical Equipment Management, Affiliated Hospital of Xuzhou Medical University, Xuzhou, China
| | - Weiguo Zhao
- Artificial Intelligence Unit, Department of Medical Equipment Management, Affiliated Hospital of Xuzhou Medical University, Xuzhou, China
| | - Jia Liu
- Department of General Surgery, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
| | - Jun Song
- Department of General Surgery, The Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China
- Institute of Digestive Diseases, Xuzhou Medical University, Xuzhou, Jiangsu, China
| |
Collapse
|
6
|
Zhao F, Lv K, Ye S, Chen X, Chen H, Fan S, Mao N, Ren Y. Integration of temporal & spatial properties of dynamic functional connectivity based on two-directional two-dimensional principal component analysis for disease analysis. PeerJ 2024; 12:e17078. [PMID: 38618569 PMCID: PMC11011592 DOI: 10.7717/peerj.17078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Accepted: 02/19/2024] [Indexed: 04/16/2024] Open
Abstract
Dynamic functional connectivity, derived from resting-state functional magnetic resonance imaging (rs-fMRI), has emerged as a crucial instrument for investigating and supporting the diagnosis of neurological disorders. However, prevalent features of dynamic functional connectivity predominantly capture either temporal or spatial properties, such as mean and global efficiency, neglecting the significant information embedded in the fusion of spatial and temporal attributes. In addition, dynamic functional connectivity suffers from the problem of temporal mismatch, i.e., the functional connectivity of different subjects at the same time point cannot be matched. To address these problems, this article introduces a novel feature extraction framework grounded in two-directional two-dimensional principal component analysis. This framework is designed to extract features that integrate both spatial and temporal properties of dynamic functional connectivity. Additionally, we propose to use Fourier transform to extract temporal-invariance properties contained in dynamic functional connectivity. Experimental findings underscore the superior performance of features extracted by this framework in classification experiments compared to features capturing individual properties.
Collapse
Affiliation(s)
- Feng Zhao
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Ke Lv
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Shixin Ye
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Xiaobo Chen
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Hongyu Chen
- School Hospital, Shandong Technology and Business University, Yantai, China
| | - Sizhe Fan
- Canada Qingdao Secondary School (CQSS), Qingdao, China
| | - Ning Mao
- Department of Radiology, Yantai Yuhuangding Hospital, Yantai, China
| | - Yande Ren
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| |
Collapse
|
7
|
Kang E, Heo DW, Lee J, Suk HI. A Learnable Counter-Condition Analysis Framework for Functional Connectivity-Based Neurological Disorder Diagnosis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1377-1387. [PMID: 38019623 DOI: 10.1109/tmi.2023.3337074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/01/2023]
Abstract
To understand the biological characteristics of neurological disorders with functional connectivity (FC), recent studies have widely utilized deep learning-based models to identify the disease and conducted post-hoc analyses via explainable models to discover disease-related biomarkers. Most existing frameworks consist of three stages, namely, feature selection, feature extraction for classification, and analysis, where each stage is implemented separately. However, if the results at each stage lack reliability, it can cause misdiagnosis and incorrect analysis in afterward stages. In this study, we propose a novel unified framework that systemically integrates diagnoses (i.e., feature selection and feature extraction) and explanations. Notably, we devised an adaptive attention network as a feature selection approach to identify individual-specific disease-related connections. We also propose a functional network relational encoder that summarizes the global topological properties of FC by learning the inter-network relations without pre-defined edges between functional networks. Last but not least, our framework provides a novel explanatory power for neuroscientific interpretation, also termed counter-condition analysis. We simulated the FC that reverses the diagnostic information (i.e., counter-condition FC): converting a normal brain to be abnormal and vice versa. We validated the effectiveness of our framework by using two large resting-state functional magnetic resonance imaging (fMRI) datasets, Autism Brain Imaging Data Exchange (ABIDE) and REST-meta-MDD, and demonstrated that our framework outperforms other competing methods for disease identification. Furthermore, we analyzed the disease-related neurological patterns based on counter-condition analysis.
Collapse
|
8
|
Liu J, Yang W, Ma Y, Dong Q, Li Y, Hu B. Effective hyper-connectivity network construction and learning: Application to major depressive disorder identification. Comput Biol Med 2024; 171:108069. [PMID: 38394798 DOI: 10.1016/j.compbiomed.2024.108069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2023] [Revised: 01/08/2024] [Accepted: 01/27/2024] [Indexed: 02/25/2024]
Abstract
Functional connectivity (FC) derived from resting-state fMRI (rs-fMRI) is a primary approach for identifying brain diseases, but it is limited to capturing the pairwise correlation between regions-of-interest (ROIs) in the brain. Thus, hyper-connectivity which describes the higher-order relationship among multiple ROIs is receiving increasing attention. However, most hyper-connectivity methods overlook the directionality of connections. The direction of information flow constitutes a pivotal factor in shaping brain activity and cognitive processes. Neglecting this directional aspect can lead to an incomplete understanding of high-order interactions within the brain. To this end, we propose a novel effective hyper-connectivity (EHC) network that integrates direction detection and hyper-connectivity modeling. It characterizes the high-order directional information flow among multiple ROIs, providing a more comprehensive understanding of brain activity. Then, we develop a directed hypergraph convolutional network (DHGCN) to acquire deep representations from EHC network and functional indicators of ROIs. In contrast to conventional hypergraph convolutional networks designed for undirected hypergraphs, DHGCN is specifically tailored to handle directed hypergraph data structures. Moreover, unlike existing methods that primarily focus on fMRI time series, our proposed DHGCN model also incorporates multiple functional indicators, providing a robust framework for feature learning. Finally, deep representations generated via DHGCN, combined with demographic factors, are used for major depressive disorder (MDD) identification. Experimental results demonstrate that the proposed framework outperforms both FC and undirected hyper-connectivity models, as well as surpassing other state-of-the-art methods. The identification of EHC abnormalities through our framework can enhance the analysis of brain function in individuals with MDD.
Collapse
Affiliation(s)
- Jingyu Liu
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention, Ministry of Education, and the School of Medical Technology, Beijing Institute of Technology, Beijing, 100081, China
| | - Wenxin Yang
- School of Information Science and Engineering, Lanzhou University, 730000, Lanzhou, China
| | - Yulan Ma
- School of Automation Science and Electrical Engineering, State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, 100191, China
| | - Qunxi Dong
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention, Ministry of Education, and the School of Medical Technology, Beijing Institute of Technology, Beijing, 100081, China.
| | - Yang Li
- School of Automation Science and Electrical Engineering, State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, 100191, China.
| | - Bin Hu
- Key Laboratory of Brain Health Intelligent Evaluation and Intervention, Ministry of Education, and the School of Medical Technology, Beijing Institute of Technology, Beijing, 100081, China.
| |
Collapse
|
9
|
Kuang LD, Li HQ, Zhang J, Gui Y, Zhang J. Dynamic functional network connectivity analysis in schizophrenia based on a spatiotemporal CPD framework. J Neural Eng 2024; 21:016032. [PMID: 38335544 DOI: 10.1088/1741-2552/ad27ee] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 02/09/2024] [Indexed: 02/12/2024]
Abstract
Objective.Dynamic functional network connectivity (dFNC), based on data-driven group independent component (IC) analysis, is an important avenue for investigating underlying patterns of certain brain diseases such as schizophrenia. Canonical polyadic decomposition (CPD) of a higher-way dynamic functional connectivity tensor, can offer an innovative spatiotemporal framework to accurately characterize potential dynamic spatial and temporal fluctuations. Since multi-subject dFNC data from sliding-window analysis are also naturally a higher-order tensor, we propose an innovative sparse and low-rank CPD (SLRCPD) for the three-way dFNC tensor to excavate significant dynamic spatiotemporal aberrant changes in schizophrenia.Approach.The proposed SLRCPD approach imposes two constraints. First, the L1regularization on spatial modules is applied to extract sparse but significant dynamic connectivity and avoid overfitting the model. Second, low-rank constraint is added on time-varying weights to enhance the temporal state clustering quality. Shared dynamic spatial modules, group-specific dynamic spatial modules and time-varying weights can be extracted by SLRCPD. The strength of connections within- and between-IC networks and connection contribution are proposed to inspect the spatial modules. K-means clustering and classification are further conducted to explore temporal group difference.Main results.82 subject resting-state functional magnetic resonance imaging (fMRI) dataset and opening Center for Biomedical Research Excellence (COBRE) schizophrenia dataset both containing schizophrenia patients (SZs) and healthy controls (HCs) were utilized in our work. Three typical dFNC patterns between different brain functional regions were obtained. Compared to the spatial modules of HCs, the aberrant connections among auditory network, somatomotor, visual, cognitive control and cerebellar networks in 82 subject dataset and COBRE dataset were detected. Four temporal states reveal significant differences between SZs and HCs for these two datasets. Additionally, the accuracy values for SZs and HCs classification based on time-varying weights are larger than 0.96.Significance.This study significantly excavates spatio-temporal patterns for schizophrenia disease.
Collapse
Affiliation(s)
- Li-Dan Kuang
- School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha, People's Republic of China
| | - He-Qiang Li
- School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha, People's Republic of China
| | - Jianming Zhang
- School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha, People's Republic of China
| | - Yan Gui
- School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha, People's Republic of China
| | - Jin Zhang
- School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha, People's Republic of China
| |
Collapse
|
10
|
Wang M, Zhu L, Li X, Pan Y, Li L. Dynamic functional connectivity analysis with temporal convolutional network for attention deficit/hyperactivity disorder identification. Front Neurosci 2023; 17:1322967. [PMID: 38148943 PMCID: PMC10750397 DOI: 10.3389/fnins.2023.1322967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 11/24/2023] [Indexed: 12/28/2023] Open
Abstract
Introduction Dynamic functional connectivity (dFC), which can capture the abnormality of brain activity over time in resting-state functional magnetic resonance imaging (rs-fMRI) data, has a natural advantage in revealing the abnormal mechanism of brain activity in patients with Attention Deficit/Hyperactivity Disorder (ADHD). Several deep learning methods have been proposed to learn dynamic changes from rs-fMRI for FC analysis, and achieved superior performance than those using static FC. However, most existing methods only consider dependencies of two adjacent timestamps, which is limited when the change is related to the course of many timestamps. Methods In this paper, we propose a novel Temporal Dependence neural Network (TDNet) for FC representation learning and temporal-dependence relationship tracking from rs-fMRI time series for automated ADHD identification. Specifically, we first partition rs-fMRI time series into a sequence of consecutive and non-overlapping segments. For each segment, we design an FC generation module to learn more discriminative representations to construct dynamic FCs. Then, we employ the Temporal Convolutional Network (TCN) to efficiently capture long-range temporal patterns with dilated convolutions, followed by three fully connected layers for disease prediction. Results As the results, we found that considering the dynamic characteristics of rs-fMRI time series data is beneficial to obtain better diagnostic performance. In addition, dynamic FC networks generated in a data-driven manner are more informative than those constructed by Pearson correlation coefficients. Discussion We validate the effectiveness of the proposed approach through extensive experiments on the public ADHD-200 database, and the results demonstrate the superiority of the proposed model over state-of-the-art methods in ADHD identification.
Collapse
Affiliation(s)
- Mingliang Wang
- School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, China
- Nanjing Xinda Institute of Safety and Emergency Management, Nanjing, China
- MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Lingyao Zhu
- School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, China
| | - Xizhi Li
- School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, China
| | - Yong Pan
- School of Accounting, Nanjing University of Finance and Economics, Nanjing, China
| | - Long Li
- Taian Tumor Prevention and Treatment Hospital, Taian, China
| |
Collapse
|
11
|
Borchert RJ, Azevedo T, Badhwar A, Bernal J, Betts M, Bruffaerts R, Burkhart MC, Dewachter I, Gellersen HM, Low A, Lourida I, Machado L, Madan CR, Malpetti M, Mejia J, Michopoulou S, Muñoz-Neira C, Pepys J, Peres M, Phillips V, Ramanan S, Tamburin S, Tantiangco HM, Thakur L, Tomassini A, Vipin A, Tang E, Newby D, Ranson JM, Llewellyn DJ, Veldsman M, Rittman T. Artificial intelligence for diagnostic and prognostic neuroimaging in dementia: A systematic review. Alzheimers Dement 2023; 19:5885-5904. [PMID: 37563912 DOI: 10.1002/alz.13412] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 05/18/2023] [Accepted: 06/02/2023] [Indexed: 08/12/2023]
Abstract
INTRODUCTION Artificial intelligence (AI) and neuroimaging offer new opportunities for diagnosis and prognosis of dementia. METHODS We systematically reviewed studies reporting AI for neuroimaging in diagnosis and/or prognosis of cognitive neurodegenerative diseases. RESULTS A total of 255 studies were identified. Most studies relied on the Alzheimer's Disease Neuroimaging Initiative dataset. Algorithmic classifiers were the most commonly used AI method (48%) and discriminative models performed best for differentiating Alzheimer's disease from controls. The accuracy of algorithms varied with the patient cohort, imaging modalities, and stratifiers used. Few studies performed validation in an independent cohort. DISCUSSION The literature has several methodological limitations including lack of sufficient algorithm development descriptions and standard definitions. We make recommendations to improve model validation including addressing key clinical questions, providing sufficient description of AI methods and validating findings in independent datasets. Collaborative approaches between experts in AI and medicine will help achieve the promising potential of AI tools in practice. HIGHLIGHTS There has been a rapid expansion in the use of machine learning for diagnosis and prognosis in neurodegenerative disease Most studies (71%) relied on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset with no other individual dataset used more than five times There has been a recent rise in the use of more complex discriminative models (e.g., neural networks) that performed better than other classifiers for classification of AD vs healthy controls We make recommendations to address methodological considerations, addressing key clinical questions, and validation We also make recommendations for the field more broadly to standardize outcome measures, address gaps in the literature, and monitor sources of bias.
Collapse
Affiliation(s)
- Robin J Borchert
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - Tiago Azevedo
- Department of Computer Science and Technology, University of Cambridge, Cambridge, UK
| | - AmanPreet Badhwar
- Department of Pharmacology and Physiology, University of Montreal, Montreal, Canada
- Centre de recherche de l'Institut Universitaire de Gériatrie (CRIUGM), Montreal, Canada
| | - Jose Bernal
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, UK
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
| | - Matthew Betts
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
- Center for Behavioral Brain Sciences, University of Magdeburg, Magdeburg, Germany
| | - Rose Bruffaerts
- Computational Neurology, Experimental Neurobiology Unit, Department of Biomedical Sciences, University of Antwerp, Antwerp, Belgium
- Biomedical Research Institute, Hasselt University, Diepenbeek, Belgium
| | | | - Ilse Dewachter
- Biomedical Research Institute, Hasselt University, Diepenbeek, Belgium
| | - Helena M Gellersen
- German Center for Neurodegenerative Diseases (DZNE), Magdeburg, Germany
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Audrey Low
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | | | - Luiza Machado
- Department of Biochemistry, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | | | - Maura Malpetti
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | - Jhony Mejia
- Department of Biomedical Engineering, Universidad de Los Andes, Bogotá, Colombia
| | - Sofia Michopoulou
- Imaging Physics, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Carlos Muñoz-Neira
- Research into Memory, Brain sciences and dementia Group (ReMemBr Group), Translational Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
- Artificial Intelligence & Computational Neuroscience Group (AICN Group), Sheffield Institute for Translational Neuroscience (SITraN), Department of Neuroscience, University of Sheffield, Sheffield, UK
| | - Jack Pepys
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| | - Marion Peres
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | | | - Siddharth Ramanan
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Stefano Tamburin
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy
| | | | - Lokendra Thakur
- Division of Genetics and Genomics, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA
- Broad Institute of MIT and Harvard, Cambridge, UK
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Alessandro Tomassini
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | | | - Eugene Tang
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Danielle Newby
- Department of Psychiatry, University of Oxford, Oxford, UK
| | | | - David J Llewellyn
- University of Exeter Medical School, Exeter, UK
- Alan Turing Institute, London, UK
| | - Michele Veldsman
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Timothy Rittman
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| |
Collapse
|
12
|
Sui J, Zhi D, Calhoun VD. Data-driven multimodal fusion: approaches and applications in psychiatric research. PSYCHORADIOLOGY 2023; 3:kkad026. [PMID: 38143530 PMCID: PMC10734907 DOI: 10.1093/psyrad/kkad026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 11/08/2023] [Accepted: 11/21/2023] [Indexed: 12/26/2023]
Abstract
In the era of big data, where vast amounts of information are being generated and collected at an unprecedented rate, there is a pressing demand for innovative data-driven multi-modal fusion methods. These methods aim to integrate diverse neuroimaging perspectives to extract meaningful insights and attain a more comprehensive understanding of complex psychiatric disorders. However, analyzing each modality separately may only reveal partial insights or miss out on important correlations between different types of data. This is where data-driven multi-modal fusion techniques come into play. By combining information from multiple modalities in a synergistic manner, these methods enable us to uncover hidden patterns and relationships that would otherwise remain unnoticed. In this paper, we present an extensive overview of data-driven multimodal fusion approaches with or without prior information, with specific emphasis on canonical correlation analysis and independent component analysis. The applications of such fusion methods are wide-ranging and allow us to incorporate multiple factors such as genetics, environment, cognition, and treatment outcomes across various brain disorders. After summarizing the diverse neuropsychiatric magnetic resonance imaging fusion applications, we further discuss the emerging neuroimaging analyzing trends in big data, such as N-way multimodal fusion, deep learning approaches, and clinical translation. Overall, multimodal fusion emerges as an imperative approach providing valuable insights into the underlying neural basis of mental disorders, which can uncover subtle abnormalities or potential biomarkers that may benefit targeted treatments and personalized medical interventions.
Collapse
Affiliation(s)
- Jing Sui
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Dongmei Zhi
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia Institute of Technology, Emory University and Georgia State University, Atlanta, GA 30303, United States
| |
Collapse
|
13
|
Lei D, Zhang T, Wu Y, Li W, Li X. Autism spectrum disorder diagnosis based on deep unrolling-based spatial constraint representation. Med Biol Eng Comput 2023; 61:2829-2842. [PMID: 37486440 DOI: 10.1007/s11517-023-02859-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 05/25/2023] [Indexed: 07/25/2023]
Abstract
Accurate diagnosis of autism spectrum disorder (ASD) is crucial for effective treatment and prognosis. Functional brain networks (FBNs) constructed from functional magnetic resonance imaging (fMRI) have become a popular tool for ASD diagnosis. However, existing model-driven approaches used to construct FBNs lack the ability to capture potential non-linear relationships between data and labels. Moreover, most existing studies treat the FBNs construction and disease classification as separate steps, leading to large inter-subject variability in the estimated FBNs and reducing the statistical power of subsequent group comparison. To address these limitations, we propose a new approach to FBNs construction called the deep unrolling-based spatial constraint representation (DUSCR) model and integrate it with a convolutional classifier to create an end-to-end framework for ASD recognition. Specifically, the model spatial constraint representation (SCR) is solved using a proximal gradient descent algorithm, and we unroll it into deep networks using the deep unrolling algorithm. Classification is then performed using a convolutional prototype learning model. We evaluated the effectiveness of the proposed method on the ABIDE I dataset and observed a significant improvement in model performance and classification accuracy. The resting state fMRI images are preprocessed into time series data and 3D coordinates of each region of interest. The data are fed into the DUSCR model, a model for building functional brain networks using deep learning instead of traditional models, that we propose, and then the outputs are fed into the convolutional classifier with prototype learning to determine whether the patient has ASD disease.
Collapse
Affiliation(s)
- Dajiang Lei
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Tao Zhang
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Yue Wu
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Weisheng Li
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Xinwei Li
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China.
| |
Collapse
|
14
|
Li Y, Zhang Y, Liu JY, Wang K, Zhang K, Zhang GS, Liao XF, Yang G. Global Transformer and Dual Local Attention Network via Deep-Shallow Hierarchical Feature Fusion for Retinal Vessel Segmentation. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:5826-5839. [PMID: 35984806 DOI: 10.1109/tcyb.2022.3194099] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Clinically, retinal vessel segmentation is a significant step in the diagnosis of fundus diseases. However, recent methods generally neglect the difference of semantic information between deep and shallow features, which fail to capture the global and local characterizations in fundus images simultaneously, resulting in the limited segmentation performance for fine vessels. In this article, a global transformer (GT) and dual local attention (DLA) network via deep-shallow hierarchical feature fusion (GT-DLA-dsHFF) are investigated to solve the above limitations. First, the GT is developed to integrate the global information in the retinal image, which effectively captures the long-distance dependence between pixels, alleviating the discontinuity of blood vessels in the segmentation results. Second, DLA, which is constructed using dilated convolutions with varied dilation rates, unsupervised edge detection, and squeeze-excitation block, is proposed to extract local vessel information, consolidating the edge details in the segmentation result. Finally, a novel deep-shallow hierarchical feature fusion (dsHFF) algorithm is studied to fuse the features in different scales in the deep learning framework, respectively, which can mitigate the attenuation of valid information in the process of feature fusion. We verified the GT-DLA-dsHFF on four typical fundus image datasets. The experimental results demonstrate our GT-DLA-dsHFF achieves superior performance against the current methods and detailed discussions verify the efficacy of the proposed three modules. Segmentation results of diseased images show the robustness of our proposed GT-DLA-dsHFF. Implementation codes will be available on https://github.com/YangLibuaa/GT-DLA-dsHFF.
Collapse
|
15
|
Yoon JA, Kong IJ, Choi I, Cha J, Baek JY, Choi J, Shin YB, Shin MJ, Lee YM. Correlation between cerebral hemodynamic functional near-infrared spectroscopy and positron emission tomography for assessing mild cognitive impairment and Alzheimer's disease: An exploratory study. PLoS One 2023; 18:e0285013. [PMID: 37561711 PMCID: PMC10414577 DOI: 10.1371/journal.pone.0285013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 04/13/2023] [Indexed: 08/12/2023] Open
Abstract
This study was performed to investigate the usefulness of functional near-infrared spectroscopy (fNIRS) by conducting a comparative analysis of hemodynamic activation detected by fNIRS and positron emission tomography (PET) and magnetic resonance imaging (MRI) in patients with mild cognitive impairment (MCI) and Alzheimer's disease (AD). Participants were divided into four groups: the subjective memory impairment (SMI), amnestic MCI (aMCI), non-amnestic MCI (naMCI), and AD groups. We recorded the hemodynamic response during the semantic verbal fluency task (SVFT) using a commercial wireless continuous-wave NIRS system. The correlation between the parameters of the neuroimaging assessments among the groups was analyzed. Region of interest-based comparisons showed that the four groups had significantly different hemodynamic responses during SVFT in the bilateral dorsolateral prefrontal cortex (DLPFC). The linear mixed effect model result indicates that the mean ΔHbO2 from the bilateral DLPFC regions showed a significant positive correlation to the overall FDG-PET after controlling for age and group differences in the fNIRS signals. Amyloid PET signals tended to better differentiate the AD group from other groups, and fNIRS signals tended to better differentiate the SMI group from other groups. In addition, a comparison between the group pairs revealed a mirrored pattern between the hippocampal volume and hemodynamic response in the DLPFC. The hemodynamic response detected by fNIRS showed a significant correlation with metabolic and anatomical changes associated with disease progression. Therefore, fNIRS may be considered as a screening tool to predict the hemodynamic and metabolic statuses of the brain in patients with MCI and AD.
Collapse
Affiliation(s)
- Jin A. Yoon
- Department of Rehabilitation Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
| | - In Joo Kong
- Department of Rehabilitation Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
| | | | | | | | | | - Yong Beom Shin
- Department of Rehabilitation Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
| | - Myung Jun Shin
- Department of Rehabilitation Medicine, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
| | - Young-Min Lee
- Department of Psychiatry, Pusan National University School of Medicine and Biomedical Research Institute, Pusan National University Hospital, Busan, Republic of Korea
| |
Collapse
|
16
|
Zhang C, Ma Y, Qiao L, Zhang L, Liu M. Learning to Fuse Multiple Brain Functional Networks for Automated Autism Identification. BIOLOGY 2023; 12:971. [PMID: 37508401 PMCID: PMC10376072 DOI: 10.3390/biology12070971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 07/03/2023] [Accepted: 07/06/2023] [Indexed: 07/30/2023]
Abstract
Functional connectivity network (FCN) has become a popular tool to identify potential biomarkers for brain dysfunction, such as autism spectrum disorder (ASD). Due to its importance, researchers have proposed many methods to estimate FCNs from resting-state functional MRI (rs-fMRI) data. However, the existing FCN estimation methods usually only capture a single relationship between brain regions of interest (ROIs), e.g., linear correlation, nonlinear correlation, or higher-order correlation, thus failing to model the complex interaction among ROIs in the brain. Additionally, such traditional methods estimate FCNs in an unsupervised way, and the estimation process is independent of the downstream tasks, which makes it difficult to guarantee the optimal performance for ASD identification. To address these issues, in this paper, we propose a multi-FCN fusion framework for rs-fMRI-based ASD classification. Specifically, for each subject, we first estimate multiple FCNs using different methods to encode rich interactions among ROIs from different perspectives. Then, we use the label information (ASD vs. healthy control (HC)) to learn a set of fusion weights for measuring the importance/discrimination of those estimated FCNs. Finally, we apply the adaptively weighted fused FCN on the ABIDE dataset to identify subjects with ASD from HCs. The proposed FCN fusion framework is straightforward to implement and can significantly improve diagnostic accuracy compared to traditional and state-of-the-art methods.
Collapse
Affiliation(s)
- Chaojun Zhang
- The School of Computer Science and Technology, Shandong Jianzhu University, Jinan 250101, China
- The School of Mathematics Science, Liaocheng University, Liaocheng 252000, China
| | - Yunling Ma
- The School of Mathematics Science, Liaocheng University, Liaocheng 252000, China
| | - Lishan Qiao
- The School of Mathematics Science, Liaocheng University, Liaocheng 252000, China
| | - Limei Zhang
- The School of Computer Science and Technology, Shandong Jianzhu University, Jinan 250101, China
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| |
Collapse
|
17
|
Bedel HA, Sivgin I, Dalmaz O, Dar SUH, Çukur T. BolT: Fused window transformers for fMRI time series analysis. Med Image Anal 2023; 88:102841. [PMID: 37224718 DOI: 10.1016/j.media.2023.102841] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 02/07/2023] [Accepted: 05/10/2023] [Indexed: 05/26/2023]
Abstract
Deep-learning models have enabled performance leaps in analysis of high-dimensional functional MRI (fMRI) data. Yet, many previous methods are suboptimally sensitive for contextual representations across diverse time scales. Here, we present BolT, a blood-oxygen-level-dependent transformer model, for analyzing multi-variate fMRI time series. BolT leverages a cascade of transformer encoders equipped with a novel fused window attention mechanism. Encoding is performed on temporally-overlapped windows within the time series to capture local representations. To integrate information temporally, cross-window attention is computed between base tokens in each window and fringe tokens from neighboring windows. To gradually transition from local to global representations, the extent of window overlap and thereby number of fringe tokens are progressively increased across the cascade. Finally, a novel cross-window regularization is employed to align high-level classification features across the time series. Comprehensive experiments on large-scale public datasets demonstrate the superior performance of BolT against state-of-the-art methods. Furthermore, explanatory analyses to identify landmark time points and regions that contribute most significantly to model decisions corroborate prominent neuroscientific findings in the literature.
Collapse
Affiliation(s)
- Hasan A Bedel
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Irmak Sivgin
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Onat Dalmaz
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Salman U H Dar
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Tolga Çukur
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey; Neuroscience Program, Bilkent University, Ankara 06800, Turkey.
| |
Collapse
|
18
|
Li R, Li Z, Fan H, Teng S, Cao X. MCFSA-Net: A multi-scale channel fusion and spatial activation network for retinal vessel segmentation. JOURNAL OF BIOPHOTONICS 2023; 16:e202200295. [PMID: 36413066 DOI: 10.1002/jbio.202200295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Revised: 11/10/2022] [Accepted: 11/17/2022] [Indexed: 06/16/2023]
Abstract
As the only vascular tissue that can be directly viewed in vivo, retinal vessels are medically important in assisting the diagnosis of ocular and cardiovascular diseases. They generally appear as different morphologies and uneven thickness in fundus images. Therefore, the single-scale segmentation method may fail to capture abundant morphological features, suffering from the deterioration in vessel segmentation, especially for tiny vessels. To alleviate this issue, we propose a multi-scale channel fusion and spatial activation network (MCFSA-Net) for retinal vessel segmentation with emphasis on tiny ones. Specifically, the Hybrid Convolution-DropBlock (HC-Drop) is first used to extract deep features of vessels and construct multi-scale feature maps by progressive down-sampling. Then, the Channel Cooperative Attention Fusion (CCAF) module is designed to handle different morphological vessels in a multi-scale manner. Finally, the Global Spatial Activation (GSA) module is introduced to aggregate global feature information for improving the attention on tiny vessels in the spatial domain and realizing effective segmentation for them. Experiments are carried out on three datasets including DRIVE, CHASE_DB1, and STARE. Our retinal vessel segmentation method achieves Accuracy of 96.95%, 97.57%, and 97.83%, and F1 score of 82.67%, 81.82%, and 82.95% in the above datasets, respectively. Qualitative and quantitative analysis show that the proposed method outperforms current advanced vessel segmentation methods, especially for tiny vessels.
Collapse
Affiliation(s)
- Rui Li
- College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao, China
| | - Zuoyong Li
- Fujian Provincial Key Laboratory of Information Processing and Intelligent Control, College of Computer and Control Engineering, Minjiang University, Fuzhou, China
| | - Haoyi Fan
- School of Computer and Artificial Intelligence, Zhengzhou University, Zhengzhou, China
| | - Shenghua Teng
- College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao, China
| | - Xinrong Cao
- Fujian Provincial Key Laboratory of Information Processing and Intelligent Control, College of Computer and Control Engineering, Minjiang University, Fuzhou, China
- Fuzhou Digital Healthcare Industry Technology Innovation Center, Minjiang University, Fuzhou, China
| |
Collapse
|
19
|
Cui W, Du J, Sun M, Zhu S, Zhao S, Peng Z, Tan L, Li Y. Dynamic multi-site graph convolutional network for autism spectrum disorder identification. Comput Biol Med 2023; 157:106749. [PMID: 36921455 DOI: 10.1016/j.compbiomed.2023.106749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2023] [Revised: 02/13/2023] [Accepted: 03/06/2023] [Indexed: 03/12/2023]
Abstract
Multi-site learning has attracted increasing interests in autism spectrum disorder (ASD) identification tasks by its efficacy on capturing data heterogeneity of neuroimaging taken from different medical sites. However, existing multi-site graph convolutional network (MSGCN) often ignores the correlations between different sites, and may obtain suboptimal identification results. Moreover, current feature extraction methods characterizing temporal variations of functional magnetic resonance imaging (fMRI) signals require the time series to be of the same length and cannot be directly applied to multi-site fMRI datasets. To address these problems, we propose a dual graph based dynamic multi-site graph convolutional network (DG-DMSGCN) for multi-site ASD identification. First, a sliding-window dual-graph convolutional network (SW-DGCN) is introduced for feature extraction, simultaneously capturing temporal and spatial features of fMRI data with different series lengths. Then we aggregate the features extracted from multiple medical sites through a novel dynamic multi-site graph convolutional network (DMSGCN), which effectively considers the correlations between different sites and is beneficial to improve identification performance. We evaluate the proposed DG-DMSGCN on public ABIDE I dataset containing data from 17 medical sites. The promising results obtained by our framework outperforms the state-of-the-art methods with increase in identification accuracy, indicating that it has a potential clinical prospect for practical ASD diagnosis. Our codes are available on https://github.com/Junling-Du/DG-DMSGCN.
Collapse
Affiliation(s)
- Weigang Cui
- School of Engineering Medicine, Beihang University, Beijing, 100191, China.
| | - Junling Du
- Department of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191, China.
| | - Mingyi Sun
- Department of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191, China.
| | - Shimao Zhu
- South China Hospital of Shenzhen University, Shenzhen University, Shenzhen, 518111, China.
| | - Shijie Zhao
- School of Automation, Northwestern Polytechnical University, Xi'an, Shaanxi, 710072, China.
| | - Ziwen Peng
- Department of Child Psychiatry, Shenzhen Kangning Hospital, Shenzhen University School of Medicine, Shenzhen, 518020, China.
| | - Li Tan
- School of Computer Science and Engineering, Beijing Technology and Business Universtiy, Beijing, 100048, China.
| | - Yang Li
- Department of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191, China; State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, 100191, China.
| |
Collapse
|
20
|
Song X, Zhou F, Frangi AF, Cao J, Xiao X, Lei Y, Wang T, Lei B. Multicenter and Multichannel Pooling GCN for Early AD Diagnosis Based on Dual-Modality Fused Brain Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:354-367. [PMID: 35767511 DOI: 10.1109/tmi.2022.3187141] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
For significant memory concern (SMC) and mild cognitive impairment (MCI), their classification performance is limited by confounding features, diverse imaging protocols, and limited sample size. To address the above limitations, we introduce a dual-modality fused brain connectivity network combining resting-state functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI), and propose three mechanisms in the current graph convolutional network (GCN) to improve classifier performance. First, we introduce a DTI-strength penalty term for constructing functional connectivity networks. Stronger structural connectivity and bigger structural strength diversity between groups provide a higher opportunity for retaining connectivity information. Second, a multi-center attention graph with each node representing a subject is proposed to consider the influence of data source, gender, acquisition equipment, and disease status of those training samples in GCN. The attention mechanism captures their different impacts on edge weights. Third, we propose a multi-channel mechanism to improve filter performance, assigning different filters to features based on feature statistics. Applying those nodes with low-quality features to perform convolution would also deteriorate filter performance. Therefore, we further propose a pooling mechanism, which introduces the disease status information of those training samples to evaluate the quality of nodes. Finally, we obtain the final classification results by inputting the multi-center attention graph into the multi-channel pooling GCN. The proposed method is tested on three datasets (i.e., an ADNI 2 dataset, an ADNI 3 dataset, and an in-house dataset). Experimental results indicate that the proposed method is effective and superior to other related algorithms, with a mean classification accuracy of 93.05% in our binary classification tasks. Our code is available at: https://github.com/Xuegang-S.
Collapse
|
21
|
Huang P, He P, Tian S, Ma M, Feng P, Xiao H, Mercaldo F, Santone A, Qin J. A ViT-AMC Network With Adaptive Model Fusion and Multiobjective Optimization for Interpretable Laryngeal Tumor Grading From Histopathological Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:15-28. [PMID: 36018875 DOI: 10.1109/tmi.2022.3202248] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
The tumor grading of laryngeal cancer pathological images needs to be accurate and interpretable. The deep learning model based on the attention mechanism-integrated convolution (AMC) block has good inductive bias capability but poor interpretability, whereas the deep learning model based on the vision transformer (ViT) block has good interpretability but weak inductive bias ability. Therefore, we propose an end-to-end ViT-AMC network (ViT-AMCNet) with adaptive model fusion and multiobjective optimization that integrates and fuses the ViT and AMC blocks. However, existing model fusion methods often have negative fusion: 1). There is no guarantee that the ViT and AMC blocks will simultaneously have good feature representation capability. 2). The difference in feature representations learning between the ViT and AMC blocks is not obvious, so there is much redundant information in the two feature representations. Accordingly, we first prove the feasibility of fusing the ViT and AMC blocks based on Hoeffding's inequality. Then, we propose a multiobjective optimization method to solve the problem that ViT and AMC blocks cannot simultaneously have good feature representation. Finally, an adaptive model fusion method integrating the metrics block and the fusion block is proposed to increase the differences between feature representations and improve the deredundancy capability. Our methods improve the fusion ability of ViT-AMCNet, and experimental results demonstrate that ViT-AMCNet significantly outperforms state-of-the-art methods. Importantly, the visualized interpretive maps are closer to the region of interest of concern by pathologists, and the generalization ability is also excellent. Our code is publicly available at https://github.com/Baron-Huang/ViT-AMCNet.
Collapse
|
22
|
Kazemi-Harikandei SZ, Shobeiri P, Salmani Jelodar MR, Tavangar SM. Effective connectivity in individuals with Alzheimer's disease and mild cognitive impairment: A systematic review. NEUROSCIENCE INFORMATICS 2022; 2:100104. [DOI: 10.1016/j.neuri.2022.100104] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/27/2023]
|
23
|
Hao X, An Q, Li J, Min H, Guo Y, Yu M, Qin J. Exploring high-order correlations with deep-broad learning for autism spectrum disorder diagnosis. Front Neurosci 2022; 16:1046268. [PMID: 36483179 PMCID: PMC9723136 DOI: 10.3389/fnins.2022.1046268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Accepted: 11/02/2022] [Indexed: 01/25/2023] Open
Abstract
Recently, a lot of research has been conducted on diagnosing neurological disorders, such as autism spectrum disorder (ASD). Functional magnetic resonance imaging (fMRI) is the commonly used technique to assist in the diagnosis of ASD. In the past years, some conventional methods have been proposed to extract the low-order functional connectivity network features for ASD diagnosis, which ignore the complexity and global features of the brain network. Most deep learning-based methods generally have a large number of parameters that need to be adjusted during the learning process. To overcome the limitations mentioned above, we propose a novel deep-broad learning method for learning the higher-order brain functional connectivity network features to assist in ASD diagnosis. Specifically, we first construct the high-order functional connectivity network that describes global correlations of the brain regions based on hypergraph, and then we use the deep-broad learning method to extract the high-dimensional feature representations for brain networks sequentially. The evaluation of the proposed method is conducted on Autism Brain Imaging Data Exchange (ABIDE) dataset. The results show that our proposed method can achieve 71.8% accuracy on the multi-center dataset and 70.6% average accuracy on 17 single-center datasets, which are the best results compared with the state-of-the-art methods. Experimental results demonstrate that our method can describe the global features of the brain regions and get rich discriminative information for the classification task.
Collapse
Affiliation(s)
- Xiaoke Hao
- School of Artificial Intelligence, Hebei University of Technology, Tianjin, China
| | - Qijin An
- School of Artificial Intelligence, Hebei University of Technology, Tianjin, China
| | - Jiayang Li
- School of Artificial Intelligence, Hebei University of Technology, Tianjin, China
| | - Hongjie Min
- School of Artificial Intelligence, Hebei University of Technology, Tianjin, China
| | - Yingchun Guo
- School of Artificial Intelligence, Hebei University of Technology, Tianjin, China
| | - Ming Yu
- School of Artificial Intelligence, Hebei University of Technology, Tianjin, China
| | - Jing Qin
- School of Nursing, Centre for Smart Health, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| |
Collapse
|
24
|
Liu J, Ji J, Xun G, Zhang A. Inferring Effective Connectivity Networks From fMRI Time Series With a Temporal Entropy-Score. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:5993-6006. [PMID: 33886478 DOI: 10.1109/tnnls.2021.3072149] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Inferring brain-effective connectivity networks from neuroimaging data has become a very hot topic in neuroinformatics and bioinformatics. In recent years, the search methods based on Bayesian network score have been greatly developed and become an emerging method for inferring effective connectivity. However, the previous score functions ignore the temporal information from functional magnetic resonance imaging (fMRI) series data and may not be able to determine all orientations in some cases. In this article, we propose a novel score function for inferring effective connectivity from fMRI data based on the conditional entropy and transfer entropy (TE) between brain regions. The new score employs the TE to capture the temporal information and can effectively infer connection directions between brain regions. Experimental results on both simulated and real-world data demonstrate the efficacy of our proposed score function.
Collapse
|
25
|
Xiao J, Uddin LQ, Meng Y, Li L, Gao L, Shan X, Huang X, Liao W, Chen H, Duan X. A spatio-temporal decomposition framework for dynamic functional connectivity in the human brain. Neuroimage 2022; 263:119618. [PMID: 36087902 DOI: 10.1016/j.neuroimage.2022.119618] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 08/15/2022] [Accepted: 09/06/2022] [Indexed: 11/29/2022] Open
Abstract
Much recent attention has been directed toward investigating the spatial and temporal organization of brain dynamics, but the rules which constrain the variation of spatio-temporal organization in functional connectivity under different brain states remain unclear. Here, we developed a novel computational approach based on tensor decomposition and regularization to represent dynamic functional connectivity as a linear combination of dynamic modules and time-varying weights. In this approach, dynamic modules represent co-activating functional connectivity patterns, and time-varying weights represent the temporal expression of dynamic modules. We applied this dynamic decomposition model (DDM) on a resting-state fMRI dataset and found that whole-brain dynamic functional connectivity can be decomposed as a linear combination of eight dynamic modules which we summarize as 'high order modules' and 'primary-high order modules', according to their spatial attributes and correspondence with existing intrinsic functional brain networks. By clustering the time-varying weights, we identified five brain states including three major states and two minor states. We found that state transitions mainly occurred between the three major states, and that temporal variation of dynamic modules may contribute to brain state transitions. We then conceptualized the variability of weights as the flexibility of the corresponding dynamic modules and found that different dynamic modules exhibit different amounts of flexibility and contribute to different cognitive measures. Finally, we applied DDM to a schizophrenia resting-state fMRI dataset and found that atypical flexibility of dynamic modules correlates with impaired cognitive flexibility in schizophrenia. Overall, this work provides a quantitative framework that characterizes temporal variation in the topology of dynamic functional connectivity.
Collapse
Affiliation(s)
- Jinming Xiao
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Lucina Q Uddin
- Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, United States
| | - Yao Meng
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Lei Li
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Leying Gao
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Xiaolong Shan
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Xinyue Huang
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Wei Liao
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Huafu Chen
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China.
| | - Xujun Duan
- The Clinical Hospital of Chengdu Brain Science Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China; High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, MOE Key Lab for Neuro Information, University of Electronic Science and Technology of China, Chengdu 611731, China.
| |
Collapse
|
26
|
Huang H, Liu Q, Jiang Y, Yang Q, Zhu X, Li Y. Deep Spatio-Temporal Attention-based Recurrent Network from Dynamic Adaptive Functional Connectivity for MCI Identification. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2600-2612. [PMID: 36040940 DOI: 10.1109/tnsre.2022.3202713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Most existing methods of constructing dynamic functional connectivity (dFC) network obtain the connectivity strength via the sliding window correlation (SWC) method, which estimates the connectivity strength at each time segment, rather than at each time point, and thus is difficult to produce accurate dFC network due to the influence of the window type and window width. Furthermore, the deep learning methods may not capture the discriminative spatio-temporal information that is closely related to disease, thus impacting the performance of (mild cognitive impairment) MCI identification. In this paper, a novel spatio-temporal attention-based bidirectional gated recurrent unit (STA-BiGRU) network is proposed to extract inherent spatio-temporal information from a dynamic adaptive functional connectivity (dAFC) network for MCI diagnosis. Specifically, we adopt a group lasso-based Kalman filter algorithm to obtain the dAFC network with more accurate connectivity strength at each time step. Then a spatial attention module with self-attention and a temporal attention module with multiple temporal attention vectors are incorporated into the BiGRU network to extract more discriminative disease-related spatio-temporal information. Finally, the spatio-temporal regularizations are employed to better guide the attention learning of STA-BiGRU network to enhance the robustness of the deep network. Experimental results show that the proposed framework achieves mean accuracies of 90.2%, 90.0%, and 81.5%, respectively, for three MCI classification tasks. This study provides a more effective deep spatio-temporal attention-based recurrent network and obtains good performance and interpretability of deep learning for psychiatry diagnosis research.
Collapse
|
27
|
Li Y, Zhang Y, Cui W, Lei B, Kuang X, Zhang T. Dual Encoder-Based Dynamic-Channel Graph Convolutional Network With Edge Enhancement for Retinal Vessel Segmentation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1975-1989. [PMID: 35167444 DOI: 10.1109/tmi.2022.3151666] [Citation(s) in RCA: 30] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Retinal vessel segmentation with deep learning technology is a crucial auxiliary method for clinicians to diagnose fundus diseases. However, the deep learning approaches inevitably lose the edge information, which contains spatial features of vessels while performing down-sampling, leading to the limited segmentation performance of fine blood vessels. Furthermore, the existing methods ignore the dynamic topological correlations among feature maps in the deep learning framework, resulting in the inefficient capture of the channel characterization. To address these limitations, we propose a novel dual encoder-based dynamic-channel graph convolutional network with edge enhancement (DE-DCGCN-EE) for retinal vessel segmentation. Specifically, we first design an edge detection-based dual encoder to preserve the edge of vessels in down-sampling. Secondly, we investigate a dynamic-channel graph convolutional network to map the image channels to the topological space and synthesize the features of each channel on the topological map, which solves the limitation of insufficient channel information utilization. Finally, we study an edge enhancement block, aiming to fuse the edge and spatial features in the dual encoder, which is beneficial to improve the accuracy of fine blood vessel segmentation. Competitive experimental results on five retinal image datasets validate the efficacy of the proposed DE-DCGCN-EE, which achieves more remarkable segmentation results against the other state-of-the-art methods, indicating its potential clinical application.
Collapse
|
28
|
Huang Z, Lei H, Chen G, Frangi AF, Xu Y, Elazab A, Qin J, Lei B. Parkinson's Disease Classification and Clinical Score Regression via United Embedding and Sparse Learning From Longitudinal Data. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:3357-3371. [PMID: 33534713 DOI: 10.1109/tnnls.2021.3052652] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Parkinson's disease (PD) is known as an irreversible neurodegenerative disease that mainly affects the patient's motor system. Early classification and regression of PD are essential to slow down this degenerative process from its onset. In this article, a novel adaptive unsupervised feature selection approach is proposed by exploiting manifold learning from longitudinal multimodal data. Classification and clinical score prediction are performed jointly to facilitate early PD diagnosis. Specifically, the proposed approach performs united embedding and sparse regression, which can determine the similarity matrices and discriminative features adaptively. Meanwhile, we constrain the similarity matrix among subjects and exploit the l2,p norm to conduct sparse adaptive control for obtaining the intrinsic information of the multimodal data structure. An effective iterative optimization algorithm is proposed to solve this problem. We perform abundant experiments on the Parkinson's Progression Markers Initiative (PPMI) data set to verify the validity of the proposed approach. The results show that our approach boosts the performance on the classification and clinical score regression of longitudinal data and surpasses the state-of-the-art approaches.
Collapse
|
29
|
Long Z, Li J, Liao H, Deng L, Du Y, Fan J, Li X, Miao J, Qiu S, Long C, Jing B. A Multi-Modal and Multi-Atlas Integrated Framework for Identification of Mild Cognitive Impairment. Brain Sci 2022; 12:brainsci12060751. [PMID: 35741636 PMCID: PMC9221217 DOI: 10.3390/brainsci12060751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 05/29/2022] [Accepted: 06/03/2022] [Indexed: 11/16/2022] Open
Abstract
Background: Multi-modal neuroimaging with appropriate atlas is vital for effectively differentiating mild cognitive impairment (MCI) from healthy controls (HC). Methods: The resting-state functional magnetic resonance imaging (rs-fMRI) and structural MRI (sMRI) of 69 MCI patients and 61 HC subjects were collected. Then, the gray matter volumes obtained from the sMRI and Hurst exponent (HE) values calculated from rs-fMRI data in the Automated Anatomical Labeling (AAL-90), Brainnetome (BN-246), Harvard–Oxford (HOA-112) and AAL3-170 atlases were extracted, respectively. Next, these characteristics were selected with a minimal redundancy maximal relevance algorithm and a sequential feature collection method in single or multi-modalities, and only the optimal features were retained after this procedure. Lastly, the retained characteristics were served as the input features for the support vector machine (SVM)-based method to classify MCI patients, and the performance was estimated with a leave-one-out cross-validation (LOOCV). Results: Our proposed method obtained the best 92.00% accuracy, 94.92% specificity and 89.39% sensitivity with the sMRI in AAL-90 and the fMRI in HOA-112 atlas, which was much better than using the single-modal or single-atlas features. Conclusion: The results demonstrated that the multi-modal and multi-atlas integrated method could effectively recognize MCI patients, which could be extended into various neurological and neuropsychiatric diseases.
Collapse
Affiliation(s)
- Zhuqing Long
- Medical Apparatus and Equipment Deployment, Hunan Children’s Hospital, Changsha 410007, China; (Z.L.); (J.L.); (H.L.); (Y.D.); (S.Q.)
- School of Biomedical Engineering, Capital Medical University, Beijing 100069, China
| | - Jie Li
- Medical Apparatus and Equipment Deployment, Hunan Children’s Hospital, Changsha 410007, China; (Z.L.); (J.L.); (H.L.); (Y.D.); (S.Q.)
| | - Haitao Liao
- Medical Apparatus and Equipment Deployment, Hunan Children’s Hospital, Changsha 410007, China; (Z.L.); (J.L.); (H.L.); (Y.D.); (S.Q.)
| | - Li Deng
- Department of Data Assessment and Examination, Hunan Children’s Hospital, Changsha 410007, China;
| | - Yukeng Du
- Medical Apparatus and Equipment Deployment, Hunan Children’s Hospital, Changsha 410007, China; (Z.L.); (J.L.); (H.L.); (Y.D.); (S.Q.)
| | - Jianghua Fan
- Department of Pediatric Emergency Center, Emergency Generally Department I, Hunan Children’s Hospital, Changsha 410007, China;
| | - Xiaofeng Li
- Hunan Guangxiu Hospital, Hunan Normal University, Changsha 410006, China;
| | - Jichang Miao
- Department of Medical Devices, Nanfang Hospital, Guangzhou 510515, China;
| | - Shuang Qiu
- Medical Apparatus and Equipment Deployment, Hunan Children’s Hospital, Changsha 410007, China; (Z.L.); (J.L.); (H.L.); (Y.D.); (S.Q.)
| | - Chaojie Long
- Medical Apparatus and Equipment Deployment, Hunan Children’s Hospital, Changsha 410007, China; (Z.L.); (J.L.); (H.L.); (Y.D.); (S.Q.)
- Correspondence: (C.L.); (B.J.); Tel./Fax: +86-731-8560-0908 (C.L.); +86-10-8391-1552 (B.J.)
| | - Bin Jing
- School of Biomedical Engineering, Capital Medical University, Beijing 100069, China
- Correspondence: (C.L.); (B.J.); Tel./Fax: +86-731-8560-0908 (C.L.); +86-10-8391-1552 (B.J.)
| |
Collapse
|
30
|
Cai C, Cao J, Yang C, Chen E. Diagnosis of Amnesic Mild Cognitive Impairment Using MGS-WBC and VGBN-LM Algorithms. Front Aging Neurosci 2022; 14:893250. [PMID: 35707699 PMCID: PMC9189381 DOI: 10.3389/fnagi.2022.893250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 04/20/2022] [Indexed: 11/13/2022] Open
Abstract
Computer-aided diagnosis (CAD) has undergone rapid development with the advent of advanced neuroimaging and machine learning methods. Nevertheless, how to extract discriminative features from the limited and high-dimensional data is not ideal, especially for amnesic mild cognitive impairment (aMCI) data based on resting-state functional magnetic resonance imaging (rs-fMRI). Furthermore, a robust and reliable system for aMCI detection is conducive to timely detecting and screening subjects at a high risk of Alzheimer's disease (AD). In this scenario, we first develop the mask generation strategy based on within-class and between-class criterion (MGS-WBC), which primarily aims at reducing data redundancy and excavating multiscale features of the brain. Concurrently, vector generation for brain networks based on Laplacian matrix (VGBN-LM) is presented to obtain the global features of the functional network. Finally, all multiscale features are fused to further improve the diagnostic performance of aMCI. Typical classifiers for small data learning, such as naive Bayesian (NB), linear discriminant analysis (LDA), logistic regression (LR), and support vector machines (SVMs), are adopted to evaluate the diagnostic performance of aMCI. This study helps to reveal discriminative neuroimaging features, and outperforms the state-of-the-art methods, providing new insights for the intelligent construction of CAD system of aMCI.
Collapse
Affiliation(s)
- Chunting Cai
- School of Informatics, Xiamen University, Xiamen, China
| | | | - Chenhui Yang
- School of Informatics, Xiamen University, Xiamen, China
| | - E. Chen
- Department of Neurology, Zhongshan Hospital Affiliated to Xiamen University, Xiamen, China
| |
Collapse
|
31
|
Bi XA, Zhou W, Luo S, Mao Y, Hu X, Zeng B, Xu L. Feature aggregation graph convolutional network based on imaging genetic data for diagnosis and pathogeny identification of Alzheimer's disease. Brief Bioinform 2022; 23:6572662. [PMID: 35453149 DOI: 10.1093/bib/bbac137] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 03/15/2022] [Accepted: 03/23/2022] [Indexed: 12/30/2022] Open
Abstract
The roles of brain regions activities and gene expressions in the development of Alzheimer's disease (AD) remain unclear. Existing imaging genetic studies usually has the problem of inefficiency and inadequate fusion of data. This study proposes a novel deep learning method to efficiently capture the development pattern of AD. First, we model the interaction between brain regions and genes as node-to-node feature aggregation in a brain region-gene network. Second, we propose a feature aggregation graph convolutional network (FAGCN) to transmit and update the node feature. Compared with the trivial graph convolutional procedure, we replace the input from the adjacency matrix with a weight matrix based on correlation analysis and consider common neighbor similarity to discover broader associations of nodes. Finally, we use a full-gradient saliency graph mechanism to score and extract the pathogenetic brain regions and risk genes. According to the results, FAGCN achieved the best performance among both traditional and cutting-edge methods and extracted AD-related brain regions and genes, providing theoretical and methodological support for the research of related diseases.
Collapse
Affiliation(s)
- Xia-An Bi
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, and the College of Information Science and Engineering in Hunan Normal University, P.R. China
| | - Wenyan Zhou
- College of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Sheng Luo
- College of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Yuhua Mao
- College of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Xi Hu
- College of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Bin Zeng
- Hunan Youdao Information Technology Co., Ltd, P.R. China
| | - Luyun Xu
- College of Business in Hunan Normal University, P.R. China
| |
Collapse
|
32
|
Improved Multiple Vector Representations of Images and Robust Dictionary Learning. ELECTRONICS 2022. [DOI: 10.3390/electronics11060847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Each sparse representation classifier has different classification accuracy for different samples. It is difficult to achieve good performance with a single feature classification model. In order to balance the large-scale information and global features of images, a robust dictionary learning method based on image multi-vector representation is proposed in this paper. First, this proposed method generates a reasonable virtual image for the original image and obtains the multi-vector representation of all images. Second, the same dictionary learning algorithm is used for each vector representation to obtain multiple sets of image features. The proposed multi-vector representation can provide a good global understanding of the whole image contour and increase the content of dictionary learning. Last, the weighted fusion algorithm is used to classify the test samples. The introduction of influencing factors and the automatic adjustment of the weights of each classifier in the final decision results have a significant indigenous effect on better extracting image features. The study conducted experiments on the proposed algorithm on a number of widely used image databases. A large number of experimental results show that it effectively improves the accuracy of image classification. At the same time, to fully dig and exploit possible representation diversity might be a better way to lead to potential various appearances and high classification accuracy concerning the image.
Collapse
|
33
|
Zhao K, Duka B, Xie H, Oathes DJ, Calhoun V, Zhang Y. A dynamic graph convolutional neural network framework reveals new insights into connectome dysfunctions in ADHD. Neuroimage 2022; 246:118774. [PMID: 34861391 PMCID: PMC10569447 DOI: 10.1016/j.neuroimage.2021.118774] [Citation(s) in RCA: 34] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 10/26/2021] [Accepted: 11/29/2021] [Indexed: 12/23/2022] Open
Abstract
The pathological mechanism of attention deficit hyperactivity disorder (ADHD) is incompletely specified, which leads to difficulty in precise diagnosis. Functional magnetic resonance imaging (fMRI) has emerged as a common neuroimaging technique for studying the brain functional connectome. Most existing methods that have either ignored or simply utilized graph structure, do not fully leverage the potentially important topological information which may be useful in characterizing brain disorders. There is a crucial need for designing novel and efficient approaches which can capture such information. To this end, we propose a new dynamic graph convolutional network (dGCN), which is trained with sparse brain regional connections from dynamically calculated graph features. We also develop a novel convolutional readout layer to improve graph representation. Our extensive experimental analysis demonstrates significantly improved performance of dGCN for ADHD diagnosis compared with existing machine learning and deep learning methods. Visualizations of the salient regions of interest (ROIs) and connectivity based on informative features learned by our model show that the identified functional abnormalities mainly involve brain regions in temporal pole, gyrus rectus, and cerebellar gyri from temporal lobe, frontal lobe, and cerebellum, respectively. A positive correlation was further observed between the identified connectomic abnormalities and ADHD symptom severity. The proposed dGCN model shows great promise in providing a functional network-based precision diagnosis of ADHD and is also broadly applicable to brain connectome-based study of mental disorders.
Collapse
Affiliation(s)
- Kanhao Zhao
- Department of Bioengineering, Lehigh University, Bethlehem, PA, USA
| | - Boris Duka
- Department of Bioengineering, Lehigh University, Bethlehem, PA, USA
| | - Hua Xie
- Department of Psychology, University of Maryland, College Park, MD, USA
| | - Desmond J Oathes
- Center for Neuromodulation in Depression and Stress, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, PA, USA
| | - Vince Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Yu Zhang
- Department of Bioengineering, Lehigh University, Bethlehem, PA, USA.
| |
Collapse
|
34
|
Chu Y, Wang G, Cao L, Qiao L, Liu M. Multi-Scale Graph Representation Learning for Autism Identification With Functional MRI. Front Neuroinform 2022; 15:802305. [PMID: 35095453 PMCID: PMC8792610 DOI: 10.3389/fninf.2021.802305] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Accepted: 12/06/2021] [Indexed: 11/16/2022] Open
Abstract
Resting-state functional MRI (rs-fMRI) has been widely used for the early diagnosis of autism spectrum disorder (ASD). With rs-fMRI, the functional connectivity networks (FCNs) are usually constructed for representing each subject, with each element representing the pairwise relationship between brain region-of-interests (ROIs). Previous studies often first extract handcrafted network features (such as node degree and clustering coefficient) from FCNs and then construct a prediction model for ASD diagnosis, which largely requires expert knowledge. Graph convolutional networks (GCNs) have recently been employed to jointly perform FCNs feature extraction and ASD identification in a data-driven manner. However, existing studies tend to focus on the single-scale topology of FCNs by using one single atlas for ROI partition, thus ignoring potential complementary topology information of FCNs at different spatial scales. In this paper, we develop a multi-scale graph representation learning (MGRL) framework for rs-fMRI based ASD diagnosis. The MGRL consists of three major components: (1) multi-scale FCNs construction using multiple brain atlases for ROI partition, (2) FCNs representation learning via multi-scale GCNs, and (3) multi-scale feature fusion and classification for ASD diagnosis. The proposed MGRL is evaluated on 184 subjects from the public Autism Brain Imaging Data Exchange (ABIDE) database with rs-fMRI scans. Experimental results suggest the efficacy of our MGRL in FCN feature extraction and ASD identification, compared with several state-of-the-art methods.
Collapse
Affiliation(s)
- Ying Chu
- School of Mathematics Science, Liaocheng University, Liaocheng, China
- Department of Information Science and Technology, Taishan University, Taian, China
| | - Guangyu Wang
- School of Mathematics Science, Liaocheng University, Liaocheng, China
| | - Liang Cao
- Taian Tumor Prevention and Treatment Hospital, Taian, China
| | - Lishan Qiao
- School of Mathematics Science, Liaocheng University, Liaocheng, China
- *Correspondence: Lishan Qiao
| | - Mingxia Liu
- Department of Information Science and Technology, Taishan University, Taian, China
- Mingxia Liu
| |
Collapse
|
35
|
Li Y, Liu J, Jiang Y, Liu Y, Lei B. Virtual Adversarial Training-Based Deep Feature Aggregation Network From Dynamic Effective Connectivity for MCI Identification. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:237-251. [PMID: 34491896 DOI: 10.1109/tmi.2021.3110829] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Dynamic functional connectivity (dFC) network inferred from resting-state fMRI reveals macroscopic dynamic neural activity patterns for brain disease identification. However, dFC methods ignore the causal influence between the brain regions. Furthermore, due to the complex non-Euclidean structure of brain networks, advanced deep neural networks are difficult to be applied for learning high-dimensional representations from brain networks. In this paper, a group constrained Kalman filter (gKF) algorithm is proposed to construct dynamic effective connectivity (dEC), where the gKF provides a more comprehensive understanding of the directional interaction within the dynamic brain networks than the dFC methods. Then, a novel virtual adversarial training convolutional neural network (VAT-CNN) is employed to extract the local features of dEC. The VAT strategy improves the robustness of the model to adversarial perturbations, and therefore avoids the overfitting problem effectively. Finally, we propose the high-order connectivity weight-guided graph attention networks (cwGAT) to aggregate features of dEC. By injecting the weight information of high-order connectivity into the attention mechanism, the cwGAT provides more effective high-level feature representations than the conventional GAT. The high-level features generated from the cwGAT are applied for binary classification and multiclass classification tasks of mild cognitive impairment (MCI). Experimental results indicate that the proposed framework achieves the classification accuracy of 90.9%, 89.8%, and 82.7% for normal control (NC) vs. early MCI (EMCI), EMCI vs. late MCI (LMCI), and NC vs. EMCI vs. LMCI classification respectively, outperforming the state-of-the-art methods significantly.
Collapse
|
36
|
Abstract
The probability of the basic HHO algorithm in choosing different search methods is symmetric: about 0.5 in the interval from 0 to 1. The optimal solution from the previous iteration of the algorithm affects the current solution, the search for prey in a linear way led to a single search result, and the overall number of updates of the optimal position was low. These factors limit Harris Hawks optimization algorithm. For example, an ease of falling into a local optimum and the efficiency of convergence is low. Inspired by the prey hunting behavior of Harris’s hawk, a multi-strategy search Harris Hawks optimization algorithm is proposed, and the least squares support vector machine (LSSVM) optimized by the proposed algorithm was used to model the reactive power output of the synchronous condenser. Firstly, we select the best Gauss chaotic mapping method from seven commonly used chaotic mapping population initialization methods to improve the accuracy. Secondly, the optimal neighborhood perturbation mechanism is introduced to avoid premature maturity of the algorithm. Simultaneously, the adaptive weight and variable spiral search strategy are designed to simulate the prey hunting behavior of Harris hawk to improve the convergence speed of the improved algorithm and enhance the global search ability of the improved algorithm. A numerical experiment is tested with the classical 23 test functions and the CEC2017 test function set. The results show that the proposed algorithm outperforms the Harris Hawks optimization algorithm and other intelligent optimization algorithms in terms of convergence speed, solution accuracy and robustness, and the model of synchronous condenser reactive power output established by the improved algorithm optimized LSSVM has good accuracy and generalization ability.
Collapse
|
37
|
Guan H, Wang C, Tao D. MRI-based Alzheimer's disease prediction via distilling the knowledge in multi-modal data. Neuroimage 2021; 244:118586. [PMID: 34563678 DOI: 10.1016/j.neuroimage.2021.118586] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Revised: 09/09/2021] [Accepted: 09/16/2021] [Indexed: 12/14/2022] Open
Abstract
Mild cognitive impairment (MCI) conversion prediction, i.e., identifying MCI patients of high risks converting to Alzheimer's disease (AD), is essential for preventing or slowing the progression of AD. Although previous studies have shown that the fusion of multi-modal data can effectively improve the prediction accuracy, their applications are largely restricted by the limited availability or high cost of multi-modal data. Building an effective prediction model using only magnetic resonance imaging (MRI) remains a challenging research topic. In this work, we propose a multi-modal multi-instance distillation scheme, which aims to distill the knowledge learned from multi-modal data to an MRI-based network for MCI conversion prediction. In contrast to existing distillation algorithms, the proposed multi-instance probabilities demonstrate a superior capability of representing the complicated atrophy distributions, and can guide the MRI-based network to better explore the input MRI. To our best knowledge, this is the first study that attempts to improve an MRI-based prediction model by leveraging extra supervision distilled from multi-modal information. Experiments demonstrate the advantage of our framework, suggesting its potentials in the data-limited clinical settings.
Collapse
Affiliation(s)
- Hao Guan
- School of Computer Science, The University of Sydney, Australia
| | - Chaoyue Wang
- School of Computer Science, The University of Sydney, Australia.
| | - Dacheng Tao
- School of Computer Science, The University of Sydney, Australia; JD Explore Academy, China.
| |
Collapse
|
38
|
Ji J, Liu J, Han L, Wang F. Estimating Effective Connectivity by Recurrent Generative Adversarial Networks. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3326-3336. [PMID: 34038358 DOI: 10.1109/tmi.2021.3083984] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Estimating effective connectivity from functional magnetic resonance imaging (fMRI) time series data has become a very hot topic in neuroinformatics and brain informatics. However, it is hard for the current methods to accurately estimate the effective connectivity due to the high noise and small sample size of fMRI data. In this paper, we propose a novel framework for estimating effective connectivity based on recurrent generative adversarial networks, called EC-RGAN. The proposed framework employs the generator that consists of a set of effective connectivity generators based on recurrent neural networks to generate the fMRI time series of each brain region, and uses the discriminator to distinguish between the joint distributions of the real and generated fMRI time series. When the model is well-trained and generated fMRI data is similar to real fMRI data, EC-RGAN outputs the effective connectivity by means of the causal parameters of the effective connectivity generators. Experimental results on both simulated and real-world fMRI time series data demonstrate the efficacy of our proposed framework.
Collapse
|
39
|
Guan H, Wang C, Cheng J, Jing J, Liu T. A parallel attention-augmented bilinear network for early magnetic resonance imaging-based diagnosis of Alzheimer's disease. Hum Brain Mapp 2021; 43:760-772. [PMID: 34676625 PMCID: PMC8720194 DOI: 10.1002/hbm.25685] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 09/15/2021] [Accepted: 09/28/2021] [Indexed: 11/16/2022] Open
Abstract
Structural magnetic resonance imaging (sMRI) can capture the spatial patterns of brain atrophy in Alzheimer's disease (AD) and incipient dementia. Recently, many sMRI‐based deep learning methods have been developed for AD diagnosis. Some of these methods utilize neural networks to extract high‐level representations on the basis of handcrafted features, while others attempt to learn useful features from brain regions proposed by a separate module. However, these methods require considerable manual engineering. Their stepwise training procedures would introduce cascading errors. Here, we propose the parallel attention‐augmented bilinear network, a novel deep learning framework for AD diagnosis. Based on a 3D convolutional neural network, the framework directly learns both global and local features from sMRI scans without any prior knowledge. The framework is lightweight and suitable for end‐to‐end training. We evaluate the framework on two public datasets (ADNI‐1 and ADNI‐2) containing 1,340 subjects. On both the AD classification and mild cognitive impairment conversion prediction tasks, our framework achieves competitive results. Furthermore, we generate heat maps that highlight discriminative areas for visual interpretation. Experiments demonstrate the effectiveness of the proposed framework when medical priors are unavailable or the computing resources are limited. The proposed framework is general for 3D medical image analysis with both efficiency and interpretability.
Collapse
Affiliation(s)
- Hao Guan
- School of Computer Science, Faculty of Engineering, The University of Sydney, Darlington, New South Wales, Australia
| | - Chaoyue Wang
- School of Computer Science, Faculty of Engineering, The University of Sydney, Darlington, New South Wales, Australia
| | - Jian Cheng
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing, China
| | - Jing Jing
- China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Tao Liu
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing, China.,Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, China
| |
Collapse
|
40
|
Li Y, Guo L, Liu Y, Liu J, Meng F. A Temporal-Spectral-Based Squeeze-and- Excitation Feature Fusion Network for Motor Imagery EEG Decoding. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1534-1545. [PMID: 34310314 DOI: 10.1109/tnsre.2021.3099908] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Motor imagery (MI) electroencephalography (EEG) decoding plays an important role in brain-computer interface (BCI), which enables motor-disabled patients to communicate with the outside world via external devices. Recent deep learning methods, which fail to fully explore both deep-temporal characterizations in EEGs itself and multi-spectral information in different rhythms, generally ignore the temporal or spectral dependencies in MI-EEG. Also, the lack of effective feature fusion probably leads to redundant or irrelative information and thus fails to achieve the most discriminative features, resulting in the limited MI-EEG decoding performance. To address these issues, in this paper, a MI-EEG decoding framework is proposed, which uses a novel temporal-spectral-based squeeze-and-excitation feature fusion network (TS-SEFFNet). First, the deep-temporal convolution block (DT-Conv block) implements convolutions in a cascade architecture, which extracts high-dimension temporal representations from raw EEG signals. Second, the multi-spectral convolution block (MS-Conv block) is then conducted in parallel using multi-level wavelet convolutions to capture discriminative spectral features from corresponding clinical subbands. Finally, the proposed squeeze-and-excitation feature fusion block (SE-Feature-Fusion block) maps the deep-temporal and multi-spectral features into comprehensive fused feature maps, which highlights channel-wise feature responses by constructing interdependencies among different domain features. Competitive experimental results on two public datasets demonstrate that our method is able to achieve promising decoding performance compared with the state-of-the-art methods.
Collapse
|
41
|
Calhoun VD, Pearlson GD, Sui J. Data-driven approaches to neuroimaging biomarkers for neurological and psychiatric disorders: emerging approaches and examples. Curr Opin Neurol 2021; 34:469-479. [PMID: 34054110 PMCID: PMC8263510 DOI: 10.1097/wco.0000000000000967] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
PURPOSE OF REVIEW The 'holy grail' of clinical applications of neuroimaging to neurological and psychiatric disorders via personalized biomarkers has remained mostly elusive, despite considerable effort. However, there are many reasons to continue to be hopeful, as the field has made remarkable advances over the past few years, fueled by a variety of converging technical and data developments. RECENT FINDINGS We discuss a number of advances that are accelerating the push for neuroimaging biomarkers including the advent of the 'neuroscience big data' era, biomarker data competitions, the development of more sophisticated algorithms including 'guided' data-driven approaches that facilitate automation of network-based analyses, dynamic connectivity, and deep learning. Another key advance includes multimodal data fusion approaches which can provide convergent and complementary evidence pointing to possible mechanisms as well as increase predictive accuracy. SUMMARY The search for clinically relevant neuroimaging biomarkers for neurological and psychiatric disorders is rapidly accelerating. Here, we highlight some of these aspects, provide recent examples from studies in our group, and link to other ongoing work in the field. It is critical that access and use of these advanced approaches becomes mainstream, this will help propel the community forward and facilitate the production of robust and replicable neuroimaging biomarkers.
Collapse
Affiliation(s)
- Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia
| | - Godfrey D Pearlson
- Department of Psychiatry and Neuroscience, Yale School of Medicine, New Haven, Connecticut, USA
| | - Jing Sui
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia
- Institute of Automation, Chinese Academy of Sciences, and the University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
42
|
Zhang L, Shen B, Barnawi A, Xi S, Kumar N, Wu Y. FedDPGAN: Federated Differentially Private Generative Adversarial Networks Framework for the Detection of COVID-19 Pneumonia. INFORMATION SYSTEMS FRONTIERS : A JOURNAL OF RESEARCH AND INNOVATION 2021; 23:1403-1415. [PMID: 34149305 PMCID: PMC8204125 DOI: 10.1007/s10796-021-10144-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/17/2021] [Indexed: 05/05/2023]
Abstract
Existing deep learning technologies generally learn the features of chest X-ray data generated by Generative Adversarial Networks (GAN) to diagnose COVID-19 pneumonia. However, the above methods have a critical challenge: data privacy. GAN will leak the semantic information of the training data which can be used to reconstruct the training samples by attackers, thereby this method will leak the privacy of the patient. Furthermore, for this reason, that is the limitation of the training data sample, different hospitals jointly train the model through data sharing, which will also cause privacy leakage. To solve this problem, we adopt the Federated Learning (FL) framework, a new technique being used to protect data privacy. Under the FL framework and Differentially Private thinking, we propose a Federated Differentially Private Generative Adversarial Network (FedDPGAN) to detect COVID-19 pneumonia for sustainable smart cities. Specifically, we use DP-GAN to privately generate diverse patient data in which differential privacy technology is introduced to make sure the privacy protection of the semantic information of the training dataset. Furthermore, we leverage FL to allow hospitals to collaboratively train COVID-19 models without sharing the original data. Under Independent and Identically Distributed (IID) and non-IID settings, the evaluation of the proposed model is on three types of chest X-ray (CXR)images dataset (COVID-19, normal, and normal pneumonia). A large number of truthful reports make the verification of our model can effectively diagnose COVID-19 without compromising privacy.
Collapse
Affiliation(s)
- Longling Zhang
- School of Data Science and Technology, Heilongjiang University, Harbin, 150080 China
| | - Bochen Shen
- School of Data Science and Technology, Heilongjiang University, Harbin, 150080 China
| | - Ahmed Barnawi
- King Abdul Aziz University, Riyadh, 11543 Saudi Arabia
| | - Shan Xi
- School of Data Science and Technology, Heilongjiang University, Harbin, 150080 China
| | - Neeraj Kumar
- Thapar Institute of Engineering and Technology, Pariala, India
- School of Computer Science, University of Petroleum and Energy Studies, Dehradun Uttarakhand, India
- Department of Computer Science and Information Engineering, Asia University, Taiwan, China
| | - Yi Wu
- School of Data Science and Technology, Heilongjiang University, Harbin, 150080 China
| |
Collapse
|
43
|
Zhu Z, Xingming Z, Tao G, Dan T, Li J, Chen X, Li Y, Zhou Z, Zhang X, Zhou J, Chen D, Wen H, Cai H. Classification of COVID-19 by Compressed Chest CT Image through Deep Learning on a Large Patients Cohort. Interdiscip Sci 2021; 13:73-82. [PMID: 33565027 PMCID: PMC7872116 DOI: 10.1007/s12539-020-00408-1] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Revised: 11/27/2020] [Accepted: 12/03/2020] [Indexed: 01/08/2023]
Abstract
Abstract Corona Virus Disease (COVID-19) has spread globally quickly, and has resulted in a large number of causalities and medical resources insufficiency in many countries. Reverse-transcriptase polymerase chain reaction (RT-PCR) testing is adopted as biopsy tool for confirmation of virus infection. However, its accuracy is as low as 60-70%, which is inefficient to uncover the infected. In comparison, the chest CT has been considered as the prior choice in diagnosis and monitoring progress of COVID-19 infection. Although the COVID-19 diagnostic systems based on artificial intelligence have been developed for assisting doctors in diagnosis, the small sample size and the excessive time consumption limit their applications. To this end, this paper proposed a diagnosis prototype system for COVID-19 infection testing. The proposed deep learning model is trained and is tested on 2267 CT sequences from 1357 patients clinically confirmed with COVID-19 and 1235 CT sequences from non-infected people. The main highlights of the prototype system are: (1) no data augmentation is needed to accurately discriminate the COVID-19 from normal controls with the specificity of 0.92 and sensitivity of 0.93; (2) the raw DICOM image is not necessary in testing. Highly compressed image like Jpeg can be used to allow a quick diagnosis; and (3) it discriminates the virus infection within 6 seconds and thus allows an online test with light cost. We also applied our model on 48 asymptomatic patients diagnosed with COVID-19. We found that: (1) the positive rate of RT-PCR assay is 63.5% (687/1082). (2) 45.8% (22/48) of the RT-PCR assay is negative for asymptomatic patients, yet the accuracy of CT scans is 95.8%. The online detection system is available: http://212.64.70.65/covid. Graphic Abstract ![]()
Collapse
Affiliation(s)
- Ziwei Zhu
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China
| | - Zhang Xingming
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China.
| | - Guihua Tao
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China
| | - Tingting Dan
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China
| | - Jiao Li
- Department of Medical Imaging, Collaborative Innovation Center for Cancer Medicine, State Key Laboratory of Oncology in South China, Sun Yat-sen University Cancer Center, Guangzhou, 510006, China
| | - Xijie Chen
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China
| | - Yang Li
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China
| | - Zhichao Zhou
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China
| | - Xiang Zhang
- Wuhan Huangpi District Hospital of Traditional Chinese Medicine, 430300, Wuhan, China
| | - Jinzhao Zhou
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China
| | - Dongpei Chen
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China
| | - Hanchun Wen
- Department of Critical Care Medicine, The First Affiliated Hospital of Guangxi Medical University, Guangxi, 530021, China
| | - Hongmin Cai
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 510600, China.
| |
Collapse
|
44
|
Hu J, Chen H, Heidari AA, Wang M, Zhang X, Chen Y, Pan Z. Orthogonal learning covariance matrix for defects of grey wolf optimizer: Insights, balance, diversity, and feature selection. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2020.106684] [Citation(s) in RCA: 123] [Impact Index Per Article: 41.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
|
45
|
Fan Y, Wang P, Mafarja M, Wang M, Zhao X, Chen H. A bioinformatic variant fruit fly optimizer for tackling optimization problems. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2020.106704] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
46
|
Ye H, Wu P, Zhu T, Xiao Z, Zhang X, Zheng L, Zheng R, Sun Y, Zhou W, Fu Q, Ye X, Chen A, Zheng S, Heidari AA, Wang M, Zhu J, Chen H, Li J. Diagnosing Coronavirus Disease 2019 (COVID-19): Efficient Harris Hawks-Inspired Fuzzy K-Nearest Neighbor Prediction Methods. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:17787-17802. [PMID: 34786302 PMCID: PMC8545238 DOI: 10.1109/access.2021.3052835] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Accepted: 01/15/2021] [Indexed: 05/26/2023]
Abstract
This study is devoted to proposing a useful intelligent prediction model to distinguish the severity of COVID-19, to provide a more fair and reasonable reference for assisting clinical diagnostic decision-making. Based on patients' necessary information, pre-existing diseases, symptoms, immune indexes, and complications, this article proposes a prediction model using the Harris hawks optimization (HHO) to optimize the Fuzzy K-nearest neighbor (FKNN), which is called HHO-FKNN. This model is utilized to distinguish the severity of COVID-19. In HHO-FKNN, the purpose of introducing HHO is to optimize the FKNN's optimal parameters and feature subsets simultaneously. Also, based on actual COVID-19 data, we conducted a comparative experiment between HHO-FKNN and several well-known machine learning algorithms, which result shows that not only the proposed HHO-FKNN can obtain better classification performance and higher stability on the four indexes but also screen out the key features that distinguish severe COVID-19 from mild COVID-19. Therefore, we can conclude that the proposed HHO-FKNN model is expected to become a useful tool for COVID-19 prediction.
Collapse
Affiliation(s)
- Hua Ye
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Peiliang Wu
- Department of Pulmonary and Critical Care MedicineThe 1st Affiliated Hospital, Wenzhou Medical UniversityWenzhou325000China
| | - Tianru Zhu
- The Second Clinical CollegeWenzhou Medical UniversityWenzhou325000China
| | - Zhongxiang Xiao
- Department of PharmacyAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Xie Zhang
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Long Zheng
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Rongwei Zheng
- Department of UrologyAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Yangjie Sun
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Weilong Zhou
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Qinlei Fu
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Xinxin Ye
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Ali Chen
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Shuang Zheng
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Ali Asghar Heidari
- School of Surveying and Geospatial Engineering, College of EngineeringUniversity of TehranTehran1417466191Iran
- Department of Computer ScienceSchool of ComputingNational University of SingaporeSingapore117417
| | - Mingjing Wang
- Institute of Research and Development, Duy Tan UniversityDa Nang550000Vietnam
| | - Jiandong Zhu
- Department of Surgical OncologyAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| | - Huiling Chen
- College of Computer Science and Artificial IntelligenceWenzhou UniversityWenzhou325035China
| | - Jifa Li
- Department of Pulmonary and Critical Care MedicineAffiliated Yueqing Hospital, Wenzhou Medical UniversityYueqing325600China
| |
Collapse
|
47
|
Dai R, Zhang W, Tang W, Wynendaele E, Zhu Q, Bin Y, De Spiegeleer B, Xia J. BBPpred: Sequence-Based Prediction of Blood-Brain Barrier Peptides with Feature Representation Learning and Logistic Regression. J Chem Inf Model 2021; 61:525-534. [PMID: 33426873 DOI: 10.1021/acs.jcim.0c01115] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Blood-brain barrier peptides (BBPs) have a large range of biomedical applications since they can cross the blood-brain barrier based on different mechanisms. As experimental methods for the identification of BBPs are laborious and expensive, computational approaches are necessary to be developed for predicting BBPs. In this work, we describe a computational method, BBPpred (blood-brain barrier peptides prediction), that can efficiently identify BBPs using logistic regression. We investigate a wide variety of features from amino acid sequence information, and then a feature learning method is adopted to represent the informative features. To improve the prediction performance, seven informative features are selected for classification by eliminating redundant and irrelevant features. In addition, we specifically create two benchmark data sets (training and independent test), which contain a total of 119 BBPs from public databases and the literature. On the training data set, BBPpred shows promising performances with an AUC score of 0.8764 and an AUPR score of 0.8757 using the 10-fold cross-validation. We also test our new method on the independent test data set and obtain a favorable performance. We envision that BBPpred will be a useful tool for identifying, annotating, and characterizing BBPs. BBPpred is freely available at http://BBPpred.xialab.info.
Collapse
Affiliation(s)
- Ruyu Dai
- Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, Institutes of Physical Science and Information Technology, Anhui University, Hefei, Anhui 230601, China
| | - Wei Zhang
- Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, Institutes of Physical Science and Information Technology, Anhui University, Hefei, Anhui 230601, China
| | - Wending Tang
- Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, Institutes of Physical Science and Information Technology, Anhui University, Hefei, Anhui 230601, China
| | - Evelien Wynendaele
- Drug Quality and Registration (DruQuaR) Group, Faculty of Pharmaceutical Sciences, Ghent University, Harelbekestraat 72, 9000 Ghent, Belgium
| | - Qizhi Zhu
- Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, Institutes of Physical Science and Information Technology, Anhui University, Hefei, Anhui 230601, China
| | - Yannan Bin
- Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, Institutes of Physical Science and Information Technology, Anhui University, Hefei, Anhui 230601, China
| | - Bart De Spiegeleer
- Drug Quality and Registration (DruQuaR) Group, Faculty of Pharmaceutical Sciences, Ghent University, Harelbekestraat 72, 9000 Ghent, Belgium
| | - Junfeng Xia
- Key Laboratory of Intelligent Computing and Signal Processing of Ministry of Education, Institutes of Physical Science and Information Technology, Anhui University, Hefei, Anhui 230601, China
| |
Collapse
|
48
|
Song X, Zhou F, Frangi AF, Cao J, Xiao X, Lei Y, Wang T, Lei B. Graph convolution network with similarity awareness and adaptive calibration for disease-induced deterioration prediction. Med Image Anal 2020; 69:101947. [PMID: 33388456 DOI: 10.1016/j.media.2020.101947] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Revised: 11/23/2020] [Accepted: 12/12/2020] [Indexed: 01/04/2023]
Abstract
Graph convolution networks (GCN) have been successfully applied in disease prediction tasks as they capture interactions (i.e., edges and edge weights on the graph) between individual elements. The interactions in existing works are constructed by fusing similarity between imaging information and distance between non-imaging information, whereas disregarding the disease status of those individuals in the training set. Besides, the similarity is being evaluated by computing the correlation distance between feature vectors, which limits prediction performance, especially for predicting significant memory concern (SMC) and mild cognitive impairment (MCI). In this paper, we propose three mechanisms to improve GCN, namely similarity-aware adaptive calibrated GCN (SAC-GCN), for predicting SMC and MCI. First, we design a similarity-aware graph using different receptive fields to consider disease status. The labelled subjects on the graph are only connected with those labelled subjects with the same status. Second, we propose an adaptive mechanism to evaluate similarity. Specifically, we construct initial GCN with evaluating similarity by using traditional correlation distance, then pre-train the initial GCN by using training samples and use it to score all subjects. Then, the difference between these scores replaces correlation distance to update similarity. Last, we devise a calibration mechanism to fuse functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI) information into edges. The proposed method is tested on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Experimental results demonstrate that our proposed method is useful to predict disease-induced deterioration and superior to other related algorithms, with a mean classification accuracy of 86.83% in our prediction tasks.
Collapse
Affiliation(s)
- Xuegang Song
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Centre, Shenzhen University, Shenzhen, 518060, China
| | - Feng Zhou
- Department of Industrial and Manufacturing, Systems Engineering, The University of Michigan, Dearborn, MI 42185, USA
| | - Alejandro F Frangi
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Centre, Shenzhen University, Shenzhen, 518060, China; CISTIB Centre for Computational Imaging & Simulation Technologies in Biomedicine, School of Computing, University of Leeds, Leeds LS2 9LU, United Kingdom; LICAMM Leeds Institute of Cardiovascular and Metabolic Medicine, School of Medicine, Leeds LS2 9LU, United Kingdom; Medical Imaging Research Center (MIRC) - University Hospital Gasthuisberg, KU Leuven, Herestraat 49, 3000 Leuven. Belgium
| | - Jiuwen Cao
- Artificial Intelligence Institute, Hangzhou Dianzi University, Zhejiang, 310010, China
| | - Xiaohua Xiao
- First Affiliated Hospital of Shenzhen University, Health Science Center, Shenzhen University, Shenzhen, 518050, China
| | - Yi Lei
- First Affiliated Hospital of Shenzhen University, Health Science Center, Shenzhen University, Shenzhen, 518050, China
| | - Tianfu Wang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Centre, Shenzhen University, Shenzhen, 518060, China
| | - Baiying Lei
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Centre, Shenzhen University, Shenzhen, 518060, China.
| |
Collapse
|
49
|
Li J, Bian C, Chen D, Meng X, Luo H, Liang H, Shen L. Effect of APOE ε4 on multimodal brain connectomic traits: a persistent homology study. BMC Bioinformatics 2020; 21:535. [PMID: 33371873 PMCID: PMC7768655 DOI: 10.1186/s12859-020-03877-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Accepted: 11/13/2020] [Indexed: 01/06/2023] Open
Abstract
BACKGROUND Although genetic risk factors and network-level neuroimaging abnormalities have shown effects on cognitive performance and brain atrophy in Alzheimer's disease (AD), little is understood about how apolipoprotein E (APOE) ε4 allele, the best-known genetic risk for AD, affect brain connectivity before the onset of symptomatic AD. This study aims to investigate APOE ε4 effects on brain connectivity from the perspective of multimodal connectome. RESULTS Here, we propose a novel multimodal brain network modeling framework and a network quantification method based on persistent homology for identifying APOE ε4-related network differences. Specifically, we employ sparse representation to integrate multimodal brain network information derived from both the resting state functional magnetic resonance imaging (rs-fMRI) data and the diffusion-weighted magnetic resonance imaging (dw-MRI) data. Moreover, persistent homology is proposed to avoid the ad hoc selection of a specific regularization parameter and to capture valuable brain connectivity patterns from the topological perspective. The experimental results demonstrate that our method outperforms the competing methods, and reasonably yields connectomic patterns specific to APOE ε4 carriers and non-carriers. CONCLUSIONS We have proposed a multimodal framework that integrates structural and functional connectivity information for constructing a fused brain network with greater discriminative power. Using persistent homology to extract topological features from the fused brain network, our method can effectively identify APOE ε4-related brain connectomic biomarkers.
Collapse
Affiliation(s)
- Jin Li
- College of Automation, Harbin Engineering University, 145 Nantong Street, Harbin, 150001, Heilongjiang, China
| | - Chenyuan Bian
- College of Automation, Harbin Engineering University, 145 Nantong Street, Harbin, 150001, Heilongjiang, China
- Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, B306 Richards Building, 3700 Hamilton Walk, Philadelphia, PA, 19104, USA
| | - Dandan Chen
- College of Automation, Harbin Engineering University, 145 Nantong Street, Harbin, 150001, Heilongjiang, China
| | - Xianglian Meng
- School of Computer Information and Engineering, Changzhou Institute of Technology, Changzhou, 213032, China
| | - Haoran Luo
- College of Automation, Harbin Engineering University, 145 Nantong Street, Harbin, 150001, Heilongjiang, China
| | - Hong Liang
- College of Automation, Harbin Engineering University, 145 Nantong Street, Harbin, 150001, Heilongjiang, China.
| | - Li Shen
- Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, B306 Richards Building, 3700 Hamilton Walk, Philadelphia, PA, 19104, USA.
| |
Collapse
|
50
|
Fusion of ULS Group Constrained High- and Low-Order Sparse Functional Connectivity Networks for MCI Classification. Neuroinformatics 2020; 18:1-24. [PMID: 30982183 DOI: 10.1007/s12021-019-09418-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Functional connectivity networks, derived from resting-state fMRI data, have been found as effective biomarkers for identifying mild cognitive impairment (MCI) from healthy elderly. However, the traditional functional connectivity network is essentially a low-order network with the assumption that the brain activity is static over the entire scanning period, ignoring temporal variations among the correlations derived from brain region pairs. To overcome this limitation, we proposed a new type of sparse functional connectivity network to precisely describe the relationship of temporal correlations among brain regions. Specifically, instead of using the simple pairwise Pearson's correlation coefficient as connectivity, we first estimate the temporal low-order functional connectivity for each region pair based on an ULS Group constrained-UOLS regression algorithm, where a combination of ultra-least squares (ULS) criterion with a Group constrained topology structure detection algorithm is applied to detect the topology of functional connectivity networks, aided by an Ultra-Orthogonal Least Squares (UOLS) algorithm to estimate connectivity strength. Compared to the classical least squares criterion which only measures the discrepancy between the observed signals and the model prediction function, the ULS criterion takes into consideration the discrepancy between the weak derivatives of the observed signals and the model prediction function and thus avoids the overfitting problem. By using a similar approach, we then estimate the high-order functional connectivity from the low-order connectivity to characterize signal flows among the brain regions. We finally fuse the low-order and the high-order networks using two decision trees for MCI classification. Experimental results demonstrate the effectiveness of the proposed method on MCI classification.
Collapse
|