1
|
Thapaliya B, Akbas E, Chen J, Sapkota R, Ray B, Suresh P, Calhoun VD, Liu J. Brain networks and intelligence: A graph neural network based approach to resting state fMRI data. Med Image Anal 2025; 101:103433. [PMID: 39708510 PMCID: PMC11877132 DOI: 10.1016/j.media.2024.103433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 09/17/2024] [Accepted: 12/07/2024] [Indexed: 12/23/2024]
Abstract
Resting-state functional magnetic resonance imaging (rsfMRI) is a powerful tool for investigating the relationship between brain function and cognitive processes as it allows for the functional organization of the brain to be captured without relying on a specific task or stimuli. In this paper, we present a novel modeling architecture called BrainRGIN for predicting intelligence (fluid, crystallized and total intelligence) using graph neural networks on rsfMRI derived static functional network connectivity matrices. Extending from the existing graph convolution networks, our approach incorporates a clustering-based embedding and graph isomorphism network in the graph convolutional layer to reflect the nature of the brain sub-network organization and efficient network expression, in combination with TopK pooling and attention-based readout functions. We evaluated our proposed architecture on a large dataset, specifically the Adolescent Brain Cognitive Development Dataset, and demonstrated its effectiveness in predicting individual differences in intelligence. Our model achieved lower mean squared errors and higher correlation scores than existing relevant graph architectures and other traditional machine learning models for all of the intelligence prediction tasks. The middle frontal gyrus exhibited a significant contribution to both fluid and crystallized intelligence, suggesting their pivotal role in these cognitive processes. Total composite scores identified a diverse set of brain regions to be relevant which underscores the complex nature of total intelligence. Our GitHub implementation is publicly available on https://github.com/bishalth01/BrainRGIN/.
Collapse
Affiliation(s)
- Bishal Thapaliya
- Tri-Institutional Center for Translational Research in Neuro Imaging and Data Science (TreNDS), USA; Department of Computer Science, Georgia State University, Atlanta, USA.
| | - Esra Akbas
- Department of Computer Science, Georgia State University, Atlanta, USA
| | - Jiayu Chen
- Tri-Institutional Center for Translational Research in Neuro Imaging and Data Science (TreNDS), USA; Department of Computer Science, Georgia State University, Atlanta, USA
| | - Ram Sapkota
- Tri-Institutional Center for Translational Research in Neuro Imaging and Data Science (TreNDS), USA; Department of Computer Science, Georgia State University, Atlanta, USA
| | - Bhaskar Ray
- Tri-Institutional Center for Translational Research in Neuro Imaging and Data Science (TreNDS), USA; Department of Computer Science, Georgia State University, Atlanta, USA
| | - Pranav Suresh
- Tri-Institutional Center for Translational Research in Neuro Imaging and Data Science (TreNDS), USA; Department of Computer Science, Georgia State University, Atlanta, USA
| | - Vince D Calhoun
- Tri-Institutional Center for Translational Research in Neuro Imaging and Data Science (TreNDS), USA; Department of Computer Science, Georgia State University, Atlanta, USA; School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, USA
| | - Jingyu Liu
- Tri-Institutional Center for Translational Research in Neuro Imaging and Data Science (TreNDS), USA; Department of Computer Science, Georgia State University, Atlanta, USA
| |
Collapse
|
2
|
Zhang Z, Chen Y, Men A, Jiang Z. Evaluating Cognitive Function and Brain Activity Patterns via Blood Oxygen Level-Dependent Transformer in N-Back Working Memory Tasks. Brain Sci 2025; 15:277. [PMID: 40149798 PMCID: PMC11940435 DOI: 10.3390/brainsci15030277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2024] [Revised: 01/25/2025] [Accepted: 01/28/2025] [Indexed: 03/29/2025] Open
Abstract
(1) Background: Working memory, which involves temporary storage, information processing, and regulating attention resources, is a fundamental cognitive process and constitutes a significant component of neuroscience research. This study aimed to evaluate brain activation patterns by analyzing functional magnetic resonance imaging (fMRI) time-series data collected during a designed N-back working memory task with varying cognitive demands. (2) Methods: We utilized a novel transformer model, blood oxygen level-dependent transformer (BolT), to extract the activation level features of brain regions in the cognitive process, thereby obtaining the influence weights of regions of interest (ROIs) on the corresponding tasks. (3) Results: Compared with previous studies, our work reached similar conclusions in major brain region performance and provides a more precise analysis for identifying brain activation patterns. For each type of working memory task, we selected the top 5 percent of the most influential ROIs and conducted a comprehensive analysis and discussion. Additionally, we explored the effect of prior knowledge conditions on the performance of different tasks in the same period and the same tasks at different times. (4) Conclusions: The comparison results reflect the brain's adaptive strategies and dependencies in coping with different levels of cognitive demands and the stability optimization of the brain's cognitive processing. This study introduces innovative methodologies for understanding brain function and cognitive processes, highlighting the potential of transformer in cognitive neuroscience. Its findings offer new insights into brain activity patterns associated with working memory, contributing to the broader landscape of neuroscience research.
Collapse
Affiliation(s)
- Zhenming Zhang
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (Z.Z.); (A.M.)
| | - Yaojing Chen
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China;
| | - Aidong Men
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (Z.Z.); (A.M.)
| | - Zhuqing Jiang
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (Z.Z.); (A.M.)
- Beijing Key Laboratory of Network System and Network Culture, Beijing University of Posts and Telecommunications, Beijing 100876, China
| |
Collapse
|
3
|
Chen H, Feng F, Lou P, Li Y, Zhang M, Zhao F. Prob-sparse self-attention extraction of time-aligned dynamic functional connectivity for ASD diagnosis. Heliyon 2025; 11:e41120. [PMID: 39802005 PMCID: PMC11719308 DOI: 10.1016/j.heliyon.2024.e41120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2024] [Revised: 12/07/2024] [Accepted: 12/09/2024] [Indexed: 01/16/2025] Open
Abstract
Dynamic functional connectivity (DFC) has shown promise in the diagnosis of Autism Spectrum Disorder (ASD). However, extracting highly discriminative information from the complex DFC matrix remains a challenging task. In this paper, we propose an ASD classification framework PSA-FCN which is based on time-aligned DFC and Prob-Sparse Self-Attention to address this problem. Specifically, we introduce Prob-Sparse Self-Attention to selectively extract global features, and use self-attention distillation as a transition at each layer to capture local patterns and reduce dimensionality. Additionally, we construct a time-aligned DFC matrix to mitigate the time sensitivity of DFC and extend the dataset, thereby alleviating model overfitting. Our model is evaluated on fMRI data from the ABIDE NYU site, and the experimental results demonstrate that the model outperforms other methods in the paper with a classification accuracy of 81.8 %. Additionally, our research findings reveal significant variability in the DFC connections of brain regions of ASD patients, including Cuneus (CUN), Lingual gyrus (LING), Superior occipital gyrus (SOG), Posterior cingulate gyrus (PCG), and Precuneus (PCUN), which is consistent with prior research. In summary, our proposed PSA framework shows potential in ASD diagnosis as well as automatic discovery of critical ASD-related biomarkers.
Collapse
Affiliation(s)
- Hongwu Chen
- School Hospital, Shandong Technology and Business University, Yantai, China
| | - Fan Feng
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Pengwei Lou
- Key Laboratory of Xinjiang Coal Resources Green Mining, Ministry of Education, Xinjiang, China
- College of Information Engineering, Xinjiang Institute of Engineering, Xinjiang, China
| | - Ying Li
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - MingLi Zhang
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Feng Zhao
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
- Key Laboratory of Xinjiang Coal Resources Green Mining, Ministry of Education, Xinjiang, China
- College of Information Engineering, Xinjiang Institute of Engineering, Xinjiang, China
| |
Collapse
|
4
|
Yoshimoto T, Tokunaga K, Chikazoe J. Enhancing prediction of human traits and behaviors through ensemble learning of traditional and novel resting-state fMRI connectivity analyses. Neuroimage 2024; 303:120911. [PMID: 39486492 DOI: 10.1016/j.neuroimage.2024.120911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2024] [Revised: 10/21/2024] [Accepted: 10/30/2024] [Indexed: 11/04/2024] Open
Abstract
Recent advances in cognitive neuroscience have focused on using resting-state functional connectivity (RSFC) data from fMRI scans to more accurately predict human traits and behaviors. Traditional approaches generally analyze RSFC by correlating averaged time-series data across regions of interest (ROIs) or networks, which may overlook important spatial signal patterns. To address this limitation, we introduced a novel linear regression technique that estimates RSFC by predicting spatial brain activity patterns in a target ROI from those in a seed ROI. We applied both traditional and our novel RSFC estimation methods to a large-scale dataset from the Human Connectome Project and the Brain Genomics Superstruct Project, analyzing resting-state fMRI data to predict sex, age, personality traits, and psychological task performance. To enhance prediction accuracy, we developed an ensemble learner that combines these qualitatively different methods using a weighted average approach. Our findings revealed that hierarchical clustering of RSFC patterns using our novel method displays distinct whole-brain grouping patterns compared to the traditional approach. Importantly, the ensemble model, integrating these diverse weak learners, outperformed the traditional RSFC method in predicting human traits and behaviors. Notably, the predictions from the traditional and novel methods showed relatively low similarity, indicating that our novel approach captures unique and previously undetected information about human traits and behaviors through fine-grained local spatial patterns of neural activation. These results highlight the potential of combining traditional and innovative RSFC analysis techniques to enrich our understanding of the neural basis of human traits and behaviors.
Collapse
Affiliation(s)
- Takaaki Yoshimoto
- Araya Inc., Tokyo, Japan; Division of Cerebral Integration, National Institute for Physiological Sciences, Okazaki, Japan; Department of Psychiatry, Aichi Medical University, Nagakute, Japan
| | - Kai Tokunaga
- Araya Inc., Tokyo, Japan; Department of Mathematical Informatics, Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| | - Junichi Chikazoe
- Araya Inc., Tokyo, Japan; Section of Brain Function Information, Supportive Center for Brain Research, National Institute for Physiological Sciences, Okazaki, Japan.
| |
Collapse
|
5
|
Hu J, Luo J, Xu Z, Liao B, Dong S, Peng B, Hou G. Spatio-temporal learning and explaining for dynamic functional connectivity analysis: Application to depression. J Affect Disord 2024; 364:266-273. [PMID: 39137835 DOI: 10.1016/j.jad.2024.08.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Revised: 06/26/2024] [Accepted: 08/09/2024] [Indexed: 08/15/2024]
Abstract
BACKGROUND Functional connectivity has been shown to fluctuate over time. The present study aimed to identifying major depressive disorders (MDD) with dynamic functional connectivity (dFC) from resting-state fMRI data, which would be helpful to produce tools of early depression diagnosis and enhance our understanding of depressive etiology. METHODS The resting-state fMRI data of 178 subjects were collected, including 89 MDD and 89 healthy controls. We propose a spatio-temporal learning and explaining framework for dFC analysis. A yet effective spatio-temporal model is developed to classifying MDD from healthy controls with dFCs. The model is a stacking neural network model, which learns network structure information by a multi-layer perceptron based spatial encoder, and learns time-varying patterns by a Transformer based temporal encoder. We propose to explain the spatio-temporal model with a two-stage explanation method of importance feature extracting and disorder-relevant pattern exploring. The layer-wise relevance propagation (LRP) method is introduced to extract the most relevant input features in the model, and the attention mechanism with LRP is applied to extract the important time steps of dFCs. The disorder-relevant functional connections, brain regions, and brain states in the model are further explored and identified. RESULTS We achieved the best classification performance in identifying MDD from healthy controls with dFC data. The top important functional connectivity, brain regions, and dynamic states closely related to MDD have been identified. LIMITATIONS The data preprocessing may affect the classification performance of the model, and this study needs further validation in a larger patient population. CONCLUSIONS The experimental results demonstrate that the proposed spatio-temporal model could effectively classify MDD, and uncover structural and temporal patterns of dFCs in depression.
Collapse
Affiliation(s)
- Jinlong Hu
- Guangdong Key Lab of Communication and Computer Network, School of Computer Science and Engineering, South China University of Technology, Guangzhou, China
| | - Jianmiao Luo
- Guangdong Key Lab of Communication and Computer Network, School of Computer Science and Engineering, South China University of Technology, Guangzhou, China
| | - Ziyun Xu
- Neuropsychiatry Imaging Center, Department of Radiology, Shenzhen Kangning Hospital, Shenzhen Mental Health Center, Shenzhen, China
| | - Bin Liao
- College of Mathematics and Informatics, South China Agricultural University, Guangzhou, China.
| | - Shoubin Dong
- Guangdong Key Lab of Communication and Computer Network, School of Computer Science and Engineering, South China University of Technology, Guangzhou, China
| | - Bo Peng
- Department of Depressive Disorder, Shenzhen Kangning Hospital, Shenzhen Mental Health Center, Shenzhen, China
| | - Gangqiang Hou
- Neuropsychiatry Imaging Center, Department of Radiology, Shenzhen Kangning Hospital, Shenzhen Mental Health Center, Shenzhen, China.
| |
Collapse
|
6
|
Almeida de Souza E, Vieira BH, Salmon CEG. Individual cognitive traits can be predicted from task-based dynamic functional connectivity with a deep convolutional-recurrent model. Cereb Cortex 2024; 34:bhae412. [PMID: 39445422 DOI: 10.1093/cercor/bhae412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 09/16/2024] [Accepted: 09/30/2024] [Indexed: 10/25/2024] Open
Abstract
There has been increased interest in understanding the neural substrates of intelligence and several human traits from neuroimaging data. Deep learning can be used to predict different cognitive measures, such as general and fluid intelligence, from different functional magnetic resonance imaging experiments providing information about the main brain areas involved in these predictions. Using neuroimaging and behavioral data from 874 subjects provided by the Human Connectome Project, we predicted various cognitive scores using dynamic functional connectivity derived from language and working memory functional magnetic resonance imaging task states, using a 360-region multimodal atlas. The deep model joins multiscale convolutional and long short-term memory layers and was trained under a 10-fold stratified cross-validation. We removed the confounding effects of gender, age, total brain volume, motion and the multiband reconstruction algorithm using multiple linear regression. We can explain 17.1% and 16% of general intelligence variance for working memory and language tasks, respectively. We showed that task-based dynamic functional connectivity has more predictive power than resting-state dynamic functional connectivity when compared to the literature and that removing confounders significantly reduces the prediction performance. No specific cortical network showed significant relevance in the prediction of general and fluid intelligence, suggesting a spatial homogeneous distribution of the intelligence construct in the brain.
Collapse
Affiliation(s)
- Erick Almeida de Souza
- InBrain Lab, Departamento de Física, FFCLRP, Universidade de São Paulo, Prof. Aymar Batista Prado Street, Vila Monte Alegre, Ribeirão Preto - SP, 14040-900, Brazil
| | - Bruno Hebling Vieira
- Methods of Plasticity Research, Department of Psychology, University of Zurich, Binzmühlestrasse 14, 8050 Zurich, Switzerland
- Neuroscience Center Zurich (ZNZ), University of Zurich & ETH Zurich, Winterthurerstrasse 190, 8057 Zurich, Switzerland
| | - Carlos Ernesto Garrido Salmon
- InBrain Lab, Departamento de Física, FFCLRP, Universidade de São Paulo, Prof. Aymar Batista Prado Street, Vila Monte Alegre, Ribeirão Preto - SP, 14040-900, Brazil
- Departamento de Imagens Médicas, Hematologia e Oncologia Clínica, FMRP, Universidade de São Paulo, Bandeirantes avenue 3900, Hospital das Clínicas - 7th Floor, Vila Monte Alegre, Ribeirão Preto, Brazil
| |
Collapse
|
7
|
Peng L, Su J, Hu D, Yu Y, Wei H, Li M. Measuring functional connectivity in frequency-domain helps to better characterize brain function. Hum Brain Mapp 2024; 45:e26726. [PMID: 38949487 PMCID: PMC11215841 DOI: 10.1002/hbm.26726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2023] [Revised: 03/25/2024] [Accepted: 05/09/2024] [Indexed: 07/02/2024] Open
Abstract
Resting-state functional connectivity (FC) is widely used in multivariate pattern analysis of functional magnetic resonance imaging (fMRI), including identifying the locations of putative brain functional borders, predicting individual phenotypes, and diagnosing clinical mental diseases. However, limited attention has been paid to the analysis of functional interactions from a frequency perspective. In this study, by contrasting coherence-based and correlation-based FC with two machine learning tasks, we observed that measuring FC in the frequency domain helped to identify finer functional subregions and achieve better pattern discrimination capability relative to the temporal correlation. This study has proven the feasibility of coherence in the analysis of fMRI, and the results indicate that modeling functional interactions in the frequency domain may provide richer information than that in the time domain, which may provide a new perspective on the analysis of functional neuroimaging.
Collapse
Affiliation(s)
- Limin Peng
- College of Intelligence Science and TechnologyNational University of Defense TechnologyChangshaChina
| | - Jianpo Su
- College of Intelligence Science and TechnologyNational University of Defense TechnologyChangshaChina
| | - Dewen Hu
- College of Intelligence Science and TechnologyNational University of Defense TechnologyChangshaChina
| | - Yang Yu
- College of Intelligence Science and TechnologyNational University of Defense TechnologyChangshaChina
| | - Huilin Wei
- Systems Engineering InstituteAcademy of Military SciencesBeijingChina
| | - Ming Li
- College of Intelligence Science and TechnologyNational University of Defense TechnologyChangshaChina
| |
Collapse
|
8
|
Zheng J, Cheng Y, Wu X, Li X, Fu Y, Yang Z. Rich-club organization of whole-brain spatio-temporal multilayer functional connectivity networks. Front Neurosci 2024; 18:1405734. [PMID: 38855440 PMCID: PMC11157044 DOI: 10.3389/fnins.2024.1405734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Accepted: 05/07/2024] [Indexed: 06/11/2024] Open
Abstract
Objective In this work, we propose a novel method for constructing whole-brain spatio-temporal multilayer functional connectivity networks (FCNs) and four innovative rich-club metrics. Methods Spatio-temporal multilayer FCNs achieve a high-order representation of the spatio-temporal dynamic characteristics of brain networks by combining the sliding time window method with graph theory and hypergraph theory. The four proposed rich-club scales are based on the dynamic changes in rich-club node identity, providing a parameterized description of the topological dynamic characteristics of brain networks from both temporal and spatial perspectives. The proposed method was validated in three independent differential analysis experiments: male-female gender difference analysis, analysis of abnormality in patients with autism spectrum disorders (ASD), and individual difference analysis. Results The proposed method yielded results consistent with previous relevant studies and revealed some innovative findings. For instance, the dynamic topological characteristics of specific white matter regions effectively reflected individual differences. The increased abnormality in internal functional connectivity within the basal ganglia may be a contributing factor to the occurrence of repetitive or restrictive behaviors in ASD patients. Conclusion The proposed methodology provides an efficacious approach for constructing whole-brain spatio-temporal multilayer FCNs and conducting analysis of their dynamic topological structures. The dynamic topological characteristics of spatio-temporal multilayer FCNs may offer new insights into physiological variations and pathological abnormalities in neuroscience.
Collapse
Affiliation(s)
- Jianhui Zheng
- College of Electronic Engineering, Chengdu University of Information Technology, Chengdu, China
| | - Yuhao Cheng
- Huaxi Molecular Imaging Research Laboratory, Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
| | - Xi Wu
- Department of Computer Science, Chengdu University of Information Technology, Chengdu, China
| | - Xiaojie Li
- Department of Computer Science, Chengdu University of Information Technology, Chengdu, China
| | - Ying Fu
- Department of Computer Science, Chengdu University of Information Technology, Chengdu, China
| | - Zhipeng Yang
- College of Electronic Engineering, Chengdu University of Information Technology, Chengdu, China
| |
Collapse
|
9
|
Kopetzky SJ, Li Y, Kaiser M, Butz-Ostendorf M. Predictability of intelligence and age from structural connectomes. PLoS One 2024; 19:e0301599. [PMID: 38557681 PMCID: PMC10984540 DOI: 10.1371/journal.pone.0301599] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Accepted: 03/19/2024] [Indexed: 04/04/2024] Open
Abstract
In this study, structural images of 1048 healthy subjects from the Human Connectome Project Young Adult study and 94 from ADNI-3 study were processed by an in-house tractography pipeline and analyzed together with pre-processed data of the same subjects from braingraph.org. Whole brain structural connectome features were used to build a simple correlation-based regression machine learning model to predict intelligence and age of healthy subjects. Our results showed that different forms of intelligence as well as age are predictable to a certain degree from diffusion tensor imaging detecting anatomical fiber tracts in the living human brain. Though we did not identify significant differences in the prediction capability for the investigated features depending on the imaging feature extraction method, we did find that crystallized intelligence was consistently better predictable than fluid intelligence from structural connectivity data through all datasets. Our findings suggest a practical and scalable processing and analysis framework to explore broader research topics employing brain MR imaging.
Collapse
Affiliation(s)
- Sebastian J. Kopetzky
- Labvantage—Biomax GmbH, Planegg, Germany
- School of Life Sciences, Technical University of Munich, Freising, Germany
| | - Yong Li
- Labvantage—Biomax GmbH, Planegg, Germany
| | - Marcus Kaiser
- Precision Imaging Beacon, School of Medicine, University of Nottingham, Nottingham, United Kingdom
- Department of Functional Neurosurgery, Rui Jin Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Markus Butz-Ostendorf
- Labvantage—Biomax GmbH, Planegg, Germany
- Laboratory for Parallel Programming, Department of Computer Science, Technical University of Darmstadt, Darmstadt, Germany
| | | |
Collapse
|
10
|
Xia J, Chen N, Qiu A. Multi-level and joint attention networks on brain functional connectivity for cross-cognitive prediction. Med Image Anal 2023; 90:102921. [PMID: 37666116 DOI: 10.1016/j.media.2023.102921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 05/15/2023] [Accepted: 07/31/2023] [Indexed: 09/06/2023]
Abstract
Deep learning on resting-state functional MRI (rs-fMRI) has shown great success in predicting a single cognition or mental disease. Nevertheless, cognitive functions or mental diseases may share neural mechanisms that can benefit their prediction/classification. We propose a multi-level and joint attention (ML-Joint-Att) network to learn high-order representations of brain functional connectivities that are specific and shared across multiple tasks. We design the ML-Joint-Att network with edge and node convolutional operators, an adaptive inception module, and three attention modules, including network-wise, region-wise, and region-wise joint attention modules. The adaptive inception learns brain functional connectivity at multiple spatial scales. The network-wise and region-wise attention modules take the multi-scale functional connectivities as input and learn features at the network and regional levels for individual tasks. Moreover, the joint attention module is designed as region-wise joint attention to learn shared brain features that contribute to and compensate for the prediction of multiple tasks. We employed the Adolescent Brain Cognitive Development (ABCD) dataset (n =9092) to evaluate the ML-Joint-Att network for the prediction of cognitive flexibility and inhibition. Our experiments demonstrated the usefulness of the three attention modules and identified brain functional connectivities and regions specific and common between cognitive flexibility and inhibition. In particular, the joint attention module can significantly improve the prediction of both cognitive functions. Moreover, leave-one-site cross-validation showed that the ML-Joint-Att network is robust to independent samples obtained from different sites of the ABCD study. Our network outperformed existing machine learning techniques, including Brain Bias Set (BBS), spatio-temporal graph convolution network (ST-GCN), and BrainNetCNN. We demonstrated the generalization of our method to other applications, such as the prediction of fluid intelligence and crystallized intelligence, which also outperformed the ST-GCN and BrainNetCNN.
Collapse
Affiliation(s)
- Jing Xia
- Department of Biomedical Engineering, National University of Singapore, Singapore
| | - Nanguang Chen
- Department of Biomedical Engineering, National University of Singapore, Singapore
| | - Anqi Qiu
- Department of Biomedical Engineering, National University of Singapore, Singapore; The N.1 Institute for Health, National University of Singapore, Singapore; NUS (Suzhou) Research Institute, National University of Singapore, China; Institute of Data Science, National University of Singapore, Singapore; Department of Health Technology and Informatics, Hong Kong Polytechnic University, Hong Kong; Department of Biomedical Engineering, the Johns Hopkins University, USA.
| |
Collapse
|
11
|
Li Y, Ma X, Sunderraman R, Ji S, Kundu S. Accounting for temporal variability in functional magnetic resonance imaging improves prediction of intelligence. Hum Brain Mapp 2023; 44:4772-4791. [PMID: 37466292 PMCID: PMC10400788 DOI: 10.1002/hbm.26415] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 06/08/2023] [Accepted: 06/20/2023] [Indexed: 07/20/2023] Open
Abstract
Neuroimaging-based prediction methods for intelligence have seen a rapid development. Among different neuroimaging modalities, prediction using functional connectivity (FC) has shown great promise. Most literature has focused on prediction using static FC, with limited investigations on the merits of such analysis compared to prediction using dynamic FC or region-level functional magnetic resonance imaging (fMRI) times series that encode temporal variability. To account for the temporal dynamics in fMRI, we propose a bi-directional long short-term memory (bi-LSTM) approach that incorporates feature selection mechanism. The proposed pipeline is implemented via an efficient algorithm and applied for predicting intelligence using region-level time series and dynamic FC. We compare the prediction performance using different fMRI features acquired from the Adolescent Brain Cognitive Development (ABCD) study involving nearly 7000 individuals. Our detailed analysis illustrates the consistently inferior performance of static FC compared to region-level time series or dynamic FC for single and combined rest and task fMRI experiments. The joint analysis of task and rest fMRI leads to improved intelligence prediction under all models compared to using fMRI from only one experiment. In addition, the proposed bi-LSTM pipeline based on region-level time series identifies several shared and differential important brain regions across fMRI experiments that drive intelligence prediction. A test-retest analysis of the selected regions shows strong reliability across cross-validation folds. Given the large sample size of ABCD study, our results provide strong evidence that superior prediction of intelligence can be achieved by accounting for temporal variations in fMRI.
Collapse
Affiliation(s)
- Yang Li
- Department of Computer ScienceGeorgia State UniversityAtlantaGeorgiaUSA
| | - Xin Ma
- Department of BiostatisticsColumbia UniversityNew YorkNew YorkUSA
| | - Raj Sunderraman
- Department of Computer ScienceGeorgia State UniversityAtlantaGeorgiaUSA
| | - Shihao Ji
- Department of Computer ScienceGeorgia State UniversityAtlantaGeorgiaUSA
| | - Suprateek Kundu
- Department of BiostatisticsThe University of Texas at MD Anderson Cancer CenterHoustonTexasUSA
| |
Collapse
|
12
|
Bedel HA, Sivgin I, Dalmaz O, Dar SUH, Çukur T. BolT: Fused window transformers for fMRI time series analysis. Med Image Anal 2023; 88:102841. [PMID: 37224718 DOI: 10.1016/j.media.2023.102841] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 02/07/2023] [Accepted: 05/10/2023] [Indexed: 05/26/2023]
Abstract
Deep-learning models have enabled performance leaps in analysis of high-dimensional functional MRI (fMRI) data. Yet, many previous methods are suboptimally sensitive for contextual representations across diverse time scales. Here, we present BolT, a blood-oxygen-level-dependent transformer model, for analyzing multi-variate fMRI time series. BolT leverages a cascade of transformer encoders equipped with a novel fused window attention mechanism. Encoding is performed on temporally-overlapped windows within the time series to capture local representations. To integrate information temporally, cross-window attention is computed between base tokens in each window and fringe tokens from neighboring windows. To gradually transition from local to global representations, the extent of window overlap and thereby number of fringe tokens are progressively increased across the cascade. Finally, a novel cross-window regularization is employed to align high-level classification features across the time series. Comprehensive experiments on large-scale public datasets demonstrate the superior performance of BolT against state-of-the-art methods. Furthermore, explanatory analyses to identify landmark time points and regions that contribute most significantly to model decisions corroborate prominent neuroscientific findings in the literature.
Collapse
Affiliation(s)
- Hasan A Bedel
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Irmak Sivgin
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Onat Dalmaz
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Salman U H Dar
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Tolga Çukur
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey; Neuroscience Program, Bilkent University, Ankara 06800, Turkey.
| |
Collapse
|
13
|
Matsui T, Yamashita KI. Static and Dynamic Functional Connectivity Alterations in Alzheimer's Disease and Neuropsychiatric Diseases. Brain Connect 2022. [PMID: 35994384 DOI: 10.1089/brain.2022.0044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
To date, numerous studies have documented various alterations in resting brain activity in Alzheimer's disease (AD) and other neuropsychiatric diseases. In particular, disease-related alterations of functional connectivity (FC) in the resting state networks (RSN) have been documented. Altered FC in RSN is useful not only for interpreting the phenotype of diseases but also for diagnosing the diseases. More recently, several studies proposed the dynamics of resting-brain activity as a useful marker for detecting altered RSNs related to AD and other diseases. In contrast to previous studies, which focused on FC calculated using an entire fMRI scan (static FC), these newer studies focused the on temporal dynamics of FC within the scan (dynamic FC) to provide more sensitive measures to characterize RSNs. However, despite the increasing popularity of dFC, several studies cautioned that the results obtained in commonly used analyses for dFC require careful interpretation. In this mini-review, we review recent studies exploring alterations of static and dynamic functional connectivity in AD and other neuropsychiatric diseases. We then discuss how to utilize and interpret dFC for studying resting brain activity in diseases.
Collapse
Affiliation(s)
- Teppei Matsui
- Okayama University - Tsushima Campus, Tsushima-kita 1-1-1, Okayama, Japan, 700-8530;
| | | |
Collapse
|
14
|
|
15
|
A deep graph neural network architecture for modelling spatio-temporal dynamics in resting-state functional MRI data. Med Image Anal 2022; 79:102471. [PMID: 35580429 DOI: 10.1016/j.media.2022.102471] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2020] [Revised: 04/11/2022] [Accepted: 05/02/2022] [Indexed: 11/23/2022]
Abstract
Resting-state functional magnetic resonance imaging (rs-fMRI) has been successfully employed to understand the organisation of the human brain. Typically, the brain is parcellated into regions of interest (ROIs) and modelled as a graph where each ROI represents a node and association measures between ROI-specific blood-oxygen-level-dependent (BOLD) time series are edges. Recently, graph neural networks (GNNs) have seen a surge in popularity due to their success in modelling unstructured relational data. The latest developments with GNNs, however, have not yet been fully exploited for the analysis of rs-fMRI data, particularly with regards to its spatio-temporal dynamics. In this paper, we present a novel deep neural network architecture which combines both GNNs and temporal convolutional networks (TCNs) in order to learn from both the spatial and temporal components of rs-fMRI data in an end-to-end fashion. In particular, this corresponds to intra-feature learning (i.e., learning temporal dynamics with TCNs) as well as inter-feature learning (i.e., leveraging interactions between ROI-wise dynamics with GNNs). We evaluate our model with an ablation study using 35,159 samples from the UK Biobank rs-fMRI database, as well as in the smaller Human Connectome Project (HCP) dataset, both in a unimodal and in a multimodal fashion. We also demonstrate that out architecture contains explainability-related features which easily map to realistic neurobiological insights. We suggest that this model could lay the groundwork for future deep learning architectures focused on leveraging the inherently and inextricably spatio-temporal nature of rs-fMRI data.
Collapse
|
16
|
Fan L, Shen H, Xie F, Su J, Yu Y, Hu D. DC-tCNN: A Deep Model for EEG-based Detection of Dim Targets. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1727-1736. [PMID: 35724287 DOI: 10.1109/tnsre.2022.3184725] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Dim target detection in remote sensing images is a significant and challenging problem. In this work, we seek to explore event-related brain responses of dim target detection tasks and extend the brain-computer interface (BCI) systems to this task for efficiency enhancement. METHODS We develop a BCI paradigm named Asynchronous Visual Evoked Paradigm (AVEP), in which subjects are required to search the dim targets within satellite images when their scalp electroencephalography (EEG) signals are simultaneously recorded. In the paradigm, stimulus onset time and target onset time are asynchronous because subjects need enough time to confirm whether there are targets of interest in the presented serial images. We further propose a Domain adaptive and Channel-wise attention-based Time-domain Convolutional Neural Network (DC-tCNN) to solve the single-trial EEG classification problem for the AVEP task. In this model, we design a multi-scale CNN module combined with a channel-wise attention module to effectively extract event-related brain responses underlying EEG signals. Meanwhile, domain adaptation is proposed to mitigate cross-subject distribution discrepancy. RESULTS The results demonstrate the superior performance and better generalizability of this model in classifying the single-trial EEG data of AVEP task in contrast to typical EEG deep learning networks. Visualization analyses of spatiotemporal features also illustrate the effectiveness and interpretability of our proposed paradigm and learning model. CONCLUSION The proposed paradigm and model can effectively explore ambiguous event-related brain responses on EEG-based dim target detection tasks. SIGNIFICANCE Our work can provide a valuable reference for BCI-based image detection of dim targets.
Collapse
|
17
|
Panda R, Kalmady SV, Greiner R. Multi-Source Domain Adaptation Techniques for Mitigating Batch Effects: A Comparative Study. Front Neuroinform 2022; 16:805117. [PMID: 35528213 PMCID: PMC9067602 DOI: 10.3389/fninf.2022.805117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Accepted: 03/15/2022] [Indexed: 11/13/2022] Open
Abstract
The past decade has seen an increasing number of applications of deep learning (DL) techniques to biomedical fields, especially in neuroimaging-based analysis. Such DL-based methods are generally data-intensive and require a large number of training instances, which might be infeasible to acquire from a single acquisition site, especially for data, such as fMRI scans, due to the time and costs that they demand. We can attempt to address this issue by combining fMRI data from various sites, thereby creating a bigger heterogeneous dataset. Unfortunately, the inherent differences in the combined data, known as batch effects, often hamper learning a model. To mitigate this issue, techniques such as multi-source domain adaptation [Multi-source Domain Adversarial Networks (MSDA)] aim at learning an effective classification function that uses (learned) domain-invariant latent features. This article analyzes and compares the performance of various popular MSDA methods [MDAN, Domain AggRegation Networks (DARN), Multi-Domain Matching Networks (MDMN), and Moment Matching for MSDA (M3SDA)] at predicting different labels (illness, age, and sex) of images from two public rs-fMRI datasets: ABIDE 1and ADHD-200. It also evaluates the impact of various conditions such as class imbalance, the number of sites along with a comparison of the degree of adaptation of each of the methods, thereby presenting the effectiveness of MSDA models in neuroimaging-based applications.
Collapse
Affiliation(s)
- Rohan Panda
- Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, United States
| | - Sunil Vasu Kalmady
- Canadian VIGOUR Centre, University of Alberta, Edmonton, AB, Canada
- Department of Computing Science, University of Alberta, Edmonton, AB, Canada
| | - Russell Greiner
- Department of Computing Science, University of Alberta, Edmonton, AB, Canada
- Alberta Machine Intelligence Institute, Edmonton, AB, Canada
- Department of Psychiatry, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
18
|
Chen M, Li H, Fan H, Dillman JR, Wang H, Altaye M, Zhang B, Parikh NA, He L. ConCeptCNN: A novel multi-filter convolutional neural network for the prediction of neurodevelopmental disorders using brain connectome. Med Phys 2022; 49:3171-3184. [PMID: 35246986 DOI: 10.1002/mp.15545] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2021] [Revised: 01/31/2022] [Accepted: 02/09/2022] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Deep convolutional neural network (CNN) and its derivatives have recently shown great promise in the prediction of brain disorders using brain connectome data. Existing deep CNN methods using single global row and column convolutional filters have limited ability to extract discriminative information from brain connectome for prediction tasks. PURPOSE This paper presents a novel deep Connectome-Inception CNN (ConCeptCNN) model, which is developed based on multiple convolutional filters. The proposed model is used to extract topological features from brain connectome data for neurological disorders classification and analysis. METHODS The ConCeptCNN uses multiple vector-shaped filters extract topological information from the brain connectome at different levels for complementary feature embeddings of brain connectome. The proposed model is validated using two datasets: the Neuro Bureau ADHD-200 dataset and the Cincinnati Early Prediction Study (CINEPS) dataset. RESULTS In a cross-validation experiment, the ConCeptCNN achieved a prediction accuracy of 78.7% for the detection of ADHD in adolescents and an accuracy of 81.6% for the prediction of cognitive deficits at 2-year corrected age in very preterm infants. In addition to the classification tasks, the ConCeptCNN identified several brain regions that are discriminative to neurodevelopmental disorders. CONCLUSIONS We compared the ConCeptCNN with several peer CNN methods. The results demonstrated that proposed model improves overall classification performance of neurodevelopmental disorders prediction tasks. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Ming Chen
- Imaging Research Center, Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.,Department of Electrical Engineering and Computer Science, University of Cincinnati, Cincinnati, OH, USA
| | - Hailong Li
- Imaging Research Center, Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.,Center for Prevention of Neurodevelopmental Disorders, Perinatal Institute, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA
| | - Howard Fan
- Department of Electrical Engineering and Computer Science, University of Cincinnati, Cincinnati, OH, USA
| | - Jonathan R Dillman
- Imaging Research Center, Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.,Department of Radiology, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| | - Hui Wang
- Imaging Research Center, Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.,MR Clinical Science, Philips, Cincinnati, OH, USA
| | - Mekibib Altaye
- Division of Biostatistics and Epidemiology, Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.,Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| | - Bin Zhang
- Division of Biostatistics and Epidemiology, Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.,Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| | - Nehal A Parikh
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, USA.,Center for Prevention of Neurodevelopmental Disorders, Perinatal Institute, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA
| | - Lili He
- Imaging Research Center, Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA.,Department of Radiology, University of Cincinnati College of Medicine, Cincinnati, OH, USA.,Center for Prevention of Neurodevelopmental Disorders, Perinatal Institute, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA
| |
Collapse
|
19
|
Cwiek A, Rajtmajer SM, Wyble B, Honavar V, Grossner E, Hillary FG. Feeding the machine: Challenges to reproducible predictive modeling in resting-state connectomics. Netw Neurosci 2022; 6:29-48. [PMID: 35350584 PMCID: PMC8942606 DOI: 10.1162/netn_a_00212] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Accepted: 10/08/2021] [Indexed: 11/04/2022] Open
Abstract
In this critical review, we examine the application of predictive models, for example, classifiers, trained using machine learning (ML) to assist in interpretation of functional neuroimaging data. Our primary goal is to summarize how ML is being applied and critically assess common practices. Our review covers 250 studies published using ML and resting-state functional MRI (fMRI) to infer various dimensions of the human functional connectome. Results for holdout ("lockbox") performance was, on average, ∼13% less accurate than performance measured through cross-validation alone, highlighting the importance of lockbox data, which was included in only 16% of the studies. There was also a concerning lack of transparency across the key steps in training and evaluating predictive models. The summary of this literature underscores the importance of the use of a lockbox and highlights several methodological pitfalls that can be addressed by the imaging community. We argue that, ideally, studies are motivated both by the reproducibility and generalizability of findings as well as the potential clinical significance of the insights. We offer recommendations for principled integration of machine learning into the clinical neurosciences with the goal of advancing imaging biomarkers of brain disorders, understanding causative determinants for health risks, and parsing heterogeneous patient outcomes.
Collapse
Affiliation(s)
- Andrew Cwiek
- Department of Psychology, Pennsylvania State University, University Park, PA, USA
- Social Life and Engineering Sciences Imaging Center, Pennsylvania State University, University Park, PA, USA
| | - Sarah M. Rajtmajer
- College of Information Sciences and Technology, Pennsylvania State University, University Park, PA, USA
- Rock Ethics Institute, Pennsylvania State University, University Park, PA, USA
| | - Bradley Wyble
- Department of Psychology, Pennsylvania State University, University Park, PA, USA
| | - Vasant Honavar
- College of Information Sciences and Technology, Pennsylvania State University, University Park, PA, USA
- Institute for Computational and Data Sciences, Pennsylvania State University, University Park, PA, USA
| | - Emily Grossner
- Department of Psychology, Pennsylvania State University, University Park, PA, USA
- Social Life and Engineering Sciences Imaging Center, Pennsylvania State University, University Park, PA, USA
| | - Frank G. Hillary
- Department of Psychology, Pennsylvania State University, University Park, PA, USA
- Social Life and Engineering Sciences Imaging Center, Pennsylvania State University, University Park, PA, USA
| |
Collapse
|
20
|
Kim JH, Zhang Y, Han K, Wen Z, Choi M, Liu Z. Representation learning of resting state fMRI with variational autoencoder. Neuroimage 2021; 241:118423. [PMID: 34303794 PMCID: PMC8485214 DOI: 10.1016/j.neuroimage.2021.118423] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Revised: 07/18/2021] [Accepted: 07/21/2021] [Indexed: 11/24/2022] Open
Abstract
Resting state functional magnetic resonance imaging (rsfMRI) data exhibits complex but structured patterns. However, the underlying origins are unclear and entangled in rsfMRI data. Here we establish a variational auto-encoder, as a generative model trainable with unsupervised learning, to disentangle the unknown sources of rsfMRI activity. After being trained with large data from the Human Connectome Project, the model has learned to represent and generate patterns of cortical activity and connectivity using latent variables. The latent representation and its trajectory represent the spatiotemporal characteristics of rsfMRI activity. The latent variables reflect the principal gradients of the latent trajectory and drive activity changes in cortical networks. Representational geometry captured as covariance or correlation between latent variables, rather than cortical connectivity, can be used as a more reliable feature to accurately identify subjects from a large group, even if only a short period of data is available in each subject. Our results demonstrate that VAE is a valuable addition to existing tools, particularly suited for unsupervised representation learning of resting state fMRI activity.
Collapse
Affiliation(s)
- Jung-Hoon Kim
- Department of Biomedical Engineering, University of Michigan, United States; Weldon School of Biomedical Engineering, Purdue University, United States
| | - Yizhen Zhang
- Department of Electrical Engineering and Computer Science, University of Michigan, United States
| | - Kuan Han
- Department of Electrical Engineering and Computer Science, University of Michigan, United States
| | - Zheyu Wen
- Department of Electrical Engineering and Computer Science, University of Michigan, United States
| | - Minkyu Choi
- Department of Electrical Engineering and Computer Science, University of Michigan, United States
| | - Zhongming Liu
- Department of Biomedical Engineering, University of Michigan, United States; Department of Electrical Engineering and Computer Science, University of Michigan, United States.
| |
Collapse
|
21
|
Saha S, Pagnozzi A, Bradford D, Fripp J. Predicting fluid intelligence in adolescence from structural MRI with deep learning methods. INTELLIGENCE 2021. [DOI: 10.1016/j.intell.2021.101568] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
22
|
Wiring of higher-order cortical areas: Spatiotemporal development of cortical hierarchy. Semin Cell Dev Biol 2021; 118:35-49. [PMID: 34034988 DOI: 10.1016/j.semcdb.2021.05.010] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 04/27/2021] [Accepted: 05/08/2021] [Indexed: 01/04/2023]
Abstract
A hierarchical development of cortical areas was suggested over a century ago, but the diversity and complexity of cortical hierarchy properties have so far prevented a formal demonstration. The aim of this review is to clarify the similarities and differences in the developmental processes underlying cortical development of primary and higher-order areas. We start by recapitulating the historical and recent advances underlying the biological principle of cortical hierarchy in adults. We then revisit the arguments for a hierarchical maturation of cortical areas, and further integrate the principles of cortical areas specification during embryonic and postnatal development. We highlight how the dramatic expansion in cortical size might have contributed to the increased number of association areas sustaining cognitive complexification in evolution. Finally, we summarize the recent observations of an alteration of cortical hierarchy in neuropsychiatric disorders and discuss their potential developmental origins.
Collapse
|
23
|
Tracking whole-brain connectivity dynamics in the resting-state fMRI with post-facial paralysis synkinesis. Brain Res Bull 2021; 173:108-115. [PMID: 33933525 DOI: 10.1016/j.brainresbull.2021.04.025] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Accepted: 04/26/2021] [Indexed: 01/11/2023]
Abstract
BACKGROUND Resting-state functional magnetic resonance imaging (rs-fMRI) is widely applied to explore abnormal functional connectivity (FC) in patients with post-facial paralysis synkinesis (PFPS). However, most studies considered steady spatial-temporal signal interactions between distinct brain regions during the period of scanning. OBJECTIVE In this study, we aim to investigate abnormal dynamic functional connectivity (dFC) in PFPS patients. METHODS We enrolled 31 PFPS patients and 19 healthy controls. All participants underwent rs-fMRI. Sliding windows approach was applied to construct dFC matrices. Next, these matrices were clustered into distinct states using the k-means clustering algorithm. RESULTS We found that it was not the dFC patterns, but rather the temporal properties including the mean dwell time (MDT) and occurrence frequencies, that showed a significant difference between PFPS patients and healthy controls. Two randomly clustered dFC states were recognized for both groups. Among them, State 1 showed significantly lower connectivity compared to State 2 in patients group. Compared to healthy controls, the duration spent by the PFPS patients in the state with lower connectivity significantly increased and is positively correlated with the better facial function. CONCLUSIONS In conclusion, aberrant dFC is a fundamental feature of brain dysfunction in PFPS patients, which is associated with the facial nerve function. These findings may contribute to a better understanding of the abnormal brain reorganization mechanisms in PFPS patients.
Collapse
|