1
|
Kraljević N, Langner R, Küppers V, Raimondo F, Patil KR, Eickhoff SB, Müller VI. Network and state specificity in connectivity-based predictions of individual behavior. Hum Brain Mapp 2024; 45:e26753. [PMID: 38864353 PMCID: PMC11167405 DOI: 10.1002/hbm.26753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 04/17/2024] [Accepted: 05/23/2024] [Indexed: 06/13/2024] Open
Abstract
Predicting individual behavior from brain functional connectivity (FC) patterns can contribute to our understanding of human brain functioning. This may apply in particular if predictions are based on features derived from circumscribed, a priori defined functional networks, which improves interpretability. Furthermore, some evidence suggests that task-based FC data may yield more successful predictions of behavior than resting-state FC data. Here, we comprehensively examined to what extent the correspondence of functional network priors and task states with behavioral target domains influences the predictability of individual performance in cognitive, social, and affective tasks. To this end, we used data from the Human Connectome Project for large-scale out-of-sample predictions of individual abilities in working memory (WM), theory-of-mind cognition (SOCIAL), and emotion processing (EMO) from FC of corresponding and non-corresponding states (WM/SOCIAL/EMO/resting-state) and networks (WM/SOCIAL/EMO/whole-brain connectome). Using root mean squared error and coefficient of determination to evaluate model fit revealed that predictive performance was rather poor overall. Predictions from whole-brain FC were slightly better than those from FC in task-specific networks, and a slight benefit of predictions based on FC from task versus resting state was observed for performance in the WM domain. Beyond that, we did not find any significant effects of a correspondence of network, task state, and performance domains. Together, these results suggest that multivariate FC patterns during both task and resting states contain rather little information on individual performance levels, calling for a reconsideration of how the brain mediates individual differences in mental abilities.
Collapse
Affiliation(s)
- Nevena Kraljević
- Institute of Systems Neuroscience, Medical Faculty and University Hospital DüsseldorfHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Robert Langner
- Institute of Systems Neuroscience, Medical Faculty and University Hospital DüsseldorfHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Vincent Küppers
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
- Department of Nuclear Medicine, Faculty of Medicine and University Hospital CologneUniversity of CologneCologneGermany
| | - Federico Raimondo
- Institute of Systems Neuroscience, Medical Faculty and University Hospital DüsseldorfHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Kaustubh R. Patil
- Institute of Systems Neuroscience, Medical Faculty and University Hospital DüsseldorfHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Simon B. Eickhoff
- Institute of Systems Neuroscience, Medical Faculty and University Hospital DüsseldorfHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| | - Veronika I. Müller
- Institute of Systems Neuroscience, Medical Faculty and University Hospital DüsseldorfHeinrich Heine University DüsseldorfDüsseldorfGermany
- Institute of Neuroscience and Medicine (INM‐7: Brain and Behaviour)Research Centre JülichJülichGermany
| |
Collapse
|
2
|
Kraljević N, Langner R, Küppers V, Raimondo F, Patil KR, Eickhoff SB, Müller VI. Network and State Specificity in Connectivity-Based Predictions of Individual Behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.11.540387. [PMID: 37215048 PMCID: PMC10197703 DOI: 10.1101/2023.05.11.540387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Predicting individual behavior from brain functional connectivity (FC) patterns can contribute to our understanding of human brain functioning. This may apply in particular if predictions are based on features derived from circumscribed, a priori defined functional networks, which improves interpretability. Furthermore, some evidence suggests that task-based FC data may yield more successful predictions of behavior than resting-state FC data. Here, we comprehensively examined to what extent the correspondence of functional network priors and task states with behavioral target domains influences the predictability of individual performance in cognitive, social, and affective tasks. To this end, we used data from the Human Connectome Project for large-scale out-of-sample predictions of individual abilities in working memory (WM), theory-of-mind cognition (SOCIAL), and emotion processing (EMO) from FC of corresponding and non-corresponding states (WM/SOCIAL/EMO/resting-state) and networks (WM/SOCIAL/EMO/whole-brain connectome). Using root mean squared error and coefficient of determination to evaluate model fit revealed that predictive performance was rather poor overall. Predictions from whole-brain FC were slightly better than those from FC in task-specific networks, and a slight benefit of predictions based on FC from task versus resting state was observed for performance in the WM domain. Beyond that, we did not find any significant effects of a correspondence of network, task state, and performance domains. Together, these results suggest that multivariate FC patterns during both task and resting states contain rather little information on individual performance levels, calling for a reconsideration of how the brain mediates individual differences in mental abilities.
Collapse
Affiliation(s)
- Nevena Kraljević
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf
| | - Robert Langner
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf
| | - Vincent Küppers
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
- Department of Nuclear Medicine, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Federico Raimondo
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf
| | - Kaustubh R Patil
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf
| | - Simon B Eickhoff
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf
| | - Veronika I Müller
- Institute of Neuroscience and Medicine (INM-7: Brain and Behaviour), Research Centre Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf
| |
Collapse
|
3
|
Greene AS, Shen X, Noble S, Horien C, Hahn CA, Arora J, Tokoglu F, Spann MN, Carrión CI, Barron DS, Sanacora G, Srihari VH, Woods SW, Scheinost D, Constable RT. Brain-phenotype models fail for individuals who defy sample stereotypes. Nature 2022; 609:109-118. [PMID: 36002572 PMCID: PMC9433326 DOI: 10.1038/s41586-022-05118-w] [Citation(s) in RCA: 47] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Accepted: 07/15/2022] [Indexed: 01/19/2023]
Abstract
Individual differences in brain functional organization track a range of traits, symptoms and behaviours1-12. So far, work modelling linear brain-phenotype relationships has assumed that a single such relationship generalizes across all individuals, but models do not work equally well in all participants13,14. A better understanding of in whom models fail and why is crucial to revealing robust, useful and unbiased brain-phenotype relationships. To this end, here we related brain activity to phenotype using predictive models-trained and tested on independent data to ensure generalizability15-and examined model failure. We applied this data-driven approach to a range of neurocognitive measures in a new, clinically and demographically heterogeneous dataset, with the results replicated in two independent, publicly available datasets16,17. Across all three datasets, we find that models reflect not unitary cognitive constructs, but rather neurocognitive scores intertwined with sociodemographic and clinical covariates; that is, models reflect stereotypical profiles, and fail when applied to individuals who defy them. Model failure is reliable, phenotype specific and generalizable across datasets. Together, these results highlight the pitfalls of a one-size-fits-all modelling approach and the effect of biased phenotypic measures18-20 on the interpretation and utility of resulting brain-phenotype models. We present a framework to address these issues so that such models may reveal the neural circuits that underlie specific phenotypes and ultimately identify individualized neural targets for clinical intervention.
Collapse
Affiliation(s)
- Abigail S Greene
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA.
- MD-PhD program, Yale School of Medicine, New Haven, CT, USA.
| | - Xilin Shen
- Depatment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Stephanie Noble
- Depatment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Corey Horien
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA
- MD-PhD program, Yale School of Medicine, New Haven, CT, USA
| | - C Alice Hahn
- Depatment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Jagriti Arora
- Depatment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Fuyuze Tokoglu
- Depatment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Marisa N Spann
- Department of Psychiatry, Columbia University Irving Medical Center, New York, NY, USA
| | - Carmen I Carrión
- Department of Neurology, Yale School of Medicine, New Haven, CT, USA
| | - Daniel S Barron
- Department of Anesthesiology and Pain Medicine, University of Washington, Seattle, WA, USA
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Department of Psychiatry, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Gerard Sanacora
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Vinod H Srihari
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Scott W Woods
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Dustin Scheinost
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA
- Depatment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
- Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT, USA
- Department of Statistics and Data Science, Yale University, New Haven, CT, USA
- Child Study Center, Yale School of Medicine, New Haven, CT, USA
| | - R Todd Constable
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA.
- Depatment of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
- Department of Biomedical Engineering, Yale School of Engineering and Applied Science, New Haven, CT, USA.
- Department of Neurosurgery, Yale School of Medicine, New Haven, CT, USA.
| |
Collapse
|
4
|
Valles-Salgado M, Cabrera-Martín MN, Curiel-Cid RE, Delgado-Álvarez A, Delgado-Alonso C, Gil-Moreno MJ, Matías-Guiu J, Loewenstein DA, Matias-Guiu JA. Neuropsychological, Metabolic, and Connectivity Underpinnings of Semantic Interference Deficits Using the LASSI-L. J Alzheimers Dis 2022; 90:823-840. [PMID: 36189601 DOI: 10.3233/jad-220754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND LASSI-L is a novel neuropsychological test specifically designed for the early diagnosis of Alzheimer's disease (AD) based on semantic interference. OBJECTIVE To examine the cognitive and neural underpinnings of the failure to recover from proactive semantic and retroactive semantic interference. METHODS One hundred and fifty-five patients consulting for memory loss were included. Patients underwent neuropsychological assessment, including the LASSI-L, and FDG-PET imaging. They were categorized as subjective memory complaints (SMC) (n=32), pre-mild cognitive impairment (MCI) due to AD (Pre-MCI) (n=39), MCI due to AD (MCI-AD) (n=71), and MCI without evidence of neurodegeneration (MCI-NN) (n=13). Voxel-based brain mapping and metabolic network connectivity analyses were conducted. RESULTS A significant group effect was found for all the LASSI-L scores. LASSI-L scores measuring failure to recover from proactive semantic interference and retroactive semantic interference were predicted by other neuropsychological tests with a precision of 64.1 and 44.8%. The LASSI-L scores were associated with brain metabolism in the bilateral precuneus, superior, middle and inferior temporal gyri, fusiform, angular, superior and inferior parietal lobule, superior, middle and inferior occipital gyri, lingual gyrus, and posterior cingulate. Connectivity analysis revealed a decrease of node degree and centrality in posterior cingulate in patients showing frPSI. CONCLUSION Episodic memory dysfunction and the involvement of the medial temporal lobe, precuneus and posterior cingulate constitute the basis of the failure to recover from proactive semantic interference and retroactive semantic interference. These findings support the role of the LASSI-L in the detection, monitoring and outcome prediction during the early stages of AD.
Collapse
Affiliation(s)
- María Valles-Salgado
- Department of Neurology, Hospital Clínico San Carlos, San Carlos Health Research Institute (IdISSC), Universidad Complutense de Madrid, Madrid, Spain
| | - María Nieves Cabrera-Martín
- Department of Nuclear Medicine, Hospital Clínico San Carlos, San Carlos Health Research Institute (IdISSC), Universidad Complutense de Madrid, Madrid, Spain
| | - Rosie E Curiel-Cid
- Center for Cognitive Neuroscience and Aging, Department of Psychiatry and Behavioral Sciences, Miller School of Medicine, University of Miami and Center of Aging, Miami, FL, USA
| | - Alfonso Delgado-Álvarez
- Department of Neurology, Hospital Clínico San Carlos, San Carlos Health Research Institute (IdISSC), Universidad Complutense de Madrid, Madrid, Spain
| | - Cristina Delgado-Alonso
- Department of Neurology, Hospital Clínico San Carlos, San Carlos Health Research Institute (IdISSC), Universidad Complutense de Madrid, Madrid, Spain
| | - María José Gil-Moreno
- Department of Neurology, Hospital Clínico San Carlos, San Carlos Health Research Institute (IdISSC), Universidad Complutense de Madrid, Madrid, Spain
| | - Jorge Matías-Guiu
- Department of Neurology, Hospital Clínico San Carlos, San Carlos Health Research Institute (IdISSC), Universidad Complutense de Madrid, Madrid, Spain
| | - David A Loewenstein
- Center for Cognitive Neuroscience and Aging, Department of Psychiatry and Behavioral Sciences, Miller School of Medicine, University of Miami and Center of Aging, Miami, FL, USA
| | - Jordi A Matias-Guiu
- Department of Neurology, Hospital Clínico San Carlos, San Carlos Health Research Institute (IdISSC), Universidad Complutense de Madrid, Madrid, Spain
| |
Collapse
|
5
|
Stark GF, Avery EW, Rosenberg MD, Greene AS, Gao S, Scheinost D, Todd Constable R, Chun MM, Yoo K. Using functional connectivity models to characterize relationships between working and episodic memory. Brain Behav 2021; 11:e02105. [PMID: 34142458 PMCID: PMC8413720 DOI: 10.1002/brb3.2105] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Revised: 01/26/2021] [Accepted: 02/18/2021] [Indexed: 02/02/2023] Open
Abstract
INTRODUCTION Working memory is a critical cognitive ability that affects our daily functioning and relates to many cognitive processes and clinical conditions. Episodic memory is vital because it enables individuals to form and maintain their self-identities. Our study analyzes the extent to which whole-brain functional connectivity observed during completion of an N-back memory task, a common measure of working memory, can predict both working memory and episodic memory. METHODS We used connectome-based predictive models (CPMs) to predict 502 Human Connectome Project (HCP) participants' in-scanner 2-back memory test scores and out-of-scanner working memory test (List Sorting) and episodic memory test (Picture Sequence and Penn Word) scores based on functional magnetic resonance imaging (fMRI) data collected both during rest and N-back task performance. We also analyzed the functional brain connections that contributed to prediction for each of these models. RESULTS Functional connectivity observed during N-back task performance predicted out-of-scanner List Sorting scores and to a lesser extent out-of-scanner Picture Sequence scores, but did not predict out-of-scanner Penn Word scores. Additionally, the functional connections predicting 2-back scores overlapped to a greater degree with those predicting List Sorting scores than with those predicting Picture Sequence or Penn Word scores. Functional connections with the insula, including connections between insular and parietal regions, predicted scores across the 2-back, List Sorting, and Picture Sequence tasks. CONCLUSIONS Our findings validate functional connectivity observed during the N-back task as a measure of working memory, which generalizes to predict episodic memory to a lesser extent. By building on our understanding of the predictive power of N-back task functional connectivity, this work enhances our knowledge of relationships between working memory and episodic memory.
Collapse
Affiliation(s)
- Gigi F Stark
- Department of Psychology, Yale University, New Haven, CT, USA
| | - Emily W Avery
- Department of Psychology, Yale University, New Haven, CT, USA
| | - Monica D Rosenberg
- Department of Psychology, Yale University, New Haven, CT, USA.,Department of Psychology, University of Chicago, Chicago, IL, USA
| | - Abigail S Greene
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT, USA
| | - Siyuan Gao
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Dustin Scheinost
- Department of Diagnostic Radiology, Yale School of Medicine, New Haven, CT, USA
| | - R Todd Constable
- Interdepartmental Neuroscience Program, Yale University, New Haven, CT, USA.,Department of Diagnostic Radiology, Yale School of Medicine, New Haven, CT, USA.,Department of Neurosurgery, Yale School of Medicine, New Haven, CT, USA
| | - Marvin M Chun
- Department of Psychology, Yale University, New Haven, CT, USA.,Interdepartmental Neuroscience Program, Yale University, New Haven, CT, USA.,Department of Neuroscience, Yale School of Medicine, New Haven, CT, USA
| | - Kwangsun Yoo
- Department of Psychology, Yale University, New Haven, CT, USA
| |
Collapse
|