1
|
Rubio JM, Lencz T, Cao H, Kraguljac N, Dhamala E, Homan P, Horga G, Sarpal DK, Argyelan M, Gallego J, Cholewa J, Barber A, Kane JM, Malhotra AK. Replication of a neuroimaging biomarker for striatal dysfunction in psychosis. Mol Psychiatry 2024; 29:929-938. [PMID: 38177349 PMCID: PMC11176002 DOI: 10.1038/s41380-023-02381-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 12/06/2023] [Accepted: 12/13/2023] [Indexed: 01/06/2024]
Abstract
To bring biomarkers closer to clinical application, they should be generalizable, reliable, and maintain performance within the constraints of routine clinical conditions. The functional striatal abnormalities (FSA), is among the most advanced neuroimaging biomarkers in schizophrenia, trained to discriminate diagnosis, with post-hoc analyses indicating prognostic properties. Here, we attempt to replicate its diagnostic capabilities measured by the area under the curve (AUC) in receiver operator characteristic curves discriminating individuals with psychosis (n = 101) from healthy controls (n = 51) in the Human Connectome Project for Early Psychosis. We also measured the test-retest (run 1 vs 2) and phase encoding direction (i.e., AP vs PA) reliability with intraclass correlation coefficients (ICC). Additionally, we measured effects of scan length on classification accuracy (i.e., AUCs) and reliability (i.e., ICCs). Finally, we tested the prognostic capability of the FSA by the correlation between baseline scores and symptom improvement over 12 weeks of antipsychotic treatment in a separate cohort (n = 97). Similar analyses were conducted for the Yeo networks intrinsic connectivity as a reference. The FSA had good/excellent diagnostic discrimination (AUC = 75.4%, 95% CI = 67.0-83.3%; in non-affective psychosis AUC = 80.5%, 95% CI = 72.1-88.0%, and in affective psychosis AUC = 58.7%, 95% CI = 44.2-72.0%). Test-retest reliability ranged between ICC = 0.48 (95% CI = 0.35-0.59) and ICC = 0.22 (95% CI = 0.06-0.36), which was comparable to that of networks intrinsic connectivity. Phase encoding direction reliability for the FSA was ICC = 0.51 (95% CI = 0.42-0.59), generally lower than for networks intrinsic connectivity. By increasing scan length from 2 to 10 min, diagnostic classification of the FSA increased from AUC = 71.7% (95% CI = 63.1-80.3%) to 75.4% (95% CI = 67.0-83.3%) and phase encoding direction reliability from ICC = 0.29 (95% CI = 0.14-0.43) to ICC = 0.51 (95% CI = 0.42-0.59). FSA scores did not correlate with symptom improvement. These results reassure that the FSA is a generalizable diagnostic - but not prognostic - biomarker. Given the replicable results of the FSA as a diagnostic biomarker trained on case-control datasets, next the development of prognostic biomarkers should be on treatment-response data.
Collapse
Affiliation(s)
- Jose M Rubio
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA.
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA.
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA.
| | - Todd Lencz
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| | - Hengyi Cao
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| | - Nina Kraguljac
- Department of Psychiatry and Behavioral Health, The Ohio State University, Columbus, OH, USA
| | - Elvisha Dhamala
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| | - Philipp Homan
- Department of Psychiatry, Psychotherapy, and Psychosomatics, Psychiatric University Hospital Zurich, University of Zurich, 8032, Zurich, Switzerland
- Neuroscience Center Zurich, University of Zurich and Swiss Federal Institute of Technology Zurich, 8057, Zurich, Switzerland
| | - Guillermo Horga
- Department of Psychiatry, Columbia University, and New York State Psychiatric Institute, New York, NY, USA
| | - Deepak K Sarpal
- Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
| | - Miklos Argyelan
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| | - Juan Gallego
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| | - John Cholewa
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| | - Anita Barber
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| | - John M Kane
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| | - Anil K Malhotra
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, NY, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, NY, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, NY, USA
| |
Collapse
|
2
|
Zugman A, Ringlein GV, Finn ES, Lewis KM, Berman E, Silverman WK, Lebowitz ER, Pine DS, Winkler AM. Brain Functional Connectivity and Anatomical Features as Predictors of Cognitive Behavioral Therapy Outcome for Anxiety in Youths. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.01.29.24301959. [PMID: 38352528 PMCID: PMC10862993 DOI: 10.1101/2024.01.29.24301959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/25/2024]
Abstract
Background Because pediatric anxiety disorders precede the onset of many other problems, successful prediction of response to the first-line treatment, cognitive-behavioral therapy (CBT), could have major impact. However, existing clinical models are weakly predictive. The current study evaluates whether structural and resting-state functional magnetic resonance imaging can predict post-CBT anxiety symptoms. Methods Two datasets were studied: (A) one consisted of n=54 subjects with an anxiety diagnosis, who received 12 weeks of CBT, and (B) one consisted of n=15 subjects treated for 8 weeks. Connectome Predictive Modeling (CPM) was used to predict treatment response, as assessed with the PARS; additionally we investigated models using anatomical features, instead of functional connectivity. The main analysis included network edges positively correlated with treatment outcome, and age, sex, and baseline anxiety severity as predictors. Results from alternative models and analyses also are presented. Model assessments utilized 1000 bootstraps, resulting in a 95% CI for R2, r and mean absolute error (MAE). Outcomes The main model showed a mean absolute error of approximately 3.5 (95%CI: [3.1-3.8]) points a R2 of 0.08 [-0.14 - 0.26] and r of 0.38 [0.24 - 0.511]. When testing this model in the left-out sample (B) the results were similar, with a MAE of 3.4 [2.8 - 4.7], R2-0.65 [-2.29 - 0.16] and r of 0.4 [0.24 - 0.54]. The anatomical metrics showed a similar pattern, where models rendered overall low R2. Interpretation The analysis showed that models based on earlier promising results failed to predict clinical outcomes. Despite the small sample size, the current study does not support extensive use of CPM to predict outcome in pediatric anxiety.
Collapse
Affiliation(s)
- Andre Zugman
- Emotion and Development Branch, National Institute of Mental Health, National Institutes of Health, 9000 Rockville Pike, Bethesda, MD, 20892, USA
| | - Grace V. Ringlein
- Emotion and Development Branch, National Institute of Mental Health, National Institutes of Health, 9000 Rockville Pike, Bethesda, MD, 20892, USA
| | - Emily S. Finn
- Psychological and Brain Sciences, Dartmouth College, 3 Maynard St, Hanover, NH, 03755, USA
| | - Krystal M. Lewis
- Emotion and Development Branch, National Institute of Mental Health, National Institutes of Health, 9000 Rockville Pike, Bethesda, MD, 20892, USA
| | - Erin Berman
- Emotion and Development Branch, National Institute of Mental Health, National Institutes of Health, 9000 Rockville Pike, Bethesda, MD, 20892, USA
| | - Wendy K. Silverman
- Child Study Center, Yale University, 230 South Frontage Rd., New Haven, CT 06520, USA
| | - Eli R. Lebowitz
- Child Study Center, Yale University, 230 South Frontage Rd., New Haven, CT 06520, USA
| | - Daniel S. Pine
- Emotion and Development Branch, National Institute of Mental Health, National Institutes of Health, 9000 Rockville Pike, Bethesda, MD, 20892, USA
| | - Anderson M. Winkler
- Division of Human Genetics, School of Medicine, University of Texas Rio Grande Valley, 1 West University Blvd, Brownsville, TX 78520, USA
| |
Collapse
|
3
|
Cliff OM, Bryant AG, Lizier JT, Tsuchiya N, Fulcher BD. Unifying pairwise interactions in complex dynamics. NATURE COMPUTATIONAL SCIENCE 2023; 3:883-893. [PMID: 38177751 DOI: 10.1038/s43588-023-00519-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 08/14/2023] [Indexed: 01/06/2024]
Abstract
Scientists have developed hundreds of techniques to measure the interactions between pairs of processes in complex systems, but these computational methods-from contemporaneous correlation coefficients to causal inference methods-define and formulate interactions differently, using distinct quantitative theories that remain largely disconnected. Here we introduce a large assembled library of 237 statistics of pairwise interactions, and assess their behavior on 1,053 multivariate time series from a wide range of real-world and model-generated systems. Our analysis highlights commonalities between disparate mathematical formulations of interactions, providing a unified picture of a rich interdisciplinary literature. Using three real-world case studies, we then show that simultaneously leveraging diverse methods can uncover those most suitable for addressing a given problem, facilitating interpretable understanding of the quantitative formulation of pairwise dependencies that drive successful performance. Our results and accompanying software enable comprehensive analysis of time-series interactions by drawing on decades of diverse methodological contributions.
Collapse
Affiliation(s)
- Oliver M Cliff
- School of Physics, The University of Sydney, Camperdown, New South Wales, Australia
- Centre for Complex Systems, The University of Sydney, Camperdown, New South Wales, Australia
| | - Annie G Bryant
- School of Physics, The University of Sydney, Camperdown, New South Wales, Australia
- Centre for Complex Systems, The University of Sydney, Camperdown, New South Wales, Australia
| | - Joseph T Lizier
- Centre for Complex Systems, The University of Sydney, Camperdown, New South Wales, Australia
- School of Computer Science, The University of Sydney, Camperdown, New South Wales, Australia
| | - Naotsugu Tsuchiya
- Turner Institute for Brain and Mental Health & School of Psychological Sciences, Faculty of Medicine, Nursing, and Health Sciences, Monash University, Melbourne, Victoria, Australia
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Suita-shi, Japan
- Advanced Telecommunications Research Computational Neuroscience Laboratories, Seika-cho, Japan
| | - Ben D Fulcher
- School of Physics, The University of Sydney, Camperdown, New South Wales, Australia.
- Centre for Complex Systems, The University of Sydney, Camperdown, New South Wales, Australia.
| |
Collapse
|
4
|
Rubio J, Lencz T, Cao H, Kraguljac N, Dhamala E, Homan P, Horga G, Sarpal D, Argyelan M, Gallego J, Cholewa J, Barber A, Kane J, Maholtra A. Replication of a neuroimaging biomarker for striatal dysfunction in psychosis. RESEARCH SQUARE 2023:rs.3.rs-3185688. [PMID: 37609149 PMCID: PMC10441472 DOI: 10.21203/rs.3.rs-3185688/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/24/2023]
Abstract
To bring biomarkers closer to clinical application, they should be generalizable, reliable, and maintain performance within the constraints of routine clinical conditions. The functional striatal abnormalities (FSA), is among the most advanced neuroimaging biomarkers in schizophrenia, trained to discriminate diagnosis, with post-hoc analyses indicating prognostic properties. Here, we attempt to replicate its diagnostic capabilities measured by the area under the curve (AUC) in receiver operator characteristic curves discriminating individuals with psychosis (n=101) from healthy controls (n=51) in the Human Connectome Project for Early Psychosis. We also measured the test-retest (run 1 vs 2) and phase encoding direction (i.e., AP vs PA) reliability with intraclass correlation coefficients (ICC). Additionally, we measured effects of scan length on classification accuracy (i.e., AUCs) and reliability (i.e., ICCs). Finally, we tested the prognostic capability of the FSA by the correlation between baseline scores and symptom improvement over 12 weeks of antipsychotic treatment in a separate cohort (n=97). Similar analyses were conducted for the Yeo networks intrinsic connectivity as a reference. The FSA had good/excellent diagnostic discrimination (AUC=75.4%, 95%CI=67.0%-83.3%; in non-affective psychosis AUC=80.5%, 95%CI=72.1-88.0%, and in affective psychosis AUC=58.7%, 95%CI=44.2-72.0%). Test-retest reliability ranged between ICC=0.48 (95%CI=0.35-0.59) and ICC=0.22 (95%CI=0.06-0.36), which was comparable to that of networks intrinsic connectivity. Phase encoding direction reliability for the FSA was ICC=0.51 (95%CI=0.42-0.59), generally lower than for networks intrinsic connectivity. By increasing scan length from 2 to 10 minutes, diagnostic classification of the FSA increased from AUC=71.7% (95%CI=63.1%-80.3%) to 75.4% (95%CI=67.0%-83.3%) and phase encoding direction reliability from ICC=0.29 (95%CI=0.14-0.43) to ICC=0.51 (95%CI=0.42-0.59). FSA scores did not correlate with symptom improvement. These results reassure that the FSA is a generalizable diagnostic - but not prognostic - biomarker. Given the replicable results of the FSA as a diagnostic biomarker trained on case-control datasets, next the development of prognostic biomarkers should be on treatment-response data.
Collapse
Affiliation(s)
- Jose Rubio
- Institute of Behavioral Science, Feinstein Institutes of Medical Research, Northwell Health
| | - Todd Lencz
- Zucker School of Medicine at Hofstra/Northwell
| | - Hengyi Cao
- The Feinstein Institute for Medical Research
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
5
|
Rubio JM, Lencz T, Cao H, Kraguljac N, Dhamala E, Homan P, Horga G, Sarpal DK, Argyelan M, Gallego J, Cholewa J, Barber A, Kane J, Malhotra A. Replication of a neuroimaging biomarker for striatal dysfunction in psychosis. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.07.17.23292779. [PMID: 37503088 PMCID: PMC10371185 DOI: 10.1101/2023.07.17.23292779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
To bring biomarkers closer to clinical application, they should be generalizable, reliable, and maintain performance within the constraints of routine clinical conditions. The functional striatal abnormalities (FSA), is among the most advanced neuroimaging biomarkers in schizophrenia, trained to discriminate diagnosis, with post-hoc analyses indicating prognostic properties. Here, we attempt to replicate its diagnostic capabilities measured by the area under the curve (AUC) in receiver operator characteristic curves discriminating individuals with psychosis (n=101) from healthy controls (n=51) in the Human Connectome Project for Early Psychosis. We also measured the test-retest (run 1 vs 2) and phase encoding direction (i.e., AP vs PA) reliability with intraclass correlation coefficients (ICC). Additionally, we measured effects of scan length on classification accuracy (i.e., AUCs) and reliability (i.e., ICCs). Finally, we tested the prognostic capability of the FSA by the correlation between baseline scores and symptom improvement over 12 weeks of antipsychotic treatment in a separate cohort (n=97). Similar analyses were conducted for the Yeo networks intrinsic connectivity as a reference. The FSA had good/excellent diagnostic discrimination (AUC=75.4%, 95%CI=67.0%-83.3%; in non-affective psychosis AUC=80.5%, 95%CI=72.1-88.0%, and in affective psychosis AUC=58.7%, 95%CI=44.2-72.0%). Test-retest reliability ranged between ICC=0.48 (95%CI=0.35-0.59) and ICC=0.22 (95%CI=0.06-0.36), which was comparable to that of networks intrinsic connectivity. Phase encoding direction reliability for the FSA was ICC=0.51 (95%CI=0.42-0.59), generally lower than for networks intrinsic connectivity. By increasing scan length from 2 to 10 minutes, diagnostic classification of the FSA increased from AUC=71.7% (95%CI=63.1%-80.3%) to 75.4% (95%CI=67.0%-83.3%) and phase encoding direction reliability from ICC=0.29 (95%CI=0.14-0.43) to ICC=0.51 (95%CI=0.42-0.59). FSA scores did not correlate with symptom improvement. These results reassure that the FSA is a generalizable diagnostic - but not prognostic - biomarker. Given the replicable results of the FSA as a diagnostic biomarker trained on case-control datasets, next the development of prognostic biomarkers should be on treatment-response data.
Collapse
Affiliation(s)
- Jose M Rubio
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - Todd Lencz
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - Hengyi Cao
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - Nina Kraguljac
- Department of Psychiatry and Behavioral Health, The Ohio State University, Columbus, Ohio
| | - Elvisha Dhamala
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - Philipp Homan
- Department of Psychiatry, Psychotherapy, and Psychosomatics, Psychiatric University Hospital Zurich, University of Zurich, 8032, Zurich, Switzerland
- Neuroscience Center Zurich, University of Zurich and Swiss Federal Institute of Technology Zurich, 8057, Zurich, Switzerland
| | - Guillermo Horga
- Department of Psychiatry, Columbia University, and New York State Psychiatric Institute, New York, USA
| | - Deepak K Sarpal
- Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Miklos Argyelan
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - Juan Gallego
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - John Cholewa
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - Anita Barber
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - John Kane
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| | - Anil Malhotra
- Donald and Barbara Zucker School of Medicine at Hofstra University - Northwell Health, New York, USA
- Institute of Behavioral Science, Feinstein Institutes for Medical Research, Northwell Health, New York, USA
- Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, New York, USA
| |
Collapse
|
6
|
Horien C, Floris DL, Greene AS, Noble S, Rolison M, Tejavibulya L, O'Connor D, McPartland JC, Scheinost D, Chawarska K, Lake EMR, Constable RT. Functional Connectome-Based Predictive Modeling in Autism. Biol Psychiatry 2022; 92:626-642. [PMID: 35690495 PMCID: PMC10948028 DOI: 10.1016/j.biopsych.2022.04.008] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Revised: 04/14/2022] [Accepted: 04/17/2022] [Indexed: 01/08/2023]
Abstract
Autism is a heterogeneous neurodevelopmental condition, and functional magnetic resonance imaging-based studies have helped advance our understanding of its effects on brain network activity. We review how predictive modeling, using measures of functional connectivity and symptoms, has helped reveal key insights into this condition. We discuss how different prediction frameworks can further our understanding of the brain-based features that underlie complex autism symptomatology and consider how predictive models may be used in clinical settings. Throughout, we highlight aspects of study interpretation, such as data decay and sampling biases, that require consideration within the context of this condition. We close by suggesting exciting future directions for predictive modeling in autism.
Collapse
Affiliation(s)
- Corey Horien
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, Connecticut; MD-PhD Program, Yale School of Medicine, New Haven, Connecticut.
| | - Dorothea L Floris
- Methods of Plasticity Research, Department of Psychology, University of Zürich, Zurich, Switzerland; Donders Center for Brain, Cognition and Behavior, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - Abigail S Greene
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, Connecticut; MD-PhD Program, Yale School of Medicine, New Haven, Connecticut
| | - Stephanie Noble
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut
| | - Max Rolison
- Yale Child Study Center, New Haven, Connecticut
| | - Link Tejavibulya
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, Connecticut
| | - David O'Connor
- Department of Biomedical Engineering, Yale University, New Haven, Connecticut
| | - James C McPartland
- Department of Psychology, Yale University, New Haven, Connecticut; Yale Child Study Center, New Haven, Connecticut
| | - Dustin Scheinost
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, Connecticut; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut; Department of Biomedical Engineering, Yale University, New Haven, Connecticut; Department of Statistics and Data Science, Yale University, New Haven, Connecticut; Yale Child Study Center, New Haven, Connecticut
| | - Katarzyna Chawarska
- Department of Pediatrics, Yale School of Medicine, New Haven, Connecticut; Department of Statistics and Data Science, Yale University, New Haven, Connecticut; Yale Child Study Center, New Haven, Connecticut
| | - Evelyn M R Lake
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut
| | - R Todd Constable
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, Connecticut; Department of Neurosurgery, Yale School of Medicine, New Haven, Connecticut; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, Connecticut; Department of Biomedical Engineering, Yale University, New Haven, Connecticut.
| |
Collapse
|
7
|
Zamani Esfahlani F, Byrge L, Tanner J, Sporns O, Kennedy DP, Betzel RF. Edge-centric analysis of time-varying functional brain networks with applications in autism spectrum disorder. Neuroimage 2022; 263:119591. [PMID: 36031181 DOI: 10.1016/j.neuroimage.2022.119591] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 08/13/2022] [Accepted: 08/23/2022] [Indexed: 11/18/2022] Open
Abstract
The interaction between brain regions changes over time, which can be characterized using time-varying functional connectivity (tvFC). The common approach to estimate tvFC uses sliding windows and offers limited temporal resolution. An alternative method is to use the recently proposed edge-centric approach, which enables the tracking of moment-to-moment changes in co-fluctuation patterns between pairs of brain regions. Here, we first examined the dynamic features of edge time series and compared them to those in the sliding window tvFC (sw-tvFC). Then, we used edge time series to compare subjects with autism spectrum disorder (ASD) and healthy controls (CN). Our results indicate that relative to sw-tvFC, edge time series captured rapid and bursty network-level fluctuations that synchronize across subjects during movie-watching. The results from the second part of the study suggested that the magnitude of peak amplitude in the collective co-fluctuations of brain regions (estimated as root sum square (RSS) of edge time series) is similar in CN and ASD. However, the trough-to-trough duration in RSS signal is greater in ASD, compared to CN. Furthermore, an edge-wise comparison of high-amplitude co-fluctuations showed that the within-network edges exhibited greater magnitude fluctuations in CN. Our findings suggest that high-amplitude co-fluctuations captured by edge time series provide details about the disruption of functional brain dynamics that could potentially be used in developing new biomarkers of mental disorders.
Collapse
Affiliation(s)
- Farnaz Zamani Esfahlani
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405, United States
| | - Lisa Byrge
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405, United States
| | - Jacob Tanner
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405, United States
| | - Olaf Sporns
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405, United States; Cognitive Science Program, Indiana University, Bloomington, IN 47405, United States; Program in Neuroscience, Indiana University, Bloomington, IN 47405, United States; Network Science Institute, Indiana University, Bloomington, IN 47405, United States
| | - Daniel P Kennedy
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405, United States; Cognitive Science Program, Indiana University, Bloomington, IN 47405, United States; Program in Neuroscience, Indiana University, Bloomington, IN 47405, United States
| | - Richard F Betzel
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405, United States; Cognitive Science Program, Indiana University, Bloomington, IN 47405, United States; Program in Neuroscience, Indiana University, Bloomington, IN 47405, United States; Network Science Institute, Indiana University, Bloomington, IN 47405, United States.
| |
Collapse
|
8
|
Litwińczuk MC, Trujillo-Barreto N, Muhlert N, Cloutman L, Woollams A. Combination of structural and functional connectivity explains unique variation in specific domains of cognitive function. Neuroimage 2022; 262:119531. [PMID: 35931312 DOI: 10.1016/j.neuroimage.2022.119531] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Revised: 07/20/2022] [Accepted: 08/01/2022] [Indexed: 11/29/2022] Open
Abstract
The relationship between structural and functional brain networks has been characterised as complex: the two networks mirror each other and show mutual influence but they also diverge in their organisation. This work explored whether a combination of structural and functional connectivity can improve the fit of regression models of cognitive performance. Principal Component Analysis (PCA) was first applied to cognitive data from the Human Connectome Project to identify latent cognitive components: Executive Function, Self-regulation, Language, Encoding and Sequence Processing. A Principal Component Regression approach with embedded Step-Wise Regression (SWR-PCR) was then used to fit regression models of each cognitive domain based on structural (SC), functional (FC) or combined structural-functional (CC) connectivity. Executive Function was best explained by the CC model. Self-regulation was equally well explained by SC and FC. Language was equally well explained by CC and FC models. Encoding and Sequence Processing were best explained by SC. Evaluation of out-of-sample models' skill via cross-validation showed that SC, FC and CC produced generalisable models of Language performance. SC models performed most effectively at predicting Language performance in unseen sample. Executive Function was most effectively predicted by SC models, followed only by CC models. Self-regulation was only effectively predicted by CC models and Sequence Processing was only effectively predicted by FC models. The present study demonstrates that integrating structural and functional connectivity can help explaining cognitive performance, but that the added explanatory value (in sample) may be domain-specific and can come at the expense of reduced generalisation performance (out-of-sample).
Collapse
Affiliation(s)
| | | | - Nils Muhlert
- Division of Neuroscience and Experimental Psychology, University of Manchester, UK
| | - Lauren Cloutman
- Division of Neuroscience and Experimental Psychology, University of Manchester, UK
| | - Anna Woollams
- Division of Neuroscience and Experimental Psychology, University of Manchester, UK
| |
Collapse
|
9
|
Byrge L, Kliemann D, He Y, Cheng H, Tyszka JM, Adolphs R, Kennedy DP. Video-evoked fMRI BOLD responses are highly consistent across different data acquisition sites. Hum Brain Mapp 2022; 43:2972-2991. [PMID: 35289976 PMCID: PMC9120552 DOI: 10.1002/hbm.25830] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 01/12/2022] [Accepted: 02/28/2022] [Indexed: 01/27/2023] Open
Abstract
Naturalistic imaging paradigms, in which participants view complex videos in the scanner, are increasingly used in human cognitive neuroscience. Videos evoke temporally synchronized brain responses that are similar across subjects as well as within subjects, but the reproducibility of these brain responses across different data acquisition sites has not yet been quantified. Here, we characterize the consistency of brain responses across independent samples of participants viewing the same videos in functional magnetic resonance imaging (fMRI) scanners at different sites (Indiana University and Caltech). We compared brain responses collected at these different sites for two carefully matched datasets with identical scanner models, acquisition, and preprocessing details, along with a third unmatched dataset in which these details varied. Our overall conclusion is that for matched and unmatched datasets alike, video-evoked brain responses have high consistency across these different sites, both when compared across groups and across pairs of individuals. As one might expect, differences between sites were larger for unmatched datasets than matched datasets. Residual differences between datasets could in part reflect participant-level variability rather than scanner- or data- related effects. Altogether our results indicate promise for the development and, critically, generalization of video fMRI studies of individual differences in healthy and clinical populations alike.
Collapse
Affiliation(s)
- Lisa Byrge
- Department of PsychologyUniversity of North FloridaJacksonvilleFloridaUSA
- Biomedical Sciences ProgramUniversity of North FloridaJacksonvilleFloridaUSA
| | - Dorit Kliemann
- Department of Psychological and Brain SciencesThe University of IowaIowa CityIowaUSA
- Iowa Neuroscience InstituteUniversity of IowaIowaIAUSA
- Department of PsychiatryUniversity of IowaIowa CityIAUSA
| | - Ye He
- School of Artificial IntelligenceBeijing University of Posts and TelecommunicationsBeijingChina
| | - Hu Cheng
- Department of Psychological and Brain SciencesIndiana UniversityBloomingtonIndianaUSA
- Program in NeuroscienceBloomingtonIndianaUSA
| | - Julian Michael Tyszka
- Division of the Humanities and Social SciencesCalifornia Institute of TechnologyPasadenaCaliforniaUSA
- Caltech Brain Imaging CenterCalifornia Institute of TechnologyPasadenaCaliforniaUSA
| | - Ralph Adolphs
- Division of the Humanities and Social SciencesCalifornia Institute of TechnologyPasadenaCaliforniaUSA
- Division of Biology and Biological EngineeringCalifornia Institute of TechnologyPasadenaCaliforniaUSA
- Chen Neuroscience InstituteCalifornia Institute of TechnologyPasadenaCaliforniaUSA
| | - Daniel P. Kennedy
- Department of Psychological and Brain SciencesIndiana UniversityBloomingtonIndianaUSA
- Program in NeuroscienceBloomingtonIndianaUSA
- Cognitive Science ProgramIndiana UniversityBloomingtonIndianaUSA
| |
Collapse
|
10
|
Brain connectivity fingerprinting and behavioural prediction rest on distinct functional systems of the human connectome. Commun Biol 2022; 5:261. [PMID: 35332230 PMCID: PMC8948277 DOI: 10.1038/s42003-022-03185-3] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Accepted: 02/08/2022] [Indexed: 11/16/2022] Open
Abstract
The prediction of inter-individual behavioural differences from neuroimaging data is a rapidly evolving field of research focusing on individualised methods to describe human brain organisation on the single-subject level. One method that harnesses such individual signatures is functional connectome fingerprinting, which can reliably identify individuals from large study populations. However, the precise relationship between functional signatures underlying fingerprinting and behavioural prediction remains unclear. Expanding on previous reports, here we systematically investigate the link between discrimination and prediction on different levels of brain network organisation (individual connections, network interactions, topographical organisation, and connection variability). Our analysis revealed a substantial divergence between discriminatory and predictive connectivity signatures on all levels of network organisation. Across different brain parcellations, thresholds, and prediction algorithms, we find discriminatory connections in higher-order multimodal association cortices, while neural correlates of behaviour display more variable distributions. Furthermore, we find the standard deviation of connections between participants to be significantly higher in fingerprinting than in prediction, making inter-individual connection variability a possible separating marker. These results demonstrate that participant identification and behavioural prediction involve highly distinct functional systems of the human connectome. The present study thus calls into question the direct functional relevance of connectome fingerprints. Mantwill et al. analysed the relationship between functional connectivity markers that are specific to individuals (i.e. brain fingerprints) and those predictive of behaviour. They reveal that these markers are unrelated and suggest an alternative perspective on the basis of individual signatures.
Collapse
|
11
|
Finn ES, Rosenberg MD. Beyond fingerprinting: Choosing predictive connectomes over reliable connectomes. Neuroimage 2021; 239:118254. [PMID: 34118397 DOI: 10.1016/j.neuroimage.2021.118254] [Citation(s) in RCA: 42] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Revised: 05/25/2021] [Accepted: 06/07/2021] [Indexed: 12/20/2022] Open
Abstract
Recent years have seen a surge of research on variability in functional brain connectivity within and between individuals, with encouraging progress toward understanding the consequences of this variability for cognition and behavior. At the same time, well-founded concerns over rigor and reproducibility in psychology and neuroscience have led many to question whether functional connectivity is sufficiently reliable, and call for methods to improve its reliability. The thesis of this opinion piece is that when studying variability in functional connectivity-both across individuals and within individuals over time-we should use behavior prediction as our benchmark rather than optimize reliability for its own sake. We discuss theoretical and empirical evidence to compel this perspective, both when the goal is to study stable, trait-level differences between people, as well as when the goal is to study state-related changes within individuals. We hope that this piece will be useful to the neuroimaging community as we continue efforts to characterize inter- and intra-subject variability in brain function and build predictive models with an eye toward eventual real-world applications.
Collapse
Affiliation(s)
- Emily S Finn
- Department of Psychological and Brain Sciences, Dartmouth College, United States.
| | - Monica D Rosenberg
- Department of Psychology, University of Chicago, United States; Neuroscience Institute, University of Chicago, United States.
| |
Collapse
|
12
|
Zamani Esfahlani F, Jo Y, Faskowitz J, Byrge L, Kennedy DP, Sporns O, Betzel RF. High-amplitude cofluctuations in cortical activity drive functional connectivity. Proc Natl Acad Sci U S A 2020; 117:28393-28401. [PMID: 33093200 PMCID: PMC7668041 DOI: 10.1073/pnas.2005531117] [Citation(s) in RCA: 106] [Impact Index Per Article: 26.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
Resting-state functional connectivity is used throughout neuroscience to study brain organization and to generate biomarkers of development, disease, and cognition. The processes that give rise to correlated activity are, however, poorly understood. Here we decompose resting-state functional connectivity using a temporal unwrapping procedure to assess the contributions of moment-to-moment activity cofluctuations to the overall connectivity pattern. This approach temporally resolves functional connectivity at a timescale of single frames, which enables us to make direct comparisons of cofluctuations of network organization with fluctuations in the blood oxygen level-dependent (BOLD) time series. We show that surprisingly, only a small fraction of frames exhibiting the strongest cofluctuation amplitude are required to explain a significant fraction of variance in the overall pattern of connection weights as well as the network's modular structure. These frames coincide with frames of high BOLD activity amplitude, corresponding to activity patterns that are remarkably consistent across individuals and identify fluctuations in default mode and control network activity as the primary driver of resting-state functional connectivity. Finally, we demonstrate that cofluctuation amplitude synchronizes across subjects during movie watching and that high-amplitude frames carry detailed information about individual subjects (whereas low-amplitude frames carry little). Our approach reveals fine-scale temporal structure of resting-state functional connectivity and discloses that frame-wise contributions vary across time. These observations illuminate the relation of brain activity to functional connectivity and open a number of directions for future research.
Collapse
Affiliation(s)
| | - Youngheun Jo
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405
| | - Joshua Faskowitz
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405
- Program in Neuroscience, Indiana University, Bloomington, IN 47405
| | - Lisa Byrge
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405
| | - Daniel P Kennedy
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405
- Program in Neuroscience, Indiana University, Bloomington, IN 47405
- Cognitive Science Program, Indiana University, Bloomington, IN 47405
| | - Olaf Sporns
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405
- Program in Neuroscience, Indiana University, Bloomington, IN 47405
- Cognitive Science Program, Indiana University, Bloomington, IN 47405
- Network Science Institute, Indiana University, Bloomington, IN 47405
| | - Richard F Betzel
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405;
- Program in Neuroscience, Indiana University, Bloomington, IN 47405
- Cognitive Science Program, Indiana University, Bloomington, IN 47405
- Network Science Institute, Indiana University, Bloomington, IN 47405
| |
Collapse
|
13
|
Byrge L, Kennedy DP. Accurate prediction of individual subject identity and task, but not autism diagnosis, from functional connectomes. Hum Brain Mapp 2020; 41:2249-2262. [PMID: 32150312 PMCID: PMC7268028 DOI: 10.1002/hbm.24943] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2019] [Revised: 01/27/2020] [Accepted: 01/28/2020] [Indexed: 12/24/2022] Open
Abstract
Despite enthusiasm about the potential for using fMRI-based functional connectomes in the development of biomarkers for autism spectrum disorder (ASD), the literature is full of negative findings-failures to distinguish ASD functional connectomes from those of typically developing controls (TD)-and positive findings that are inconsistent across studies. Here, we report on a new study designed to either better differentiate ASD from TD functional connectomes-or, alternatively, to refine our understanding of the factors underlying the current state of affairs. We scanned individuals with ASD and controls both at rest and while watching videos with social content. Using multiband fMRI across repeat sessions, we improved both data quantity and scanning duration by collecting up to 2 hr of data per individual. This is about 50 times the typical number of temporal samples per individual in ASD fcMRI studies. We obtained functional connectomes that were discriminable, allowing for near-perfect individual identification regardless of diagnosis, and equally reliable in both groups. However, contrary to what one might expect, we did not consistently or robustly observe in the ASD group either reductions in similarity to TD functional connectivity (FC) patterns or shared atypical FC patterns. Accordingly, FC-based predictions of diagnosis group achieved accuracy levels around chance. However, using the same approaches to predict scan type (rest vs. video) achieved near-perfect accuracy. Our findings suggest that neither the limitations of resting state as a "task," data resolution, data quantity, or scan duration can be considered solely responsible for failures to differentiate ASD from TD functional connectomes.
Collapse
Affiliation(s)
- Lisa Byrge
- Department of Psychological and Brain SciencesIndiana UniversityBloomingtonIndiana
| | - Daniel P. Kennedy
- Department of Psychological and Brain SciencesIndiana UniversityBloomingtonIndiana
- Cognitive Science ProgramIndiana UniversityBloomingtonIndiana
- Program in NeuroscienceIndiana UniversityBloomingtonIndiana
| |
Collapse
|