1
|
Liu Y, Wang H, Sha G, Cao Y, Chen Y, Chen Y, Zhang J, Chai C, Fan Q, Xia S. The covariant structural and functional neuro-correlates of cognitive impairments in patients with end-stage renal diseases. Front Neurosci 2024; 18:1374948. [PMID: 38686326 PMCID: PMC11056510 DOI: 10.3389/fnins.2024.1374948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 04/03/2024] [Indexed: 05/02/2024] Open
Abstract
Introduction Cognitive impairment (CI) is a common complication of end-stage renal disease (ESRD) that is associated with structural and functional changes in the brain. However, whether a joint structural and functional alteration pattern exists that is related to CI in ESRD is unclear. Methods In this study, instead of looking at brain structure and function separately, we aim to investigate the covariant characteristics of both functional and structural aspects. Specifically, we took the fusion analysis approach, namely, multimodal canonical correlation analysis and joint independent component analysis (mCCA+jICA), to jointly study the discriminative features in gray matter volume (GMV) measured by T1-weighted (T1w) MRI, fractional anisotropy (FA) in white matter measured by diffusion MRI, and the amplitude of low-frequency fluctuation (ALFF) measured by blood oxygenation-level-dependent (BOLD) MRI in 78 ESRD patients versus 64 healthy controls (HCs), followed by a mediation effect analysis to explore the relationship between neuroimaging findings, cognitive impairments and uremic toxins. Results Two joint group-discriminative independent components (ICs) were found to show covariant abnormalities across FA, GMV, and ALFF (all p < 0.05). The most dominant joint IC revealed associative patterns of alterations of GMV (in the precentral gyrus, occipital lobe, temporal lobe, parahippocampal gyrus, and hippocampus), alterations of ALFF (in the precuneus, superior parietal gyrus, and superior occipital gyrus), and of white matter FA (in the corticospinal tract and inferior frontal occipital fasciculus). Another significant IC revealed associative alterations of GMV (in the dorsolateral prefrontal and orbitofrontal cortex) and FA (in the forceps minor). Moreover, the brain changes identified by FA and GMV in the above-mentioned brain regions were found to mediate the negative correlation between serum phosphate and mini-mental state examination (MMSE) scores (all p < 0.05). Conclusion The mCCA+jICA method was demonstrated to be capable of revealing covariant abnormalities across neuronal features of different types in ESRD patients as contrasted to HCs, and joint brain changes may play an important role in mediating the relationship between serum toxins and CIs in ESRD. Our results show the mCCA+jICA fusion analysis approach may provide new insights into similar neurobiological studies.
Collapse
Affiliation(s)
- Yuefan Liu
- Department of Biomedical Engineering, Medical College, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
| | - Huiying Wang
- Department of Radiology, School of Medicine, Tianjin First Central Hospital, Nankai University, Tianjin, China
| | - Guanchen Sha
- Department of Biomedical Engineering, Medical College, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
| | - Yutong Cao
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
- Intelligent Medical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Yongsheng Chen
- Department of Neurology, Wayne State University School of Medicine, Detroit, MI, United States
| | - Yuanyuan Chen
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
- Intelligent Medical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Jingyi Zhang
- Department of Radiology, School of Medicine, Tianjin First Central Hospital, Nankai University, Tianjin, China
| | - Chao Chai
- Department of Radiology, School of Medicine, Tianjin First Central Hospital, Nankai University, Tianjin, China
| | - Qiuyun Fan
- Department of Biomedical Engineering, Medical College, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
- Intelligent Medical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Shuang Xia
- Department of Radiology, School of Medicine, Tianjin First Central Hospital, Nankai University, Tianjin, China
| |
Collapse
|
2
|
Wang Y, Yen PS, Ajilore OA, Bhaumik DK. A novel biomarker selection method using multimodal neuroimaging data. PLoS One 2024; 19:e0289401. [PMID: 38573979 PMCID: PMC10994318 DOI: 10.1371/journal.pone.0289401] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Accepted: 07/18/2023] [Indexed: 04/06/2024] Open
Abstract
Identifying biomarkers is essential to obtain the optimal therapeutic benefit while treating patients with late-life depression (LLD). We compare LLD patients with healthy controls (HC) using resting-state functional magnetic resonance and diffusion tensor imaging data to identify neuroimaging biomarkers that may be potentially associated with the underlying pathophysiology of LLD. We implement a Bayesian multimodal local false discovery rate approach for functional connectivity, borrowing strength from structural connectivity to identify disrupted functional connectivity of LLD compared to HC. In the Bayesian framework, we develop an algorithm to control the overall false discovery rate of our findings. We compare our findings with the literature and show that our approach can better detect some regions never discovered before for LLD patients. The Hub of our discovery related to various neurobehavioral disorders can be used to develop behavioral interventions to treat LLD patients who do not respond to antidepressants.
Collapse
Affiliation(s)
- Yue Wang
- Division of Epidemiology and Biostatistics, University of Illinois at Chicago, Chicago, IL, United States of America
| | - Pei-Shan Yen
- Division of Epidemiology and Biostatistics, University of Illinois at Chicago, Chicago, IL, United States of America
| | - Olusola A. Ajilore
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, United States of America
| | - Dulal K. Bhaumik
- Division of Epidemiology and Biostatistics, University of Illinois at Chicago, Chicago, IL, United States of America
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, United States of America
| |
Collapse
|
3
|
Sui J, Zhi D, Calhoun VD. Data-driven multimodal fusion: approaches and applications in psychiatric research. PSYCHORADIOLOGY 2023; 3:kkad026. [PMID: 38143530 PMCID: PMC10734907 DOI: 10.1093/psyrad/kkad026] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 11/08/2023] [Accepted: 11/21/2023] [Indexed: 12/26/2023]
Abstract
In the era of big data, where vast amounts of information are being generated and collected at an unprecedented rate, there is a pressing demand for innovative data-driven multi-modal fusion methods. These methods aim to integrate diverse neuroimaging perspectives to extract meaningful insights and attain a more comprehensive understanding of complex psychiatric disorders. However, analyzing each modality separately may only reveal partial insights or miss out on important correlations between different types of data. This is where data-driven multi-modal fusion techniques come into play. By combining information from multiple modalities in a synergistic manner, these methods enable us to uncover hidden patterns and relationships that would otherwise remain unnoticed. In this paper, we present an extensive overview of data-driven multimodal fusion approaches with or without prior information, with specific emphasis on canonical correlation analysis and independent component analysis. The applications of such fusion methods are wide-ranging and allow us to incorporate multiple factors such as genetics, environment, cognition, and treatment outcomes across various brain disorders. After summarizing the diverse neuropsychiatric magnetic resonance imaging fusion applications, we further discuss the emerging neuroimaging analyzing trends in big data, such as N-way multimodal fusion, deep learning approaches, and clinical translation. Overall, multimodal fusion emerges as an imperative approach providing valuable insights into the underlying neural basis of mental disorders, which can uncover subtle abnormalities or potential biomarkers that may benefit targeted treatments and personalized medical interventions.
Collapse
Affiliation(s)
- Jing Sui
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Dongmei Zhi
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China
| | - Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia Institute of Technology, Emory University and Georgia State University, Atlanta, GA 30303, United States
| |
Collapse
|
4
|
Wu L, Calhoun V. Joint connectivity matrix independent component analysis: Auto-linking of structural and functional connectivities. Hum Brain Mapp 2023; 44:1533-1547. [PMID: 36420833 PMCID: PMC9921228 DOI: 10.1002/hbm.26155] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Revised: 09/25/2022] [Accepted: 11/04/2022] [Indexed: 11/25/2022] Open
Abstract
The study of human brain connectivity, including structural connectivity (SC) and functional connectivity (FC), provides insights into the neurophysiological mechanism of brain function and its relationship to human behavior and cognition. Both types of connectivity measurements provide crucial yet complementary information. However, integrating these two modalities into a single framework remains a challenge, because of the differences in their quantitative interdependencies as well as their anatomical representations due to distinctive imaging mechanisms. In this study, we introduced a new method, joint connectivity matrix independent component analysis (cmICA), which provides a data-driven parcellation and automated-linking of SC and FC information simultaneously using a joint analysis of functional magnetic resonance imaging (MRI) and diffusion-weighted MRI data. We showed that these two connectivity modalities produce common cortical segregation, though with various degrees of (dis)similarity. Moreover, we show conjoint FC networks and structural white matter tracts that directly link these cortical parcellations/sources, within one analysis. Overall, data-driven joint cmICA provides a new approach for integrating or fusing structural connectivity and FC systematically and conveniently, and provides an effective tool for connectivity-based multimodal data fusion in brain.
Collapse
Affiliation(s)
- Lei Wu
- Tri‐Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS) CenterGeorgia State University, Georgia Institute of Technology, Emory UniversityAtlantaGeorgiaUSA
- Department of Electrical and Computer EngineeringUniversity of New MexicoAlbuquerqueNew MexicoUSA
| | - Vince Calhoun
- Tri‐Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS) CenterGeorgia State University, Georgia Institute of Technology, Emory UniversityAtlantaGeorgiaUSA
- Department of Electrical and Computer EngineeringUniversity of New MexicoAlbuquerqueNew MexicoUSA
| |
Collapse
|
5
|
Lila E, Aston JAD. Functional random effects modeling of brain shape and connectivity. Ann Appl Stat 2022. [DOI: 10.1214/21-aoas1572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Affiliation(s)
- Eardi Lila
- Department of Biostatistics, University of Washington
| | | |
Collapse
|
6
|
Jarret J, Boré A, Bedetti C, Descoteaux M, Brambati SM. A methodological scoping review of the integration of fMRI to guide dMRI tractography. What has been done and what can be improved: A 20-year perspective. J Neurosci Methods 2022; 367:109435. [PMID: 34915047 DOI: 10.1016/j.jneumeth.2021.109435] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 11/30/2021] [Accepted: 12/02/2021] [Indexed: 11/23/2022]
Abstract
Combining MRI modalities is a growing trend in neurosciences. It provides opportunities to investigate the brain architecture supporting cognitive functions. Integrating fMRI activation to guide dMRI tractography offers potential advantages over standard tractography methods. A quick glimpse of the literature on this topic reveals that this technique is challenging, and no consensus or "best practices" currently exist, at least not within a single document. We present the first attempt to systematically analyze and summarize the literature of 80 studies that integrated task-based fMRI results to guide tractography, over the last two decades. We report 19 findings that cover challenges related to sample size, microstructure modelling, seeding methods, multimodal space registration, false negatives/positives, specificity/validity, gray/white matter interface and more. These findings will help the scientific community (1) understand the strengths and limitations of the approaches, (2) design studies using this integrative framework, and (3) motivate researchers to fill the gaps identified. We provide references toward best practices, in order to improve the overall result's replicability, sensitivity, specificity, and validity.
Collapse
Affiliation(s)
- Julien Jarret
- Département de psychologie, Université de Montréal, Montréal, QC, Canada; Centre de Recherche de l'Institut Universitaire de Gériatrie de Montréal (CRIUGM), Montréal, QC, Canada
| | - Arnaud Boré
- Centre de Recherche de l'Institut Universitaire de Gériatrie de Montréal (CRIUGM), Montréal, QC, Canada
| | - Christophe Bedetti
- Centre de Recherche de l'Institut Universitaire de Gériatrie de Montréal (CRIUGM), Montréal, QC, Canada
| | - Maxime Descoteaux
- Sherbrooke Connectivity Imaging Lab (SCIL), Département d'informatique, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Simona Maria Brambati
- Département de psychologie, Université de Montréal, Montréal, QC, Canada; Centre de Recherche de l'Institut Universitaire de Gériatrie de Montréal (CRIUGM), Montréal, QC, Canada; Centre de Recherche du Centre Intégré Universitaire de Santé et de Services Sociaux du Nord-de-l'Île-de-Montréal, Montreal, QC, Canada.
| |
Collapse
|
7
|
Wu B, Pal S, Kang J, Guo Y. Distributional independent component analysis for diverse neuroimaging modalities. Biometrics 2021; 78:1092-1105. [PMID: 34694629 DOI: 10.1111/biom.13594] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2019] [Revised: 03/04/2021] [Accepted: 03/10/2021] [Indexed: 12/13/2022]
Abstract
Recent advances in neuroimaging technologies have provided opportunities to acquire brain images of different modalities for studying human brain organization from both functional and structural perspectives. Analysis of images derived from various modalities involves some common goals such as dimension reduction, denoising, and feature extraction. However, since these modalities have vastly different data characteristics, the current analysis is usually performed using distinct analytical tools that are only suitable for a specific imaging modality. In this paper, we present a Distributional Independent Component Analysis (DICA) that represents a new approach that performs decomposition on the distribution level, providing a unified framework for extracting features across imaging modalities with different scales and representations. When applying DICA to fMRI images, we successfully recover well-established brain functional networks in neuroscience literature, providing empirical validation that DICA delivers neurologically relevant findings. More importantly, we discover several structural network components when applying DICA to DTI images. Through fiber tracking, we find these DICA-derived structural components correspond to several major white fiber bundles. To the best of our knowledge, this is the first time these fiber bundles are successfully identified via blind source separation on single subject DTI images. We also evaluate the performance of DICA as compared with existing ICA methods through extensive simulation studies.
Collapse
Affiliation(s)
- Ben Wu
- Center for Applied Statistics, School of Statistics, Renmin University of China, Beijing, 100872, China
| | - Subhadip Pal
- Department of Biostatistics and Bioinformatics, University of Louisville, Louisville, Kentucky, USA
| | - Jian Kang
- Department of Biostatistics, University of Michigan, Ann Arbor, Michigan, USA
| | - Ying Guo
- Department of Biostatistics and Bioinformatics, Emory University, Atlanta, Georgia, USA
| |
Collapse
|
8
|
Bhaumik D, Jie F, Nordgren R, Bhaumik R, Sinha BK. A Mixed-Effects Model for Detecting Disrupted Connectivities in Heterogeneous Data. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:2381-2389. [PMID: 29994089 DOI: 10.1109/tmi.2018.2821655] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The human brain is an amazingly complex network. Aberrant activities in this network can lead to various neurological disorders such as multiple sclerosis, Parkinson's disease, Alzheimer's disease, and autism. functional magnetic resonance imaging has emerged as an important tool to delineate the neural networks affected by such diseases, particularly autism. In this paper, we propose a special type of mixed-effects model together with an appropriate procedure for controlling false discoveries to detect disrupted connectivities for developing a neural network in whole brain studies. Results are illustrated with a large data set known as autism brain imaging data exchange which includes 361 subjects from eight medical centers.
Collapse
|
9
|
Calamante F, Smith RE, Liang X, Zalesky A, Connelly A. Track-weighted dynamic functional connectivity (TW-dFC): a new method to study time-resolved functional connectivity. Brain Struct Funct 2017; 222:3761-3774. [PMID: 28447220 DOI: 10.1007/s00429-017-1431-1] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2016] [Accepted: 04/24/2017] [Indexed: 12/13/2022]
Abstract
Interest in the study of brain connectivity is growing, particularly in understanding the dynamics of the structural/functional connectivity relation. Structural and functional connectivity are most often analysed independently of each other. Track-weighted functional connectivity (TW-FC) was recently proposed as a means to combine structural/functional connectivity information into a single image. We extend here TW-FC in two important ways: first, all the functional data are used without having to define a prior functional network (cf. TW-FC generates a map for a pre-specified network); second, we incorporate time-resolved connectivity information, thus allowing dynamic characterisation of functional connectivity. We refer to this technique as track-weighted dynamic functional connectivity (TW-dFC), which fuses structural/functional connectivity data into a four-dimensional image, providing a new approach to investigate dynamic connectivity. The structural connectivity information effectively 'constrains' the extremely large number of possible connections in the functional connectivity data (i.e. each voxel's connection to every other voxel), thus providing a way of reducing the problem's dimensionality while still maintaining key data features. The methodology is demonstrated in data from eight healthy subjects, and independent component analysis was subsequently applied to parcellate the corpus callosum, as an illustration of a possible application. TW-dFC maps demonstrate that different white matter pathways can have very different temporal characteristics, corresponding to correlated fluctuations in the grey matter regions they link. A realistic parcellation of the corpus callosum was generated, which was qualitatively similar to topography previously reported. TW-dFC, therefore, provides a complementary new tool to investigate the dynamic nature of brain connectivity.
Collapse
Affiliation(s)
- Fernando Calamante
- Florey Institute of Neuroscience and Mental Health, Melbourne Brain Centre, 245 Burgundy Street, Heidelberg, VIC, 3084, Australia. .,Florey Department of Neuroscience and Mental Health, University of Melbourne, Melbourne, VIC, Australia. .,Department of Medicine, Austin Health and Northern Health, University of Melbourne, Melbourne, VIC, Australia.
| | - Robert E Smith
- Florey Institute of Neuroscience and Mental Health, Melbourne Brain Centre, 245 Burgundy Street, Heidelberg, VIC, 3084, Australia
| | - Xiaoyun Liang
- Florey Institute of Neuroscience and Mental Health, Melbourne Brain Centre, 245 Burgundy Street, Heidelberg, VIC, 3084, Australia
| | - Andrew Zalesky
- Melbourne Neuropsychiatry Centre, University of Melbourne, Melbourne, VIC, Australia.,Department of Electrical and Electronic Engineering, University of Melbourne, Melbourne, VIC, Australia
| | - Alan Connelly
- Florey Institute of Neuroscience and Mental Health, Melbourne Brain Centre, 245 Burgundy Street, Heidelberg, VIC, 3084, Australia.,Florey Department of Neuroscience and Mental Health, University of Melbourne, Melbourne, VIC, Australia.,Department of Medicine, Austin Health and Northern Health, University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
10
|
Wang W, Qian S, Liu K, Li B, Li M, Xin K, Sun G. Reduced white matter integrity and its correlation with clinical symptom in first-episode, treatment-naive generalized anxiety disorder. Behav Brain Res 2016; 314:159-64. [DOI: 10.1016/j.bbr.2016.08.017] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2016] [Revised: 08/05/2016] [Accepted: 08/07/2016] [Indexed: 12/27/2022]
|
11
|
Calhoun VD, Sui J. Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2016; 1:230-244. [PMID: 27347565 PMCID: PMC4917230 DOI: 10.1016/j.bpsc.2015.12.005] [Citation(s) in RCA: 182] [Impact Index Per Article: 20.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness.
Collapse
Affiliation(s)
- Vince D Calhoun
- The Mind Research Network & LBERI, Albuquerque, New Mexico.; Dept. of ECE, University of New Mexico, Albuquerque, New Mexico
| | - Jing Sui
- The Mind Research Network & LBERI, Albuquerque, New Mexico.; Brainnetome Center and National Laboratory of Pattern Recognition, Beijing, China; CAS Center for Excellence in Brain Science, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
12
|
Turner BM, Rodriguez CA, Norcia TM, McClure SM, Steyvers M. Why more is better: Simultaneous modeling of EEG, fMRI, and behavioral data. Neuroimage 2015; 128:96-115. [PMID: 26723544 DOI: 10.1016/j.neuroimage.2015.12.030] [Citation(s) in RCA: 52] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2015] [Revised: 11/13/2015] [Accepted: 12/18/2015] [Indexed: 11/29/2022] Open
Abstract
The need to test a growing number of theories in cognitive science has led to increased interest in inferential methods that integrate multiple data modalities. In this manuscript, we show how a method for integrating three data modalities within a single framework provides (1) more detailed descriptions of cognitive processes and (2) more accurate predictions of unobserved data than less integrative methods. Specifically, we show how combining either EEG and fMRI with a behavioral model can perform substantially better than a behavioral-data-only model in both generative and predictive modeling analyses. We then show how a trivariate model - a model including EEG, fMRI, and behavioral data - outperforms bivariate models in both generative and predictive modeling analyses. Together, these results suggest that within an appropriate modeling framework, more data can be used to better constrain cognitive theory, and to generate more accurate predictions for behavioral and neural data.
Collapse
Affiliation(s)
| | | | | | | | - Mark Steyvers
- Department of Cognitive Science, University of California, Irvine, USA
| |
Collapse
|
13
|
Jing M, McGinnity TM, Coleman S, Fuchs A, Kelso JAS. Temporal Changes of Diffusion Patterns in Mild Traumatic Brain Injury via Group-Based Semi-blind Source Separation. IEEE J Biomed Health Inform 2015; 19:1459-71. [DOI: 10.1109/jbhi.2014.2352119] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
14
|
Craddock RC, Tungaraza RL, Milham MP. Connectomics and new approaches for analyzing human brain functional connectivity. Gigascience 2015; 4:13. [PMID: 25810900 PMCID: PMC4373299 DOI: 10.1186/s13742-015-0045-x] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2014] [Accepted: 01/18/2015] [Indexed: 11/10/2022] Open
Abstract
Estimating the functional interactions between brain regions and mapping those connections to corresponding inter-individual differences in cognitive, behavioral and psychiatric domains are central pursuits for understanding the human connectome. The number and complexity of functional interactions within the connectome and the large amounts of data required to study them position functional connectivity research as a “big data” problem. Maximizing the degree to which knowledge about human brain function can be extracted from the connectome will require developing a new generation of neuroimaging analysis algorithms and tools. This review describes several outstanding problems in brain functional connectomics with the goal of engaging researchers from a broad spectrum of data sciences to help solve these problems. Additionally it provides information about open science resources consisting of raw and preprocessed data to help interested researchers get started.
Collapse
Affiliation(s)
- R Cameron Craddock
- Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Rd, Orangeburg, 10962 New York USA ; Center for the Developing Brain, Child Mind Institute, 445 Park Ave, New York, 10022 New York USA
| | - Rosalia L Tungaraza
- Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Rd, Orangeburg, 10962 New York USA
| | - Michael P Milham
- Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute for Psychiatric Research, 140 Old Orangeburg Rd, Orangeburg, 10962 New York USA ; Center for the Developing Brain, Child Mind Institute, 445 Park Ave, New York, 10022 New York USA
| |
Collapse
|
15
|
Wang Z, Meda SA, Keshavan MS, Tamminga CA, Sweeney JA, Clementz BA, Schretlen DJ, Calhoun VD, Lui S, Pearlson GD. Large-Scale Fusion of Gray Matter and Resting-State Functional MRI Reveals Common and Distinct Biological Markers across the Psychosis Spectrum in the B-SNIP Cohort. Front Psychiatry 2015; 6:174. [PMID: 26732139 PMCID: PMC4685049 DOI: 10.3389/fpsyt.2015.00174] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/19/2015] [Accepted: 11/27/2015] [Indexed: 02/05/2023] Open
Abstract
To investigate whether aberrant interactions between brain structure and function present similarly or differently across probands with psychotic illnesses [schizophrenia (SZ), schizoaffective disorder (SAD), and bipolar I disorder with psychosis (BP)] and whether these deficits are shared with their first-degree non-psychotic relatives. A total of 1199 subjects were assessed, including 220 SZ, 147 SAD, 180 psychotic BP, 150 first-degree relatives of SZ, 126 SAD relatives, 134 BP relatives, and 242 healthy controls (1). All subjects underwent structural MRI (sMRI) and resting-state functional MRI (rs-fMRI) scanning. Joint-independent component analysis (jICA) was used to fuse sMRI gray matter and rs-fMRI amplitude of low-frequency fluctuations data to identify the relationship between the two modalities. jICA revealed two significantly fused components. The association between functional brain alteration in a prefrontal-striatal-thalamic-cerebellar network and structural abnormalities in the default mode network was found to be common across psychotic diagnoses and correlated with cognitive function, social function, and schizo-bipolar scale scores. The fused alteration in the temporal lobe was unique to SZ and SAD. The above effects were not seen in any relative group (including those with cluster-A personality). Using a multivariate-fused approach involving two widely used imaging markers, we demonstrate both shared and distinct biological traits across the psychosis spectrum. Furthermore, our results suggest that the above traits are psychosis biomarkers rather than endophenotypes.
Collapse
Affiliation(s)
- Zheng Wang
- Mental Health Institute of the Second Xiangya Hospital, Central South University , Changsha , China
| | - Shashwath A Meda
- Olin Neuropsychiatry Research Center, Institute of Living at Hartford Hospital , Hartford, CT , USA
| | - Matcheri S Keshavan
- Department of Psychiatry, Beth Israel Deaconess Hospital, Harvard Medical School , Boston, MA , USA
| | - Carol A Tamminga
- Department of Psychiatry, University of Texas Southwestern Medical Center , Dallas, TX , USA
| | - John A Sweeney
- Department of Psychiatry, University of Texas Southwestern Medical Center , Dallas, TX , USA
| | - Brett A Clementz
- Department of Psychology, University of Georgia , Athens, GA , USA
| | - David J Schretlen
- Department of Psychiatry, Johns Hopkins University , Baltimore, MD , USA
| | - Vince D Calhoun
- Department of Psychiatry, Johns Hopkins University, Baltimore, MD, USA; The Mind Research Network, Albuquerque, NM, USA; Department of Psychiatry, Yale University, New Haven, CT, USA
| | - Su Lui
- Department of Radiology, Huaxi MR Research Center, West China Hospital of Sichuan University , Chengdu , China
| | - Godfrey D Pearlson
- Olin Neuropsychiatry Research Center, Institute of Living at Hartford Hospital, Hartford, CT, USA; Department of Psychiatry, Yale University, New Haven, CT, USA
| |
Collapse
|
16
|
Itahashi T, Yamada T, Nakamura M, Watanabe H, Yamagata B, Jimbo D, Shioda S, Kuroda M, Toriizuka K, Kato N, Hashimoto R. Linked alterations in gray and white matter morphology in adults with high-functioning autism spectrum disorder: a multimodal brain imaging study. NEUROIMAGE-CLINICAL 2014; 7:155-69. [PMID: 25610777 PMCID: PMC4299973 DOI: 10.1016/j.nicl.2014.11.019] [Citation(s) in RCA: 61] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2014] [Revised: 11/22/2014] [Accepted: 11/26/2014] [Indexed: 11/17/2022]
Abstract
Growing evidence suggests that a broad range of behavioral anomalies in people with autism spectrum disorder (ASD) can be linked with morphological and functional alterations in the brain. However, the neuroanatomical underpinnings of ASD have been investigated using either structural magnetic resonance imaging (MRI) or diffusion tensor imaging (DTI), and the relationships between abnormalities revealed by these two modalities remain unclear. This study applied a multimodal data-fusion method, known as linked independent component analysis (ICA), to a set of structural MRI and DTI data acquired from 46 adult males with ASD and 46 matched controls in order to elucidate associations between different aspects of atypical neuroanatomy of ASD. Linked ICA identified two composite components that showed significant between-group differences, one of which was significantly correlated with age. In the other component, participants with ASD showed decreased gray matter (GM) volumes in multiple regions, including the bilateral fusiform gyri, bilateral orbitofrontal cortices, and bilateral pre- and post-central gyri. These GM changes were linked with a pattern of decreased fractional anisotropy (FA) in several white matter tracts, such as the bilateral inferior longitudinal fasciculi, bilateral inferior fronto-occipital fasciculi, and bilateral corticospinal tracts. Furthermore, unimodal analysis for DTI data revealed significant reductions of FA along with increased mean diffusivity in those tracts for ASD, providing further evidence of disrupted anatomical connectivity. Taken together, our findings suggest that, in ASD, alterations in different aspects of brain morphology may co-occur in specific brain networks, providing a comprehensive view for understanding the neuroanatomy of this disorder. Structural alterations of gray (GM) and white matter (WM) in ASD were investigated. Linked independent component analysis was used for multimodal data analysis. Alterations of GM and WM in ASD co-occurred in cognitive and affective networks. Results reveal an integrative view of multiple aspects of structural changes in ASD.
Collapse
Affiliation(s)
- Takashi Itahashi
- Department of Pharmacognosy and Phytochemistry, Showa University School of Pharmacy, Tokyo, Japan
- Medical Institute of Developmental Disabilities Research, Showa University, Tokyo, Japan
| | - Takashi Yamada
- Department of Psychiatry, Showa University School of Medicine, Tokyo, Japan
| | - Motoaki Nakamura
- Department of Psychiatry, Showa University School of Medicine, Tokyo, Japan
- Kinko Hospital, Kanagawa Psychiatric Center, Kanagawa, Japan
| | - Hiromi Watanabe
- Department of Psychiatry, Showa University School of Medicine, Tokyo, Japan
| | - Bun Yamagata
- Department of Psychiatry, Showa University School of Medicine, Tokyo, Japan
| | - Daiki Jimbo
- Department of Anatomy, Showa University School of Medicine, Tokyo, Japan
| | - Seiji Shioda
- Department of Anatomy, Showa University School of Medicine, Tokyo, Japan
| | - Miho Kuroda
- Department of Psychiatry, Showa University School of Medicine, Tokyo, Japan
- Child Mental Health-care Center, Fukushima University, Fukushima, Japan
- Department of Child Neuropsychiatry, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Kazuo Toriizuka
- Department of Pharmacognosy and Phytochemistry, Showa University School of Pharmacy, Tokyo, Japan
| | - Nobumasa Kato
- Medical Institute of Developmental Disabilities Research, Showa University, Tokyo, Japan
| | - Ryuichiro Hashimoto
- Medical Institute of Developmental Disabilities Research, Showa University, Tokyo, Japan
- Department of Language Sciences, Graduate School of Humanities, Tokyo Metropolitan University, Tokyo, Japan
- Corresponding author at: Medical Institute of Developmental Disabilities Research, Showa University, 6-11-11, Kita-karasuyama, Setagaya-ku, Tokyo 157-8577, Japan. Tel.: +81 3 5315 9357.
| |
Collapse
|
17
|
Oishi K, Faria AV, Yoshida S, Chang L, Mori S. Reprint of "Quantitative evaluation of brain development using anatomical MRI and diffusion tensor imaging". Int J Dev Neurosci 2014; 32:28-40. [PMID: 24295553 PMCID: PMC4696018 DOI: 10.1016/j.ijdevneu.2013.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2012] [Revised: 05/24/2013] [Accepted: 06/13/2013] [Indexed: 01/18/2023] Open
Abstract
The development of the brain is structure-specific, and the growth rate of each structure differs depending on the age of the subject. Magnetic resonance imaging (MRI) is often used to evaluate brain development because of the high spatial resolution and contrast that enable the observation of structure-specific developmental status. Currently, most clinical MRIs are evaluated qualitatively to assist in the clinical decision-making and diagnosis. The clinical MRI report usually does not provide quantitative values that can be used to monitor developmental status. Recently, the importance of image quantification to detect and evaluate mild-to-moderate anatomical abnormalities has been emphasized because these alterations are possibly related to several psychiatric disorders and learning disabilities. In the research arena, structural MRI and diffusion tensor imaging (DTI) have been widely applied to quantify brain development of the pediatric population. To interpret the values from these MR modalities, a "growth percentile chart," which describes the mean and standard deviation of the normal developmental curve for each anatomical structure, is required. Although efforts have been made to create such a growth percentile chart based on MRI and DTI, one of the greatest challenges is to standardize the anatomical boundaries of the measured anatomical structures. To avoid inter- and intra-reader variability about the anatomical boundary definition, and hence, to increase the precision of quantitative measurements, an automated structure parcellation method, customized for the neonatal and pediatric population, has been developed. This method enables quantification of multiple MR modalities using a common analytic framework. In this paper, the attempt to create an MRI- and a DTI-based growth percentile chart, followed by an application to investigate developmental abnormalities related to cerebral palsy, Williams syndrome, and Rett syndrome, have been introduced. Future directions include multimodal image analysis and personalization for clinical application.
Collapse
Affiliation(s)
- Kenichi Oishi
- The Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| | - Andreia V Faria
- The Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Shoko Yoshida
- The Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Linda Chang
- Neuroscience and Magnetic Resonance Research Program, John A. Burns School of Medicine, University of Hawaii at Manoa, Honolulu, HI, USA
| | - Susumu Mori
- The Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD, USA; F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
| |
Collapse
|
18
|
Oishi K, Faria AV, Yoshida S, Chang L, Mori S. Quantitative evaluation of brain development using anatomical MRI and diffusion tensor imaging. Int J Dev Neurosci 2013; 31:512-24. [PMID: 23796902 PMCID: PMC3830705 DOI: 10.1016/j.ijdevneu.2013.06.004] [Citation(s) in RCA: 66] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2012] [Revised: 05/24/2013] [Accepted: 06/13/2013] [Indexed: 01/18/2023] Open
Abstract
The development of the brain is structure-specific, and the growth rate of each structure differs depending on the age of the subject. Magnetic resonance imaging (MRI) is often used to evaluate brain development because of the high spatial resolution and contrast that enable the observation of structure-specific developmental status. Currently, most clinical MRIs are evaluated qualitatively to assist in the clinical decision-making and diagnosis. The clinical MRI report usually does not provide quantitative values that can be used to monitor developmental status. Recently, the importance of image quantification to detect and evaluate mild-to-moderate anatomical abnormalities has been emphasized because these alterations are possibly related to several psychiatric disorders and learning disabilities. In the research arena, structural MRI and diffusion tensor imaging (DTI) have been widely applied to quantify brain development of the pediatric population. To interpret the values from these MR modalities, a "growth percentile chart," which describes the mean and standard deviation of the normal developmental curve for each anatomical structure, is required. Although efforts have been made to create such a growth percentile chart based on MRI and DTI, one of the greatest challenges is to standardize the anatomical boundaries of the measured anatomical structures. To avoid inter- and intra-reader variability about the anatomical boundary definition, and hence, to increase the precision of quantitative measurements, an automated structure parcellation method, customized for the neonatal and pediatric population, has been developed. This method enables quantification of multiple MR modalities using a common analytic framework. In this paper, the attempt to create an MRI- and a DTI-based growth percentile chart, followed by an application to investigate developmental abnormalities related to cerebral palsy, Williams syndrome, and Rett syndrome, have been introduced. Future directions include multimodal image analysis and personalization for clinical application.
Collapse
Affiliation(s)
- Kenichi Oishi
- The Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| | | | | | | | | |
Collapse
|
19
|
Sui J, Huster R, Yu Q, Segall JM, Calhoun VD. Function-structure associations of the brain: evidence from multimodal connectivity and covariance studies. Neuroimage 2013; 102 Pt 1:11-23. [PMID: 24084066 DOI: 10.1016/j.neuroimage.2013.09.044] [Citation(s) in RCA: 115] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2013] [Revised: 09/18/2013] [Accepted: 09/20/2013] [Indexed: 12/13/2022] Open
Abstract
Despite significant advances in multimodal imaging techniques and analysis approaches, unimodal studies are still the predominant way to investigate brain changes or group differences, including structural magnetic resonance imaging (sMRI), functional MRI (fMRI), diffusion tensor imaging (DTI) and electroencephalography (EEG). Multimodal brain studies can be used to understand the complex interplay of anatomical, functional and physiological brain alterations or development, and to better comprehend the biological significance of multiple imaging measures. To examine the function-structure associations of the brain in a more comprehensive and integrated manner, we reviewed a number of multimodal studies that combined two or more functional (fMRI and/or EEG) and structural (sMRI and/or DTI) modalities. In this review paper, we specifically focused on multimodal neuroimaging studies on cognition, aging, disease and behavior. We also compared multiple analysis approaches, including univariate and multivariate methods. The possible strengths and limitations of each method are highlighted, which can guide readers when selecting a method based on a given research question. In particular, we believe that multimodal fusion approaches will shed further light on the neuronal mechanisms underlying the major structural and functional pathophysiological features of both the healthy brain (e.g. development) or the diseased brain (e.g. mental illness) and, in the latter case, may provide a more sensitive measure than unimodal imaging for disease classification, e.g. multimodal biomarkers, which potentially can be used to support clinical diagnosis based on neuroimaging techniques.
Collapse
Affiliation(s)
- Jing Sui
- The Mind Research Network, Albuquerque, NM 87106, USA; Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
| | - Rene Huster
- Experimental Psychology Lab, Carl von Ossietzky University, Oldenburg, Germany
| | - Qingbao Yu
- The Mind Research Network, Albuquerque, NM 87106, USA
| | | | - Vince D Calhoun
- The Mind Research Network, Albuquerque, NM 87106, USA; Dept. of ECE, University of New Mexico, Albuquerque, NM 87131, USA.
| |
Collapse
|
20
|
Douglas PK, Lau E, Anderson A, Head A, Kerr W, Wollner M, Moyer D, Li W, Durnhofer M, Bramen J, Cohen MS. Single trial decoding of belief decision making from EEG and fMRI data using independent components features. Front Hum Neurosci 2013; 7:392. [PMID: 23914164 PMCID: PMC3728485 DOI: 10.3389/fnhum.2013.00392] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2012] [Accepted: 07/04/2013] [Indexed: 12/14/2022] Open
Abstract
The complex task of assessing the veracity of a statement is thought to activate uniquely distributed brain regions based on whether a subject believes or disbelieves a given assertion. In the current work, we present parallel machine learning methods for predicting a subject's decision response to a given propositional statement based on independent component (IC) features derived from EEG and fMRI data. Our results demonstrate that IC features outperformed features derived from event related spectral perturbations derived from any single spectral band, yet were similar to accuracy across all spectral bands combined. We compared our diagnostic IC spatial maps with our conventional general linear model (GLM) results, and found that informative ICs had significant spatial overlap with our GLM results, yet also revealed unique regions like amygdala that were not statistically significant in GLM analyses. Overall, these results suggest that ICs may yield a parsimonious feature set that can be used along with a decision tree structure for interpretation of features used in classifying complex cognitive processes such as belief and disbelief across both fMRI and EEG neuroimaging modalities.
Collapse
Affiliation(s)
- Pamela K. Douglas
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
| | - Edward Lau
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
| | - Ariana Anderson
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
- Department of Neurology, University of California, Los AngelesLos Angeles, CA, USA
| | - Austin Head
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
| | - Wesley Kerr
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
| | - Margalit Wollner
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
| | - Daniel Moyer
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
| | - Wei Li
- Interdepartmental Program in Neuroscience, University of California, Los AngelesLos Angeles, CA, USA
| | - Mike Durnhofer
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
| | - Jennifer Bramen
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
| | - Mark S. Cohen
- LINT Laboratory, University of California, Los AngelesLos Angeles, CA, USA
- California Nanosystems Institute, University of California, Los AngelesLos Angeles, CA, USA
| |
Collapse
|
21
|
Luo L, Xu L, Jung R, Pearlson G, Adali T, Calhoun VD. Constrained source-based morphometry identifies structural networks associated with default mode network. Brain Connect 2012; 2:33-43. [PMID: 22468608 DOI: 10.1089/brain.2011.0026] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
We present constrained source-based morphometry (SBM), a multivariate semiblind data-driven approach, to explore a possible brain-wide structural network in both gray matter (GM) and white matter (WM) associated with the functional default mode network (DMN). With this approach, we utilize seed regions associated with the DMN as constraints on GM maps and derive a joint GM and WM structural network automatically through a multivariate data-driven approach. In this article, we first provide a simulation to validate the constrained SBM approach. The approach was then applied to structural magnetic resonance imaging and diffusion tensor imaging data obtained from 102 healthy controls. Regions that have consistently reported to be associated with the DMN were used to create an a priori mask that was integrated within an independent component analysis framework to derive the structural network associated with the DMN. We identified a set of GM and corresponding WM regions contributing to a structural network underlying the functional DMN. The GM regions consisted mainly of the precuneus, superior and medial frontal gyri, middle temporal gyrus, hippocampus, cuneus, and cerebellum. The WM regions included the cingulum, corpus callosum, corona radiata, association fibers, and middle cerebellar peduncle. Significant gender differences in the relationship between intelligence quotient (IQ) and the identified structural network were observed. Our findings suggest that the functional DMN is underpinned by a corresponding brain-wide structural network. The constrained SBM approach is additionally applicable to a wide variety of problems identifying structural networks from seed regions.
Collapse
Affiliation(s)
- Li Luo
- The Mind Research Network, Albuquerque, New Mexico 87106, USA
| | | | | | | | | | | |
Collapse
|
22
|
Mijović B, Vanderperren K, Novitskiy N, Vanrumste B, Stiers P, Van den Bergh B, Lagae L, Sunaert S, Wagemans J, Van Huffel S, De Vos M. The “why” and “how” of JointICA: Results from a visual detection task. Neuroimage 2012; 60:1171-85. [DOI: 10.1016/j.neuroimage.2012.01.063] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2011] [Revised: 12/14/2011] [Accepted: 01/08/2012] [Indexed: 11/30/2022] Open
|
23
|
Sui J, Yu Q, He H, Pearlson GD, Calhoun VD. A selective review of multimodal fusion methods in schizophrenia. Front Hum Neurosci 2012; 6:27. [PMID: 22375114 PMCID: PMC3285795 DOI: 10.3389/fnhum.2012.00027] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2011] [Accepted: 02/08/2012] [Indexed: 12/29/2022] Open
Abstract
Schizophrenia (SZ) is one of the most cryptic and costly mental disorders in terms of human suffering and societal expenditure (van Os and Kapur, 2009). Though strong evidence for functional, structural, and genetic abnormalities associated with this disease exists, there is yet no replicable finding which has proven accurate enough to be useful in clinical decision making (Fornito et al., 2009), and its diagnosis relies primarily upon symptom assessment (Williams et al., 2010a). It is likely in part that the lack of consistent neuroimaging findings is because most models favor only one data type or do not combine data from different imaging modalities effectively, thus missing potentially important differences which are only partially detected by each modality (Calhoun et al., 2006a). It is becoming increasingly clear that multimodal fusion, a technique which takes advantage of the fact that each modality provides a limited view of the brain/gene and may uncover hidden relationships, is an important tool to help unravel the black box of schizophrenia. In this review paper, we survey a number of multimodal fusion applications which enable us to study the schizophrenia macro-connectome, including brain functional, structural, and genetic aspects and may help us understand the disorder in a more comprehensive and integrated manner. We also provide a table that characterizes these applications by the methods used and compare these methods in detail, especially for multivariate models, which may serve as a valuable reference that helps readers select an appropriate method based on a given research question.
Collapse
Affiliation(s)
- Jing Sui
- The Mind Research NetworkAlbuquerque, NM, USA
| | - Qingbao Yu
- The Mind Research NetworkAlbuquerque, NM, USA
| | - Hao He
- The Mind Research NetworkAlbuquerque, NM, USA
- Department of Electrical and Computer Engineering, University of New MexicoAlbuquerque, NM, USA
| | - Godfrey D. Pearlson
- Olin Neuropsychiatry Research CenterHartford, CT, USA
- Department of Psychiatry, Yale UniversityNew Haven, CT, USA
- Department of Neurobiology, Yale UniversityNew Haven, CT, USA
| | - Vince D. Calhoun
- The Mind Research NetworkAlbuquerque, NM, USA
- Department of Electrical and Computer Engineering, University of New MexicoAlbuquerque, NM, USA
- Olin Neuropsychiatry Research CenterHartford, CT, USA
| |
Collapse
|
24
|
Sui J, Adali T, Yu Q, Chen J, Calhoun VD. A review of multivariate methods for multimodal fusion of brain imaging data. J Neurosci Methods 2011; 204:68-81. [PMID: 22108139 DOI: 10.1016/j.jneumeth.2011.10.031] [Citation(s) in RCA: 221] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2011] [Revised: 10/24/2011] [Accepted: 10/26/2011] [Indexed: 01/29/2023]
Abstract
The development of various neuroimaging techniques is rapidly improving the measurements of brain function/structure. However, despite improvements in individual modalities, it is becoming increasingly clear that the most effective research approaches will utilize multi-modal fusion, which takes advantage of the fact that each modality provides a limited view of the brain. The goal of multi-modal fusion is to capitalize on the strength of each modality in a joint analysis, rather than a separate analysis of each. This is a more complicated endeavor that must be approached more carefully and efficient methods should be developed to draw generalized and valid conclusions from high dimensional data with a limited number of subjects. Numerous research efforts have been reported in the field based on various statistical approaches, e.g. independent component analysis (ICA), canonical correlation analysis (CCA) and partial least squares (PLS). In this review paper, we survey a number of multivariate methods appearing in previous multimodal fusion reports, mostly fMRI with other modality, which were performed with or without prior information. A table for comparing optimization assumptions, purpose of the analysis, the need of priors, dimension reduction strategies and input data types is provided, which may serve as a valuable reference that helps readers understand the trade-offs of the 7 methods comprehensively. Finally, we evaluate 3 representative methods via simulation and give some suggestions on how to select an appropriate method based on a given research.
Collapse
Affiliation(s)
- Jing Sui
- The Mind Research Network, Albuquerque, NM 87106, USA.
| | - Tülay Adali
- Dept. of CSEE, University of Maryland, Baltimore County, Baltimore, MD 21250, USA
| | - Qingbao Yu
- The Mind Research Network, Albuquerque, NM 87106, USA
| | - Jiayu Chen
- The Mind Research Network, Albuquerque, NM 87106, USA; Dept. of ECE, University of New Mexico, Albuquerque, NM 87131, USA
| | - Vince D Calhoun
- The Mind Research Network, Albuquerque, NM 87106, USA; Dept. of ECE, University of New Mexico, Albuquerque, NM 87131, USA; Dept. of Psychiatry, Yale University, New Haven, CT 06519, USA
| |
Collapse
|
25
|
Jing M, McGinnity TM, Coleman S, Zhang H, Fuchs A, Kelso JAS. Enhancement of fiber orientation distribution reconstruction in diffusion-weighted imaging by single channel blind source separation. IEEE Trans Biomed Eng 2011; 59:363-73. [PMID: 22020665 DOI: 10.1109/tbme.2011.2172793] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
In diffusion-weighted imaging (DWI), reliable fiber tracking results rely on the accurate reconstruction of the fiber orientation distribution function (fODF) in each individual voxel. For high angular resolution diffusion imaging (HARDI), deconvolution-based approaches can reconstruct the complex fODF and have advantages in terms of computational efficiency and no need to estimate the number of distinct fiber populations. However, HARDI-based methods usually require relatively high b-values and a large number of gradient directions to produce good results. Such requirements are not always easy to meet in common clinical studies due to limitations in MRI facilities. Moreover, most of these approaches are sensitive to noise. In this study, we propose a new framework to enhance the performance of the spherical deconvolution (SD) approach in low angular resolution DWI by employing a single channel blind source separation (BSS) technique to decompose the fODF initially estimated by SD such that the desired fODF can be extracted from the noisy background. The results based on numerical simulations and two phantom datasets demonstrate that the proposed method achieves better performance than SD in terms of robustness to noise and variation in b-values. In addition, the results show that the proposed method has the potential to be applied to low angular resolution DWI which is commonly used in clinical studies.
Collapse
Affiliation(s)
- Min Jing
- Intelligent Systems Research Centre, School of Computing and Intelligent Systems, University of Ulster, BT48 7JL UK.
| | | | | | | | | | | |
Collapse
|
26
|
Discriminating schizophrenia and bipolar disorder by fusing fMRI and DTI in a multimodal CCA+ joint ICA model. Neuroimage 2011; 57:839-55. [PMID: 21640835 DOI: 10.1016/j.neuroimage.2011.05.055] [Citation(s) in RCA: 171] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2011] [Revised: 04/26/2011] [Accepted: 05/17/2011] [Indexed: 11/22/2022] Open
Abstract
Diverse structural and functional brain alterations have been identified in both schizophrenia and bipolar disorder, but with variable replicability, significant overlap and often in limited number of subjects. In this paper, we aimed to clarify differences between bipolar disorder and schizophrenia by combining fMRI (collected during an auditory oddball task) and diffusion tensor imaging (DTI) data. We proposed a fusion method, "multimodal CCA+ joint ICA", which increases flexibility in statistical assumptions beyond existing approaches and can achieve higher estimation accuracy. The data collected from 164 participants (62 healthy controls, 54 schizophrenia and 48 bipolar) were extracted into "features" (contrast maps for fMRI and fractional anisotropy (FA) for DTI) and analyzed in multiple facets to investigate the group differences for each pair-wised groups and each modality. Specifically, both patient groups shared significant dysfunction in dorsolateral prefrontal cortex and thalamus, as well as reduced white matter (WM) integrity in anterior thalamic radiation and uncinate fasciculus. Schizophrenia and bipolar subjects were separated by functional differences in medial frontal and visual cortex, as well as WM tracts associated with occipital and frontal lobes. Both patients and controls showed similar spatial distributions in motor and parietal regions, but exhibited significant variations in temporal lobe. Furthermore, there were different group trends for age effects on loading parameters in motor cortex and multiple WM regions, suggesting that brain dysfunction and WM disruptions occurred in identified regions for both disorders. Most importantly, we can visualize an underlying function-structure network by evaluating the joint components with strong links between DTI and fMRI. Our findings suggest that although the two patient groups showed several distinct brain patterns from each other and healthy controls, they also shared common abnormalities in prefrontal thalamic WM integrity and in frontal brain mechanisms.
Collapse
|
27
|
Li YO, Yang FG, Nguyen CT, Cooper SR, LaHue SC, Venugopal S, Mukherjee P. Independent component analysis of DTI reveals multivariate microstructural correlations of white matter in the human brain. Hum Brain Mapp 2011; 33:1431-51. [PMID: 21567660 DOI: 10.1002/hbm.21292] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2010] [Revised: 02/08/2011] [Accepted: 02/09/2011] [Indexed: 11/07/2022] Open
Abstract
It has recently been demonstrated that specific patterns of correlation exist in diffusion tensor imaging (DTI) parameters across white matter tracts in the normal human brain. These microstructural correlations are thought to reflect phylogenetic and functional similarities between different axonal fiber pathways. However, this earlier work was limited in three major respects: (1) the analysis was restricted to only a dozen selected tracts; (2) the DTI measurements were averaged across whole tracts, whereas metrics such as fractional anisotropy (FA) are known to vary considerably within single tracts; and (3) a univariate measure of correlation was used. In this investigation, we perform an automated multivariate whole-brain voxel-based study of white matter FA correlations using independent component analysis (ICA) of tract-based spatial statistics computed from 3T DTI in 53 healthy adult volunteers. The resulting spatial maps of the independent components show voxels for which the FA values within each map co-vary across individuals. The strongest FA correlations were found in anatomically recognizable tracts and tract segments, either singly or in homologous pairs. Hence, ICA of DTI provides an automated unsupervised decomposition of the normal human brain into multiple separable microstructurally correlated white matter regions, many of which correspond to anatomically familiar classes of white matter pathways. Further research is needed to determine whether whole-brain ICA of DTI represents a novel alternative to tractography for feature extraction in studying the normal microstructure of human white matter as well as the abnormal white matter microstructure found in neurological and psychiatric disorders.
Collapse
Affiliation(s)
- Yi-Ou Li
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, California 94107-0946, USA
| | | | | | | | | | | | | |
Collapse
|
28
|
Mayer AR, Mannell MV, Ling J, Gasparovic C, Yeo RA. Functional connectivity in mild traumatic brain injury. Hum Brain Mapp 2011; 32:1825-35. [PMID: 21259381 DOI: 10.1002/hbm.21151] [Citation(s) in RCA: 360] [Impact Index Per Article: 25.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2010] [Revised: 07/13/2010] [Accepted: 07/29/2010] [Indexed: 01/28/2023] Open
Abstract
OBJECTIVES Research suggests that the majority of mild traumatic brain injury (mTBI) patients exhibit both cognitive and emotional dysfunction within the first weeks of injury, followed by symptom resolution 3-6 months postinjury. The neuronal correlates of said dysfunction are difficult to detect with standard clinical neuroimaging, complicating differential diagnosis and early identification of patients who may not recover. This study examined whether resting state functional magnetic resonance imaging (fMRI) provides objective markers of injury and predicts cognitive, emotional, and somatic complaints in mTBI patients semiacutely (<3 weeks postinjury) and in late recovery (3-5 month) phases. METHODS Twenty-seven semiacute mTBI patients and 26 gender, age, and education-matched controls were studied. Fifteen of 27 patients returned for a follow-up visit 3-5 months postinjury. The main dependent variables were spontaneous fluctuations (temporal correlation) in the default-mode (DMN) and fronto-parietal task-related networks as measured by fMRI. RESULTS Significant differences in self-reported cognitive, emotional, and somatic complaints were observed (all P < 0.05), despite normal clinical (T1 and T2) imaging and neuropsychological testing results. Mild TBI patients demonstrated decreased functional connectivity within the DMN and hyper-connectivity between the DMN and lateral prefrontal cortex. Measures of functional connectivity exhibited high levels of sensitivity and specificity for patient classification and predicted cognitive complaints in the semi-acute injury stage. However, no changes in functional connectivity were observed across a 4-month recovery period. CONCLUSIONS Abnormal connectivity between the DMN and frontal cortex may provide objective biomarkers of mTBI and underlie cognitive impairment.
Collapse
Affiliation(s)
- Andrew R Mayer
- The Mind Research Network, Albuquerque, New Mexico 87106, USA.
| | | | | | | | | |
Collapse
|
29
|
Meda SA, Jagannathan K, Gelernter J, Calhoun VD, Liu J, Stevens MC, Pearlson GD. A pilot multivariate parallel ICA study to investigate differential linkage between neural networks and genetic profiles in schizophrenia. Neuroimage 2010; 53:1007-15. [PMID: 19944766 PMCID: PMC3968678 DOI: 10.1016/j.neuroimage.2009.11.052] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2009] [Revised: 10/29/2009] [Accepted: 11/19/2009] [Indexed: 11/28/2022] Open
Abstract
Understanding genetic influences on both healthy and disordered brain function is a major focus in psychiatric neuroimaging. We utilized task-related imaging findings from an fMRI auditory oddball task known to be robustly associated with abnormal activation in schizophrenia, to investigate genomic factors derived from multiple single nucleotide polymorphisms (SNPs) from genes previously shown to be associated with schizophrenia. Our major aim was to investigate the relationship of these genomic factors to normal/abnormal brain functionality between controls and schizophrenia patients. We studied a Caucasian-only sample of 35 healthy controls and 31 schizophrenia patients. All subjects performed an auditory oddball task, which consists of detecting an infrequent sound within a series of frequent sounds. Each subject was characterized on 24 different SNP markers spanning multiple risk genes previously associated with schizophrenia. We used a recently developed technique named parallel independent component analysis (para-ICA) to analyze this multimodal data set (Liu et al., 2008). The method aims to identify simultaneously independent components of each modality (functional imaging, genetics) and the relationships between them. We detected three fMRI components significantly correlated with two distinct gene components. The fMRI components, along with their significant genetic profile (dominant SNP) correlations were as follows: (1) Inferior frontal-anterior/posterior cingulate-thalamus-caudate with SNPs from Brain derived neurotropic factor (BDNF) and dopamine transporter (DAT) [r=-0.51; p<0.0001], (2) superior/middle temporal gyrus-cingulate-premotor with SLC6A4_PR and SLC6A4_PR_AG (serotonin transporter promoter; 5HTTLPR) [r=0.27; p=0.03], and (3) default mode-fronto-temporal gyrus with Brain derived neurotropic factor and dopamine transporter (BDNF, DAT) [r=-0.25; p=0.04]. Functional components comprised task-relevant regions (including PFC, ACC, STG and MTG) frequently identified as abnormal in schizophrenia. Further, gene-fMRI combinations 1 (Z=1.75; p=0.03), 2 (Z=1.84; p=0.03) and 3 (Z=1.67; p=0.04) listed above showed significant differences between controls and patients, based on their correlated loading coefficients. We demonstrate a framework to identify interactions between "clusters" of brain function and of genetic information. Our results reveal the effect/influence of specific interactions, (perhaps epistastatic in nature), between schizophrenia risk genes on imaging endophenotypes representing attention/working memory and goal directed related brain function, thus establishing a useful methodology to probe multivariate genotype-phenotype relationships.
Collapse
Affiliation(s)
- Shashwath A Meda
- Olin Neuropsychiatry Research Center, Institute of Living, 200 Retreat Avenue, Hartford, CT 06106, USA.
| | | | | | | | | | | | | |
Collapse
|
30
|
Jing M, McGinnity TM, Coleman S, Zhang H. Incorporating independent component analysis to Q-ball imaging for diffusion orientation distribution reconstruction. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2010; 2010:2706-2709. [PMID: 21096204 DOI: 10.1109/iembs.2010.5626529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
In this paper, we investigate the incorporation of independent component analysis (ICA) with Q-ball imaging (QBI) to extract information on the diffusion orientation distribution function (ODF) from an inner voxel. In our approach, the ICA algorithm is applied to a mixture of ODFs which are constructed based on the analytical QBI solution. The numerical simulation results demonstrate that the proposed ICA framework can not only successfully separate the diffusion ODF from the noisy diffusion data, but also achieves better performance compared with a QBI solution when the data has a low signal to noise ratio (SNR).
Collapse
Affiliation(s)
- M Jing
- Intelligent Systems Research Centre, School of Computing and Intelligent Systems, University of Ulster, Magee Campus, UK.
| | | | | | | |
Collapse
|
31
|
Age-related cognitive gains are mediated by the effects of white matter development on brain network integration. Neuroimage 2009; 48:738-46. [PMID: 19577651 DOI: 10.1016/j.neuroimage.2009.06.065] [Citation(s) in RCA: 52] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2008] [Revised: 04/24/2009] [Accepted: 06/25/2009] [Indexed: 11/23/2022] Open
Abstract
A fundamental, yet rarely tested premise of developmental cognitive neuroscience is that changes in brain activity and improvements in behavioral control across adolescent development are related to brain maturational factors that shape a more efficient, highly-interconnected brain in adulthood. We present the first multimodal neuroimaging study to empirically demonstrate that maturation of executive cognitive ability is directly associated with the relationship of white matter development and age-related changes in neural network functional integration. In this study, we identified specific white matter regions whose maturation across adolescence appears to reduce reliance on local processing in brain regions recruited for conscious, deliberate cognitive control in favor of a more widely distributed profile of functionally-integrated brain activity. Greater white matter coherence with age was associated with both increases and decreases in functional connectivity within task-engaged functional circuits. Importantly, these associations between white matter development and brain system functional integration were related to behavioral performance on tests of response inhibition, demonstrating their importance in the maturation of optimal cognitive control.
Collapse
|