1
|
Ruiz S, Lee S, Dalboni da Rocha JL, Ramos-Murguialday A, Pasqualotto E, Soares E, García E, Fetz E, Birbaumer N, Sitaram R. Motor Intentions Decoded from fMRI Signals. Brain Sci 2024; 14:643. [PMID: 39061384 PMCID: PMC11274965 DOI: 10.3390/brainsci14070643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Revised: 06/05/2024] [Accepted: 06/13/2024] [Indexed: 07/28/2024] Open
Abstract
Motor intention is a high-level brain function related to planning for movement. Although studies have shown that motor intentions can be decoded from brain signals before movement execution, it is unclear whether intentions relating to mental imagery of movement can be decoded. Here, we investigated whether differences in spatial and temporal patterns of brain activation were elicited by intentions to perform different types of motor imagery and whether the patterns could be used by a multivariate pattern classifier to detect such differential intentions. The results showed that it is possible to decode intentions before the onset of different types of motor imagery from functional MR signals obtained from fronto-parietal brain regions, such as the premotor cortex and posterior parietal cortex, while controlling for eye movements and for muscular activity of the hands. These results highlight the critical role played by the aforementioned brain regions in covert motor intentions. Moreover, they have substantial implications for rehabilitating patients with motor disabilities.
Collapse
Affiliation(s)
- Sergio Ruiz
- Psychiatry Department, Interventional Psychiatric Unit, Interdisciplinary Center for Neurosciences, Medicine School, Pontificia Universidad Católica de Chile, Santiago 8320165, Chile;
- Laboratory for Brain—Machine Interfaces and Neuromodulation, Pontificia Universidad Católica de Chile, Santiago 8320165, Chile
| | | | | | - Ander Ramos-Murguialday
- Institute of Medical and Behavioral Neurobiology, University of Tubingen, 72076 Tübingen, Germany;
- TECNALIA Basque Research and Technology Alliance (BRTA), 20009 San Sebastian, Spain
- Department of Neurology & Stroke, University of Tubingen, 72074 Tübingen, Germany
- Athenea Neuroclinics, 20014 San Sebastian, Spain
| | | | - Ernesto Soares
- Coimbra Institute for Biomedical Imaging and Translational Research (CIBIT), University of Coimbra, 3000-548 Coimbra, Portugal;
| | | | - Eberhard Fetz
- Departments of Physiology and Biophysics and DXARTS, Washington National Primate Research Center, University of Washington, Seattle, WA 98195, USA;
| | - Niels Birbaumer
- Dipartimento di Neuroscienze (DNS), Universita degli Studi di Padova, 35131 Padova, Italy;
| | - Ranganatha Sitaram
- Psychiatry Department, Interventional Psychiatric Unit, Interdisciplinary Center for Neurosciences, Medicine School, Pontificia Universidad Católica de Chile, Santiago 8320165, Chile;
- Laboratory for Brain—Machine Interfaces and Neuromodulation, Pontificia Universidad Católica de Chile, Santiago 8320165, Chile
- Institute of Medical and Behavioral Neurobiology, University of Tubingen, 72076 Tübingen, Germany;
| |
Collapse
|
2
|
Wu H, Wang R, Ma Y, Liang X, Liu C, Yu D, An N, Ning X. Decoding N400m Evoked Component: A Tutorial on Multivariate Pattern Analysis for OP-MEG Data. Bioengineering (Basel) 2024; 11:609. [PMID: 38927845 PMCID: PMC11200846 DOI: 10.3390/bioengineering11060609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2024] [Revised: 05/26/2024] [Accepted: 06/11/2024] [Indexed: 06/28/2024] Open
Abstract
Multivariate pattern analysis (MVPA) has played an extensive role in interpreting brain activity, which has been applied in studies with modalities such as functional Magnetic Resonance Imaging (fMRI), Magnetoencephalography (MEG) and Electroencephalography (EEG). The advent of wearable MEG systems based on optically pumped magnetometers (OPMs), i.e., OP-MEG, has broadened the application of bio-magnetism in the realm of neuroscience. Nonetheless, it also raises challenges in temporal decoding analysis due to the unique attributes of OP-MEG itself. The efficacy of decoding performance utilizing multimodal fusion, such as MEG-EEG, also remains to be elucidated. In this regard, we investigated the impact of several factors, such as processing methods, models and modalities, on the decoding outcomes of OP-MEG. Our findings indicate that the number of averaged trials, dimensionality reduction (DR) methods, and the number of cross-validation folds significantly affect the decoding performance of OP-MEG data. Additionally, decoding results vary across modalities and fusion strategy. In contrast, decoder type, resampling frequency, and sliding window length exert marginal effects. Furthermore, we introduced mutual information (MI) to investigate how information loss due to OP-MEG data processing affect decoding accuracy. Our study offers insights for linear decoding research using OP-MEG and expand its application in the fields of cognitive neuroscience.
Collapse
Affiliation(s)
- Huanqi Wu
- Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 37 Xueyuan Rd., Haidian Dist., Beijing 100083, China; (H.W.); (R.W.); (Y.M.); (X.L.); (C.L.)
- Hangzhou Institute of National Extremely-Weak Magnetic Field Infrastructure, 465 Binan Rd., Binjiang Dist., Hangzhou 310000, China
| | - Ruonan Wang
- Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 37 Xueyuan Rd., Haidian Dist., Beijing 100083, China; (H.W.); (R.W.); (Y.M.); (X.L.); (C.L.)
- Hangzhou Institute of National Extremely-Weak Magnetic Field Infrastructure, 465 Binan Rd., Binjiang Dist., Hangzhou 310000, China
| | - Yuyu Ma
- Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 37 Xueyuan Rd., Haidian Dist., Beijing 100083, China; (H.W.); (R.W.); (Y.M.); (X.L.); (C.L.)
- Hangzhou Institute of National Extremely-Weak Magnetic Field Infrastructure, 465 Binan Rd., Binjiang Dist., Hangzhou 310000, China
| | - Xiaoyu Liang
- Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 37 Xueyuan Rd., Haidian Dist., Beijing 100083, China; (H.W.); (R.W.); (Y.M.); (X.L.); (C.L.)
- Hangzhou Institute of National Extremely-Weak Magnetic Field Infrastructure, 465 Binan Rd., Binjiang Dist., Hangzhou 310000, China
| | - Changzeng Liu
- Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 37 Xueyuan Rd., Haidian Dist., Beijing 100083, China; (H.W.); (R.W.); (Y.M.); (X.L.); (C.L.)
- Hangzhou Institute of National Extremely-Weak Magnetic Field Infrastructure, 465 Binan Rd., Binjiang Dist., Hangzhou 310000, China
| | - Dexin Yu
- Shandong Key Laboratory for Magnetic Field-Free Medicine and Functional Imaging, Institute of Magnetic Field-Free Medicine and Functional Imaging, Shandong University, 27 South Shanda Rd., Licheng Dist., Jinan 250100, China;
| | - Nan An
- Hangzhou Institute of National Extremely-Weak Magnetic Field Infrastructure, 465 Binan Rd., Binjiang Dist., Hangzhou 310000, China
| | - Xiaolin Ning
- Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 37 Xueyuan Rd., Haidian Dist., Beijing 100083, China; (H.W.); (R.W.); (Y.M.); (X.L.); (C.L.)
- Hangzhou Institute of National Extremely-Weak Magnetic Field Infrastructure, 465 Binan Rd., Binjiang Dist., Hangzhou 310000, China
- Shandong Key Laboratory for Magnetic Field-Free Medicine and Functional Imaging, Institute of Magnetic Field-Free Medicine and Functional Imaging, Shandong University, 27 South Shanda Rd., Licheng Dist., Jinan 250100, China;
- Hefei National Laboratory, Gaoxin Dist., Hefei 230093, China
| |
Collapse
|
3
|
Wu M, Wang Y, Zhao X, Xin T, Wu K, Liu H, Wu S, Liu M, Chai X, Li J, Wei C, Zhu C, Liu Y, Zhang YX. Anti-phasic oscillatory development for speech and noise processing in cochlear implanted toddlers. Child Dev 2024. [PMID: 38742715 DOI: 10.1111/cdev.14105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
Human brain demonstrates amazing readiness for speech and language learning at birth, but the auditory development preceding such readiness remains unknown. Cochlear implanted (CI) children (n = 67; mean age 2.77 year ± 1.31 SD; 28 females) with prelingual deafness provide a unique opportunity to study this stage. Using functional near-infrared spectroscopy, it was revealed that the brain of CI children was irresponsive to sounds at CI hearing onset. With increasing CI experiences up to 32 months, the brain demonstrated function, region and hemisphere specific development. Most strikingly, the left anterior temporal lobe showed an oscillatory trajectory, changing in opposite phases for speech and noise. The study provides the first longitudinal brain imaging evidence for early auditory development preceding speech acquisition.
Collapse
Affiliation(s)
- Meiyun Wu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Yuyang Wang
- Department of Otolaryngology Head and Neck Surgery, Beijing Friendship Hospital, Capital Medical University, Beijing, China
- Department of Otolaryngology Head and Neck Surgery, Hunan Provincial People's Hospital (First Affiliated Hospital of Hunan Normal University), Changsha, China
| | - Xue Zhao
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Tianyu Xin
- Department of Otolaryngology Head and Neck Surgery, Peking University First Hospital, Beijing, China
| | - Kun Wu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Haotian Liu
- Department of Otolaryngology Head and Neck Surgery, Beijing Friendship Hospital, Capital Medical University, Beijing, China
- Department of Otolaryngology Head and Neck Surgery, West China Hospital of Sichuan University, Chengdu, China
| | - Shinan Wu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Min Liu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Xiaoke Chai
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Jinhong Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Chaogang Wei
- Department of Otolaryngology Head and Neck Surgery, Peking University First Hospital, Beijing, China
| | - Chaozhe Zhu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Yuhe Liu
- Department of Otolaryngology Head and Neck Surgery, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Yu-Xuan Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| |
Collapse
|
4
|
Thiebes JJ, Grumstrup EM. Quantifying noise effects in optical measures of excited state transport. J Chem Phys 2024; 160:124201. [PMID: 38516971 DOI: 10.1063/5.0190347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Accepted: 03/03/2024] [Indexed: 03/23/2024] Open
Abstract
Time-resolved microscopy is a widely used approach for imaging and quantifying charge and energy transport in functional materials. While it is generally recognized that resolving small diffusion lengths is limited by measurement noise, the impacts of noise have not been systematically assessed or quantified. This article reports modeling efforts to elucidate the impact of noise on optical probes of transport. Excited state population distributions, modeled as Gaussians with additive white noise typical of experimental conditions, are subject to decay and diffusive evolution. Using a conventional composite least-squares fitting algorithm, the resulting diffusion constant estimates are compared with the model input parameter. The results show that heteroscedasticity (i.e., time-varying noise levels), insufficient spatial and/or temporal resolution, and small diffusion lengths relative to the magnitude of noise lead to a surprising degree of imprecision under moderate experimental parameters. Moreover, the compounding influence of low initial contrast and small diffusion length leads to systematic overestimation of diffusion coefficients. Each of these issues is quantitatively analyzed herein, and experimental approaches to mitigate them are proposed. General guidelines for experimentalists to rapidly assess measurement precision are provided, as is an open-source tool for customizable evaluation of noise effects on time-resolved microscopy transport measurements.
Collapse
Affiliation(s)
- Joseph J Thiebes
- Department of Chemistry and Biochemistry, Montana State University, Bozeman, Montana 59717, USA
| | - Erik M Grumstrup
- Department of Chemistry and Biochemistry, Montana State University, Bozeman, Montana 59717, USA
- Montana Materials Science Program, Montana State University, Bozeman, Montana 59717, USA
| |
Collapse
|
5
|
Zhang Y, Gao Y, Xu J, Zhao G, Shi L, Kong L. Unsupervised Joint Domain Adaptation for Decoding Brain Cognitive States From tfMRI Images. IEEE J Biomed Health Inform 2024; 28:1494-1503. [PMID: 38157464 DOI: 10.1109/jbhi.2023.3348130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2024]
Abstract
Recent advances in large model and neuroscience have enabled exploration of the mechanism of brain activity by using neuroimaging data. Brain decoding is one of the most promising researches to further understand the human cognitive function. However, current methods excessively depends on high-quality labeled data, which brings enormous expense of collection and annotation of neural images by experts. Besides, the performance of cross-individual decoding suffers from inconsistency in data distribution caused by individual variation and different collection equipments. To address mentioned above issues, a Join Domain Adapative Decoding (JDAD) framework is proposed for unsupervised decoding specific brain cognitive state related to behavioral task. Based on the volumetric feature extraction from task-based functional Magnetic Resonance Imaging (tfMRI) data, a novel objective loss function is designed by the combination of joint distribution regularizer, which aims to restrict the distance of both the conditional and marginal probability distribution of labeled and unlabeled samples. Experimental results on the public Human Connectome Project (HCP) S1200 dataset show that JDAD achieves superior performance than other prevalent methods, especially for fine-grained task with 11.5%-21.6% improvements of decoding accuracy. The learned 3D features are visualized by Grad-CAM to build a combination with brain functional regions, which provides a novel path to learn the function of brain cortex regions related to specific cognitive task in group level.
Collapse
|
6
|
Shrivastava M, Ye L. Neuroimaging and artificial intelligence for assessment of chronic painful temporomandibular disorders-a comprehensive review. Int J Oral Sci 2023; 15:58. [PMID: 38155153 PMCID: PMC10754947 DOI: 10.1038/s41368-023-00254-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 10/19/2023] [Accepted: 10/20/2023] [Indexed: 12/30/2023] Open
Abstract
Chronic Painful Temporomandibular Disorders (TMD) are challenging to diagnose and manage due to their complexity and lack of understanding of brain mechanism. In the past few decades' neural mechanisms of pain regulation and perception have been clarified by neuroimaging research. Advances in the neuroimaging have bridged the gap between brain activity and the subjective experience of pain. Neuroimaging has also made strides toward separating the neural mechanisms underlying the chronic painful TMD. Recently, Artificial Intelligence (AI) is transforming various sectors by automating tasks that previously required humans' intelligence to complete. AI has started to contribute to the recognition, assessment, and understanding of painful TMD. The application of AI and neuroimaging in understanding the pathophysiology and diagnosis of chronic painful TMD are still in its early stages. The objective of the present review is to identify the contemporary neuroimaging approaches such as structural, functional, and molecular techniques that have been used to investigate the brain of chronic painful TMD individuals. Furthermore, this review guides practitioners on relevant aspects of AI and how AI and neuroimaging methods can revolutionize our understanding on the mechanisms of painful TMD and aid in both diagnosis and management to enhance patient outcomes.
Collapse
Affiliation(s)
- Mayank Shrivastava
- Adams School of Dentistry, University of North Carolina, Chapel Hill, NC, USA
| | - Liang Ye
- Department of Rehabilitation Medicine, University of Minnesota Medical School, Minneapolis, MN, USA.
| |
Collapse
|
7
|
Chen Y, Zhao W, Yi S, Liu J. The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis. Front Neurosci 2023; 17:1174080. [PMID: 37811326 PMCID: PMC10559726 DOI: 10.3389/fnins.2023.1174080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 08/11/2023] [Indexed: 10/10/2023] Open
Abstract
Objective Machine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-analysis to evaluate the diagnostic performance of ML based on rs-fMRI data for MDD. Methods English databases were searched for relevant studies. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) was used to assess the methodological quality of the included studies. A random-effects meta-analytic model was implemented to investigate the diagnostic efficiency, including sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Regression meta-analysis and subgroup analysis were performed to investigate the cause of heterogeneity. Results Thirty-one studies were included in this meta-analysis. The pooled sensitivity, specificity, DOR, and AUC with 95% confidence intervals were 0.80 (0.75, 0.83), 0.83 (0.74, 0.82), 14.00 (9, 22.00), and 0.86 (0.83, 0.89), respectively. Substantial heterogeneity was observed among the studies included. The meta-regression showed that the leave-one-out cross-validation (loocv) (sensitivity: p < 0.01, specificity: p < 0.001), graph theory (sensitivity: p < 0.05, specificity: p < 0.01), n > 100 (sensitivity: p < 0.001, specificity: p < 0.001), simens equipment (sensitivity: p < 0.01, specificity: p < 0.001), 3.0T field strength (Sensitivity: p < 0.001, specificity: p = 0.04), and Beck Depression Inventory (BDI) (sensitivity: p = 0.04, specificity: p = 0.06) might be the sources of heterogeneity. Furthermore, the subgroup analysis showed that the sample size (n > 100: sensitivity: 0.71, specificity: 0.72, n < 100: sensitivity: 0.81, specificity: 0.79), the different levels of disease evaluated by the Hamilton Depression Rating Scale (HDRS/HAMD) (mild vs. moderate vs. severe: sensitivity: 0.52 vs. 0.86 vs. 0.89, specificity: 0.62 vs. 0.78 vs. 0.82, respectively), the depression scales in patients with comparable levels of severity. (BDI vs. HDRS/HAMD: sensitivity: 0.86 vs. 0.87, specificity: 0.78 vs. 0.80, respectively), and the features (graph vs. functional connectivity: sensitivity: 0.84 vs. 0.86, specificity: 0.76 vs. 0.78, respectively) selected might be the causes of heterogeneity. Conclusion ML showed high accuracy for the automatic diagnosis of MDD. Future studies are warranted to promote the potential use of these classification algorithms in clinical settings.
Collapse
Affiliation(s)
- Yanjing Chen
- Department of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, China
| | - Wei Zhao
- Department of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, China
- Clinical Research Center for Medical Imaging in Hunan Province, Changsha, Hunan, China
| | - Sijie Yi
- Department of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, China
| | - Jun Liu
- Department of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, China
- Clinical Research Center for Medical Imaging in Hunan Province, Changsha, Hunan, China
| |
Collapse
|
8
|
Chen J, Golomb JD. Dynamic neural reconstructions of attended object location and features using EEG. J Neurophysiol 2023; 130:139-154. [PMID: 37283457 PMCID: PMC10393364 DOI: 10.1152/jn.00180.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Revised: 05/10/2023] [Accepted: 06/02/2023] [Indexed: 06/08/2023] Open
Abstract
Attention allows us to select relevant and ignore irrelevant information from our complex environments. What happens when attention shifts from one item to another? To answer this question, it is critical to have tools that accurately recover neural representations of both feature and location information with high temporal resolution. In the present study, we used human electroencephalography (EEG) and machine learning to explore how neural representations of object features and locations update across dynamic shifts of attention. We demonstrate that EEG can be used to create simultaneous time courses of neural representations of attended features (time point-by-time point inverted encoding model reconstructions) and attended location (time point-by-time point decoding) during both stable periods and across dynamic shifts of attention. Each trial presented two oriented gratings that flickered at the same frequency but had different orientations; participants were cued to attend one of them and on half of trials received a shift cue midtrial. We trained models on a stable period from Hold attention trials and then reconstructed/decoded the attended orientation/location at each time point on Shift attention trials. Our results showed that both feature reconstruction and location decoding dynamically track the shift of attention and that there may be time points during the shifting of attention when 1) feature and location representations become uncoupled and 2) both the previously attended and currently attended orientations are represented with roughly equal strength. The results offer insight into our understanding of attentional shifts, and the noninvasive techniques developed in the present study lend themselves well to a wide variety of future applications.NEW & NOTEWORTHY We used human EEG and machine learning to reconstruct neural response profiles during dynamic shifts of attention. Specifically, we demonstrated that we could simultaneously read out both location and feature information from an attended item in a multistimulus display. Moreover, we examined how that readout evolves over time during the dynamic process of attentional shifts. These results provide insight into our understanding of attention, and this technique carries substantial potential for versatile extensions and applications.
Collapse
Affiliation(s)
- Jiageng Chen
- Department of Psychology, The Ohio State University, Columbus, Ohio, United States
| | - Julie D Golomb
- Department of Psychology, The Ohio State University, Columbus, Ohio, United States
| |
Collapse
|
9
|
Bedel HA, Sivgin I, Dalmaz O, Dar SUH, Çukur T. BolT: Fused window transformers for fMRI time series analysis. Med Image Anal 2023; 88:102841. [PMID: 37224718 DOI: 10.1016/j.media.2023.102841] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 02/07/2023] [Accepted: 05/10/2023] [Indexed: 05/26/2023]
Abstract
Deep-learning models have enabled performance leaps in analysis of high-dimensional functional MRI (fMRI) data. Yet, many previous methods are suboptimally sensitive for contextual representations across diverse time scales. Here, we present BolT, a blood-oxygen-level-dependent transformer model, for analyzing multi-variate fMRI time series. BolT leverages a cascade of transformer encoders equipped with a novel fused window attention mechanism. Encoding is performed on temporally-overlapped windows within the time series to capture local representations. To integrate information temporally, cross-window attention is computed between base tokens in each window and fringe tokens from neighboring windows. To gradually transition from local to global representations, the extent of window overlap and thereby number of fringe tokens are progressively increased across the cascade. Finally, a novel cross-window regularization is employed to align high-level classification features across the time series. Comprehensive experiments on large-scale public datasets demonstrate the superior performance of BolT against state-of-the-art methods. Furthermore, explanatory analyses to identify landmark time points and regions that contribute most significantly to model decisions corroborate prominent neuroscientific findings in the literature.
Collapse
Affiliation(s)
- Hasan A Bedel
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Irmak Sivgin
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Onat Dalmaz
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Salman U H Dar
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Tolga Çukur
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey; Neuroscience Program, Bilkent University, Ankara 06800, Turkey.
| |
Collapse
|
10
|
Meng X, Iraji A, Fu Z, Kochunov P, Belger A, Ford JM, McEwen S, Mathalon DH, Mueller BA, Pearlson G, Potkin SG, Preda A, Turner J, van Erp TGM, Sui J, Calhoun VD. Multi-model order spatially constrained ICA reveals highly replicable group differences and consistent predictive results from resting data: A large N fMRI schizophrenia study. Neuroimage Clin 2023; 38:103434. [PMID: 37209635 PMCID: PMC10209454 DOI: 10.1016/j.nicl.2023.103434] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 05/10/2023] [Accepted: 05/12/2023] [Indexed: 05/22/2023]
Abstract
Brain functional networks identified from resting functional magnetic resonance imaging (fMRI) data have the potential to reveal biomarkers for brain disorders, but studies of complex mental illnesses such as schizophrenia (SZ) often yield mixed results across replication studies. This is likely due in part to the complexity of the disorder, the short data acquisition time, and the limited ability of the approaches for brain imaging data mining. Therefore, the use of analytic approaches which can both capture individual variability while offering comparability across analyses is highly preferred. Fully blind data-driven approaches such as independent component analysis (ICA) are hard to compare across studies, and approaches that use fixed atlas-based regions can have limited sensitivity to individual sensitivity. By contrast, spatially constrained ICA (scICA) provides a hybrid, fully automated solution that can incorporate spatial network priors while also adapting to new subjects. However, scICA has thus far only been used with a single spatial scale (ICA dimensionality, i.e., ICA model order). In this work, we present an approach using multi-objective optimization scICA with reference algorithm (MOO-ICAR) to extract subject-specific intrinsic connectivity networks (ICNs) from fMRI data at multiple spatial scales, which also enables us to study interactions across spatial scales. We evaluate this approach using a large N (N > 1,600) study of schizophrenia divided into separate validation and replication sets. A multi-scale ICN template was estimated and labeled, then used as input into scICA which was computed on an individual subject level. We then performed a subsequent analysis of multiscale functional network connectivity (msFNC) to evaluate the patient data, including group differences and classification. Results showed highly consistent group differences in msFNC in regions including cerebellum, thalamus, and motor/auditory networks. Importantly, multiple msFNC pairs linking different spatial scales were implicated. The classification model built on the msFNC features obtained up to 85% F1 score, 83% precision, and 88% recall, indicating the strength of the proposed framework in detecting group differences between schizophrenia and the control group. Finally, we evaluated the relationship of the identified patterns to positive symptoms and found consistent results across datasets. The results verified the robustness of our framework in evaluating brain functional connectivity of schizophrenia at multiple spatial scales, implicated consistent and replicable brain networks, and highlighted a promising approach for leveraging resting fMRI data for brain biomarker development.
Collapse
Affiliation(s)
- Xing Meng
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, GA, USA
| | - Armin Iraji
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, GA, USA
| | - Zening Fu
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, GA, USA
| | - Peter Kochunov
- Maryland Psychiatric Research Center, Department of Psychiatry, School of Medicine, University of Maryland, Baltimore, MD, USA
| | - Aysenil Belger
- Department of Psychiatry, University of North Carolina, Chapel Hill, NC, USA
| | - Judy M Ford
- Department of Psychiatry, University of California San Francisco, San Francisco, CA, USA; San Francisco VA Medical Center, San Francisco, CA, USA
| | - Sara McEwen
- Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, USA
| | - Daniel H Mathalon
- Department of Psychiatry, University of California San Francisco, San Francisco, CA, USA; San Francisco VA Medical Center, San Francisco, CA, USA
| | - Bryon A Mueller
- Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA
| | - Godfrey Pearlson
- Departments of Psychiatry and Neuroscience, Yale University, School of Medicine, New Haven, CT, USA
| | - Steven G Potkin
- Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, CA, USA
| | - Adrian Preda
- Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, CA, USA
| | - Jessica Turner
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, GA, USA; Department of Psychology, Georgia State University, Atlanta, GA, USA
| | - Theo G M van Erp
- Clinical Translational Neuroscience Laboratory, Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, CA, USA
| | - Jing Sui
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, GA, USA; Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Vince D Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, GA, USA; Department of Psychology, Georgia State University, Atlanta, GA, USA.
| |
Collapse
|
11
|
Luthra S, Magnuson JS, Myers EB. Right Posterior Temporal Cortex Supports Integration of Phonetic and Talker Information. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:145-177. [PMID: 37229142 PMCID: PMC10205075 DOI: 10.1162/nol_a_00091] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/04/2022] [Accepted: 11/08/2022] [Indexed: 05/27/2023]
Abstract
Though the right hemisphere has been implicated in talker processing, it is thought to play a minimal role in phonetic processing, at least relative to the left hemisphere. Recent evidence suggests that the right posterior temporal cortex may support learning of phonetic variation associated with a specific talker. In the current study, listeners heard a male talker and a female talker, one of whom produced an ambiguous fricative in /s/-biased lexical contexts (e.g., epi?ode) and one who produced it in /∫/-biased contexts (e.g., friend?ip). Listeners in a behavioral experiment (Experiment 1) showed evidence of lexically guided perceptual learning, categorizing ambiguous fricatives in line with their previous experience. Listeners in an fMRI experiment (Experiment 2) showed differential phonetic categorization as a function of talker, allowing for an investigation of the neural basis of talker-specific phonetic processing, though they did not exhibit perceptual learning (likely due to characteristics of our in-scanner headphones). Searchlight analyses revealed that the patterns of activation in the right superior temporal sulcus (STS) contained information about who was talking and what phoneme they produced. We take this as evidence that talker information and phonetic information are integrated in the right STS. Functional connectivity analyses suggested that the process of conditioning phonetic identity on talker information depends on the coordinated activity of a left-lateralized phonetic processing system and a right-lateralized talker processing system. Overall, these results clarify the mechanisms through which the right hemisphere supports talker-specific phonetic processing.
Collapse
Affiliation(s)
- Sahil Luthra
- Department of Psychological Sciences, University of Connecticut, Storrs, CT, USA
| | - James S. Magnuson
- Department of Psychological Sciences, University of Connecticut, Storrs, CT, USA
- Basque Center on Cognition Brain and Language (BCBL), Donostia-San Sebastián, Spain
- Ikerbasque, Basque Foundation for Science, Bilbao, Spain
| | - Emily B. Myers
- Department of Psychological Sciences, University of Connecticut, Storrs, CT, USA
- Speech, Language, and Hearing Sciences, University of Connecticut, Storrs, CT, USA
| |
Collapse
|
12
|
Bahrami M, Laurienti PJ, Shappell HM, Simpson SL. Brain Network Analysis: A Review on Multivariate Analytical Methods. Brain Connect 2023; 13:64-79. [PMID: 36006366 PMCID: PMC10024592 DOI: 10.1089/brain.2022.0007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Despite the explosive growth of neuroimaging studies aimed at analyzing the brain as a complex system, critical methodological gaps remain to be addressed. Most tools currently used for analyzing network data of the brain are univariate in nature and are based on assumptions borne out of previous techniques not directly related to the big and complex data of the brain. Although graph-based methods have shown great promise, the development of principled multivariate models to address inherent limitations of graph-based methods, such as their dependence on network size and degree distributions, and to allow assessing the effects of multiple phenotypes on the brain and simulating brain networks has largely lagged behind. Although some studies have been made in developing multivariate frameworks to fill this gap, in the absence of a "gold-standard" method or guidelines, choosing the most appropriate method for each study can be another critical challenge for investigators in this multidisciplinary field. Here, we briefly introduce important multivariate methods for brain network analyses in two main categories: data-driven and model-based methods. We discuss whether/how such methods are suited for examining connectivity (edge-level), topology (system-level), or both. This review will aid in choosing an appropriate multivariate method with respect to variables such as network type, number of subjects and brain regions included, and the interest in connectivity, topology, or both. This review is aimed to be accessible to investigators from different backgrounds, with a focus on applications in brain network studies, though the methods may be applicable in other areas too. Impact statement As the U.S. National Institute of Health notes, the rich biomedical data can greatly improve our knowledge of human health if new analytical tools are developed, and their applications are broadly disseminated. A major challenge in analyzing the brain as a complex system is about developing parsimonious multivariate methods, and particularly choosing the most appropriate one among the existing methods with respect to the study variables in this multidisciplinary field. This study provides a review on the most important multivariate methods to aid in helping the most appropriate ones with respect to the desired variables for each study.
Collapse
Affiliation(s)
- Mohsen Bahrami
- Laboratory for Complex Brain Networks, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
- Department of Radiology and Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Paul J. Laurienti
- Laboratory for Complex Brain Networks, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
- Department of Radiology and Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Heather M. Shappell
- Laboratory for Complex Brain Networks, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
- Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Sean L. Simpson
- Laboratory for Complex Brain Networks, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
- Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| |
Collapse
|
13
|
Stehr DA, Garcia JO, Pyles JA, Grossman ED. Optimizing multivariate pattern classification in rapid event-related designs. J Neurosci Methods 2023; 387:109808. [PMID: 36738848 DOI: 10.1016/j.jneumeth.2023.109808] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 12/28/2022] [Accepted: 01/29/2023] [Indexed: 02/05/2023]
Abstract
BACKGROUND Multivariate pattern analysis (MVPA or pattern decoding) has attracted considerable attention as a sensitive analytic tool for investigations using functional magnetic resonance imaging (fMRI) data. With the introduction of MVPA, however, has come a proliferation of methodological choices confronting the researcher, with few studies to date offering guidance from the vantage point of controlled datasets detached from specific experimental hypotheses. NEW METHOD We investigated the impact of four data processing steps on support vector machine (SVM) classification performance aimed at maximizing information capture in the presence of common noise sources. The four techniques included: trial averaging (classifying on separate trial estimates versus condition-based averages), within-run mean centering (centering the data or not), method of cost selection (using a fixed or tuned cost value), and motion-related denoising approach (comparing no denoising versus a variety of nuisance regressions capturing motion-related reference signals). The impact of these approaches was evaluated on real fMRI data from two control ROIs, as well as on simulated pattern data constructed with carefully controlled voxel- and trial-level noise components. RESULTS We find significant improvements in classification performance across both real and simulated datasets with run-wise trial averaging and mean centering. When averaging trials within conditions of each run, we note a simultaneous increase in the between-subject variability of SVM classification accuracies which we attribute to the reduced size of the test set used to assess the classifier's prediction error. Therefore, we propose a hybrid technique whereby randomly sampled subsets of trials are averaged per run and demonstrate that it helps mitigate the tradeoff between improving signal-to-noise ratio by averaging and losing exemplars in the test set. COMPARISON WITH EXISTING METHODS Though a handful of empirical studies have employed run-based trial averaging, mean centering, or their combination, such studies have done so without theoretical justification or rigorous testing using control ROIs. CONCLUSIONS Therefore, we intend this study to serve as a practical guide for researchers wishing to optimize pattern decoding without risk of introducing spurious results.
Collapse
Affiliation(s)
- Daniel A Stehr
- University of California, Irvine, United States of America.
| | - Javier O Garcia
- US DEVCOM Army Research Laboratory, United States of America
| | - John A Pyles
- University of Washington, Seattle, Washington, United States of America
| | | |
Collapse
|
14
|
Mattioni S, Rezk M, Battal C, Vadlamudi J, Collignon O. Impact of blindness onset on the representation of sound categories in occipital and temporal cortices. eLife 2022; 11:79370. [PMID: 36070354 PMCID: PMC9451537 DOI: 10.7554/elife.79370] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 08/15/2022] [Indexed: 11/30/2022] Open
Abstract
The ventral occipito-temporal cortex (VOTC) reliably encodes auditory categories in people born blind using a representational structure partially similar to the one found in vision (Mattioni et al.,2020). Here, using a combination of uni- and multivoxel analyses applied to fMRI data, we extend our previous findings, comprehensively investigating how early and late acquired blindness impact on the cortical regions coding for the deprived and the remaining senses. First, we show enhanced univariate response to sounds in part of the occipital cortex of both blind groups that is concomitant to reduced auditory responses in temporal regions. We then reveal that the representation of the sound categories in the occipital and temporal regions is more similar in blind subjects compared to sighted subjects. What could drive this enhanced similarity? The multivoxel encoding of the ‘human voice’ category that we observed in the temporal cortex of all sighted and blind groups is enhanced in occipital regions in blind groups , suggesting that the representation of vocal information is more similar between the occipital and temporal regions in blind compared to sighted individuals. We additionally show that blindness does not affect the encoding of the acoustic properties of our sounds (e.g. pitch, harmonicity) in occipital and in temporal regions but instead selectively alter the categorical coding of the voice category itself. These results suggest a functionally congruent interplay between the reorganization of occipital and temporal regions following visual deprivation, across the lifespan.
Collapse
Affiliation(s)
- Stefania Mattioni
- Institute for research in Psychology (IPSY) & Neuroscience (IoNS), Louvain Bionics, Crossmodal Perception and Plasticity Laboratory - University of Louvain (UCLouvain), Louvain-la-Neuve, Belgium.,Department of Brain and Cognition, KU Leuven, Leuven, Belgium
| | - Mohamed Rezk
- Institute for research in Psychology (IPSY) & Neuroscience (IoNS), Louvain Bionics, Crossmodal Perception and Plasticity Laboratory - University of Louvain (UCLouvain), Louvain-la-Neuve, Belgium
| | - Ceren Battal
- Institute for research in Psychology (IPSY) & Neuroscience (IoNS), Louvain Bionics, Crossmodal Perception and Plasticity Laboratory - University of Louvain (UCLouvain), Louvain-la-Neuve, Belgium
| | - Jyothirmayi Vadlamudi
- Institute for research in Psychology (IPSY) & Neuroscience (IoNS), Louvain Bionics, Crossmodal Perception and Plasticity Laboratory - University of Louvain (UCLouvain), Louvain-la-Neuve, Belgium
| | - Olivier Collignon
- Institute for research in Psychology (IPSY) & Neuroscience (IoNS), Louvain Bionics, Crossmodal Perception and Plasticity Laboratory - University of Louvain (UCLouvain), Louvain-la-Neuve, Belgium.,Center for Mind/Brain Studies, University of Trento, Trento, Italy.,School of Health Sciences, HES-SO Valais-Wallis, Sion, Switzerland.,The Sense Innovation and Research Center, Lausanne and Sion, Sion, Switzerland
| |
Collapse
|
15
|
Meng X, Iraji A, Fu Z, Kochunov P, Belger A, Ford J, McEwen S, Mathalon DH, Mueller BA, Pearlson G, Potkin SG, Preda A, Turner J, van Erp T, Sui J, Calhoun VD. Multimodel Order Independent Component Analysis: A Data-Driven Method for Evaluating Brain Functional Network Connectivity Within and Between Multiple Spatial Scales. Brain Connect 2022; 12:617-628. [PMID: 34541879 PMCID: PMC9529308 DOI: 10.1089/brain.2021.0079] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Background: While functional connectivity is widely studied, there has been little work studying functional connectivity at different spatial scales. Likewise, the relationship of functional connectivity between spatial scales is unknown. Methods: We proposed an independent component analysis (ICA)-based approach to capture information at multiple-model orders (component numbers), and to evaluate functional network connectivity (FNC) both within and between model orders. We evaluated the approach by studying group differences in the context of a study of resting-state functional magnetic resonance imaging (rsfMRI) data collected from schizophrenia (SZ) individuals and healthy controls (HC). The predictive ability of FNC at multiple spatial scales was assessed using support vector machine-based classification. Results: In addition to consistent predictive patterns at both multiple-model orders and single-model orders, unique predictive information was seen at multiple-model orders and in the interaction between model orders. We observed that the FNC between model orders 25 and 50 maintained the highest predictive information between HC and SZ. Results highlighted the predictive ability of the somatomotor and visual domains both within and between model orders compared with other functional domains. Also, subcortical-somatomotor, temporal-somatomotor, and temporal-subcortical FNCs had relatively high weights in predicting SZ. Conclusions: In sum, multimodel order ICA provides a more comprehensive way to study FNC, produces meaningful and interesting results, which are applicable to future studies. We shared the spatial templates from this work at different model orders to provide a reference for the community, which can be leveraged in regression-based or fully automated (spatially constrained) ICA approaches. Impact statement Multimodel order independent component analysis (ICA) provides a comprehensive way to study brain functional network connectivity within and between multiple spatial scales, highlighting findings that would have been ignored in single-model order analysis. This work expands upon and adds to the relatively new literature on resting functional magnetic resonance imaging-based classification and prediction. Results highlighted the differentiating power of specific intrinsic connectivity networks on classifying brain disorders of schizophrenia patients and healthy participants, at different spatial scales. The spatial templates from this work provide a reference for the community, which can be leveraged in regression-based or fully automated ICA approaches.
Collapse
Affiliation(s)
- Xing Meng
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, Georgia, USA
| | - Armin Iraji
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, Georgia, USA
| | - Zening Fu
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, Georgia, USA
| | - Peter Kochunov
- Maryland Psychiatric Research Center, Department of Psychiatry, School of Medicine, University of Maryland, Baltimore, Maryland, USA
| | - Aysenil Belger
- Department of Psychiatry, University of North Carolina, Chapel Hill, North Carolina, USA
| | - Judith Ford
- Department of Psychiatry, University of California San Francisco, San Francisco, California, USA
- San Francisco VA Medical Center, San Francisco, California, USA
| | - Sara McEwen
- Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, California, USA
| | - Daniel H. Mathalon
- Department of Psychiatry, University of California San Francisco, San Francisco, California, USA
- San Francisco VA Medical Center, San Francisco, California, USA
| | - Bryon A. Mueller
- Department of Psychiatry, University of Minnesota, Minneapolis, Minnesota, USA
| | - Godfrey Pearlson
- Department of Psychiatry and Neuroscience, Yale University, School of Medicine, New Haven, Connecticut, USA
| | - Steven G. Potkin
- Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, California, USA
| | - Adrian Preda
- Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, California, USA
| | - Jessica Turner
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, Georgia, USA
- Department of Psychology, Georgia State University, Atlanta, Georgia, USA
| | - Theo van Erp
- Clinical Translational Neuroscience Laboratory, Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, California, USA
| | - Jing Sui
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, Georgia, USA
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Vince D. Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory University, Atlanta, Georgia, USA
- Department of Psychology, Georgia State University, Atlanta, Georgia, USA
| |
Collapse
|
16
|
Chang DHF, Thinnes D, Au PY, Maziero D, Stenger VA, Sinnett S, Vibell J. Sound-modulations of visual motion perception implicate the cortico-vestibular brain. Neuroimage 2022; 257:119285. [PMID: 35537600 DOI: 10.1016/j.neuroimage.2022.119285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 04/20/2022] [Accepted: 05/05/2022] [Indexed: 11/19/2022] Open
Abstract
A widely used example of the intricate (yet poorly understood) intertwining of multisensory signals in the brain is the audiovisual bounce inducing effect (ABE). This effect presents two identical objects moving along the azimuth with uniform motion and towards opposite directions. The perceptual interpretation of the motion is ambiguous and is modulated if a transient (sound) is presented in coincidence with the point of overlap of the two objects' motion trajectories. This phenomenon has long been written-off to simple attentional or decision-making mechanisms, although the neurological underpinnings for the effect are not well understood. Using behavioural metrics concurrently with event-related fMRI, we show that sound-induced modulations of motion perception can be further modulated by changing motion dynamics of the visual targets. The phenomenon engages the posterior parietal cortex and the parieto-insular-vestibular cortical complex, with a close correspondence of activity in these regions with behaviour. These findings suggest that the insular cortex is engaged in deriving a probabilistic perceptual solution through the integration of multisensory data.
Collapse
Affiliation(s)
- Dorita H F Chang
- Department of Psychology and The State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong.
| | - David Thinnes
- Department of Psychology, University of Hawai'i at Mānoa, Hawaii, USA; Faculty of Medicine, Systems Neuroscience & Neurotechnology Unit, Saarland University & HTW Saar, Germany
| | - Pak Yam Au
- Department of Psychology and The State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong
| | - Danilo Maziero
- Department of Medicine, MR Research Program, John A. Burns School of Medicine, University of Hawai'i, HI, USA
| | - Victor Andrew Stenger
- Department of Medicine, MR Research Program, John A. Burns School of Medicine, University of Hawai'i, HI, USA
| | - Scott Sinnett
- Department of Psychology, University of Hawai'i at Mānoa, Hawaii, USA
| | - Jonas Vibell
- Department of Psychology, University of Hawai'i at Mānoa, Hawaii, USA.
| |
Collapse
|
17
|
Zhang X, Guan M, Chen X, Zhang P, Wu J, Zhang X, Dong M. Identifying neuroimaging biomarkers for psychogenic erectile dysfunction by fusing multi‐level brain information: a resting‐state fMRI study. Andrology 2022; 10:1398-1410. [PMID: 35869867 DOI: 10.1111/andr.13238] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Revised: 07/18/2022] [Accepted: 07/20/2022] [Indexed: 11/29/2022]
Affiliation(s)
- Xiaoyan Zhang
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education School of Life Science and Technology Xidian University Xi'an Shaanxi 710071 China
- Xian Key Laboratory of Intelligent Sensing and Regulation of tran‐Scale Life Information Xi'an Shaanxi 710071 China
| | - Min Guan
- Department of Cerebrovascular Disease Henan Provincial People's Hospital Zhengzhou 450003 China
| | - Xin Chen
- Department of Andrology Henan Provincial People's Hospital, People's Hospital of Zhengzhou University Zheng Zhou Henan 450003 China
| | - Peiming Zhang
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education School of Life Science and Technology Xidian University Xi'an Shaanxi 710071 China
- Xian Key Laboratory of Intelligent Sensing and Regulation of tran‐Scale Life Information Xi'an Shaanxi 710071 China
| | - Jia Wu
- School of Foreign Languages Northwestern Polytechnical University Xi'an Shaanxi China
| | - Xiangsheng Zhang
- Department of Andrology Henan Provincial People's Hospital, People's Hospital of Zhengzhou University Zheng Zhou Henan 450003 China
| | - Minghao Dong
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education School of Life Science and Technology Xidian University Xi'an Shaanxi 710071 China
- Xian Key Laboratory of Intelligent Sensing and Regulation of tran‐Scale Life Information Xi'an Shaanxi 710071 China
- Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence Xidian University Xi'an China
| |
Collapse
|
18
|
Stiers P, Goulas A. Task-specific subnetworks extend from prefrontal cortex to striatum. Cortex 2022; 156:106-125. [DOI: 10.1016/j.cortex.2022.06.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 02/23/2022] [Accepted: 06/07/2022] [Indexed: 11/29/2022]
|
19
|
Gu F, Ma S, Wang X, Zhao J, Yu Y, Song X. Evaluation of Feature Selection for Alzheimer’s Disease Diagnosis. Front Aging Neurosci 2022; 14:924113. [PMID: 35813964 PMCID: PMC9263380 DOI: 10.3389/fnagi.2022.924113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Accepted: 06/06/2022] [Indexed: 11/13/2022] Open
Abstract
Accurate recognition of patients with Alzheimer’s disease (AD) or mild cognitive impairment (MCI) is important for the subsequent treatment and rehabilitation. Recently, with the fast development of artificial intelligence (AI), AI-assisted diagnosis has been widely used. Feature selection as a key component is very important in AI-assisted diagnosis. So far, many feature selection methods have been developed. However, few studies consider the stability of a feature selection method. Therefore, in this study, we introduce a frequency-based criterion to evaluate the stability of feature selection and design a pipeline to select feature selection methods considering both stability and discriminability. There are two main contributions of this study: (1) It designs a bootstrap sampling-based workflow to simulate real-world scenario of feature selection. (2) It develops a decision graph to determine the optimal combination of supervised and unsupervised feature selection both considering feature stability and discriminability. Experimental results on the ADNI dataset have demonstrated the feasibility of our method.
Collapse
Affiliation(s)
- Feng Gu
- Department of Medical Image, Affiliated Nantong Rehabilitation Hospital of Nantong University, Nantong, China
- Department of Medical Image, The Second People’s Hospital of Nantong, Nantong, China
| | - Songhua Ma
- Department of Neurology, Affiliated Nantong Rehabilitation Hospital of Nantong University, Nantong, China
- Department of Neurology, The Second People’s Hospital of Nantong, Nantong, China
| | - Xiude Wang
- Department of Medical Image, Affiliated Nantong Rehabilitation Hospital of Nantong University, Nantong, China
- Department of Medical Image, The Second People’s Hospital of Nantong, Nantong, China
| | - Jian Zhao
- Nantong Center for Disease Control and Prevention, Nantong, China
| | - Ying Yu
- Nantong Center for Disease Control and Prevention, Nantong, China
| | - Xinjian Song
- Department of Rehabilitation Medicine, Affiliated Nantong Rehabilitation Hospital of Nantong University, Nantong, China
- Department of Rehabilitation Medicine, The Second People’s Hospital of Nantong, Nantong, China
- *Correspondence: Xinjian Song,
| |
Collapse
|
20
|
Sreenivasan V, Kumar S, Pestilli F, Talukdar P, Sridharan D. GPU-accelerated connectome discovery at scale. NATURE COMPUTATIONAL SCIENCE 2022; 2:298-306. [PMID: 38177824 PMCID: PMC10766542 DOI: 10.1038/s43588-022-00250-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Accepted: 04/21/2022] [Indexed: 01/06/2024]
Abstract
Diffusion magnetic resonance imaging and tractography enable the estimation of anatomical connectivity in the human brain, in vivo. Yet, without ground-truth validation, different tractography algorithms can yield widely varying connectivity estimates. Although streamline pruning techniques mitigate this challenge, slow compute times preclude their use in big-data applications. We present 'Regularized, Accelerated, Linear Fascicle Evaluation' (ReAl-LiFE), a GPU-based implementation of a state-of-the-art streamline pruning algorithm (LiFE), which achieves >100× speedups over previous CPU-based implementations. Leveraging these speedups, we overcome key limitations with LiFE's algorithm to generate sparser and more accurate connectomes. We showcase ReAl-LiFE's ability to estimate connections with superlative test-retest reliability, while outperforming competing approaches. Moreover, we predicted inter-individual variations in multiple cognitive scores with ReAl-LiFE connectome features. We propose ReAl-LiFE as a timely tool, surpassing the state of the art, for accurate discovery of individualized brain connectomes at scale. Finally, our GPU-accelerated implementation of a popular non-negative least-squares optimization algorithm is widely applicable to many real-world problems.
Collapse
Affiliation(s)
| | - Sawan Kumar
- Department of Computational and Data Sciences, Indian Institute of Science, Bangalore, India
| | - Franco Pestilli
- Department of Psychology, University of Texas at Austin, Austin, TX, USA
| | - Partha Talukdar
- Department of Computational and Data Sciences, Indian Institute of Science, Bangalore, India
- Department of Computer Science and Automation, Indian Institute of Science, Bangalore, India
| | - Devarajan Sridharan
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India.
- Department of Computer Science and Automation, Indian Institute of Science, Bangalore, India.
| |
Collapse
|
21
|
Rybář M, Daly I. Neural decoding of semantic concepts: A systematic literature review. J Neural Eng 2022; 19. [PMID: 35344941 DOI: 10.1088/1741-2552/ac619a] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 03/27/2022] [Indexed: 11/12/2022]
Abstract
Objective Semantic concepts are coherent entities within our minds. They underpin our thought processes and are a part of the basis for our understanding of the world. Modern neuroscience research is increasingly exploring how individual semantic concepts are encoded within our brains and a number of studies are beginning to reveal key patterns of neural activity that underpin specific concepts. Building upon this basic understanding of the process of semantic neural encoding, neural engineers are beginning to explore tools and methods for semantic decoding: identifying which semantic concepts an individual is focused on at a given moment in time from recordings of their neural activity. In this paper we review the current literature on semantic neural decoding. Approach We conducted this review according to the Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) guidelines. Specifically, we assess the eligibility of published peer-reviewed reports via a search of PubMed and Google Scholar. We identify a total of 74 studies in which semantic neural decoding is used to attempt to identify individual semantic concepts from neural activity. Results Our review reveals how modern neuroscientific tools have been developed to allow decoding of individual concepts from a range of neuroimaging modalities. We discuss specific neuroimaging methods, experimental designs, and machine learning pipelines that are employed to aid the decoding of semantic concepts. We quantify the efficacy of semantic decoders by measuring information transfer rates. We also discuss current challenges presented by this research area and present some possible solutions. Finally, we discuss some possible emerging and speculative future directions for this research area. Significance Semantic decoding is a rapidly growing area of research. However, despite its increasingly widespread popularity and use in neuroscientific research this is the first literature review focusing on this topic across neuroimaging modalities and with a focus on quantifying the efficacy of semantic decoders.
Collapse
Affiliation(s)
- Milan Rybář
- School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Ian Daly
- University of Essex, School of Computer Science and Electronic Engineering, Wivenhoe Park, Colchester, Colchester, Essex, CO4 3SQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| |
Collapse
|
22
|
Zhang W, Shen J, Wang Y, Cai K, Zhang Q, Cao M. Blood SSR1: A Possible Biomarker for Early Prediction of Parkinson’s Disease. Front Mol Neurosci 2022; 15:762544. [PMID: 35310885 PMCID: PMC8924528 DOI: 10.3389/fnmol.2022.762544] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2021] [Accepted: 01/14/2022] [Indexed: 01/31/2023] Open
Abstract
Parkinson’s disease (PD) is the second most common neurodegenerative disease associated with age. Early diagnosis of PD is key to preventing the loss of dopamine neurons. Peripheral-blood biomarkers have shown their value in recent years because of their easy access and long-term monitoring advantages. However, few peripheral-blood biomarkers have proven useful. This study aims to explore potential peripheral-blood biomarkers for the early diagnosis of PD. Three substantia nigra (SN) transcriptome datasets from the Gene Expression Omnibus (GEO) database were divided into a training cohort and a test cohort. We constructed a protein–protein interaction (PPI) network and a weighted gene co-expression network analysis (WGCNA) network, found their overlapping differentially expressed genes and studied them as the key genes. Analysis of the peripheral-blood transcriptome datasets of PD patients from GEO showed that three key genes were upregulated in PD over healthy participants. Analysis of the relationship between their expression and survival and analysis of their brain expression suggested that these key genes could become biomarkers. Then, animal models were studied to validate the expression of the key genes, and only SSR1 (the signal sequence receptor subunit1) was significantly upregulated in both animal models in peripheral blood. Correlation analysis and logistic regression analysis were used to analyze the correlation between brain dopaminergic neurons and SSR1 expression, and it was found that SSR1 expression was negatively correlated with dopaminergic neuron survival. The upregulation of SSR1 expression in peripheral blood was also found to precede the abnormal behavior of animals. In addition, the application of artificial intelligence technology further showed the value of SSR1 in clinical PD prediction. The three classifiers all showed that SSR1 had high predictability for PD. The classifier with the best prediction accuracy was selected through AUC and MCC to construct a prediction model. In short, this research not only provides potential biomarkers for the early diagnosis of PD but also establishes a possible artificial intelligence model for predicting PD.
Collapse
Affiliation(s)
- Wen Zhang
- Department of Neurology, Affiliated Hospital of Nantong University, Nantong, China
| | - Jiabing Shen
- Department of Neurology, Affiliated Hospital of Nantong University, Nantong, China
| | - Yuhui Wang
- Department of Microelectrics, Peking University, Peking, China
| | - Kefu Cai
- Department of Neurology, Affiliated Hospital of Nantong University, Nantong, China
| | - Qi Zhang
- Key Laboratory of Neuroregeneration of Jiangsu and Ministry of Education, Co-innovation Center of Neuroregeneration, Nantong University, Nantong, China
- *Correspondence: Maohong Cao Qi Zhang
| | - Maohong Cao
- Department of Neurology, Affiliated Hospital of Nantong University, Nantong, China
- *Correspondence: Maohong Cao Qi Zhang
| |
Collapse
|
23
|
Rennig J, Beauchamp MS. Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex. Neuroimage 2022; 247:118796. [PMID: 34906712 PMCID: PMC8819942 DOI: 10.1016/j.neuroimage.2021.118796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 11/18/2021] [Accepted: 12/08/2021] [Indexed: 11/18/2022] Open
Abstract
Regions of the human posterior superior temporal gyrus and sulcus (pSTG/S) respond to the visual mouth movements that constitute visual speech and the auditory vocalizations that constitute auditory speech, and neural responses in pSTG/S may underlie the perceptual benefit of visual speech for the comprehension of noisy auditory speech. We examined this possibility through the lens of multivoxel pattern responses in pSTG/S. BOLD fMRI data was collected from 22 participants presented with speech consisting of English sentences presented in five different formats: visual-only; auditory with and without added auditory noise; and audiovisual with and without auditory noise. Participants reported the intelligibility of each sentence with a button press and trials were sorted post-hoc into those that were more or less intelligible. Response patterns were measured in regions of the pSTG/S identified with an independent localizer. Noisy audiovisual sentences with very similar physical properties evoked very different response patterns depending on their intelligibility. When a noisy audiovisual sentence was reported as intelligible, the pattern was nearly identical to that elicited by clear audiovisual sentences. In contrast, an unintelligible noisy audiovisual sentence evoked a pattern like that of visual-only sentences. This effect was less pronounced for noisy auditory-only sentences, which evoked similar response patterns regardless of intelligibility. The successful integration of visual and auditory speech produces a characteristic neural signature in pSTG/S, highlighting the importance of this region in generating the perceptual benefit of visual speech.
Collapse
Affiliation(s)
- Johannes Rennig
- Division of Neuropsychology, Center of Neurology, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Michael S Beauchamp
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Richards Medical Research Building, A607, 3700 Hamilton Walk, Philadelphia, PA 19104-6016, United States.
| |
Collapse
|
24
|
Nenning KH, Langs G. Machine learning in neuroimaging: from research to clinical practice. RADIOLOGIE (HEIDELBERG, GERMANY) 2022; 62:1-10. [PMID: 36044070 PMCID: PMC9732070 DOI: 10.1007/s00117-022-01051-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 07/07/2022] [Indexed: 12/14/2022]
Abstract
Neuroimaging is critical in clinical care and research, enabling us to investigate the brain in health and disease. There is a complex link between the brain's morphological structure, physiological architecture, and the corresponding imaging characteristics. The shape, function, and relationships between various brain areas change during development and throughout life, disease, and recovery. Like few other areas, neuroimaging benefits from advanced analysis techniques to fully exploit imaging data for studying the brain and its function. Recently, machine learning has started to contribute (a) to anatomical measurements, detection, segmentation, and quantification of lesions and disease patterns, (b) to the rapid identification of acute conditions such as stroke, or (c) to the tracking of imaging changes over time. As our ability to image and analyze the brain advances, so does our understanding of its intricate relationships and their role in therapeutic decision-making. Here, we review the current state of the art in using machine learning techniques to exploit neuroimaging data for clinical care and research, providing an overview of clinical applications and their contribution to fundamental computational neuroscience.
Collapse
Affiliation(s)
- Karl-Heinz Nenning
- Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA
- Department of Biomedical Imaging and Image-guided Therapy, Computational Imaging Research Lab, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria
| | - Georg Langs
- Department of Biomedical Imaging and Image-guided Therapy, Computational Imaging Research Lab, Medical University of Vienna, Währinger Gürtel 18-20, 1090, Vienna, Austria.
| |
Collapse
|
25
|
Wang S, Celebi ME, Zhang YD, Yu X, Lu S, Yao X, Zhou Q, Miguel MG, Tian Y, Gorriz JM, Tyukin I. Advances in Data Preprocessing for Biomedical Data Fusion: An Overview of the Methods, Challenges, and Prospects. INFORMATION FUSION 2021; 76:376-421. [DOI: 10.1016/j.inffus.2021.07.001] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/30/2023]
|
26
|
Cao R, Qian C, Ren S, He Z, He S, Zhang P. Visual adaptation and 7T fMRI reveal facial identity processing in the human brain under shallow interocular suppression. Neuroimage 2021; 244:118622. [PMID: 34610434 DOI: 10.1016/j.neuroimage.2021.118622] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Revised: 09/18/2021] [Accepted: 09/24/2021] [Indexed: 11/19/2022] Open
Abstract
Face identity is represented at a high level of the visual hierarchy. Whether the human brain can process facial identity information in the absence of visual awareness remains unclear. In this study, we investigated potential face identity representation through face-identity adaptation with the adapting faces interocularly suppressed by Continuous Flash Suppression (CFS) noise, a modified binocular rivalry paradigm. The strength of interocular suppression was manipulated by varying the contrast of CFS noise. While obeservers reported the face images subjectively unperceived and the face identity objectively unrecognizable, a significant face identity aftereffect was observed under low but not high contrast CFS noise. In addition, the identity of face images under shallow interocular suppression can be decoded from multi-voxel patterns in the right fusiform face area (FFA) obtained with high-resolution 7T fMRI. Thus the comined evidence from visual adaptation and 7T fMRI suggest that face identity can be represented in the human brain without explicit perceptual recognition. The processing of interocularly suppressed faces could occur at different levels depending on how "deep" the information is suppressed.
Collapse
Affiliation(s)
- Runnan Cao
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Chencan Qian
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Shiwen Ren
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhifen He
- School of Ophthalmology and Optometry and Eye Hospital and State Key Laboratory of Ophthalmology, Optometry and Vision Science, Wenzhou Medical University, Wenzhou, Zhejiang 325000, China
| | - Sheng He
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China; University of Chinese Academy of Sciences, Beijing 100049, China; Department of Psychology, University of Minnesota, Minneapolis, MN 55455, United States; CAS Center for Excellence in Brain Science and Intelligence Technology, Shanghai 200031, China.
| | - Peng Zhang
- School of Ophthalmology and Optometry and Eye Hospital and State Key Laboratory of Ophthalmology, Optometry and Vision Science, Wenzhou Medical University, Wenzhou, Zhejiang 325000, China; State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing 100101, China; Hefei Comprehensive National Science Center, Institute of Artificial Intelligence, Hefei 230026, China; University of Chinese Academy of Sciences, Beijing 100049, China.
| |
Collapse
|
27
|
Kita K, Furuya S, Osu R, Sakamoto T, Hanakawa T. Aberrant Cerebello-Cortical Connectivity in Pianists With Focal Task-Specific Dystonia. Cereb Cortex 2021; 31:4853-4863. [PMID: 34013319 DOI: 10.1093/cercor/bhab127] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Musician's dystonia is a type of focal task-specific dystonia (FTSD) characterized by abnormal muscle hypercontraction and loss of fine motor control specifically during instrument playing. Although the neuropathophysiology of musician's dystonia remains unclear, it has been suggested that maladaptive functional abnormalities in subcortical and cortical regions may be involved. Here, we hypothesized that aberrant effective connectivity between the cerebellum (subcortical) and motor/somatosensory cortex may underlie the neuropathophysiology of musician's dystonia. Using functional magnetic resonance imaging, we measured the brain activity of 30 pianists with or without FTSD as they played a magnetic resonance imaging-compatible piano-like keyboard, which elicited dystonic symptoms in many but not all pianists with FTSD. Pianists with FTSD showed greater activation of the right cerebellum during the task than healthy pianists. Furthermore, patients who reported dystonic symptoms during the task demonstrated greater cerebellar activation than those who did not, establishing a link between cerebellar activity and overt dystonic symptoms. Using multivoxel pattern analysis, moreover, we found that dystonic and healthy pianists differed in the task-related effective connectivity between the right cerebellum and left premotor/somatosensory cortex. The present study indicates that abnormal cerebellar activity and cerebello-cortical connectivity may underlie the pathophysiology of FTSD in musicians.
Collapse
Affiliation(s)
- Kahori Kita
- Department of Advanced Neuroimaging, Integrative Brain Imaging Center, National Center of Neurology and Psychiatry, Tokyo 187-8551, Japan.,Center for Frontier Medical Engineering, Chiba University, Chiba 263-8522, Japan.,Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Shinichi Furuya
- Department of Advanced Neuroimaging, Integrative Brain Imaging Center, National Center of Neurology and Psychiatry, Tokyo 187-8551, Japan.,Musical Skill and Injury Center, Sophia University, Tokyo 102-8554, Japan.,Sony Computer Science Laboratories Inc., Tokyo 141-0022, Japan
| | - Rieko Osu
- Faculty of Human Sciences, Waseda University, Saitama 359-1192, Japan
| | - Takashi Sakamoto
- Department of Neurology, National Center of Neurology and Psychiatry Hospital, Tokyo 187-8551, Japan
| | - Takashi Hanakawa
- Department of Advanced Neuroimaging, Integrative Brain Imaging Center, National Center of Neurology and Psychiatry, Tokyo 187-8551, Japan.,Integrated Neuroanatomy and Neuroimaging, Graduate School of Medicine, Kyoto University, Kyoto 606-8501, Japan
| |
Collapse
|
28
|
Huang W, Li X, Li X, Kang G, Han Y, Shu N. Combined Support Vector Machine Classifier and Brain Structural Network Features for the Individual Classification of Amnestic Mild Cognitive Impairment and Subjective Cognitive Decline Patients. Front Aging Neurosci 2021; 13:687927. [PMID: 34393757 PMCID: PMC8361326 DOI: 10.3389/fnagi.2021.687927] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 06/30/2021] [Indexed: 12/16/2022] Open
Abstract
OBJECTIVE Individuals with subjective cognitive decline (SCD) or amnestic mild cognitive impairment (aMCI) represent important targets for the early detection and intervention of Alzheimer's disease (AD). In this study, we employed a multi-kernel support vector machine (SVM) to examine whether white matter (WM) structural networks can be used for screening SCD and aMCI. METHODS A total of 138 right-handed participants [51 normal controls (NC), 36 SCD, 51 aMCI] underwent MRI brain scans. For each participant, three types of WM networks with different edge weights were constructed with diffusion MRI data: fiber number-weighted networks, mean fractional anisotropy-weighted networks, and mean diffusivity (MD)-weighted networks. By employing a multiple-kernel SVM, we seek to integrate information from three weighted networks to improve classification performance. The accuracy of classification between each pair of groups was evaluated via leave-one-out cross-validation. RESULTS For the discrimination between SCD and NC, an area under the curve (AUC) value of 0.89 was obtained, with an accuracy of 83.9%. Further analysis revealed that the methods using three types of WM networks outperformed other methods using single WM network. Moreover, we found that most of discriminative features were from MD-weighted networks, which distributed among frontal lobes. Similar classification performance was also reported in the differentiation between subjects with aMCI and NCs (accuracy = 83.3%). Between SCD and aMCI, an AUC value of 0.72 was obtained, with an accuracy of 72.4%, sensitivity of 74.5% and specificity of 69.4%. The highest accuracy was achieved with features only selected from MD-weighted networks. CONCLUSION White matter structural network features help machine learning algorithms accurately identify individuals with SCD and aMCI from NCs. Our findings have significant implications for the development of potential brain imaging markers for the early detection of AD.
Collapse
Affiliation(s)
- Weijie Huang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
- Center for Collaboration and Innovation in Brain and Learning Sciences, Beijing Normal University, Beijing, China
- Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China
| | - Xuanyu Li
- Department of Neurology, Xuanwu Hospital of Capital Medical University, Beijing, China
- Department of Neurology, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Xin Li
- School of Electrical Engineering, Yanshan University, Qinhuangdao, China
- Measurement Technology and Instrumentation Key Lab of Hebei Province, Qinhuangdao, China
| | - Guixia Kang
- Beijing University of Posts and Telecommunications, Beijing, China
| | - Ying Han
- Department of Neurology, Xuanwu Hospital of Capital Medical University, Beijing, China
- Biomedical Engineering Institute, Hainan University, Haikou, China
- Center of Alzheimer’s Disease, Beijing Institute for Brain Disorders, Beijing, China
- National Clinical Research Center for Geriatric Disorders, Beijing, China
| | - Ni Shu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
- Center for Collaboration and Innovation in Brain and Learning Sciences, Beijing Normal University, Beijing, China
- Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China
| |
Collapse
|
29
|
An integrative prediction algorithm of drug-refractory epilepsy based on combined clinical-EEG functional connectivity features. J Neurol 2021; 269:1501-1514. [PMID: 34308506 DOI: 10.1007/s00415-021-10718-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 07/15/2021] [Accepted: 07/17/2021] [Indexed: 12/27/2022]
Abstract
OBJECTIVE Although the use of antiepileptic drugs (AEDs) is routine, 30-40% of patients with epilepsy (PWEs) experience drug resistance. Thus, early identification of AED resistance will help optimize treatment regimens and improve patients' prognoses. However, there have been few studies on this topic to date. Here, we try to establish an integrative prediction model of AED resistance for drug-naive PWEs, and to identify the clinical and Electroencephalogram (EEG) factors that affect their outcomes. METHODS One hundred sixty-four PWEs naive to AEDs treated at a tertiary care center from January 2014 to June 2020 were retrospectively analyzed. A total of 113 of these patients were well controlled and 53 were drug refractory with regular AED treatment for more than one year. Eighty clinical characteristics and 684 EEG functional connectivity variables based on phase lag index before drug initiation were identified. Overall, 80% of each group was chosen to establish a support vector machine (SVM) model with ten-fold cross validation, and the other 20% were used to evaluate the model's performance. Absolute weight value was used to rank the features that had impacts on classification. RESULTS An integrative algorithm was modeled to predict AED resistance for drug-naive PWEs by SVM based on clinical characteristics and EEG functional connectivity values. The model had an accuracy of 94% [95% confidence interval (CI) 0.85-1.0], sensitivity of 95% [95% CI 0.82-1.0], specificity of 93% [95% CI 0.77-1.0], and an area under the curve (AUC) of 0.98 [95% CI 0.91-1.0]. The p values of accuracy, sensitivity specificity and AUC were calculated as 0.001, 0.001, 0.01 and 0.001, respectively. The δ band fromT4-FZ and T3-PZ, α band from T3-T6 and β band from F7-CZ and FP2-F3 were the top five EEG features that impacted the SVM classifier. CONCLUSION We constructed an integrative prediction algorithm of AED resistance for drug-naive PWEs. Its utility in clinical settings should be evaluated in the future.
Collapse
|
30
|
Chou IWY, Ban H, Chang DHF. Modulations of depth responses in the human brain by object context: Does biological relevance matter? eNeuro 2021; 8:ENEURO.0039-21.2021. [PMID: 34140352 PMCID: PMC8287874 DOI: 10.1523/eneuro.0039-21.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Revised: 05/25/2021] [Accepted: 06/10/2021] [Indexed: 11/21/2022] Open
Abstract
Depth sensitivity has been shown to be modulated by object context (plausibility). It is possible that it is behavioural relevance rather than object plausibility per se which drives this effect. Here, we manipulated the biological relevance of objects (face or a non-face) and tested whether object relevance affects behavioural sensitivity and neural responses to depth-position. In a first experiment, we presented human observers with disparity-defined faces and non-faces, and observers were asked to judge the depth position of the target under signal-noise and clear (fine) task conditions. In the second experiment, we concurrently measured behavioural and fMRI responses to depth. We found that behavioural performance varied across stimulus conditions such that they were significantly worse for the upright face than the inverted face and the random shape in the SNR task, but worse for the random shape than the upright face in the feature task. Pattern analysis of fMRI responses revealed that activity of FFA was distinctly different during depth judgments of the upright face versus the other two stimuli, with its responses (and to a stronger extent, those of V3) appearing functionally-relevant to behavioural performance. We speculate that FFA is not only involved in object analysis, but exerts considerable influence on stereoscopic mechanisms as early as in V3 based on a broader appreciation of the stimulus' behavioural relevance.Significance StatementWe asked how disparity sensitivity is modulated by object (biological) relevance using behavioural and neuroimaging paradigms. We show that behavioural sensitivity to depth-position changes in biological (face) vs non-biological (random surface) contexts, and that these changes are task-dependent. Imaging results highlight a potentially key role of the fusiform region for governing the modulation of stereo encoding by object relevance. These findings highlight powerful interactions between object recognition mechanisms and stereoencoding, such that the utility of disparity information may be up/down weighed depending on the biological relevance of the object.
Collapse
Affiliation(s)
- Idy W Y Chou
- Department of Psychology, The University of Hong Kong, Hong Kong
| | - Hiroshi Ban
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Japan
- Graduate School of Frontier Biosciences, Osaka University, Japan
| | - Dorita H F Chang
- Department of Psychology, The University of Hong Kong, Hong Kong
- State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong
| |
Collapse
|
31
|
Shahnazian D, Senoussi M, Krebs RM, Verguts T, Holroyd CB. Neural Representations of Task Context and Temporal Order During Action Sequence Execution. Top Cogn Sci 2021; 14:223-240. [PMID: 33836116 DOI: 10.1111/tops.12533] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Revised: 03/29/2021] [Accepted: 03/29/2021] [Indexed: 12/22/2022]
Abstract
Routine action sequences can share a great deal of similarity in terms of their stimulus response mappings. As a consequence, their correct execution relies crucially on the ability to preserve contextual and temporal information. However, there are few empirical studies on the neural mechanism and the brain areas maintaining such information. To address this gap in the literature, we recently recorded the blood-oxygen level dependent (BOLD) response in a newly developed coffee-tea making task. The task involves the execution of four action sequences that each comprise six consecutive decision states, which allows for examining the maintenance of contextual and temporal information. Here, we report a reanalysis of this dataset using a data-driven approach, namely multivariate pattern analysis, that examines context-dependent neural activity across several predefined regions of interest. Results highlight involvement of the inferior-temporal gyrus and lateral prefrontal cortex in maintaining temporal and contextual information for the execution of hierarchically organized action sequences. Furthermore, temporal information seems to be more strongly encoded in areas over the left hemisphere.
Collapse
Affiliation(s)
| | | | - Ruth M Krebs
- Department of Experimental Psychology, Ghent University
| | - Tom Verguts
- Department of Experimental Psychology, Ghent University
| | | |
Collapse
|
32
|
Zhao M, Liu J, Cai W, Li J, Zhu X, Yu D, Yuan K. Support vector machine based classification of smokers and nonsmokers using diffusion tensor imaging. Brain Imaging Behav 2021; 14:2242-2250. [PMID: 31428924 DOI: 10.1007/s11682-019-00176-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Despite significant progress in treatments for smoking cessation, smoking continues to be a significant public health concern, especially in young adulthood. Thus, developing a predictive model that can classify and characterize the brain-based biomarkers predicting smoking status would be imperative to improving treatment development. In this study, we applied a support vector machine-based classification method to discriminate 70 young male smokers and 70 matched nonsmokers using their diffusion tensor imaging (DTI) data. The classification procedure achieved an average accuracy of 88.6% and an average area under the curve of 0.95. The most discriminative features that contributed to the classification were primarily located in the sagittal stratum (SS), external capsule (EC), superior longitudinal fasciculus (SLF), anterior corona radiata (ACR) and inferior front-occipital fasciculus (IFOF). The following regression analysis showed a significant negatively correlation between the average RD values of the left ACR (r = -0.247, p = 0.039) and FTND. The average MD values in the right EC (r = -0.254, p = 0.034) and RD values in the right IFOF (r = -0.240, p = 0.046) were inversely associated with pack-years. Our findings indicate that the discriminative white matter (WM) features as brain biomarkers provide great predictive power for smoking status and suggest that machine learning techniques can reveal underlying smoking-related neurobiology.
Collapse
Affiliation(s)
- Meng Zhao
- School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, People's Republic of China.,Engineering Research Center of Molecular and Neuro Imaging Ministry of Education, Xi'an, People's Republic of China
| | - Jingjing Liu
- School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, People's Republic of China.,Engineering Research Center of Molecular and Neuro Imaging Ministry of Education, Xi'an, People's Republic of China
| | - Wanye Cai
- School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, People's Republic of China.,Engineering Research Center of Molecular and Neuro Imaging Ministry of Education, Xi'an, People's Republic of China
| | - Jun Li
- School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, People's Republic of China
| | - Xueling Zhu
- Department of Radiology, Xiangya Hospital, Central South University, Changsha, China.
| | - Dahua Yu
- Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, 014010, People's Republic of China.
| | - Kai Yuan
- School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, People's Republic of China. .,Engineering Research Center of Molecular and Neuro Imaging Ministry of Education, Xi'an, People's Republic of China. .,Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, 014010, People's Republic of China.
| |
Collapse
|
33
|
Leipold S, Klein C, Jäncke L. Musical Expertise Shapes Functional and Structural Brain Networks Independent of Absolute Pitch Ability. J Neurosci 2021; 41:2496-2511. [PMID: 33495199 PMCID: PMC7984587 DOI: 10.1523/jneurosci.1985-20.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Revised: 11/11/2020] [Accepted: 11/17/2020] [Indexed: 11/21/2022] Open
Abstract
Professional musicians are a popular model for investigating experience-dependent plasticity in human large-scale brain networks. A minority of musicians possess absolute pitch, the ability to name a tone without reference. The study of absolute pitch musicians provides insights into how a very specific talent is reflected in brain networks. Previous studies of the effects of musicianship and absolute pitch on large-scale brain networks have yielded highly heterogeneous findings regarding the localization and direction of the effects. This heterogeneity was likely influenced by small samples and vastly different methodological approaches. Here, we conducted a comprehensive multimodal assessment of effects of musicianship and absolute pitch on intrinsic functional and structural connectivity using a variety of commonly used and state-of-the-art multivariate methods in the largest sample to date (n = 153 female and male human participants; 52 absolute pitch musicians, 51 non-absolute pitch musicians, and 50 non-musicians). Our results show robust effects of musicianship in interhemispheric and intrahemispheric connectivity in both structural and functional networks. Crucially, most of the effects were replicable in both musicians with and without absolute pitch compared with non-musicians. However, we did not find evidence for an effect of absolute pitch on intrinsic functional or structural connectivity in our data: The two musician groups showed strikingly similar networks across all analyses. Our results suggest that long-term musical training is associated with robust changes in large-scale brain networks. The effects of absolute pitch on neural networks might be subtle, requiring very large samples or task-based experiments to be detected.SIGNIFICANCE STATEMENT A question that has fascinated neuroscientists, psychologists, and musicologists for a long time is how musicianship and absolute pitch, the rare talent to name a tone without reference, are reflected in large-scale networks of the human brain. Much is still unknown as previous studies have reported widely inconsistent results based on small samples. Here, we investigate the largest sample of musicians and non-musicians to date (n = 153) using a multitude of established and novel analysis methods. Results provide evidence for robust effects of musicianship on functional and structural networks that were replicable in two separate groups of musicians and independent of absolute pitch ability.
Collapse
Affiliation(s)
- Simon Leipold
- Division of Neuropsychology, Department of Psychology, University of Zurich, 8050 Zurich, Switzerland
- Department of Psychiatry and Behavioral Sciences, Stanford University, School of Medicine, Stanford, California 94305
| | - Carina Klein
- Division of Neuropsychology, Department of Psychology, University of Zurich, 8050 Zurich, Switzerland
| | - Lutz Jäncke
- Division of Neuropsychology, Department of Psychology, University of Zurich, 8050 Zurich, Switzerland
- University Research Priority Program, Dynamics of Healthy Aging, University of Zurich, 8050 Zurich, Switzerland
| |
Collapse
|
34
|
Decoding with confidence: Statistical control on decoder maps. Neuroimage 2021; 234:117921. [PMID: 33722670 DOI: 10.1016/j.neuroimage.2021.117921] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Revised: 02/17/2021] [Accepted: 02/21/2021] [Indexed: 11/22/2022] Open
Abstract
In brain imaging, decoding is widely used to infer relationships between brain and cognition, or to craft brain-imaging biomarkers of pathologies. Yet, standard decoding procedures do not come with statistical guarantees, and thus do not give confidence bounds to interpret the pattern maps that they produce. Indeed, in whole-brain decoding settings, the number of explanatory variables is much greater than the number of samples, hence classical statistical inference methodology cannot be applied. Specifically, the standard practice that consists in thresholding decoding maps is not a correct inference procedure. We contribute a new statistical-testing framework for this type of inference. To overcome the statistical inefficiency of voxel-level control, we generalize the Family Wise Error Rate (FWER) to account for a spatial tolerance δ, introducing the δ-Family Wise Error Rate (δ-FWER). Then, we present a decoding procedure that can control the δ-FWER: the Ensemble of Clustered Desparsified Lasso (EnCluDL), a procedure for multivariate statistical inference on high-dimensional structured data. We evaluate the statistical properties of EnCluDL with a thorough empirical study, along with three alternative procedures including decoder map thresholding. We show that EnCluDL exhibits the best recovery properties while ensuring the expected statistical control.
Collapse
|
35
|
Kuntzelman KM, Williams JM, Lim PC, Samal A, Rao PK, Johnson MR. Deep-Learning-Based Multivariate Pattern Analysis (dMVPA): A Tutorial and a Toolbox. Front Hum Neurosci 2021; 15:638052. [PMID: 33737872 PMCID: PMC7960649 DOI: 10.3389/fnhum.2021.638052] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2020] [Accepted: 02/08/2021] [Indexed: 11/17/2022] Open
Abstract
In recent years, multivariate pattern analysis (MVPA) has been hugely beneficial for cognitive neuroscience by making new experiment designs possible and by increasing the inferential power of functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and other neuroimaging methodologies. In a similar time frame, “deep learning” (a term for the use of artificial neural networks with convolutional, recurrent, or similarly sophisticated architectures) has produced a parallel revolution in the field of machine learning and has been employed across a wide variety of applications. Traditional MVPA also uses a form of machine learning, but most commonly with much simpler techniques based on linear calculations; a number of studies have applied deep learning techniques to neuroimaging data, but we believe that those have barely scratched the surface of the potential deep learning holds for the field. In this paper, we provide a brief introduction to deep learning for those new to the technique, explore the logistical pros and cons of using deep learning to analyze neuroimaging data – which we term “deep MVPA,” or dMVPA – and introduce a new software toolbox (the “Deep Learning In Neuroimaging: Exploration, Analysis, Tools, and Education” package, DeLINEATE for short) intended to facilitate dMVPA for neuroscientists (and indeed, scientists more broadly) everywhere.
Collapse
Affiliation(s)
- Karl M Kuntzelman
- Center for Brain, Biology and Behavior, University of Nebraska-Lincoln, Lincoln, NE, United States.,Office of Technology Development and Coordination, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, United States
| | - Jacob M Williams
- Department of Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln, NE, United States
| | - Phui Cheng Lim
- Center for Brain, Biology and Behavior, University of Nebraska-Lincoln, Lincoln, NE, United States.,Department of Psychology, University of Nebraska-Lincoln, Lincoln, NE, United States
| | - Ashok Samal
- Department of Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln, NE, United States
| | - Prahalada K Rao
- Department of Mechanical and Materials Engineering, University of Nebraska-Lincoln, Lincoln, NE, United States
| | - Matthew R Johnson
- Center for Brain, Biology and Behavior, University of Nebraska-Lincoln, Lincoln, NE, United States.,Department of Psychology, University of Nebraska-Lincoln, Lincoln, NE, United States
| |
Collapse
|
36
|
Rasero J, Sentis AI, Yeh FC, Verstynen T. Integrating across neuroimaging modalities boosts prediction accuracy of cognitive ability. PLoS Comput Biol 2021; 17:e1008347. [PMID: 33667224 PMCID: PMC7984650 DOI: 10.1371/journal.pcbi.1008347] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Revised: 03/22/2021] [Accepted: 02/10/2021] [Indexed: 01/08/2023] Open
Abstract
Variation in cognitive ability arises from subtle differences in underlying neural architecture. Understanding and predicting individual variability in cognition from the differences in brain networks requires harnessing the unique variance captured by different neuroimaging modalities. Here we adopted a multi-level machine learning approach that combines diffusion, functional, and structural MRI data from the Human Connectome Project (N = 1050) to provide unitary prediction models of various cognitive abilities: global cognitive function, fluid intelligence, crystallized intelligence, impulsivity, spatial orientation, verbal episodic memory and sustained attention. Out-of-sample predictions of each cognitive score were first generated using a sparsity-constrained principal component regression on individual neuroimaging modalities. These individual predictions were then aggregated and submitted to a LASSO estimator that removed redundant variability across channels. This stacked prediction led to a significant improvement in accuracy, relative to the best single modality predictions (approximately 1% to more than 3% boost in variance explained), across a majority of the cognitive abilities tested. Further analysis found that diffusion and brain surface properties contribute the most to the predictive power. Our findings establish a lower bound to predict individual differences in cognition using multiple neuroimaging measures of brain architecture, both structural and functional, quantify the relative predictive power of the different imaging modalities, and reveal how each modality provides unique and complementary information about individual differences in cognitive function.
Collapse
Affiliation(s)
- Javier Rasero
- Department of Psychology, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America
| | - Amy Isabella Sentis
- Carnegie Mellon Neuroscience Institute, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America
- Program in Neural Computation, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America
| | - Fang-Cheng Yeh
- Program in Neural Computation, University of Pittsburgh and Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania, United States of America
| | - Timothy Verstynen
- Department of Psychology, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania, United States of America
- Biomedical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America
| |
Collapse
|
37
|
Valencia GN, Khoo S, Wong T, Ta J, Hou B, Barsalou LW, Hazen K, Lin HH, Wang S, Brefczynski-Lewis JA, Frum CA, Lewis JW. Chinese-English bilinguals show linguistic-perceptual links in the brain associating short spoken phrases with corresponding real-world natural action sounds by semantic category. LANGUAGE, COGNITION AND NEUROSCIENCE 2021; 36:773-790. [PMID: 34568509 PMCID: PMC8462789 DOI: 10.1080/23273798.2021.1883073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Accepted: 01/26/2021] [Indexed: 06/13/2023]
Abstract
Higher cognitive functions such as linguistic comprehension must ultimately relate to perceptual systems in the brain, though how and why this forms remains unclear. Different brain networks that mediate perception when hearing real-world natural sounds has recently been proposed to respect a taxonomic model of acoustic-semantic categories. Using functional magnetic resonance imaging (fMRI) with Chinese/English bilingual listeners, the present study explored whether reception of short spoken phrases, in both Chinese (Mandarin) and English, describing corresponding sound-producing events would engage overlapping brain regions at a semantic category level. The results revealed a double-dissociation of cortical regions that were preferential for representing knowledge of human versus environmental action events, whether conveyed through natural sounds or the corresponding spoken phrases depicted by either language. These findings of cortical hubs exhibiting linguistic-perceptual knowledge links at a semantic category level should help to advance neurocomputational models of the neurodevelopment of language systems.
Collapse
Affiliation(s)
- Gabriela N. Valencia
- Department of Neuroscience, Rockefeller Neuroscience Institute, West Virginia University (WVU), Morgantown, WV 26506, USA
| | - Stephanie Khoo
- Department of Neuroscience, Rockefeller Neuroscience Institute, West Virginia University (WVU), Morgantown, WV 26506, USA
| | - Ting Wong
- Department of Neuroscience, Rockefeller Neuroscience Institute, West Virginia University (WVU), Morgantown, WV 26506, USA
| | - Joseph Ta
- Department of Neuroscience, Rockefeller Neuroscience Institute, West Virginia University (WVU), Morgantown, WV 26506, USA
| | - Bob Hou
- Department of Radiology, Center for Advanced Imaging
| | | | - Kirk Hazen
- Department of English, West Virginia University
| | | | - Shuo Wang
- Department of Chemical and Biomedical Engineering
| | - Julie A. Brefczynski-Lewis
- Department of Neuroscience, Rockefeller Neuroscience Institute, West Virginia University (WVU), Morgantown, WV 26506, USA
| | - Chris A. Frum
- Department of Neuroscience, Rockefeller Neuroscience Institute, West Virginia University (WVU), Morgantown, WV 26506, USA
| | - James W. Lewis
- Department of Neuroscience, Rockefeller Neuroscience Institute, West Virginia University (WVU), Morgantown, WV 26506, USA
| |
Collapse
|
38
|
Jolly E, Chang LJ. Multivariate spatial feature selection in fMRI. Soc Cogn Affect Neurosci 2021; 16:795-806. [PMID: 33501987 PMCID: PMC8343556 DOI: 10.1093/scan/nsab010] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Revised: 09/16/2020] [Accepted: 01/25/2021] [Indexed: 01/20/2023] Open
Abstract
Multivariate neuroimaging analyses constitute a powerful class of techniques to identify psychological representations. However, not all psychological processes are represented at the same spatial scale throughout the brain. This heterogeneity is apparent when comparing hierarchically organized local representations of perceptual processes to flexible transmodal representations of more abstract cognitive processes such as social and affective operations. An open question is how the spatial scale of analytic approaches interacts with the spatial scale of the representations under investigation. In this article, we describe how multivariate analyses can be viewed as existing on a spatial spectrum, anchored by searchlights used to identify locally distributed patterns of information on one end, whole brain approach used to identify diffuse neural representations at the other and region-based approaches in between. We describe how these distinctions are an important and often overlooked analytic consideration and provide heuristics to compare these different techniques to choose based on the analyst’s inferential goals.
Collapse
Affiliation(s)
- E Jolly
- Computational Social Affective Neuroscience Laboratory, Department of Psychological and Brain Science, Dartmouth College, Hanover, NH 03755, USA
| | - L J Chang
- Computational Social Affective Neuroscience Laboratory, Department of Psychological and Brain Science, Dartmouth College, Hanover, NH 03755, USA
| |
Collapse
|
39
|
Chang DHF, Jiang B, Wong NHL, Wong JJ, Webster C, Lee TMC. The human posterior cingulate and the stress-response benefits of viewing green urban landscapes. Neuroimage 2020; 226:117555. [PMID: 33189933 DOI: 10.1016/j.neuroimage.2020.117555] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Revised: 11/03/2020] [Accepted: 11/05/2020] [Indexed: 12/21/2022] Open
Abstract
The mechanistic and neural bases of why green environments drive positive mental health outcomes remain poorly understood. We show that viewing green urban landscapes that vary in terms of green-space density elicits corresponding changes in the activity of the human ventral posterior cingulate cortex that is correlated to behavioural stress-related responses. We further show that cingulate responses are engaged early in the processing cascade, influencing attentional and executive regions in a predominantly feedforward manner. Our data suggest a key role for this region in regulating (nature) dose-dependent changes in stress responses, potentially through its extensive connections to the prefrontal and hippocampal regions which in turn project towards the neuroendocrine system. As the posterior cingulate cortex is implicated in a variety of neurological diseases and disorders, these findings raise a therapeutic potential for natural environmental exposure, highlighting green-cover as a modifiable element that links to changes in limbic responses, and has health consequences for practitioners and city-planners alike.
Collapse
Affiliation(s)
- Dorita H F Chang
- Department of Psychology, The University of Hong Kong, Hong Kong; The State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong
| | - Bin Jiang
- Division of Landscape Architecture, Faculty of Architecture, The University of Hong Kong, Hong Kong; Virtual Reality Lab of Urban Environments and Human Health, HKUrbanLabs, The University of Hong Kong, Hong Kong
| | - Nicole H L Wong
- Department of Psychology, The University of Hong Kong, Hong Kong
| | - Jing Jun Wong
- Department of Psychology, The University of Hong Kong, Hong Kong
| | - Chris Webster
- HKUrbanLabs, Faculty of Architecture, The University of Hong Kong, Hong Kong.
| | - Tatia M C Lee
- Department of Psychology, The University of Hong Kong, Hong Kong; The State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong.
| |
Collapse
|
40
|
Wang C, Yan H, Huang W, Li J, Yang J, Li R, Zhang L, Li L, Zhang J, Zuo Z, Chen H. ‘When’ and ‘what’ did you see? A novel fMRI-based visual decoding framework. J Neural Eng 2020; 17:056013. [DOI: 10.1088/1741-2552/abb691] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
41
|
Luthra S, Correia JM, Kleinschmidt DF, Mesite L, Myers EB. Lexical Information Guides Retuning of Neural Patterns in Perceptual Learning for Speech. J Cogn Neurosci 2020; 32:2001-2012. [PMID: 32662731 PMCID: PMC8048099 DOI: 10.1162/jocn_a_01612] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
A listener's interpretation of a given speech sound can vary probabilistically from moment to moment. Previous experience (i.e., the contexts in which one has encountered an ambiguous sound) can further influence the interpretation of speech, a phenomenon known as perceptual learning for speech. This study used multivoxel pattern analysis to query how neural patterns reflect perceptual learning, leveraging archival fMRI data from a lexically guided perceptual learning study conducted by Myers and Mesite [Myers, E. B., & Mesite, L. M. Neural systems underlying perceptual adjustment to non-standard speech tokens. Journal of Memory and Language, 76, 80-93, 2014]. In that study, participants first heard ambiguous /s/-/∫/ blends in either /s/-biased lexical contexts (epi_ode) or /∫/-biased contexts (refre_ing); subsequently, they performed a phonetic categorization task on tokens from an /asi/-/a∫i/ continuum. In the current work, a classifier was trained to distinguish between phonetic categorization trials in which participants heard unambiguous productions of /s/ and those in which they heard unambiguous productions of /∫/. The classifier was able to generalize this training to ambiguous tokens from the middle of the continuum on the basis of individual participants' trial-by-trial perception. We take these findings as evidence that perceptual learning for speech involves neural recalibration, such that the pattern of activation approximates the perceived category. Exploratory analyses showed that left parietal regions (supramarginal and angular gyri) and right temporal regions (superior, middle, and transverse temporal gyri) were most informative for categorization. Overall, our results inform an understanding of how moment-to-moment variability in speech perception is encoded in the brain.
Collapse
Affiliation(s)
| | - João M Correia
- University of Algarve
- Basque Center on Cognition, Brain and Language
| | | | - Laura Mesite
- MGH Institute of Health Professions
- Harvard Graduate School of Education
| | | |
Collapse
|
42
|
Fang HZ, Hu DL, Li Q, Tu S. Risk gene identification and support vector machine learning to construct an early diagnosis model of myocardial infarction. Mol Med Rep 2020; 22:1775-1782. [PMID: 32705275 PMCID: PMC7411293 DOI: 10.3892/mmr.2020.11247] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 05/18/2020] [Indexed: 11/16/2022] Open
Abstract
The present study aimed to identify genes associated with increased risk of myocardial infarction (MI) and construct an early diagnosis model based on support vector machine (SVM) learning. The gene expression profile data of GSE34198, containing 97 human blood samples including 49 patients with MI and 48 healthy individuals, were obtained from the Gene Expression Omnibus database. Differentially expressed gene (DEG) screening, DEG enrichment analysis, protein-protein interaction (PPI) network investigation and clustering analysis were performed. The feature genes were identified using the neighboring score algorithm. Furthermore, a recursive feature elimination (RFE) algorithm was employed to screen risk factors among feature genes. The SVM prediction model was constructed and validated using the dataset GSE61144. A total of 1,207 DEGs (724 downregulated, 483 upregulated) between the two groups were identified. PPI analysis investigated 1,083 DEGs and 46,363 edges. In total, 87 genes were selected as candidate genes, and were primarily enriched in functions including ‘G-protein coupled receptor signaling’ or pathways such as ‘focal adhesion’. Furthermore, 15 genes with a high RFE score were selected to construct an SVM prediction model. The model's average accuracy was 86%. Data set verification showed that the predictive precision reached 0.92. High expression of the genes vascular endothelial growth factor A, A-kinase anchoring protein 12 and olfactory receptor 8D2 were potential risk factors for MI. The SVM early diagnosis model constructed by candidate genes could not only predict early MI, but also provide risk probability according to the severity of MI.
Collapse
Affiliation(s)
- Hong-Zhi Fang
- Department of Emergency, The Second Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi, Jiangsu 214000, P.R. China
| | - Dan-Li Hu
- Department of Emergency, The Second Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi, Jiangsu 214000, P.R. China
| | - Qin Li
- Department of Emergency, The Second Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi, Jiangsu 214000, P.R. China
| | - Su Tu
- Department of Emergency, The Second Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi, Jiangsu 214000, P.R. China
| |
Collapse
|
43
|
Zhang W, Yu YC, Li JS. Dynamics reconstruction and classification via Koopman features. Data Min Knowl Discov 2020; 33:1710-1735. [PMID: 32728345 DOI: 10.1007/s10618-019-00639-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Knowledge discovery and information extraction of large and complex datasets has attracted great attention in wide-ranging areas from statistics and biology to medicine. Tools from machine learning, data mining, and neurocomputing have been extensively explored and utilized to accomplish such compelling data analytics tasks. However, for time-series data presenting active dynamic characteristics, many of the state-of-the-art techniques may not perform well in capturing the inherited temporal structures in these data. In this paper, integrating the Koopman operator and linear dynamical systems theory with support vector machines, we develop an ovel dynamic data mining framework to construct low-dimensional linear models that approximate the nonlinear flow of high-dimensional time-series data generated by unknown nonlinear dynamical systems. This framework then immediately enables pattern recognition, e.g., classification, of complex time-series data to distinguish their dynamic behaviors by using the trajectories generated by the reduced linear systems. Moreover, we demonstrate the applicability and efficiency of this framework through the problems of time-series classification in bioinformatics and healthcare, including cognitive classification and seizure detection with fMRI and EEG data, respectively. The developed Koopman dynamic learning framework then lays a solid foundation for effective dynamic data mining and promises a mathematically justified method for extracting the dynamics and significant temporal structures of nonlinear dynamical systems.
Collapse
Affiliation(s)
- Wei Zhang
- Washington University in St. Louis, St. Louis, USA
| | - Yao-Chsi Yu
- Washington University in St. Louis, St. Louis, USA
| | - Jr-Shin Li
- Washington University in St. Louis, St. Louis, USA
| |
Collapse
|
44
|
Wilkey ED, Conrad BN, Yeo DJ, Price GR. Shared Numerosity Representations Across Formats and Tasks Revealed with 7 Tesla fMRI: Decoding, Generalization, and Individual Differences in Behavior. Cereb Cortex Commun 2020; 1:tgaa038. [PMID: 34296107 PMCID: PMC8153058 DOI: 10.1093/texcom/tgaa038] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2020] [Revised: 06/19/2020] [Accepted: 07/22/2020] [Indexed: 01/28/2023] Open
Abstract
Debate continues on whether encoding of symbolic number is grounded in nonsymbolic numerical magnitudes. Nevertheless, fluency of perceiving both number formats, and translating between them, predicts math skills across the life span. Therefore, this study asked if numbers share cortical activation patterns across formats and tasks, and whether neural response to number predicts math-related behaviors. We analyzed patterns of neural activation using 7 Tesla functional magnetic resonance imaging in a sample of 39 healthy adults. Discrimination was successful between numerosities 2, 4, 6, and 8 dots and generalized to activation patterns of the same numerosities represented as Arabic digits in the bilateral parietal lobes and left inferior frontal gyrus (IFG) (and vice versa). This indicates that numerosity-specific neural resources are shared between formats. Generalization was also successful across tasks where participants either identified or compared numerosities in bilateral parietal lobes and IFG. Individual differences in decoding did not relate to performance on a number comparison task completed outside of the scanner, but generalization between formats and across tasks negatively related to math achievement in the parietal lobes. Together, these findings suggest that individual differences in representational specificity within format and task contexts relate to mathematical expertise.
Collapse
Affiliation(s)
- Eric D Wilkey
- Brain and Mind Institute, Western University, London, Ontario N6A5B7, Canada
| | - Benjamin N Conrad
- Department of Psychology and Human Development, Peabody College, Vanderbilt University, Nashville, TN 37203, USA
| | - Darren J Yeo
- Department of Psychology and Human Development, Peabody College, Vanderbilt University, Nashville, TN 37203, USA
- Division of Psychology, School of Social Sciences, Nanyang Technological University, 639818, Singapore
| | - Gavin R Price
- Department of Psychology and Human Development, Peabody College, Vanderbilt University, Nashville, TN 37203, USA
| |
Collapse
|
45
|
Provenzano D, Washington SD, Rao YJ, Loew M, Baraniuk J. Machine Learning Detects Pattern of Differences in Functional Magnetic Resonance Imaging (fMRI) Data between Chronic Fatigue Syndrome (CFS) and Gulf War Illness (GWI). Brain Sci 2020; 10:brainsci10070456. [PMID: 32708912 PMCID: PMC7407325 DOI: 10.3390/brainsci10070456] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Revised: 07/11/2020] [Accepted: 07/14/2020] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND Gulf War Illness (GWI) and Chronic Fatigue Syndrome (CFS) are two debilitating disorders that share similar symptoms of chronic pain, fatigue, and exertional exhaustion after exercise. Many physicians continue to believe that both are psychosomatic disorders and to date no underlying etiology has been discovered. As such, uncovering objective biomarkers is important to lend credibility to criteria for diagnosis and to help differentiate the two disorders. METHODS We assessed cognitive differences in 80 subjects with GWI and 38 with CFS by comparing corresponding fMRI scans during 2-back working memory tasks before and after exercise to model brain activation during normal activity and after exertional exhaustion, respectively. Voxels were grouped by the count of total activity into the Automated Anatomical Labeling (AAL) atlas and used in an "ensemble" series of machine learning algorithms to assess if a multi-regional pattern of differences in the fMRI scans could be detected. RESULTS A K-Nearest Neighbor (70%/81%), Linear Support Vector Machine (SVM) (70%/77%), Decision Tree (82%/82%), Random Forest (77%/78%), AdaBoost (69%/81%), Naïve Bayes (74%/78%), Quadratic Discriminant Analysis (QDA) (73%/75%), Logistic Regression model (82%/82%), and Neural Net (76%/77%) were able to differentiate CFS from GWI before and after exercise with an average of 75% accuracy in predictions across all models before exercise and 79% after exercise. An iterative feature selection and removal process based on Recursive Feature Elimination (RFE) and Random Forest importance selected 30 regions before exercise and 33 regions after exercise that differentiated CFS from GWI across all models, and produced the ultimate best accuracies of 82% before exercise and 82% after exercise by Logistic Regression or Decision Tree by a single model, and 100% before and after exercise when selected by any six or more models. Differential activation on both days included the right anterior insula, left putamen, and bilateral orbital frontal, ventrolateral prefrontal cortex, superior, inferior, and precuneus (medial) parietal, and lateral temporal regions. Day 2 had the cerebellum, left supplementary motor area and bilateral pre- and post-central gyri. Changes between days included the right Rolandic operculum switching to the left on Day 2, and the bilateral midcingulum switching to the left anterior cingulum. CONCLUSION We concluded that CFS and GWI are significantly differentiable using a pattern of fMRI activity based on an ensemble machine learning model.
Collapse
Affiliation(s)
- Destie Provenzano
- School of Medicine, Georgetown University, Washington, DC 20057, USA; (D.P.); (S.D.W.)
- School of Engineering and Applied Science, George Washington University, Washington, DC 20052, USA;
| | - Stuart D. Washington
- School of Medicine, Georgetown University, Washington, DC 20057, USA; (D.P.); (S.D.W.)
| | - Yuan J. Rao
- School of Medicine and Health Sciences, George Washington University, Washington, DC 20052, USA;
| | - Murray Loew
- School of Engineering and Applied Science, George Washington University, Washington, DC 20052, USA;
| | - James Baraniuk
- School of Medicine, Georgetown University, Washington, DC 20057, USA; (D.P.); (S.D.W.)
- Correspondence:
| |
Collapse
|
46
|
Lei M, Miyoshi T, Dan I, Sato H. Using a Data-Driven Approach to Estimate Second-Language Proficiency From Brain Activation: A Functional Near-Infrared Spectroscopy Study. Front Neurosci 2020; 14:694. [PMID: 32754011 PMCID: PMC7365871 DOI: 10.3389/fnins.2020.00694] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 06/08/2020] [Indexed: 12/19/2022] Open
Abstract
While non-invasive brain imaging has made substantial contributions to advance human brain science, estimation of individual state is becoming important to realize its applications in society. Brain activations were used to classify second-language proficiencies. Participants in functional near-infrared spectroscopy (fNIRS) experiment were 20/20 native Japanese speakers with high/low English abilities and 19/19 native English speakers with high/low Japanese abilities. Their cortical activities were measured by functional near-infrared spectroscopy while they were conducting Japanese/English listening comprehension tests. The data-driven method achieved classification accuracy of 77.5% in the case of Japanese speakers and 81.9% in the case of English speakers. The informative features predominantly originated from regions associated with language function. These results bring an insight of fNIRS neuroscience and its applications in society.
Collapse
Affiliation(s)
- Miaomei Lei
- Research & Development Group, Hitachi, Ltd., Tokyo, Japan
| | | | - Ippeita Dan
- Research and Development Initiatives, Applied Cognitive Neuroscience Laboratory, Chuo University, Tokyo, Japan
| | - Hiroki Sato
- Department of Bioscience and Engineering, College of Systems Engineering and Science, Shibaura Institute of Technology, Saitama, Japan
| |
Collapse
|
47
|
Weaverdyck ME, Lieberman MD, Parkinson C. Tools of the Trade Multivoxel pattern analysis in fMRI: a practical introduction for social and affective neuroscientists. Soc Cogn Affect Neurosci 2020; 15:487-509. [PMID: 32364607 PMCID: PMC7308652 DOI: 10.1093/scan/nsaa057] [Citation(s) in RCA: 57] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 04/08/2020] [Accepted: 04/15/2020] [Indexed: 12/26/2022] Open
Abstract
The family of neuroimaging analytical techniques known as multivoxel pattern analysis (MVPA) has dramatically increased in popularity over the past decade, particularly in social and affective neuroscience research using functional magnetic resonance imaging (fMRI). MVPA examines patterns of neural responses, rather than analyzing single voxel- or region-based values, as is customary in conventional univariate analyses. Here, we provide a practical introduction to MVPA and its most popular variants (namely, representational similarity analysis (RSA) and decoding analyses, such as classification using machine learning) for social and affective neuroscientists of all levels, particularly those new to such methods. We discuss how MVPA differs from traditional mass-univariate analyses, the benefits MVPA offers to social neuroscientists, experimental design and analysis considerations, step-by-step instructions for how to implement specific analyses in one's own dataset and issues that are currently facing research using MVPA methods.
Collapse
Affiliation(s)
- Miriam E Weaverdyck
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
| | - Matthew D Lieberman
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
| | - Carolyn Parkinson
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
- Brain Research Institute, University of California, Los Angeles, CA 90095, USA
| |
Collapse
|
48
|
Gutiérrez-Gómez L, Vohryzek J, Chiêm B, Baumann PS, Conus P, Cuenod KD, Hagmann P, Delvenne JC. Stable biomarker identification for predicting schizophrenia in the human connectome. NEUROIMAGE-CLINICAL 2020; 27:102316. [PMID: 32623137 PMCID: PMC7334612 DOI: 10.1016/j.nicl.2020.102316] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/23/2019] [Revised: 06/12/2020] [Accepted: 06/13/2020] [Indexed: 12/11/2022]
Abstract
Schizophrenia, as a psychiatric disorder, has recognized brain alterations both at the structural and at the functional magnetic resonance imaging level. The developing field of connectomics has attracted much attention as it allows researchers to take advantage of powerful tools of network analysis in order to study structural and functional connectivity abnormalities in schizophrenia. Many methods have been proposed to identify biomarkers in schizophrenia, focusing mainly on improving the classification performance or performing statistical comparisons between groups. However, the stability of biomarkers selection has been for long overlooked in the connectomics field. In this study, we follow a machine learning approach where the identification of biomarkers is addressed as a feature selection problem for a classification task. We perform a recursive feature elimination and support vector machines (RFE-SVM) approach to identify the most meaningful biomarkers from the structural, functional, and multi-modal connectomes of healthy controls and patients. Furthermore, the stability of the retrieved biomarkers is assessed across different subsamplings of the dataset, allowing us to identify the affected core of the pathology. Considering our technique altogether, it demonstrates a principled way to achieve both accurate and stable biomarkers while highlighting the importance of multi-modal approaches to brain pathology as they tend to reveal complementary information.
Collapse
Affiliation(s)
- Leonardo Gutiérrez-Gómez
- Institute for Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), Université catholique de Louvain, Louvain-la-Neuve, Belgium.
| | - Jakub Vohryzek
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom; Department of Radiology, University Hospital Centre and University of Lausanne, Lausanne, Switzerland.
| | - Benjamin Chiêm
- Institute for Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), Université catholique de Louvain, Louvain-la-Neuve, Belgium.
| | - Philipp S Baumann
- Service of General Psychiatry and Center for Psychiatric Neuroscience, Department of Psychiatry, Lausanne University Hospital (CHUV), Lausanne, Switzerland.
| | - Philippe Conus
- Service of General Psychiatry and Center for Psychiatric Neuroscience, Department of Psychiatry, Lausanne University Hospital (CHUV), Lausanne, Switzerland.
| | - Kim Do Cuenod
- Service of General Psychiatry and Center for Psychiatric Neuroscience, Department of Psychiatry, Lausanne University Hospital (CHUV), Lausanne, Switzerland.
| | - Patric Hagmann
- Department of Radiology, University Hospital Centre and University of Lausanne, Lausanne, Switzerland.
| | - Jean-Charles Delvenne
- Institute for Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), Université catholique de Louvain, Louvain-la-Neuve, Belgium; Center for Operations Research and Econometrics (CORE), Université catholique de Louvain, Louvain-la-Neuve, Belgium.
| |
Collapse
|
49
|
Abstract
Support vector machines (SVMs) are being used increasingly in affective science as a data-driven classification method and feature reduction technique. Whereas traditional statistical methods typically compare group averages on selected variables, SVMs use a predictive algorithm to learn multivariate patterns that optimally discriminate between groups. In this review, we provide a framework for understanding the methods of SVM-based analyses and summarize the findings of seminal studies that use SVMs for classification or data reduction in the behavioral and neural study of emotion and affective disorders. We conclude by discussing promising directions and potential applications of SVMs in future research in affective science.
Collapse
Affiliation(s)
| | - Matthew D. Sacchet
- Center for Depression, Anxiety, and Stress Research, McLean Hospital, Harvard Medical School, USA
| | - Ian H. Gotlib
- Department of Psychology, Stanford Neurosciences Institute, Stanford University, USA
| |
Collapse
|
50
|
Logistic Regression Algorithm Differentiates Gulf War Illness (GWI) Functional Magnetic Resonance Imaging (fMRI) Data from a Sedentary Control. Brain Sci 2020; 10:brainsci10050319. [PMID: 32466139 PMCID: PMC7287630 DOI: 10.3390/brainsci10050319] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2020] [Revised: 05/15/2020] [Accepted: 05/22/2020] [Indexed: 11/16/2022] Open
Abstract
Gulf War Illness (GWI) is a debilitating condition characterized by dysfunction of cognition, pain, fatigue, sleep, and diverse somatic symptoms with no known underlying pathology. As such, uncovering objective biomarkers such as differential regions of activity within a Functional Magnetic Resonance Imaging (fMRI) scan is important to enhance validity of the criteria for diagnosis. Symptoms are exacerbated by mild activity, and exertional exhaustion is a key complaint amongst sufferers. We modeled this exertional exhaustion by having GWI (n = 80) and sedentary control (n = 31) subjects perform submaximal exercise stress tests on two consecutive days. Cognitive differences were assessed by comparing fMRI scans performed during 2-Back working memory tasks before and after the exercise. Machine learning algorithms were used to identify differences in brain activation patterns between the two groups on Day 1 (before exercise) and Day 2 (after exercise). The numbers of voxels with t > 3.17 (corresponding to p < 0.001 uncorrected) were determined for brain regions defined by the Automated Anatomical Labeling (AAL) atlas. Data were divided 70:30 into training and test sets. Recursive feature selection identified twenty-nine regions of interest (ROIs) that significantly distinguished GWI from control on Day 1 and 28 ROIs on Day 2. Ten regions were present in both models between the two days, including right anterior insula, orbital frontal cortex, thalamus, bilateral temporal poles, and left supramarginal gyrus and cerebellar Crus 1. The models had 70% accuracy before exercise on Day 1 and 85% accuracy after exercise on Day 2, indicating the logistic regression model significantly differentiated subjects with GWI from the sedentary control group. Exercise caused changes in these patterns that may indicate the cognitive differences caused by exertional exhaustion. A second set of predictive models was able to classify previously identified GWI exercise subgroups START, STOPP, and POTS for both Days 1 and Days 2 with 67% and 69% accuracy respectively. This study was the first of its kind to differentiate GWI and the three sub-phenotypes START, STOPP, and POTS from a sedentary control using a logistic regression estimation method.
Collapse
|