1
|
Robert S, Granovetter MC, Patterson C, Behrmann M. Hemispheric functional organization, as revealed by naturalistic neuroimaging, in pediatric epilepsy patients with cortical resections. Proc Natl Acad Sci U S A 2024; 121:e2317458121. [PMID: 38950362 PMCID: PMC11252739 DOI: 10.1073/pnas.2317458121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2023] [Accepted: 05/14/2024] [Indexed: 07/03/2024] Open
Abstract
Functional changes in the pediatric brain following neural injuries attest to remarkable feats of plasticity. Investigations of the neurobiological mechanisms that underlie this plasticity have largely focused on activation in the penumbra of the lesion or in contralesional, homotopic regions. Here, we adopt a whole-brain approach to evaluate the plasticity of the cortex in patients with large unilateral cortical resections due to drug-resistant childhood epilepsy. We compared the functional connectivity (FC) in patients' preserved hemisphere with the corresponding hemisphere of matched controls as they viewed and listened to a movie excerpt in a functional magnetic resonance imaging (fMRI) scanner. The preserved hemisphere was segmented into 180 and 200 parcels using two different anatomical atlases. We calculated all pairwise multivariate statistical dependencies between parcels, or parcel edges, and between 22 and 7 larger-scale functional networks, or network edges, aggregated from the smaller parcel edges. Both the left and right hemisphere-preserved patient groups had widespread reductions in FC relative to matched controls, particularly for within-network edges. A case series analysis further uncovered subclusters of patients with distinctive edgewise changes relative to controls, illustrating individual postoperative connectivity profiles. The large-scale differences in networks of the preserved hemisphere potentially reflect plasticity in the service of maintained and/or retained cognitive function.
Collapse
Affiliation(s)
- Sophia Robert
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA15213
- The Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA15213
| | - Michael C. Granovetter
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA15213
- The Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA15213
- School of Medicine, University of Pittsburgh, Pittsburgh, PA15213
| | - Christina Patterson
- Department of Pediatrics, Division of Child Neurology, University of Pittsburgh, Pittsburgh, PA15213
| | - Marlene Behrmann
- Department of Psychology, Carnegie Mellon University, Pittsburgh, PA15213
- The Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA15213
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA15219
| |
Collapse
|
2
|
Basti A, Nolte G, Guidotti R, Ilmoniemi RJ, Romani GL, Pizzella V, Marzetti L. A bicoherence approach to analyze multi-dimensional cross-frequency coupling in EEG/MEG data. Sci Rep 2024; 14:8461. [PMID: 38605061 PMCID: PMC11009359 DOI: 10.1038/s41598-024-57014-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 03/13/2024] [Indexed: 04/13/2024] Open
Abstract
We introduce a blockwise generalisation of the Antisymmetric Cross-Bicoherence (ACB), a statistical method based on bispectral analysis. The Multi-dimensional ACB (MACB) is an approach that aims at detecting quadratic lagged phase-interactions between vector time series in the frequency domain. Such a coupling can be empirically observed in functional neuroimaging data, e.g., in electro/magnetoencephalographic signals. MACB is invariant under orthogonal trasformations of the data, which makes it independent, e.g., on the choice of the physical coordinate system in the neuro-electromagnetic inverse procedure. In extensive synthetic experiments, we prove that MACB performance is significantly better than that obtained by ACB. Specifically, the shorter the data length, or the higher the dimension of the single data space, the larger the difference between the two methods.
Collapse
Affiliation(s)
- Alessio Basti
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University of Chieti-Pescara, 66100, Chieti, Italy.
| | - Guido Nolte
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany
| | - Roberto Guidotti
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University of Chieti-Pescara, 66100, Chieti, Italy
| | - Risto J Ilmoniemi
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 02150, Espoo, Finland
- BioMag Laboratory, HUS Medical Imaging Center, University of Helsinki, Aalto University and Helsinki University Hospital, 00029, Helsinki, Finland
| | - Gian Luca Romani
- Institute for Advanced Biomedical Technologies, "G. d'Annunzio" University of Chieti-Pescara, 66100, Chieti, Italy
| | - Vittorio Pizzella
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University of Chieti-Pescara, 66100, Chieti, Italy
| | - Laura Marzetti
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University of Chieti-Pescara, 66100, Chieti, Italy
| |
Collapse
|
3
|
Rahimi S, Jackson R, Farahibozorg SR, Hauk O. Time-Lagged Multidimensional Pattern Connectivity (TL-MDPC): An EEG/MEG pattern transformation based functional connectivity metric. Neuroimage 2023; 270:119958. [PMID: 36813063 PMCID: PMC10030313 DOI: 10.1016/j.neuroimage.2023.119958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 01/16/2023] [Accepted: 02/19/2023] [Indexed: 02/23/2023] Open
Abstract
Functional and effective connectivity methods are essential to study the complex information flow in brain networks underlying human cognition. Only recently have connectivity methods begun to emerge that make use of the full multidimensional information contained in patterns of brain activation, rather than unidimensional summary measures of these patterns. To date, these methods have mostly been applied to fMRI data, and no method allows vertex-to-vertex transformations with the temporal specificity of EEG/MEG data. Here, we introduce time-lagged multidimensional pattern connectivity (TL-MDPC) as a novel bivariate functional connectivity metric for EEG/MEG research. TL-MDPC estimates the vertex-to-vertex transformations among multiple brain regions and across different latency ranges. It determines how well patterns in ROI X at time point tx can linearly predict patterns of ROI Y at time point ty. In the present study, we use simulations to demonstrate TL-MDPC's increased sensitivity to multidimensional effects compared to a unidimensional approach across realistic choices of number of trials and signal-to-noise ratios. We applied TL-MDPC, as well as its unidimensional counterpart, to an existing dataset varying the depth of semantic processing of visually presented words by contrasting a semantic decision and a lexical decision task. TL-MDPC detected significant effects beginning very early on, and showed stronger task modulations than the unidimensional approach, suggesting that it is capable of capturing more information. With TL-MDPC only, we observed rich connectivity between core semantic representation (left and right anterior temporal lobes) and semantic control (inferior frontal gyrus and posterior temporal cortex) areas with greater semantic demands. TL-MDPC is a promising approach to identify multidimensional connectivity patterns, typically missed by unidimensional approaches.
Collapse
Affiliation(s)
- Setareh Rahimi
- MRC Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge CB2 7EF United Kingdom.
| | - Rebecca Jackson
- Department of Psychology & York Biomedical Research Institute, University of York, United Kingdom; MRC Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge CB2 7EF United Kingdom
| | - Seyedeh-Rezvan Farahibozorg
- Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, University of Oxford, United Kingdom
| | - Olaf Hauk
- MRC Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge CB2 7EF United Kingdom
| |
Collapse
|
4
|
Fang M, Aglinskas A, Li Y, Anzellotti S. Angular Gyrus Responses Show Joint Statistical Dependence with Brain Regions Selective for Different Categories. J Neurosci 2023; 43:2756-2766. [PMID: 36894316 PMCID: PMC10089240 DOI: 10.1523/jneurosci.1283-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 02/13/2023] [Accepted: 02/20/2023] [Indexed: 03/11/2023] Open
Abstract
Category selectivity is a fundamental principle of organization of perceptual brain regions. Human occipitotemporal cortex is subdivided into areas that respond preferentially to faces, bodies, artifacts, and scenes. However, observers need to combine information about objects from different categories to form a coherent understanding of the world. How is this multicategory information encoded in the brain? Studying the multivariate interactions between brain regions of male and female human subjects with fMRI and artificial neural networks, we found that the angular gyrus shows joint statistical dependence with multiple category-selective regions. Adjacent regions show effects for the combination of scenes and each other category, suggesting that scenes provide a context to combine information about the world. Additional analyses revealed a cortical map of areas that encode information across different subsets of categories, indicating that multicategory information is not encoded in a single centralized location, but in multiple distinct brain regions.SIGNIFICANCE STATEMENT Many cognitive tasks require combining information about entities from different categories. However, visual information about different categorical objects is processed by separate, specialized brain regions. How is the joint representation from multiple category-selective regions implemented in the brain? Using fMRI movie data and state-of-the-art multivariate statistical dependence based on artificial neural networks, we identified the angular gyrus encoding responses across face-, body-, artifact-, and scene-selective regions. Further, we showed a cortical map of areas that encode information across different subsets of categories. These findings suggest that multicategory information is not encoded in a single centralized location, but at multiple cortical sites which might contribute to distinct cognitive functions, offering insights to understand integration in a variety of domains.
Collapse
Affiliation(s)
- Mengting Fang
- Department of Psychology and Neuroscience, Boston College, Boston, Massachusetts 02467
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Aidas Aglinskas
- Department of Psychology and Neuroscience, Boston College, Boston, Massachusetts 02467
| | - Yichen Li
- Department of Psychology, Harvard University, Cambridge, Massachusetts 02138
| | - Stefano Anzellotti
- Department of Psychology and Neuroscience, Boston College, Boston, Massachusetts 02467
| |
Collapse
|
5
|
Fang M, Poskanzer C, Anzellotti S. Multivariate connectivity: A brief introduction and an open question. Front Neurosci 2023; 16:1082120. [PMID: 36704006 PMCID: PMC9871770 DOI: 10.3389/fnins.2022.1082120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Accepted: 12/16/2022] [Indexed: 01/11/2023] Open
Affiliation(s)
- Mengting Fang
- University of Pennsylvania, Philadelphia, PA, United States
| | | | | |
Collapse
|
6
|
Representations and decodability of diverse cognitive functions are preserved across the human cortex, cerebellum, and subcortex. Commun Biol 2022; 5:1245. [PMCID: PMC9663596 DOI: 10.1038/s42003-022-04221-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Accepted: 11/03/2022] [Indexed: 11/16/2022] Open
Abstract
AbstractWhich part of the brain contributes to our complex cognitive processes? Studies have revealed contributions of the cerebellum and subcortex to higher-order cognitive functions; however, it has been unclear whether such functional representations are preserved across the cortex, cerebellum, and subcortex. In this study, we use functional magnetic resonance imaging data with 103 cognitive tasks and construct three voxel-wise encoding and decoding models independently using cortical, cerebellar, and subcortical voxels. Representational similarity analysis reveals that the structure of task representations is preserved across the three brain parts. Principal component analysis visualizes distinct organizations of abstract cognitive functions in each part of the cerebellum and subcortex. More than 90% of the cognitive tasks are decodable from the cerebellum and subcortical activities, even for the novel tasks not included in model training. Furthermore, we show that the cerebellum and subcortex have sufficient information to reconstruct activity in the cerebral cortex.
Collapse
|
7
|
Poskanzer C, Anzellotti S. Functional coordinates: Modeling interactions between brain regions as points in a function space. Netw Neurosci 2022; 6:1296-1315. [PMID: 38800459 PMCID: PMC11117108 DOI: 10.1162/netn_a_00264] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Accepted: 06/22/2022] [Indexed: 05/29/2024] Open
Abstract
Here, we propose a novel technique to investigate nonlinear interactions between brain regions that captures both the strength and type of the functional relationship. Inspired by the field of functional analysis, we propose that the relationship between activity in separate brain areas can be viewed as a point in function space, identified by coordinates along an infinite set of basis functions. Using Hermite polynomials as bases, we estimate a subset of these values that serve as "functional coordinates," characterizing the interaction between BOLD activity across brain areas. We provide a proof of the convergence of the estimates in the limit, and we validate the method with simulations in which the ground truth is known, additionally showing that functional coordinates detect statistical dependence even when correlations ("functional connectivity") approach zero. We then use functional coordinates to examine neural interactions with a chosen seed region: the fusiform face area (FFA). Using k-means clustering across each voxel's functional coordinates, we illustrate that adding nonlinear basis functions allows for the discrimination of interregional interactions that are otherwise grouped together when using only linear dependence. Finally, we show that regions in V5 and medial occipital and temporal lobes exhibit significant nonlinear interactions with the FFA.
Collapse
Affiliation(s)
- Craig Poskanzer
- Department of Psychology, Columbia University, New York City, NY, USA
- Department of Psychology and Neuroscience, Boston College, Boston, MA, USA
| | - Stefano Anzellotti
- Department of Psychology and Neuroscience, Boston College, Boston, MA, USA
| |
Collapse
|
8
|
Poskanzer C, Fang M, Aglinskas A, Anzellotti S. Controlling for Spurious Nonlinear Dependence in Connectivity Analyses. Neuroinformatics 2022; 20:599-611. [PMID: 34519963 DOI: 10.1007/s12021-021-09540-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/03/2021] [Indexed: 12/31/2022]
Abstract
Recent analysis methods can capture nonlinear interactions between brain regions. However, noise sources might induce spurious nonlinear relationships between the responses in different regions. Previous research has demonstrated that traditional denoising techniques effectively remove noise-induced linear relationships between brain areas, but it is unknown whether these techniques can remove spurious nonlinear relationships. To address this question, we analyzed fMRI responses while participants watched the film Forrest Gump. We tested whether nonlinear Multivariate Pattern Dependence Networks (MVPN) outperform linear MVPN in non-denoised data, and whether this difference is reduced after CompCor denoising. Whereas nonlinear MVPN outperformed linear MVPN in the non-denoised data, denoising removed these nonlinear interactions. We replicated our results using different neural network architectures as the bases of MVPN, different activation functions (ReLU and sigmoid), different dimensionality reduction techniques for CompCor (PCA and ICA), and multiple datasets, demonstrating that CompCor's ability to remove nonlinear interactions is robust across these analysis choices and across different groups of participants. Finally, we asked whether information contributing to the removal of nonlinear interactions is localized to specific anatomical regions of no interest or to specific principal components. We denoised the data 8 separate times by regressing out 5 principal components extracted from combined white matter (WM) and cerebrospinal fluid (CSF), each of the 5 components separately, 5 components extracted from WM only, and 5 components extracted solely from CSF. In all cases, denoising was sufficient to remove the observed nonlinear interactions.
Collapse
Affiliation(s)
- Craig Poskanzer
- Department of Psychology and Neuroscience, Boston College, Boston, 02467, MA, USA.
| | - Mengting Fang
- Department of Psychology and Neuroscience, Boston College, Boston, 02467, MA, USA
| | - Aidas Aglinskas
- Department of Psychology and Neuroscience, Boston College, Boston, 02467, MA, USA
| | - Stefano Anzellotti
- Department of Psychology and Neuroscience, Boston College, Boston, 02467, MA, USA
| |
Collapse
|
9
|
Fang M, Poskanzer C, Anzellotti S. PyMVPD: A Toolbox for Multivariate Pattern Dependence. Front Neuroinform 2022; 16:835772. [PMID: 35811995 PMCID: PMC9262406 DOI: 10.3389/fninf.2022.835772] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Accepted: 05/17/2022] [Indexed: 11/13/2022] Open
Abstract
Cognitive tasks engage multiple brain regions. Studying how these regions interact is key to understand the neural bases of cognition. Standard approaches to model the interactions between brain regions rely on univariate statistical dependence. However, newly developed methods can capture multivariate dependence. Multivariate pattern dependence (MVPD) is a powerful and flexible approach that trains and tests multivariate models of the interactions between brain regions using independent data. In this article, we introduce PyMVPD: an open source toolbox for multivariate pattern dependence. The toolbox includes linear regression models and artificial neural network models of the interactions between regions. It is designed to be easily customizable. We demonstrate example applications of PyMVPD using well-studied seed regions such as the fusiform face area (FFA) and the parahippocampal place area (PPA). Next, we compare the performance of different model architectures. Overall, artificial neural networks outperform linear regression. Importantly, the best performing architecture is region-dependent: MVPD subdivides cortex in distinct, contiguous regions whose interaction with FFA and PPA is best captured by different models.
Collapse
|
10
|
Ayzenberg V, Behrmann M. The Dorsal Visual Pathway Represents Object-Centered Spatial Relations for Object Recognition. J Neurosci 2022; 42:4693-4710. [PMID: 35508386 PMCID: PMC9186804 DOI: 10.1523/jneurosci.2257-21.2022] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Revised: 04/19/2022] [Accepted: 04/21/2022] [Indexed: 11/21/2022] Open
Abstract
Although there is mounting evidence that input from the dorsal visual pathway is crucial for object processes in the ventral pathway, the specific functional contributions of dorsal cortex to these processes remain poorly understood. Here, we hypothesized that dorsal cortex computes the spatial relations among an object's parts, a process crucial for forming global shape percepts, and transmits this information to the ventral pathway to support object categorization. Using fMRI with human participants (females and males), we discovered regions in the intraparietal sulcus (IPS) that were selectively involved in computing object-centered part relations. These regions exhibited task-dependent functional and effective connectivity with ventral cortex, and were distinct from other dorsal regions, such as those representing allocentric relations, 3D shape, and tools. In a subsequent experiment, we found that the multivariate response of posterior (p)IPS, defined on the basis of part-relations, could be used to decode object category at levels comparable to ventral object regions. Moreover, mediation and multivariate effective connectivity analyses further suggested that IPS may account for representations of part relations in the ventral pathway. Together, our results highlight specific contributions of the dorsal visual pathway to object recognition. We suggest that dorsal cortex is a crucial source of input to the ventral pathway and may support the ability to categorize objects on the basis of global shape.SIGNIFICANCE STATEMENT Humans categorize novel objects rapidly and effortlessly. Such categorization is achieved by representing an object's global shape structure, that is, the relations among object parts. Yet, despite their importance, it is unclear how part relations are represented neurally. Here, we hypothesized that object-centered part relations may be computed by the dorsal visual pathway, which is typically implicated in visuospatial processing. Using fMRI, we identified regions selective for the part relations in dorsal cortex. We found that these regions can support object categorization, and even mediate representations of part relations in the ventral pathway, the region typically thought to support object categorization. Together, these findings shed light on the broader network of brain regions that support object categorization.
Collapse
Affiliation(s)
- Vladislav Ayzenberg
- Neuroscience Institute and Psychology Department, Carnegie Mellon University, Pittsburgh, PA 15213
| | - Marlene Behrmann
- Neuroscience Institute and Psychology Department, Carnegie Mellon University, Pittsburgh, PA 15213
| |
Collapse
|
11
|
Testing the distributed representation hypothesis in object recognition in two open datasets. Neurosci Lett 2022; 783:136709. [PMID: 35667579 DOI: 10.1016/j.neulet.2022.136709] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 05/30/2022] [Accepted: 05/31/2022] [Indexed: 11/23/2022]
Abstract
Neural representation has long been thought to follow the modularity hypothesis, which states that each type of information corresponds to a specific brain area. Though supported by many studies, this hypothesis surfers the pitfall of inefficiency for information encoding. To overcome difficulties the modularity representation hypothesis faced, researchers have proposed that information may be distributed represented in a specific brain area. The distributed representation hypothesis along with the multi-variate pattern approaches have made great success in detecting representation patterns in the previous decade. However, this hypothesis implicitly requires that the pattern should be transformed in a consistent way with respect to all of the represented information in the specific brain area. And the accuracy and validity of the prediction have never been thoroughly tested. Here in the present study, we tested this prediction in two open datasets compiling the object recognition. We validated the distributed representation patterns in the lateral occipital complex/ventral temporal gyrus where all six classifiers were capable of predicting the correct category represented. Furthermore, we correlated the classifiers' decision function values to the bold signals and found that the decision function value of the logistic regression classifier was exclusively correlated with activities of the same brain area in both datasets. These results support the distributed representation hypothesis and suggest that our neural system may be embedded within the algorithm of a specific classifier.
Collapse
|
12
|
Brier LM, Zhang X, Bice AR, Gaines SH, Landsness EC, Lee JM, Anastasio MA, Culver JP. A Multivariate Functional Connectivity Approach to Mapping Brain Networks and Imputing Neural Activity in Mice. Cereb Cortex 2022; 32:1593-1607. [PMID: 34541601 PMCID: PMC9016290 DOI: 10.1093/cercor/bhab282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Revised: 07/12/2021] [Accepted: 07/14/2021] [Indexed: 11/13/2022] Open
Abstract
Temporal correlation analysis of spontaneous brain activity (e.g., Pearson "functional connectivity," FC) has provided insights into the functional organization of the human brain. However, bivariate analysis techniques such as this are often susceptible to confounding physiological processes (e.g., sleep, Mayer-waves, breathing, motion), which makes it difficult to accurately map connectivity in health and disease as these physiological processes affect FC. In contrast, a multivariate approach to imputing individual neural networks from spontaneous neuroimaging data could be influential to our conceptual understanding of FC and provide performance advantages. Therefore, we analyzed neural calcium imaging data from Thy1-GCaMP6f mice while either awake, asleep, anesthetized, during low and high bouts of motion, or before and after photothrombotic stroke. A linear support vector regression approach was used to determine the optimal weights for integrating the signals from the remaining pixels to accurately predict neural activity in a region of interest (ROI). The resultant weight maps for each ROI were interpreted as multivariate functional connectivity (MFC), resembled anatomical connectivity, and demonstrated a sparser set of strong focused positive connections than traditional FC. While global variations in data have large effects on standard correlation FC analysis, the MFC mapping methods were mostly impervious. Lastly, MFC analysis provided a more powerful connectivity deficit detection following stroke compared to traditional FC.
Collapse
Affiliation(s)
- Lindsey M Brier
- Department of Radiology, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Xiaohui Zhang
- Department of Bioengineering, University of Illinois, Urbana-Champaign, IL 61801, USA
| | - Annie R Bice
- Department of Radiology, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Seana H Gaines
- Department of Radiology, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Eric C Landsness
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63108, USA
| | - Jin-Moo Lee
- Department of Neurology, Washington University School of Medicine, St. Louis, MO 63108, USA
| | - Mark A Anastasio
- Department of Bioengineering, University of Illinois, Urbana-Champaign, IL 61801, USA
| | - Joseph P Culver
- Department of Radiology, Washington University School of Medicine, St. Louis, MO 63110, USA
- Department of Biomedical Engineering, Washington University School of Engineering, St. Louis, MO 63105, USA
- Department of Electrical and Systems Engineering, Washington University School of Engineering, St. Louis, MO 63112, USA
- Department of Physics, Washington University School of Arts and Science, St. Louis, MO 63130, USA
| |
Collapse
|
13
|
Karimi-Rouzbahani H, Woolgar A, Henson R, Nili H. Caveats and Nuances of Model-Based and Model-Free Representational Connectivity Analysis. Front Neurosci 2022; 16:755988. [PMID: 35360178 PMCID: PMC8960982 DOI: 10.3389/fnins.2022.755988] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Accepted: 02/02/2022] [Indexed: 11/30/2022] Open
Abstract
Brain connectivity analyses have conventionally relied on statistical relationship between one-dimensional summaries of activation in different brain areas. However, summarizing activation patterns within each area to a single dimension ignores the potential statistical dependencies between their multi-dimensional activity patterns. Representational Connectivity Analyses (RCA) is a method that quantifies the relationship between multi-dimensional patterns of activity without reducing the dimensionality of the data. We consider two variants of RCA. In model-free RCA, the goal is to quantify the shared information for two brain regions. In model-based RCA, one tests whether two regions have shared information about a specific aspect of the stimuli/task, as defined by a model. However, this is a new approach and the potential caveats of model-free and model-based RCA are still understudied. We first explain how model-based RCA detects connectivity through the lens of models, and then present three scenarios where model-based and model-free RCA give discrepant results. These conflicting results complicate the interpretation of functional connectivity. We highlight the challenges in three scenarios: complex intermediate models, common patterns across regions, and transformation of representational structure across brain regions. The article is accompanied by scripts (https://osf.io/3nxfa/) that reproduce the results. In each case, we suggest potential ways to mitigate the difficulties caused by inconsistent results. The results of this study shed light on some understudied aspects of RCA, and allow researchers to use the method more effectively.
Collapse
Affiliation(s)
- Hamid Karimi-Rouzbahani
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
- Department of Computing, Macquarie University, Sydney, NSW, Australia
| | - Alexandra Woolgar
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
| | - Richard Henson
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
- Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | - Hamed Nili
- Department of Excellence for Neural Information Processing, Center for Molecular Neurobiology (ZMNH), University Medical Center Hamburg-Eppendorf (UKE), Hamburg, Germany
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
14
|
Brooks JA, Stolier RM, Freeman JB. Computational approaches to the neuroscience of social perception. Soc Cogn Affect Neurosci 2021; 16:827-837. [PMID: 32986115 PMCID: PMC8343569 DOI: 10.1093/scan/nsaa127] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2019] [Revised: 07/23/2020] [Accepted: 09/09/2020] [Indexed: 11/14/2022] Open
Abstract
Across multiple domains of social perception-including social categorization, emotion perception, impression formation and mentalizing-multivariate pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data has permitted a more detailed understanding of how social information is processed and represented in the brain. As in other neuroimaging fields, the neuroscientific study of social perception initially relied on broad structure-function associations derived from univariate fMRI analysis to map neural regions involved in these processes. In this review, we trace the ways that social neuroscience studies using MVPA have built on these neuroanatomical associations to better characterize the computational relevance of different brain regions, and discuss how MVPA allows explicit tests of the correspondence between psychological models and the neural representation of social information. We also describe current and future advances in methodological approaches to multivariate fMRI data and their theoretical value for the neuroscience of social perception.
Collapse
Affiliation(s)
- Jeffrey A Brooks
- Department of Psychology, New York University, New York, NY, USA
| | - Ryan M Stolier
- Columbia University, 1190 Amsterdam Ave., New York, NY 10027, USA
| | | |
Collapse
|
15
|
Kragel PA, Čeko M, Theriault J, Chen D, Satpute AB, Wald LW, Lindquist MA, Feldman Barrett L, Wager TD. A human colliculus-pulvinar-amygdala pathway encodes negative emotion. Neuron 2021; 109:2404-2412.e5. [PMID: 34166604 DOI: 10.1016/j.neuron.2021.06.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Revised: 03/08/2021] [Accepted: 06/01/2021] [Indexed: 10/21/2022]
Abstract
Animals must rapidly respond to threats to survive. In rodents, threat-related signals are processed through a subcortical pathway from the superior colliculus to the amygdala, a putative "low road" to affective behavior. This pathway has not been well characterized in humans. We developed a novel pathway identification framework that uses pattern recognition to identify connected neural populations and optimize measurement of inter-region connectivity. We first verified that the model identifies known thalamocortical pathways with high sensitivity and specificity in 7 T (n = 56) and 3 T (n = 48) fMRI experiments. Then we identified a human functional superior colliculus-pulvinar-amygdala pathway. Activity in this pathway encodes the intensity of normative emotional responses to negative images and sounds but not pleasant images or painful stimuli. These results provide a functional description of a human "low road" pathway selective for negative exteroceptive events and demonstrate a promising method for characterizing human functional brain pathways.
Collapse
Affiliation(s)
- Philip A Kragel
- Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO 80309, USA; Department of Psychology, Emory University, Atlanta, GA 30322, USA; Department of Psychiatry and Behavioral Science, Emory University, Atlanta, GA 30322, USA.
| | - Marta Čeko
- Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO 80309, USA
| | - Jordan Theriault
- Department of Psychology, Northeastern University, Boston, MA 02115, USA
| | - Danlei Chen
- Department of Psychology, Northeastern University, Boston, MA 02115, USA
| | - Ajay B Satpute
- Department of Psychology, Northeastern University, Boston, MA 02115, USA; Athinoula A. Martinos Center for Biomedical Imaging, Boston, MA 02129, USA
| | - Lawrence W Wald
- Athinoula A. Martinos Center for Biomedical Imaging, Boston, MA 02129, USA; Harvard Medical School, Boston, MA 02129, USA
| | - Martin A Lindquist
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD 21205, USA
| | - Lisa Feldman Barrett
- Department of Psychology, Northeastern University, Boston, MA 02115, USA; Athinoula A. Martinos Center for Biomedical Imaging, Boston, MA 02129, USA; Harvard Medical School, Boston, MA 02129, USA
| | - Tor D Wager
- Institute of Cognitive Science, University of Colorado Boulder, Boulder, CO 80309, USA; Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH 03755, USA.
| |
Collapse
|
16
|
Mell MM, St-Yves G, Naselaris T. Voxel-to-voxel predictive models reveal unexpected structure in unexplained variance. Neuroimage 2021; 238:118266. [PMID: 34129949 DOI: 10.1016/j.neuroimage.2021.118266] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2019] [Revised: 06/08/2021] [Accepted: 06/11/2021] [Indexed: 11/19/2022] Open
Abstract
Encoding models based on deep convolutional neural networks (DCNN) predict BOLD responses to natural scenes in the human visual system more accurately than many other currently available models. However, DCNN-based encoding models fail to predict a significant amount of variance in the activity of most voxels in all visual areas. This failure could reflect limitations in the data (e.g., a noise ceiling), or could reflect limitations of the DCNN as a model of computation in the brain. Understanding the source and structure of the unexplained variance could therefore provide helpful clues for improving models of brain computation. Here, we characterize the structure of the variance that DCNN-based encoding models cannot explain. Using a publicly available dataset of BOLD responses to natural scenes, we determined if the source of unexplained variance was shared across voxels, individual brains, retinotopic locations, and hierarchically distant visual brain areas. We answered these questions using voxel-to-voxel (vox2vox) models that predict activity in a target voxel given activity in a population of source voxels. We found that simple linear vox2vox models increased within-subject prediction accuracy over DCNN-based models for any pair of source/target visual areas, clearly demonstrating that the source of unexplained variance is widely shared within and across visual brain areas. However, vox2vox models were not more accurate than DCNN-based encoding models when source and target voxels came from different brains, demonstrating that the source of unexplained variance was not shared across brains. Importantly, control analyses demonstrated that the source of unexplained variance was not encoded in the mean activity of source voxels, or the activity of voxels in white matter. Interestingly, the weights of vox2vox models revealed preferential connection of target voxel activity to source voxels with adjacent receptive fields, even when source and target voxels were in different functional brain areas. Finally, we found that the prediction accuracy of the vox2vox models decayed with hierarchical distance between the source and target voxels but showed detailed patterns of dependence on hierarchical relationships that we did not observe in DCNNs. Given these results, we argue that the structured variance unexplained by DCNN-based encoding models is unlikely to be entirely caused by non-neural artifacts (e.g., spatially correlated measurement noise) or a failure of DCNNs to approximate the features encoded in brain activity; rather, our results point to a need for brain models that provide both mechanistic and computational explanations for structured ongoing activity in the brain. Keywords: fMRI, encoding models, deep neural networks, functional connectivity.
Collapse
Affiliation(s)
- Maggie Mae Mell
- Department of Neuroscience, Medical University of South Carolina, Charleston, SC, USA
| | - Ghislain St-Yves
- Department of Neuroscience, Medical University of South Carolina, Charleston, SC, USA
| | - Thomas Naselaris
- Department of Neuroscience, Medical University of South Carolina, Charleston, SC, USA.
| |
Collapse
|
17
|
Kurmakaeva D, Blagovechtchenski E, Gnedykh D, Mkrtychian N, Kostromina S, Shtyrov Y. Acquisition of concrete and abstract words is modulated by tDCS of Wernicke's area. Sci Rep 2021; 11:1508. [PMID: 33452288 PMCID: PMC7811021 DOI: 10.1038/s41598-020-79967-8] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Accepted: 12/14/2020] [Indexed: 11/28/2022] Open
Abstract
Previous behavioural and neuroimaging research suggested distinct cortical systems involved in processing abstract and concrete semantics; however, there is a dearth of causal evidence to support this. To address this, we applied anodal, cathodal, or sham (placebo) tDCS over Wernicke’s area before a session of contextual learning of novel concrete and abstract words (n = 10 each), presented five times in short stories. Learning effects were assessed at lexical and semantic levels immediately after the training and, to attest any consolidation effects of overnight sleep, on the next day. We observed successful learning of all items immediately after the session, with decreased performance in Day 2 assessment. Importantly, the results differed between stimulation conditions and tasks. Whereas the accuracy of semantic judgement for abstract words was significantly lower in the sham and anodal groups on Day 2 vs. Day 1, no significant performance drop was observed in the cathodal group. Similarly, the cathodal group showed no significant overnight performance reduction in the free recall task for either of the stimuli, unlike the other two groups. Furthermore, between-group analysis showed an overall better performance of both tDCS groups over the sham group, particularly expressed for abstract semantics and cathodal stimulation. In sum, the results suggest overlapping but diverging brain mechanisms for concrete and abstract semantics and indicate a larger degree of involvement of core language areas in storing abstract knowledge. Furthermore, they demonstrate a possiblity to improve learning outcomes using neuromodulatory techniques.
Collapse
Affiliation(s)
- Diana Kurmakaeva
- Laboratory of Behavioural Neurodynamics, Saint Petersburg University, Saint Petersburg, 199004, Russian Federation.
| | - Evgeny Blagovechtchenski
- Laboratory of Behavioural Neurodynamics, Saint Petersburg University, Saint Petersburg, 199004, Russian Federation
| | - Daria Gnedykh
- Laboratory of Behavioural Neurodynamics, Saint Petersburg University, Saint Petersburg, 199004, Russian Federation
| | - Nadezhda Mkrtychian
- Laboratory of Behavioural Neurodynamics, Saint Petersburg University, Saint Petersburg, 199004, Russian Federation
| | - Svetlana Kostromina
- Laboratory of Behavioural Neurodynamics, Saint Petersburg University, Saint Petersburg, 199004, Russian Federation
| | - Yury Shtyrov
- Laboratory of Behavioural Neurodynamics, Saint Petersburg University, Saint Petersburg, 199004, Russian Federation.,Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, 8000, Aarhus, Denmark
| |
Collapse
|
18
|
Maleki Balajoo S, Asemani D, Khadem A, Soltanian-Zadeh H. Improved dynamic connection detection power in estimated dynamic functional connectivity considering multivariate dependencies between brain regions. Hum Brain Mapp 2020; 41:4264-4287. [PMID: 32643845 PMCID: PMC7502846 DOI: 10.1002/hbm.25124] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 06/21/2020] [Accepted: 06/22/2020] [Indexed: 11/10/2022] Open
Abstract
To estimate dynamic functional connectivity (dFC), the conventional method of sliding window correlation (SWC) suffers from poor performance of dynamic connection detection. This stems from the equal weighting of observations, suboptimal time scale, nonsparse output, and the fact that it is bivariate. To overcome these limitations, we exploited the kernel-reweighted logistic regression (KELLER) algorithm, a method that is common in genetic studies, to estimate dFC in resting state functional magnetic resonance imaging (rs-fMRI) data. KELLER can estimate dFC through estimating both spatial and temporal patterns of functional connectivity between brain regions. This paper compares the performance of the proposed KELLER method with current methods (SWC and tapered-SWC (T-SWC) with different window lengths) based on both simulated and real rs-fMRI data. Estimated dFC networks were assessed for detecting dynamically connected brain region pairs with hypothesis testing. Simulation results revealed that KELLER can detect dynamic connections with a statistical power of 87.35% compared with 70.17% and 58.54% associated with T-SWC (p-value = .001) and SWC (p-value <.001), respectively. Results of these different methods applied on real rs-fMRI data were investigated for two aspects: calculating the similarity between identified mean dynamic pattern and identifying dynamic pattern in default mode network (DMN). In 68% of subjects, the results of T-SWC with window length of 100 s, among different window lengths, demonstrated the highest similarity to those of KELLER. With regards to DMN, KELLER estimated previously reported dynamic connection pairs between dorsal and ventral DMN while SWC-based method was unable to detect these dynamic connections.
Collapse
Affiliation(s)
- Somayeh Maleki Balajoo
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Davud Asemani
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Ali Khadem
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Hamid Soltanian-Zadeh
- CIPCE, School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran.,School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran.,Radiology Image Analysis Lab, Henry Ford Health System, Detroit, Michigan, USA
| |
Collapse
|
19
|
Basti A, Nili H, Hauk O, Marzetti L, Henson RN. Multi-dimensional connectivity: a conceptual and mathematical review. Neuroimage 2020; 221:117179. [PMID: 32682988 DOI: 10.1016/j.neuroimage.2020.117179] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2020] [Revised: 07/13/2020] [Accepted: 07/14/2020] [Indexed: 12/12/2022] Open
Abstract
The estimation of functional connectivity between regions of the brain, for example based on statistical dependencies between the time series of activity in each region, has become increasingly important in neuroimaging. Typically, multiple time series (e.g. from each voxel in fMRI data) are first reduced to a single time series that summarises the activity in a region of interest, e.g. by averaging across voxels or by taking the first principal component; an approach we call one-dimensional connectivity. However, this summary approach ignores potential multi-dimensional connectivity between two regions, and a number of recent methods have been proposed to capture such complex dependencies. Here we review the most common multi-dimensional connectivity methods, from an intuitive perspective, from a formal (mathematical) point of view, and through a number of simulated and real (fMRI and MEG) data examples that illustrate the strengths and weaknesses of each method. The paper is accompanied with both functions and scripts, which implement each method and reproduce all the examples.
Collapse
Affiliation(s)
- Alessio Basti
- Department of Neuroscience, Imaging and Clinical Sciences, University of Chieti-Pescara, Italy; Institute for Advanced Biomedical Technologies, University of Chieti-Pescara, Italy
| | - Hamed Nili
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, United Kingdom.
| | - Olaf Hauk
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, United Kingdom
| | - Laura Marzetti
- Department of Neuroscience, Imaging and Clinical Sciences, University of Chieti-Pescara, Italy; Institute for Advanced Biomedical Technologies, University of Chieti-Pescara, Italy
| | - Richard N Henson
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, United Kingdom; Department of Psychiatry, University of Cambridge, United Kingdom
| |
Collapse
|
20
|
Weaverdyck ME, Lieberman MD, Parkinson C. Tools of the Trade Multivoxel pattern analysis in fMRI: a practical introduction for social and affective neuroscientists. Soc Cogn Affect Neurosci 2020; 15:487-509. [PMID: 32364607 PMCID: PMC7308652 DOI: 10.1093/scan/nsaa057] [Citation(s) in RCA: 57] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 04/08/2020] [Accepted: 04/15/2020] [Indexed: 12/26/2022] Open
Abstract
The family of neuroimaging analytical techniques known as multivoxel pattern analysis (MVPA) has dramatically increased in popularity over the past decade, particularly in social and affective neuroscience research using functional magnetic resonance imaging (fMRI). MVPA examines patterns of neural responses, rather than analyzing single voxel- or region-based values, as is customary in conventional univariate analyses. Here, we provide a practical introduction to MVPA and its most popular variants (namely, representational similarity analysis (RSA) and decoding analyses, such as classification using machine learning) for social and affective neuroscientists of all levels, particularly those new to such methods. We discuss how MVPA differs from traditional mass-univariate analyses, the benefits MVPA offers to social neuroscientists, experimental design and analysis considerations, step-by-step instructions for how to implement specific analyses in one's own dataset and issues that are currently facing research using MVPA methods.
Collapse
Affiliation(s)
- Miriam E Weaverdyck
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
| | - Matthew D Lieberman
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
| | - Carolyn Parkinson
- Department of Psychology, University of California, Los Angeles, CA 90095, USA
- Brain Research Institute, University of California, Los Angeles, CA 90095, USA
| |
Collapse
|
21
|
Dynamic representations in networked neural systems. Nat Neurosci 2020; 23:908-917. [PMID: 32541963 DOI: 10.1038/s41593-020-0653-3] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Accepted: 05/12/2020] [Indexed: 11/08/2022]
Abstract
A group of neurons can generate patterns of activity that represent information about stimuli; subsequently, the group can transform and transmit activity patterns across synapses to spatially distributed areas. Recent studies in neuroscience have begun to independently address the two components of information processing: the representation of stimuli in neural activity and the transmission of information in networks that model neural interactions. Yet only recently are studies seeking to link these two types of approaches. Here we briefly review the two separate bodies of literature; we then review the recent strides made to address this gap. We continue with a discussion of how patterns of activity evolve from one representation to another, forming dynamic representations that unfold on the underlying network. Our goal is to offer a holistic framework for understanding and describing neural information representation and transmission while revealing exciting frontiers for future research.
Collapse
|
22
|
Yau Y, Dadar M, Taylor M, Zeighami Y, Fellows LK, Cisek P, Dagher A. Neural Correlates of Evidence and Urgency During Human Perceptual Decision-Making in Dynamically Changing Conditions. Cereb Cortex 2020; 30:5471-5483. [PMID: 32500144 DOI: 10.1093/cercor/bhaa129] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Revised: 03/27/2020] [Accepted: 04/22/2020] [Indexed: 12/31/2022] Open
Abstract
Current models of decision-making assume that the brain gradually accumulates evidence and drifts toward a threshold that, once crossed, results in a choice selection. These models have been especially successful in primate research; however, transposing them to human fMRI paradigms has proved it to be challenging. Here, we exploit the face-selective visual system and test whether decoded emotional facial features from multivariate fMRI signals during a dynamic perceptual decision-making task are related to the parameters of computational models of decision-making. We show that trial-by-trial variations in the pattern of neural activity in the fusiform gyrus reflect facial emotional information and modulate drift rates during deliberation. We also observed an inverse-urgency signal based in the caudate nucleus that was independent of sensory information but appeared to slow decisions, particularly when information in the task was ambiguous. Taken together, our results characterize how decision parameters from a computational model (i.e., drift rate and urgency signal) are involved in perceptual decision-making and reflected in the activity of the human brain.
Collapse
Affiliation(s)
- Y Yau
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montréal, Quebec H3A 2B4, Canada
| | - M Dadar
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montréal, Quebec H3A 2B4, Canada
| | - M Taylor
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montréal, Quebec H3A 2B4, Canada.,Schulich School of Medicine and Dentistry, University of Western Ontario, London, Ontario, N6A 5C1, Canada
| | - Y Zeighami
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montréal, Quebec H3A 2B4, Canada
| | - L K Fellows
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montréal, Quebec H3A 2B4, Canada
| | - P Cisek
- Département of Neuroscience, Université of Montréal, Montréal, Quebec H3C 3J7, Canada
| | - A Dagher
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montréal, Quebec H3A 2B4, Canada
| |
Collapse
|
23
|
Mesocorticolimbic Pathways Encode Cue-Based Expectancy Effects on Pain. J Neurosci 2019; 40:382-394. [PMID: 31694965 DOI: 10.1523/jneurosci.1082-19.2019] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2019] [Revised: 10/25/2019] [Accepted: 10/31/2019] [Indexed: 12/12/2022] Open
Abstract
Expectation interacting with nociceptive input can shape the perception of pain. It has been suggested that reward-related expectations are associated with the activation of the ventral tegmental area (VTA), which projects to the striatum (e.g., nucleus accumbens [NAc]) and prefrontal cortex (e.g., rostral anterior cingulate cortex [rACC]). However, the role of these projection pathways in encoding expectancy effects on pain remains unclear. In this study, we leveraged a visual cue conditioning paradigm with a long pain anticipation period and collected magnetic resonance imaging (MRI) data from 30 healthy human subjects (14 females). At the within-subject level, whole-brain functional connectivity (FC) analyses showed that the mesocortical pathway (VTA-rACC FC) and the mesolimbic pathway (VTA-NAc FC) were enhanced with positive expectation but inhibited with negative expectation during pain anticipation period. Mediation analyses revealed that cue-based expectancy effects on pain were mainly mediated by the VTA-NAc FC, and structural equation modeling showed that VTA-based FC influenced pain perception by modulating pain-evoked brain responses. At the between-subject level, multivariate pattern analyses demonstrated that gray matter volumes in the VTA, NAc, and rACC were able to predict the magnitudes of conditioned pain responses associated with positive and/or negative expectations across subjects. Our results therefore advance the current understanding of how the reward system is linked to the interaction between expectation and pain. Furthermore, they provide precise functional and structural information on mesocorticolimibic pathways that encode within-subject and between-subject variability of expectancy effects on pain.SIGNIFICANCE STATEMENT Studies have suggested that reward-related expectation is associated with the activation of the VTA, which projects to the striatum and prefrontal cortex. However, the role of these projection pathways in encoding expectancy effects on pain remains unclear. Using multimodality MRI and a visual cue conditioning paradigm, we found that the functional connectivity and gray matter volumes in key regions (the VTA, NAc, and rostral ACC) within the mesocorticolimbic pathways encoded expectancy effects on pain. Our results advance the current understanding of how the reward system is linked to the interaction between expectation and pain, and provide precise functional and structural information on mesocorticolimbic pathways that encode expectancy effects on pain.
Collapse
|
24
|
Analysing linear multivariate pattern transformations in neuroimaging data. PLoS One 2019; 14:e0223660. [PMID: 31613918 PMCID: PMC6793861 DOI: 10.1371/journal.pone.0223660] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Accepted: 09/24/2019] [Indexed: 11/19/2022] Open
Abstract
Most connectivity metrics in neuroimaging research reduce multivariate activity patterns in regions-of-interests (ROIs) to one dimension, which leads to a loss of information. Importantly, it prevents us from investigating the transformations between patterns in different ROIs. Here, we applied linear estimation theory in order to robustly estimate the linear transformations between multivariate fMRI patterns with a cross-validated ridge regression approach. We used three functional connectivity metrics that describe different features of these voxel-by-voxel mappings: goodness-of-fit, sparsity and pattern deformation. The goodness-of-fit describes the degree to which the patterns in an input region can be described as a linear transformation of patterns in an output region. The sparsity metric, which relies on a Monte Carlo procedure, was introduced in order to test whether the transformation mostly consists of one-to-one mappings between voxels in different regions. Furthermore, we defined a metric for pattern deformation, i.e. the degree to which the transformation rotates or rescales the input patterns. As a proof of concept, we applied these metrics to an event-related fMRI data set consisting of four subjects that has been used in previous studies. We focused on the transformations from early visual cortex (EVC) to inferior temporal cortex (ITC), fusiform face area (FFA) and parahippocampal place area (PPA). Our results suggest that the estimated linear mappings explain a significant amount of response variance in the three output ROIs. The transformation from EVC to ITC shows the highest goodness-of-fit, and those from EVC to FFA and PPA show the expected preference for faces and places as well as animate and inanimate objects, respectively. The pattern transformations are sparse, but sparsity is lower than would have been expected for one-to-one mappings, thus suggesting the presence of one-to-few voxel mappings. The mappings are also characterised by different levels of pattern deformations, thus indicating that the transformations differentially amplify or dampen certain dimensions of the input patterns. While our results are only based on a small number of subjects, they show that our pattern transformation metrics can describe novel aspects of multivariate functional connectivity in neuroimaging data.
Collapse
|
25
|
Li Y, Saxe R, Anzellotti S. Intersubject MVPD: Empirical comparison of fMRI denoising methods for connectivity analysis. PLoS One 2019; 14:e0222914. [PMID: 31550276 PMCID: PMC6759145 DOI: 10.1371/journal.pone.0222914] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2019] [Accepted: 09/10/2019] [Indexed: 11/18/2022] Open
Abstract
Noise is a major challenge for the analysis of fMRI data in general and for connectivity analyses in particular. As researchers develop increasingly sophisticated tools to model statistical dependence between the fMRI signal in different brain regions, there is a risk that these models may increasingly capture artifactual relationships between regions, that are the result of noise. Thus, choosing optimal denoising methods is a crucial step to maximize the accuracy and reproducibility of connectivity models. Most comparisons between denoising methods require knowledge of the ground truth: of what is the ‘real signal’. For this reason, they are usually based on simulated fMRI data. However, simulated data may not match the statistical properties of real data, limiting the generalizability of the conclusions. In this article, we propose an approach to evaluate denoising methods using real (non-simulated) fMRI data. First, we introduce an intersubject version of multivariate pattern dependence (iMVPD) that computes the statistical dependence between a brain region in one participant, and another brain region in a different participant. iMVPD has the following advantages: 1) it is multivariate, 2) it trains and tests models on independent partitions of the real fMRI data, and 3) it generates predictions that are both between subjects and between regions. Since whole-brain sources of noise are more strongly correlated within subject than between subjects, we can use the difference between standard MVPD and iMVPD as a ‘discrepancy metric’ to evaluate denoising techniques (where more effective techniques should yield smaller differences). As predicted, the difference is the greatest in the absence of denoising methods. Furthermore, a combination of removal of the global signal and CompCorr optimizes denoising (among the set of denoising options tested).
Collapse
Affiliation(s)
- Yichen Li
- Courant Institute of Mathematical Sciences, New York University, New York, NY, United States of America
- Department of Computer Science, New York University, New York, NY, United States of America
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States of America
| | - Rebecca Saxe
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, United States of America
| | - Stefano Anzellotti
- Department of Psychology, Boston College, Chestnut Hill, MA, United States of America
- * E-mail:
| |
Collapse
|
26
|
Brooks JA, Freeman JB. Neuroimaging of person perception: A social-visual interface. Neurosci Lett 2017; 693:40-43. [PMID: 29275186 DOI: 10.1016/j.neulet.2017.12.046] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2017] [Revised: 12/19/2017] [Accepted: 12/20/2017] [Indexed: 10/18/2022]
Abstract
The visual system is able to extract an enormous amount of socially relevant information from the face, including social categories, personality traits, and emotion. While facial features may be directly tied to certain perceptions, emerging research suggests that top-down social cognitive factors (e.g., stereotypes, social-conceptual knowledge, prejudice) considerably influence and shape the perceptual process. The rapid integration of higher-order social cognitive processes into visual perception can give rise to systematic biases in face perception and may potentially act as a mediating factor for intergroup behavioral and evaluative biases. Drawing on neuroimaging evidence, we review the ways that top-down social cognitive factors shape visual perception of facial features. This emerging work in social and affective neuroscience builds upon work on predictive coding and perceptual priors in cognitive neuroscience and visual cognition, suggesting domain-general mechanisms that underlie a social-visual interface through which social cognition affects visual perception.
Collapse
Affiliation(s)
- Jeffrey A Brooks
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, United States.
| | - Jonathan B Freeman
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, United States.
| |
Collapse
|