1
|
Zhang Y, Zhou K, Bao P, Liu J. A biologically inspired computational model of human ventral temporal cortex. Neural Netw 2024; 178:106437. [PMID: 38936111 DOI: 10.1016/j.neunet.2024.106437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 06/01/2024] [Accepted: 06/05/2024] [Indexed: 06/29/2024]
Abstract
Our minds represent miscellaneous objects in the physical world metaphorically in an abstract and complex high-dimensional object space, which is implemented in a two-dimensional surface of the ventral temporal cortex (VTC) with topologically organized object selectivity. Here we investigated principles guiding the topographical organization of object selectivities in the VTC by constructing a hybrid Self-Organizing Map (SOM) model that harnesses a biologically inspired algorithm of wiring cost minimization and adheres to the constraints of the lateral wiring span of human VTC neurons. In a series of in silico experiments with functional brain neuroimaging and neurophysiological single-unit data from humans and non-human primates, the VTC-SOM predicted the topographical structure of fine-scale category-selective regions (face-, tool-, body-, and place-selective regions) and the boundary in large-scale abstract functional maps (animate vs. inanimate, real-word small-size vs. big-size, central vs. peripheral), with no significant loss in functionality (e.g., categorical selectivity and view-invariant representations). In addition, when the same principle was applied to V1 orientation preferences, a pinwheel-like topology emerged, suggesting the model's broad applicability. In summary, our study illustrates that the simple principle of wiring cost minimization, coupled with the appropriate biological constraint of lateral wiring span, is able to implement the high-dimensional object space in a two-dimensional cortical surface.
Collapse
Affiliation(s)
- Yiyuan Zhang
- Tsinghua Laboratory of Brain & Intelligence, Department of Psychology, Tsinghua University, Beijing, 100084, China
| | - Ke Zhou
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, 100875, China.
| | - Pinglei Bao
- Department of Psychology, Peking University, Beijing, 100871, China
| | - Jia Liu
- Tsinghua Laboratory of Brain & Intelligence, Department of Psychology, Tsinghua University, Beijing, 100084, China.
| |
Collapse
|
2
|
Borovska P, de Haas B. Individual gaze shapes diverging neural representations. Proc Natl Acad Sci U S A 2024; 121:e2405602121. [PMID: 39213176 DOI: 10.1073/pnas.2405602121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Accepted: 08/04/2024] [Indexed: 09/04/2024] Open
Abstract
Complex visual stimuli evoke diverse patterns of gaze, but previous research suggests that their neural representations are shared across brains. Here, we used hyperalignment to compare visual responses between observers viewing identical stimuli. We find that individual eye movements enhance cortical visual responses but also lead to representational divergence. Pairwise differences in the spatial distribution of gaze and in semantic salience predict pairwise representational divergence in V1 and inferior temporal cortex, respectively. This suggests that individual gaze sculpts individual visual worlds.
Collapse
Affiliation(s)
- Petra Borovska
- Department of Experimental Psychology, Justus Liebig University, Giessen 35394, Germany
| | - Benjamin de Haas
- Department of Experimental Psychology, Justus Liebig University, Giessen 35394, Germany
- Center for Mind, Brain and Behavior, Marburg and Giessen, Darmstadt 35032, Germany
| |
Collapse
|
3
|
Lin R, Naselaris T, Kay K, Wehbe L. Stacked regressions and structured variance partitioning for interpretable brain maps. Neuroimage 2024; 298:120772. [PMID: 39117095 DOI: 10.1016/j.neuroimage.2024.120772] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Revised: 07/26/2024] [Accepted: 08/02/2024] [Indexed: 08/10/2024] Open
Abstract
Relating brain activity associated with a complex stimulus to different properties of that stimulus is a powerful approach for constructing functional brain maps. However, when stimuli are naturalistic, their properties are often correlated (e.g., visual and semantic features of natural images, or different layers of a convolutional neural network that are used as features of images). Correlated properties can act as confounders for each other and complicate the interpretability of brain maps, and can impact the robustness of statistical estimators. Here, we present an approach for brain mapping based on two proposed methods: stacking different encoding models and structured variance partitioning. Our stacking algorithm combines encoding models that each uses as input a feature space that describes a different stimulus attribute. The algorithm learns to predict the activity of a voxel as a linear combination of the outputs of different encoding models. We show that the resulting combined model can predict held-out brain activity better or at least as well as the individual encoding models. Further, the weights of the linear combination are readily interpretable; they show the importance of each feature space for predicting a voxel. We then build on our stacking models to introduce structured variance partitioning, a new type of variance partitioning that takes into account the known relationships between features. Our approach constrains the size of the hypothesis space and allows us to ask targeted questions about the similarity between feature spaces and brain regions even in the presence of correlations between the feature spaces. We validate our approach in simulation, showcase its brain mapping potential on fMRI data, and release a Python package. Our methods can be useful for researchers interested in aligning brain activity with different layers of a neural network, or with other types of correlated feature spaces.
Collapse
Affiliation(s)
- Ruogu Lin
- Computational Biology Department, Carnegie Mellon University, Pittsburgh, PA 15213, United States of America
| | - Thomas Naselaris
- Department of Neuroscience, University of Minnesota, Minneapolis, MN 55455, United States of America; Center for Magnetic Resonance Research (CMRR), Department of Radiology, University of Minnesota, Minneapolis, MN 55455, United States of America
| | - Kendrick Kay
- Center for Magnetic Resonance Research (CMRR), Department of Radiology, University of Minnesota, Minneapolis, MN 55455, United States of America
| | - Leila Wehbe
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA 15213, United States of America; Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213, United States of America.
| |
Collapse
|
4
|
Yeatman JD. Primate brain: A unique connection between dorsal and ventral visual cortex. Curr Biol 2024; 34:R779-R781. [PMID: 39163839 DOI: 10.1016/j.cub.2024.06.065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/22/2024]
Abstract
In humans and other primates, vision is subserved by at least two parallel processing streams that are interconnected through a pathway known as the vertical occipital fasciculus. New research reveals that this white matter pathway may be a unique feature of the primate brain.
Collapse
Affiliation(s)
- Jason D Yeatman
- Center for Educational Research at Stanford, 520 Galvez Mall, Stanford, CA 94305, USA.
| |
Collapse
|
5
|
Lunghi M, Di Giorgio E. I like the way you move: how animate motion affects visual attention in early human infancy. Front Neurosci 2024; 18:1459550. [PMID: 39193524 PMCID: PMC11347423 DOI: 10.3389/fnins.2024.1459550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2024] [Accepted: 08/01/2024] [Indexed: 08/29/2024] Open
Abstract
The ability to detect animates (as compared with inanimates) rapidly is advantageous for human survival. Due to its relevance, not only the adult human brain has evolved specific neural mechanisms to discriminate animates, but it has been proposed that selection finely tuned the human visual attention system to prioritize visual cues that signal the presence of living things. Among them, animate motion-i.e., the motion of animate entities -, is one of the most powerful cues that triggers humans' attention. From a developmental point of view, whether such specialization is inborn or acquired through experience is a fascinating research topic. This mini-review aims to summarize and discuss recent behavioral and electrophysiological research that suggests that animate motion has an attentional advantage in the first year of life starting from birth. Specifically, the rationale underlying this paper concerns how attention deployment is affected by animate motion conveyed both by the movement of a single dot and, also, when the single dot is embedded in a complex array, named biological motion. Overall, it will highlight the importance of both inborn predispositions to pay attention preferentially to animate motion, mainly supported by subcortical structures, and the exposure to certain experiences, shortly after birth, to drive the cortical attentional visual system to become the way it is in adults.
Collapse
Affiliation(s)
- Marco Lunghi
- Department of Developmental Psychology and Socialization, University of Padova, Padova, Italy
- Department of Women’s and Children’s Health (SDB), University of Padova, Padova, Italy
| | - Elisa Di Giorgio
- Department of Developmental Psychology and Socialization, University of Padova, Padova, Italy
| |
Collapse
|
6
|
Hu J, Badde S, Vetter P. Auditory guidance of eye movements toward threat-related images in the absence of visual awareness. Front Hum Neurosci 2024; 18:1441915. [PMID: 39175660 PMCID: PMC11338778 DOI: 10.3389/fnhum.2024.1441915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Accepted: 07/30/2024] [Indexed: 08/24/2024] Open
Abstract
The human brain is sensitive to threat-related information even when we are not aware of this information. For example, fearful faces attract gaze in the absence of visual awareness. Moreover, information in different sensory modalities interacts in the absence of awareness, for example, the detection of suppressed visual stimuli is facilitated by simultaneously presented congruent sounds or tactile stimuli. Here, we combined these two lines of research and investigated whether threat-related sounds could facilitate visual processing of threat-related images suppressed from awareness such that they attract eye gaze. We suppressed threat-related images of cars and neutral images of human hands from visual awareness using continuous flash suppression and tracked observers' eye movements while presenting congruent or incongruent sounds (finger snapping and car engine sounds). Indeed, threat-related car sounds guided the eyes toward suppressed car images, participants looked longer at the hidden car images than at any other part of the display. In contrast, neither congruent nor incongruent sounds had a significant effect on eye responses to suppressed finger images. Overall, our results suggest that only in a danger-related context semantically congruent sounds modulate eye movements to images suppressed from awareness, highlighting the prioritisation of eye responses to threat-related stimuli in the absence of visual awareness.
Collapse
Affiliation(s)
- Junchao Hu
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Stephanie Badde
- Department of Psychology, Tufts University, Medford, MA, United States
| | - Petra Vetter
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| |
Collapse
|
7
|
Duan Y, Zhan J, Gross J, Ince RAA, Schyns PG. Pre-frontal cortex guides dimension-reducing transformations in the occipito-ventral pathway for categorization behaviors. Curr Biol 2024; 34:3392-3404.e5. [PMID: 39029470 DOI: 10.1016/j.cub.2024.06.050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Revised: 05/10/2024] [Accepted: 06/20/2024] [Indexed: 07/21/2024]
Abstract
To interpret our surroundings, the brain uses a visual categorization process. Current theories and models suggest that this process comprises a hierarchy of different computations that transforms complex, high-dimensional inputs into lower-dimensional representations (i.e., manifolds) in support of multiple categorization behaviors. Here, we tested this hypothesis by analyzing these transformations reflected in dynamic MEG source activity while individual participants actively categorized the same stimuli according to different tasks: face expression, face gender, pedestrian gender, and vehicle type. Results reveal three transformation stages guided by the pre-frontal cortex. At stage 1 (high-dimensional, 50-120 ms), occipital sources represent both task-relevant and task-irrelevant stimulus features; task-relevant features advance into higher ventral/dorsal regions, whereas task-irrelevant features halt at the occipital-temporal junction. At stage 2 (121-150 ms), stimulus feature representations reduce to lower-dimensional manifolds, which then transform into the task-relevant features underlying categorization behavior over stage 3 (161-350 ms). Our findings shed light on how the brain's network mechanisms transform high-dimensional inputs into specific feature manifolds that support multiple categorization behaviors.
Collapse
Affiliation(s)
- Yaocong Duan
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Jiayu Zhan
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Joachim Gross
- Institute for Biomagnetism and Biosignalanalysis, University of Münster, Malmedyweg 15, Münster 48149, Germany
| | - Robin A A Ince
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Philippe G Schyns
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK.
| |
Collapse
|
8
|
Simonelli F, Handjaras G, Benuzzi F, Bernardi G, Leo A, Duzzi D, Cecchetti L, Nichelli PF, Porro CA, Pietrini P, Ricciardi E, Lui F. Sensitivity and specificity of the action observation network to kinematics, target object, and gesture meaning. Hum Brain Mapp 2024; 45:e26762. [PMID: 39037079 PMCID: PMC11261593 DOI: 10.1002/hbm.26762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 05/23/2024] [Accepted: 06/02/2024] [Indexed: 07/23/2024] Open
Abstract
Hierarchical models have been proposed to explain how the brain encodes actions, whereby different areas represent different features, such as gesture kinematics, target object, action goal, and meaning. The visual processing of action-related information is distributed over a well-known network of brain regions spanning separate anatomical areas, attuned to specific stimulus properties, and referred to as action observation network (AON). To determine the brain organization of these features, we measured representational geometries during the observation of a large set of transitive and intransitive gestures in two independent functional magnetic resonance imaging experiments. We provided evidence for a partial dissociation between kinematics, object characteristics, and action meaning in the occipito-parietal, ventro-temporal, and lateral occipito-temporal cortex, respectively. Importantly, most of the AON showed low specificity to all the explored features, and representational spaces sharing similar information content were spread across the cortex without being anatomically adjacent. Overall, our results support the notion that the AON relies on overlapping and distributed coding and may act as a unique representational space instead of mapping features in a modular and segregated manner.
Collapse
Affiliation(s)
| | | | - Francesca Benuzzi
- Department of Biomedical, Metabolic and Neural Sciences and Center for Neuroscience and NeurotechnologyUniversity of Modena and Reggio EmiliaModenaItaly
| | | | - Andrea Leo
- IMT School for Advanced Studies LuccaLuccaItaly
| | - Davide Duzzi
- Department of Biomedical, Metabolic and Neural Sciences and Center for Neuroscience and NeurotechnologyUniversity of Modena and Reggio EmiliaModenaItaly
| | | | - Paolo F. Nichelli
- Department of Biomedical, Metabolic and Neural Sciences and Center for Neuroscience and NeurotechnologyUniversity of Modena and Reggio EmiliaModenaItaly
| | - Carlo A. Porro
- Department of Biomedical, Metabolic and Neural Sciences and Center for Neuroscience and NeurotechnologyUniversity of Modena and Reggio EmiliaModenaItaly
| | | | | | - Fausta Lui
- Department of Biomedical, Metabolic and Neural Sciences and Center for Neuroscience and NeurotechnologyUniversity of Modena and Reggio EmiliaModenaItaly
| |
Collapse
|
9
|
Arcaro M, Livingstone M. A Whole-Brain Topographic Ontology. Annu Rev Neurosci 2024; 47:21-40. [PMID: 38360565 DOI: 10.1146/annurev-neuro-082823-073701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/17/2024]
Abstract
It is a common view that the intricate array of specialized domains in the ventral visual pathway is innately prespecified. What this review postulates is that it is not. We explore the origins of domain specificity, hypothesizing that the adult brain emerges from an interplay between a domain-general map-based architecture, shaped by intrinsic mechanisms, and experience. We argue that the most fundamental innate organization of cortex in general, and not just the visual pathway, is a map-based topography that governs how the environment maps onto the brain, how brain areas interconnect, and ultimately, how the brain processes information.
Collapse
Affiliation(s)
- Michael Arcaro
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | | |
Collapse
|
10
|
Bouhali F, Dubois J, Hoeft F, Weiner KS. Unique longitudinal contributions of sulcal interruptions to reading acquisition in children. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.30.605574. [PMID: 39131390 PMCID: PMC11312548 DOI: 10.1101/2024.07.30.605574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/13/2024]
Abstract
A growing body of literature indicates strong associations between indentations of the cerebral cortex (i.e., sulci) and individual differences in cognitive performance. Interruptions, or gaps, of sulci (historically known as pli de passage) are particularly intriguing as previous work suggests that these interruptions have a causal effect on cognitive development. Here, we tested how the presence and morphology of sulcal interruptions in the left posterior occipitotemporal sulcus (pOTS) longitudinally impact the development of a culturally-acquired skill: reading. Forty-three children were successfully followed from age 5 in kindergarten, at the onset of literacy instruction, to ages 7 and 8 with assessments of cognitive, pre-literacy, and literacy skills, as well as MRI anatomical scans at ages 5 and 8. Crucially, we demonstrate that the presence of a left pOTS gap at 5 years is a specific and robust longitudinal predictor of better future reading skills in children, with large observed benefits on reading behavior ranging from letter knowledge to reading comprehension. The effect of left pOTS interruptions on reading acquisition accumulated through time, and was larger than the impact of benchmark cognitive and familial predictors of reading ability and disability. Finally, we show that increased local U-fiber white matter connectivity associated with such sulcal interruptions possibly underlie these behavioral benefits, by providing a computational advantage. To our knowledge, this is the first quantitative evidence supporting a potential integrative gray-white matter mechanism underlying the cognitive benefits of macro-anatomical differences in sulcal morphology related to longitudinal improvements in a culturally-acquired skill.
Collapse
Affiliation(s)
- Florence Bouhali
- Department of Psychiatry and Behavioral Sciences & Weil Institute of Neuroscience, University of California San Francisco, San Francisco, CA, USA
- Aix-Marseille University, CNRS, CRPN, Marseille, France
| | - Jessica Dubois
- University Paris Cité, NeuroDiderot, INSERM, Paris, France
- University Paris-Saclay, NeuroSpin, UNIACT, CEA, France
| | - Fumiko Hoeft
- Department of Psychological Sciences, University of Connecticut Waterbury, Waterbury, CT, USA
| | - Kevin S. Weiner
- Department of Psychology, Department of Neuroscience, Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
| |
Collapse
|
11
|
Kubota E, Yan X, Tung S, Fascendini B, Tyagi C, Duhameau S, Ortiz D, Grotheer M, Natu VS, Keil B, Grill-Spector K. White matter connections of human ventral temporal cortex are organized by cytoarchitecture, eccentricity, and category-selectivity from birth. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.29.605705. [PMID: 39131283 PMCID: PMC11312531 DOI: 10.1101/2024.07.29.605705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/13/2024]
Abstract
Category-selective regions in ventral temporal cortex (VTC) have a consistent anatomical organization, which is hypothesized to be scaffolded by white matter connections. However, it is unknown how white matter connections are organized from birth. Here, we scanned newborn to 6-month-old infants and adults and used a data-driven approach to determine the organization of the white matter connections of VTC. We find that white matter connections are organized by cytoarchitecture, eccentricity, and category from birth. Connectivity profiles of functional regions in the same cytoarchitectonic area are similar from birth and develop in parallel, with decreases in endpoint connectivity to lateral occipital, and parietal, and somatosensory cortex, and increases to lateral prefrontal cortex. Additionally, connections between VTC and early visual cortex are organized topographically by eccentricity bands and predict eccentricity biases in VTC. These data have important implications for theories of cortical functional development and open new possibilities for understanding typical and atypical white matter development.
Collapse
Affiliation(s)
- Emily Kubota
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305, USA
| | - Xiaoqian Yan
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
| | - Sarah Tung
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305, USA
| | - Bella Fascendini
- Department of Psychology, Princeton University, Peretsmfan Scully Hall, Princeton, NJ 08540, USA
| | - Christina Tyagi
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305, USA
| | - Sophie Duhameau
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305, USA
| | - Danya Ortiz
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305, USA
| | - Mareike Grotheer
- Department of Psychology, Philipps-Universität Marburg, Frankfurter Str. 35, Marburg 35037, Germany
- Center for Mind, Brain and Behavior – CMBB, Universities of Marburg, Giessen, and Darmstadt, Marburg 35039, Germany
| | - Vaidehi S. Natu
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305, USA
| | - Boris Keil
- Center for Mind, Brain and Behavior – CMBB, Universities of Marburg, Giessen, and Darmstadt, Marburg 35039, Germany
- Institute of Medical Physics and Radiation Protection, TH Mittelhessen University of Applied Sciences, Giessen 35390, Germany
- Department of Diagnostic and Interventional Radiology, University Hospital Marburg, Philipps-Universität Marburg, Baldinger Str., Marburg 35043, Germany
- LOEWE Research Cluster for Advanced Medical Physics in Imaging and Therapy (ADMIT), TH Mittelhessen University of Applied Sciences, Giessen 35390, Germany
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305, USA
- Wu Tsai Neurosciences Institute, 288 Campus Drive, Stanford, CA 94305 USA
| |
Collapse
|
12
|
Alashram AR. The efficacy of transcranial random noise stimulation in treating tinnitus: a systematic review. Eur Arch Otorhinolaryngol 2024:10.1007/s00405-024-08858-9. [PMID: 39046497 DOI: 10.1007/s00405-024-08858-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2024] [Accepted: 07/17/2024] [Indexed: 07/25/2024]
Abstract
PURPOSE This review aims to examine the effects of transcranial random noise stimulation (tRNS) on tinnitus and to determine the optimal treatment parameters, if possible. METHODS A comprehensive search, including MEDLINE, PubMed, EMBASE, CINAHL, SCOPUS, and PEDro, was conducted to determine experiments studying the effects of tRNS on tinnitus from inception to March 1, 2024. The Physiotherapy Evidence Database (PEDro) scale was used to evaluate the quality of the included studies. RESULTS Seven studies met the eligibility criteria. A total of 616 patients with non-pulsatile tinnitus (mean age 50.93 years; 66% males) were included in this review. The included studies ranged from 3 to 8 out of 10 (median = 7) on the PEDro scale. The results showed that tRNS is an effective intervention in reducing tinnitus symptoms. CONCLUSIONS The evidence for the effects of tRNS on people with chronic non-pulsatile tinnitus is promising. Administering tRNS with an intensity of 1-2 mA, high-frequency (101-650 Hz), using a 35 cm² electrode size over the auditory cortex and DLPFC, for 20 min with eight sessions may demonstrate the desired tRNS effects. The tRNS stimulation should be contralateral for unilateral tinnitus and bilaterally for bilateral tinnitus. Combining tRNS with other concurrent interventions may show superior effects in reducing tinnitus compared to tRNS alone. Further high-quality studies with larger sample sizes are strongly needed.
Collapse
Affiliation(s)
- Anas R Alashram
- Department of Physiotherapy, Middle East University, Airport Road, Amman, 1666, Jordan.
- Applied Science Research Center, Applied Science Private University, Amman, Jordan.
- Centre of SpaceBio-Medicine, Department of Systems Medicine, Faculty of Medicine and Surgery, San Raffaele Roma Open University, University of Rome "Tor Vergata", Rome, 00133, Italy.
| |
Collapse
|
13
|
Walbrin J, Sossounov N, Mahdiani M, Vaz I, Almeida J. Fine-grained knowledge about manipulable objects is well-predicted by contrastive language image pre-training. iScience 2024; 27:110297. [PMID: 39040066 PMCID: PMC11261149 DOI: 10.1016/j.isci.2024.110297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Revised: 02/23/2024] [Accepted: 06/14/2024] [Indexed: 07/24/2024] Open
Abstract
Object recognition is an important ability that relies on distinguishing between similar objects (e.g., deciding which utensil(s) to use at different stages of meal preparation). Recent work describes the fine-grained organization of knowledge about manipulable objects via the study of the constituent dimensions that are most relevant to human behavior, for example, vision, manipulation, and function-based properties. A logical extension of this work concerns whether or not these dimensions are uniquely human, or can be approximated by deep learning. Here, we show that behavioral dimensions are generally well-predicted by CLIP-ViT - a multimodal network trained on a large and diverse set of image-text pairs. Moreover, this model outperforms comparison networks pre-trained on smaller, image-only datasets. These results demonstrate the impressive capacity of CLIP-ViT to approximate fine-grained object knowledge. We discuss the possible sources of this benefit relative to other models (e.g., multimodal vs. image-only pre-training, dataset size, architecture).
Collapse
Affiliation(s)
- Jon Walbrin
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
- CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | - Nikita Sossounov
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
- CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | | | - Igor Vaz
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
- CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| | - Jorge Almeida
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
- CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Coimbra, Portugal
| |
Collapse
|
14
|
Ye Z, Zhao Y, Allen EJ, Naselaris T, Kay K, Hutchinson JB, Kuhl BA. Temporal asymmetry of neural representations predicts memory decisions. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.16.603778. [PMID: 39071351 PMCID: PMC11275784 DOI: 10.1101/2024.07.16.603778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
A stimulus can be familiar for multiple reasons. It might have been recently encountered, or is similar to recent experience, or is similar to 'typical' experience. Understanding how the brain translates these sources of similarity into memory decisions is a fundamental, but challenging goal. Here, using fMRI, we computed neural similarity between a current stimulus and events from different temporal windows in the past and future (from seconds to days). We show that trial-by-trial memory decisions (is this stimulus 'old'?) were predicted by the difference in similarity to past vs. future events (temporal asymmetry). This relationship was (i) evident in lateral parietal and occipitotemporal cortices, (ii) strongest when considering events from the recent past (minutes ago), and (iii) most pronounced when veridical (true) memories were weak. These findings suggest a new perspective in which the brain supports memory decisions by comparing what actually occurred to what is likely to occur.
Collapse
Affiliation(s)
- Zhifang Ye
- Department of Psychology, University of Oregon, Eugene, OR, USA
| | - Yufei Zhao
- Department of Psychology, University of Oregon, Eugene, OR, USA
| | - Emily J Allen
- Department of Psychology, University of Minnesota, Minneapolis, MN, USA
| | - Thomas Naselaris
- Department of Radiology, Center for Magnetic Resonance Research (CMRR), University of Minnesota, Minneapolis, MN, USA
| | - Kendrick Kay
- Department of Radiology, Center for Magnetic Resonance Research (CMRR), University of Minnesota, Minneapolis, MN, USA
| | | | - Brice A Kuhl
- Department of Psychology, University of Oregon, Eugene, OR, USA
| |
Collapse
|
15
|
Fleming SM, Shea N. Quality space computations for consciousness. Trends Cogn Sci 2024:S1364-6613(24)00165-7. [PMID: 39025769 DOI: 10.1016/j.tics.2024.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 06/18/2024] [Accepted: 06/19/2024] [Indexed: 07/20/2024]
Abstract
The quality space hypothesis about conscious experience proposes that conscious sensory states are experienced in relation to other possible sensory states. For instance, the colour red is experienced as being more like orange, and less like green or blue. Recent empirical findings suggest that subjective similarity space can be explained in terms of similarities in neural activation patterns. Here, we consider how localist, workspace, and higher-order theories of consciousness can accommodate claims about the qualitative character of experience and functionally support a quality space. We review existing empirical evidence for each of these positions, and highlight novel experimental tools, such as altering local activation spaces via brain stimulation or behavioural training, that can distinguish these accounts.
Collapse
Affiliation(s)
- Stephen M Fleming
- Wellcome Centre for Human Neuroimaging, University College London, London, UK; Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK; Department of Experimental Psychology, University College London, London, UK; Canadian Institute for Advanced Research (CIFAR), Brain, Mind, and Consciousness Program, Toronto, ON, Canada.
| | - Nicholas Shea
- Institute of Philosophy, School of Advanced Study, University of London, London, UK; Faculty of Philosophy, University of Oxford, Oxford, UK.
| |
Collapse
|
16
|
Margalit E, Lee H, Finzi D, DiCarlo JJ, Grill-Spector K, Yamins DLK. A unifying framework for functional organization in early and higher ventral visual cortex. Neuron 2024; 112:2435-2451.e7. [PMID: 38733985 PMCID: PMC11257790 DOI: 10.1016/j.neuron.2024.04.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 12/08/2023] [Accepted: 04/15/2024] [Indexed: 05/13/2024]
Abstract
A key feature of cortical systems is functional organization: the arrangement of functionally distinct neurons in characteristic spatial patterns. However, the principles underlying the emergence of functional organization in the cortex are poorly understood. Here, we develop the topographic deep artificial neural network (TDANN), the first model to predict several aspects of the functional organization of multiple cortical areas in the primate visual system. We analyze the factors driving the TDANN's success and find that it balances two objectives: learning a task-general sensory representation and maximizing the spatial smoothness of responses according to a metric that scales with cortical surface area. In turn, the representations learned by the TDANN are more brain-like than in spatially unconstrained models. Finally, we provide evidence that the TDANN's functional organization balances performance with between-area connection length. Our results offer a unified principle for understanding the functional organization of the primate ventral visual system.
Collapse
Affiliation(s)
- Eshed Margalit
- Neurosciences Graduate Program, Stanford University, Stanford, CA 94305, USA.
| | - Hyodong Lee
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Dawn Finzi
- Department of Psychology, Stanford University, Stanford, CA 94305, USA; Department of Computer Science, Stanford University, Stanford, CA 94305, USA
| | - James J DiCarlo
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Center for Brains Minds and Machines, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, Stanford, CA 94305, USA; Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA 94305, USA
| | - Daniel L K Yamins
- Department of Psychology, Stanford University, Stanford, CA 94305, USA; Department of Computer Science, Stanford University, Stanford, CA 94305, USA; Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA 94305, USA
| |
Collapse
|
17
|
Contier O, Baker CI, Hebart MN. Distributed representations of behavior-derived object dimensions in the human visual system. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.23.553812. [PMID: 37662312 PMCID: PMC10473665 DOI: 10.1101/2023.08.23.553812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Object vision is commonly thought to involve a hierarchy of brain regions processing increasingly complex image features, with high-level visual cortex supporting object recognition and categorization. However, object vision supports diverse behavioral goals, suggesting basic limitations of this category-centric framework. To address these limitations, we mapped a series of dimensions derived from a large-scale analysis of human similarity judgments directly onto the brain. Our results reveal broadly distributed representations of behaviorally-relevant information, demonstrating selectivity to a wide variety of novel dimensions while capturing known selectivities for visual features and categories. Behavior-derived dimensions were superior to categories at predicting brain responses, yielding mixed selectivity in much of visual cortex and sparse selectivity in category-selective clusters. This framework reconciles seemingly disparate findings regarding regional specialization, explaining category selectivity as a special case of sparse response profiles among representational dimensions, suggesting a more expansive view on visual processing in the human brain.
Collapse
Affiliation(s)
- O Contier
- Vision and Computational Cognition Group, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Max Planck School of Cognition, Leipzig, Germany
| | - C I Baker
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda MD, USA
| | - M N Hebart
- Vision and Computational Cognition Group, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Department of Medicine, Justus Liebig University Giessen, Giessen, Germany
| |
Collapse
|
18
|
Chauhan VS, McCook KC, White AL. Reading Reshapes Stimulus Selectivity in the Visual Word Form Area. eNeuro 2024; 11:ENEURO.0228-24.2024. [PMID: 38997142 DOI: 10.1523/eneuro.0228-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Revised: 07/03/2024] [Accepted: 07/04/2024] [Indexed: 07/14/2024] Open
Abstract
Reading depends on a brain region known as the "visual word form area" (VWFA) in the left ventral occipitotemporal cortex. This region's function is debated because its stimulus selectivity is not absolute, it is modulated by a variety of task demands, and it is inconsistently localized. We used fMRI to characterize the combination of sensory and cognitive factors that activate word-responsive regions that we precisely localized in 16 adult humans (4 male). We then presented three types of character strings: English words, pseudowords, and unfamiliar characters with matched visual features. Participants performed three different tasks while viewing those stimuli: detecting real words, detecting color in the characters, and detecting color in the fixation mark. There were three primary findings about the VWFA's response: (1) It preferred letter strings over unfamiliar characters even when the stimuli were ignored during the fixation task. (2) Compared with those baseline responses, engaging in the word reading task enhanced the response to words but suppressed the response to unfamiliar characters. (3) Attending to the stimuli to judge their color had little effect on the response magnitudes. Thus, the VWFA is uniquely modulated by a cognitive signal that is specific to voluntary linguistic processing and is not additive. Functional connectivity analyses revealed that communication between the VWFA and a left frontal language area increased when the participant engaged in the linguistic task. We conclude that the VWFA is inherently selective for familiar orthography, but it falls under control of the language network when the task demands it.
Collapse
Affiliation(s)
- Vassiki S Chauhan
- Department of Neuroscience & Behavior, Barnard College, Columbia University, New York, New York 10027
| | - Krystal C McCook
- Department of Neuroscience & Behavior, Barnard College, Columbia University, New York, New York 10027
| | - Alex L White
- Department of Neuroscience & Behavior, Barnard College, Columbia University, New York, New York 10027
| |
Collapse
|
19
|
Tansey R, Graff K, Rai S, Merrikh D, Godfrey KJ, Vanderwal T, Bray S. Development of human visual cortical function: A scoping review of task- and naturalistic-fMRI studies through the interactive specialization and maturational frameworks. Neurosci Biobehav Rev 2024; 162:105729. [PMID: 38763178 DOI: 10.1016/j.neubiorev.2024.105729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 05/12/2024] [Accepted: 05/14/2024] [Indexed: 05/21/2024]
Abstract
Overarching theories such as the interactive specialization and maturational frameworks have been proposed to describe human functional brain development. However, these frameworks have not yet been systematically examined across the fMRI literature. Visual processing is one of the most well-studied fields in neuroimaging, and research in this area has recently expanded to include naturalistic paradigms that facilitate study in younger age ranges, allowing for an in-depth critical appraisal of these frameworks across childhood. To this end, we conducted a scoping review of 94 developmental visual fMRI studies, including both traditional experimental task and naturalistic studies, across multiple sub-domains (early visual processing, category-specific higher order processing, naturalistic visual processing). We found that across domains, many studies reported progressive development, but few studies describe regressive or emergent changes necessary to fit the maturational or interactive specialization frameworks. Our findings suggest a need for the expansion of developmental frameworks and clearer reporting of both progressive and regressive changes, along with well-powered, longitudinal studies.
Collapse
Affiliation(s)
- Ryann Tansey
- Department of Psychiatry, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada; Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.
| | - Kirk Graff
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada; Department of Psychiatry, Washington University in St. Louis, St. Louis, MO, USA
| | - Shefali Rai
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Daria Merrikh
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Kate J Godfrey
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Tamara Vanderwal
- Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada; BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Signe Bray
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada; Department of Radiology, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada; Department of Pediatrics, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
20
|
Martín-Monzón I, Amores-Carrera L, Sabsevitz D, Herbet G. Intraoperative mapping of the right hemisphere: a systematic review of protocols that evaluate cognitive and social cognitive functions. Front Psychol 2024; 15:1415523. [PMID: 38966723 PMCID: PMC11222673 DOI: 10.3389/fpsyg.2024.1415523] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 06/03/2024] [Indexed: 07/06/2024] Open
Abstract
The right hemisphere of the brain is often referred to as the non-dominant hemisphere. Though this is meant to highlight the specialized role of the left hemisphere in language, the use of this term runs the risk of oversimplifying or minimizing the essential functions of the right hemisphere. There is accumulating evidence from functional MRI, clinical lesion studies, and intraoperative mapping data that implicate the right hemisphere in a diverse array of cognitive functions, including visuospatial functions, attentional processes, and social cognitive functions. Neuropsychological deficits following right hemisphere resections are well-documented, but there is a general paucity of literature focusing on how to best map these functions during awake brain surgery to minimize such deficits. To address this gap in the literature, a systematic review was conducted to examine the cognitive and emotional processes associated with the right hemisphere and the neuropsychological tasks frequently used for mapping the right hemisphere during awake brain tumor surgery. It was found that the most employed tests to assess language and speech functions in patients with lesions in the right cerebral hemisphere were the naming task and the Pyramids and Palm Trees Test (PPTT). Spatial cognition was typically evaluated using the line bisection task, while social cognition was assessed through the Reading the Mind in the Eyes (RME) test. Dual-tasking and the movement of the upper and lower limbs were the most frequently used methods to evaluate motor/sensory functions. Executive functions were typically assessed using the N-back test and Stroop test. To the best of our knowledge, this is the first comprehensive review to help provide guidance on the cognitive functions most at risk and methods to map such functions during right awake brain surgery. Systematic Review Registration PROSPERO database [CRD42023483324].
Collapse
Affiliation(s)
- Isabel Martín-Monzón
- Department of Experimental Psychology, Faculty of Psychology, Campus Santiago Ramón y Cajal, University of Seville, Seville, Spain
| | - Laura Amores-Carrera
- Department of Experimental Psychology, Faculty of Psychology, Campus Santiago Ramón y Cajal, University of Seville, Seville, Spain
| | - David Sabsevitz
- Department of Psychiatry and Psychology, Division of Neuropsychology, Mayo Clinic Florida, Jacksonville, FL, United States
| | - Guillaume Herbet
- Department of Neurosurgery, Gui de Chauliac Hospital, Montpellier, France
- Praxiling Lab, UMR5267 CNRS & Paul Valéry University, Bâtiment de Recherche Marc Bloch, Montpellier, France
- Department of Medicine, University of Montpellier, Campus ADV, Montpellier, France
- Institut Universitaire de France, Paris, France
| |
Collapse
|
21
|
Chauhan VS, McCook KC, White AL. Reading reshapes stimulus selectivity in the visual word form area. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.10.04.560764. [PMID: 38948708 PMCID: PMC11212929 DOI: 10.1101/2023.10.04.560764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/02/2024]
Abstract
Reading depends on a brain region known as the "visual word form area" (VWFA) in left ventral occipito-temporal cortex. This region's function is debated because its stimulus selectivity is not absolute, it is modulated by a variety of task demands, and it is inconsistently localized. We used fMRI to characterize the combination of sensory and cognitive factors that activate word-responsive regions that we precisely localized in 16 adult humans (4 male). We then presented three types of character strings: English words, pseudowords, and unfamiliar characters with matched visual features. Participants performed three different tasks while viewing those stimuli: detecting real words, detecting color in the characters, and detecting color in the fixation mark. There were three primary findings about the VWFA's response: (1) It preferred letter strings over unfamiliar characters even when the stimuli were ignored during the fixation task; (2) Compared to those baseline responses, engaging in the word reading task enhanced the response to words but suppressed the response to unfamiliar characters. (3) Attending to the stimuli to judge their font color had little effect on the response magnitudes. Thus, the VWFA is uniquely modulated by a cognitive signal that is specific to voluntary linguistic processing and is not additive. Functional connectivity analyses revealed that communication between the VWFA and a left frontal language area increased when the participant engaged in the linguistic task. We conclude that the VWFA is inherently selective for familiar orthography, but it falls under control of the language network when the task demands it.
Collapse
Affiliation(s)
- Vassiki S. Chauhan
- Department of Neuroscience & Behavior Barnard College, Columbia University 76 Claremont Ave New York, NY 10027 USA
| | - Krystal C McCook
- Department of Neuroscience & Behavior Barnard College, Columbia University 76 Claremont Ave New York, NY 10027 USA
| | - Alex L. White
- Department of Neuroscience & Behavior Barnard College, Columbia University 76 Claremont Ave New York, NY 10027 USA
| |
Collapse
|
22
|
Yeatman JD, McCloy DR, Caffarra S, Clarke MD, Ender S, Gijbels L, Joo SJ, Kubota EC, Kuhl PK, Larson E, O'Brien G, Peterson ER, Takada ME, Taulu S. Reading instruction causes changes in category-selective visual cortex. Brain Res Bull 2024; 212:110958. [PMID: 38677559 PMCID: PMC11194742 DOI: 10.1016/j.brainresbull.2024.110958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 03/15/2024] [Accepted: 04/17/2024] [Indexed: 04/29/2024]
Abstract
Education sculpts specialized neural circuits for skills like reading that are critical to success in modern society but were not anticipated by the selective pressures of evolution. Does the emergence of brain regions that selectively process novel visual stimuli like words occur at the expense of cortical representations of other stimuli like faces and objects? "Neuronal Recycling" predicts that learning to read should enhance the response to words in ventral occipitotemporal cortex (VOTC) and decrease the response to other visual categories such as faces and objects. To test this hypothesis, and more broadly to understand the changes that are induced by the early stages of literacy instruction, we conducted a randomized controlled trial with pre-school children (five years of age). Children were randomly assigned to intervention programs focused on either reading skills or oral language skills and magnetoencephalography (MEG) data collected before and after the intervention was used to measure visual responses to images of text, faces, and objects. We found that being taught reading versus oral language skills induced different patterns of change in category-selective regions of visual cortex, but that there was not a clear tradeoff between the response to words versus other categories. Within a predefined region of VOTC corresponding to the visual word form area (VWFA) we found that the relative amplitude of responses to text, faces, and objects changed, but increases in the response to words were not linked to decreases in the response to faces or objects. How these changes play out over a longer timescale is still unknown but, based on these data, we can surmise that high-level visual cortex undergoes rapid changes as children enter school and begin establishing new skills like literacy.
Collapse
Affiliation(s)
- Jason D Yeatman
- Graduate School of Education, Stanford University, Stanford, CA, USA; Division of Developmental Behavioral Pediatrics, Stanford University School of Medicine, Stanford, CA, USA; Department of Psychology, Stanford University, Stanford, CA, USA.
| | - Daniel R McCloy
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA; Department of Speech & Hearing Sciences, University of Washington, Seattle, WA, USA
| | - Sendy Caffarra
- Graduate School of Education, Stanford University, Stanford, CA, USA; Division of Developmental Behavioral Pediatrics, Stanford University School of Medicine, Stanford, CA, USA; Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy
| | - Maggie D Clarke
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA; Department of Speech & Hearing Sciences, University of Washington, Seattle, WA, USA
| | - Suzanne Ender
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA; Department of Speech & Hearing Sciences, University of Washington, Seattle, WA, USA
| | - Liesbeth Gijbels
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA; Department of Speech & Hearing Sciences, University of Washington, Seattle, WA, USA
| | - Sung Jun Joo
- Department of Psychology, Pusan National University, Busan, Republic of Korea
| | - Emily C Kubota
- Department of Psychology, Stanford University, Stanford, CA, USA
| | - Patricia K Kuhl
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA; Department of Speech & Hearing Sciences, University of Washington, Seattle, WA, USA
| | - Eric Larson
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA
| | - Gabrielle O'Brien
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA; Department of Speech & Hearing Sciences, University of Washington, Seattle, WA, USA
| | - Erica R Peterson
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA; Department of Speech & Hearing Sciences, University of Washington, Seattle, WA, USA
| | - Megumi E Takada
- Graduate School of Education, Stanford University, Stanford, CA, USA
| | - Samu Taulu
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA, USA; Department of Physics, University of Washington, Seattle, WA, USA
| |
Collapse
|
23
|
Stecher R, Kaiser D. Representations of imaginary scenes and their properties in cortical alpha activity. Sci Rep 2024; 14:12796. [PMID: 38834699 DOI: 10.1038/s41598-024-63320-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 05/28/2024] [Indexed: 06/06/2024] Open
Abstract
Imagining natural scenes enables us to engage with a myriad of simulated environments. How do our brains generate such complex mental images? Recent research suggests that cortical alpha activity carries information about individual objects during visual imagery. However, it remains unclear if more complex imagined contents such as natural scenes are similarly represented in alpha activity. Here, we answer this question by decoding the contents of imagined scenes from rhythmic cortical activity patterns. In an EEG experiment, participants imagined natural scenes based on detailed written descriptions, which conveyed four complementary scene properties: openness, naturalness, clutter level and brightness. By conducting classification analyses on EEG power patterns across neural frequencies, we were able to decode both individual imagined scenes as well as their properties from the alpha band, showing that also the contents of complex visual images are represented in alpha rhythms. A cross-classification analysis between alpha power patterns during the imagery task and during a perception task, in which participants were presented images of the described scenes, showed that scene representations in the alpha band are partly shared between imagery and late stages of perception. This suggests that alpha activity mediates the top-down re-activation of scene-related visual contents during imagery.
Collapse
Affiliation(s)
- Rico Stecher
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus Liebig University Gießen, 35392, Gießen, Germany.
| | - Daniel Kaiser
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus Liebig University Gießen, 35392, Gießen, Germany
- Center for Mind, Brain and Behavior (CMBB), Philipps-University Marburg and Justus Liebig University Gießen, 35032, Marburg, Germany
| |
Collapse
|
24
|
Chen YY, Areti A, Yoshor D, Foster BL. Perception and Memory Reinstatement Engage Overlapping Face-Selective Regions within Human Ventral Temporal Cortex. J Neurosci 2024; 44:e2180232024. [PMID: 38627090 PMCID: PMC11140664 DOI: 10.1523/jneurosci.2180-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 04/03/2024] [Accepted: 04/05/2024] [Indexed: 04/19/2024] Open
Abstract
Humans have the remarkable ability to vividly retrieve sensory details of past events. According to the theory of sensory reinstatement, during remembering, brain regions specialized for processing specific sensory stimuli are reactivated to support content-specific retrieval. Recently, several studies have emphasized transformations in the spatial organization of these reinstated activity patterns. Specifically, studies of scene stimuli suggest a clear anterior shift in the location of retrieval activations compared with the activity observed during perception. However, it is not clear that such transformations occur universally, with inconsistent evidence for other important stimulus categories, particularly faces. One challenge in addressing this question is the careful delineation of face-selective cortices, which are interdigitated with other selective regions, in configurations that spatially differ across individuals. Therefore, we conducted a multisession neuroimaging study to first carefully map individual participants' (nine males and seven females) face-selective regions within ventral temporal cortex (VTC), followed by a second session to examine the activity patterns within these regions during face memory encoding and retrieval. While face-selective regions were expectedly engaged during face perception at encoding, memory retrieval engagement exhibited a more selective and constricted reinstatement pattern within these regions, but did not show any consistent direction of spatial transformation (e.g., anteriorization). We also report on unique human intracranial recordings from VTC under the same experimental conditions. These findings highlight the importance of considering the complex configuration of category-selective cortex in elucidating principles shaping the neural transformations that occur from perception to memory.
Collapse
Affiliation(s)
- Yvonne Y Chen
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | | | - Daniel Yoshor
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Brett L Foster
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| |
Collapse
|
25
|
Koenig-Robert R, Quek GL, Grootswagers T, Varlet M. Movement trajectories as a window into the dynamics of emerging neural representations. Sci Rep 2024; 14:11499. [PMID: 38769313 PMCID: PMC11106280 DOI: 10.1038/s41598-024-62135-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 05/14/2024] [Indexed: 05/22/2024] Open
Abstract
The rapid transformation of sensory inputs into meaningful neural representations is critical to adaptive human behaviour. While non-invasive neuroimaging methods are the de-facto method for investigating neural representations, they remain expensive, not widely available, time-consuming, and restrictive. Here we show that movement trajectories can be used to measure emerging neural representations with fine temporal resolution. By combining online computer mouse-tracking and publicly available neuroimaging data via representational similarity analysis (RSA), we show that movement trajectories track the unfolding of stimulus- and category-wise neural representations along key dimensions of the human visual system. We demonstrate that time-resolved representational structures derived from movement trajectories overlap with those derived from M/EEG (albeit delayed) and those derived from fMRI in functionally-relevant brain areas. Our findings highlight the richness of movement trajectories and the power of the RSA framework to reveal and compare their information content, opening new avenues to better understand human perception.
Collapse
Affiliation(s)
- Roger Koenig-Robert
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
- School of Psychology, University of New South Wales, Sydney, NSW, Australia
| | - Genevieve L Quek
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
| | - Tijl Grootswagers
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia
- School of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, NSW, 2751, Australia
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, 2751, Australia.
- School of Psychology, Western Sydney University, Sydney, NSW, 2751, Australia.
| |
Collapse
|
26
|
Molloy MF, Saygin ZM, Osher DE. Predicting high-level visual areas in the absence of task fMRI. Sci Rep 2024; 14:11376. [PMID: 38762549 PMCID: PMC11102456 DOI: 10.1038/s41598-024-62098-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 05/13/2024] [Indexed: 05/20/2024] Open
Abstract
The ventral visual stream is organized into units, or functional regions of interest (fROIs), specialized for processing high-level visual categories. Task-based fMRI scans ("localizers") are typically used to identify each individual's nuanced set of fROIs. The unique landscape of an individual's functional activation may rely in large part on their specialized connectivity patterns; recent studies corroborate this by showing that connectivity can predict individual differences in neural responses. We focus on the ventral visual stream and ask: how well can an individual's resting state functional connectivity localize their fROIs for face, body, scene, and object perception? And are the neural processors for any particular visual category better predicted by connectivity than others, suggesting a tighter mechanistic relationship between connectivity and function? We found, among 18 fROIs predicted from connectivity for each subject, all but one were selective for their preferred visual category. Defining an individual's fROIs based on their connectivity patterns yielded regions that were more selective than regions identified from previous studies or atlases in nearly all cases. Overall, we found that in the absence of a domain-specific localizer task, a 10-min resting state scan can be reliably used for defining these fROIs.
Collapse
Affiliation(s)
- M Fiona Molloy
- Department of Psychology, The Ohio State University, 1835 Neil Avenue, Columbus, OH, 43210, USA
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, USA
| | - Zeynep M Saygin
- Department of Psychology, The Ohio State University, 1835 Neil Avenue, Columbus, OH, 43210, USA
| | - David E Osher
- Department of Psychology, The Ohio State University, 1835 Neil Avenue, Columbus, OH, 43210, USA.
| |
Collapse
|
27
|
Granovetter MC, Maallo AMS, Ling S, Robert S, Freud E, Patterson C, Behrmann M. Functional Resilience of the Neural Visual Recognition System Post-Pediatric Occipitotemporal Resection. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.08.592792. [PMID: 38766137 PMCID: PMC11100714 DOI: 10.1101/2024.05.08.592792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
In the typically developing (TD) brain, neural representations for visual stimulus categories (e.g., faces, objects, and words) emerge in bilateral occipitotemporal cortex (OTC), albeit with weighted asymmetry; in parallel, recognition behavior continues to be refined. A fundamental question is whether two hemispheres are necessary or redundant for the emergence of neural representations and recognition behavior typically distributed across both hemispheres. The rare population of patients undergoing unilateral OTC resection in childhood offers a unique opportunity to evaluate whether neural computations for visual stimulus individuation suffice for recognition with only a single developing OTC. Here, using functional magnetic resonance imaging, we mapped category selectivity (CS) and neural representations for individual stimulus exemplars using repetition suppression (RS) in the non-resected hemisphere of pediatric OTC resection patients (n = 9) and control patients with resection outside of OTC (n = 12), as well as in both hemispheres of TD controls (n = 21). There were no univariate group differences in the magnitude of CS or RS or any multivariate differences (per representational similarity analysis) in neural activation to faces, objects, or words across groups. Notwithstanding their comparable neural profiles, accuracy of OTC resection patients on face and object recognition, but not word recognition, was statistically inferior to that of controls. The comparable neural signature of the OTC resection patients' preserved hemisphere and the other two groups highlights the resilience of the system following damage to the contralateral homologue. Critically, however, a single OTC does not suffice for normal behavior, and, thereby, implicates the necessity for two hemispheres.
Collapse
Affiliation(s)
- Michael C. Granovetter
- School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Anne Margarette S. Maallo
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Shouyu Ling
- Department of Ophthalmology, University of Pittsburgh, Pittsburgh, PA, USA
| | - Sophia Robert
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Erez Freud
- Department of Psychology, York University, Toronto, ON, CA
| | | | - Marlene Behrmann
- Department of Psychology and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
- Department of Ophthalmology, University of Pittsburgh, Pittsburgh, PA, USA
| |
Collapse
|
28
|
Heinbockel H, Wagner AD, Schwabe L. Post-retrieval stress impairs subsequent memory depending on hippocampal memory trace reinstatement during reactivation. SCIENCE ADVANCES 2024; 10:eadm7504. [PMID: 38691596 PMCID: PMC11062581 DOI: 10.1126/sciadv.adm7504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 03/29/2024] [Indexed: 05/03/2024]
Abstract
Upon retrieval, memories can become susceptible to meaningful events, such as stress. Post-retrieval memory changes may be attributed to an alteration of the original memory trace during reactivation-dependent reconsolidation or, alternatively, to the modification of retrieval-related memory traces that impact future remembering. Hence, how post-retrieval memory changes emerge in the human brain is unknown. In a 3-day functional magnetic resonance imaging study, we show that post-retrieval stress impairs subsequent memory depending on the strength of neural reinstatement of the original memory trace during reactivation, driven by the hippocampus and its cross-talk with neocortical representation areas. Comparison of neural patterns during immediate and final memory testing further revealed that successful retrieval was linked to pattern-dissimilarity in controls, suggesting the use of a different trace, whereas stressed participants relied on the original memory representation. These representation changes were again dependent on neocortical reinstatement during reactivation. Our findings show disruptive stress effects on the consolidation of retrieval-related memory traces that support future remembering.
Collapse
Affiliation(s)
- Hendrik Heinbockel
- Department of Cognitive Psychology, Universität Hamburg, 20146 Hamburg, Germany
| | - Anthony D. Wagner
- Department of Psychology, Wu Tsai Neurosciences Institute, Building 420, Stanford, CA 94305, USA
| | - Lars Schwabe
- Department of Cognitive Psychology, Universität Hamburg, 20146 Hamburg, Germany
| |
Collapse
|
29
|
Taghizadeh B, Fortmann O, Gail A. Position- and scale-invariant object-centered spatial localization in monkey frontoparietal cortex dynamically adapts to cognitive demand. Nat Commun 2024; 15:3357. [PMID: 38637493 PMCID: PMC11026390 DOI: 10.1038/s41467-024-47554-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 04/02/2024] [Indexed: 04/20/2024] Open
Abstract
Egocentric encoding is a well-known property of brain areas along the dorsal pathway. Different to previous experiments, which typically only demanded egocentric spatial processing during movement preparation, we designed a task where two male rhesus monkeys memorized an on-the-object target position and then planned a reach to this position after the object re-occurred at variable location with potentially different size. We found allocentric (in addition to egocentric) encoding in the dorsal stream reach planning areas, parietal reach region and dorsal premotor cortex, which is invariant with respect to the position, and, remarkably, also the size of the object. The dynamic adjustment from predominantly allocentric encoding during visual memory to predominantly egocentric during reach planning in the same brain areas and often the same neurons, suggests that the prevailing frame of reference is less a question of brain area or processing stream, but more of the cognitive demands.
Collapse
Affiliation(s)
- Bahareh Taghizadeh
- Sensorimotor Group, German Primate Center, Göttingen, Germany
- School of Cognitive Science, Institute for Research in Fundamental Sciences (IPM), P.O. Box 19395-5746, Tehran, Iran
| | - Ole Fortmann
- Sensorimotor Group, German Primate Center, Göttingen, Germany
- Faculty of Biology and Psychology, University of Göttingen, Göttingen, Germany
| | - Alexander Gail
- Sensorimotor Group, German Primate Center, Göttingen, Germany.
- Faculty of Biology and Psychology, University of Göttingen, Göttingen, Germany.
- Bernstein Center for Computational Neuroscience, Göttingen, Germany.
- Leibniz ScienceCampus Primate Cognition, Göttingen, Germany.
| |
Collapse
|
30
|
Van Overwalle J, Van der Donck S, Van de Cruys S, Boets B, Wagemans J. Assessing Spontaneous Categorical Processing of Visual Shapes via Frequency-Tagging EEG. J Neurosci 2024; 44:e1346232024. [PMID: 38423762 PMCID: PMC11026363 DOI: 10.1523/jneurosci.1346-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 01/25/2024] [Accepted: 02/20/2024] [Indexed: 03/02/2024] Open
Abstract
Categorization is an essential cognitive and perceptual process, which happens spontaneously. However, earlier research often neglected the spontaneous nature of this process by mainly adopting explicit tasks in behavioral or neuroimaging paradigms. Here, we use frequency-tagging (FT) during electroencephalography (EEG) in 22 healthy human participants (both male and female) as a direct approach to pinpoint spontaneous visual categorical processing. Starting from schematic natural visual stimuli, we created morph sequences comprising 11 equal steps. Mirroring a behavioral categorical perception discrimination paradigm, we administered a FT-EEG oddball paradigm, assessing neural sensitivity for equally sized differences within and between stimulus categories. Likewise, mirroring a behavioral category classification paradigm, we administered a sweep FT-EEG oddball paradigm, sweeping from one end of the morph sequence to the other, thereby allowing us to objectively pinpoint the neural category boundary. We found that FT-EEG can implicitly measure categorical processing and discrimination. More specifically, we could derive an objective neural index of the required level to differentiate between the two categories, and this neural index showed the typical marker of categorical perception (i.e., stronger discrimination across as compared with within categories). The neural findings of the implicit paradigms were also validated using an explicit behavioral task. These results provide evidence that FT-EEG can be used as an objective tool to measure discrimination and categorization and that the human brain inherently and spontaneously (without any conscious or decisional processes) uses higher-level meaningful categorization information to interpret ambiguous (morph) shapes.
Collapse
Affiliation(s)
- Jaana Van Overwalle
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven 3000, Belgium
| | - Stephanie Van der Donck
- Center for Developmental Psychiatry, Leuven Brain Institute, KU Leuven, Leuven 3000, Belgium
| | - Sander Van de Cruys
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven 3000, Belgium
| | - Bart Boets
- Center for Developmental Psychiatry, Leuven Brain Institute, KU Leuven, Leuven 3000, Belgium
| | - Johan Wagemans
- Department of Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven 3000, Belgium
| |
Collapse
|
31
|
Gagl B, Gregorová K. Investigating lexical categorization in reading based on joint diagnostic and training approaches for language learners. NPJ SCIENCE OF LEARNING 2024; 9:29. [PMID: 38600183 PMCID: PMC11006909 DOI: 10.1038/s41539-024-00237-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Accepted: 03/07/2024] [Indexed: 04/12/2024]
Abstract
Efficient reading is essential for societal participation, so reading proficiency is a central educational goal. Here, we use an individualized diagnostics and training framework to investigate processes in visual word recognition and evaluate its usefulness for detecting training responders. We (i) motivated a training procedure based on the Lexical Categorization Model (LCM) to introduce the framework. The LCM describes pre-lexical orthographic processing implemented in the left-ventral occipital cortex and is vital to reading. German language learners trained their lexical categorization abilities while we monitored reading speed change. In three studies, most language learners increased their reading skills. Next, we (ii) estimated, for each word, the LCM-based features and assessed each reader's lexical categorization capabilities. Finally, we (iii) explored machine learning procedures to find the optimal feature selection and regression model to predict the benefit of the lexical categorization training for each individual. The best-performing pipeline increased reading speed from 23% in the unselected group to 43% in the machine-selected group. This selection process strongly depended on parameters associated with the LCM. Thus, training in lexical categorization can increase reading skills, and accurate computational descriptions of brain functions that allow the motivation of a training procedure combined with machine learning can be powerful for individualized reading training procedures.
Collapse
Affiliation(s)
- Benjamin Gagl
- Self-learning Systems Laboratory, Department of Special Education and Rehabilitation, University of Cologne, Cologne, Germany.
- Department of Psychology and Sports Sciences, Goethe University, Frankfurt am Main, Germany.
| | - Klara Gregorová
- Department of Psychology and Sports Sciences, Goethe University, Frankfurt am Main, Germany
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital & German Center of Prevention Research on Mental Health, Würzburg, Germany
- Department of Psychology, Julius-Maximilians-University of Würzburg, Würzburg, Germany
| |
Collapse
|
32
|
Campbell A, Tanaka JW. Fast saccades to faces during the feedforward sweep. J Vis 2024; 24:16. [PMID: 38630459 PMCID: PMC11037494 DOI: 10.1167/jov.24.4.16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 09/19/2023] [Indexed: 04/19/2024] Open
Abstract
Saccadic choice tasks use eye movements as a response method, typically in a task where observers are asked to saccade as quickly as possible to an image of a prespecified target category. Using this approach, face-selective saccades have been observed within 100 ms poststimulus. When taking into account oculomotor processing, this suggests that faces can be detected in as little as 70 to 80 ms. It has therefore been suggested that face detection must occur during the initial feedforward sweep, since this latency leaves little time for feedback processing. In the current experiment, we tested this hypothesis using backward masking-a technique shown to primarily disrupt feedback processing while leaving feedforward activation relatively intact. Based on minimum saccadic reaction time, we found that face detection benefited from ultra-fast, accurate saccades within 110 to 160 ms and that these eye movements are obtainable even under extreme masking conditions that limit perceptual awareness. However, masking did significantly increase the median SRT for faces. In the manual responses, we found remarkable detection accuracy for faces and houses, even when participants indicated having no visual experience of the test images. These results provide evidence for the view that the saccadic bias to faces is initiated by coarse information used to categorize faces in the feedforward sweep but that, in most cases, additional processing is required to quickly reach the threshold for saccade initiation.
Collapse
Affiliation(s)
- Alison Campbell
- Department of Psychology, University of Victoria, Victoria, BC, Canada
- https://orcid.org/0000-0001-6891-8609
| | - James W Tanaka
- Department of Psychology, University of Victoria, Victoria, BC, Canada
- https://orcid.org/0000-0001-6559-0388
| |
Collapse
|
33
|
Ramos Benitez J, Kannan S, Hastings WL, Parker BJ, Willbrand EH, Weiner KS. Ventral temporal and posteromedial sulcal morphology in autism spectrum disorder. Neuropsychologia 2024; 195:108786. [PMID: 38181845 DOI: 10.1016/j.neuropsychologia.2024.108786] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 12/14/2023] [Accepted: 01/02/2024] [Indexed: 01/07/2024]
Abstract
Two parallel research tracks link the morphology of small and shallow indentations, or sulci, of the cerebral cortex with functional features of the cortex and human cognition, respectively. The first track identified a relationship between the mid-fusiform sulcus (MFS) in ventral temporal cortex (VTC) and cognition in individuals with Autism Spectrum Disorder (ASD). The second track identified a new sulcus, the inframarginal sulcus (IFRMS), that serves as a tripartite landmark within the posteromedial cortex (PMC). As VTC and PMC are structurally and functionally different in ASD, here, we integrated these two tracks and tested if there are morphological differences in VTC and PMC sulci in a sample of young (5-17 years old) male participants (50 participants with ASD and 50 neurotypical controls). Our approach replicates and extends recent findings in four ways. First, regarding replication, the standard deviation (STD) of MFS cortical thickness (CT) was increased in ASD. Second, MFS length was shorter in ASD. Third, the CT STD effect extended to other VTC and to PMC sulci. Fourth, additional morphological features of VTC sulci (depth, surface area, gray matter volume) and PMC sulci (mean CT) were decreased in ASD, including putative tertiary sulci, which emerge last in gestation and continue to develop after birth. To our knowledge, this study is the most extensive comparison of the sulcal landscape (including putative tertiary sulci) in multiple cortical expanses between individuals with ASD and NTs based on manually defined sulci at the level of individual hemispheres, providing novel targets for future studies of neurodevelopmental disorders more broadly.
Collapse
Affiliation(s)
- Javier Ramos Benitez
- Neuroscience Graduate Program, University of Washington School of Medicine, Seattle, WA, USA
| | - Sandhya Kannan
- Department of Radiology, University of California San Francisco, San Francisco, CA, USA
| | - William L Hastings
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| | - Benjamin J Parker
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, USA
| | - Ethan H Willbrand
- Medical Scientist Training Program, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, USA
| | - Kevin S Weiner
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA; Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, USA.
| |
Collapse
|
34
|
Walbrin J, Downing PE, Sotero FD, Almeida J. Characterizing the discriminability of visual categorical information in strongly connected voxels. Neuropsychologia 2024; 195:108815. [PMID: 38311112 DOI: 10.1016/j.neuropsychologia.2024.108815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 01/06/2024] [Accepted: 02/01/2024] [Indexed: 02/06/2024]
Abstract
Functional brain responses are strongly influenced by connectivity. Recently, we demonstrated a major example of this: category discriminability within occipitotemporal cortex (OTC) is enhanced for voxel sets that share strong functional connectivity to distal brain areas, relative to those that share lesser connectivity. That is, within OTC regions, sets of 'most-connected' voxels show improved multivoxel pattern discriminability for tool-, face-, and place stimuli relative to voxels with weaker connectivity to the wider brain. However, understanding whether these effects generalize to other domains (e.g. body perception network), and across different levels of the visual processing streams (e.g. dorsal as well as ventral stream areas) is an important extension of this work. Here, we show that this so-called connectivity-guided decoding (CGD) effect broadly generalizes across a wide range of categories (tools, faces, bodies, hands, places). This effect is robust across dorsal stream areas, but less consistent in earlier ventral stream areas. In the latter regions, category discriminability is generally very high, suggesting that extraction of category-relevant visual properties is less reliant on connectivity to downstream areas. Further, CGD effects are primarily expressed in a category-specific manner: For example, within the network of tool regions, discriminability of tool information is greater than non-tool information. The connectivity-guided decoding approach shown here provides a novel demonstration of the crucial relationship between wider brain connectivity and complex local-level functional responses at different levels of the visual processing streams. Further, this approach generates testable new hypotheses about the relationships between connectivity and local selectivity.
Collapse
Affiliation(s)
- Jon Walbrin
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal; CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal.
| | - Paul E Downing
- School of Human and Behavioural Sciences, Bangor University, Bangor, Wales
| | - Filipa Dourado Sotero
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal; CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal
| | - Jorge Almeida
- Proaction Laboratory, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal; CINEICC, Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal
| |
Collapse
|
35
|
Dong X, Gui X, Klich S, Zhu L, Chen D, Sun Z, Shi Y, Chen A. The effects of football juggling learning on executive function and brain functional connectivity. Front Hum Neurosci 2024; 18:1362418. [PMID: 38516307 PMCID: PMC10954781 DOI: 10.3389/fnhum.2024.1362418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Accepted: 02/20/2024] [Indexed: 03/23/2024] Open
Abstract
This study aimed to explore the relationship between motor skill learning and executive function (EF), with an emphasis on the potential effects of football juggling learning. A randomized controlled trial involving 111 participants aged 17-19 years was conducted. Participants were randomly assigned to either the football juggling learning (FJL) group or a control group. The FJL group underwent 70 sessions of football juggling learning, while the control group engaged in their normal daily activities without any exercise intervention during the same time frame. Both groups were assessed for EF performance and underwent functional magnetic resonance imaging (fMRI) scans before and after the experiment. The executive function test included three tasks, namely, inhibition, working memory, and shifting. The results showed significant improvement in inhibition and shifting in both groups, and the FJL group showed greater improvement in these aspects of EF compared to the control group. Additionally, in comparison to the control group, the FJL group exhibited increased functional connectivity within the frontal, temporal, and cerebellar regions from the pre-test to the post-test. Notably, enhanced functional connectivity between the right superior temporal gyrus (posterior division) and left cerebellum 6 was identified in the FJL group and was associated with improved EF performance induced by football juggling learning. These findings shed light on the potential causal relationship between motor skill learning, EF, and brain plasticity. Importantly, our study provides preliminary evidence supporting the use of motor skill learning, such as football juggling, as a potential avenue for cognitive enhancement.
Collapse
Affiliation(s)
| | - Xiang Gui
- Yangzhou University, Yangzhou, China
| | - Sebastian Klich
- Department of Paralympic Sport, Wroclaw University of Health and Sport Sciences, Wroclaw, Poland
| | - Lina Zhu
- Yangzhou University, Yangzhou, China
| | | | | | - Yifan Shi
- Yangzhou University, Yangzhou, China
| | | |
Collapse
|
36
|
Ziereis A, Schacht A. Additive effects of emotional expression and stimulus size on the perception of genuine and artificial facial expressions: an ERP study. Sci Rep 2024; 14:5574. [PMID: 38448642 PMCID: PMC10918072 DOI: 10.1038/s41598-024-55678-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 02/26/2024] [Indexed: 03/08/2024] Open
Abstract
Seeing an angry individual in close physical proximity can not only result in a larger retinal representation of that individual and an enhanced resolution of emotional cues, but may also increase motivation for rapid visual processing and action preparation. The present study investigated the effects of stimulus size and emotional expression on the perception of happy, angry, non-expressive, and scrambled faces. We analyzed event-related potentials (ERPs) and behavioral responses of N = 40 participants who performed a naturalness classification task on real and artificially created facial expressions. While the emotion-related effects on accuracy for recognizing authentic expressions were modulated by stimulus size, ERPs showed only additive effects of stimulus size and emotional expression, with no significant interaction with size. This contrasts with previous research on emotional scenes and words. Effects of size were present in all included ERPs, whereas emotional expressions affected the N170, EPN, and LPC, irrespective of size. These results imply that the decoding of emotional valence in faces can occur even for small stimuli. Supra-additive effects in faces may necessitate larger size ranges or dynamic stimuli that increase arousal.
Collapse
Affiliation(s)
- Annika Ziereis
- Department for Cognition, Emotion and Behavior, Affective Neuroscience and Psychophysiology Laboratory, Georg-August-University of Göttingen, 37073, Göttingen, Germany.
| | - Anne Schacht
- Department for Cognition, Emotion and Behavior, Affective Neuroscience and Psychophysiology Laboratory, Georg-August-University of Göttingen, 37073, Göttingen, Germany
| |
Collapse
|
37
|
Spagna A, Heidenry Z, Miselevich M, Lambert C, Eisenstadt BE, Tremblay L, Liu Z, Liu J, Bartolomeo P. Visual mental imagery: Evidence for a heterarchical neural architecture. Phys Life Rev 2024; 48:113-131. [PMID: 38217888 DOI: 10.1016/j.plrev.2023.12.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Accepted: 12/26/2023] [Indexed: 01/15/2024]
Abstract
Theories of Visual Mental Imagery (VMI) emphasize the processes of retrieval, modification, and recombination of sensory information from long-term memory. Yet, only few studies have focused on the behavioral mechanisms and neural correlates supporting VMI of stimuli from different semantic domains. Therefore, we currently have a limited understanding of how the brain generates and maintains mental representations of colors, faces, shapes - to name a few. Such an undetermined scenario renders unclear the organizational structure of neural circuits supporting VMI, including the role of the early visual cortex. We aimed to fill this gap by reviewing the scientific literature of five semantic domains: visuospatial, face, colors, shapes, and letters imagery. Linking theory to evidence from over 60 different experimental designs, this review highlights three main points. First, there is no consistent activity in the early visual cortex across all VMI domains, contrary to the prediction of the dominant model. Second, there is consistent activity of the frontoparietal networks and the left hemisphere's fusiform gyrus during voluntary VMI irrespective of the semantic domain investigated. We propose that these structures are part of a domain-general VMI sub-network. Third, domain-specific information engages specific regions of the ventral and dorsal cortical visual pathways. These regions partly overlap with those found in visual perception studies (e.g., fusiform face area for faces imagery; lingual gyrus for color imagery). Altogether, the reviewed evidence suggests the existence of domain-general and domain-specific mechanisms of VMI selectively engaged by stimulus-specific properties (e.g., colors or faces). These mechanisms would be supported by an organizational structure mixing vertical and horizontal connections (heterarchy) between sub-networks for specific stimulus domains. Such a heterarchical organization of VMI makes different predictions from current models of VMI as reversed perception. Our conclusions set the stage for future research, which should aim to characterize the spatiotemporal dynamics and interactions among key regions of this architecture giving rise to visual mental images.
Collapse
Affiliation(s)
- Alfredo Spagna
- Department of Psychology, Columbia University in the City of New York, NY, 10027, USA.
| | - Zoe Heidenry
- Department of Psychology, Columbia University in the City of New York, NY, 10027, USA
| | | | - Chloe Lambert
- Department of Psychology, Columbia University in the City of New York, NY, 10027, USA
| | | | - Laura Tremblay
- Department of Psychology, Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California; Department of Neurology, VA Northern California Health Care System, Martinez, California
| | - Zixin Liu
- Department of Human Development, Teachers College, Columbia University, NY, 10027, USA
| | - Jianghao Liu
- Sorbonne Université, Inserm, CNRS, Paris Brain Institute, ICM, Hôpital de la Pitié-Salpêtrière, Paris 10027, France; Dassault Systèmes, Vélizy-Villacoublay, France
| | - Paolo Bartolomeo
- Sorbonne Université, Inserm, CNRS, Paris Brain Institute, ICM, Hôpital de la Pitié-Salpêtrière, Paris 10027, France
| |
Collapse
|
38
|
Willbrand EH, Jackson S, Chen S, Hathaway CB, Voorhies WI, Bunge SA, Weiner KS. Sulcal variability in anterior lateral prefrontal cortex contributes to variability in reasoning performance among young adults. Brain Struct Funct 2024; 229:387-402. [PMID: 38184493 DOI: 10.1007/s00429-023-02734-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 11/12/2023] [Indexed: 01/08/2024]
Abstract
Identifying structure-function correspondences is a major goal among biologists, cognitive neuroscientists, and brain mappers. Recent studies have identified relationships between performance on cognitive tasks and the presence or absence of small, shallow indentations, or sulci, of the human brain. Building on the previous finding that the presence of the ventral para-intermediate frontal sulcus (pimfs-v) in the left anterior lateral prefrontal cortex (aLPFC) was related to reasoning task performance in children and adolescents, we tested whether this relationship extended to a different sample, age group, and reasoning task. As predicted, the presence of this aLPFC sulcus was also associated with higher reasoning scores in young adults (ages 22-36). These findings have not only direct developmental, but also evolutionary relevance-as recent work shows that the pimfs-v is exceedingly rare in chimpanzees. Thus, the pimfs-v is a key developmental, cognitive, and evolutionarily relevant feature that should be considered in future studies examining how the complex relationships among multiscale anatomical and functional features of the brain give rise to abstract thought.
Collapse
Affiliation(s)
- Ethan H Willbrand
- Medical Scientist Training Program, School of Medicine and Public Health, University of WI-Madison, Madison, WI, USA
| | - Samantha Jackson
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA
| | - Szeshuen Chen
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| | | | - Willa I Voorhies
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| | - Silvia A Bunge
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA.
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA.
| | - Kevin S Weiner
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, USA.
- Department of Psychology, University of California, Berkeley, Berkeley, CA, USA.
| |
Collapse
|
39
|
Stoinski LM, Perkuhn J, Hebart MN. THINGSplus: New norms and metadata for the THINGS database of 1854 object concepts and 26,107 natural object images. Behav Res Methods 2024; 56:1583-1603. [PMID: 37095326 PMCID: PMC10991023 DOI: 10.3758/s13428-023-02110-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/13/2023] [Indexed: 04/26/2023]
Abstract
To study visual and semantic object representations, the need for well-curated object concepts and images has grown significantly over the past years. To address this, we have previously developed THINGS, a large-scale database of 1854 systematically sampled object concepts with 26,107 high-quality naturalistic images of these concepts. With THINGSplus, we significantly extend THINGS by adding concept- and image-specific norms and metadata for all 1854 concepts and one copyright-free image example per concept. Concept-specific norms were collected for the properties of real-world size, manmadeness, preciousness, liveliness, heaviness, naturalness, ability to move or be moved, graspability, holdability, pleasantness, and arousal. Further, we provide 53 superordinate categories as well as typicality ratings for all their members. Image-specific metadata includes a nameability measure, based on human-generated labels of the objects depicted in the 26,107 images. Finally, we identified one new public domain image per concept. Property (M = 0.97, SD = 0.03) and typicality ratings (M = 0.97, SD = 0.01) demonstrate excellent consistency, with the subsequently collected arousal ratings as the only exception (r = 0.69). Our property (M = 0.85, SD = 0.11) and typicality (r = 0.72, 0.74, 0.88) data correlated strongly with external norms, again with the lowest validity for arousal (M = 0.41, SD = 0.08). To summarize, THINGSplus provides a large-scale, externally validated extension to existing object norms and an important extension to THINGS, allowing detailed selection of stimuli and control variables for a wide range of research interested in visual object processing, language, and semantic memory.
Collapse
Affiliation(s)
- Laura M Stoinski
- Max Planck Institute for Human Cognitive & Brain Sciences, Leipzig, Germany.
| | - Jonas Perkuhn
- Max Planck Institute for Human Cognitive & Brain Sciences, Leipzig, Germany
| | - Martin N Hebart
- Max Planck Institute for Human Cognitive & Brain Sciences, Leipzig, Germany
- Justus Liebig University, Gießen, Germany
| |
Collapse
|
40
|
Yablonski M, Karipidis II, Kubota E, Yeatman JD. The transition from vision to language: Distinct patterns of functional connectivity for subregions of the visual word form area. Hum Brain Mapp 2024; 45:e26655. [PMID: 38488471 PMCID: PMC10941549 DOI: 10.1002/hbm.26655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 12/22/2023] [Accepted: 02/26/2024] [Indexed: 03/18/2024] Open
Abstract
Reading entails transforming visual symbols to sound and meaning. This process depends on specialized circuitry in the visual cortex, the visual word form area (VWFA). Recent findings suggest that this text-selective cortex comprises at least two distinct subregions: the more posterior VWFA-1 is sensitive to visual features, while the more anterior VWFA-2 processes higher level language information. Here, we explore whether these two subregions also exhibit different patterns of functional connectivity. To this end, we capitalize on two complementary datasets: Using the Natural Scenes Dataset (NSD), we identify text-selective responses in high-quality 7T adult data (N = 8), and investigate functional connectivity patterns of VWFA-1 and VWFA-2 at the individual level. We then turn to the Healthy Brain Network (HBN) database to assess whether these patterns replicate in a large developmental sample (N = 224; age 6-20 years), and whether they relate to reading development. In both datasets, we find that VWFA-1 is primarily correlated with bilateral visual regions. In contrast, VWFA-2 is more strongly correlated with language regions in the frontal and lateral parietal lobes, particularly the bilateral inferior frontal gyrus. Critically, these patterns do not generalize to adjacent face-selective regions, suggesting a specific relationship between VWFA-2 and the frontal language network. No correlations were observed between functional connectivity and reading ability. Together, our findings support the distinction between subregions of the VWFA, and suggest that functional connectivity patterns in the ventral temporal cortex are consistent over a wide range of reading skills.
Collapse
Affiliation(s)
- Maya Yablonski
- Division of Developmental‐Behavioral Pediatrics, Department of PediatricsStanford University School of MedicineStanfordCaliforniaUSA
- Stanford University Graduate School of EducationStanfordCaliforniaUSA
| | - Iliana I. Karipidis
- Department of Psychiatry and Behavioral SciencesStanford School of MedicineStanfordCaliforniaUSA
- Department of Child and Adolescent Psychiatry and PsychotherapyUniversity Hospital of Psychiatry Zurich, University of ZurichZürichSwitzerland
- Neuroscience Center ZurichUniversity of Zurich and ETHZurichSwitzerland
| | - Emily Kubota
- Psychology DepartmentStanford UniversityStanfordCaliforniaUSA
| | - Jason D. Yeatman
- Division of Developmental‐Behavioral Pediatrics, Department of PediatricsStanford University School of MedicineStanfordCaliforniaUSA
- Stanford University Graduate School of EducationStanfordCaliforniaUSA
- Psychology DepartmentStanford UniversityStanfordCaliforniaUSA
| |
Collapse
|
41
|
Monosov IE. Curiosity: primate neural circuits for novelty and information seeking. Nat Rev Neurosci 2024; 25:195-208. [PMID: 38263217 DOI: 10.1038/s41583-023-00784-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/13/2023] [Indexed: 01/25/2024]
Abstract
For many years, neuroscientists have investigated the behavioural, computational and neurobiological mechanisms that support value-based decisions, revealing how humans and animals make choices to obtain rewards. However, many decisions are influenced by factors other than the value of physical rewards or second-order reinforcers (such as money). For instance, animals (including humans) frequently explore novel objects that have no intrinsic value solely because they are novel and they exhibit the desire to gain information to reduce their uncertainties about the future, even if this information cannot lead to reward or assist them in accomplishing upcoming tasks. In this Review, I discuss how circuits in the primate brain responsible for detecting, predicting and assessing novelty and uncertainty regulate behaviour and give rise to these behavioural components of curiosity. I also briefly discuss how curiosity-related behaviours arise during postnatal development and point out some important reasons for the persistence of curiosity across generations.
Collapse
Affiliation(s)
- Ilya E Monosov
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO, USA.
- Department of Electrical Engineering, Washington University, St. Louis, MO, USA.
- Department of Biomedical Engineering, Washington University, St. Louis, MO, USA.
- Department of Neurosurgery, Washington University, St. Louis, MO, USA.
- Pain Center, Washington University, St. Louis, MO, USA.
| |
Collapse
|
42
|
Weisberg SM, Ebner NC, Seidler RD. Getting LOST: A conceptual framework for supporting and enhancing spatial navigation in aging. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2024; 15:e1669. [PMID: 37933623 PMCID: PMC10939954 DOI: 10.1002/wcs.1669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 10/09/2023] [Accepted: 10/10/2023] [Indexed: 11/08/2023]
Abstract
Spatial navigation is more difficult and effortful for older than younger individuals, a shift which occurs for a variety of neurological, physical, and cognitive reasons associated with aging. Despite a large body of evidence documenting age-related deficits in spatial navigation, comparatively less research addresses how to facilitate more effective navigation behavior for older adults. Since navigation challenges arise for a variety of reasons in old age, a one-size-fits-all solution is unlikely to work. Here, we introduce a framework for the variety of spatial navigation challenges faced in aging, which we call LOST-Location, Orientation, Spatial mapping, and Transit. The LOST framework builds on evidence from the cognitive neuroscience of spatial navigation, which reveals distinct components underpinning human wayfinding. We evaluate research on navigational aids-devices and depictions-which help people find their way around; and we reflect on how navigation aids solve (or fail to solve) specific wayfinding difficulties faced by older adults. In summary, we emphasize a bespoke approach to improving spatial navigation in aging, which focuses on tailoring navigation solutions to specific navigation challenges. Our hope is that by providing precise support to older navigators, navigation opportunities can facilitate independence and exploration, while minimizing the danger of becoming lost. We conclude by delineating critical knowledge gaps in how to improve older adults' spatial navigation capacities that the novel LOST framework could guide to address. This article is categorized under: Psychology > Development and Aging Neuroscience > Cognition Neuroscience > Behavior.
Collapse
Affiliation(s)
- Steven M. Weisberg
- Department of Psychology, University of Florida, 945 Center Dr., Gainesville, FL 32611
- Center for Cognitive Aging and Memory, Department of Clinical and Health Psychology, University of Florida, 1225 Center Dr., Gainesville, FL 32611
| | - Natalie C. Ebner
- Department of Psychology, University of Florida, 945 Center Dr., Gainesville, FL 32611
- Center for Cognitive Aging and Memory, Department of Clinical and Health Psychology, University of Florida, 1225 Center Dr., Gainesville, FL 32611
- Institute on Aging, University of Florida, 2004 Mowry Rd., Gainesville, FL 32611
- Department of Physiology and Aging, University of Florida, 1345 Center Drive, Gainesville, FL 32610-0274
| | - Rachael D. Seidler
- Department of Applied Physiology & Kinesiology, University of Florida, 1864 Stadium Rd., Gainesville, FL 32611
- Department of Neurology, University of Florida, 1149 Newell Dr., Gainesville, FL 32611
- Normal Fixel Institute for Neurological Diseases, University of Florida, 3009 SW Williston Rd. 1864 Stadium Rd., Gainesville, FL 32608
| |
Collapse
|
43
|
Ritchie JB, Andrews S, Vaziri-Pashkam M, Baker CI. Graspable foods and tools elicit similar responses in visual cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.20.581258. [PMID: 38529495 PMCID: PMC10962699 DOI: 10.1101/2024.02.20.581258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/27/2024]
Abstract
Extrastriatal visual cortex is known to exhibit distinct response profiles to complex stimuli of varying ecological importance (e.g., faces, scenes, and tools). The dominant interpretation of these effects is that they reflect activation of distinct "category-selective" brain regions specialized to represent these and other stimulus categories. We sought to explore an alternative perspective: that the response to these stimuli is determined less by whether they form distinct categories, and more by their relevance to different forms of natural behavior. In this regard, food is an interesting test case, since it is primarily distinguished from other objects by its edibility, not its appearance, and there is evidence of food-selectivity in human visual cortex. Food is also associated with a common behavior, eating, and food consumption typically also involves the manipulation of food, often with the hands. In this context, food items share many properties in common with tools: they are graspable objects that we manipulate in self-directed and stereotyped forms of action. Thus, food items may be preferentially represented in extrastriatal visual cortex in part because of these shared affordance properties, rather than because they reflect a wholly distinct kind of category. We conducted fMRI and behavioral experiments to test this hypothesis. We found that behaviorally graspable food items and tools were judged to be similar in their action-related properties, and that the location, magnitude, and patterns of neural responses for images of graspable food items were similar in profile to the responses for tool stimuli. Our findings suggest that food-selectivity may reflect the behavioral affordances of food items rather than a distinct form of category-selectivity.
Collapse
|
44
|
Luo X, Li M, Zeng J, Dai Z, Cui Z, Zhu M, Tian M, Wu J, Han Z. Mechanisms underlying category learning in the human ventral occipito-temporal cortex. Neuroimage 2024; 287:120520. [PMID: 38242489 DOI: 10.1016/j.neuroimage.2024.120520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 01/07/2024] [Accepted: 01/17/2024] [Indexed: 01/21/2024] Open
Abstract
The human ventral occipito-temporal cortex (VOTC) has evolved into specialized regions that process specific categories, such as words, tools, and animals. The formation of these areas is driven by bottom-up visual and top-down nonvisual experiences. However, the specific mechanisms through which top-down nonvisual experiences modulate category-specific regions in the VOTC are still unknown. To address this question, we conducted a study in which participants were trained for approximately 13 h to associate three sets of novel meaningless figures with different top-down nonvisual features: the wordlike category with word features, the non-wordlike category with nonword features, and the visual familiarity condition with no nonvisual features. Pre- and post-training functional MRI (fMRI) experiments were used to measure brain activity during stimulus presentation. Our results revealed that training induced a categorical preference for the two training categories within the VOTC. Moreover, the locations of two training category-specific regions exhibited a notable overlap. Remarkably, within the overlapping category-specific region, training resulted in a dissociation in activation intensity and pattern between the two training categories. These findings provide important insights into how different nonvisual categorical information is encoded in the human VOTC.
Collapse
Affiliation(s)
- Xiangqi Luo
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, PR China
| | - Mingyang Li
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou 310027, PR China
| | - Jiahong Zeng
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, PR China
| | - Zhiyun Dai
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, PR China
| | - Zhenjiang Cui
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, PR China
| | - Minhong Zhu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, PR China
| | - Mengxin Tian
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, PR China
| | - Jiahao Wu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, PR China
| | - Zaizhu Han
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, PR China.
| |
Collapse
|
45
|
Shang L, Yeh LC, Zhao Y, Wiegand I, Peelen MV. Category-based attention facilitates memory search. eNeuro 2024; 11:ENEURO.0012-24.2024. [PMID: 38331577 PMCID: PMC10897531 DOI: 10.1523/eneuro.0012-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Accepted: 01/16/2024] [Indexed: 02/10/2024] Open
Abstract
We often need to decide whether the object we look at is also the object we look for. When we look for one specific object, this process can be facilitated by feature-based attention. However, when we look for many objects at the same time (e.g., the products on our shopping list) such a strategy may no longer be possible, as research has shown that we can actively prepare to detect only one or two objects at a time. Therefore, looking for multiple objects additionally requires long-term memory search, slowing down decision making. Interestingly, however, previous research has shown that distractor objects can be efficiently rejected during memory search when they are from a different category than the items in the memory set. Here, using EEG, we show that this efficiency is supported by top-down attention at the category level. In Experiment 1, human participants (both sexes) performed a memory search task on individually presented objects from different categories, most of which were distractors. We observed category-level attentional modulation of distractor processing from ∼150 ms after stimulus onset, expressed both as an evoked response modulation and as an increase in decoding accuracy of same-category distractors. In Experiment 2, memory search was performed on two concurrently presented objects. When both objects were distractors, spatial attention (indexed by the N2pc component) was directed to the object that was of the same category as the objects in the memory set. Together, these results demonstrate how top-down attention can facilitate memory search.Significance statement When we are in the supermarket, we repeatedly decide whether a product we look at (e.g., a banana) is on our memorized shopping list (e.g., apples, oranges, kiwis). This requires searching our memory, which takes time. However, when the product is of an entirely different category (e.g., dairy instead of fruit), the decision can be made quickly. Here, we used EEG to show that this between-category advantage in memory search tasks is supported by top-down attentional modulation of visual processing: The visual response evoked by distractor objects was modulated by category membership, and spatial attention was quickly directed to the location of within-category (vs. between-category) distractors. These results demonstrate a close link between attention and memory.
Collapse
Affiliation(s)
- Linlin Shang
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, 6525 GD Nijmegen, The Netherlands
| | - Lu-Chun Yeh
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus-Liebig-University Gießen, 35392 Gießen, Germany
| | - Yuanfang Zhao
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD, USA
| | - Iris Wiegand
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, 6525 GD Nijmegen, The Netherlands
| | - Marius V Peelen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, 6525 GD Nijmegen, The Netherlands
| |
Collapse
|
46
|
Yeo DJ, Pollack C, Conrad BN, Price GR. Functional and representational differences between bilateral inferior temporal numeral areas. Cortex 2024; 171:113-135. [PMID: 37992508 DOI: 10.1016/j.cortex.2023.08.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 12/15/2022] [Accepted: 08/09/2023] [Indexed: 11/24/2023]
Abstract
The processing of numerals as visual objects is supported by an "Inferior Temporal Numeral Area" (ITNA) in the bilateral inferior temporal gyri (ITG). Extant findings suggest some degree of hemispheric asymmetry in how the bilateral ITNAs process numerals. Pollack and Price (2019) reported such a hemispheric asymmetry by which a region in the left ITG was sensitive to digits during a visual search for a digit among letters, and a homologous region in the right ITG that showed greater digit sensitivity in individuals with higher calculation skills. However, the ITG regions were localized with separate analyses without directly contrasting their digit sensitivities and relation to calculation skills. So, the extent of and reasons for these functional asymmetries remain unclear. Here we probe whether the functional and representational properties of the ITNAs are asymmetric by applying both univariate and multivariate region-of-interest analyses to Pollack and Price's (2019) data. Contrary to the implications of the original findings, digit sensitivity did not differ between ITNAs, and digit sensitivity in both left and right ITNAs was associated with calculation skills. Representational similarity analyses revealed that the overall representational geometries of digits in the ITNAs were also correlated, albeit weakly, but the representational contents of the ITNAs were largely inconclusive. Nonetheless, we found a right lateralization in engagement in alphanumeric categorization, and that the right ITNA showed greater discriminability between digits and letters. Greater right lateralization of digit sensitivity and digit discriminability in the left ITNA were also related to higher calculation skills. Our findings thus suggest that the ITNAs may not be functionally identical and should be directly contrasted in future work. Our study also highlights the importance of within-individual comparisons for understanding hemispheric asymmetries, and analyses of individual differences and multivariate features to uncover effects that would otherwise be obscured by averages.
Collapse
Affiliation(s)
- Darren J Yeo
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, Nashville, TN, USA; Division of Psychology, School of Social Sciences, Nanyang Technological University, Singapore
| | - Courtney Pollack
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, Nashville, TN, USA
| | - Benjamin N Conrad
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, Nashville, TN, USA
| | - Gavin R Price
- Department of Psychology & Human Development, Peabody College, Vanderbilt University, Nashville, TN, USA; Department of Psychology, University of Exeter, Exeter, United Kingdom.
| |
Collapse
|
47
|
Abassi E, Papeo L. Category-Selective Representation of Relationships in the Visual Cortex. J Neurosci 2024; 44:e0250232023. [PMID: 38124013 PMCID: PMC10860595 DOI: 10.1523/jneurosci.0250-23.2023] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 09/29/2023] [Accepted: 10/14/2023] [Indexed: 12/23/2023] Open
Abstract
Understanding social interaction requires processing social agents and their relationships. The latest results show that much of this process is visually solved: visual areas can represent multiple people encoding emergent information about their interaction that is not explained by the response to the individuals alone. A neural signature of this process is an increased response in visual areas, to face-to-face (seemingly interacting) people, relative to people presented as unrelated (back-to-back). This effect highlighted a network of visual areas for representing relational information. How is this network organized? Using functional MRI, we measured the brain activity of healthy female and male humans (N = 42), in response to images of two faces or two (head-blurred) bodies, facing toward or away from each other. Taking the facing > non-facing effect as a signature of relation perception, we found that relations between faces and between bodies were coded in distinct areas, mirroring the categorical representation of faces and bodies in the visual cortex. Additional analyses suggest the existence of a third network encoding relations between (nonsocial) objects. Finally, a separate occipitotemporal network showed the generalization of relational information across body, face, and nonsocial object dyads (multivariate pattern classification analysis), revealing shared properties of relations across categories. In sum, beyond single entities, the visual cortex encodes the relations that bind multiple entities into relationships; it does so in a category-selective fashion, thus respecting a general organizing principle of representation in high-level vision. Visual areas encoding visual relational information can reveal the processing of emergent properties of social (and nonsocial) interaction, which trigger inferential processes.
Collapse
Affiliation(s)
- Etienne Abassi
- Institut des Sciences Cognitives-Marc Jeannerod, UMR5229, Centre National de la Recherche Scientifique (CNRS), Université Claude Bernard Lyon 1, Bron 69675, France
| | - Liuba Papeo
- Institut des Sciences Cognitives-Marc Jeannerod, UMR5229, Centre National de la Recherche Scientifique (CNRS), Université Claude Bernard Lyon 1, Bron 69675, France
| |
Collapse
|
48
|
Dalski A, Kular H, Jorgensen JG, Grill-Spector K, Grotheer M. Both mOTS-words and pOTS-words prefer emoji stimuli over text stimuli during a reading task. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.11.07.565794. [PMID: 37986766 PMCID: PMC10659328 DOI: 10.1101/2023.11.07.565794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
The visual word form area in the occipitotemporal sulcus (OTS), here referred to as OTS-words, responds more strongly to text than other visual stimuli and is crucial for reading. We hypothesized, that this text preference may be driven by a preference for reading tasks, as in most prior fMRI studies only the text stimuli were readable. Hence, we performed three fMRI experiments (N=15) and systematically varied the participant's task and the stimulus, investigating mOTS-words and pOTS-words subregions. In experiment 1, we contrasted text stimuli with non-readable visual stimuli (faces, limbs, houses, objects). Experiment 2 utilized an fMRI adaptation paradigm, presenting compound words in text or emoji formats. In experiment 3, participants performed a reading or a color task on compound words in text or emoji format. Using experiment 1 data, we identified mOTS-words and pOTS-words by contrasting texts with non-readable stimuli. In experiment 2, pOTS-words, but not mOTS-words, showed fMRI adaptation for compound words in both text and emoji formats. In experiment 3, surprisingly, both subregions showed higher responses to compound words in emoji than text format. Moreover, mOTS-words showed higher responses during the reading than the color task and a task-stimulus interaction. Multivariate analyses revealed that distributed responses in pOTS-words encode the visual stimulus, while responses in mOTS-words encode both stimulus and task. Together, our findings suggest that the function of the OTS-words subregions goes beyond the specific visual processing of text and that these regions are flexibly recruited whenever semantic meaning needs to be assigned to visual input.
Collapse
Affiliation(s)
- Alexia Dalski
- Department of Psychology, Philipps-Universität Marburg, Marburg 35039, Germany
- Center for Mind, Brain and Behavior – CMBB, Philipps-Universität Marburg and Justus-Liebig-Universität Giessen, Marburg 35032, Germany
| | - Holly Kular
- Department of Psychology, Stanford University, Stanford, CA 94305, USA
| | | | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, Stanford, CA 94305, USA
- Wu Tsai Neurosciences Institute, Stanford University, CA 94305, USA
| | - Mareike Grotheer
- Department of Psychology, Philipps-Universität Marburg, Marburg 35039, Germany
- Center for Mind, Brain and Behavior – CMBB, Philipps-Universität Marburg and Justus-Liebig-Universität Giessen, Marburg 35032, Germany
| |
Collapse
|
49
|
Karakose-Akbiyik S, Sussman O, Wurm MF, Caramazza A. The Role of Agentive and Physical Forces in the Neural Representation of Motion Events. J Neurosci 2024; 44:e1363232023. [PMID: 38050107 PMCID: PMC10860628 DOI: 10.1523/jneurosci.1363-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 11/14/2023] [Accepted: 11/19/2023] [Indexed: 12/06/2023] Open
Abstract
How does the brain represent information about motion events in relation to agentive and physical forces? In this study, we investigated the neural activity patterns associated with observing animated actions of agents (e.g., an agent hitting a chair) in comparison to similar movements of inanimate objects that were either shaped solely by the physics of the scene (e.g., gravity causing an object to fall down a hill and hit a chair) or initiated by agents (e.g., a visible agent causing an object to hit a chair). Using an fMRI-based multivariate pattern analysis (MVPA), this design allowed testing where in the brain the neural activity patterns associated with motion events change as a function of, or are invariant to, agentive versus physical forces behind them. A total of 29 human participants (nine male) participated in the study. Cross-decoding revealed a shared neural representation of animate and inanimate motion events that is invariant to agentive or physical forces in regions spanning frontoparietal and posterior temporal cortices. In contrast, the right lateral occipitotemporal cortex showed a higher sensitivity to agentive events, while the left dorsal premotor cortex was more sensitive to information about inanimate object events that were solely shaped by the physics of the scene.
Collapse
Affiliation(s)
| | - Oliver Sussman
- Department of Psychology, Harvard University, Cambridge, Massachusetts 02138
| | - Moritz F Wurm
- Center for Mind/Brain Sciences - CIMeC, University of Trento, 38068 Rovereto, Italy
| | - Alfonso Caramazza
- Department of Psychology, Harvard University, Cambridge, Massachusetts 02138
- Center for Mind/Brain Sciences - CIMeC, University of Trento, 38068 Rovereto, Italy
| |
Collapse
|
50
|
Kubota E, Grill-Spector K, Nordt M. Rethinking cortical recycling in ventral temporal cortex. Trends Cogn Sci 2024; 28:8-17. [PMID: 37858388 PMCID: PMC10841108 DOI: 10.1016/j.tics.2023.09.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 09/18/2023] [Accepted: 09/20/2023] [Indexed: 10/21/2023]
Abstract
High-level visual areas in ventral temporal cortex (VTC) support recognition of important categories, such as faces and words. Word-selective regions are left lateralized and emerge at the onset of reading instruction. Face-selective regions are right lateralized and have been documented in infancy. Prevailing theories suggest that face-selective regions become right lateralized due to competition with word-selective regions in the left hemisphere. However, recent longitudinal studies examining face- and word-selective responses in childhood do not provide support for this theory. Instead, there is evidence that word representations recycle cortex previously involved in processing other stimuli, such as limbs. These findings call for more longitudinal investigations of cortical recycling and a new era of work that links visual experience and behavior with neural responses.
Collapse
Affiliation(s)
- Emily Kubota
- Department of Psychology, Stanford University, Stanford, CA, USA.
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University, Stanford, CA, USA; Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Marisa Nordt
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, Medical Faculty, RWTH Aachen University, Aachen, Germany; JARA-Brain Institute II, Molecular Neuroscience and Neuroimaging, RWTH Aachen and Research Centre Juelich, Juelich, Germany
| |
Collapse
|