1
|
Yao L, Fu Q, Liu CH. The roles of edge-based and surface-based information in the dynamic neural representation of objects. Neuroimage 2023; 283:120425. [PMID: 37890562 DOI: 10.1016/j.neuroimage.2023.120425] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 10/22/2023] [Accepted: 10/24/2023] [Indexed: 10/29/2023] Open
Abstract
We combined multivariate pattern analysis (MVPA) and electroencephalogram (EEG) to investigate the role of edge, color, and other surface information in the neural representation of visual objects. Participants completed a one-back task in which they were presented with color photographs, grayscale images, and line drawings of animals, tools, and fruits. Our results provide the first neural evidence that line drawings elicit similar neural activities as color photographs and grayscale images during the 175-305 ms window after the stimulus onset. Furthermore, we found that other surface information, rather than color information, facilitates decoding accuracy in the early stages of object representations and affects the speed of this. These results provide new insights into the role of edge-based and surface-based information in the dynamic process of neural representations of visual objects.
Collapse
Affiliation(s)
- Liansheng Yao
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Qiufang Fu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.
| | - Chang Hong Liu
- Department of Psychology, Bournemouth University, Fern Barrow, Poole, UK
| |
Collapse
|
2
|
Tharmaratnam V, Patel M, Lowe MX, Cant JS. Shared cognitive mechanisms involved in the processing of scene texture and scene shape. J Vis 2021; 21:11. [PMID: 34269793 PMCID: PMC8297417 DOI: 10.1167/jov.21.7.11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Recent research has demonstrated that the parahippocampal place area represents both the shape and texture features of scenes, with the importance of each feature varying according to perceived scene category. Namely, shape features are predominately more diagnostic to the processing of artificial human–made scenes, while shape and texture are equally diagnostic in natural scene processing. However, to date little is known regarding the degree of interactivity or independence observed in the processing of these scene features. Furthermore, manipulating the scope of visual attention (i.e., globally vs. locally) when processing ensembles of multiple objects—stimuli that share a functional neuroanatomical link with scenes—has been shown to affect their cognitive visual representation. It remains unknown whether manipulating the scope of attention impacts scene processing in a similar manner. Using the well-established Garner speeded-classification behavioral paradigm, we investigated the influence of both feature diagnosticity and the scope of visual attention on potential interactivity or independence in the shape and texture processing of artificial human–made scenes. The results revealed asymmetric interference between scene shape and texture processing, with the more diagnostic feature (i.e., shape) interfering with the less diagnostic feature (i.e., texture), but not vice versa. Furthermore, this interference was attenuated and enhanced with more local and global visual processing strategies, respectively. These findings suggest that the scene shape and texture processing are mediated by shared cognitive mechanisms and that, although these representations are governed primarily via feature diagnosticity, they can nevertheless be influenced by the scope of visual attention.
Collapse
Affiliation(s)
| | | | - Matthew X Lowe
- Graduate Program in Psychology, University of Toronto, Toronto, ON, Canada.,
| | - Jonathan S Cant
- Graduate Program in Psychology, University of Toronto, Toronto, ON, Canada.,Department of Psychology, University of Toronto Scarborough, Toronto, ON, Canada.,
| |
Collapse
|
3
|
Robin J, Rivest J, Rosenbaum RS, Moscovitch M. Remote spatial and autobiographical memory in cases of episodic amnesia and topographical disorientation. Cortex 2019; 119:237-257. [DOI: 10.1016/j.cortex.2019.04.013] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 03/24/2019] [Accepted: 04/23/2019] [Indexed: 12/11/2022]
|
4
|
Robin J, Rai Y, Valli M, Olsen RK. Category specificity in the medial temporal lobe: A systematic review. Hippocampus 2018; 29:313-339. [PMID: 30155943 DOI: 10.1002/hipo.23024] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2018] [Revised: 08/03/2018] [Accepted: 08/07/2018] [Indexed: 01/30/2023]
Abstract
Theoretical accounts of medial temporal lobe (MTL) function ascribe different functions to subregions of the MTL including perirhinal, entorhinal, parahippocampal cortices, and the hippocampus. Some have suggested that the functional roles of these subregions vary in terms of their category specificity, showing preferential coding for certain stimulus types, but the evidence for this functional organization is mixed. In this systematic review, we evaluate existing evidence for regional specialization in the MTL for three categories of visual stimuli: faces, objects, and scenes. We review and synthesize across univariate and multivariate neuroimaging studies, as well as neuropsychological studies of cases with lesions to the MTL. Neuroimaging evidence suggests that faces activate the perirhinal cortex, entorhinal cortex, and the anterior hippocampus, while scenes engage the parahippocampal cortex and both the anterior and posterior hippocampus, depending on the contrast condition. There is some evidence for object-related activity in anterior MTL regions when compared to scenes, and in posterior MTL regions when compared to faces, suggesting that aspects of object representations may share similarities with face and scene representations. While neuroimaging evidence suggests some hippocampal specialization for faces and scenes, neuropsychological evidence shows that hippocampal damage leads to impairments in scene memory and perception, but does not entail equivalent impairments for faces in cases where the perirhinal cortex remains intact. Regional specialization based on stimulus categories has implications for understanding the mechanisms of MTL subregions, and highlights the need for the development of theoretical models of MTL function that can accommodate the differential patterns of specificity observed in the MTL.
Collapse
Affiliation(s)
- Jessica Robin
- Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada
| | - Yeshith Rai
- Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada
| | - Mikaeel Valli
- Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada.,Institute of Medical Science, University of Toronto, Toronto, Ontario, Canada
| | - Rosanna K Olsen
- Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada.,Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
5
|
Lowe MX, Rajsic J, Ferber S, Walther DB. Discriminating scene categories from brain activity within 100 milliseconds. Cortex 2018; 106:275-287. [PMID: 30037637 DOI: 10.1016/j.cortex.2018.06.006] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2017] [Revised: 02/26/2018] [Accepted: 06/01/2018] [Indexed: 10/28/2022]
Abstract
Humans have the ability to make sense of the world around them in only a single glance. This astonishing feat requires the visual system to extract information from our environment with remarkable speed. How quickly does this process unfold across time, and what visual information contributes to our understanding of the visual world? We address these questions by directly measuring the temporal dynamics of the perception of colour photographs and line drawings of scenes with electroencephalography (EEG) during a scene-memorization task. Within a fraction of a second, event-related potentials (ERPs) show dissociable response patterns for global scene properties of content (natural versus manmade) and layout (open versus closed). Subsequent detailed analyses of within-category versus between-category discriminations found significant dissociations of basic-level scene categories (e.g., forest; city) within the first 100 msec of perception. The similarity of this neural activity with feature-based discriminations suggests low-level image statistics may be foundational for this rapid categorization. Interestingly, our results also suggest that the structure preserved in line drawings may form a primary and necessary basis for visual processing, whereas surface information may further enhance category selectivity in later-stage processing. Critically, these findings provide evidence that the distinction of both basic-level categories and global properties of scenes from neural signals occurs within 100 msec.
Collapse
Affiliation(s)
| | - Jason Rajsic
- Psychology Department, University of Toronto, Canada
| | - Susanne Ferber
- Psychology Department, University of Toronto, Canada; Rotman Research Institute, Baycrest, Toronto, Canada
| | - Dirk B Walther
- Psychology Department, University of Toronto, Canada; Rotman Research Institute, Baycrest, Toronto, Canada
| |
Collapse
|
6
|
Robin J. Spatial scaffold effects in event memory and imagination. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2018; 9:e1462. [PMID: 29485243 DOI: 10.1002/wcs.1462] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/17/2017] [Revised: 01/04/2018] [Accepted: 01/12/2018] [Indexed: 01/06/2023]
Abstract
Spatial context is a defining feature of episodic memories, which are often characterized as being events occurring in specific spatiotemporal contexts. In this review, I summarize research suggesting a common neural basis for episodic and spatial memory and relate this to the role of spatial context in episodic memory. I review evidence that spatial context serves as a scaffold for episodic memory and imagination, in terms of both behavioral and neural effects demonstrating a dependence of episodic memory on spatial representations. These effects are mediated by a posterior-medial set of neocortical regions, including the parahippocampal cortex, retrosplenial cortex, posterior cingulate cortex, precuneus, and angular gyrus, which interact with the hippocampus to represent spatial context in remembered and imagined events. I highlight questions and areas that require further research, including differentiation of hippocampal function along its long axis and subfields, and how these areas interact with the posterior-medial network. This article is categorized under: Psychology > Memory Neuroscience > Cognition.
Collapse
Affiliation(s)
- Jessica Robin
- Rotman Research Institute, Baycrest Health Sciences, Toronto, Canada
| |
Collapse
|
7
|
Berlucchi G, Vallar G. The history of the neurophysiology and neurology of the parietal lobe. HANDBOOK OF CLINICAL NEUROLOGY 2018. [PMID: 29519464 DOI: 10.1016/b978-0-444-63622-5.00001-2] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
The development and change of knowledge on the function of the parietal lobe from the second half of the 19th century to the early 1970s are reviewed. Motor and somatosensory functions were initially localized in a broad frontoparietal region. At the beginning of the 20th century the motor cortex was restricted to the posterior frontal lobe. The separate attribution of somatosensory functions to the parietal lobe was initially based on anatomic considerations, but mostly on localized bodily sensations elicited by electric stimulation in awake patients. Patients and nonhuman primates with anterior parietal damage showed deficits in somatic sensation (tactile discrimination and position sense, less markedly pain and thermal sensitivity). Somatosensory evoked potentials demonstrated in all mammals that the body is orderly and multiply represented in the anterior parietal cortex. The parietal lobe was divided into an anterior and a posterior cortex (PPC). The PPC is particularly developed in primates, where it includes a superior and an inferior parietal lobule. The PPC was initially thought to be a higher-order region for somatosensory information processing, but its functional specialization proved soon to be greater and more complex. PPC damage in humans gives rise to a variety of neuropsychologic disorders: pain asymbolia, sensory extinction, spatial neglect, optic ataxia and limb apraxia, alexia and agraphia. Single-neuron recordings in freely behaving monkeys furnished the complementary information that the PPC is involved in body-environment interactions, for visual exploration and hand use as a sensor and a tool. The PPC is now believed to underpin higher-order processes of sensory inputs, multisensory and sensorimotor integration, spatial attention, intention, and the conjoint representation of external space and the body. The symptoms in which disorders of these processes manifest after PPC damage are considerably different in humans and nonhuman primates.
Collapse
Affiliation(s)
- Giovanni Berlucchi
- Department of Neuroscience, Biomedicine and Movement Science, School of Medicine and Surgery, University of Verona, Verona, and National Institute of Neuroscience, Pisa, Italy.
| | - Giuseppe Vallar
- Department of Psychology and NeuroMI-Milan Center for Neuroscience, University of Milano-Bicocca, and Neuropsychological Laboratory, IRCCS Istituto Auxologico Italiano, Milan, Italy
| |
Collapse
|
8
|
Lowe MX, Rajsic J, Gallivan JP, Ferber S, Cant JS. Neural representation of geometry and surface properties in object and scene perception. Neuroimage 2017. [PMID: 28647484 DOI: 10.1016/j.neuroimage.2017.06.043] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022] Open
Abstract
Multiple cortical regions are crucial for perceiving the visual world, yet the processes shaping representations in these regions are unclear. To address this issue, we must elucidate how perceptual features shape representations of the environment. Here, we explore how the weighting of different visual features affects neural representations of objects and scenes, focusing on the scene-selective parahippocampal place area (PPA), but additionally including the retrosplenial complex (RSC), occipital place area (OPA), lateral occipital (LO) area, fusiform face area (FFA) and occipital face area (OFA). Across three experiments, we examined functional magnetic resonance imaging (fMRI) activity while human observers viewed scenes and objects that varied in geometry (shape/layout) and surface properties (texture/material). Interestingly, we found equal sensitivity in the PPA for these properties within a scene, revealing that spatial-selectivity alone does not drive activation within this cortical region. We also observed sensitivity to object texture in PPA, but not to the same degree as scene texture, and representations in PPA varied when objects were placed within scenes. We conclude that PPA may process surface properties in a domain-specific manner, and that the processing of scene texture and geometry is equally-weighted in PPA and may be mediated by similar underlying neuronal mechanisms.
Collapse
Affiliation(s)
- Matthew X Lowe
- Department of Psychology (Scarborough), University of Toronto, Toronto, ON, Canada M1C 1A4; Department of Psychology (St. George), University of Toronto, Toronto, ON, Canada M5S 3G3.
| | - Jason Rajsic
- Department of Psychology (St. George), University of Toronto, Toronto, ON, Canada M5S 3G3
| | - Jason P Gallivan
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6; Department of Psychology, Queen's University, Kingston, ON, Canada K7L 3N6; Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Susanne Ferber
- Department of Psychology (St. George), University of Toronto, Toronto, ON, Canada M5S 3G3; Rotman Research Institute, Baycrest, Toronto, ON, Canada, M6A 2E1
| | - Jonathan S Cant
- Department of Psychology (Scarborough), University of Toronto, Toronto, ON, Canada M1C 1A4
| |
Collapse
|