1
|
Orban GA, Lanzilotto M, Bonini L. From Observed Action Identity to Social Affordances. Trends Cogn Sci 2021; 25:493-505. [PMID: 33745819 DOI: 10.1016/j.tics.2021.02.012] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 02/24/2021] [Accepted: 02/27/2021] [Indexed: 01/08/2023]
Abstract
Others' observed actions cause continuously changing retinal images, making it challenging to build neural representations of action identity. The monkey anterior intraparietal area (AIP) and its putative human homologue (phAIP) host neurons selective for observed manipulative actions (OMAs). The neuronal activity of both AIP and phAIP allows a stable readout of OMA identity across visual formats, but human neurons exhibit greater invariance and generalize from observed actions to action verbs. These properties stem from the convergence in AIP of superior temporal signals concerning: (i) observed body movements; and (ii) the changes in the body-object relationship. We propose that evolutionarily preserved mechanisms underlie the specification of observed-actions identity and the selection of motor responses afforded by them, thereby promoting social behavior.
Collapse
Affiliation(s)
- G A Orban
- Department of Medicine and Surgery, University of Parma, Parma, Italy
| | - M Lanzilotto
- Department of Psychology, University of Turin, Turin, Italy
| | - L Bonini
- Department of Medicine and Surgery, University of Parma, Parma, Italy.
| |
Collapse
|
2
|
Yoshioka TW, Doi T, Abdolrahmani M, Fujita I. Specialized contributions of mid-tier stages of dorsal and ventral pathways to stereoscopic processing in macaque. eLife 2021; 10:58749. [PMID: 33625356 PMCID: PMC7959693 DOI: 10.7554/elife.58749] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2020] [Accepted: 02/18/2021] [Indexed: 11/22/2022] Open
Abstract
The division of labor between the dorsal and ventral visual pathways has been well studied, but not often with direct comparison at the single-neuron resolution with matched stimuli. Here we directly compared how single neurons in MT and V4, mid-tier areas of the two pathways, process binocular disparity, a powerful cue for 3D perception and actions. We found that MT neurons transmitted disparity signals more quickly and robustly, whereas V4 or its upstream neurons transformed the signals into sophisticated representations more prominently. Therefore, signaling speed and robustness were traded for transformation between the dorsal and ventral pathways. The key factor in this tradeoff was disparity-tuning shape: V4 neurons had more even-symmetric tuning than MT neurons. Moreover, the tuning symmetry predicted the degree of signal transformation across neurons similarly within each area, implying a general role of tuning symmetry in the stereoscopic processing by the two pathways.
Collapse
Affiliation(s)
- Toshihide W Yoshioka
- Laboratory for Cognitive Neuroscience, Graduate School of Frontier Biosciences, Osaka University, SuitaOsaka, Japan.,Center for Information and Neural Networks, Osaka University and National Institute of Information and Communications Technology, SuitaOsaka, Japan
| | - Takahiro Doi
- Department of Psychology, University of Pennsylvania, Philadelphia, United States
| | - Mohammad Abdolrahmani
- Laboratory for Neural Circuits and Behavior, RIKEN Center for Brain Science (CBS), Wako, Japan
| | - Ichiro Fujita
- Laboratory for Cognitive Neuroscience, Graduate School of Frontier Biosciences, Osaka University, SuitaOsaka, Japan.,Center for Information and Neural Networks, Osaka University and National Institute of Information and Communications Technology, SuitaOsaka, Japan
| |
Collapse
|
3
|
Roe AW, Chen G, Xu AG, Hu J. A roadmap to a columnar visual cortical prosthetic. CURRENT OPINION IN PHYSIOLOGY 2020. [DOI: 10.1016/j.cophys.2020.06.009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
|
4
|
Krug K. Coding Perceptual Decisions: From Single Units to Emergent Signaling Properties in Cortical Circuits. Annu Rev Vis Sci 2020; 6:387-409. [PMID: 32600168 DOI: 10.1146/annurev-vision-030320-041223] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Spiking activity in single neurons of the primate visual cortex has been tightly linked to perceptual decisions. Any mechanism that reads out these perceptual signals to support behavior must respect the underlying neuroanatomy that shapes the functional properties of sensory neurons. Spatial distribution and timing of inputs to the next processing levels are critical, as conjoint activity of precursor neurons increases the spiking rate of downstream neurons and ultimately drives behavior. I set out how correlated activity might coalesce into a micropool of task-sensitive neurons signaling a particular percept to determine perceptual decision signals locally and for flexible interarea transmission depending on the task context. As data from more and more neurons and their complex interactions are analyzed, the space of computational mechanisms must be constrained based on what is plausible within neurobiological limits. This review outlines experiments to test the new perspectives offered by these extended methods.
Collapse
Affiliation(s)
- Kristine Krug
- Lehrstuhl für Sensorische Physiologie, Institut für Biologie, Otto-von-Guericke-Universität Magdeburg, 39120 Magdeburg, Germany; .,Leibniz-Institut für Neurobiologie, 39118 Magdeburg, Germany.,Department of Physiology, Anatomy, and Genetics, Oxford University, Oxford OX1 3PT, United Kingdom
| |
Collapse
|
5
|
Mazurek KA, Schieber MH. How is electrical stimulation of the brain experienced, and how can we tell? Selected considerations on sensorimotor function and speech. Cogn Neuropsychol 2019; 36:103-116. [PMID: 31076014 PMCID: PMC6744321 DOI: 10.1080/02643294.2019.1609918] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2018] [Revised: 04/14/2019] [Accepted: 04/15/2019] [Indexed: 01/05/2023]
Abstract
Electrical stimulation of the nervous system is a powerful tool for localizing and examining the function of numerous brain regions. Delivered to certain regions of the cerebral cortex, electrical stimulation can evoke a variety of first-order effects, including observable movements or an urge to move, or somatosensory, visual, or auditory percepts. In still other regions the subject may be oblivious to the stimulation. Often overlooked, however, is whether the subject is aware of the stimulation, and if so, how the stimulation is experienced by the subject. In this review of how electrical stimulation has been used to study selected aspects of sensorimotor and language function, we raise questions that future studies might address concerning the subjects' second-order experiences of intention and agency regarding evoked movements, of the naturalness of evoked sensory percepts, and of other qualia that might be evoked in the absence of an overt first-order experience.
Collapse
Affiliation(s)
- Kevin A. Mazurek
- Department of Neurology, University of Rochester, Rochester, NY
- Del Monte Institute for Neuroscience, University of Rochester, Rochester, NY
| | - Marc H. Schieber
- Department of Neurology, University of Rochester, Rochester, NY
- Department of Neuroscience, University of Rochester, Rochester, NY
- Department of Biomedical Engineering, University of Rochester, Rochester, NY
- Del Monte Institute for Neuroscience, University of Rochester, Rochester, NY
| |
Collapse
|
6
|
Xu Y. A Tale of Two Visual Systems: Invariant and Adaptive Visual Information Representations in the Primate Brain. Annu Rev Vis Sci 2018; 4:311-336. [PMID: 29949722 DOI: 10.1146/annurev-vision-091517-033954] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Visual information processing contains two opposite needs. There is both a need to comprehend the richness of the visual world and a need to extract only pertinent visual information to guide thoughts and behavior at a given moment. I argue that these two aspects of visual processing are mediated by two complementary visual systems in the primate brain-specifically, the occipitotemporal cortex (OTC) and the posterior parietal cortex (PPC). The role of OTC in visual processing has been documented extensively by decades of neuroscience research. I review here recent evidence from human imaging and monkey neurophysiology studies to highlight the role of PPC in adaptive visual processing. I first document the diverse array of visual representations found in PPC. I then describe the adaptive nature of visual representation in PPC by contrasting visual processing in OTC and PPC and by showing that visual representations in PPC largely originate from OTC.
Collapse
Affiliation(s)
- Yaoda Xu
- Visual Sciences Laboratory, Psychology Department, Harvard University, Cambridge, Massachusetts 02138, USA;
| |
Collapse
|
7
|
Functional anatomy of the macaque temporo-parieto-frontal connectivity. Cortex 2017; 97:306-326. [DOI: 10.1016/j.cortex.2016.12.007] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2016] [Revised: 11/21/2016] [Accepted: 12/04/2016] [Indexed: 01/19/2023]
|
8
|
Verhoef BE, Vogels R, Janssen P. Binocular depth processing in the ventral visual pathway. Philos Trans R Soc Lond B Biol Sci 2017; 371:rstb.2015.0259. [PMID: 27269602 DOI: 10.1098/rstb.2015.0259] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/09/2016] [Indexed: 11/12/2022] Open
Abstract
One of the most powerful forms of depth perception capitalizes on the small relative displacements, or binocular disparities, in the images projected onto each eye. The brain employs these disparities to facilitate various computations, including sensori-motor transformations (reaching, grasping), scene segmentation and object recognition. In accordance with these different functions, disparity activates a large number of regions in the brain of both humans and monkeys. Here, we review how disparity processing evolves along different regions of the ventral visual pathway of macaques, emphasizing research based on both correlational and causal techniques. We will discuss the progression in the ventral pathway from a basic absolute disparity representation to a more complex three-dimensional shape code. We will show that, in the course of this evolution, the underlying neuronal activity becomes progressively more bound to the global perceptual experience. We argue that these observations most probably extend beyond disparity processing per se, and pertain to object processing in the ventral pathway in general. We conclude by posing some important unresolved questions whose answers may significantly advance the field, and broaden its scope.This article is part of the themed issue 'Vision in our three-dimensional world'.
Collapse
Affiliation(s)
- Bram-Ernst Verhoef
- Laboratorium voor Neuro en Psychofysiologie, KU Leuven, O&N2, Campus Gasthuisberg, 3000 Leuven, Belgium Department of Neurobiology, University of Chicago, Chicago, IL 60637, USA
| | - Rufin Vogels
- Laboratorium voor Neuro en Psychofysiologie, KU Leuven, O&N2, Campus Gasthuisberg, 3000 Leuven, Belgium
| | - Peter Janssen
- Laboratorium voor Neuro en Psychofysiologie, KU Leuven, O&N2, Campus Gasthuisberg, 3000 Leuven, Belgium
| |
Collapse
|
9
|
Borra E, Gerbella M, Rozzi S, Luppino G. The macaque lateral grasping network: A neural substrate for generating purposeful hand actions. Neurosci Biobehav Rev 2017; 75:65-90. [DOI: 10.1016/j.neubiorev.2017.01.017] [Citation(s) in RCA: 61] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2016] [Revised: 12/22/2016] [Accepted: 01/12/2017] [Indexed: 10/20/2022]
|
10
|
Janssen P, Verhoef BE, Premereur E. Functional interactions between the macaque dorsal and ventral visual pathways during three-dimensional object vision. Cortex 2017; 98:218-227. [PMID: 28258716 DOI: 10.1016/j.cortex.2017.01.021] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2016] [Revised: 01/23/2017] [Accepted: 01/25/2017] [Indexed: 11/18/2022]
Abstract
The division of labor between the dorsal and the ventral visual stream in the primate brain has inspired numerous studies on the visual system in humans and in nonhuman primates. However, how and under which circumstances the two visual streams interact is still poorly understood. Here we review evidence from anatomy, modelling, electrophysiology, electrical microstimulation (EM), reversible inactivation and functional imaging in the macaque monkey aimed at clarifying at which levels in the hierarchy of visual areas the two streams interact, and what type of information might be exchanged between the two streams during three-dimensional (3D) object viewing. Neurons in both streams encode 3D structure from binocular disparity, synchronized activity between parietal and inferotemporal areas is present during 3D structure categorization, and clusters of 3D structure-selective neurons in parietal cortex are anatomically connected to ventral stream areas. In addition, caudal intraparietal cortex exerts a causal influence on 3D-structure related activations in more anterior parietal cortex and in inferotemporal cortex. Thus, both anatomical and functional evidence indicates that the dorsal and the ventral visual stream interact during 3D object viewing.
Collapse
Affiliation(s)
- Peter Janssen
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven, Belgium.
| | - Bram-Ernst Verhoef
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven, Belgium; Department of Neurobiology, University of Chicago, Chicago, IL 60637, USA
| | - Elsie Premereur
- Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Leuven, Belgium
| |
Collapse
|
11
|
Stereopsis after anterior temporal lobectomy. Cortex 2016; 82:63-71. [PMID: 27344239 DOI: 10.1016/j.cortex.2016.05.020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2016] [Revised: 05/06/2016] [Accepted: 05/27/2016] [Indexed: 11/21/2022]
Abstract
Brain areas critical for stereopsis have been investigated in non-human primates but are largely unknown in the human brain. Microelectrode recordings and functional MRI (fMRI) studies in monkeys have shown that in monkeys the inferior temporal cortex is critically involved in 3D shape categorization. Furthermore, some human fMRI studies similarly suggest an involvement of visual areas in the temporal lobe in depth perception. We aimed to investigate the role of the human anterior temporal neocortex in stereopsis by assessing stereoscopic depth perception before and after anterior temporal lobectomy. Eighteen epilepsy surgery patients were tested, pre- and postoperatively, in 3 different depth discrimination tasks. Sensitivity for local and global disparity was tested in a near-far discrimination task and sensitivity for 3D curvature was assessed in a convex-concave discrimination task, where 3D shapes were presented at different positions in depth. We found no evidence that temporal lobe epilepsy surgery has a significant effect on stereopsis. In contrast with earlier findings, we conclude that local as well as global stereopsis is maintained after unilateral resection of the temporal pole in epilepsy surgery patients. Our findings, together with previous studies, suggest that in humans more posterior visual regions underlie depth perception.
Collapse
|