1
|
Lee H, Lee HJ, Choe KW, Lee SH. Neural Evidence for Boundary Updating as the Source of the Repulsive Bias in Classification. J Neurosci 2023; 43:4664-4683. [PMID: 37286349 PMCID: PMC10286949 DOI: 10.1523/jneurosci.0166-23.2023] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 05/29/2023] [Accepted: 06/01/2023] [Indexed: 06/09/2023] Open
Abstract
Binary classification, an act of sorting items into two classes by setting a boundary, is biased by recent history. One common form of such bias is repulsive bias, a tendency to sort an item into the class opposite to its preceding items. Sensory-adaptation and boundary-updating are considered as two contending sources of the repulsive bias, yet no neural support has been provided for either source. Here, we explored human brains of both men and women, using functional magnetic resonance imaging (fMRI), to find such support by relating the brain signals of sensory-adaptation and boundary-updating to human classification behavior. We found that the stimulus-encoding signal in the early visual cortex adapted to previous stimuli, yet its adaptation-related changes were dissociated from current choices. Contrastingly, the boundary-representing signals in the inferior-parietal and superior-temporal cortices shifted to previous stimuli and covaried with current choices. Our exploration points to boundary-updating, rather than sensory-adaptation, as the origin of the repulsive bias in binary classification.SIGNIFICANCE STATEMENT Many animal and human studies on perceptual decision-making have reported an intriguing history effect called "repulsive bias," a tendency to classify an item as the opposite class of its previous item. Regarding the origin of repulsive bias, two contending ideas have been proposed: "bias in stimulus representation because of sensory adaptation" versus "bias in class-boundary setting because of belief updating." By conducting model-based neuroimaging experiments, we verified their predictions about which brain signal should contribute to the trial-to-trial variability in choice behavior. We found that the brain signal of class boundary, but not stimulus representation, contributed to the choice variability associated with repulsive bias. Our study provides the first neural evidence supporting the boundary-based hypothesis of repulsive bias.
Collapse
Affiliation(s)
- Heeseung Lee
- Department of Brain and Cognitive Sciences, Seoul National University, Seoul 08826, Republic of Korea
| | - Hyang-Jung Lee
- Department of Brain and Cognitive Sciences, Seoul National University, Seoul 08826, Republic of Korea
| | - Kyoung Whan Choe
- Department of Brain and Cognitive Sciences, Seoul National University, Seoul 08826, Republic of Korea
| | - Sang-Hun Lee
- Department of Brain and Cognitive Sciences, Seoul National University, Seoul 08826, Republic of Korea
| |
Collapse
|
2
|
Abstract
Visual processing varies dramatically across the visual field. These differences start in the retina and continue all the way to the visual cortex. Despite these differences in processing, the perceptual experience of humans is remarkably stable and continuous across the visual field. Research in the last decade has shown that processing in peripheral and foveal vision is not independent, but is more directly connected than previously thought. We address three core questions on how peripheral and foveal vision interact, and review recent findings on potentially related phenomena that could provide answers to these questions. First, how is the processing of peripheral and foveal signals related during fixation? Peripheral signals seem to be processed in foveal retinotopic areas to facilitate peripheral object recognition, and foveal information seems to be extrapolated toward the periphery to generate a homogeneous representation of the environment. Second, how are peripheral and foveal signals re-calibrated? Transsaccadic changes in object features lead to a reduction in the discrepancy between peripheral and foveal appearance. Third, how is peripheral and foveal information stitched together across saccades? Peripheral and foveal signals are integrated across saccadic eye movements to average percepts and to reduce uncertainty. Together, these findings illustrate that peripheral and foveal processing are closely connected, mastering the compromise between a large peripheral visual field and high resolution at the fovea.
Collapse
Affiliation(s)
- Emma E M Stewart
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.,
| | - Matteo Valsecchi
- Dipartimento di Psicologia, Universitá di Bologna, Bologna, Italy.,
| | - Alexander C Schütz
- Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany.,Center for Mind, Brain and Behavior, Philipps-Universität Marburg, Marburg, Germany., https://www.uni-marburg.de/en/fb04/team-schuetz/team/alexander-schutz
| |
Collapse
|
3
|
Ge Y, Sun Z, Qian C, He S. Spatiotopic updating across saccades in the absence of awareness. J Vis 2021; 21:7. [PMID: 33961004 PMCID: PMC8114003 DOI: 10.1167/jov.21.5.7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 03/15/2021] [Indexed: 11/25/2022] Open
Abstract
Despite the continuously changing visual inputs caused by eye movements, our perceptual representation of the visual world remains remarkably stable. Visual stability has been a major area of interest within the field of visual neuroscience. The early visual cortical areas are retinotopic-organized, and presumably there is a retinotopic to spatiotopic transformation process that supports the stable representation of the visual world. In this study, we used a cross-saccadic adaptation paradigm to show that both the orientation adaptation and face gender adaptation could still be observed at the same spatiotopic (but different retinotopic) locations even when the adapting stimuli were rendered invisible. These results suggest that awareness of a visual object is not required for its transformation from the retinotopic to the spatiotopic reference frame.
Collapse
Affiliation(s)
- Yijun Ge
- State Key Lab of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
- Vision and Attention Lab, Department of Psychology, University of Minnesota, MN, USA
| | - Zhouyuan Sun
- State Key Lab of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
- Department of Neurosurgery, Huazhong University of Science and Technology Union Shenzhen Hospital, Shenzhen, Guangdong, China
- The 6th Affiliated Hospital of Shenzhen University Health Science Center, Shenzhen, Guangdong, China
| | - Chencan Qian
- State Key Lab of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Sheng He
- State Key Lab of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
- Vision and Attention Lab, Department of Psychology, University of Minnesota, MN, USA
- Chinese Academy of Sciences, Center for Excellence in Brain Science and Intelligence Technology, Shanghai, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
4
|
Ding Y, Naber M, Paffen CLE, Fabius JH, Van der Stigchel S. Saccades reset the priority of visual information to access awareness. Vision Res 2020; 173:1-6. [PMID: 32438013 DOI: 10.1016/j.visres.2020.04.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Revised: 04/09/2020] [Accepted: 04/23/2020] [Indexed: 11/18/2022]
Abstract
Subjectively, we experience a stable representation of the outside world across saccades. Although previous studies have reported that presaccadically acquired visual information influences postsaccadic perception, whether such information's priority to access visual awareness is either reset by each saccade or continuous across saccades remains unclear. To investigate this issue, we combined a breaking continuous flash suppression (b-CFS) with a saccade task. Before each saccade, a grating was presented in the peripheral visual field under suppression. After the saccade, the same grating was again presented under suppression at either the retinotopically matched, the spatiotopically matched, or a control location. By measuring the duration of the grating to break through CFS into awareness after a saccade, we could compare the breakthrough times across stimuli presented at the different locations. No difference in the reaction times between the spatiotopic and control location was observed, indicating that a saccade resets the buildup of an object's priority to access visual awareness. However, a longer breakthrough time was observed for the retinotopic as compared to the control location, suggesting that a form of retinotopic adaptation to the grating suppressed the priority to access visual awareness after a saccade.
Collapse
Affiliation(s)
- Yun Ding
- Department of Experimental Psychology, Utrecht University, Utrecht, the Netherlands.
| | - Marnix Naber
- Department of Experimental Psychology, Utrecht University, Utrecht, the Netherlands
| | - Chris L E Paffen
- Department of Experimental Psychology, Utrecht University, Utrecht, the Netherlands
| | - Jasper H Fabius
- Institute of Neuroscience and Psychology, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G12 8QB, Scotland, United Kingdom
| | | |
Collapse
|
5
|
He T, Fritsche M, de Lange FP. Predictive remapping of visual features beyond saccadic targets. J Vis 2019; 18:20. [PMID: 30593063 DOI: 10.1167/18.13.20] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Visual stability is thought to be mediated by predictive remapping of the relevant object information from its current, presaccadic location to its future, postsaccadic location on the retina. However, it is heavily debated whether and what feature information is predictively remapped during the presaccadic interval. Here we examined the spatial and featural properties of predictive remapping in a set of three psychophysical studies. We made use of an orientation-adaptation paradigm, in which we induced a tilt aftereffect by prolonged exposure to an oriented adaptor stimulus. Following this adaptation phase, a test stimulus was presented shortly before saccade onset. We found strong evidence for predictive remapping of the features of this test stimulus presented shortly before saccade onset, evidenced by a large tilt aftereffect elicited when the adaptor was positioned at the postsaccadic retinal location of the test stimulus. Conversely, the adaptation state itself, caused by the exposure to the adaptor stimulus, was not predictively remapped. Furthermore, we establish that predictive remapping also occurs for stimuli that are not saccade targets, pointing toward a forward remapping process operating across the whole visual field. Together, our findings suggest that predictive feature remapping of object information plays an important role in mediating visual stability.
Collapse
Affiliation(s)
- Tao He
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Matthias Fritsche
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Floris P de Lange
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| |
Collapse
|
6
|
Abstract
Humans move their eyes several times per second, yet we perceive the outside world as continuous despite the sudden disruptions created by each eye movement. To date, the mechanism that the brain employs to achieve visual continuity across eye movements remains unclear. While it has been proposed that the oculomotor system quickly updates and informs the visual system about the upcoming eye movement, behavioral studies investigating the time course of this updating suggest the involvement of a slow mechanism, estimated to take more than 500 ms to operate effectively. This is a surprisingly slow estimate, because both the visual system and the oculomotor system process information faster. If spatiotopic updating is indeed this slow, it cannot contribute to perceptual continuity, because it is outside the temporal regime of typical oculomotor behavior. Here, we argue that the behavioral paradigms that have been used previously are suboptimal to measure the speed of spatiotopic updating. In this study, we used a fast gaze-contingent paradigm, using high phi as a continuous stimulus across eye movements. We observed fast spatiotopic updating within 150 ms after stimulus onset. The results suggest the involvement of a fast updating mechanism that predictively influences visual perception after an eye movement. The temporal characteristics of this mechanism are compatible with the rate at which saccadic eye movements are typically observed in natural viewing.
Collapse
|