1
|
Gao Y, Miller KN, Webster MA, Crognale MA, Jiang F. Time course and neural locus of the Flashed Face Distortion Effect. Vision Res 2024; 224:108492. [PMID: 39348745 PMCID: PMC11466683 DOI: 10.1016/j.visres.2024.108492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 07/27/2024] [Accepted: 09/24/2024] [Indexed: 10/02/2024]
Abstract
Viewing a rapid sequence of face images shown in the periphery can lead to large caricature-like distortions in the perceived images, a phenomenon known as the Flashed Face Distortion Effect (FFDE). The mechanisms underlying FFDE are poorly understood. Here we examined the timing and sites of the adaptation processes giving rise to the FFDE. To investigate the effects of presentation rate, we maintained consistent trial lengths while assessing how variations in the temporal frequencies of face presentation influenced the magnitude of face distortion and the averaging of facial expressions. Over a wide range of temporal frequencies (1.2-60 Hz) tested, we observed a decrease in FFDE strength as the presentation rate increased. To probe the neural sites of FFDE, we varied whether successive faces were presented to the same or different eyes using a dichoptic display. Distortion effects were comparable for monocular, binocular, and interocular conditions, yet much larger than a control condition where faces were presented with a temporal interval between successive images, suggesting a cortical locus for FFDE.
Collapse
Affiliation(s)
- Yi Gao
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA.
| | | | | | - Michael A Crognale
- Department of Psychology and Graduate Program in Integrative Neuroscience, University of Nevada, Reno, NV, USA
| | - Fang Jiang
- Department of Psychology and Graduate Program in Integrative Neuroscience, University of Nevada, Reno, NV, USA
| |
Collapse
|
2
|
Renet C, Randall W, Guterstam A. A motion aftereffect from viewing other people's gaze. Front Hum Neurosci 2024; 18:1444428. [PMID: 39183816 PMCID: PMC11341350 DOI: 10.3389/fnhum.2024.1444428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Accepted: 07/26/2024] [Indexed: 08/27/2024] Open
Abstract
Recent work suggests that our brains may generate subtle, false motion signals streaming from other people to the objects of their attention, aiding social cognition. For instance, brief exposure to static images depicting other people gazing at objects made subjects slower at detecting subsequent motion in the direction of gaze, suggesting that looking at someone else's gaze caused a directional motion adaptation. Here we confirm, using a more stringent method, that viewing static images of another person gazing in a particular direction, at an object, produced motion aftereffects in the opposite direction. The aftereffect was manifested as a change in perceptual decision threshold for detecting left vs. right motion. The effect disappeared when the person was looking away from the object. These findings suggest that the attentive gaze of others is encoded as an implied agent-to-object motion that is sufficiently robust to cause genuine motion aftereffects, though subtle enough to remain subthreshold.
Collapse
Affiliation(s)
- Christian Renet
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
| | - William Randall
- Department of Psychology, Princeton University, Princeton, NJ, United States
| | - Arvid Guterstam
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
3
|
Feuerriegel D. Adaptation in the visual system: Networked fatigue or suppressed prediction error signalling? Cortex 2024; 177:302-320. [PMID: 38905873 DOI: 10.1016/j.cortex.2024.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 05/10/2024] [Accepted: 06/04/2024] [Indexed: 06/23/2024]
Abstract
Our brains are constantly adapting to changes in our visual environments. Neural adaptation exerts a persistent influence on the activity of sensory neurons and our perceptual experience, however there is a lack of consensus regarding how adaptation is implemented in the visual system. One account describes fatigue-based mechanisms embedded within local networks of stimulus-selective neurons (networked fatigue models). Another depicts adaptation as a product of stimulus expectations (predictive coding models). In this review, I evaluate neuroimaging and psychophysical evidence that poses fundamental problems for predictive coding models of neural adaptation. Specifically, I discuss observations of distinct repetition and expectation effects, as well as incorrect predictions of repulsive adaptation aftereffects made by predictive coding accounts. Based on this evidence, I argue that networked fatigue models provide a more parsimonious account of adaptation effects in the visual system. Although stimulus expectations can be formed based on recent stimulation history, any consequences of these expectations are likely to co-occur (or interact) with effects of fatigue-based adaptation. I conclude by proposing novel, testable hypotheses relating to interactions between fatigue-based adaptation and other predictive processes, focusing on stimulus feature extrapolation phenomena.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia.
| |
Collapse
|
4
|
Zhou L, Liu Y, Jiang Y, Wang W, Xu P, Zhou K. The distinct development of stimulus and response serial dependence. Psychon Bull Rev 2024:10.3758/s13423-024-02474-8. [PMID: 38379075 DOI: 10.3758/s13423-024-02474-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/04/2024] [Indexed: 02/22/2024]
Abstract
Serial dependence (SD) is a phenomenon wherein current perceptions are biased by the previous stimulus and response. This helps to attenuate perceptual noise and variability in sensory input and facilitates stable ongoing perceptions of the environment. However, little is known about the developmental trajectory of SD. This study investigates how the stimulus and response biases of the SD effect develop across three age groups. Conventional analyses, in which previous stimulus and response biases were assessed separately, revealed significant changes in the biases over time. Previous stimulus bias shifted from repulsion to attraction, while previous response bias evolved from attraction to greater attraction. However, there was a strong correlation between stimulus and response orientations. Therefore, a generalized linear mixed-effects (GLME) analysis that simultaneously considered both previous stimulus and response, outperformed separate analyses. This revealed that previous stimulus and response resulted in two distinct biases with different developmental trajectories. The repulsion bias of previous stimulus remained relatively stable across all age groups, whereas the attraction bias of previous response was significantly stronger in adults than in children and adolescents. These findings demonstrate that the repulsion bias towards preceding stimuli is established early in the developing brain (at least by around 10 years old), while the attraction bias towards responses is not fully developed until adulthood. Our findings provide new insights into the development of the SD phenomenon and how humans integrate two opposing mechanisms into their perceptual responses to external input during development.
Collapse
Affiliation(s)
- Liqin Zhou
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Yujie Liu
- Sino-Danish College, University of Chinese Academy of Sciences, Beijing, China
- State Key Laboratory of Brain and Cognitive Sciences, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
| | - Yuhan Jiang
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Wenbo Wang
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Pengfei Xu
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Ke Zhou
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (Beijing Normal University), Faculty of Psychology, Beijing Normal University, Beijing, China.
| |
Collapse
|
5
|
Li X, Tang X, Yang J, Wang A, Zhang M. Visual adaptation changes the susceptibility to the fission illusion. Atten Percept Psychophys 2023; 85:2046-2055. [PMID: 36949258 DOI: 10.3758/s13414-023-02686-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/20/2023] [Indexed: 03/24/2023]
Abstract
Sound-induced flash illusion (SiFI) is the illusion that participants perceive incorrectly that the number of visual flashes is equal to the number of auditory beeps when presented within 100 ms. Although previous studies found that repetition suppression can reduce an individual's perceptual sensitivity to the SiFI, there is not yet a consensus as to how visual adaptation affects the SiFI. In the present study, we added prolonged adapting visual stimuli prior to the presentation of audiovisual stimuli to investigate whether the bottom-up factor of adaptation affects the SiFI. The adapting visual stimuli consisted of one or two of the same visual stimuli that lasted for 2 minutes in succession, followed by the audiovisual stimuli. Both adaptation conditions showed SiFI effects. The accuracy of adapting double-flashes was significantly lower than that of in adapting a single flash for the fission illusion. Our analyses indicated that such a pattern could be attributed to a lower d' in adapting double-flashes than in adapting a single flash. However, the accuracy, discriminability and criterion were not significantly different between the two adaptation conditions because of the instability of the fusion illusion. Thus, the present study indicated that the reduced perceptual sensitivity based on visual adaptation could enhance the fission illusion in multisensory integration.
Collapse
Affiliation(s)
- Xin Li
- Department of Psychology, Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou, People's Republic of China
| | - Xiaoyu Tang
- School of Psychology, Liaoning Normal University, Dalian, China
| | - Jiajia Yang
- Applied Brain Science Lab Faculty of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| | - Aijun Wang
- Department of Psychology, Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou, People's Republic of China.
| | - Ming Zhang
- Department of Psychology, Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou, People's Republic of China.
- Cognitive Neuroscience Laboratory, Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan.
| |
Collapse
|
6
|
Moon J, Kwon OS. Attractive and repulsive effects of sensory history concurrently shape visual perception. BMC Biol 2022; 20:247. [PMID: 36345010 PMCID: PMC9641899 DOI: 10.1186/s12915-022-01444-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Accepted: 10/19/2022] [Indexed: 11/09/2022] Open
Abstract
BACKGROUND Sequential effects of environmental stimuli are ubiquitous in most behavioral tasks involving magnitude estimation, memory, decision making, and emotion. The human visual system exploits continuity in the visual environment, which induces two contrasting perceptual phenomena shaping visual perception. Previous work reported that perceptual estimation of a stimulus may be influenced either by attractive serial dependencies or repulsive aftereffects, with a number of experimental variables suggested as factors determining the direction and magnitude of sequential effects. Recent studies have theorized that these two effects concurrently arise in perceptual processing, but empirical evidence that directly supports this hypothesis is lacking, and it remains unclear whether and how attractive and repulsive sequential effects interact in a trial. Here we show that the two effects concurrently modulate estimation behavior in a typical sequence of perceptual tasks. RESULTS We first demonstrate that observers' estimation error as a function of both the previous stimulus and response cannot be fully described by either attractive or repulsive bias but is instead well captured by a summation of repulsion from the previous stimulus and attraction toward the previous response. We then reveal that the repulsive bias is centered on the observer's sensory encoding of the previous stimulus, which is again repelled away from its own preceding trial, whereas the attractive bias is centered precisely on the previous response, which is the observer's best prediction about the incoming stimuli. CONCLUSIONS Our findings provide strong evidence that sensory encoding is shaped by dynamic tuning of the system to the past stimuli, inducing repulsive aftereffects, and followed by inference incorporating the prediction from the past estimation, leading to attractive serial dependence.
Collapse
Affiliation(s)
- Jongmin Moon
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan, 44919, South Korea
| | - Oh-Sang Kwon
- Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan, 44919, South Korea.
| |
Collapse
|
7
|
Davidenko N, Heller NH, Schooley MJ, McDougall SG. Visual priming of two-step motion sequences. J Vis 2022; 22:14. [PMID: 35881413 PMCID: PMC9339696 DOI: 10.1167/jov.22.8.14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Perception of an ambiguous apparent motion is influenced by the immediately preceding motion. In positive priming, when an observer is primed with a slow-pace (1-3 Hz) sequence of motion frames depicting unidirectional drift (e.g., Right-Right-Right-Right), subsequent sequences of ambiguous frames are often perceived to continue moving in the primed direction (illusory Right-Right …). Furthermore, priming an observer with a slow-pace sequence of rebounding apparent motion frames that alternate between opponently coded motion directions (e.g., Right-Left-Right-Left) leads to an illusory continuation of the two-step rebounding sequence in subsequent random frames. Here, we show that even more arbitrary two-step motion sequences can be primed; in particular, two-step motion sequences that alternate between non-opponently coded directions (e.g., Up-Right-Up-Right; staircase motion) can be primed to be illusorily perceived in subsequent random frames. We found that staircase sequences, but not drifting or rebounding sequences, were primed more effectively with four priming frames compared with two priming frames, suggesting the importance of repeating the sequence element for priming arbitrary two-step motion sequences. Moreover, we compared the effectiveness of motion primes to that of symbolic primes (arrows) and found that motion primes were significantly more effective at producing prime-consistent responses. Although it has been proposed that excitatory and rivalry-like mechanisms account for drifting and rebounding motion priming, current motion processing models cannot account for our observed priming of staircase motion. We argue that higher order processes involving the recruitment and interaction of both attention and visual working memory are required to account for the type of two-step motion priming reported here.
Collapse
Affiliation(s)
- Nicolas Davidenko
- Department of Psychology, University of California, Santa Cruz, Santa Cruz, CA, USA.,
| | - Nathan H Heller
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.,
| | - Maxwell J Schooley
- Department of Psychology, University of California, Santa Cruz, Santa Cruz, CA, USA.,
| | - Sean G McDougall
- Department of Psychology, University of California, Santa Cruz, Santa Cruz, CA, USA.,
| |
Collapse
|
8
|
The effect of abstract representation and response feedback on serial dependence in numerosity perception. Atten Percept Psychophys 2022; 84:1651-1665. [PMID: 35610413 DOI: 10.3758/s13414-022-02518-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/12/2022] [Indexed: 11/08/2022]
Abstract
Serial dependence entails an attractive bias based on the recent history of stimulation, making the current stimulus appear more similar to the preceding one. Although serial dependence is ubiquitous in perception, its nature and mechanisms remain unclear. Here, in two independent experiments, we test the hypothesis that this bias originates from high-level processing stages at the level of abstract information processing (Exp. 1) or at the level of judgment (Exp. 2). In Experiment 1, serial dependence was induced by a task-irrelevant "inducer" stimulus in a numerosity discrimination task, similarly to previous studies. Importantly, in this experiment, the inducers were either arrays of dots similar to the task-relevant stimuli (e.g., 12 dots), or symbolic numbers (e.g., the numeral "12"). Both dots and symbol inducers successfully yielded attractive serial dependence biases, suggesting that abstract information about an image is sufficient to bias the perception of the current stimulus. In Experiment 2, participants received feedback about their responses in each trial of a numerosity estimation task, which was designed to assess whether providing external information about the accuracy of judgments would modulate serial dependence. Providing feedback significantly increased the attractive serial dependence effect, suggesting that external information at the level of judgment may modulate the weight of past perceptual information during the processing of the current image. Overall, our results support the idea that, although serial dependence may operate at a perceptual level, it originates from high-level processing stages at the level of abstract information processing and at the level of judgment.
Collapse
|
9
|
Hohaia W, Saurels BW, Johnston A, Yarrow K, Arnold DH. Occipital alpha-band brain waves when the eyes are closed are shaped by ongoing visual processes. Sci Rep 2022; 12:1194. [PMID: 35075196 PMCID: PMC8786963 DOI: 10.1038/s41598-022-05289-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 10/18/2021] [Indexed: 11/15/2022] Open
Abstract
One of the seminal findings of cognitive neuroscience is that the power of occipital alpha-band (~ 10 Hz) brain waves is increased when peoples' eyes are closed, rather than open. This has encouraged the view that alpha oscillations are a default dynamic, to which the visual brain returns in the absence of input. Accordingly, we might be unable to increase the power of alpha oscillations when the eyes are closed, above the level that would normally ensue when people close their eyes. Here we report counter evidence. We used electroencephalography (EEG) to record brain activity when people had their eyes open and closed, both before and after they had adapted to radial motion. The increase in alpha power when people closed their eyes was increased by prior adaptation to a broad range of radial motion speeds. This effect was greatest for 10 Hz motion, but robust for other frequencies (and especially 7.5 Hz). This discredits a persistent entrainment of activity at the adaptation frequency as an explanation for our findings. Our data show that the power of occipital alpha-band brain waves can be increased by motion sensitive visual processes that persist when the eyes are closed. Consequently, we suggest that the power of these brain waves is, at least in part, an index of the degree to which visual brain activity is being subjected to inhibition. This is increased when people close their eyes, but can be even further increased by pre-adaptation to radial motion.
Collapse
Affiliation(s)
- Wiremu Hohaia
- School of Psychology, The University of Queensland, Brisbane, Australia
| | - Blake W Saurels
- School of Psychology, The University of Queensland, Brisbane, Australia
| | - Alan Johnston
- School of Psychology, The University of Nottingham, Nottingham, UK
| | - Kielan Yarrow
- School of Psychology, City University London, London, UK
| | - Derek H Arnold
- School of Psychology, The University of Queensland, Brisbane, Australia.
| |
Collapse
|
10
|
Abstract
Viewing static images depicting movement can result in a motion aftereffect: people tend to categorise direction signals as moving in the opposite direction relative to the implied motion in still photographs. This finding could indicate that inferred motion direction can penetrate sensory processing and change perception. Equally possible, however, is that inferred motion changes decision processes, but not perception. Here we test these two possibilities. Since both categorical decisions and subjective confidence are informed by sensory information, confidence can be informative about whether an aftereffect probably results from changes to perceptual or decision processes. We therefore used subjective confidence as an additional measure of the implied motion aftereffect. In Experiment 1 (implied motion), we find support for decision-level changes only, with no change in subjective confidence. In Experiment 2 (real motion), we find equal changes to decisions and confidence. Our results suggest the implied motion aftereffect produces a bias in decision-making, but leaves perceptual processing unchanged.
Collapse
|
11
|
Pasternak T, Tadin D. Linking Neuronal Direction Selectivity to Perceptual Decisions About Visual Motion. Annu Rev Vis Sci 2021; 6:335-362. [PMID: 32936737 DOI: 10.1146/annurev-vision-121219-081816] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Psychophysical and neurophysiological studies of responses to visual motion have converged on a consistent set of general principles that characterize visual processing of motion information. Both types of approaches have shown that the direction and speed of target motion are among the most important encoded stimulus properties, revealing many parallels between psychophysical and physiological responses to motion. Motivated by these parallels, this review focuses largely on more direct links between the key feature of the neuronal response to motion, direction selectivity, and its utilization in memory-guided perceptual decisions. These links were established during neuronal recordings in monkeys performing direction discriminations, but also by examining perceptual effects of widespread elimination of cortical direction selectivity produced by motion deprivation during development. Other approaches, such as microstimulation and lesions, have documented the importance of direction-selective activity in the areas that are active during memory-guided direction comparisons, area MT and the prefrontal cortex, revealing their likely interactions during behavioral tasks.
Collapse
Affiliation(s)
- Tatiana Pasternak
- Department of Neuroscience, University of Rochester, Rochester, New York 14642, USA; , .,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, New York 14627, USA.,Center for Visual Science, University of Rochester, Rochester, New York 14627, USA.,Del Monte Institute for Neuroscience, University of Rochester, Rochester, New York 14642, USA
| | - Duje Tadin
- Department of Neuroscience, University of Rochester, Rochester, New York 14642, USA; , .,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, New York 14627, USA.,Center for Visual Science, University of Rochester, Rochester, New York 14627, USA.,Del Monte Institute for Neuroscience, University of Rochester, Rochester, New York 14642, USA.,Department of Ophthalmology, University of Rochester, Rochester, New York 14642, USA
| |
Collapse
|
12
|
Barbot A, Park WJ, Ng CJ, Zhang RY, Huxlin KR, Tadin D, Yoon G. Functional reallocation of sensory processing resources caused by long-term neural adaptation to altered optics. eLife 2021; 10:58734. [PMID: 33616034 PMCID: PMC7963487 DOI: 10.7554/elife.58734] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2020] [Accepted: 02/10/2021] [Indexed: 11/21/2022] Open
Abstract
The eye’s optics are a major determinant of visual perception. Elucidating how long-term exposure to optical defects affects visual processing is key to understanding the capacity for, and limits of, sensory plasticity. Here, we show evidence of functional reallocation of sensory processing resources following long-term exposure to poor optical quality. Using adaptive optics to bypass all optical defects, we assessed visual processing in neurotypically-developed adults with healthy eyes and with keratoconus – a corneal disease causing severe optical aberrations. Under fully-corrected optical conditions, keratoconus patients showed altered contrast sensitivity, with impaired sensitivity for fine spatial details and better-than-typical sensitivity for coarse spatial details. Both gains and losses in sensitivity were more pronounced in patients experiencing poorer optical quality in their daily life and mediated by changes in signal enhancement mechanisms. These findings show that adult neural processing adapts to better match the changes in sensory inputs caused by long-term exposure to altered optics.
Collapse
Affiliation(s)
- Antoine Barbot
- Flaum Eye Institute, University of Rochester Medical Center, Rochester, United States.,Center for Visual Science, University of Rochester, Rochester, United States
| | - Woon Ju Park
- Brain and Cognitive Sciences, University of Rochester, Rochester, United States.,Department of Psychology, University of Washington, Seattle, United States
| | - Cherlyn J Ng
- Flaum Eye Institute, University of Rochester Medical Center, Rochester, United States.,Center for Visual Science, University of Rochester, Rochester, United States
| | - Ru-Yuan Zhang
- Brain and Cognitive Sciences, University of Rochester, Rochester, United States.,Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.,Institute of Psychology and Behavioral Science, Shanghai Jiao Tong University, Shanghai, China
| | - Krystel R Huxlin
- Flaum Eye Institute, University of Rochester Medical Center, Rochester, United States.,Center for Visual Science, University of Rochester, Rochester, United States.,Brain and Cognitive Sciences, University of Rochester, Rochester, United States.,Department of Neuroscience, University of Rochester, Rochester, United States
| | - Duje Tadin
- Flaum Eye Institute, University of Rochester Medical Center, Rochester, United States.,Center for Visual Science, University of Rochester, Rochester, United States.,Brain and Cognitive Sciences, University of Rochester, Rochester, United States.,Department of Neuroscience, University of Rochester, Rochester, United States
| | - Geunyoung Yoon
- Flaum Eye Institute, University of Rochester Medical Center, Rochester, United States.,Center for Visual Science, University of Rochester, Rochester, United States
| |
Collapse
|
13
|
Burlingham CS, Heeger DJ. Heading perception depends on time-varying evolution of optic flow. Proc Natl Acad Sci U S A 2020; 117:33161-33169. [PMID: 33328275 PMCID: PMC7776640 DOI: 10.1073/pnas.2022984117] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
There is considerable support for the hypothesis that perception of heading in the presence of rotation is mediated by instantaneous optic flow. This hypothesis, however, has never been tested. We introduce a method, termed "nonvarying phase motion," for generating a stimulus that conveys a single instantaneous optic flow field, even though the stimulus is presented for an extended period of time. In this experiment, observers viewed stimulus videos and performed a forced-choice heading discrimination task. For nonvarying phase motion, observers made large errors in heading judgments. This suggests that instantaneous optic flow is insufficient for heading perception in the presence of rotation. These errors were mostly eliminated when the velocity of phase motion was varied over time to convey the evolving sequence of optic flow fields corresponding to a particular heading. This demonstrates that heading perception in the presence of rotation relies on the time-varying evolution of optic flow. We hypothesize that the visual system accurately computes heading, despite rotation, based on optic acceleration, the temporal derivative of optic flow.
Collapse
Affiliation(s)
| | - David J Heeger
- Department of Psychology, New York University, New York, NY 10003;
- Center for Neural Science, New York University, New York, NY 10003
| |
Collapse
|
14
|
Johnson P, Davies S, Hogendoorn H. Motion extrapolation in the High-Phi illusion: Analogous but dissociable effects on perceived position and perceived motion. J Vis 2020; 20:8. [PMID: 33296460 PMCID: PMC7726593 DOI: 10.1167/jov.20.13.8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
A range of visual illusions, including the much-studied flash-lag effect, demonstrate that neural signals coding for motion and position interact in the visual system. One interpretation of these illusions is that they are the consequence of motion extrapolation mechanisms in the early visual system. Here, we study the recently reported High-Phi illusion to investigate whether it might be caused by the same underlying mechanisms. In the High-Phi illusion, a rotating texture is abruptly replaced by a new, uncorrelated texture. This leads to the percept of a large illusory jump, which can be forward or backward depending on the duration of the initial motion sequence (the inducer). To investigate whether this motion illusion also leads to illusions of perceived position, in three experiments we asked observers to localize briefly flashed targets presented concurrently with the new texture. Our results replicate the original finding of perceived forward and backward jumps, and reveal an illusion of perceived position. Like the observed effects on illusory motion, these position shifts could be forward or backward, depending on the duration of the inducer: brief inducers caused forward mislocalization, and longer inducers caused backward mislocalization. Additionally, we found that both jumps and mislocalizations scaled in magnitude with the speed of the inducer. Interestingly, forward position shifts were observed at shorter inducer durations than forward jumps. We interpret our results as an interaction of extrapolation and correction-for-extrapolation, and discuss possible mechanisms in the early visual system that might carry out these computations.
Collapse
Affiliation(s)
- Philippa Johnson
- Melbourne School of Psychological Sciences, Parkville, Victoria, Melbourne, Australia.,
| | - Sidney Davies
- Melbourne School of Psychological Sciences, Parkville, Victoria, Melbourne, Australia.,
| | - Hinze Hogendoorn
- Melbourne School of Psychological Sciences, Parkville, Victoria, Melbourne, Australia.,
| |
Collapse
|
15
|
Isherwood ZJ, Joyce DS, Parthasarathy MK, Webster MA. Plasticity in perception: insights from color vision deficiencies. Fac Rev 2020; 9:8. [PMID: 33659940 PMCID: PMC7886061 DOI: 10.12703/b/9-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
Abstract
Inherited color vision deficiencies typically result from a loss or alteration of the visual photopigments absorbing light and thus impact the very first step of seeing. There is growing interest in how subsequent steps in the visual pathway might be calibrated to compensate for the altered receptor signals, with the possibility that color coding and color percepts might be less severely impacted than the receptor differences predict. These compensatory adjustments provide important insights into general questions about sensory plasticity and the sensory and cognitive processes underlying how we experience color.
Collapse
Affiliation(s)
| | - Daniel S Joyce
- Department of Psychology, University of Nevada, Reno, NV, USA
| | | | | |
Collapse
|
16
|
Roumani D, Moutoussis K. Invisible Adaptation: The Effect of Awareness on the Strength of the Motion Aftereffect. Perception 2020; 49:835-857. [PMID: 32605425 DOI: 10.1177/0301006620936853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The ability to process information despite the lack of perceptual awareness is one of the most fascinating aspects of the visual system. Such unconscious processing is often investigated using adaptation, where any presence of the former can be traced by its footprint on aftereffects following the latter. We have investigated the mechanisms of the motion aftereffect (MAE) using random dot displays of varying motion coherence as well as crowding to modulate both the physical as well as the perceptual strength of the adaptation stimulus. Perceptual strength was quantitatively measured as the performance in a forced-choice direction-discrimination task. A motion-nulling technique was used to quantitatively measure the strength of the MAE. We show that the strength of the dynamic MAE is independently influenced by both the physical stimulus strength as well as the subjective perceptual strength, with the effect of the former being more prominent than that of the latter. We further show that the MAE still persists under conditions of subthreshold perception. Our results suggest that perceptual awareness can influence the strength of visual processing, but the latter is not fully dependent on the former and can still take place at its partial or even total absence.
Collapse
Affiliation(s)
- Daphne Roumani
- Cognitive Science Division, Department of Philosophy and History of Science, National and Kapodistrian University of Athens, Greece
| | - Konstantinos Moutoussis
- Cognitive Science Division, Department of Philosophy and History of Science, National and Kapodistrian University of Athens, Greece
| |
Collapse
|
17
|
Fornaciai M, Park J. Attractive serial dependence between memorized stimuli. Cognition 2020; 200:104250. [DOI: 10.1016/j.cognition.2020.104250] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 02/25/2020] [Accepted: 02/27/2020] [Indexed: 11/27/2022]
|
18
|
Sato H, Motoyoshi I. Distinct strategies for estimating the temporal average of numerical and perceptual information. Vision Res 2020; 174:41-49. [PMID: 32521341 DOI: 10.1016/j.visres.2020.05.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2019] [Revised: 05/17/2020] [Accepted: 05/20/2020] [Indexed: 01/29/2023]
Abstract
Humans can estimate global trends in dynamic information presented either as perceptual features or as symbolic codes such as numbers. Previous studies on temporal statistics estimation have shown that observers judge the temporal average of visual attributes according to information from the last few frames of the presentation sequence (in what is referred to as the recency effect). Here, we investigated how humans estimate the temporal average of number vs. orientation using identical stimuli for the two tasks. In Experiment 1, a randomly-selected single-digit number was serially presented at orientations randomly varying over time. In Experiment 2, a texture comprising a random number of Gabor elements was shown at orientations randomly varying over time. In both experiments, observers judged the temporal averages of the numerical values and orientations in separate blocks. Results showed that observers judging the temporal average of orientation relied upon information from later frames as predicted by a typical model of perceptual decision making. By contrast, for the judgement of numerical values, we found that the impacts of each temporal frame were constant or varied little across temporal frames regardless of whether the numerical information was given as digits or by the number of texture elements. The results are interpreted as evidence that distinct computational strategies may be involved in estimating the temporal averages of perceptual features and numerical information.
Collapse
Affiliation(s)
- Hiromi Sato
- Department of Life Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo 153-8902, Japan.
| | - Isamu Motoyoshi
- Department of Life Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo 153-8902, Japan
| |
Collapse
|
19
|
Abstract
The storage mechanisms of working memory are the matter of an ongoing debate. The sensory recruitment hypothesis states that memory maintenance and perceptual encoding rely on the same neural substrate. This suggests that the same cortical mechanisms that shape object perception also apply to maintained memory content. We tested this prediction using the Direction Illusion, i.e., the mutual repulsion of two concurrently visible motion directions. Participants memorized the directions of two random dot patterns for later recall. In Experiments 1 and 2, we varied the temporal separation of spatially distinct stimuli to manipulate perceptual concurrency, while keeping concurrency within working memory constant. We observed mutual motion repulsion only under simultaneous stimulus presentation, but proactive repulsion and retroactive attraction under immediate stimulus succession. At inter-stimulus intervals of 0.5 and 2 s, however, proactive repulsion vanished, while the retroactive attraction remained. In Experiment 3, we presented both stimuli at the same spatial position and observed a reappearance of the repulsion effect. Our results indicate that the repulsive mechanisms that shape object perception across space fade during the transition from a perceptual representation to a consolidated memory content. This suggests differences in the underlying structure of perceptual and mnemonic representations. The persistence of local interactions, however, indicates different mechanisms of spatially global and local feature interactions.
Collapse
|
20
|
Guterstam A, Graziano MSA. Implied motion as a possible mechanism for encoding other people's attention. Prog Neurobiol 2020; 190:101797. [PMID: 32217129 DOI: 10.1016/j.pneurobio.2020.101797] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2019] [Revised: 02/05/2020] [Accepted: 03/19/2020] [Indexed: 11/16/2022]
Abstract
Recent evidence suggests that the human brain automatically constructs a rich model of other people's attention, beyond registering low-level cues such as someone else's gaze direction. This model is not a physically accurate representation of attention, but instead appears to contain simplifying and physically incoherent features. For example, without explicitly realizing it, people treat the attentive gaze of others as though it exerts a gentle force pushing on objects. Here we specify another aspect of that implicit model of attention. People treat the attentive gaze of an agent as though it were travelling through space, with an implied motion encoded literally enough that it causes a perceptual motion adaptation effect. This implicit model of other people's attention may facilitate the process of keeping track of who is attending to what, which is essential for reading and predicting the minds and behavior of social agents. This implicit model of attention may also have shaped culturally widespread ideas about mind and spirit.
Collapse
Affiliation(s)
- Arvid Guterstam
- Department of Psychology, Princeton University, Princeton, NJ 08540, United States.
| | - Michael S A Graziano
- Department of Psychology, Princeton University, Princeton, NJ 08540, United States
| |
Collapse
|
21
|
Abstract
Most people easily learn to recognize new faces and places, and with more extensive practice they can become experts at visual tasks as complex as radiological diagnosis and action video games. Such perceptual plasticity has been thoroughly studied in the context of training paradigms that require constant fixation. In contrast, when observers learn under more natural conditions, they make frequent saccadic eye movements. Here we show that such eye movements can play an important role in visual learning. Observers performed a task in which they executed a saccade while discriminating the motion of a cued visual stimulus. Additional stimuli, presented simultaneously with the cued one, permitted an assessment of the perceptual integration of information across visual space. Consistent with previous results on perisaccadic remapping [M. Szinte, D. Jonikaitis, M. Rolfs, P. Cavanagh, H. Deubel, J. Neurophysiol. 116, 1592-1602 (2016)], most observers preferentially integrated information from locations representing the presaccadic and postsaccadic retinal positions of the cue. With extensive training on the saccade task, these observers gradually acquired the ability to perform similar motion integration without making eye movements. Importantly, the newly acquired pattern of spatial integration was determined by the metrics of the saccades made during training. These results suggest that oculomotor influences on visual processing, long thought to subserve the function of perceptual stability, also play a role in visual plasticity.
Collapse
|
22
|
Stein M, Fendrich R, Mattler U. Stimulus dependencies of an illusory motion: Investigations of the Motion Bridging Effect. J Vis 2020; 19:13. [PMID: 31100129 DOI: 10.1167/19.5.13] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The Motion Bridging Effect (MBE) is an illusion in which a motion that is not consciously visible generates a visible motion aftereffect that is predominantly in the same direction as the adapter motion. In the initial study of the MBE (Mattler & Fendrich, 2010), a ring of 16 points was rotated at angular velocities as high as 2250°/s so that observers saw only an unbroken outline circle and performed at chance when asked to report the ring's rotation direction. However, when the rotating ring was replaced by a veridically stationary ring of 16 points, the stationary ring appeared to visibly spin to a halt, principally in the same direction as the initial ring's rotation. Here we continue to investigate the stimulus dependencies of the MBE. We find the MBE, measured by the correspondence between the direction of the invisible rotation of the spinning ring and perceived rotation of the stationary ring, increases as the number of points used to construct the rings decreases and grows stronger as the diameter of the rings get larger. We consider the potential contributions of temporal frequency, retinal eccentricity, luminance levels, and the separation between the points forming the rings as mediators of these effects. Data is discussed with regard to the detection of real movement and apparent motion. We conclude that the detection of the rapid rotation of the spinning ring is likely to be modulated by temporal frequency of luminance changes along the ring perimeter while the point-distance may modulate an apparent motion produced by the transition from the perceptually unbroken spinning ring to the point-defined stationary ring.
Collapse
Affiliation(s)
- Maximilian Stein
- Department of Experimental Psychology, University of Goettingen, Goettingen, Germany
| | - Robert Fendrich
- Program in Cognitive Neuroscience, Dartmouth College, Hanover, NH, USA
| | - Uwe Mattler
- Department of Experimental Psychology, University of Goettingen, Goettingen, Germany
| |
Collapse
|
23
|
Akyuz S, Pavan A, Kaya U, Kafaligonul H. Short- and long-term forms of neural adaptation: An ERP investigation of dynamic motion aftereffects. Cortex 2020; 125:122-134. [PMID: 31981892 DOI: 10.1016/j.cortex.2019.12.015] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2019] [Revised: 11/04/2019] [Accepted: 12/11/2019] [Indexed: 01/10/2023]
Abstract
Adaptation is essential to interact with a dynamic and changing environment, and can be observed on different timescales. Previous studies on a motion paradigm called dynamic motion aftereffect (dMAE) showed that neural adaptation can establish even in very short timescales. However, the neural mechanisms underlying such rapid form of neural plasticity is still debated. In the present study, short- and long-term forms of neural plasticity were investigated using dynamic motion aftereffect combined with EEG (Electroencephalogram). Participants were adapted to directional drifting gratings for either short (640 msec) or long (6.4 sec) durations. Both adaptation durations led to motion aftereffects on the perceived direction of a dynamic and directionally ambiguous test pattern, but the long adaptation produced stronger dMAE. In line with behavioral results, we found robust changes in the event-related potentials elicited by the dynamic test pattern within 64-112 msec time range. These changes were mainly clustered over occipital and parieto-occipital scalp sites. Within this time range, the aftereffects induced by long adaptation were stronger than those by short adaptation. Moreover, the aftereffects by each adaptation duration were in the opposite direction. Overall, these EEG findings suggest that dMAEs reflect changes in cortical areas mediating low- and mid-level visual motion processing. They further provide evidence that short- and long-term forms of motion adaptation lead to distinct changes in neural activity, and hence support the view that adaptation is an active time-dependent process which involves different neural mechanisms.
Collapse
Affiliation(s)
- Sibel Akyuz
- Interdisciplinary Neuroscience Program, Bilkent University, Ankara, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey; Faculty of Arts and Sciences, Osmaniye Korkut Ata University, Osmaniye, Turkey
| | - Andrea Pavan
- School of Psychology, University of Lincoln, Lincoln, UK
| | - Utku Kaya
- National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey; Department of Anesthesiology, University of Michigan, Ann Arbor, MI, USA
| | - Hulusi Kafaligonul
- Interdisciplinary Neuroscience Program, Bilkent University, Ankara, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey.
| |
Collapse
|
24
|
Spatial suppression promotes rapid figure-ground segmentation of moving objects. Nat Commun 2019; 10:2732. [PMID: 31266956 PMCID: PMC6606582 DOI: 10.1038/s41467-019-10653-8] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2018] [Accepted: 05/21/2019] [Indexed: 12/21/2022] Open
Abstract
Segregation of objects from their backgrounds is a fundamental visual function and one that is particularly effective when objects are in motion. Theoretically, suppressive center-surround mechanisms are well suited for accomplishing motion segregation. This longstanding hypothesis, however, has received limited empirical support. We report converging correlational and causal evidence that spatial suppression of background motion signals is critical for rapid segmentation of moving objects. Motion segregation ability is strongly predicted by both individual and stimulus-driven variations in spatial suppression strength. Moreover, aging-related superiority in perceiving background motion is associated with profound impairments in motion segregation. This segregation deficit is alleviated via perceptual learning, but only when motion segregation training also causes decreased sensitivity to background motion. We argue that perceptual insensitivity to large moving stimuli effectively implements background subtraction, which, in turn, enhances the visibility of moving objects and accounts for the observed link between spatial suppression and motion segregation. The visual system excels at segregating moving objects from their backgrounds, a key visual function hypothesized to be driven by suppressive centre-surround mechanisms. Here, the authors show that spatial suppression of background motion signals is critical for rapid segmentation of moving objects.
Collapse
|
25
|
Fornaciai M, Park J. Spontaneous repulsive adaptation in the absence of attractive serial dependence. J Vis 2019; 19:21. [DOI: 10.1167/19.5.21] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Michele Fornaciai
- Department of Psychological & Brain Sciences, University of Massachusetts, Amherst, MA, USA
| | - Joonkoo Park
- Department of Psychological & Brain Sciences and the Commonwealth Honors College, University of Massachusetts, Amherst, MA, USA
| |
Collapse
|
26
|
Gallagher RM, Suddendorf T, Arnold DH. Confidence as a diagnostic tool for perceptual aftereffects. Sci Rep 2019; 9:7124. [PMID: 31073187 PMCID: PMC6509108 DOI: 10.1038/s41598-019-43170-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2018] [Accepted: 04/17/2019] [Indexed: 11/21/2022] Open
Abstract
Perceptual judgements are, by nature, a product both of sensation and the cognitive processes responsible for interpreting and reporting subjective experiences. Changed perceptual judgements may thus result from changes in how the world appears (perception), or subsequent interpretation (judgement). This ambiguity has led to persistent debates about how to interpret changes in decision-making, and if higher-order cognitions can change how the world looks, or sounds, or feels. Here we introduce an approach that can help resolve these ambiguities. In three motion-direction experiments, we measured perceptual judgements and subjective confidence. We show that each measure is sensitive to sensory information and can index sensory adaptation. Each measure is also sensitive to decision biases, but response bias impacts the central tendency of decision and confidence distributions differently. Our findings show that subjective confidence, when measured in addition to perceptual decisions, can supply important diagnostic information about the cause of aftereffects.
Collapse
Affiliation(s)
- Regan M Gallagher
- School of Psychology, The University of Queensland, Brisbane, Australia.
| | - Thomas Suddendorf
- School of Psychology, The University of Queensland, Brisbane, Australia
| | - Derek H Arnold
- School of Psychology, The University of Queensland, Brisbane, Australia
| |
Collapse
|
27
|
Yashiro R, Sato H, Motoyoshi I. Prospective decision making for randomly moving visual stimuli. Sci Rep 2019; 9:3809. [PMID: 30846815 PMCID: PMC6405837 DOI: 10.1038/s41598-019-40687-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2018] [Accepted: 02/18/2019] [Indexed: 11/16/2022] Open
Abstract
Humans persist in their attempts to predict the future in spite of the fact that natural events often involve a fundamental element of uncertainty. The present study explored computational mechanisms underlying biases in prospective decision making by using a simple psychophysical task. Observers viewed a randomly moving Gabor target for T sec and anticipated its future position ΔT sec following stimulus offset. Applying reverse correlation analysis, we found that observer decisions focused heavily on the last part of target velocity and especially on velocity information following the last several direction reversals. If target random motion explicitly contained an additional linear trend, observers tended to utilize information of the linear trend as well. These behavioral data are well explained by a leaky-integrator model of perceptual decision making based on evidence accumulation with adaptive gain control. The results raise the possibility that prospective decision making toward future events follows principles similar to those involved in retrospective decision making toward past events.
Collapse
Affiliation(s)
- Ryuto Yashiro
- Department of Life Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo, 153-8902, Japan.
| | - Hiromi Sato
- Faculty of Informatics, Kogakuin University, 1-24-2 Nishi-shinjuku, Shinjuku-ku, Tokyo, 163-8677, Japan
- JSPS Research Fellow, Tokyo, Japan
| | - Isamu Motoyoshi
- Department of Life Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-ku, Tokyo, 153-8902, Japan
| |
Collapse
|
28
|
Disentangling locus of perceptual learning in the visual hierarchy of motion processing. Sci Rep 2019; 9:1557. [PMID: 30733535 PMCID: PMC6367332 DOI: 10.1038/s41598-018-37892-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2018] [Accepted: 12/17/2018] [Indexed: 12/03/2022] Open
Abstract
Visual perceptual learning (VPL) can lead to long-lasting perceptual improvements. One of the central topics in VPL studies is the locus of plasticity in the visual processing hierarchy. Here, we tackled this question in the context of motion processing. We took advantage of an established transition from component-dependent representations at the earliest level to pattern-dependent representations at the middle-level of cortical motion processing. Two groups of participants were trained on the same motion direction identification task using either grating or plaid stimuli. A set of pre- and post-training tests was used to determine the degree of learning specificity and generalizability. This approach allowed us to disentangle contributions from different levels of processing stages to behavioral improvements. We observed a complete bi-directional transfer of learning between component and pattern stimuli that moved to the same directions, indicating learning-induced plasticity associated with intermediate levels of motion processing. Moreover, we found that motion VPL is specific to the trained stimulus direction, speed, size, and contrast, diminishing the possibility of non-sensory decision-level enhancements. Taken together, these results indicate that, at least for the type of stimuli and the task used here, motion VPL most likely alters visual computation associated with signals at the middle stage of motion processing.
Collapse
|
29
|
Validation of motion perception of briefly displayed images using a tablet. Sci Rep 2018; 8:16056. [PMID: 30375459 PMCID: PMC6207664 DOI: 10.1038/s41598-018-34466-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2018] [Accepted: 10/18/2018] [Indexed: 01/07/2023] Open
Abstract
Motion perception of briefly displayed images has been reported to be abnormal in clinical populations afflicted with schizophrenia, major depression, autism, Alzheimer’s disease and epilepsy. These abnormalities have been measured using CRT monitors connected to a computer. Given that the use of this experimental set-up in clinical environments can be difficult, we tested whether motion perception of briefly displayed images could also be measured using a tablet. For 13 participants, we found similar estimates of motion discrimination on a tablet and a CRT. This validates a tablet to measure motion perception of briefly displayed images.
Collapse
|
30
|
Abstract
Inhibition of return is the name typically given to the prolonged latency of motor responses directed to a previously cued target location. There is intense debate about the origins of this effect and its function, but most take for granted (despite lack of evidence) that it depends little on forward masking. Therefore, we re-examined the role of forward masking in inhibition of return. Forward masking was indexed by slower saccadic reaction times (SRTs) when the target orientation repeated the cue orientation at the same location. We confirmed effects of orientation repetition in the absence of an attentional bias when cues were presented on both sides of fixation (bilateral presentation). The effect of orientation repetition was reduced with high target contrast, consistent with a low-level origin such as contrast gain control in early visual areas. When presenting cues on only one side of fixation (unilateral presentation), we obtained inhibition of return with longer cue-target intervals and facilitation with targets presented shortly after the cue. The effect of orientation repetition was reduced when facilitation was observed, but was as strong as with bilateral cues when inhibition of return was observed. Therefore, forward masking may contribute to the inhibition of return effect by delaying reaction times to repeated features at the same location, but is not a principal cause of inhibition of return; in agreement with previous views. SIGNIFICANCE STATEMENT The saccadic inhibition of return effect is a reaction-time cost when responding to a pre-cued location. Additional object updating costs are typically invoked to explain reaction-time costs observed when cue and target have the same shape. Yet, lower-level, forward masking of the target by the cue can not be ruled out. Importantly, we show an effect of orientation repetition that is consistent with low-level forward masking rather than object updating costs and that does not interact with inhibition of return.
Collapse
Affiliation(s)
- David Souto
- Department of Neuroscience, Psychology and Behaviour, University of Leicester, Lancaster Road, Leicester, LE1 9HN, UK.
- Faculté de Psychologie et des Sciences de l'Éducation, Université de Genève, Geneva, Switzerland.
| | - Sabine Born
- Faculté de Psychologie et des Sciences de l'Éducation, Université de Genève, Geneva, Switzerland
| | - Dirk Kerzel
- Faculté de Psychologie et des Sciences de l'Éducation, Université de Genève, Geneva, Switzerland
| |
Collapse
|
31
|
Schallmo MP, Kale AM, Millin R, Flevaris AV, Brkanac Z, Edden RA, Bernier RA, Murray SO. Suppression and facilitation of human neural responses. eLife 2018; 7:30334. [PMID: 29376822 PMCID: PMC5812713 DOI: 10.7554/elife.30334] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2017] [Accepted: 01/26/2018] [Indexed: 12/12/2022] Open
Abstract
Efficient neural processing depends on regulating responses through suppression and facilitation of neural activity. Utilizing a well-known visual motion paradigm that evokes behavioral suppression and facilitation, and combining five different methodologies (behavioral psychophysics, computational modeling, functional MRI, pharmacology, and magnetic resonance spectroscopy), we provide evidence that challenges commonly held assumptions about the neural processes underlying suppression and facilitation. We show that: (1) both suppression and facilitation can emerge from a single, computational principle – divisive normalization; there is no need to invoke separate neural mechanisms, (2) neural suppression and facilitation in the motion-selective area MT mirror perception, but strong suppression also occurs in earlier visual areas, and (3) suppression is not primarily driven by GABA-mediated inhibition. Thus, while commonly used spatial suppression paradigms may provide insight into neural response magnitudes in visual areas, they should not be used to infer neural inhibition.
Collapse
Affiliation(s)
| | - Alexander M Kale
- Department of Psychology, University of Washington, Seattle, United States
| | - Rachel Millin
- Department of Psychology, University of Washington, Seattle, United States
| | | | - Zoran Brkanac
- Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, United States
| | - Richard Ae Edden
- Department of Radiology and Radiological Science, Johns Hopkins University, Baltimore, United States
| | - Raphael A Bernier
- Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, United States
| | - Scott O Murray
- Department of Psychology, University of Washington, Seattle, United States
| |
Collapse
|
32
|
Abstract
It is widely believed that the human visual system is insensitive to acceleration in moving stimuli. This notion is supported by evidence that detection sensitivity for velocity modulation in moving stimuli is a lowpass function of the velocity modulation's temporal frequency. However, the lowpass function might be a mixture of detection by attention-based tracking and low-level mechanisms sensitive to acceleration. To revisit the issue of acceleration perception in relation to attentive tracking, we measured detection sensitivities for velocity modulations at various temporal frequencies (0.25–8 Hz) by using drifting gratings within long or short spatial windows that make the tracking of grating easier or more difficult respectively. Results showed that modulation sensitivity is lowpass for gratings with long windows but bandpass for gratings with short windows (peak at ~1 Hz). Moreover, we found that lowpass sensitivity becomes bandpass when we removed observer attention by a concurrent letter identification task. An additional visual-search experiment showed that a target dot moving with a velocity modulation at relatively high temporal frequencies (~2–4 Hz) was most easily detected among dots moving at various constant velocities. These results support the notion that high sensitivity to sluggish velocity modulation is a product of attentively tracking of moving stimuli and that the visual system is directly sensitive to accelerations and/or decelerations at the preattentive level.
Collapse
Affiliation(s)
- Ryohei Nakayama
- Department of Life Sciences, The University of TokyoTokyo, Japan
| | - Isamu Motoyoshi
- Department of Life Sciences, The University of TokyoTokyo, Japan
| |
Collapse
|
33
|
Linear Summation of Repulsive and Attractive Serial Dependencies: Orientation and Motion Dependencies Sum in Motion Perception. J Neurosci 2017; 37:4381-4390. [PMID: 28330878 DOI: 10.1523/jneurosci.4601-15.2017] [Citation(s) in RCA: 54] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2015] [Revised: 03/14/2017] [Accepted: 03/15/2017] [Indexed: 11/21/2022] Open
Abstract
Recent work from several groups has shown that perception of various visual attributes in human observers at a given moment is biased toward what was recently seen. This positive serial dependency is a kind of temporal averaging that exploits short-term correlations in visual scenes to reduce noise and stabilize perception. To date, this stabilizing "continuity field" has been demonstrated on stable visual attributes such as orientation and face identity, yet it would be counterproductive to apply it to dynamic attributes in which change sensitivity is needed. Here, we tested this using motion direction discrimination and predict a negative perceptual dependency: a contrastive relationship that enhances sensitivity to change. Surprisingly, our data showed a cubic-like pattern of dependencies with positive and negative components. By interleaving various stimulus combinations, we separated the components and isolated a positive perceptual dependency for motion and a negative dependency for orientation. A weighted linear sum of the separate dependencies described the original cubic pattern well. The positive dependency for motion shows an integrative perceptual effect and was unexpected, although it is consistent with work on motion priming. These findings suggest that a perception-stabilizing continuity field occurs pervasively, occurring even when it obscures sensitivity to dynamic stimuli.SIGNIFICANCE STATEMENT Recent studies show that visual perception at a given moment is not entirely veridical, but rather biased toward recently seen stimuli: a positive serial dependency. This temporal smoothing process helps perceptual continuity by preserving stable aspects of the visual scene over time, yet, for dynamic stimuli, temporal smoothing would blur dynamics and reduce sensitivity to change. We tested whether this process is selective for stable attributes by examining dependencies in motion perception. We found a clear positive dependency for motion, suggesting that positive perceptual dependencies are pervasive. We also found a concurrent negative (contrastive) dependency for orientation. Both dependencies combined linearly to determine perception, showing that the brain can calculate contrastive and integrative dependencies simultaneously from recent stimulus history when making perceptual decisions.
Collapse
|
34
|
Niemeyer JE, Paradiso MA. Contrast sensitivity, V1 neural activity, and natural vision. J Neurophysiol 2017; 117:492-508. [PMID: 27832603 PMCID: PMC5288473 DOI: 10.1152/jn.00635.2016] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2016] [Accepted: 10/30/2016] [Indexed: 11/22/2022] Open
Abstract
Contrast sensitivity is fundamental to natural visual processing and an important tool for characterizing both visual function and clinical disorders. We simultaneously measured contrast sensitivity and neural contrast response functions and compared measurements in common laboratory conditions with naturalistic conditions. In typical experiments, a subject holds fixation and a stimulus is flashed on, whereas in natural vision, saccades bring stimuli into view. Motivated by our previous V1 findings, we tested the hypothesis that perceptual contrast sensitivity is lower in natural vision and that this effect is associated with corresponding changes in V1 activity. We found that contrast sensitivity and V1 activity are correlated and that the relationship is similar in laboratory and naturalistic paradigms. However, in the more natural situation, contrast sensitivity is reduced up to 25% compared with that in a standard fixation paradigm, particularly at lower spatial frequencies, and this effect correlates with significant reductions in V1 responses. Our data suggest that these reductions in natural vision result from fast adaptation on one fixation that lowers the response on a subsequent fixation. This is the first demonstration of rapid, natural-image adaptation that carries across saccades, a process that appears to constantly influence visual sensitivity in natural vision. NEW & NOTEWORTHY Visual sensitivity and activity in brain area V1 were studied in a paradigm that included saccadic eye movements and natural visual input. V1 responses and contrast sensitivity were significantly reduced compared with results in common laboratory paradigms. The parallel neural and perceptual effects of eye movements and stimulus complexity appear to be due to a form of rapid adaptation that carries across saccades.
Collapse
Affiliation(s)
- James E Niemeyer
- Department of Neuroscience, Brown University, Providence, Rhode Island
| | | |
Collapse
|
35
|
Palumbo R, D'Ascenzo S, Quercia A, Tommasi L. Adaptation to Complex Pictures: Exposure to Emotional Valence Induces Assimilative Aftereffects. Front Psychol 2017; 8:54. [PMID: 28194123 PMCID: PMC5276860 DOI: 10.3389/fpsyg.2017.00054] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2016] [Accepted: 01/10/2017] [Indexed: 12/15/2022] Open
Abstract
Aftereffects have been documented for a variety of perceptual categories spanning from body gender to facial emotion, thus becoming an important tool in the study of high-level vision and its neural bases. We examined whether the perceived valence of a complex scene is subject to aftereffects, by observing the participants’ evaluation of the valence of a test picture preceded by a different picture. For this study, we employed an adaptation paradigm with positive and negative images used as adapters, and positive, negative, and neutral images used as tests. Our results show that adaptation to complex emotional pictures induces assimilative aftereffects: participants judged neutral tests more positively following positive adapters and more negatively following negative adapters. This depended on the prolonged adaptation phase (10 s), as the results of a second experiment, in which adapters lasted for 500 ms, did not show aftereffects. In addition, the results show that assimilative aftereffects of negative and positive adapters also manifested themselves on non-neutral (negative and positive) targets, providing evidence that the global emotional content of complex pictures is suitable to induce assimilative aftereffects.
Collapse
Affiliation(s)
- Rocco Palumbo
- Schepens Eye Research Institute, Harvard Medical School, BostonMA, USA; Department of Psychological Science, Humanities and Territory, "G. d'Annunzio" UniversityChieti, Italy
| | - Stefania D'Ascenzo
- Department of Philosophy and Communication, University of Bologna Bologna, Italy
| | - Angelica Quercia
- Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University Chieti, Italy
| | - Luca Tommasi
- Department of Psychological Science, Humanities and Territory, "G. d'Annunzio" University Chieti, Italy
| |
Collapse
|
36
|
Takeuchi T, Yoshimoto S, Shimada Y, Kochiyama T, Kondo HM. Individual differences in visual motion perception and neurotransmitter concentrations in the human brain. Philos Trans R Soc Lond B Biol Sci 2017; 372:rstb.2016.0111. [PMID: 28044021 DOI: 10.1098/rstb.2016.0111] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/01/2016] [Indexed: 11/12/2022] Open
Abstract
Recent studies have shown that interindividual variability can be a rich source of information regarding the mechanism of human visual perception. In this study, we examined the mechanisms underlying interindividual variability in the perception of visual motion, one of the fundamental components of visual scene analysis, by measuring neurotransmitter concentrations using magnetic resonance spectroscopy. First, by psychophysically examining two types of motion phenomena-motion assimilation and contrast-we found that, following the presentation of the same stimulus, some participants perceived motion assimilation, while others perceived motion contrast. Furthermore, we found that the concentration of the excitatory neurotransmitter glutamate-glutamine (Glx) in the dorsolateral prefrontal cortex (Brodmann area 46) was positively correlated with the participant's tendency to motion assimilation over motion contrast; however, this effect was not observed in the visual areas. The concentration of the inhibitory neurotransmitter γ-aminobutyric acid had only a weak effect compared with that of Glx. We conclude that excitatory process in the suprasensory area is important for an individual's tendency to determine antagonistically perceived visual motion phenomena.This article is part of the themed issue 'Auditory and visual scene analysis'.
Collapse
Affiliation(s)
- Tatsuto Takeuchi
- Department of Psychology, Japan Women's University, Kawasaki, Kanagawa 214-8565, Japan .,Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243-0198, Japan
| | - Sanae Yoshimoto
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243-0198, Japan.,School of Psychology, Chukyo University, Nagoya, Aichi 466-8666, Japan
| | - Yasuhiro Shimada
- Brain Activity Imaging Center, ATR-Promotions, Seika-cho, Kyoto 619-0288, Japan
| | - Takanori Kochiyama
- Brain Activity Imaging Center, ATR-Promotions, Seika-cho, Kyoto 619-0288, Japan.,Department of Cognitive Neuroscience, Advanced Telecommunications Research Institute International, Seika-cho, Kyoto 619-0228, Japan
| | - Hirohito M Kondo
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243-0198, Japan
| |
Collapse
|
37
|
Oluk C, Pavan A, Kafaligonul H. Rapid Motion Adaptation Reveals the Temporal Dynamics of Spatiotemporal Correlation between ON and OFF Pathways. Sci Rep 2016; 6:34073. [PMID: 27667401 PMCID: PMC5036170 DOI: 10.1038/srep34073] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2016] [Accepted: 09/07/2016] [Indexed: 11/13/2022] Open
Abstract
At the early stages of visual processing, information is processed by two major thalamic pathways encoding brightness increments (ON) and decrements (OFF). Accumulating evidence suggests that these pathways interact and merge as early as in primary visual cortex. Using regular and reverse-phi motion in a rapid adaptation paradigm, we investigated the temporal dynamics of within and across pathway mechanisms for motion processing. When the adaptation duration was short (188 ms), reverse-phi and regular motion led to similar adaptation effects, suggesting that the information from the two pathways are combined efficiently at early-stages of motion processing. However, as the adaption duration was increased to 752 ms, reverse-phi and regular motion showed distinct adaptation effects depending on the test pattern used, either engaging spatiotemporal correlation between the same or opposite contrast polarities. Overall, these findings indicate that spatiotemporal correlation within and across ON-OFF pathways for motion processing can be selectively adapted, and support those models that integrate within and across pathway mechanisms for motion processing.
Collapse
Affiliation(s)
- Can Oluk
- National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey
- Department of Psychology, Bilkent University, Ankara, Turkey
| | - Andrea Pavan
- University of Lincoln, School of Psychology, Brayford Pool, Lincoln, LN6 7TS, UK
| | - Hulusi Kafaligonul
- National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey
- Interdisciplinary Neuroscience Program, Bilkent University, Ankara, Turkey
| |
Collapse
|
38
|
Rapid Adaptation Induces Persistent Biases in Population Codes for Visual Motion. J Neurosci 2016; 36:4579-90. [PMID: 27098699 DOI: 10.1523/jneurosci.4563-15.2016] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2015] [Accepted: 03/13/2016] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED Each visual experience changes the neural response to subsequent stimuli. If the brain is unable to incorporate these encoding changes, the decoding, or perception, of subsequent stimuli is biased. Although the phenomenon of adaptation pervades the nervous system, its effects have been studied mainly in isolation, based on neuronal encoding changes induced by an isolated, prolonged stimulus. To understand how adaptation-induced biases arise and persist under continuous, naturalistic stimulation, we simultaneously recorded the responses of up to 61 neurons in the marmoset (Callithrix jacchus) middle temporal area to a sequence of directions that changed every 500 ms. We found that direction-specific adaptation following only 0.5 s of stimulation strongly affected encoding for up to 2 s by reducing both the gain and the spike count correlations between pairs of neurons with preferred directions close to the adapting direction. In addition, smaller changes in bandwidth and preferred direction were observed in some animals. Decoding individual trials of adaptation-affected activity in simultaneously recorded neurons predicted repulsive biases that are consistent with the direction aftereffect. Surprisingly, removing spike count correlations by trial shuffling did not impact decoding performance or bias. When adaptation had the largest effect on encoding, the decoder made the most errors. This suggests that neural and perceptual repulsion is not a mechanism to enhance perceptual performance but is instead a necessary consequence of optimizing neural encoding for the identification of a wide range of stimulus properties in diverse temporal contexts. SIGNIFICANCE STATEMENT Although perception depends upon decoding the pattern of activity across a neuronal population, the encoding properties of individual neurons are unreliable: a single neuron's response to repetitions of the same stimulus is variable, and depends on both its spatial and temporal context. In this manuscript, we describe the complete cascade of adaptation-induced effects in sensory encoding and show how they predict population decoding errors consistent with perceptual biases. We measure the time course of adaptation-induced changes to the response properties of neurons in isolation, and to the correlation structure across pairs of simultaneously recorded neurons. These results provide novel insight into how and for how long adaptation affects the neural code, particularly during continuous, naturalistic vision.
Collapse
|
39
|
Liu B, Macellaio MV, Osborne LC. Efficient sensory cortical coding optimizes pursuit eye movements. Nat Commun 2016; 7:12759. [PMID: 27611214 PMCID: PMC5023965 DOI: 10.1038/ncomms12759] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2016] [Accepted: 07/29/2016] [Indexed: 01/16/2023] Open
Abstract
In the natural world, the statistics of sensory stimuli fluctuate across a wide range. In theory, the brain could maximize information recovery if sensory neurons adaptively rescale their sensitivity to the current range of inputs. Such adaptive coding has been observed in a variety of systems, but the premise that adaptation optimizes behaviour has not been tested. Here we show that adaptation in cortical sensory neurons maximizes information about visual motion in pursuit eye movements guided by that cortical activity. We find that gain adaptation drives a rapid (<100 ms) recovery of information after shifts in motion variance, because the neurons and behaviour rescale their sensitivity to motion fluctuations. Both neurons and pursuit rapidly adopt a response gain that maximizes motion information and minimizes tracking errors. Thus, efficient sensory coding is not simply an ideal standard but a description of real sensory computation that manifests in improved behavioural performance.
Collapse
Affiliation(s)
- Bing Liu
- Department of Neurobiology, The University of Chicago, 947 East 58th Street, P415 MC0928, Chicago, Illinois 60637, USA
| | - Matthew V. Macellaio
- Department of Neurobiology, The University of Chicago, 947 East 58th Street, P415 MC0928, Chicago, Illinois 60637, USA
| | - Leslie C. Osborne
- Department of Neurobiology, The University of Chicago, 947 East 58th Street, P415 MC0928, Chicago, Illinois 60637, USA
- Department of Organismal Biology and Anatomy, The University of Chicago, Chicago, Illinois 60637, USA
| |
Collapse
|
40
|
Pinchuk-Yacobi N, Harris H, Sagi D. Target-selective tilt aftereffect during texture learning. Vision Res 2016; 124:44-51. [DOI: 10.1016/j.visres.2016.06.008] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2016] [Revised: 05/12/2016] [Accepted: 06/07/2016] [Indexed: 10/21/2022]
|
41
|
Liu LD, Haefner RM, Pack CC. A neural basis for the spatial suppression of visual motion perception. eLife 2016; 5. [PMID: 27228283 PMCID: PMC4882155 DOI: 10.7554/elife.16167] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2016] [Accepted: 05/08/2016] [Indexed: 11/30/2022] Open
Abstract
In theory, sensory perception should be more accurate when more neurons contribute to the representation of a stimulus. However, psychophysical experiments that use larger stimuli to activate larger pools of neurons sometimes report impoverished perceptual performance. To determine the neural mechanisms underlying these paradoxical findings, we trained monkeys to discriminate the direction of motion of visual stimuli that varied in size across trials, while simultaneously recording from populations of motion-sensitive neurons in cortical area MT. We used the resulting data to constrain a computational model that explained the behavioral data as an interaction of three main mechanisms: noise correlations, which prevented stimulus information from growing with stimulus size; neural surround suppression, which decreased sensitivity for large stimuli; and a read-out strategy that emphasized neurons with receptive fields near the stimulus center. These results suggest that paradoxical percepts reflect tradeoffs between sensitivity and noise in neuronal populations. DOI:http://dx.doi.org/10.7554/eLife.16167.001 People usually find it easier to see things when they are big and bright, but there are occasionally exceptions. One example concerns moving objects: when they are small, we can identify their direction of motion easily, but this becomes much more difficult for larger objects. This decreased perceptual sensitivity appears to be linked to other mental processes. For example, studies have suggested that people with high IQs have more difficulty perceiving the motion of large objects, whereas people with various psychiatric disorders, such as schizophrenia, are better able to see such movement. Although several theories have been proposed, there is currently no good explanation for these findings. Liu et al. set out to determine why the part of the brain that is responsible for vision (the visual cortex) fails to register the direction of large moving objects and how this failure might relate to mental function in general. To do this, Liu et al. trained monkeys to report which direction different sized stimuli were moving on a screen. The electrical activity of nerve cells in the part of the visual cortex that deals with movement was recorded while the monkeys performed this task. The results of the experiments revealed that, on average, these cells responded strongly to large moving stimuli, even though the monkeys had trouble seeing their motion. However, nerve cells are “noisy” – they respond a bit differently every time they are presented with the same stimulus – and this noise was stronger for larger stimuli. By studying the mathematical relationship between the noise and what the animals perceived, Liu et al. found that the visual cortex attempts to suppress the noise and in the process often shuts off the responses to large stimuli entirely. This suppression is likely to cause the movement of large stimuli to be poorly perceived. If suppressing this kind of noise is really responsible for failures in perceiving motion, then this mechanism could also explain the connection between motion perception and other mental processes. Liu et al. are currently testing this idea. DOI:http://dx.doi.org/10.7554/eLife.16167.002
Collapse
Affiliation(s)
- Liu D Liu
- Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Canada
| | - Ralf M Haefner
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, United States
| | - Christopher C Pack
- Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Canada
| |
Collapse
|
42
|
Payzan-LeNestour E, Balleine BW, Berrada T, Pearson J. Variance After-Effects Distort Risk Perception in Humans. Curr Biol 2016; 26:1500-4. [PMID: 27161500 DOI: 10.1016/j.cub.2016.04.023] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2016] [Revised: 03/21/2016] [Accepted: 04/06/2016] [Indexed: 10/21/2022]
Abstract
In many contexts, decision-making requires an accurate representation of outcome variance-otherwise known as "risk" in economics. Conventional economic theory assumes this representation to be perfect, thereby focusing on risk preferences rather than risk perception per se [1-3] (but see [4]). However, humans often misrepresent their physical environment. Perhaps the most striking of such misrepresentations are the many well-known sensory after-effects, which most commonly involve visual properties, such as color, contrast, size, and motion. For example, viewing downward motion of a waterfall induces the anomalous biased experience of upward motion during subsequent viewing of static rocks to the side [5]. Given that after-effects are pervasive, occurring across a wide range of time horizons [6] and stimulus dimensions (including properties such as face perception [7, 8], gender [9], and numerosity [10]), and that some evidence exists that neurons show adaptation to variance in the sole visual feature of motion [11], we were interested in assessing whether after-effects distort variance perception in humans. We found that perceived variance is decreased after prolonged exposure to high variance and increased after exposure to low variance within a number of different visual representations of variance. We demonstrate these after-effects occur across very different visual representations of variance, suggesting that these effects are not sensory, but operate at a high (cognitive) level of information processing. These results suggest, therefore, that variance constitutes an independent cognitive property and that prolonged exposure to extreme variance distorts risk perception-a fundamental challenge for economic theory and practice.
Collapse
Affiliation(s)
| | - Bernard W Balleine
- Sydney Medical School and the Brain and Mind Centre, University of Sydney, 94 Mallett Street, Camperdown, NSW 2050, Australia; School of Psychology, Mathews Building, University of New South Wales, Sydney, NSW 2052, Australia
| | - Tony Berrada
- Swiss Finance Institute, University of Geneva, Boulevard du Pont d'Arve 40, 1205 Geneva, Switzerland
| | - Joel Pearson
- School of Psychology, Mathews Building, University of New South Wales, Sydney, NSW 2052, Australia
| |
Collapse
|
43
|
Steering Transforms the Cortical Representation of Self-Movement from Direction to Destination. J Neurosci 2016; 35:16055-63. [PMID: 26658859 DOI: 10.1523/jneurosci.2368-15.2015] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED Steering demands rapid responses to heading deviations and uses optic flow to redirect self-movement toward the intended destination. We trained monkeys in a naturalistic steering paradigm and recorded dorsal medial superior temporal area (MSTd) cortical neuronal responses to the visual motion and spatial location cues in optic flow. We found that neuronal responses to the initial heading direction are dominated by the optic flow's global radial pattern cue. Responses to subsequently imposed heading deviations are dominated by the local direction of motion cue. Finally, as the monkey steers its heading back to the goal location, responses are dominated by the spatial location cue, the screen location of the flow field's center of motion. We conclude that MSTd responses are not rigidly linked to specific stimuli, but rather are transformed by the task relevance of cues that guide performance in learned, naturalistic behaviors. SIGNIFICANCE STATEMENT Unplanned heading changes trigger lifesaving steering back to a goal. Conventionally, such behaviors are thought of as cortical sensory-motor reflex arcs. We find that a more reciprocal process underlies such cycles of perception and action, rapidly transforming visual processing to suit each stage of the task. When monkeys monitor their simulated self-movement, dorsal medial superior temporal area (MSTd) neurons represent their current heading direction. When monkeys steer to recover from an unplanned change in heading direction, MSTd shifts toward representing the goal location. We hypothesize that this transformation reflects the reweighting of bottom-up visual motion signals and top-down spatial location signals, reshaping MSTd's response properties through task-dependent interactions with adjacent cortical areas.
Collapse
|
44
|
|
45
|
Abstract
Sensory systems continuously mold themselves to the widely varying contexts in which they must operate. Studies of these adaptations have played a long and central role in vision science. In part this is because the specific adaptations remain a powerful tool for dissecting vision, by exposing the mechanisms that are adapting. That is, "if it adapts, it's there." Many insights about vision have come from using adaptation in this way, as a method. A second important trend has been the realization that the processes of adaptation are themselves essential to how vision works, and thus are likely to operate at all levels. That is, "if it's there, it adapts." This has focused interest on the mechanisms of adaptation as the target rather than the probe. Together both approaches have led to an emerging insight of adaptation as a fundamental and ubiquitous coding strategy impacting all aspects of how we see.
Collapse
|
46
|
Tadin D. Suppressive mechanisms in visual motion processing: From perception to intelligence. Vision Res 2015; 115:58-70. [PMID: 26299386 DOI: 10.1016/j.visres.2015.08.005] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2015] [Revised: 07/31/2015] [Accepted: 08/04/2015] [Indexed: 11/19/2022]
Abstract
Perception operates on an immense amount of incoming information that greatly exceeds the brain's processing capacity. Because of this fundamental limitation, the ability to suppress irrelevant information is a key determinant of perceptual efficiency. Here, I will review a series of studies investigating suppressive mechanisms in visual motion processing, namely perceptual suppression of large, background-like motions. These spatial suppression mechanisms are adaptive, operating only when sensory inputs are sufficiently robust to guarantee visibility. Converging correlational and causal evidence links these behavioral results with inhibitory center-surround mechanisms, namely those in cortical area MT. Spatial suppression is abnormally weak in several special populations, including the elderly and individuals with schizophrenia-a deficit that is evidenced by better-than-normal direction discriminations of large moving stimuli. Theoretical work shows that this abnormal weakening of spatial suppression should result in motion segregation deficits, but direct behavioral support of this hypothesis is lacking. Finally, I will argue that the ability to suppress information is a fundamental neural process that applies not only to perception but also to cognition in general. Supporting this argument, I will discuss recent research that shows individual differences in spatial suppression of motion signals strongly predict individual variations in IQ scores.
Collapse
Affiliation(s)
- Duje Tadin
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY 14627, USA; Center for Visual Science, University of Rochester, Rochester, NY 14627, USA; Department of Ophthalmology, University of Rochester School of Medicine, Rochester, NY 14642, USA.
| |
Collapse
|
47
|
Nortmann N, Rekauzke S, Onat S, König P, Jancke D. Primary visual cortex represents the difference between past and present. Cereb Cortex 2015; 25:1427-40. [PMID: 24343889 PMCID: PMC4428292 DOI: 10.1093/cercor/bht318] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
The visual system is confronted with rapidly changing stimuli in everyday life. It is not well understood how information in such a stream of input is updated within the brain. We performed voltage-sensitive dye imaging across the primary visual cortex (V1) to capture responses to sequences of natural scene contours. We presented vertically and horizontally filtered natural images, and their superpositions, at 10 or 33 Hz. At low frequency, the encoding was found to represent not the currently presented images, but differences in orientation between consecutive images. This was in sharp contrast to more rapid sequences for which we found an ongoing representation of current input, consistent with earlier studies. Our finding that for slower image sequences, V1 does no longer report actual features but represents their relative difference in time counteracts the view that the first cortical processing stage must always transfer complete information. Instead, we show its capacities for change detection with a new emphasis on the role of automatic computation evolving in the 100-ms range, inevitably affecting information transmission further downstream.
Collapse
Affiliation(s)
- Nora Nortmann
- Optical Imaging Group, Institut für Neuroinformatik, Ruhr-University Bochum, 44780 Bochum, Germany
- Bernstein Group for Computational Neuroscience, Ruhr-University Bochum, 44780 Bochum, Germany
- Institute of Cognitive Science, University of Osnabrück, 49069 Osnabrück, Germany
| | - Sascha Rekauzke
- Optical Imaging Group, Institut für Neuroinformatik, Ruhr-University Bochum, 44780 Bochum, Germany
- Bernstein Group for Computational Neuroscience, Ruhr-University Bochum, 44780 Bochum, Germany
| | - Selim Onat
- Institute of Cognitive Science, University of Osnabrück, 49069 Osnabrück, Germany
| | - Peter König
- Institute of Cognitive Science, University of Osnabrück, 49069 Osnabrück, Germany
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
| | - Dirk Jancke
- Optical Imaging Group, Institut für Neuroinformatik, Ruhr-University Bochum, 44780 Bochum, Germany
- Bernstein Group for Computational Neuroscience, Ruhr-University Bochum, 44780 Bochum, Germany
| |
Collapse
|
48
|
Cuturi L, MacNeilage P. Optic Flow Induces Nonvisual Self-Motion Aftereffects. Curr Biol 2014; 24:2817-21. [DOI: 10.1016/j.cub.2014.10.015] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2014] [Revised: 08/26/2014] [Accepted: 10/07/2014] [Indexed: 11/30/2022]
|
49
|
Abstract
How an object is perceived depends on the temporal context in which it is encountered. Sensory signals in the brain also depend on temporal context, a phenomenon often referred to as adaptation. Traditional descriptions of adaptation effects emphasize various forms of response fatigue in single neurons, which grow in strength with exposure to a stimulus. Recent work on vision, and other sensory modalities, has shown that this description has substantial shortcomings. Here we review our emerging understanding of how adaptation alters the balance between excitatory and suppressive signals, how effects depend on adaptation duration, and how adaptation influences representations that are distributed within and across multiple brain structures. This work points to a sophisticated set of mechanisms for adjusting to recent sensory experience, and suggests new avenues for understanding their function.
Collapse
Affiliation(s)
- Samuel G Solomon
- Institute for Behavioural Neuroscience, University College London, London, UK; Department of Experimental Psychology, University College London, London, UK.
| | - Adam Kohn
- Dominick Purpura Department of Neuroscience, Albert Einstein College of Medicine, Bronx, NY 10461, USA; Department of Ophthalmology and Visual Sciences, Albert Einstein College of Medicine, Bronx, NY 10461, USA.
| |
Collapse
|
50
|
Liberman A, Fischer J, Whitney D. Serial dependence in the perception of faces. Curr Biol 2014; 24:2569-74. [PMID: 25283781 DOI: 10.1016/j.cub.2014.09.025] [Citation(s) in RCA: 190] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2014] [Revised: 07/30/2014] [Accepted: 09/09/2014] [Indexed: 11/17/2022]
Abstract
From moment to moment, we perceive objects in the world as continuous despite fluctuations in their image properties due to factors like occlusion, visual noise, and eye movements. The mechanism by which the visual system accomplishes this object continuity remains elusive. Recent results have demonstrated that the perception of low-level stimulus features such as orientation and numerosity is systematically biased (i.e., pulled) toward visual input from the recent past. The spatial region over which current orientations are pulled by previous orientations is known as the continuity field, which is temporally tuned for the past 10-15 s. This perceptual pull could contribute to the visual stability of low-level features over short time periods, but it does not address how visual stability occurs at the level of object identity. Here, we tested whether the visual system facilitates stable perception by biasing current perception of a face, a complex and behaviorally relevant object, toward recently seen faces. We found that perception of face identity is systematically biased toward identities seen up to several seconds prior, even across changes in viewpoint. This effect did not depend on subjects' prior responses or on the method used to measure identity perception. Although this bias in perceived identity manifests as a misperception, it is adaptive: visual processing echoes the stability of objects in the world to create perceptual continuity. The serial dependence of identity perception promotes object identity invariance over time and provides the clearest evidence for the existence of an object-selective perceptual continuity field.
Collapse
Affiliation(s)
- Alina Liberman
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA.
| | - Jason Fischer
- Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - David Whitney
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA; Vision Science Group, University of California, Berkeley, Berkeley, CA 94720, USA
| |
Collapse
|