1
|
Alexander RG, Venkatakrishnan A, Chanovas J, Ferguson S, Macknik SL, Martinez-Conde S. Why did Rubens add a parrot to Titian's The Fall of Man? A pictorial manipulation of joint attention. J Vis 2024; 24:1. [PMID: 38558160 PMCID: PMC10996941 DOI: 10.1167/jov.24.4.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 01/19/2024] [Indexed: 04/04/2024] Open
Abstract
Almost 400 years ago, Rubens copied Titian's The Fall of Man, albeit with important changes. Rubens altered Titian's original composition in numerous ways, including by changing the gaze directions of the depicted characters and adding a striking red parrot to the painting. Here, we quantify the impact of Rubens's choices on the viewer's gaze behavior. We displayed digital copies of Rubens's and Titian's artworks-as well as a version of Rubens's painting with the parrot digitally removed-on a computer screen while recording the eye movements produced by observers during free visual exploration of each image. To assess the effects of Rubens's changes to Titian's composition, we directly compared multiple gaze parameters across the different images. We found that participants gazed at Eve's face more frequently in Rubens's painting than in Titian's. In addition, gaze positions were more tightly focused for the former than for the latter, consistent with different allocations of viewer interest. We also investigated how gaze fixation on Eve's face affected the perceptual visibility of the parrot in Rubens's composition and how the parrot's presence versus its absence impacted gaze dynamics. Taken together, our results demonstrate that Rubens's critical deviations from Titian's painting have powerful effects on viewers' oculomotor behavior.
Collapse
Affiliation(s)
- Robert G Alexander
- Department of Psychology & Counseling, New York Institute of Technology, New York, NY, USA
| | - Ashwin Venkatakrishnan
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Jordi Chanovas
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
- Graduate Program in Neural and Behavioral Science, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Sophie Ferguson
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Stephen L Macknik
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Susana Martinez-Conde
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| |
Collapse
|
2
|
Murali S, Händel B. Spontaneous Eye Blinks Map the Probability of Perceptual Reinterpretation During Visual and Auditory Ambiguity. Cogn Sci 2024; 48:e13414. [PMID: 38320109 DOI: 10.1111/cogs.13414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 01/10/2024] [Accepted: 01/27/2024] [Indexed: 02/08/2024]
Abstract
Spontaneous eye blinks are modulated around perceptual events. Our previous study, using a visual ambiguous stimulus, indicated that blink probability decreases before a reported perceptual switch. In the current study, we tested our hypothesis that an absence of blinks marks a time in which perceptual switches are facilitated in- and outside the visual domain. In three experiments, presenting either a visual motion quartet in light or darkness or a bistable auditory streaming stimulus, we found a co-occurrence of blink rate reduction with increased perceptual switch probability. In the visual domain, perceptual switches induced by a short interruption of visual input (blank) allowed an estimate of the timing of the perceptual event with respect to the motor response. This provided the first evidence that the blink reduction was not a consequence of the perceptual switch. Importantly, by showing that the time between switches and the previous blink was significantly longer than the inter-blink interval, our studies allowed to conclude that perceptual switches did not happen at random but followed a prolonged period of nonblinking. Correspondingly, blink rate and switch rate showed an inverse relationship. Our study supports the idea that the absence or presence of blinks maps perceptual processes independent of the sensory modality.
Collapse
Affiliation(s)
| | - Barbara Händel
- Institute of Psychology III, University of Würzburg
- Department of Neurology, University Hospital Würzburg
| |
Collapse
|
3
|
Huber SE, Martini M, Sachse P. Task-synchronized eye blink modulation neither requires visual stimulation nor active motor response and is modulated by task predictability. Int J Psychophysiol 2023; 187:1-10. [PMID: 36773888 DOI: 10.1016/j.ijpsycho.2023.01.011] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 01/31/2023] [Accepted: 01/31/2023] [Indexed: 02/12/2023]
Abstract
It has been repeatedly shown that temporal task features are reflected in eye blink dynamics during attention tasks. Eye blinks occur with increased likeliness particularly when demands on external attention allocation are low. Both predictive, top-down and reactive, bottom-up processes were shown to be involved in blink regulation. However, whether temporal stimulus prediction is a generally active component of the attention system or rather specific to the visual domain has not been fully elaborated yet. By monitoring eye blinking of 99 students during an auditory attention task and analyzing particularly the dynamics of eye blink onsets relative to stimuli timings, we show here that prediction does, in principle, not require visual stimulation, and is also not merely a consequence of the involvement of manual responses during the task. We further show that both the inclusion of manual response to stimuli and elevated task predictability enhance the prediction component reflected in eye blink dynamics, whereas for the latter we experimentally manipulate objective task predictability by adjusting the frequency dependence of the power spectral densities of the series of inter-stimulus time intervals. This allows us finally to explain why, for specific choices of experimental conditions, the generally active and present prediction component involved in attention can become difficult to detect in non-visual, auditory tasks. Conversely, this comes with the important implication that, if tasks aim for elaborating particularly temporal prediction, distributing stimuli over time such that inter-stimulus-intervals conform to a sample of Gaussian noise represents a specifically unfavorable choice.
Collapse
Affiliation(s)
- Stefan E Huber
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria; Institute of Psychology, University of Graz, Universitätsplatz 2, A-8010 Graz, Austria.
| | - Markus Martini
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria
| | - Pierre Sachse
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria
| |
Collapse
|
4
|
Orczyk JJ, Barczak A, O'Connell MN, Kajikawa Y. Saccadic inhibition during free viewing in macaque monkeys. J Neurophysiol 2023; 129:356-367. [PMID: 36629324 PMCID: PMC9902227 DOI: 10.1152/jn.00225.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Revised: 12/08/2022] [Accepted: 01/03/2023] [Indexed: 01/12/2023] Open
Abstract
Through the process of saccadic inhibition, visual events briefly suppress eye movements including microsaccades. In humans, saccadic inhibition has been shown to occur in response to the presentation of parafoveal or peripheral visual distractors during fixation and target-directed saccades and to physical changes of behaviorally relevant visual objects. In monkeys performing tasks that controlled eye movements, saccadic inhibition of microsaccades and target-directed saccades has been shown. Using eye data from three previously published studies, we investigated how saccade rate changed while monkeys were presented with visual stimuli under conditions with loose or no viewing demands. In two conditions, animals passively sat while an LED lamp flashed or screen-wide images appeared in front of them. In the third condition, images were repeated semiperiodically while animals had to maintain their gaze within a wide rectangular area and detect oddballs. Despite animals not being required to maintain fixation or make saccades to particular targets, the onset of visual events led to a temporary reduction of saccade rate across all conditions. Interestingly, saccadic inhibition was found at image offsets as well. These results show that saccadic inhibition occurs in monkeys during free viewing.NEW & NOTEWORTHY We investigated the time courses of saccade rate following visual stimuli during three conditions of free viewing in macaque monkeys. Under all conditions, saccade rate decreased transiently after the onset of visual stimuli. These results suggest that saccadic inhibition occurs during free viewing.
Collapse
Affiliation(s)
- John J Orczyk
- Translational Neuroscience, Center for Biological Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, New York
| | - Annamaria Barczak
- Translational Neuroscience, Center for Biological Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, New York
| | - Monica N O'Connell
- Translational Neuroscience, Center for Biological Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, New York
- Department of Psychiatry, New York University School of Medicine, New York, New York
| | - Yoshinao Kajikawa
- Translational Neuroscience, Center for Biological Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, New York
- Department of Psychiatry, New York University School of Medicine, New York, New York
| |
Collapse
|
5
|
Lubinus C, Einhäuser W, Schiller F, Kircher T, Straube B, van Kemenade BM. Action-based predictions affect visual perception, neural processing, and pupil size, regardless of temporal predictability. Neuroimage 2022; 263:119601. [PMID: 36064139 DOI: 10.1016/j.neuroimage.2022.119601] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 08/30/2022] [Accepted: 09/01/2022] [Indexed: 10/31/2022] Open
Abstract
Sensory consequences of one's own action are often perceived as less intense, and lead to reduced neural responses, compared to externally generated stimuli. Presumably, such sensory attenuation is due to predictive mechanisms based on the motor command (efference copy). However, sensory attenuation has also been observed outside the context of voluntary action, namely when stimuli are temporally predictable. Here, we aimed at disentangling the effects of motor and temporal predictability-based mechanisms on the attenuation of sensory action consequences. During fMRI data acquisition, participants (N = 25) judged which of two visual stimuli was brighter. In predictable blocks, the stimuli appeared temporally aligned with their button press (active) or aligned with an automatically generated cue (passive). In unpredictable blocks, stimuli were presented with a variable delay after button press/cue, respectively. Eye tracking was performed to investigate pupil-size changes and to ensure proper fixation. Self-generated stimuli were perceived as darker and led to less neural activation in visual areas than their passive counterparts, indicating sensory attenuation for self-generated stimuli independent of temporal predictability. Pupil size was larger during self-generated stimuli, which correlated negatively with the blood oxygenation level dependent (BOLD) response: the larger the pupil, the smaller the BOLD amplitude in visual areas. Our results suggest that sensory attenuation in visual cortex is driven by action-based predictive mechanisms rather than by temporal predictability. This effect may be related to changes in pupil diameter. Altogether, these results emphasize the role of the efference copy in the processing of sensory action consequences.
Collapse
Affiliation(s)
- Christina Lubinus
- Department of Neuroscience, Max-Planck-Institute for Empirical Aesthetics, Grüneburgweg 14, Frankfurt am Main D-60322, Germany; Department of Psychiatry and Psychotherapy and Center for Mind, Brain and Behavior (CMBB), University of Marburg, Rudolf-Bultmann-Str. 8, Marburg D-35039, Germany.
| | - Wolfgang Einhäuser
- Institute of Physics, Physics of Cognition Group, Chemnitz University of Technology, Chemnitz D-09107, Germany
| | - Florian Schiller
- Department of Psychology, Justus Liebig University Giessen, Otto-Behaghel-Str. 10, Giessen D-35394, Germany
| | - Tilo Kircher
- Department of Psychiatry and Psychotherapy and Center for Mind, Brain and Behavior (CMBB), University of Marburg, Rudolf-Bultmann-Str. 8, Marburg D-35039, Germany
| | - Benjamin Straube
- Department of Psychiatry and Psychotherapy and Center for Mind, Brain and Behavior (CMBB), University of Marburg, Rudolf-Bultmann-Str. 8, Marburg D-35039, Germany
| | - Bianca M van Kemenade
- Department of Psychiatry and Psychotherapy and Center for Mind, Brain and Behavior (CMBB), University of Marburg, Rudolf-Bultmann-Str. 8, Marburg D-35039, Germany; Center for Cognitive Neuroimaging, Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| |
Collapse
|
6
|
Toppino TC. Reversible-figure perception: Why is voluntary control limited? Perception 2022; 51:624-638. [PMID: 35833335 DOI: 10.1177/03010066221109990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Observers can voluntarily avoid reversals of an ambiguous, reversible figure, extending the duration of an intended percept. This is usually attributed to high-level, top-down attentional processes. However, voluntary control is limited. Reversals occur despite attempts to avoid them. In two experiments, observers demonstrated significant, but limited, voluntary control over Necker cube perception. Cube size and cube completeness, variables associated with stimulus-driven processes involving neural adaptation, influenced the frequency of reversals regardless of observers' intentions. Results are consistent with the hybrid hypothesis that both top-down and bottom-up processes contribute to Necker-cube perception and support the hypothesis that the contribution of bottom-up processes is responsible for the limitation on voluntary control.
Collapse
Affiliation(s)
- Thomas C Toppino
- Department of Psychological and Brain Sciences, 8210Villanova University, United States
| |
Collapse
|
7
|
Brascamp JW, de Hollander G, Wertheimer MD, DePew AN, Knapen T. Separable pupillary signatures of perception and action during perceptual multistability. eLife 2021; 10:66161. [PMID: 34378532 PMCID: PMC8378849 DOI: 10.7554/elife.66161] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2020] [Accepted: 08/11/2021] [Indexed: 02/04/2023] Open
Abstract
The pupil provides a rich, non-invasive measure of the neural bases of perception and cognition and has been of particular value in uncovering the role of arousal-linked neuromodulation, which alters both cortical processing and pupil size. But pupil size is subject to a multitude of influences, which complicates unique interpretation. We measured pupils of observers experiencing perceptual multistability-an ever-changing subjective percept in the face of unchanging but inconclusive sensory input. In separate conditions, the endogenously generated perceptual changes were either task-relevant or not, allowing a separation between perception-related and task-related pupil signals. Perceptual changes were marked by a complex pupil response that could be decomposed into two components: a dilation tied to task execution and plausibly indicative of an arousal-linked noradrenaline surge, and an overlapping constriction tied to the perceptual transient and plausibly a marker of altered visual cortical representation. Constriction, but not dilation, amplitude systematically depended on the time interval between perceptual changes, possibly providing an overt index of neural adaptation. These results show that the pupil provides a simultaneous reading on interacting but dissociable neural processes during perceptual multistability, and suggest that arousal-linked neuromodulator release shapes action but not perception in these circumstances.
Collapse
Affiliation(s)
- Jan W Brascamp
- Michigan State University, Department of Psychology, East Lansing, United States.,Michigan State University, Neuroscience Program, East Lansing, United States
| | - Gilles de Hollander
- Zurich Center for Neuroeconomics, Department of Economics, University of Zurich, Zurich, Switzerland
| | - Michael D Wertheimer
- Michigan State University, Department of Psychology, East Lansing, United States
| | - Ashley N DePew
- Michigan State University, Department of Psychology, East Lansing, United States
| | - Tomas Knapen
- Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Spinoza Centre for Neuroimaging, Royal Academy of Sciences, Amsterdam, Netherlands
| |
Collapse
|
8
|
Grenzebach J, Wegner TGG, Einhäuser W, Bendixen A. Pupillometry in auditory multistability. PLoS One 2021; 16:e0252370. [PMID: 34086770 PMCID: PMC8177413 DOI: 10.1371/journal.pone.0252370] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Accepted: 05/15/2021] [Indexed: 11/20/2022] Open
Abstract
In multistability, a constant stimulus induces alternating perceptual interpretations. For many forms of visual multistability, the transition from one interpretation to another ("perceptual switch") is accompanied by a dilation of the pupil. Here we ask whether the same holds for auditory multistability, specifically auditory streaming. Two tones were played in alternation, yielding four distinct interpretations: the tones can be perceived as one integrated percept (single sound source), or as segregated with either tone or both tones in the foreground. We found that the pupil dilates significantly around the time a perceptual switch is reported ("multistable condition"). When participants instead responded to actual stimulus changes that closely mimicked the multistable perceptual experience ("replay condition"), the pupil dilated more around such responses than in multistability. This still held when data were corrected for the pupil response to the stimulus change as such. Hence, active responses to an exogeneous stimulus change trigger a stronger or temporally more confined pupil dilation than responses to an endogenous perceptual switch. In another condition, participants randomly pressed the buttons used for reporting multistability. In Study 1, this "random condition" failed to sufficiently mimic the temporal pattern of multistability. By adapting the instructions, in Study 2 we obtained a response pattern more similar to the multistable condition. In this case, the pupil dilated significantly around the random button presses. Albeit numerically smaller, this pupil response was not significantly different from the multistable condition. While there are several possible explanations-related, e.g., to the decision to respond-this underlines the difficulty to isolate a purely perceptual effect in multistability. Our data extend previous findings from visual to auditory multistability. They highlight methodological challenges in interpreting such data and suggest possible approaches to meet them, including a novel stimulus to simulate the experience of perceptual switches in auditory streaming.
Collapse
Affiliation(s)
- Jan Grenzebach
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
- Physics of Cognition Group, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Thomas G. G. Wegner
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
- Physics of Cognition Group, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Wolfgang Einhäuser
- Physics of Cognition Group, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Alexandra Bendixen
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| |
Collapse
|
9
|
Brych M, Murali S, Händel B. The Role of Blinks, Microsaccades and their Retinal Consequences in Bistable Motion Perception. Front Psychol 2021; 12:647256. [PMID: 33897552 PMCID: PMC8061730 DOI: 10.3389/fpsyg.2021.647256] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2020] [Accepted: 03/03/2021] [Indexed: 11/30/2022] Open
Abstract
Eye-related movements such as blinks and microsaccades are modulated during bistable perceptual tasks. However, if they play an active role during internal perceptual switches is not known. We conducted two experiments involving an ambiguous plaid stimulus, wherein participants were asked to continuously report their percept, which could consist of either unidirectional coherent or bidirectional component movement. Our main results show that blinks and microsaccades did not facilitate perceptual switches. On the contrary, a reduction in eye movements preceded the perceptual switch. Blanks, on the other hand, thought to mimic the retinal consequences of a blink, consistently led to a switch. Through the timing of the blank-introduced perceptual change, we were able to estimate the delay between the internal switch and the response. This delay further allowed us to evaluate that the reduction in blink probability co-occurred with the internal perceptual switch. Additionally, our results indicate that distinct internal processes underlie the switch to coherent vs. component percept. Blanks exclusively facilitated a switch to the coherent percept, and only the switch to coherent percept was followed by an increase in blink rate. In a second study, we largely replicated the findings and included a microsaccade analysis. Microsaccades only showed a weak relation with perceptual switches, but their direction was correlated with the perceived motion direction. Nevertheless, our data suggests an interaction between microsaccades and blinks by showing that microsaccades were differently modulated around blinks compared with blanks. This study shows that a reduction in eye movements precedes internal perceptual switches indicating that the rate of blinks can set the stage for a reinterpretation of sensory input. While a perceptual switch based on changed sensory input usually leads to an increase in blink rate, such an increase was only present after the perceptual switch to coherent motion but absent after the switch to component percept. This provides evidence of different underlying mechanism or internal consequence of the two perceptual switches and suggests that blinks can uncover differences in internal percept-related processes that are not evident from the percept itself.
Collapse
Affiliation(s)
- Mareike Brych
- Department of Psychology III, University of Würzburg, Würzburg, Germany
| | - Supriya Murali
- Department of Psychology III, University of Würzburg, Würzburg, Germany
| | - Barbara Händel
- Department of Psychology III, University of Würzburg, Würzburg, Germany
| |
Collapse
|
10
|
Microsaccades mediate perceptual alternations in Monet's "Impression, sunrise". Sci Rep 2021; 11:3612. [PMID: 33574386 PMCID: PMC7878487 DOI: 10.1038/s41598-021-82222-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2020] [Accepted: 01/18/2021] [Indexed: 11/08/2022] Open
Abstract
Troxler fading, the perceptual disappearance of stationary images upon sustained fixation, is common for objects with equivalent luminance to that of the background. Previous work showed that variations in microsaccadic rates underlie the perceptual vanishing and intensification of simple stimuli, such as Gabor patches. Here, we demonstrate that microsaccade dynamics also contribute to Troxler fading and intensification during the viewing of representational art. Participants fixated a small spot while viewing either a Gabor patch on a blank background, or Monet's painting "Impression, Sunrise." They continuously reported, via button press/release, whether the Gabor patch, or the sun in Monet's painting, was fading versus intensifying, while their eye movements were recorded with high precision. Microsaccade rates peaked before reports of increased visibility, and dropped before reports of decreased visibility or fading, both when viewing Gabor patches and Monet's sun. These results reveal that the relationship between microsaccade production and the reversal and prevention of Troxler fading applies not only to the viewing of contrived stimuli, but also to the observation of "Impression, Sunrise." Whether or not perceptual fading was consciously intended by Monet, our findings indicate that observers' oculomotor dynamics are a contributor to the cornerstone of Impressionism.
Collapse
|
11
|
Cao L, Chen X, Haendel BF. Overground Walking Decreases Alpha Activity and Entrains Eye Movements in Humans. Front Hum Neurosci 2021; 14:561755. [PMID: 33414709 PMCID: PMC7782973 DOI: 10.3389/fnhum.2020.561755] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2020] [Accepted: 12/02/2020] [Indexed: 01/25/2023] Open
Abstract
Experiments in animal models have shown that running increases neuronal activity in early visual areas in light as well as in darkness. This suggests that visual processing is influenced by locomotion independent of visual input. Combining mobile electroencephalography, motion- and eye-tracking, we investigated the influence of overground free walking on cortical alpha activity (~10 Hz) and eye movements in healthy humans. Alpha activity has been considered a valuable marker of inhibition of sensory processing and shown to negatively correlate with neuronal firing rates. We found that walking led to a decrease in alpha activity over occipital cortex compared to standing. This decrease was present during walking in darkness as well as during light. Importantly, eye movements could not explain the change in alpha activity. Nevertheless, we found that walking and eye related movements were linked. While the blink rate increased with increasing walking speed independent of light or darkness, saccade rate was only significantly linked to walking speed in the light. Pupil size, on the other hand, was larger during darkness than during light, but only showed a modulation by walking in darkness. Analyzing the effect of walking with respect to the stride cycle, we further found that blinks and saccades preferentially occurred during the double support phase of walking. Alpha power, as shown previously, was lower during the swing phase than during the double support phase. We however could exclude the possibility that the alpha modulation was introduced by a walking movement induced change in electrode impedance. Overall, our work indicates that the human visual system is influenced by the current locomotion state of the body. This influence affects eye movement pattern as well as neuronal activity in sensory areas and might form part of an implicit strategy to optimally extract sensory information during locomotion.
Collapse
Affiliation(s)
- Liyu Cao
- Department of Psychology (III), Julius-Maximilians-Universität Würzburg, Würzburg, Germany
| | - Xinyu Chen
- Department of Psychology (III), Julius-Maximilians-Universität Würzburg, Würzburg, Germany
| | - Barbara F Haendel
- Department of Psychology (III), Julius-Maximilians-Universität Würzburg, Würzburg, Germany
| |
Collapse
|
12
|
Brych M, Händel B. Disentangling top-down and bottom-up influences on blinks in the visual and auditory domain. Int J Psychophysiol 2020; 158:400-410. [PMID: 33181189 DOI: 10.1016/j.ijpsycho.2020.11.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2020] [Revised: 07/23/2020] [Accepted: 11/04/2020] [Indexed: 11/28/2022]
Abstract
Sensory input as well as cognitive factors can drive the modulation of blinking. Our aim was to dissociate sensory driven bottom-up from cognitive top-down influences on blinking behavior and compare these influences between the auditory and the visual domain. Using an oddball paradigm, we found a significant pre-stimulus decrease in blink probability for visual input compared to auditory input. Sensory input further led to an early post-stimulus blink increase in both modalities if a task demanded attention to the input. Only visual input caused a pronounced early increase without a task. In case of a target or the omission of a stimulus (as compared to standard input), an additional late increase in blink rate was found in the auditory and visual domain. This suggests that blink modulation must be based on the interpretation of the input, but does not need any sensory input at all to occur. Our results show a complex modulation of blinking based on top-down factors such as prediction and attention in addition to sensory-based influences. The magnitude of the modulation is mainly influenced by general attentional demands, while the latency of this modulation allows dissociating general from specific top-down influences that are independent of the sensory domain.
Collapse
Affiliation(s)
- Mareike Brych
- Department of Psychology III, University of Wuerzburg, Germany.
| | - Barbara Händel
- Department of Psychology III, University of Wuerzburg, Germany.
| |
Collapse
|
13
|
Niikawa T, Miyahara K, Hamada HT, Nishida S. A new experimental phenomenological method to explore the subjective features of psychological phenomena: its application to binocular rivalry. Neurosci Conscious 2020; 2020:niaa018. [PMID: 33033630 PMCID: PMC7532693 DOI: 10.1093/nc/niaa018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2019] [Revised: 04/20/2020] [Accepted: 06/09/2020] [Indexed: 11/30/2022] Open
Abstract
The subjective features of psychological phenomena have been studied intensively in experimental science in recent years. Although various methods have been proposed to identify subjective features of psychological phenomena, there are elusive subjective features such as the spatiotemporal structure of experience, which are difficult to capture without some additional methodological tools. We propose a new experimental method to address this challenge, which we call the contrast-based experimental phenomenological method (CEP). CEP proceeds in four steps: (i) front-loading phenomenology, (ii) online second-personal interview, (iii) questionnaire survey, and (iv) hypotheses testing. It differs from other experimental phenomenological methods in that it takes advantage of phenomenal contrasts in collecting phenomenological data. In this paper, we verify the validity and productivity of this method by applying it to binocular rivalry (BR). The study contributes to empirical research on BR in three respects. First, it provides additional evidence for existing propositions about the subjective features of BR: e.g. the proposition that the temporal dynamics of the experience depend upon subject-dependent parameters such as attentional change. Second, it deepens our understanding of the spatiotemporal structures of the transition phase of BR. Third, it elicits new research questions about depth experience and individual differences in BR. The presence of such contributions demonstrates the validity and productivity of CEP.
Collapse
Affiliation(s)
- Takuya Niikawa
- Institut Jean Nicod, Ecole normale supérieure, Paris, France
- Faculty of Humanities and Human Sciences, Hokkaido University, Sapporo, Japan
| | - Katsunori Miyahara
- School of Liberal Arts, University of Wollongong, Wollongong, Australia
- Graduate School of Arts and Sciences, University of Tokyo, Tokyo, Japan
| | - Hiro Taiyo Hamada
- Autonomous Agent Team, Araya Inc., Minato-ku, Tokyo, Japan
- Department of Functional Brain Imaging Research, National Institute of Radiological Sciences, National Institutes for Quantum and Radiological Science and Technology, Inage-ku, Chiba, Japan
- Neural Computation Unit, Okinawa Institute of Science and Technology, Onna, Okinawa, Japan
| | - Satoshi Nishida
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Suita, Osaka, Japan
- Graduate School of Frontier Biosciences, Osaka University, Suita, Osaka, Japan
| |
Collapse
|
14
|
Intracranial Recordings Reveal Unique Shape and Timing of Responses in Human Visual Cortex during Illusory Visual Events. Curr Biol 2020; 30:3089-3100.e4. [PMID: 32619489 DOI: 10.1016/j.cub.2020.05.082] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2019] [Revised: 05/01/2020] [Accepted: 05/27/2020] [Indexed: 02/06/2023]
Abstract
During binocular rivalry, perception spontaneously changes without any alteration to the visual stimulus. What neural events bring about this illusion that a constant stimulus is changing? We recorded from intracranial electrodes placed on the occipital and posterior temporal cortex of two patients with epilepsy while they experienced illusory changes of a face-house binocular-rivalry stimulus or observed a control stimulus that physically changed. We performed within-patient comparisons of broadband high-frequency responses, focusing on single epochs recorded along the ventral processing stream. We found transient face- and house-selective responses localized to the same electrodes for illusory and physical changes, but the temporal characteristics of these responses markedly differed. In comparison with physical changes, responses to illusory changes were longer lasting, in particular exhibiting a characteristic slow rise. Furthermore, the temporal order of responses across the visual hierarchy was reversed for illusory as compared to physical changes: for illusory changes, higher order fusiform and parahippocampal regions responded before lower order occipital regions. Our tentative interpretation of these findings is that two stages underlie the initiation of illusory changes: a destabilization stage in which activity associated with the impending change gradually accumulates across the visual hierarchy, ultimately graduating in a top-down cascade of activity that may stabilize the new perceptual interpretation of the stimulus.
Collapse
|
15
|
Kornmeier J, Friedel E, Hecker L, Schmidt S, Wittmann M. What happens in the brain of meditators when perception changes but not the stimulus? PLoS One 2019; 14:e0223843. [PMID: 31647833 PMCID: PMC6812751 DOI: 10.1371/journal.pone.0223843] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Accepted: 09/30/2019] [Indexed: 11/30/2022] Open
Abstract
During the observation of an ambiguous figure our perception alternates between mutually exclusive interpretations, although the stimulus itself remains unchanged. The rate of these endogenous reversals has been discussed as reflecting basic aspects of endogenous brain dynamics. Recent evidence indicates that extensive meditation practice evokes long-term functional and anatomic changes in the brain, also affecting the endogenous brain dynamics. As one of several consequences the rate of perceptual reversals during ambiguous figure perception decreases. In the present study we compared EEG-correlates of endogenous reversals of ambiguous figures between meditators and non-meditating controls in order to better understand timing and brain locations of this altered endogenous brain dynamics. A well-established EEG paradigm was used to measure the neural processes underlying endogenous perceptual reversals of ambiguous figures with high temporal precision. We compared reversal-related ERPs between experienced meditators and non-meditating controls. For both groups we found highly similar chains of reversal-related ERPs, starting early in visual areas, therewith replicating previous findings from the literature. Meditators, however, showed an additional frontal ERP signature already 160 ms after stimulus onset (Frontal Negativity). We interpret the additional, meditation-specific ERP results as evidence that extensive meditation practice provides control of frontal brain areas over early sensory processing steps. This may allow meditators to overcome phylogenetically evolved perceptual and attentional processing automatisms.
Collapse
Affiliation(s)
- Jürgen Kornmeier
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Department of Psychiatry and Psychotherapy, Medical Center, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Evelyn. Friedel
- Department of Psychiatry and Psychotherapy, Medical Center, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Lukas Hecker
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Department of Psychiatry and Psychotherapy, Medical Center, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Eye Center, Medical Center, University of Freiburg, Freiburg, Germany
| | - Stefan Schmidt
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Department of Psychosomatic Medicine and Psychotherapy, Medical Center, University of Freiburg, Freiburg, Germany
| | - Marc Wittmann
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
| |
Collapse
|
16
|
Barnhart AS, Costela FM, Martinez-Conde S, Macknik SL, Goldinger SD. Microsaccades reflect the dynamics of misdirected attention in magic. J Eye Mov Res 2019; 12:10.16910/jemr.12.6.7. [PMID: 33828753 PMCID: PMC7962680 DOI: 10.16910/jemr.12.6.7] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
The methods of magicians provide powerful tools for enhancing the ecological validity of laboratory studies of attention. The current research borrows a technique from magic to explore the relationship between microsaccades and covert attention under near-natural viewing conditions. We monitored participants' eye movements as they viewed a magic trick where a coin placed beneath a napkin vanishes and reappears beneath another napkin. Many participants fail to see the coin move from one location to the other the first time around, thanks to the magician's misdirection. However, previous research was unable to distinguish whether or not participants were fooled based on their eye movements. Here, we set out to determine if microsaccades may provide a window into the efficacy of the magician's misdirection. In a multi-trial setting, participants monitored the location of the coin (which changed positions in half of the trials), while engaging in a delayed match-to-sample task at a different spatial location. Microsaccades onset times varied with task difficulty, and microsaccade directions indexed the locus of covert attention. Our combined results indicate that microsaccades may be a useful metric of covert attentional processes in applied and ecologically valid settings.
Collapse
Affiliation(s)
| | - Francisco M Costela
- Schepens Eye Research Institute, Harvard Medical School, Boston, Massachusetts, USA
| | | | | | | |
Collapse
|
17
|
Liu J, Zhou Y, Tzvetanov T. Globally Normal Bistable Motion Perception of Anisometropic Amblyopes May Profit From an Unusual Coding Mechanism. Front Neurosci 2018; 12:391. [PMID: 29930497 PMCID: PMC5999761 DOI: 10.3389/fnins.2018.00391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2017] [Accepted: 05/22/2018] [Indexed: 11/19/2022] Open
Abstract
Anisometropic amblyopia is a neurodevelopmental disorder of the visual system. There is evidence that the neural deficits spread across visual areas, from the primary cortex up to higher brain areas, including motion coding structures such as MT. Here, we used bistable plaid motion to investigate changes in the underlying mechanisms of motion integration and segmentation and, thus, help us to unravel in more detail deficits in the amblyopic visual motion system. Our results showed that (1) amblyopes globally exhibited normal bistable perception in all viewing conditions compared to the control group and (2) decreased contrast led to a stronger increase in percept switches and decreased percept durations in the control group, while the amblyopic group exhibited no such changes. There were few differences in outcomes dependent upon the use of the weak eye, the strong eye, or both eyes for viewing the stimuli, but this was a general effect present across all subjects, not specific to the amblyopic group. To understand the role of noise and adaptation in such cases of bistable perception, we analyzed predictions from a model and found that contrast does indeed affect percept switches and durations as observed in the control group, in line with the hypothesis that lower stimulus contrast enhances internal noise effects. The combination of experimental and computational results presented here suggests a different motion coding mechanism in the amblyopic visual system, with relatively little effect of stimulus contrast on amblyopes' bistable motion perception.
Collapse
Affiliation(s)
- Jiachen Liu
- Hefei National Laboratory for Physical Sciences at Microscale, School of Life Science, University of Science and Technology of China, Hefei, China
| | - Yifeng Zhou
- Hefei National Laboratory for Physical Sciences at Microscale, School of Life Science, University of Science and Technology of China, Hefei, China.,State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Science, Beijing, China
| | - Tzvetomir Tzvetanov
- Hefei National Laboratory for Physical Sciences at Microscale, School of Life Science, University of Science and Technology of China, Hefei, China.,Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine and School of Computer and Information, Hefei University of Technology, Hefei, China
| |
Collapse
|
18
|
Cao T, Wang L, Sun Z, Engel SA, He S. The Independent and Shared Mechanisms of Intrinsic Brain Dynamics: Insights From Bistable Perception. Front Psychol 2018; 9:589. [PMID: 29740374 PMCID: PMC5928422 DOI: 10.3389/fpsyg.2018.00589] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2017] [Accepted: 04/06/2018] [Indexed: 11/23/2022] Open
Abstract
In bistable perception, constant input leads to alternating perception. The dynamics of the changing perception reflects the intrinsic dynamic properties of the “unconscious inferential” process in the brain. Under the same condition, individuals differ in how fast they experience the perceptual alternation. In this study, testing many forms of bistable perception in a large number of observers, we investigated the key question of whether there is a general and common mechanism or multiple and independent mechanisms that control the dynamics of the inferential brain. Bistable phenomena tested include binocular rivalry, vase-face, Necker cube, moving plaid, motion induced blindness, biological motion, spinning dancer, rotating cylinder, Lissajous-figure, rolling wheel, and translating diamond. Switching dynamics for each bistable percept was measured in 100 observers. Results show that the switching rates of subsets of bistable percept are highly correlated. The clustering of dynamic properties of some bistable phenomena but not an overall general control of switching dynamics implies that the brain’s inferential processes are both shared and independent – faster in constructing 3D structure from motion does not mean faster in integrating components into an objects.
Collapse
Affiliation(s)
- Teng Cao
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China.,College of Life Sciences, University of Chinese Academy of Sciences, Beijing, China
| | - Lan Wang
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
| | - Zhouyuan Sun
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China.,College of Life Sciences, University of Chinese Academy of Sciences, Beijing, China
| | - Stephen A Engel
- Department of Psychology, University of Minnesota, Minneapolis, MN, United States
| | - Sheng He
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of Minnesota, Minneapolis, MN, United States
| |
Collapse
|
19
|
Out of sight, out of mind: Occlusion and eye closure destabilize moving bistable structure-from-motion displays. Atten Percept Psychophys 2018; 80:1193-1204. [PMID: 29560607 DOI: 10.3758/s13414-018-1505-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Our brain constantly tries to anticipate the future by using a variety of memory mechanisms. Interestingly, studies using the intermittent presentation of multistable displays have shown little perceptual persistence for interruptions longer than a few hundred milliseconds. Here we examined whether we can facilitate the perceptual stability of bistable displays following a period of invisibility by employing a physically plausible and ecologically valid occlusion event sequence, as opposed to the typical intermittent presentation, with sudden onsets and offsets. To this end, we presented a bistable rotating structure-from-motion display that was moving along a linear horizontal trajectory on the screen and either was temporarily occluded by another object (a cardboard strip in Exp. 1, a computer-generated image in Exp. 2) or became invisible due to eye closure (Exp. 3). We report that a bistable rotation direction reliably persisted following occlusion or interruption only (1) if the pre- and postinterruption locations overlapped spatially (an occluder with apertures in Exp. 2 or brief, spontaneous blinks in Exp. 3) or (2) if an object's size allowed for the efficient grouping of dots on both sides of the occluding object (large objects in Exp. 1). In contrast, we observed no persistence whenever the pre- and postinterruption locations were nonoverlapping (large solid occluding objects in Exps. 1 and 2 and long, prompted blinks in Exp. 3). We report that the bistable rotation direction of a moving object persisted only for spatially overlapping neural representations, and that persistence was not facilitated by a physically plausible and ecologically valid occlusion event.
Collapse
|
20
|
Intracranial Recordings of Occipital Cortex Responses to Illusory Visual Events. J Neurosci 2017; 36:6297-311. [PMID: 27277806 DOI: 10.1523/jneurosci.0242-15.2016] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2015] [Accepted: 05/05/2016] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED Ambiguous visual stimuli elicit different perceptual interpretations over time, creating the illusion that a constant stimulus is changing. We investigate whether such spontaneous changes in visual perception involve occipital brain regions specialized for processing visual information, despite the absence of concomitant changes in stimulation. Spontaneous perceptual changes observed while viewing a binocular rivalry stimulus or an ambiguous structure-from-motion stimulus were compared with stimulus-induced perceptual changes that occurred in response to an actual stimulus change. Intracranial recordings from human occipital cortex revealed that spontaneous and stimulus-induced perceptual changes were both associated with an early transient increase in high-frequency power that was more spatially confined than a later transient decrease in low-frequency power. We suggest that the observed high-frequency and low-frequency modulations relate to initiation and maintenance of a percept, respectively. Our results are compatible with the idea that spontaneous changes in perception originate from competitive interactions within visual neural networks. SIGNIFICANCE STATEMENT Ambiguous visual stimuli elicit different perceptual interpretations over time, creating the illusion that a constant stimulus is changing. The literature on the neural correlates of conscious visual perception remains inconclusive regarding the extent to which such spontaneous changes in perception involve sensory brain regions. In an attempt to bridge the gap between existing animal and human studies, we recorded from intracranial electrodes placed on the human occipital lobe. We compared two different kinds of ambiguous stimuli, binocular rivalry and the phenomenon of ambiguous structure-from-motion, enabling generalization of our findings across different stimuli. Our results indicate that spontaneous and stimulus-induced changes in perception (i.e., "illusory" and "real" changes in the stimulus, respectively) may involve sensory regions to a similar extent.
Collapse
|
21
|
Chen Z, Maus GW, Whitney D, Denison RN. Filling-in rivalry: Perceptual alternations in the absence of retinal image conflict. J Vis 2017; 17:8. [PMID: 28114480 PMCID: PMC5256469 DOI: 10.1167/17.1.8] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2016] [Accepted: 11/28/2016] [Indexed: 11/24/2022] Open
Abstract
During perceptual rivalry, an observer's perceptual experience alternates over time despite constant sensory stimulation. Perceptual alternations are thought to be driven by conflicting or ambiguous retinal image features at a particular spatial location and modulated by global context from surrounding locations. However, rivalry can also occur between two illusory stimuli-such as two filled-in stimuli within the retinal blind spot. In this "filling-in rivalry," what observers perceive in the blind spot changes in the absence of local stimulation. It remains unclear if filling-in rivalry shares common mechanisms with other types of rivalry. We measured the dynamics of rivalry between filled-in percepts in the blind spot, finding a high degree of exclusivity (perceptual dominance of one filled-in percept, rather than a perception of transparency), alternation rates that were highly consistent for individual observers, and dynamics that closely resembled other forms of perceptual rivalry. The results suggest that mechanisms common to a wide range of rivalry situations need not rely on conflicting retinal image signals.
Collapse
Affiliation(s)
- Zhimin Chen
- Department of Psychology, University of California Berkeley, Berkeley, CA, USADepartment of Psychology, Peking University, Beijing, P. R. China
| | - Gerrit W Maus
- Department of Psychology, University of California Berkeley, Berkeley, CA, USADivision of Psychology, School of Humanities and Social Sciences, Nanyang Technological University, Singapore
| | - David Whitney
- Department of Psychology, University of California Berkeley, Berkeley, CA, USA
| | - Rachel N Denison
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
22
|
Marx S, Gruenhage G, Walper D, Rutishauser U, Einhäuser W. Competition with and without priority control: linking rivalry to attention through winner-take-all networks with memory. Ann N Y Acad Sci 2015; 1339:138-53. [PMID: 25581077 PMCID: PMC4376592 DOI: 10.1111/nyas.12575] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Competition is ubiquitous in perception. For example, items in the visual field compete for processing resources, and attention controls their priority (biased competition). The inevitable ambiguity in the interpretation of sensory signals yields another form of competition: distinct perceptual interpretations compete for access to awareness. Rivalry, where two equally likely percepts compete for dominance, explicates the latter form of competition. Building upon the similarity between attention and rivalry, we propose to model rivalry by a generic competitive circuit that is widely used in the attention literature-a winner-take-all (WTA) network. Specifically, we show that a network of two coupled WTA circuits replicates three common hallmarks of rivalry: the distribution of dominance durations, their dependence on input strength ("Levelt's propositions"), and the effects of stimulus removal (blanking). This model introduces a form of memory by forming discrete states and explains experimental data better than competitive models of rivalry without memory. This result supports the crucial role of memory in rivalry specifically and in competitive processes in general. Our approach unifies the seemingly distinct phenomena of rivalry, memory, and attention in a single model with competition as the common underlying principle.
Collapse
Affiliation(s)
- Svenja Marx
- Neurophysics, Philipp-University of MarburgMarburg, Germany
| | - Gina Gruenhage
- Bernstein Center for Computational NeurosciencesBerlin, Germany
| | - Daniel Walper
- Neurophysics, Philipp-University of MarburgMarburg, Germany
| | - Ueli Rutishauser
- Department of Neurosurgery, Cedars-Sinai Medical CenterLos Angeles, California
- Division of Biology and Biological Engineering, California Institute of TechnologyPasadena, California
| | | |
Collapse
|
23
|
Otero-Millan J, Macknik SL, Martinez-Conde S. Fixational eye movements and binocular vision. Front Integr Neurosci 2014; 8:52. [PMID: 25071480 PMCID: PMC4083562 DOI: 10.3389/fnint.2014.00052] [Citation(s) in RCA: 47] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2014] [Accepted: 06/03/2014] [Indexed: 11/13/2022] Open
Abstract
During attempted visual fixation, small involuntary eye movements-called fixational eye movements-continuously change of our gaze's position. Disagreement between the left and right eye positions during such motions can produce diplopia (double vision). Thus, the ability to properly coordinate the two eyes during gaze fixation is critical for stable perception. For the last 50 years, researchers have studied the binocular characteristics of fixational eye movements. Here we review classical and recent studies on the binocular coordination (i.e., degree of conjugacy) of each fixational eye movement type: microsaccades, drift and tremor, and its perceptual contribution to increasing or reducing binocular disparity. We also discuss how amblyopia and other visual pathologies affect the binocular coordination of fixational eye movements.
Collapse
Affiliation(s)
- Jorge Otero-Millan
- Department of Neurobiology, Barrow Neurological Institute Phoenix, AZ, USA ; Department of Neurology, Johns Hopkins University Baltimore, MD, USA
| | - Stephen L Macknik
- Department of Neurobiology, Barrow Neurological Institute Phoenix, AZ, USA ; Department of Neurosurgery, Barrow Neurological Institute Phoenix, AZ, USA
| | | |
Collapse
|
24
|
Abstract
Delusions are unfounded yet tenacious beliefs and a symptom of psychotic disorder. Varying degrees of delusional ideation are also found in the healthy population. Here, we empirically validated a neurocognitive model that explains both the formation and the persistence of delusional beliefs in terms of altered perceptual inference. In a combined behavioral and functional neuroimaging study in healthy participants, we used ambiguous visual stimulation to probe the relationship between delusion-proneness and the effect of learned predictions on perception. Delusional ideation was associated with less perceptual stability, but a stronger belief-induced bias on perception, paralleled by enhanced functional connectivity between frontal areas that encoded beliefs and sensory areas that encoded perception. These findings suggest that weakened lower-level predictions that result in perceptual instability are implicated in the emergence of delusional beliefs. In contrast, stronger higher-level predictions that sculpt perception into conformity with beliefs might contribute to the tenacious persistence of delusional beliefs.
Collapse
|
25
|
Kalisvaart JP, Goossens J. Influence of retinal image shifts and extra-retinal eye movement signals on binocular rivalry alternations. PLoS One 2013; 8:e61702. [PMID: 23593494 PMCID: PMC3625164 DOI: 10.1371/journal.pone.0061702] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2012] [Accepted: 03/14/2013] [Indexed: 11/27/2022] Open
Abstract
Previous studies have indicated that saccadic eye movements correlate positively with perceptual alternations in binocular rivalry, presumably because the foveal image changes resulting from saccades, rather than the eye movement themselves, cause switches in awareness. Recently, however, we found evidence that retinal image shifts elicit so-called onset rivalry and not percept switches as such. These findings raise the interesting question whether onset rivalry may account for correlations between saccades and percept switches. We therefore studied binocular rivalry when subjects made eye movements across a visual stimulus and compared it with the rivalry in a ‘replay’ condition in which subjects maintained fixation while the same retinal displacements were reproduced by stimulus displacements on the screen. We used dichoptic random-dot motion stimuli viewed through a stereoscope, and measured eye and eyelid movements with scleral search-coils. Positive correlations between retinal image shifts and perceptual switches were observed for both saccades and stimulus jumps, but only for switches towards the subjects' preferred eye at stimulus onset. A similar asymmetry was observed for blink-induced stimulus interruptions. Moreover, for saccades, amplitude appeared crucial as the positive correlation persisted for small stimulus jumps, but not for small saccades (amplitudes < 1°). These findings corroborate our tenet that saccades elicit a form of onset rivalry, and that rivalry is modulated by extra-retinal eye movement signals.
Collapse
Affiliation(s)
- Joke P. Kalisvaart
- Radboud University Nijmegen Medical Centre, Donders Institute for Brain, Cognition and Behaviour, Dept. Cognitive Neuroscience, section Biophysics, Nijmegen, The Netherlands
| | - Jeroen Goossens
- Radboud University Nijmegen Medical Centre, Donders Institute for Brain, Cognition and Behaviour, Dept. Cognitive Neuroscience, section Biophysics, Nijmegen, The Netherlands
- * E-mail:
| |
Collapse
|
26
|
Ross NM, Kowler E. Eye movements while viewing narrated, captioned, and silent videos. J Vis 2013; 13:1. [PMID: 23457357 DOI: 10.1167/13.4.1] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Videos are often accompanied by narration delivered either by an audio stream or by captions, yet little is known about saccadic patterns while viewing narrated video displays. Eye movements were recorded while viewing video clips with (a) audio narration, (b) captions, (c) no narration, or (d) concurrent captions and audio. A surprisingly large proportion of time (>40%) was spent reading captions even in the presence of a redundant audio stream. Redundant audio did not affect the saccadic reading patterns but did lead to skipping of some portions of the captions and to delays of saccades made into the caption region. In the absence of captions, fixations were drawn to regions with a high density of information, such as the central region of the display, and to regions with high levels of temporal change (actions and events), regardless of the presence of narration. The strong attraction to captions, with or without redundant audio, raises the question of what determines how time is apportioned between captions and video regions so as to minimize information loss. The strategies of apportioning time may be based on several factors, including the inherent attraction of the line of sight to any available text, the moment by moment impressions of the relative importance of the information in the caption and the video, and the drive to integrate visual text accompanied by audio into a single narrative stream.
Collapse
Affiliation(s)
- Nicholas M Ross
- Department of Psychology, Rutgers University, Piscataway, NJ, USA.
| | | |
Collapse
|
27
|
Abstract
Some aspects of attentional processing are known to decline with normal aging. To understand how age affects the attentional control of perceptual stability, we investigated age-related changes in voluntarily controlled perceptual rivalry. Durations of the dominant percept, produced by an ambiguous Rubin vase-faces figure, were measured in conditions that required passive viewing and attentional control: holding and switching the dominant percept. During passive viewing, mean dominance duration in the older group was significantly longer (63%) than the dominance duration found in the young group. This age-related deficit could be due to a decline in the apparent strength of the alternating percepts as a result of higher contrast gain of visual cortical activity and a reduction in the amount of attentional resources allocated to the ambiguous stimulus in older people compared to young adults. In comparison to passive viewing, holding the dominant percept did not significantly alter the dominance durations in the older group, while the dominance durations in the young group were increased (∼100%). The dominance durations for both age groups in switch conditions were reduced compared to their passive viewing durations (∼40%). The inability of older people to voluntarily prolong the duration of the dominant percept suggests that they may have abnormal attentional mechanisms, which are inefficient at enhancing the effective strength of the dominant percept. Results suggest that older adults have difficulty holding attended visual objects in focus, a problem that could affect their ability to carry out everyday tasks.
Collapse
Affiliation(s)
- Senay Aydin
- Department of Vision & Hearing Sciences, Anglia Ruskin University, Cambridge, UK
| | | | | |
Collapse
|
28
|
Otero-Millan J, Macknik SL, Martinez-Conde S. Microsaccades and blinks trigger illusory rotation in the "rotating snakes" illusion. J Neurosci 2012; 32:6043-51. [PMID: 22539864 PMCID: PMC6703624 DOI: 10.1523/jneurosci.5823-11.2012] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2011] [Revised: 02/14/2012] [Accepted: 03/07/2012] [Indexed: 11/21/2022] Open
Abstract
Certain repetitive arrangements of luminance gradients elicit the perception of strong illusory motion. Among them, the "Rotating Snakes Illusion" has generated a large amount of interest in the visual neurosciences, as well as in the public. Prior evidence indicates that the Rotating Snakes illusion depends critically on eye movements, yet the specific eye movement types involved and their associated neural mechanisms remain controversial. According to recent reports, slow ocular drift--a nonsaccadic type of fixational eye movement--drives the illusion, whereas microsaccades produced during attempted fixation fail to do so. Here, we asked human subjects to indicate the presence or absence of rotation during the observation of the illusion while we simultaneously recorded their eye movements with high precision. We found a strong quantitative link between microsaccade and blink production and illusory rotation. These results suggest that transient oculomotor events such as microsaccades, saccades, and blinks, rather than continuous drift, act to trigger the illusory motion in the Rotating Snakes illusion.
Collapse
Affiliation(s)
- Jorge Otero-Millan
- Barrow Neurological Institute, Phoenix, Arizona 85013, and
- University of Vigo, 36310 Vigo, Spain
| | | | | |
Collapse
|
29
|
Sherman A, Papathomas TV, Jain A, Keane BP. The Role of Stereopsis, Motion Parallax, Perspective and Angle Polarity in Perceiving 3-D Shape. ACTA ACUST UNITED AC 2012; 25:263-85. [DOI: 10.1163/187847511x576802] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
30
|
Arnold DH. Why is Binocular Rivalry Uncommon? Discrepant Monocular Images in the Real World. Front Hum Neurosci 2011; 5:116. [PMID: 22028689 PMCID: PMC3199540 DOI: 10.3389/fnhum.2011.00116] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2011] [Accepted: 09/28/2011] [Indexed: 11/13/2022] Open
Abstract
When different images project to corresponding points in the two eyes they can instigate a phenomenon called binocular rivalry (BR), wherein each image seems to intermittently disappear such that only one of the two images is seen at a time. Cautious readers may have noted an important caveat in the opening sentence – this situation can instigate BR, but usually it doesn’t. Unmatched monocular images are frequently encountered in daily life due to either differential occlusions of the two eyes or because of selective obstructions of just one eye, but this does not tend to induce BR. Here I will explore the reasons for this and discuss implications for BR in general. It will be argued that BR is resolved in favor of the instantaneously stronger neural signal, and that this process is driven by an adaptation that enhances the visibility of distant fixated objects over that of more proximate obstructions of an eye. Accordingly, BR would reflect the dynamics of an inherently visual operation that usually deals with real-world constraints.
Collapse
Affiliation(s)
- Derek Henry Arnold
- School of Psychology, The University of Queensland St Lucia, QLD, Australia
| |
Collapse
|
31
|
Abstract
When sensory input allows for multiple, competing perceptual interpretations, observers' perception can fluctuate over time, which is called bistable perception. Imaging studies in humans have revealed transient responses in a right-lateralized network in the frontal-parietal cortex (rFPC) around the time of perceptual transitions between interpretations, potentially reflecting the neural initiation of transitions. We investigated the role of this activity in male human observers, with specific interest in its relation to the temporal structure of transitions, which can be either instantaneous or prolonged by periods during which observers experience a mix of both perceptual interpretations. Using both bistable apparent motion and binocular rivalry, we show that transition-related rFPC activity is larger for transitions that last longer, suggesting that rFPC remains active as long as a transition lasts. We also replicate earlier findings that rFPC activity during binocular rivalry transitions exceeds activity during yoked transitions that are simulated using video replay. However, we show that this established finding holds only when perceptual transitions are replayed as instantaneous events. When replay, instead, depicts transitions with the actual durations reported during rivalry, yoked transitions and genuine rivalry transitions elicit equal activity. Together, our results are consistent with the view that at least a component of rFPC activation during bistable perception reflects a response to perceptual transitions, both real and yoked, rather than their cause. This component of activity could reflect the change in sensory experience and task demand that occurs during transitions, which fits well with the known role of these areas in attention and decision making.
Collapse
|
32
|
Kowler E. Eye movements: the past 25 years. Vision Res 2011; 51:1457-83. [PMID: 21237189 PMCID: PMC3094591 DOI: 10.1016/j.visres.2010.12.014] [Citation(s) in RCA: 289] [Impact Index Per Article: 22.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2010] [Revised: 11/29/2010] [Accepted: 12/27/2010] [Indexed: 11/30/2022]
Abstract
This article reviews the past 25 years of research on eye movements (1986-2011). Emphasis is on three oculomotor behaviors: gaze control, smooth pursuit and saccades, and on their interactions with vision. Focus over the past 25 years has remained on the fundamental and classical questions: What are the mechanisms that keep gaze stable with either stationary or moving targets? How does the motion of the image on the retina affect vision? Where do we look - and why - when performing a complex task? How can the world appear clear and stable despite continual movements of the eyes? The past 25 years of investigation of these questions has seen progress and transformations at all levels due to new approaches (behavioral, neural and theoretical) aimed at studying how eye movements cope with real-world visual and cognitive demands. The work has led to a better understanding of how prediction, learning and attention work with sensory signals to contribute to the effective operation of eye movements in visually rich environments.
Collapse
Affiliation(s)
- Eileen Kowler
- Department of Psychology, Rutgers University, Piscataway, NJ 08854, United States.
| |
Collapse
|
33
|
Naber M, Frässle S, Einhäuser W. Perceptual rivalry: reflexes reveal the gradual nature of visual awareness. PLoS One 2011; 6:e20910. [PMID: 21677786 PMCID: PMC3109001 DOI: 10.1371/journal.pone.0020910] [Citation(s) in RCA: 87] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2011] [Accepted: 05/16/2011] [Indexed: 11/19/2022] Open
Abstract
Rivalry is a common tool to probe visual awareness: a constant physical stimulus evokes multiple, distinct perceptual interpretations ("percepts") that alternate over time. Percepts are typically described as mutually exclusive, suggesting that a discrete (all-or-none) process underlies changes in visual awareness. Here we follow two strategies to address whether rivalry is an all-or-none process: first, we introduce two reflexes as objective measures of rivalry, pupil dilation and optokinetic nystagmus (OKN); second, we use a continuous input device (analog joystick) to allow observers a gradual subjective report. We find that the "reflexes" reflect the percept rather than the physical stimulus. Both reflexes show a gradual dependence on the time relative to perceptual transitions. Similarly, observers' joystick deflections, which are highly correlated with the reflex measures, indicate gradual transitions. Physically simulating wave-like transitions between percepts suggest piece-meal rivalry (i.e., different regions of space belonging to distinct percepts) as one possible explanation for the gradual transitions. Furthermore, the reflexes show that dominance durations depend on whether or not the percept is actively reported. In addition, reflexes respond to transitions with shorter latencies than the subjective report and show an abundance of short dominance durations. This failure to report fast changes in dominance may result from limited access of introspection to rivalry dynamics. In sum, reflexes reveal that rivalry is a gradual process, rivalry's dynamics is modulated by the required action (response mode), and that rapid transitions in perceptual dominance can slip away from awareness.
Collapse
Affiliation(s)
- Marnix Naber
- Department of Neurophysics, Philipps-University Marburg, Marburg, Germany.
| | | | | |
Collapse
|
34
|
Beets IAM, 't Hart BM, Rösler F, Henriques DYP, Einhäuser W, Fiehler K. Online action-to-perception transfer: only percept-dependent action affects perception. Vision Res 2010; 50:2633-41. [PMID: 20934444 DOI: 10.1016/j.visres.2010.10.004] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2010] [Revised: 09/03/2010] [Accepted: 10/04/2010] [Indexed: 10/19/2022]
Abstract
Perception self-evidently affects action, but under which conditions does action in turn influence perception? To answer this question we ask observers to view an ambiguous stimulus that is alternatingly perceived as rotating clockwise or counterclockwise. When observers report the perceived direction by rotating a manipulandum, opposing directions between report and percept ('incongruent') destabilize the percept, whereas equal directions ('congruent') stabilize it. In contrast, when observers report their percept by key presses while performing a predefined movement, we find no effect of congruency. Consequently, our findings suggest that only percept-dependent action directly influences perceptual experience.
Collapse
Affiliation(s)
- I A M Beets
- Experimental and Biological Psychology, Philipps-University Marburg, Germany.
| | | | | | | | | | | |
Collapse
|
35
|
Baker DH, Graf EW. Extrinsic factors in the perception of bistable motion stimuli. Vision Res 2010; 50:1257-65. [PMID: 20433864 DOI: 10.1016/j.visres.2010.04.016] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2009] [Revised: 04/09/2010] [Accepted: 04/09/2010] [Indexed: 11/26/2022]
Abstract
When viewing a drifting plaid stimulus, perceived motion alternates over time between coherent pattern motion and a transparent impression of the two component gratings. It is known that changing the intrinsic attributes of such patterns (e.g. speed, orientation and spatial frequency of components) can influence percept predominance. Here, we investigate the contribution of extrinsic factors to perception; specifically contextual motion and eye movements. In the first experiment, the percept most similar to the speed and direction of surround motion increased in dominance, implying a tuned integration process. This shift primarily involved an increase in dominance durations of the consistent percept. The second experiment measured eye movements under similar conditions. Saccades were not associated with perceptual transitions, though blink rate increased around the time of a switch. This indicates that saccades do not cause switches, yet saccades in a congruent direction might help to prolong a percept because (i) more saccades were directionally congruent with the currently reported percept than expected by chance, and (ii) when observers were asked to make deliberate eye movements along one motion axis, this increased percept reports in that direction. Overall, we find evidence that perception of bistable motion can be modulated by information from spatially adjacent regions, and changes to the retinal image caused by blinks and saccades.
Collapse
Affiliation(s)
- Daniel H Baker
- School of Psychology, University of Southampton, Highfield, Southampton SO171BJ, UK.
| | | |
Collapse
|
36
|
Tri-stable stimuli reveal interactions among subsequent percepts: Rivalry is biased by perceptual history. Vision Res 2010; 50:818-28. [PMID: 20156475 DOI: 10.1016/j.visres.2010.02.004] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2009] [Revised: 01/26/2010] [Accepted: 02/08/2010] [Indexed: 11/21/2022]
|
37
|
van Ee R. Stochastic variations in sensory awareness are driven by noisy neuronal adaptation: evidence from serial correlations in perceptual bistability. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2009; 26:2612-2622. [PMID: 19956332 DOI: 10.1364/josaa.26.002612] [Citation(s) in RCA: 70] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
When the sensory system is subjected to ambiguous input, perception alternates between interpretations in a seemingly random fashion. Although neuronal noise obviously plays a role, the neural mechanism for the generation of randomness at the slow time scale of the percept durations (multiple seconds) is unresolved. Here significant nonzero serial correlations are reported in series of visual percept durations (to the author's knowledge for the first time accounting for duration impurities caused by reaction time, drift, and incomplete percepts). Serial correlations for perceptual rivalry using structure-from-motion ambiguity were smaller than for binocular rivalry using orthogonal gratings. A spectrum of computational models is considered, and it is concluded that noise in adaptation of percept-related neurons causes the serial correlations. This work bridges, in a physiologically plausible way, widely appreciated deterministic modeling and randomness in experimental observations of visual rivalry.
Collapse
Affiliation(s)
- Raymond van Ee
- Helmholtz Institute Physics of Man, Utrecht University, PaduaLaan 8, 3584 CH, Utrecht, The Netherlands.
| |
Collapse
|
38
|
Martinez-Conde S, Macknik SL, Troncoso XG, Hubel DH. Microsaccades: a neurophysiological analysis. Trends Neurosci 2009; 32:463-75. [PMID: 19716186 DOI: 10.1016/j.tins.2009.05.006] [Citation(s) in RCA: 228] [Impact Index Per Article: 15.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2009] [Revised: 05/26/2009] [Accepted: 05/27/2009] [Indexed: 11/16/2022]
Abstract
Microsaccades are the largest and fastest of the fixational eye movements, which are involuntary eye movements produced during attempted visual fixation. In recent years, the interaction between microsaccades, perception and cognition has become one of the most rapidly growing areas of study in visual neuroscience. The neurophysiological consequences of microsaccades have been the focus of less attention, however, as have the oculomotor mechanisms that generate and control microsaccades. Here we review the latest neurophysiological findings concerning microsaccades and discuss their relationships to perception and cognition. We also point out the current gaps in our understanding of the neurobiology of microsaccades and identify the most promising lines of enquiry.
Collapse
|
39
|
Rolfs M. Microsaccades: small steps on a long way. Vision Res 2009; 49:2415-41. [PMID: 19683016 DOI: 10.1016/j.visres.2009.08.010] [Citation(s) in RCA: 277] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2009] [Revised: 08/03/2009] [Accepted: 08/07/2009] [Indexed: 12/01/2022]
Abstract
Contrary to common wisdom, fixations are a dynamically rich behavior, composed of continual, miniature eye movements, of which microsaccades are the most salient component. Over the last few years, interest in these small movements has risen dramatically, driven by both neurophysiological and psychophysical results and by advances in techniques, analysis, and modeling of eye movements. The field has a long history but a significant portion of the earlier work has gone missing in the current literature, in part, as a result of the collapse of the field in the 1980s that followed a series of discouraging results. The present review compiles 60 years of work demonstrating the unique contribution of microsaccades to visual and oculomotor function. Specifically, the review covers the contribution of microsaccades to (1) the control of fixation position, (2) the reduction of perceptual fading and the continuity of perception, (3) the generation of synchronized visual transients, (4) visual acuity, (5) scanning of small spatial regions, (6) shifts of spatial attention, (7) resolving perceptual ambiguities in the face of multistable perception, as well as several other functions. The accumulated evidence demonstrates that microsaccades serve both perceptual and oculomotor goals and although in some cases their contribution is neither necessary nor unique, microsaccades are a malleable tool conveniently employed by the visual system.
Collapse
Affiliation(s)
- Martin Rolfs
- Université Paris Descartes, Laboratoire Psychologie de la Perception, 75006 Paris, France.
| |
Collapse
|
40
|
Brouwer GJ, Tong F, Hagoort P, van Ee R. Perceptual incongruence influences bistability and cortical activation. PLoS One 2009; 4:e5056. [PMID: 19333385 PMCID: PMC2659433 DOI: 10.1371/journal.pone.0005056] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2008] [Accepted: 02/25/2009] [Indexed: 11/19/2022] Open
Abstract
We employed a parametric psychophysical design in combination with functional imaging to examine the influence of metric changes in perceptual incongruence on perceptual alternation rates and cortical responses. Subjects viewed a bistable stimulus defined by incongruent depth cues; bistability resulted from incongruence between binocular disparity and monocular perspective cues that specify different slants (slant rivalry). Psychophysical results revealed that perceptual alternation rates were positively correlated with the degree of perceived incongruence. Functional imaging revealed systematic increases in activity that paralleled the psychophysical results within anterior intraparietal sulcus, prior to the onset of perceptual alternations. We suggest that this cortical activity predicts the frequency of subsequent alternations, implying a putative causal role for these areas in initiating bistable perception. In contrast, areas implicated in form and depth processing (LOC and V3A) were sensitive to the degree of slant, but failed to show increases in activity when these cues were in conflict.
Collapse
Affiliation(s)
- Gijs Joost Brouwer
- Department of Physics, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands.
| | | | | | | |
Collapse
|
41
|
Bonfiglio L, Sello S, Andre P, Carboncini MC, Arrighi P, Rossi B. Blink-related delta oscillations in the resting-state EEG: A wavelet analysis. Neurosci Lett 2009; 449:57-60. [DOI: 10.1016/j.neulet.2008.10.039] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2008] [Revised: 10/02/2008] [Accepted: 10/02/2008] [Indexed: 10/21/2022]
|
42
|
Abstract
Visual images consisting of repetitive patterns can elicit striking illusory motion percepts. For almost 200 years, artists, psychologists, and neuroscientists have debated whether this type of illusion originates in the eye or in the brain. For more than a decade, the controversy has centered on the powerful illusory motion perceived in the painting Enigma, created by op-artist Isia Leviant. However, no previous study has directly correlated the Enigma illusion to any specific physiological mechanism, and so the debate rages on. Here, we show that microsaccades, a type of miniature eye movement produced during visual fixation, can drive illusory motion in Enigma. We asked subjects to indicate when illusory motion sped up or slowed down during the observation of Enigma while we simultaneously recorded their eye movements with high precision. Before "faster" motion periods, the rate of microsaccades increased. Before "slower/no" motion periods, the rate of microsaccades decreased. These results reveal a direct link between microsaccade production and the perception of illusory motion in Enigma and rule out the hypothesis that the origin of the illusion is purely cortical.
Collapse
|
43
|
Klink PC, van Ee R, Nijs MM, Brouwer GJ, Noest AJ, van Wezel RJA. Early interactions between neuronal adaptation and voluntary control determine perceptual choices in bistable vision. J Vis 2008; 8:16.1-18. [PMID: 18842087 DOI: 10.1167/8.5.16] [Citation(s) in RCA: 67] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2007] [Accepted: 03/13/2008] [Indexed: 11/24/2022] Open
Abstract
At the onset of bistable stimuli, the brain needs to choose which of the competing perceptual interpretations will first reach awareness. Stimulus manipulations and cognitive control both influence this choice process, but the underlying mechanisms and interactions remain poorly understood. Using intermittent presentation of bistable visual stimuli, we demonstrate that short interruptions cause perceptual reversals upon the next presentation, whereas longer interstimulus intervals stabilize the percept. Top-down voluntary control biases this process but does not override the timing dependencies. Extending a recently introduced low-level neural model, we demonstrate that percept-choice dynamics in bistable vision can be fully understood with interactions in early neural processing stages. Our model includes adaptive neural processing preceding a rivalry resolution stage with cross-inhibition, adaptation, and an interaction of the adaptation levels with a neural baseline. Most importantly, our findings suggest that top-down attentional control over bistable stimuli interacts with low-level mechanisms at early levels of sensory processing before perceptual conflicts are resolved and perceptual choices about bistable stimuli are made.
Collapse
Affiliation(s)
- P C Klink
- Functional Neurobiology and Helmholtz Institute, Utrecht University, Utrecht, The Netherlands.
| | | | | | | | | | | |
Collapse
|
44
|
Arnold DH, Law P, Wallis TSA. Binocular switch suppression: a new method for persistently rendering the visible 'invisible'. Vision Res 2008; 48:994-1001. [PMID: 18329066 DOI: 10.1016/j.visres.2008.01.020] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2007] [Revised: 01/15/2008] [Accepted: 01/18/2008] [Indexed: 11/17/2022]
Abstract
Rendering the usually visible 'invisible' has long been a popular experimental manipulation. With one notable exception, 'continuous flash suppression' [Tsuchiya, N., & Koch, C. (2005). Continuous flash suppression reduces negative afterimages. Nature Neuroscience, 8, 1096-1101], existing methods of achieving this goal suffer from being either unable to suppress stimuli from awareness for prolonged periods, from being unable to reliably suppress stimuli at specific epochs, or from a combination of both of these limitations. Here we report a new method, binocular switch suppression (BSS), which overcomes these restrictions. We establish that BSS is novel as it taps a different causal mechanism to the only similar pre-existing method. We also establish that BSS is superior to pre-existing methods both in terms of the depth and duration of perceptual suppression achieved. BSS should therefore prove to be a useful tool for the large number of researchers interested in exploring the neural correlates and functional consequences of conscious visual awareness.
Collapse
Affiliation(s)
- Derek H Arnold
- School of Psychology, The University of Queensland, St. Lucia, Qld 4072, Australia.
| | | | | |
Collapse
|
45
|
Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry. Proc Natl Acad Sci U S A 2008; 105:1704-9. [PMID: 18250340 DOI: 10.1073/pnas.0707727105] [Citation(s) in RCA: 220] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
During sustained viewing of an ambiguous stimulus, an individual's perceptual experience will generally switch between the different possible alternatives rather than stay fixed on one interpretation (perceptual rivalry). Here, we measured pupil diameter while subjects viewed different ambiguous visual and auditory stimuli. For all stimuli tested, pupil diameter increased just before the reported perceptual switch and the relative amount of dilation before this switch was a significant predictor of the subsequent duration of perceptual stability. These results could not be explained by blink or eye-movement effects, the motor response or stimulus driven changes in retinal input. Because pupil dilation reflects levels of norepinephrine (NE) released from the locus coeruleus (LC), we interpret these results as suggestive that the LC-NE complex may play the same role in perceptual selection as in behavioral decision making.
Collapse
|
46
|
Brouwer GJ, van Ee R. Visual cortex allows prediction of perceptual states during ambiguous structure-from-motion. J Neurosci 2007; 27:1015-23. [PMID: 17267555 PMCID: PMC6673188 DOI: 10.1523/jneurosci.4593-06.2007] [Citation(s) in RCA: 58] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
We investigated the role of retinotopic visual cortex and motion-sensitive areas in representing the content of visual awareness during ambiguous structure-from-motion (SFM), using functional magnetic resonance imaging (fMRI) and multivariate statistics (support vector machines). Our results indicate that prediction of perceptual states can be very accurate for data taken from dorsal visual areas V3A, V4D, V7, and MT+ and for parietal areas responsive to SFM, but to a lesser extent for other visual areas. Generalization of prediction was possible, because prediction accuracy was significantly better than chance for both an unambiguous stimulus and a different experimental design. Detailed analysis of eye movements revealed that strategic and even encouraged beneficial eye movements were not the cause of the prediction accuracy based on cortical activation. We conclude that during perceptual rivalry, neural correlates of visual awareness can be found in retinotopic visual cortex, MT+, and parietal cortex. We argue that the organization of specific motion-sensitive neurons creates detectable biases in the preferred direction selectivity of voxels, allowing prediction of perceptual states. During perceptual rivalry, retinotopic visual cortex, in particular higher-tier dorsal areas like V3A and V7, actively represents the content the visual awareness.
Collapse
Affiliation(s)
- Gijs Joost Brouwer
- Helmholtz Institute, University of Utrecht, 3584 CC Utrecht, The Netherlands
| | - Raymond van Ee
- Helmholtz Institute, University of Utrecht, 3584 CC Utrecht, The Netherlands
| |
Collapse
|
47
|
Koene AR. A Model for Perceptual Averaging and Stochastic Bistable Behavior and the Role of Voluntary Control. Neural Comput 2006; 18:3069-96. [PMID: 17052159 DOI: 10.1162/neco.2006.18.12.3069] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
We combine population coding, winner-take-all competition, and differentiated inhibitory feedback to model the process by which information from different, continuously variable signals is integrated for perceptual awareness. We focus on “slant rivalry,” where binocular disparity is in conflict with monocular perspective in specifying surface slant. Using a robust single parameter set, our model successfully replicates three key experimental results: (1) transition from signal averaging to bistability with increasing signal conflict, (2) change in perceptual reversal rates as a function of signal conflict, and (3) a shift in the distribution of percept durations through voluntary control exertion. Voluntary control is implemented through the use of a single top-down bias input. The transition from signal averaging to bistability arises as a natural consequence of combining population coding and wide receptive fields, common to higher cortical areas. The model architecture does not contain any assumption that would limit it to this particular example of stimulus rivalry. An emergent physiological interpretation is that differentiated inhibitory feedback may play an important role for increasing percept stability without reducing sensitivity to large stimulus changes, which for bistable conditions leads to increased alternation rate as a function of signal conflict.
Collapse
Affiliation(s)
- Ansgar R Koene
- Department of Psychology, University College London, London, WC1H 0AP, UK.
| |
Collapse
|
48
|
van Ee R, Noest AJ, Brascamp JW, van den Berg AV. Attentional control over either of the two competing percepts of ambiguous stimuli revealed by a two-parameter analysis: Means do not make the difference. Vision Res 2006; 46:3129-41. [PMID: 16650452 DOI: 10.1016/j.visres.2006.03.017] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2005] [Revised: 03/03/2006] [Accepted: 03/14/2006] [Indexed: 10/24/2022]
Abstract
We studied distributions of perceptual rivalry reversals, as defined by the two fitted parameters of the Gamma distribution. We did so for a variety of bi-stable stimuli and voluntary control exertion tasks. Subjects' distributions differed from one another for a particular stimulus and control task in a systematic way that reflects a constraint on the describing parameters. We found a variety of two-parameter effects, the most important one being that distributions of subjects differ from one another in the same systematic way across different stimuli and control tasks (i.e., a fast switcher remains fast across all conditions in a parameter-specified way). The cardinal component of subject-dependent variation was not the conventionally used mean reversal rate, but a component that was oriented-for all stimuli and tasks-roughly perpendicular to the mean rate. For the Necker cube, we performed additional experiments employing specific variations in control exertion, suggesting that subjects have to a considerable extent independent control over the reversal rate of either of the two competing percepts.
Collapse
Affiliation(s)
- R van Ee
- Utrecht University, Helmholtz Institute, The Netherlands.
| | | | | | | |
Collapse
|
49
|
Knapen T, van Ee R. Slant perception, and its voluntary control, do not govern the slant aftereffect: multiple slant signals adapt independently. Vision Res 2006; 46:3381-92. [PMID: 16698056 DOI: 10.1016/j.visres.2006.03.027] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2005] [Revised: 02/10/2006] [Accepted: 03/29/2006] [Indexed: 11/24/2022]
Abstract
Although it is known that high-level spatial attention affects adaptation for a variety of stimulus features (including binocular disparity), the influence of voluntary attentional control-and the associated awareness-on adaptation has remained unexplored. We developed an ambiguous surface slant adaptation stimulus with conflicting monocular and binocular slant signals that instigated two mutually exclusive surface percepts with opposite slants. Using intermittent stimulus removal, subjects were able to voluntarily select one of the two rivaling slant percepts for extended adaptation periods, enabling us to dissociate slant adaptation due to awareness from stimulus-induced slant adaptation. We found that slant aftereffects (SAE) for monocular and binocular test patterns had opposite signs when measured simultaneously. There was no significant influence of voluntarily controlled perceptual state during adaptation on SAEs of monocular or binocular signals. In addition, the magnitude of the binocular SAE did not correlate with the magnitude of perceived slant. Using adaptation to one slant cue, and testing with the other cue, we demonstrated that multiple slant signals adapt independently. We conclude that slant adaptation occurs before the level of slant awareness. Our findings place the site of stereoscopic slant adaptation after disparity and eye posture are interpreted for slant [as demonstrated by Berends et al. (Berends, E. M., Liu, B., & Schor, C. M. (2005). Stereo-slant adaptation is high level and does not involve disparity coding. Journal of Vision 5 (1), 71-80), using that disparity scales with distance], but before other slant signals are integrated for the resulting awareness of the presented slant stimulus.
Collapse
Affiliation(s)
- Tomas Knapen
- Helmholtz Institute, Utrecht University, Princetonplein 5, 3584CC Utrecht, The Netherlands
| | | |
Collapse
|
50
|
van Dam LCJ, van Ee R. The role of saccades in exerting voluntary control in perceptual and binocular rivalry. Vision Res 2006; 46:787-99. [PMID: 16309727 DOI: 10.1016/j.visres.2005.10.011] [Citation(s) in RCA: 66] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2005] [Revised: 10/04/2005] [Accepted: 10/05/2005] [Indexed: 11/24/2022]
Abstract
We have investigated the role of saccades and fixation positions in two perceptual rivalry paradigms (slant rivalry and Necker cube) and in two binocular rivalry paradigms (grating and house-face rivalry), and we compared results obtained from two different voluntary control conditions (natural viewing and hold percept). We found that for binocular rivalry, rather than for perceptual rivalry, there is a marked positive temporal correlation between saccades and perceptual flips at about the moment of the flip. Across different voluntary control conditions the pattern of temporal correlation did not change (although the amount of correlation did frequently, but not always, change), indicating that subjects do not use different temporal eye movement schemes to exert voluntary control. Analysis of the fixation positions at about the moment of the flips indicates that the fixation position by itself does not determine the percept but that subjects prefer to fixate at different positions when asked to hold either of the different percepts.
Collapse
Affiliation(s)
- Loes C J van Dam
- Helmholtz Institute, Utrecht University, PrincetonPlein 5, 3584 CC Utrecht, The Netherlands
| | | |
Collapse
|