Stabilized Structure from Motion without Disparity Induces Disparity Adaptation

Change not State: Perceptual coupling in multistable displays reflects transient bias induced by perceptual change

We investigated how changes in dynamic spatial context influence visual perception. Specifically, we reexamined the perceptual coupling phenomenon when two multistable displays viewed simultaneously tend to be in the same dominant state and switch in accord. Current models assume this interaction reflecting mutual bias produced by a dominant perceptual state. In contrast, we demonstrate that influence of spatial context is strongest when perception changes. First, we replicated earlier work using bistable kinetic-depth effect displays, then extended it by employing asynchronous presentation to show that perceptual coupling cannot be accounted for by the static context provided by perceptually dominant states. Next, we demonstrated that perceptual coupling reflects transient bias induced by perceptual change, both in ambiguous and disambiguated displays. We used a hierarchical Bayesian model to characterize its timing, demonstrating that the transient bias is induced 50-70 ms after the exogenous trigger event and decays within ~200-300 ms. Both endogenous and exogenous switches led to quantitatively and qualitatively similar perceptual consequences, activating similar perceptual reevaluation mechanisms within a spatial surround. We explain how they can be understood within a transient selective visual attention framework or using local lateral connections within sensory representations. We suggest that observed perceptual effects reflect general mechanisms of perceptual inference for dynamic visual scene perception.

Duration Aftereffect Depends on the Duration of Adaptation

It has been widely demonstrated that a prolonged adaptation to a relatively long or short stimulus leads to a robust repulsive duration aftereffect. However, little is known about the rapid adaptation to stimulus duration. In this study, we investigated whether the duration aftereffect could also be induced by short-term adaptation to stimuli of both sub- and supra-second durations. To control for the internal reference for duration judgment, participants were adapted to a stimulus of medium duration, and then tested with both longer and shorter stimuli. We found that the duration aftereffect was only observed after long-term adaptation to stimuli of both sub- and supra-second durations, which suggests that the exposure time to the adaptor is a fundamental factor in determining the duration aftereffect. Our findings offer further evidence of the duration aftereffect, which in this study was dissociated from the anchor effect and high-level aftereffects.

Additivity of Retinal and Pursuit Velocity in the Perceptions of Depth and Rigidity from Object-Produced Motion Parallax

Two psychophysical experiments were conducted to investigate the mechanism that generates stable depth structure from retinal motion combined with extraretinal signals from pursuit eye movements. Stimuli consisted of random dots that moved horizontally in one direction (ie stimuli had common motion on the retina), but at different speeds between adjacent rows. The stimuli were presented with different speeds of pursuit eye movements whose direction was opposite to that of the common retinal motion. Experiment 1 showed that the rows moving faster on the retina appeared closer when viewed without eye movements; however, they appeared farther when pursuit speed exceeded the speed of common retinal motion. The ‘transition’ speed of the pursuit eye movement was slightly, but consistently, larger than the speed of common retinal motion. Experiment 2 showed that parallax thresholds for perceiving relative motion between adjacent rows were minimum at the transition speed found in experiment 1. These results suggest that the visual system calculates head-centric velocity, by adding retinal velocity and pursuit velocity, to obtain a stable depth structure.

Structure-from-motion: dissociating perception, neural persistence, and sensory memory of illusory depth and illusory rotation

In the structure-from-motion paradigm, physical motion on a screen produces the vivid illusion of an object rotating in depth. Here, we show how to dissociate illusory depth and illusory rotation in a structure-from-motion stimulus using a rotationally asymmetric shape and reversals of physical motion. Reversals of physical motion create a conflict between the original illusory states and the new physical motion: Either illusory depth remains constant and illusory rotation reverses, or illusory rotation stays the same and illusory depth reverses. When physical motion reverses after the interruption in presentation, we find that illusory rotation tends to remain constant for long blank durations (T (blank) ≥ 0.5 s), but illusory depth is stabilized if interruptions are short (T (blank) ≤ 0.1 s). The stability of illusory depth over brief interruptions is consistent with the effect of neural persistence. When this is curtailed using a mask, stability of ambiguous vision (for either illusory depth or illusory rotation) is disrupted. We also examined the selectivity of the neural persistence of illusory depth. We found that it relies on a static representation of an interpolated illusory object, since changes to low-level display properties had little detrimental effect. We discuss our findings with respect to other types of history dependence in multistable displays (sensory stabilization memory, neural fatigue, etc.). Our results suggest that when brief interruptions are used during the presentation of multistable displays, switches in perception are likely to rely on the same neural mechanisms as spontaneous switches, rather than switches due to the initial percept choice at the stimulus onset.

The role of attention in ambiguous reversals of structure-from-motion

Multiple dots moving independently back and forth on a flat screen induce a compelling illusion of a sphere rotating in depth (structure-from-motion). If all dots simultaneously reverse their direction of motion, two perceptual outcomes are possible: either the illusory rotation reverses as well (and the illusory depth of each dot is maintained), or the illusory rotation is maintained (but the illusory depth of each dot reverses). We investigated the role of attention in these ambiguous reversals. Greater availability of attention--as manipulated with a concurrent task or inferred from eye movement statistics--shifted the balance in favor of reversing illusory rotation (rather than depth). On the other hand, volitional control over illusory reversals was limited and did not depend on tracking individual dots during the direction reversal. Finally, display properties strongly influenced ambiguous reversals. Any asymmetries between 'front' and 'back' surfaces--created either on purpose by coloring or accidentally by random dot placement--also shifted the balance in favor of reversing illusory rotation (rather than depth). We conclude that the outcome of ambiguous reversals depends on attention, specifically on attention to the illusory sphere and its surface irregularities, but not on attentive tracking of individual surface dots.

Adaptive estimation of three-dimensional structure in the human brain

Perceiving the three-dimensional (3D) properties of the environment relies on the brain bringing together ambiguous cues (e.g., binocular disparity, shading, texture) with information gained from short- and long-term experience. Perceptual aftereffects, in which the perception of an ambiguous 3D stimulus is biased away from the shape of a previously viewed stimulus, provide a sensitive means of probing this process, yet little is known about their neural basis. Here, we investigate 3D aftereffects using psychophysical and functional MRI (fMRI) adaptation paradigms to gain insight into the cortical circuits that mediate the perceptual interpretation of ambiguous depth signals. Using two classic bistable stimuli (Mach card, kinetic depth effect), we test aftereffects produced by 3D shapes defined by binocular (disparity) or monocular (texture, shading) depth cues. We show that the processing of ambiguous 3D stimuli in dorsal visual cortical areas (V3B/KO, V7) and posterior parietal regions is modulated by adaptation in line with perceptual aftereffects. Similar behavioral and fMRI adaptation effects for the two types of bistable stimuli suggest common neural substrates for depth aftereffects independent of the inducing depth cues (disparity, texture, shading). In line with current thinking about the role of adaptation in sensory optimization, our findings provide evidence that estimation of 3D shape in dorsal cortical areas takes account of the adaptive context to resolve depth ambiguity and interpret 3D structure.

Intermittent ambiguous stimuli: implicit memory causes periodic perceptual alternations

When viewing a stimulus that has multiple plausible real-world interpretations, perception alternates between these interpretations every few seconds. Alternations can be halted by intermittently removing the stimulus from view. The same interpretation dominates over many successive presentations, and perception stabilizes. Here we study perception during long sessions of such intermittent presentation. We demonstrate that, rather than causing truly stable perception, intermittent presentation gives rise to a perceptual alternation cycle with its own characteristics and dependencies, different from those during continuous presentation. Alternations during intermittent viewing typically occur once every few minutes--much less frequently than the seconds-scale alternations during continuous viewing. Strikingly, alternations during intermittent viewing occur at fairly regular intervals, making for a surprisingly periodic alternation cycle. The duration of this cycle becomes longer as the blank duration between presentations is increased, reaching dozens of minutes in some cases. We interpret our findings in terms of a mathematical model that describes a neural network with competition between alternative interpretations. Network sensitivities depend on prior dominance, thus providing a memory for past perception. Slow changes in sensitivity produce both perceptual stabilization and the regular but infrequent alternations, meaning that the same memory traces are responsible for both. This model provides a good description of psychophysical findings, and offers several indications regarding their neural basis.

Rapid perceptual switching of a reversible biological figure

Certain visual stimuli can give rise to contradictory perceptions. In this paper we examine the temporal dynamics of perceptual reversals experienced with biological motion, comparing these dynamics to those observed with other ambiguous structure from motion (SFM) stimuli. In our first experiment, naïve observers monitored perceptual alternations with an ambiguous rotating walker, a figure that randomly alternates between walking in clockwise (CW) and counter-clockwise (CCW) directions. While the number of reported reversals varied between observers, the observed dynamics (distribution of dominance durations, CW/CCW proportions) were comparable to those experienced with an ambiguous kinetic depth cylinder. In a second experiment, we compared reversal profiles with rotating and standard point-light walkers (i.e. non-rotating). Over multiple test repetitions, three out of four observers experienced consistently shorter mean percept durations with the rotating walker, suggesting that the added rotational component may speed up reversal rates with biomotion. For both stimuli, the drift in alternation rate across trial and across repetition was minimal. In our final experiment, we investigated whether reversals with the rotating walker and a non-biological object with similar global dimensions (rotating cuboid) occur at random phases of the rotation cycle. We found evidence that some observers experience peaks in the distribution of response locations that are relatively stable across sessions. Using control data, we discuss the role of eye movements in the development of these reversal patterns, and the related role of exogenous stimulus characteristics. In summary, we have demonstrated that the temporal dynamics of reversal with biological motion are similar to other forms of ambiguous SFM. We conclude that perceptual switching with biological motion is a robust bistable phenomenon.

Behavioral and physiological characterization of sensorimotor gating in the goldfish startle response

Prepulse inhibition (PPI) is typically associated with an attenuation of auditory startle behavior in mammals and is presumably mediated within the brainstem startle circuit. However, the inhibitory mechanisms underlying PPI are not yet clear. We addressed this question with complementary behavioral and in vivo electrophysiological experiments in the startle escape circuit of goldfish, the Mauthner cell (M-cell) system. In the behavioral experiments we observed a 77.5% attenuation (PPI) of startle escape probability following auditory prepulse-pulse stimulation. The PPI effect was observed for prepulse-pulse interstimulus intervals (ISIs) ranging from 20 to 600 ms and its magnitude depended linearly on prepulse intensity over a range of 14 dB. Electrophysiological recordings of synaptic responses to a sound pulse in the M-cell, which is the sensorimotor neuron initiating startle escapes, showed a 21% reduction in amplitude of the dendritic postsynaptic potential (PSP) and a 23% reduction of the somatic PSP following a prepulse. In addition, a prepulse evoked a long-lasting (500 ms) decrease in M-cell excitability indicated by 1) an increased threshold current, 2) an inhibitory shunt of the action potential (AP), and 3) by a linearized M-cell membrane, which effectively impedes M-cell AP generation. Comparing the magnitude and kinetics of inhibitory shunts evoked by a prepulse in the M-cell dendrite and soma revealed a disproportionately larger and longer-lasting inhibition in the dendrite. These results suggest that the observed PPI-type attenuation of startle behavior can be correlated to distinct postsynaptic mechanisms mediated primarily at the M-cell lateral dendrite.

Motion aftereffects specific to surface depth order: beyond binocular disparity

Despite evidence for concurrent processing of motion and stereopsis from psychophysics and neurophysiology, the detailed relationship between depth and motion processing is not yet clear. Using the contingent aftereffect paradigm, we investigated how the order of surfaces presented across depth influenced motion perception. After having observers adapt to two superimposed populations of dots moving in opposite directions at different binocular disparities, we assessed how much of the motion aftereffect (MAE) was specific to absolute disparity and how much was specific to the depth order of the surfaces. The test contained two planes of moving dots at several different pairs of disparities and asked observers to report the MAE direction at one of the planes (the target). In addition to the disparity-contingent MAE (Verstraten, Verlinde, Fredericksen, & van de Grind, 1994), we found MAEs dependent on surface order. When the target surface was in front of another surface, observers more often reported the MAE in the direction opposite to the front adapting surface than the back. This effect was observed despite differences in absolute and relative disparity between the adapted and test surfaces. The results suggest that some motion information is represented in terms of surface depth order.

Orientation-tuned FMRI adaptation in human visual cortex

Adaptation is a general property of almost all neural systems and has been a longstanding tool of psychophysics because of its power to isolate and temporarily reduce the contribution of specific neural populations. Recently, adaptation designs have been extensively applied in functional MRI (fMRI) studies to infer neural selectivity in specific cortical areas. However, there has been considerable variability in the duration of adaptation used in these experiments. In particular, although long-term adaptation has been solidly established in psychophysical and neurophysiological studies, it has been incorporated into few fMRI studies. Furthermore, there has been little validation of fMRI adaptation using stimulus dimensions with well-known adaptive properties (e.g., orientation) and in better understood regions of cortex (e.g., primary visual cortex, V1). We used an event-related fMRI experiment to study long-term orientation adaptation in the human visual cortex. After long-term adaptation to an oriented pattern, the fMRI response in V1, V2, V3/VP, V3A, and V4 to a test stimulus was proportional to the angular difference between the adapting and test stimuli. However, only V3A and V4 showed this response pattern with short-term adaptation. In a separate experiment, we measured behavioral contrast detection thresholds after adaptation and found that the fMRI signal in V1 closely matched the psychophysically derived contrast detection thresholds. Similar to the fMRI results, adaptation induced threshold changes strongly depended on the duration of adaptation. In addition to supporting the existence of adaptable orientation-tuned neurons in human visual cortex, our results show the importance of considering timing parameters in fMRI adaptation experiments.

Local factors determine the stabilization of monocular ambiguous and binocular rivalry stimuli

Perceptual alternation in viewing bistable stimuli can be slowed or halted if the stimuli are presented intermittently. Memory of the recent perceptual experience has been proposed to explain this stabilization effect. But the nature of this "perceptual memory" remains unclear. By using a bistable rotating cylinder and two dichoptically presented orthogonal gratings, we explored the features that are important for the stabilization by changing a particular feature of the stimuli between alternate presentations. For the rotating cylinder, changing its color, rotating speed, size, or its stereo depth had no or minimal effect on the stabilization of its perceived rotation direction. For binocular rivalry, when the two gratings were matched in strength and then swapped between the two eyes synchronously with the intermittent presentation, the percepts were usually stabilized to one eye. In both cases, perceptual stabilization occurred only if the stimuli were presented to the same retinal location. These results suggest that the stabilization of monocular bistable stimuli is likely due to the removal of local adaptation, insensitive to the features that define the object identity. For binocular rivalry, preservation of the direction of interocular suppression rather than memory of the stimulus identity accounts for the stabilization effect.