A gain-control model relating nulling results to the duration of dynamic motion aftereffects

Congruent audio-visual stimulation during adaptation modulates the subsequently experienced visual motion aftereffect

Sensory information registered in one modality can influence perception associated with sensory information registered in another modality. The current work focuses on one particularly salient form of such multisensory interaction: audio-visual motion perception. Previous studies have shown that watching visual motion and listening to auditory motion influence each other, but results from those studies are mixed with regard to the nature of the interactions promoting that influence and where within the sequence of information processing those interactions transpire. To address these issues, we investigated whether (i) concurrent audio-visual motion stimulation during an adaptation phase impacts the strength of the visual motion aftereffect (MAE) during a subsequent test phase, and (ii) whether the magnitude of that impact was dependent on the congruence between auditory and visual motion experienced during adaptation. Results show that congruent direction of audio-visual motion during adaptation induced a stronger initial impression and a slower decay of the MAE than did the incongruent direction, which is not attributable to differential patterns of eye movements during adaptation. The audio-visual congruency effects measured here imply that visual motion perception emerges from integration of audio-visual motion information at a sensory neural stage of processing.

The Role of Bottom-Up and Top-Down Cortical Interactions in Adaptation to Natural Scene Statistics

Adaptation is a mechanism by which cortical neurons adjust their responses according to recently viewed stimuli. Visual information is processed in a circuit formed by feedforward (FF) and feedback (FB) synaptic connections of neurons in different cortical layers. Here, the functional role of FF-FB streams and their synaptic dynamics in adaptation to natural stimuli is assessed in psychophysics and neural model. We propose a cortical model which predicts psychophysically observed motion adaptation aftereffects (MAE) after exposure to geometrically distorted natural image sequences. The model comprises direction selective neurons in V1 and MT connected by recurrent FF and FB dynamic synapses. Psychophysically plausible model MAEs were obtained from synaptic changes within neurons tuned to salient direction signals of the broadband natural input. It is conceived that, motion disambiguation by FF-FB interactions is critical to encode this salient information. Moreover, only FF-FB dynamic synapses operating at distinct rates predicted psychophysical MAEs at different adaptation time-scales which could not be accounted for by single rate dynamic synapses in either of the streams. Recurrent FF-FB pathways thereby play a role during adaptation in a natural environment, specifically in inducing multilevel cortical plasticity to salient information and in mediating adaptation at different time-scales.

Habituation of visual adaptation

Our sensory system adjusts its function driven by both shorter-term (e.g. adaptation) and longer-term (e.g. learning) experiences. Most past adaptation literature focuses on short-term adaptation. Only recently researchers have begun to investigate how adaptation changes over a span of days. This question is important, since in real life many environmental changes stretch over multiple days or longer. However, the answer to the question remains largely unclear. Here we addressed this issue by tracking perceptual bias (also known as aftereffect) induced by motion or contrast adaptation across multiple daily adaptation sessions. Aftereffects were measured every day after adaptation, which corresponded to the degree of adaptation on each day. For passively viewed adapters, repeated adaptation attenuated aftereffects. Once adapters were presented with an attentional task, aftereffects could either reduce for easy tasks, or initially show an increase followed by a later decrease for demanding tasks. Quantitative analysis of the decay rates in contrast adaptation showed that repeated exposure of the adapter appeared to be equivalent to adaptation to a weaker stimulus. These results suggest that both attention and a non-attentional habituation-like mechanism jointly determine how adaptation develops across multiple daily sessions.

Modelling adaptation to directional motion using the Adelson-Bergen energy sensor

The motion energy sensor has been shown to account for a wide range of physiological and psychophysical results in motion detection and discrimination studies. It has become established as the standard computational model for retinal movement sensing in the human visual system. Adaptation effects have been extensively studied in the psychophysical literature on motion perception, and play a crucial role in theoretical debates, but the current implementation of the energy sensor does not provide directly for modelling adaptation-induced changes in output. We describe an extension of the model to incorporate changes in output due to adaptation. The extended model first computes a space-time representation of the output to a given stimulus, and then a RC gain-control circuit ("leaky integrator") is applied to the time-dependent output. The output of the extended model shows effects which mirror those observed in psychophysical studies of motion adaptation: a decline in sensor output during stimulation, and changes in the relative of outputs of different sensors following this adaptation.

Perceptual learning reconfigures the effects of visual adaptation

Our sensory experiences over a range of different timescales shape our perception of the environment. Two particularly striking short-term forms of plasticity with manifestly different time courses and perceptual consequences are those caused by visual adaptation and perceptual learning. Although conventionally treated as distinct forms of experience-dependent plasticity, their neural mechanisms and perceptual consequences have become increasingly blurred, raising the possibility that they might interact. To optimize our chances of finding a functionally meaningful interaction between learning and adaptation, we examined in humans the perceptual consequences of learning a fine discrimination task while adapting the neurons that carry most information for performing this task. Learning improved discriminative accuracy to a level that ultimately surpassed that in an unadapted state. This remarkable improvement came at a price: adapting directions that before learning had little effect elevated discrimination thresholds afterward. The improvements in discriminative accuracy grew quickly and surpassed unadapted levels within the first few training sessions, whereas the deterioration in discriminative accuracy had a different time course. This learned reconfiguration of adapted discriminative accuracy occurred without a concomitant change to the characteristic perceptual biases induced by adaptation, suggesting that the system was still in an adapted state. Our results point to a functionally meaningful push-pull interaction between learning and adaptation in which a gain in sensitivity in one adapted state is balanced by a loss of sensitivity in other adapted states.

Motion aftereffect duration is not changed by perceptual learning: evidence against the representation modification hypothesis

The representation modification hypothesis of perceptual learning attributes the practice-induced improvements in sensitivity and/or discriminability to changes in the early visual areas. We used motion aftereffects (MAE) to probe the representations of motion direction. In two experiments, four practice sessions on a fine direction-discrimination task caused large stimulus-specific improvements in d' but no significant stimulus-specific changes in either static or dynamic MAE duration at posttest relative to a pretest. Power analysis indicated that the data were approximately 100 times more likely given the hypothesis of no MAE change than the hypothesis of a 10% relative change. In light of converging evidence in the MAE literature, this suggests that little or no change occurred in the cortical representations of visual motion up to and including area MT. The task specificity of the learning effect challenges the representation modification hypothesis and supports an alternative-selective reweighting.

Spatially localized motion aftereffect disappears faster from awareness when selectively attended to according to its direction

In searching for the target-afterimage patch among spatially separate alternatives of color-afterimages the target fades from awareness before its competitors (Bachmann, T., & Murd, C. (2010). Covert spatial attention in search for the location of a color-afterimage patch speeds up its decay from awareness: Introducing a method useful for the study of neural correlates of visual awareness. Vision Research 50, 1048-1053). In an analogous study presented here we show that a similar effect is obtained when a target spatial location specified according to the direction of motion aftereffect within it is searched by covert top-down attention. The adverse effect of selective attention on the duration of awareness of sensory qualiae known earlier to be present for color and periodic spatial contrast is extended also to sensory channels carrying motion information.

Dynamics of spatial distortions reveal multiple time scales of motion adaptation

Prolonged exposure to consistent visual motion can significantly alter the perceived direction and speed of subsequently viewed objects. These perceptual aftereffects have provided invaluable tools with which to study the mechanisms of motion adaptation and draw inferences about the properties of underlying neural populations. Behavioral studies of the time course of motion aftereffects typically reveal a gradual process of adaptation spanning a period of multiple seconds. In contrast, neurophysiological studies have documented multiple motion adaptation effects operating over similar, or substantially faster (i.e., sub-second) time scales. Here we investigated motion adaptation by measuring time-dependent changes in the ability of moving stimuli to distort the perceived position of briefly presented static objects. The temporal dynamics of these motion-induced spatial distortions reveal the operation of two dissociable mechanisms of motion adaptation with differing properties. The first is rapid (subsecond), acts to limit the distortions induced by continuing motion, but is not sufficient to produce an aftereffect once the motion signal disappears. The second gradually accumulates over a period of seconds, does not modulate the size of distortions produced by continuing motion, and produces repulsive aftereffects after motion offset. These results provide new psychophysical evidence for the operation of multiple mechanisms of motion adaptation operating over distinct time scales.

Motion fading and the motion aftereffect share a common process of neural adaptation

After prolonged viewing of a slowly drifting or rotating pattern under strict fixation, the pattern appears to slow down and then momentarily stop. Here, we show that this motion fading occurs not only for slowly moving stimuli, but also for stimuli moving at high speed; after prolonged viewing of high-speed stimuli, the stimuli appear to slow down but not to stop. We report psychophysical evidence that the same neural adaptation process likely gives rise to motion fading and to the motion aftereffect.

Modeling the simulated real-world optic flow motion aftereffect

We investigated the simulated real-world optic flow motion aftereffect (MAE) (illusory sense of moving backward following adaptation to expansive optic flow). In Experiment 1, adaptation duration was either 30, 120, 240, or 480 s.

RESULTS

duration of the MAE grew with increasing adaptation duration. In Experiment 2, the MAE was measured across different combinations of values of global optical flow rate and optical edge rate.

RESULTS

the aftereffect was selective for global optical flow rate, suggesting that the aftereffect reflects gain changes at processing levels where a sense of self-motion is generated. RESULTS were used in a computational model of this MAE, which was a modified framework by van de Grind et al. [Vision Res.44, 2269 (2004)].

Reduction in the motion coherence threshold for the same direction as that perceived during adaptation

When a stimulus of equally spaced parallel lines is displaced slightly in a direction perpendicular to the lines, low-speed motion toward the displacement direction can be perceived. Such a stimulus embodies both a low-speed and a high-speed component in opposite directions. The dominance of the former would result in the perception of low-speed motion. To see how the unperceived high-speed component is processed by the visual system, I measured coherence thresholds for random-dot test-motion with and without prior adaptation to the low-speed motion of the equally spaced parallel lines. The results depended on the test speeds. At low speeds, the coherence thresholds for the same direction as that perceived during the adaptation phase increased and the coherence thresholds for the opposite direction decreased. At high speeds, the same adaptation resulted in an opposite effect. The threshold reduction for high-speed motion in the same direction as that perceived during the adaptation phase and the threshold elevation in the opposite direction might be due to adaptation of a high-speed processing channel to the high-speed component that was not perceived but was nevertheless detected.

Motion adaptation: net duration matters, not continuousness

Motion processing is strongly adaptable. Adaptation strength generally increases with motion duration. Little is known, though, about the effect of motion onsets and offsets, which might be relevant if adaptation is not based on motion duration per se, but on the recent cumulated activity of motion-processing mechanisms. Thus, we presented intermittent motion with three different onset rates for adaptation. The duty cycle was kept constant at 33% while the rate of motion onsets was either 1.4, 2.8, or 5.6 per second. Stationary stimuli and continuous motion were used as reference conditions. The amplitude of the N2 component of human motion visual evoked potentials was used to quantify adaptation. All three onset rates induced virtually identical amounts of adaptation (occipitally, P=0.71; occipito-temporally, P=0.27), suggesting that the continuousness of the stimulus does not play an important role in motion adaptation. This was confirmed by measuring the motion aftereffect psychophysically.

Storage for free: a surprising property of a simple gain-control model of motion aftereffects

If a motion aftereffect (MAE) for given adaptation conditions has a duration T s, and the eyes are closed after adaptation during a waiting period tw=T s before testing, an unexpected MAE of a 'residual' duration TrT s is experienced. This effect is called 'storage' and it is often quantified by a storage factor sigma=TrT/T, which can reach values up to about 0.7-0.8. The phenomenon and its name have invited explanations in terms of inhibition of recovery during darkness. We present a model based on the opposite idea, that an effective test stimulus quickens recovery relative to darkness or other ineffective test stimuli. The model is worked out in mathematical detail and proves to explain 'storage' data from the literature, on the static MAE (sMAE: an MAE experienced for static test stimuli). We also present results of a psychophysical experiment with moving random pixel arrays, quantifying storage phenomena both for the sMAE and the dynamic MAE (dMAE: an MAE experienced for a random dynamic noise test stimulus). Storage factors for the dMAE are lower than for the sMAE. Our model also gives an excellent description of these new data on storage of the dMAE. The term 'storage' might therefore be a misnomer. If an effective test stimulus influences all direction tuned motion sensors indiscriminately and thus speeds up equalization of gains, one gets the storage phenomenon for free.

Velocity dependence of the interocular transfer of dynamic motion aftereffects

It is well established that motion aftereffects (MAEs) can show interocular transfer (IOT); that is, motion adaptation in one eye can give a MAE in the other eye. Different quantification methods and different test stimuli have been shown to give different IOT magnitudes, varying from no to almost full IOT. In this study, we examine to what extent IOT of the dynamic MAE (dMAE), that is the MAE seen with a dynamic noise test pattern, varies with velocity of the adaptation stimulus. We measured strength of dMAE by a nulling method. The aftereffect induced by adaptation to a moving random-pixel array was compensated (nulled), during a brief dynamic test period, by the same kind of motion stimulus of variable luminance signal-to-noise ratio (LSNR). The LSNR nulling value was determined in a Quest-staircase procedure. We found that velocity has a strong effect on the magnitude of IOT for the dMAE. For increasing speeds from 1.5 deg s(-1) to 24 deg s(-1) average IOT values increased about linearly from 18% to 63% or from 32% to 83%, depending on IOT definition. The finding that dMAEs transfer to an increasing extent as speed increases, suggests that binocular cells play a more dominant role at higher speeds.