Interocular transfer of expansion, rotation, and translation motion aftereffects

Inattentional aftereffects: The role of attention on the strength of the motion aftereffect

The way that attention affects the processing of visual information is one of the most intriguing fields in the study of visual perception. One way to examine this interaction is by studying the way perceptual aftereffects are modulated by attention. In the present study, we have manipulated attention during adaptation to translational motion generated by coherently moving random dots, in order to investigate the effect of the distraction of attention on the strength of the peripheral dynamic motion aftereffect (MAE). A foveal rapid serial visual presentation task (RSVP) of varying difficulty was introduced during the adaptation period while the adaptation and test stimuli were presented peripherally. Furthermore, to examine the interaction between the physical characteristics of the stimulus and attention, we have manipulated the motion coherence level of the adaptation stimuli. Our results suggested that the removal of attention through an irrelevant task modulated the MAE's magnitude moderately and that such an effect depends on the stimulus strength. We also showed that the MAE still persists with subthreshold and unattended stimuli, suggesting that perhaps attention is not required for the complete development of the MAE.

Introspective inference counteracts perceptual distortion

Introspective agents can recognize the extent to which their internal perceptual experiences deviate from the actual states of the external world. This ability, also known as insight, is critically required for reality testing and is impaired in psychosis, yet little is known about its cognitive underpinnings. We develop a Bayesian modeling framework and a psychophysics paradigm to quantitatively characterize this type of insight while people experience a motion after-effect illusion. People can incorporate knowledge about the illusion into their decisions when judging the actual direction of a motion stimulus, compensating for the illusion (and often overcompensating). Furthermore, confidence, reaction-time, and pupil-dilation data all show signatures consistent with inferential adjustments in the Bayesian insight model. Our results suggest that people can question the veracity of what they see by making insightful inferences that incorporate introspective knowledge about internal distortions.

Invisible Adaptation: The Effect of Awareness on the Strength of the Motion Aftereffect

The ability to process information despite the lack of perceptual awareness is one of the most fascinating aspects of the visual system. Such unconscious processing is often investigated using adaptation, where any presence of the former can be traced by its footprint on aftereffects following the latter. We have investigated the mechanisms of the motion aftereffect (MAE) using random dot displays of varying motion coherence as well as crowding to modulate both the physical as well as the perceptual strength of the adaptation stimulus. Perceptual strength was quantitatively measured as the performance in a forced-choice direction-discrimination task. A motion-nulling technique was used to quantitatively measure the strength of the MAE. We show that the strength of the dynamic MAE is independently influenced by both the physical stimulus strength as well as the subjective perceptual strength, with the effect of the former being more prominent than that of the latter. We further show that the MAE still persists under conditions of subthreshold perception. Our results suggest that perceptual awareness can influence the strength of visual processing, but the latter is not fully dependent on the former and can still take place at its partial or even total absence.

Adaptation to Spiral Motion in Crowding Condition

When a single, moving stimulus is presented in the peripheral visual field, its direction of motion can be easily distinguished, but when the same stimulus is flanked by other similar moving stimuli, observers are unable to report its direction of motion. In this condition, known as ‘crowding’, specific features of visual stimuli do not access conscious perception. The aim of this study was to investigate whether adaptation to spiral motion is preserved in crowding conditions. Logarithmic spirals were used as adapting stimuli. A rotating spiral stimulus (target spiral) was presented, flanked by spirals of the same type, and observers were adapted to its motion. The observers' task was to report the rotational direction of a directionally ambiguous motion (test stimulus) presented afterwards. The directionally ambiguous motion consisted of a pair of spirals flickering in counterphase, which were mirror images of the target spiral. Although observers were not aware of the rotational direction of the target and identified it at chance levels, the direction of rotation reported by the observers during the test phase (motion aftereffect) was contrarotational to the direction of the adapting spiral. Since all contours of the adapting and test stimuli were 90° apart, local motion detectors tuned to the directions of the mirror-image spiral should fail to respond, and therefore not adapt to the adapting spiral. Thus, any motion aftereffect observed should be attributed to adaptation of global motion detectors (ie rotation detectors). Hence, activation of rotation-selective cells is not necessarily correlated with conscious perception.

Unbiased Measures of Interocular Transfer of Motion Adaptation

Numerous studies have measured the extent to which motion aftereffects transfer interocularly. However, many have done so using bias-prone methods, and studies rarely compare different types of motion directly. Here, we use a technique designed to reduce bias (Morgan, 2013, Journal of Vision, 13(8):26, 1–11) to estimate interocular transfer (IOT) for five types of motion: simple translational motion, expansion/contraction, rotation, spiral, and complex translational motion. We used both static and dynamic targets with subjects making binary judgments of perceived speed. Overall, the average IOT was 65%, consistent with previous studies (mean over 17 studies of 67% transfer). There was a main effect of motion type, with translational motion producing stronger IOT (mean: 86%) overall than any of the more complex varieties of motion (mean: 51%). This is inconsistent with the notion that IOT should be strongest for motion processed in extrastriate regions that are fully binocular. We conclude that adaptation is a complex phenomenon too poorly understood to make firm inferences about the binocular structure of motion systems.

Interocular induction of illusory size perception

Background

The perceived size of objects not only depends on their physical size but also on the surroundings in which they appear. For example, an object surrounded by small items looks larger than a physically identical object surrounded by big items (Ebbinghaus illusion), and a physically identical but distant object looks larger than an object that appears closer in space (Ponzo illusion). Activity in human primary visual cortex (V1) reflects the perceived rather than the physical size of objects, indicating an involvement of V1 in illusory size perception. Here we investigate the role of eye-specific signals in two common size illusions in order to provide further information about the mechanisms underlying illusory size perception.

Results

We devised stimuli so that an object and its spatial context associated with illusory size perception could be presented together to one eye or separately to two eyes. We found that the Ponzo illusion had an equivalent magnitude whether the objects and contexts were presented to the same or different eyes, indicating that it may be largely mediated by binocular neurons. In contrast, the Ebbinghaus illusion became much weaker when objects and their contexts were presented to different eyes, indicating important contributions to the illusion from monocular neurons early in the visual pathway.

Conclusions

Our findings show that two well-known size illusions - the Ponzo illusion and the Ebbinghaus illusion - are mediated by different neuronal populations, and suggest that the underlying neural mechanisms associated with illusory size perception differ and can be dependent on monocular channels in the early visual pathway.

Similar adaptation effects on motion pattern detection and position discrimination tasks: unusual properties of global and local level motion adaptation

Here we examine adaptation effects on pattern detection and position discrimination tasks in radial and rotational motion patterns, induced by adapting stimuli moving in the same or opposite directions to the test stimuli. Adaptation effects on the two tasks were similar, suggesting these tasks are performed by the same population of neurons. Global motion specific adaptation was then induced by presenting adaptation stimuli and test stimuli in different parts of the visual field. Again, adaptation effects on the two tasks were similar, but neither same-direction nor opposite-direction motion produced any adaptation effect on contracting motion patterns. Finally, adaptation stimuli were compared that should have similar effects on local motion processing neurons, but different effects on global motion processing neurons. Again, adaptation effects on the two tasks were similar. However, when global-level adaptation was avoided, no adaptation effects were seen with adaptation patterns moving in the opposite direction to the test pattern. Together, these last two experiments suggest that adaptation to opposite directions of motion from the test motion affects global motion processing but not local motion processing neurons.

Modeling the simulated real-world optic flow motion aftereffect

We investigated the simulated real-world optic flow motion aftereffect (MAE) (illusory sense of moving backward following adaptation to expansive optic flow). In Experiment 1, adaptation duration was either 30, 120, 240, or 480 s.

RESULTS

duration of the MAE grew with increasing adaptation duration. In Experiment 2, the MAE was measured across different combinations of values of global optical flow rate and optical edge rate.

RESULTS

the aftereffect was selective for global optical flow rate, suggesting that the aftereffect reflects gain changes at processing levels where a sense of self-motion is generated. RESULTS were used in a computational model of this MAE, which was a modified framework by van de Grind et al. [Vision Res.44, 2269 (2004)].

Interocular Transfer of a Rotational Motion Aftereffect as a Function of Eccentricity

In previous psychophysical investigations it has been reported that the angular extent over which the human visual field is served by binocular neurons in the visual cortex is limited to the central 40°. However, these reports have been primarily based on data collected with static stimuli. Here we extend this investigation to include dynamic stimuli. Interocular transfer of the rotary motion aftereffect (rMAE) was measured for three stimulus diameters: 5, 30, and 62 deg. Interocular transfer, expressed as a percentage of monocular adapt/test rMAE duration was significantly reduced for stimulus diameter of 62 deg relative to 30 and 5 deg diameters. Nevertheless, interocular transfer durations still comprised a significant percentage of same-eye adapt/test durations (46.9%), comparable to previous reports of transfer MAE durations in near-central vision. The spatial extent of binocular interaction is likely stimulus specific and is still appreciable in the far periphery for complex-motion stimuli.

Detecting structure in glass patterns: an interocular transfer study

Glass patterns are visual stimuli used here to study how local orientation signals are spatially integrated into global pattern perception. We measured a form aftereffect from adaptation to both static and dynamic Glass patterns and calculated the amount of interocular transfer to determine the binocularity of the detectors responsible for the perception of global structure. Both static and dynamic adaptation produced significant form aftereffects and showed a very high degree of interocular transfer, suggesting that Glass-pattern perception involves cortical processing beyond primary visual cortex. Surprisingly, dynamic adaptation produced significantly greater interocular transfer than static adaptation. Our results suggest a functional interaction between local orientation processing and global motion processing that contributes to form perception.

Cross-fixation transfer of motion aftereffects with expansion motion

It has been shown that motion aftereffect (MAE) not only is present at the adapted location but also partially transfers to nearby non-adapted locations. However, it is not clear whether MAE transfers across the fixation point. Since cells in area MSTd have receptive fields that cover both sides of the fixation point and since many MSTd cells, but not cells in earlier visual areas, prefer complex motion patterns such as expansion, we tested cross-fixation transfer of MAE induced by expanding random-dots stimuli. We also used rightward translational motion for comparison. Subjects adapted to motion patterns on a fixed side of the fixation point. Dynamic MAE was then measured with a nulling procedure at both the adapted site and the mirror site across the fixation point. Subjects' eye fixation during stimulus presentation was monitored with an infrared eye tracker. At the adapted site, both the expansion and the translation patterns generated strong MAEs, as expected. However, only the expansion pattern, but not translation pattern, generated significant MAE at the mirror site. This remained true even after we adjusted stimulus parameters to equate the strengths of the expansion MAE and translation MAE at the adapted site. We conclude that there is cross-fixation transfer of MAE for expansion motion but not for translational motion.

Aftereffect of adaptation to Glass patterns

Our visual systems constantly adapt their representation of the environment to match the prevailing input. Adaptation phenomena provide striking examples of perceptual plasticity and offer valuable insight into the mechanisms of sensory coding. Here, we describe an aftereffect of adaptation to a spatially structured image whereby an unstructured test stimulus takes on illusory structure locally perpendicular to that of the adaptor. Objective measurement of the strength of the aftereffect for different patterns suggests a neural locus of adaptation prior to the extraction of complex form in the visual processing hierarchy, probably at the level of primary visual cortex. This view is supported by further experiments showing that the aftereffect exhibits partial interocular transfer but complete transfer across opposite contrast polarities. However, the aftereffect does show weak position invariance, suggesting that adaptation at higher levels of the visual system may also contribute to the effect.

Velocity dependence of the interocular transfer of dynamic motion aftereffects

It is well established that motion aftereffects (MAEs) can show interocular transfer (IOT); that is, motion adaptation in one eye can give a MAE in the other eye. Different quantification methods and different test stimuli have been shown to give different IOT magnitudes, varying from no to almost full IOT. In this study, we examine to what extent IOT of the dynamic MAE (dMAE), that is the MAE seen with a dynamic noise test pattern, varies with velocity of the adaptation stimulus. We measured strength of dMAE by a nulling method. The aftereffect induced by adaptation to a moving random-pixel array was compensated (nulled), during a brief dynamic test period, by the same kind of motion stimulus of variable luminance signal-to-noise ratio (LSNR). The LSNR nulling value was determined in a Quest-staircase procedure. We found that velocity has a strong effect on the magnitude of IOT for the dMAE. For increasing speeds from 1.5 deg s(-1) to 24 deg s(-1) average IOT values increased about linearly from 18% to 63% or from 32% to 83%, depending on IOT definition. The finding that dMAEs transfer to an increasing extent as speed increases, suggests that binocular cells play a more dominant role at higher speeds.

Adaptation of PMLS neurons to prolonged optic flow stimuli

Changes in neuronal responses during and after adaptation to prolonged optic flow stimulation were investigated by extracellular single-unit recording in the posteromedial lateral suprasylvian area (PMLS) of the cat. In comparison with translation stimuli, the complex optic flow patterns (radiation and rotation) produced more pronounced adaptation and after-effects by inducing larger response reduction, and altered the direction selectivity of many neurons obviously as well. Generally, the adaptation effects were direction-specific for radiation/rotation, but independent of the direction of test stimulus for translation. These results suggest that PMLS may play an important role in the perception of motion after-effects to complex optic flow fields, while the adaptation to simple translation might be generated at a relatively earlier level of the visual system.

Differential effect of attention to translation and expansion on motion aftereffects (MAE)

Recent fMRI findings have shown that selective attention to translating dots enhances V1 and MT complex activity whereas attention to expansion enhances MT complex activity rather than V1 (Watanabe et al., Proceedings of the National Academy of Sciences of the USA, (1998a) 95(19), 11489-11492). In order to clarify whether or not attention actually enhances the neural mechanism for the attended motion direction(s), we took advantage of the motion aftereffect (MAE), using superimposed groups of translating and expanding dots as the adaptation stimulus. During the adaptation stage, the subject was instructed to direct attention to one-way translation, expansion, or no particular motion or location, while gazing at the fixation point. The strength of the MAE in the attended monocular condition was greater than the sum of the unattended monocular MAE and the attended binocular MAE. In another experiment the monocular and binocular components showed linear additivity. These results suggest that attention enhances the monocular mechanism for the attended translational direction and that bottom-up monocular signals and top-down attentional signals simply add linearly. In contrast, no significant monocular contribution was found for attention to expansion. This is not only in accord with previous fMRI findings (Watanabe et al., 1998a), but also supports the thesis that attention to translation or expansion enhances the activation of the mechanism for the attended motion, rather than simply increasing arousal as a result of a heavier task load.

Motion aftereffect of combined first-order and second-order motion

When, after prolonged viewing of a moving stimulus, a stationary (test) pattern is presented to an observer, this results in an illusory movement in the direction opposite to the adapting motion. Typically, this motion aftereffect (MAE) does not occur after adaptation to a second-order motion stimulus (i.e. an equiluminous stimulus where the movement is defined by a contrast or texture border, not by a luminance border). However, a MAE of second-order motion is perceived when, instead of a static test pattern, a dynamic test pattern is used. Here, we investigate whether a second-order motion stimulus does affect the MAE on a static test pattern (sMAE), when second-order motion is presented in combination with first-order motion during adaptation. The results show that this is indeed the case. Although the second-order motion stimulus is too weak to produce a convincing sMAE on its own, its influence on the sMAE is of equal strength to that of the first-order motion component, when they are adapted to simultaneously. The results suggest that the perceptual appearance of the sMAE originates from the site where first-order and second-order motion are integrated.

A hierarchical structure of motion system revealed by interocular transfer of flicker motion aftereffects

Interocular transfer of the motion aftereffect (MAE) has been extensively investigated for the purpose of analysing the binocularity of the underlying motion mechanism. Previous studies unanimously reported that the transfer of the classical static MAE is partial, but there is a controversy as to whether the transfer of the flicker MAE (MAE measured using counterphase gratings) is partial or perfect. To gain insight into the discrepancy between studies, we investigated whether the interocular transfer of the flicker MAE is influenced by the MAE measurement method, retinal eccentricity and attention. Our results showed that the transfer was perfect or nearly so when the MAE duration was measured in the central visual field with observers paying attention to the adaptation stimulus, but the transfer was partial when the MAE nulling strength was measured, when the MAE duration was measured in the peripheral visual field, or when the observers' attention was distracted by a secondary task. These results not only resolve discrepancies between previous studies, but also suggest that the flicker MAE reflects adaptation at multiple stages in the hierarchical architecture of motion processing.

Enhanced motion aftereffect for complex motions

We measured the magnitude of the motion after effect (MAE) elicited by gratings viewed through four spatial apertures symmetrically positioned around fixation. The gratings were identical except for their orientations, which were varied to form patterns of global motion corresponding to radiation, rotation or translation. MAE magnitude was estimated by three methods: the duration of the MAE; the contrast required to null the MAE and the threshold elevation for detecting an abrupt jump. All three techniques showed that MAEs for radiation and rotation were greater than those for translation. The greater adaptability of radiation and rotation over translation also was observed in areas of the display where no adapting stimulus had been presented. We also found that adaptation to motion in one direction had equal effects on sensitivity to motion in the same and opposite directions.

Visual discrimination of direction changes based upon two types of angular motion

We address the question of how the visual system analyses changes in direction. Using plaid stimuli, we define type O direction changes which entail a change in the orientations of the plaid components, and type V direction changes in which the orientations of the components remain constant, relative to the observer but their relative speeds change. Lower thresholds for discriminating type O and type V direction changes were compared. Type O thresholds for clockwise/anticlockwise direction change were very low (0.2-0.5 degree), were resistant to directional noise, and showed a low-pass relationship with drift velocity. Type V thresholds on the other hand were higher (1-5 degrees), and exhibited a bandpass relationship with drift velocity. Type O direction changes gave low thresholds at short inter-stimulus intervals (ISI) (< 160 ms) and higher thresholds (successive orientation discrimination) at long ISI (240 ms-12.8 s). Type V thresholds, on the other hand, exhibited no short-range process and performance at short ISI, was no better than for successive direction discrimination at long ISI. A two-stage rotary motion model is sufficient to explain the discrimination of type O direction changes and results rule out a model based on velocity discrimination. For type V direction changes, a two-stage mechanism is insufficient and results are consistent with a minimum of three computational stages.

Complex motion perception and its deficits

Within the hierarchy of motion perception, the dorsolateral middle superior temporal area (MSTd) is optimally suited for the analysis of the complex motion patterns that are directly useful for visually guided behaviour (e.g. computation of heading). Recent electrophysiological and psychophysical evidence suggests the existence of 'detectors' in MSTd that are specialised for complex motion patterns and advocates the necessity of combining retinal and extraretinal signals received by MSTd neurones for the accurate perception of heading. In some neurological patients, of which only a small number have been reported to date, lesions involving the human homologue of MST have devastating effects on their ability to navigate in their surroundings. It has been reported that these patients have impaired performance of psychophysical tasks of complex motion discrimination.

Binocular rivalry and motion perception

In a series of experiments psychophysical techniques were used to study the relation between binocular rivalry and motion perception. An initial series of experiments confirmed that motion enhances the predominance of an eye during rivalry, although the direction of motion does not matter. The presence of an annulus of motion immediately surrounding one eye's rival target greatly enhances dominance of that target, but the influence of the annulus progressively decreases as the separation between disk and annulus increased. Opponent directions of motion in disk and annulus yield greater dominance than when dots in the disk and annulus moved in identical directions. In a second experiment that two eyes were adapted to orthogonal directions of motion, generating strong, distinctively different monocular motion aftereffects (MAEs). Even though the two eyes view physically identical random-motion displays following differential adaptation, binocular rivalry of the discrepant MAEs can occur. Finally, using a stimulus replacement technique to measure detectability of translational and rotational motion, it was found that both types of motion were readily detected during periods of dominance but went undetected during periods of suppression. Taken together, these results bear on the process responsible for rivalry and its neural locus relative to the analysis of different types of motion.

Linear motion aftereffect induced by pure relative motion

The effect of adaptation to pure relative motion was investigated for the motion aftereffect (MAE) of linear translation motion. In experiment 1, MAE induced by adaptation in the surrounding area was tested. The relative motion signal significantly increased the magnitude of MAE while local MAE in the surrounds was not affected. In experiment 2, MAE observed in the same adapted area was examined while local adaptation was cancelled out. Substantial MAE was found only when the test stimuli included the surroundings, which is considered to be favourable for relative motion mechanisms. These results clearly indicate that MAE is induced by adaptation to pure relative motion as well as by local motion. MAE should be regarded as a composite phenomenon reflecting multiple sites of adaptation including the local and the relative motion levels. The results also provide evidence for the existence of independent detecting mechanisms for relative motion processing.

Equivalent background speed in recovery from motion adaptation

We measured, in the same observers, (1) the detectability, d, of a small rotational jump following adaptation to rotational motion and (2) the detectability of the same jump when superimposed on one of several background rotation speeds. Following 90 s of motion adaptation the detectability of the jump was impaired, and sensitivity slowly recovered over the course of 60 s. The detectability of the jump was also impaired by the background speed in a way consistent with a quadratic form of Weber's law. We propose that motion adaptation impairs the detectability of the small jump because it is as if an equivalent background speed has been superimposed on the display. We measured the equivalent background by finding the real background speed that produced the same d' at each instant in the recovery from motion adaptation. The equivalent background started at approximately one to two thirds the speed of the adapting motion, declined rapidly, rose to a small peak at 30 s, then disappeared by 60 s. Since the equivalent background speed corresponds to the speed of the motion aftereffect, we have measured the time course of the motion aftereffect with objective psychophysics.

Temporal and spatial frequency tuning of the flicker motion aftereffect

The motion aftereffect (MAE) was used to study the temporal and spatial frequency selectivity of the visual system at supra-threshold contrasts. Observers adapted to drifting sine-wave gratings of a range of spatial and temporal frequencies. The magnitude of the MAE induced by the adaptation was measured with counterphasing test gratings of a variety of spatial and temporal frequencies. Independently of the spatial or temporal frequency of the adapting grating, the largest MAE was found with slowly counterphasing test gratings (at approximately 0.125-0.25 Hz). The largest MAEs were also found when the test grating was of similar spatial frequency to that of the adapting grating, even at very low spatial frequencies (0.125 c/deg). These data suggest that MAEs are dominated by a single, low-pass temporal frequency mechanism and by a series of band-pass spatial frequency mechanisms. The band-pass spatial frequency tuning even at low spatial frequencies suggests that the "lowest adaptable channel" concept [Cameron et al. (1992). Vision Research, 32, 561-568] may be an artifact of disadvantaged low spatial frequencies using static test patterns.

Recovery from adaptation for dynamic and static motion aftereffects: evidence for two mechanisms

The motion aftereffect (MAE) is an illusory drift of a physically stationary pattern induced by prolonged viewing of a moving pattern. Depending on the nature of the test pattern the MAE can be phenomenally different. This difference in appearance has led to the suggestion that different underlying mechanisms may be responsible and several reports show that this might be the case. Here, we tested whether differences in MAE duration obtained with stationary test patterns and dynamic test patterns can be explained by a single underlying mechanism. We find the results support the existence of (at least) two mechanisms. The two mechanisms show different characteristics: the static MAE (i.e. the MAE tested with a static test pattern) is almost completely stored when the static test is preceded by a dynamic test; in contradistinction, the dynamic MAE is not stored when dynamic testing is preceded by a static test pattern.