The discrimination of abrupt changes in speed and direction of visual motion

Achieving visual stability during smooth pursuit eye movements: Directional and confidence judgements favor a recalibration model

During smooth pursuit eye movements, the visual system is faced with the task of telling apart reafferent retinal motion from motion in the world. While an efference copy signal can be used to predict the amount of reafference to subtract from the image, an image-based adaptive mechanism can ensure the continued accuracy of this computation. Indeed, repeatedly exposing observers to background motion with a fixed direction relative to that of the target that is pursued leads to a shift in their point of subjective stationarity (PSS). We asked whether the effect of exposure reflects adaptation to motion contingent on pursuit direction, recalibration of a reference signal or both. A recalibration account predicts a shift in reference signal (i.e. predicted reafference), resulting in a shift of PSS, but no change in sensitivity. Results show that both directional judgements and confidence judgements about them favor a recalibration account, whereby there is an adaptive shift in the reference signal caused by the prevailing retinal motion during pursuit. We also found that the recalibration effect is specific to the exposed visual hemifield.

Three-Dimensional Motion Perception: Comparing Speed and Speed Change Discrimination for Looming Stimuli

Judging the speed of objects moving in three dimensions is important in our everyday lives because we interact with objects in a three-dimensional world. However, speed perception has been seldom studied for motion in depth, particularly when using monocular cues such as looming. Here, we compared speed discrimination, and speed change discrimination, for looming stimuli, in order to better understand what visual information is used for these tasks. For the speed discrimination task, we manipulated the distance and duration information available, in order to investigate if participants were specifically using speed information. For speed change discrimination, total distance and duration were held constant; hence, they could not be used to successfully perform that task. For the speed change discrimination task, our data were consistent with observers not responding specifically to speed changes within an interval. Instead, they may have used alternative, arguably less optimal, strategies to complete the task. Evidence suggested that participants used a variety of cues to complete the speed discrimination task, not always solely relying on speed. Further, our data suggested that participants may have switched between cues on a trial to trial basis. We conclude that speed changes in looming stimuli were not used in a speed change discrimination task, and that naïve participants may not always exclusively use speed for speed discrimination.

Speed change discrimination for motion in depth using constant world and retinal speeds

Motion at constant speed in the world maps into retinal motion very differently for lateral motion and motion in depth. The former is close to linear, for the latter, constant speed objects accelerate on the retina as they approach. Motion in depth is frequently studied using speeds that are constant on the retina, and are thus not consistent with real-world constant motion. Our aim here was to test whether this matters: are we more sensitive to real-world motion? We measured speed change discrimination for objects undergoing accelerating retinal motion in depth (consistent with constant real-world speed), and constant retinal motion in depth (consistent with real-world deceleration). Our stimuli contained both looming and binocular disparity cues to motion in depth. We used a speed change discrimination task to obtain thresholds for conditions with and without binocular and looming motion in depth cues. We found that speed change discrimination thresholds were similar for accelerating retinal speed and constant retinal speed and were notably poor compared to classic speed discrimination thresholds. We conclude that the ecologically valid retinal acceleration in our stimuli neither helps, nor hinders, our ability to make judgements in a speed change discrimination task.

Attentional modulation of speed-change perception in the perifoveal and near-peripheral visual field

The ability to perceive changes in motion, such as rapid changes of speed, has important ecological significance. We show that exogenous and endogenous attention have different effects on speed-change perception and operate differently in different regions of the visual field. Using a spatial-cueing paradigm, with either exogenous or endogenous cues followed by drifting Gabor patches of changing speed that appear at the cued or uncued location, we measured participants’ thresholds for localizing both acceleration and deceleration of the Gabor patches in different regions (5° and 10°) of the visual field. The results revealed a larger exogenous cueing effect, indexed by a lower threshold for the cued relative to the uncued conditions, at 5° for perceiving acceleration and at 10° for perceiving deceleration. Endogenous attention, in contrast, improved performance equally at both eccentricities. We conclude that exogenous and endogenous spatial orienting constitute two independent attentional systems, with distinct modulation patterns on speed change perception in the visual field. While exogenous attentional modulation is eccentricity-dependent, endogenous attention acts homogeneously in perifoveal and near-peripheral regions of the visual field.

Aperture extent and stimulus speed affect the perception of visual acceleration

Humans are generally poor at detecting the presence of visual acceleration, but it is unclear whether the extent of a field of moving objects through an aperture affects this ability. Hypothetically, the farther a stimulus can accelerate uninterrupted by an aperture's physical constraints, the easier it should be to discern its motion profile. We varied the horizontal extent of the aperture through which continuously accelerating or decelerating random dot arrays were presented at different average speeds, and measured acceleration and deceleration detection thresholds. We also hypothesized that manipulating aperture extent at different speeds would change how observers visually pursue acceleration, which we tested in a control experiment. Results showed that, while there was no difference between the acceleration and deceleration conditions, detection was better in the larger than small aperture conditions. Regardless of aperture size, smaller acceleration and deceleration rates (relative to average speed) were needed to detect changing speed in faster than slower speed ranges. Similarly, observers tracked the stimuli to a greater extent in the larger than small apertures, and smooth pursuit was overall poorer at faster than slower speeds. Notably, the effect of speed on pursuit was greater for the larger than small aperture conditions, suggesting that the small aperture restricted pursuit. Furthermore, there was little difference in psychophysical and eye movement data between the medium and large aperture conditions within each speed range, indicating that it is easier to detect an accelerating profile when the aperture is large enough to encourage a minimum level of pursuit.

Look before you leap: sensory memory improves decision making

Simple decisions require the processing and evaluation of perceptual and cognitive information, the formation of a decision, and often the execution of a motor response. This process involves the accumulation of evidence over time until a particular choice reaches a decision threshold. Using a random-dot-motion stimulus, we showed that simply delaying responses after the stimulus offset can almost double accuracy, even in the absence of new incoming visual information. However, under conditions in which the otherwise blank interval was filled with a sensory mask or concurrent working memory load was high, performance gains were lost. Further, memory and perception showed equivalent rates of evidence accumulation, suggesting a high-capacity memory store. We propose an account of continued evidence accumulation by sequential sampling from a simultaneously decaying memory trace. Memories typically decay with time, hence immediate inquiry trumps later recall from memory. However, the results we report here show the inverse: Inspecting a memory trumps viewing the actual object.

Form features provide a cue to the angular velocity of rotating objects

As an object rotates, each location on the object moves with an instantaneous linear velocity, dependent upon its distance from the center of rotation, whereas the object as a whole rotates with a fixed angular velocity. Does the perceived rotational speed of an object correspond to its angular velocity, linear velocities, or some combination of the two? We had observers perform relative speed judgments of different-sized objects, as changing the size of an object changes the linear velocity of each location on the object's surface, while maintaining the object's angular velocity. We found that the larger a given object is, the faster it is perceived to rotate. However, the observed relationships between size and perceived speed cannot be accounted for simply by size-related changes in linear velocity. Further, the degree to which size influences perceived rotational speed depends on the shape of the object. Specifically, perceived rotational speeds of objects with corners or regions of high-contour curvature were less affected by size. The results suggest distinct contour features, such as corners or regions of high or discontinuous contour curvature, provide cues to the angular velocity of a rotating object.

The effect of stimulus intensity on response time and accuracy in dynamic, temporally constrained environments

The ability to make accurate judgments and execute effective skilled movements under severe temporal constraints are fundamental to elite performance in a number of domains including sport, military combat, law enforcement, and medicine. In two experiments, we examine the effect of stimulus strength on response time and accuracy in a temporally constrained, real-world, decision-making task. Specifically, we examine the effect of low stimulus intensity (black) and high stimulus intensity (sequin) uniform designs, worn by teammates, to determine the effect of stimulus strength on the ability of soccer players to make rapid and accurate responses. In both field- and laboratory-based scenarios, professional soccer players viewed developing patterns of play and were required to make a penetrative pass to an attacking player. Significant differences in response accuracy between uniform designs were reported in laboratory- and field-based experiments. Response accuracy was significantly higher in the sequin compared with the black uniform condition. Response times only differed between uniform designs in the laboratory-based experiment. These findings extend the literature into a real-world environment and have significant implications for the design of clothing wear in a number of domains.

Similar Effects of Visual Perception and Imagery on Simple Reaction Time

A longstanding issue is whether perception and mental imagery share similar cognitive and neural mechanisms. To cast further light on this problem, we compared the effects of real and mentally generated visual stimuli on simple reaction time (RT). In five experiments, we tested the effects of difference in luminance, contrast, spatial frequency, motion, and orientation. With the intriguing exception of spatial frequency, in all other tasks perception and imagery showed qualitatively similar effects. An increase in luminance, contrast, and visual motion yielded a decrease in RT for both visually presented and imagined stimuli. In contrast, gratings of low spatial frequency were responded to more quickly than those of higher spatial frequency only for visually presented stimuli. Thus, the present study shows that basic dependent variables exert similar effects on visual RT either when retinally presented or when imagined. Of course, this evidence does not necessarily imply analogous mechanisms for perception and imagery, and a note of caution in such respect is suggested by the large difference in RT between the two operations. However, the present results undoubtedly provide support for some overlap between the structural representation of perception and imagery.

Flexible, task-dependent use of sensory feedback to control hand movements

We tested whether changing accuracy demands for simple pointing movements leads humans to adjust the feedback control laws that map sensory signals from the moving hand to motor commands. Subjects made repeated pointing movements in a virtual environment to touch a button whose shape varied randomly from trial to trial-between squares, rectangles oriented perpendicular to the movement path, and rectangles oriented parallel to the movement path. Subjects performed the task on a horizontal table but saw the target configuration and a virtual rendering of their pointing finger through a mirror mounted between a monitor and the table. On one-third of trials, the position of the virtual finger was perturbed by ±1 cm either in the movement direction or perpendicular to the movement direction when the finger passed behind an occluder. Subjects corrected quickly for the perturbations despite not consciously noticing them; however, they corrected almost twice as much for perturbations aligned with the narrow dimension of a target than for perturbations aligned with the long dimension. These changes in apparent feedback gain appeared in the kinematic trajectories soon after the time of the perturbations, indicating that they reflect differences in the feedback control law used throughout the duration of movements. The results indicate that the brain adjusts its feedback control law for individual movements "on demand" to fit task demands. Simulations of optimal control laws for a two-joint arm show that accuracy demands alone, coupled with signal-dependent noise, lead to qualitatively the same behavior.

Recent history of stimulus speeds affects the speed tuning of neurons in area MT

Visual motion processing plays a key role in enabling primates' successful interaction with their dynamic environments. Although in natural environments the speed of visual stimuli continuously varies, speed tuning of neurons in the prototypical motion area MT has traditionally been assessed with stimuli that moved at constant speeds. We investigated whether the representation of speed in a continuously varying stimulus context differs from the representation of constant speeds. We recorded from individual MT neurons of fixating macaques while stimuli moved either at a constant speed or in a linearly accelerating or decelerating manner. We found clear speed tuning even when the stimulus consisted of visual motion with gradual speed changes. There were, however, important differences with the speed tuning as measured with constant stimuli: the stimulus context affected neuronal preferred speed as well as the associated tuning width of the speed tuning curves. These acceleration-dependent changes in response lead to an accurate representation of the acceleration of these stimuli in the MT cells. To elucidate the mechanistic basis of this signal, we constructed a stochastic firing rate model based on the constant speed response profiles. This model incorporated each cell's speed tuning and response adaptation dynamics and accurately predicted the response to constant speeds as well as accelerating and decelerating stimuli. Because the response of the model neurons had no explicit acceleration dependence, we conclude that speed-dependent adaptation creates a strong influence of temporal context on the MT response and thereby results in the representation of acceleration signals.

The psychophysical law of speed estimation in Michotte’s causal events

Observers saw an event in which a computer-animated square moved up to and made contact with another, which after a short delay moved off, its motion appearing to be caused by launch by the first square. Observers chose whether the second (launched) square was faster in this causal event than when presented following a long delay (non-causal event). The speed of the second object in causal events was overestimated for a wide range of speeds of the first object (launcher), but accurately assessed in non-causal events. Experiments 2 and 3 showed that overestimation occurred also in other causal displays in which the trajectories were overlapping, successive, spatially separated or inverted but did not occurred with consecutive speeds that did not produce causal percepts. We also found that if the first object in a causal event was faster, then Weber's law holds and overestimation of the launched object speed was proportional to the speed of the launcher. In contrast, if the second object was faster, overestimation was constant, i.e. independent of the launcher. We propose that the particular speed integration of causal display results in overestimation and that the way overestimation depends on V1 phenomenally affects the attribution of the source of V2 motion: either in V1 (in launching) or in V2 (in triggering).

Detection of motion onset and offset: reaction time and visual evoked potential analysis

Manual reaction time (RT) and visual evoked potentials (VEP) were measured in motion onset and offset detection tasks. A considerable homology was observed between the temporal structure of RTs and VEP intervals, provided that the change in motion was detected as soon as the VEP signal has reached critical threshold amplitude. Both manual reactions and VEP rise in latency as the velocity of the onset or offset motion decreases and were well approximated by the same negative power function with the exponent close to -2/3. This indicates that motion processing is normalised by subtracting the initial motion vector from ongoing motion. A comparison of the motion onset VEP signals in two different conditions, in one of which the observer was instructed to abstain from the reaction and in the other to indicate as fast as possible the beginning of the motion, contained accurate information about the manual response.

MEG responses correlated with the visual perception of velocity change

Magnetoencephalography (MEG) was used to find neural activities, in the human brain, involved in perception of velocity changes in visual motion. We recorded MEG responses evoked by the stimuli whose velocity increased by 40% or 80% of baseline velocities of 1.0, 2.0, 3.0, and 4.0 deg/s. The velocity increment threshold and the manual reaction time (RT) were also measured under similar stimulus conditions. To manipulate observer's sensitivity to velocity increments, the MEG responses and the psychophysical performances were measured after adaptation to motion in one direction (adapted condition) or alternating directions (control condition). MEG responses evoked by velocity increments peaked at 200-290 ms (M1), and the M1 amplitudes, especially those obtained for 40% increments, were correlated with the sensitivities, which are the reciprocal of velocity increment thresholds. Furthermore, motion adaptation enhanced sensitivity to velocity increments and increased the M1 amplitudes. These results suggest a close correlation between the perceptual velocity increment and the evoked MEG response. In other words, the results suggest that velocity increments are detectable when there is a constant increment in magnetic neural response. As for latencies, nearly constant value of M1 latency did not quantitatively match a large decrease in manual RT with the increase in the baseline velocity. Motion adaptation reduced neither the peak MEG latency nor the manual RT.

Detection of speed changes during pursuit eye movements

The human visual system is strikingly insensitive to speed changes attributed to the need to infer visual acceleration, observed during stationary fixation, indirectly by comparing velocities integrated over time. The objective of this study was to test if smooth pursuit eye movements improve the detection of speed changes. This was expected for two reasons: first, pursuit reduces the retinal image slip velocity, leading to smaller Weber fractions for velocity changes; secondly, pursuit provides acceleration-dependent retinal position cues unavailable during stationary fixation such as displacements of the target image away from the fovea due to unexpected changes in target velocity. In a first set of experiments thresholds for just noticeable speed changes were measured in ten healthy human subjects confronted with a horizontally moving target, changing its velocity unpredictably during its ramp-like movement. During stationary fixation, the Weber fraction averaged 0.13 for a starting velocity of the target being 15 degrees /s. Smooth pursuit of the same target significantly reduced the Weber fraction down to 0.08. In a second set of experiments, the discrimination of speed changes was tested in patients (n=10) with pursuit disturbances characterized by increased retinal image slip and unidirectional retinal image displacements. These patients showed a strong perceptual bias to report speed increments and an insensitivity to speed decrements. We argue that this asymmetry is a necessary consequence of a mechanism exploiting retinal position errors for the detection of speed change, confronted with directionally biased errors due to the pursuit impairment. In summary, the detection of speed changes is facilitated by pursuit eye movements but is highly susceptible to pursuit insufficiencies.

Discrimination of speed in 5-year-olds and adults: are children up to speed?

We compared thresholds for discriminating changes in speed by 5-year-olds and adults for two reference speeds: 1.5 and 6 degrees s(-1). Both adults and 5-year-olds were more sensitive to changes from the faster than from the slower reference speed. Five-year-olds were less sensitive than adults at both reference speeds but significantly more immature at the slower (1.5 degrees s(-1)) than at the faster (6 degrees s(-1)) reference speed. The findings suggest that the mechanisms underlying speed discrimination are immature in 5-year-olds, especially those that process slower speeds.

Humans use continuous visual feedback from the hand to control both the direction and distance of pointing movements

Vision of the hand during reaching provides dynamic feedback that can be used to control movement. We investigated the relative contributions of feedback about the direction and distance of the hand relative to a target. Subjects made pointing movements in a 3-D virtual environment, in which a small sphere provided dynamic visual feedback about the position of their unseen fingertip. On a subset of trials, the position of the virtual fingertip was smoothly shifted by 2 cm during movement, either (1) in the direction of movement, which would require adjustments to the distance moved, or (2) orthogonal to the direction of movement, which would require adjustments to the direction moved. Despite not noticing the perturbations, subjects adjusted their movements to compensate for both types of visual shifts. Corrective responses to direction perturbations were observed within 117 ms, and response latencies were invariant to movement speed and perturbation onset time. Initial corrections to distance perturbations were smaller and appeared after longer delays of 130-200 ms, and both the speed and magnitude of responses were reduced for early onset perturbations. Simulations of a feedback control model that optimally integrates visual information over time show that the results can be explained by differences in the sensory noise levels in the visual dimensions relevant for direction and distance control.

Visual feedback control of hand movements

We investigated what visual information contributes to on-line control of hand movements. It has been suggested that motion information predominates early in movements but that position information predominates for endpoint control. We used a perturbation method to determine the relative contributions of motion and position information to feedback control. Subjects reached to touch targets in a dynamic virtual environment in which subjects viewed a moving virtual fingertip in place of their own finger. On some trials, we perturbed the virtual fingertip while it moved behind an occluder. Subjects responded to perturbations that selectively altered either motion or position information, indicating that both contribute to feedback control. Responses to perturbations that changed both motion and position information were consistent with superimposed motion-based and position-based control. Results were well fit by a control model that optimally integrates noisy, delayed sensory feedback about both motion and position to estimate hand state.

Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task

Decisions about the visual world can take time to form, especially when information is unreliable. We studied the neural correlate of gradual decision formation by recording activity from the lateral intraparietal cortex (area LIP) of rhesus monkeys during a combined motion-discrimination reaction-time task. Monkeys reported the direction of random-dot motion by making an eye movement to one of two peripheral choice targets, one of which was within the response field of the neuron. We varied the difficulty of the task and measured both the accuracy of direction discrimination and the time required to reach a decision. Both the accuracy and speed of decisions increased as a function of motion strength. During the period of decision formation, the epoch between onset of visual motion and the initiation of the eye movement response, LIP neurons underwent ramp-like changes in their discharge rate that predicted the monkey's decision. A steeper rise in spike rate was associated with stronger stimulus motion and shorter reaction times. The observations suggest that neurons in LIP integrate time-varying signals that originate in the extrastriate visual cortex, accumulating evidence for or against a specific behavioral response. A threshold level of LIP activity appears to mark the completion of the decision process and to govern the tradeoff between accuracy and speed of perception.

Mechanisms of simple and choice reaction to changes in direction of visual motion

Experiments are presented in which a random dot pattern moved vertically upwards (velocity vector V(1)) and then abruptly changed its direction of motion by the angle alpha (velocity vector V(2)), either to the left or to the right, without changing the speed. Subjects performed simple reactions to the direction change, disregarding its sign. In another experiment choice reactions to the same stimuli were performed: the subjects pushed a left button when the direction change was to the left and a right button when the change was to the right. The simple reaction time decreased monotonically with alpha increasing from 11 degrees to 169 degrees, whereas, within the same range of angles, a U-shaped curve described the function of the choice reaction time versus alpha. Both types of reaction time increased with decreasing the base speed. Difficulties are outlined which occur when the angle of change alpha is considered as 'intensity' of the stimulus. Instead, the parameter mid R:V(2)-V(1)mid R:, the absolute value of the difference between the velocity vectors before and after the change, is shown to be a meaningful 'intensity' parameter for the simple reaction task. The parameter V(2N), the speed of the velocity component normal to the initial velocity vector V(1), is suggested as an 'intensity' parameter for the choice reaction task. It is shown that the simple and choice reactions to changes in direction of visual motion are performed by two distinct mechanisms which seem to work in parallel and may be nearly equally fast for small angles of change, when mid R:V(2)-V(1)mid R: approximately V(2N).