Heading and path percepts from visual flow and eye pursuit signals

Attention affects the perception of self-motion direction from optic flow

Many studies have demonstrated that attention affects the perception of many visual features. However, previous studies show conflicting results regarding the effect of attention on the perception of self-motion direction (i.e., heading) from optic flow. To address this question, we conducted three behavioral experiments and found that estimation accuracies of large headings (>14°) decreased with attention load, discrimination thresholds of these headings increased with attention load, and heading estimates were systematically compressed toward the focus of attention. Therefore, the current study demonstrated that attention affected heading perception from optic flow, showing that the perception is both information-driven and cognitive.

Optic-Flow-Based Perception of Two-Dimensional Trajectories and the Effects of a Single Landmark

Human observers can detect their heading direction on a short time scale on the basis of optic flow. We investigated the visual perception and reconstruction of visually travelled two-dimensional (2-D) trajectories from optic flow, with and without a landmark. As in our previous study, seated, stationary subjects wore a head-mounted display in which optic-flow stimuli were shown that simulated various manoeuvres: linear or curvilinear 2-D trajectories over a horizontal plane, with observer orientation either fixed in space, fixed relative to the path, or changing relative to both. Afterwards, they reproduced the perceived manoeuvre with a model vehicle, whose position and orientation were recorded. Previous results had suggested that our stimuli can induce illusory percepts when translation and yaw are unyoked. We tested that hypothesis and investigated how perception of the travelled trajectory depends on the amount of yaw and the average path-relative orientation. Using a structured visual environment instead of only dots, or making available additional extra-retinal information, can improve perception of ambiguous optic-flow stimuli. We investigated the amount of necessary structuring, specifically the effect of additional visual and/or extra-retinal information provided by a single landmark in conditions where illusory percepts occur. While yaw was perceived correctly, the travelled path was less accurately perceived, but still adequately when the simulated orientation was fixed in space or relative to the trajectory. When the amount of yaw was not equal to the rotation of the path, or in the opposite direction, subjects still perceived orientation as fixed relative to the trajectory. This caused trajectory misperception because yaw was wrongly attributed to a rotation of the path: path perception is governed by the amount of yaw in the manoeuvre. Trajectory misperception also occurs when orientation is fixed relative to a curvilinear path, but not tangential to it. A single landmark could improve perception. Our results confirm and extend previous findings that, for unambiguous perception of ego-motion from optic flow, additional information is required in many cases, which can take the form of fairly minimal, visual information.

Representation of head-centric flow in the human motion complex

Recent neuroimaging studies have identified putative homologs of macaque middle temporal area (area MT) and medial superior temporal area (area MST) in humans. Little is known about the integration of visual and nonvisual signals in human motion areas compared with monkeys. Through extra-retinal signals, the brain can factor out the components of visual flow on the retina that are induced by eye-in-head and head-in-space rotations and achieve a representation of flow relative to the head (head-centric flow) or body (body-centric flow). Here, we used functional magnetic resonance imaging to test whether extra-retinal eye-movement signals modulate responses to visual flow in the human MT+ complex. We distinguished between MT and MST and tested whether subdivisions of these areas may transform the retinal flow into head-centric flow. We report that interactions between eye-movement signals and visual flow are not evenly distributed across MT+. Pursuit hardly influenced the response of MT to flow, whereas the responses in MST to the same retinal stimuli were stronger during pursuit than during fixation. We also identified two subregions in which the flow-related responses were boosted significantly by pursuit, one overlapping part of MST. In addition, we found evidence of a metric relation between rotational flow relative to the head and fMRI signals in a subregion of MST. The latter findings provide an important advance over published single-cell recordings in monkey MST. A visual representation of the rotation of the head in the world derived from head-centric flow may supplement semicircular canals signals and is appropriate for cross-calibrating vestibular and visual signals.

Judgments of path, not heading, guide locomotion

To steer a course through the world, people are almost entirely dependent on visual information, of which a key component is optic flow. In many models of locomotion, heading is described as the fundamental control variable; however, it has also been shown that fixating points along or near one's future path could be the basis of an efficient control solution. Here, the authors aim to establish how well observers can pinpoint instantaneous heading and path, by measuring their accuracy when looking at these features while traveling along straight and curved paths. The results showed that observers could identify both heading and path accurately (approximately 3 degrees ) when traveling along straight paths, but on curved paths they were more accurate at identifying a point on their future path (approximately 5 degrees ) than indicating their instantaneous heading (approximately 13 degrees ). Furthermore, whereas participants could track changes in the tightness of their path, they were unable to accurately track the rate of change of heading. In light of these results, the authors suggest it is unlikely that heading is primarily used by the visual system to support active steering.

An algorithmic model of heading perception

On the basis of Hanada and Ejima's (2000) model, an algorithmic model was presented to explain psychophysical data of van den Berg and Beintema (2000) that are inconsistent with vector-subtractive compensation for the rotational flow. The earlier model was modified in order not to use vector-subtractive compensation for the rotational flow. The proposed model computes the center of flow first and then estimates self-rotation; finally, heading is recovered from the center of flow and the estimate of self-rotation. The model explains the data of van de Berg and Beintema (2000). A fusion model of rotation estimates from different sources (efferent signals, proprioceptive feedback, vestibular signals about eye and head rotation, and visual motion) was also presented.