Human ego-motion perception

Neuronal processing of translational optic flow in the visual system of the shore crab Carcinus maenas

This paper describes a search for neurones sensitive to optic flow in the visual system of the shore crab Carcinus maenas using a procedure developed from that of Krapp and Hengstenberg. This involved determining local motion sensitivity and its directional selectivity at many points within the neurone's receptive field and plotting the results on a map. Our results showed that local preferred directions of motion are independent of velocity, stimulus shape and type of motion (circular or linear). Global response maps thus clearly represent real properties of the neurones' receptive fields. Using this method, we have discovered two families of interneurones sensitive to translational optic flow. The first family has its terminal arborisations in the lobula of the optic lobe, the second family in the medulla. The response maps of the lobula neurones (which appear to be monostratified lobular giant neurones) show a clear focus of expansion centred on or just above the horizon, but at significantly different azimuth angles. Response maps such as these, consisting of patterns of movement vectors radiating from a pole, would be expected of neurones responding to self-motion in a particular direction. They would be stimulated when the crab moves towards the pole of the neurone's receptive field. The response maps of the medulla neurones show a focus of contraction, approximately centred on the horizon, but at significantly different azimuth angles. Such neurones would be stimulated when the crab walked away from the pole of the neurone's receptive field. We hypothesise that both the lobula and the medulla interneurones are representatives of arrays of cells, each of which would be optimally activated by self-motion in a different direction. The lobula neurones would be stimulated by the approaching scene and the medulla neurones by the receding scene. Neurones tuned to translational optic flow provide information on the three-dimensional layout of the environment and are thought to play a role in the judgment of heading.

Velocity discrimination thresholds for flowfield motions with moving observers

The visual flow field, produced by forward locomotion, contains useful information about many aspects of visually guided behavior. But locomotion itself also contributes to possible distortions by adding head bobbing motions. Here we examine whether vertical head bobbing affects velocity discrimination thresholds and how the system may compensate for the distortions. Vertical head and eye movements while fixating were recorded during standing, walking or running on a treadmill. Bobbing noise was found to be larger during locomotion. The same observers were equally good at discriminating velocity increases in large accelerating flow fields when standing or walking or running. Simulated head bobbing was compensated when produced by pursuit eye movements, but not when it was part of the flow field. The results showed that these two contributions are additive and dealt with independently before they are combined. Distortions produced by body/head oscillations may also be compensated. Visual performance during running was at least as good as during walking, suggesting more efficient compensation mechanisms for running.

Spatial Coding of the Predicted Impact Location of a Looming Object

Avoiding or intercepting looming objects implies a precise estimate of both time until contact and impact location. In natural situations, extrapolating a movement trajectory relative to some egocentric landmark requires taking into account variations in retinal input associated with moment-to-moment changes in body posture. Here, human observers predicted the impact location on their face of an approaching stimulus mounted on a robotic arm, while we systematically manipulated the relation between eye, head, and trunk orientation. The projected impact point on the observer's face was estimated most accurately when the target originated from a location aligned with both the head and eye axes. Eccentric targets with respect to either axis resulted in a systematic perceptual bias ipsilateral to the trajectory's origin. We conclude that (1) predicting the impact point of a looming target requires combining retinal information with eye position information, (2) that this computation is accomplished accurately for some, but not all, possible combinations of these cues, (3) that the representation of looming trajectories is not formed in a single, canonical reference frame, and (4) that the observed perceptual biases could reflect an automatic adaptation for interceptive/defensive actions within near peripersonal space.

A laterally interconnected neural architecture in MST accounts for psychophysical discrimination of complex motion patterns

The complex patterns of visual motion formed across the retina during self-motion, often referred to as optic flow, provide a rich source of information describing our dynamic relationship within the environment. Psychophysical studies indicate the existence of specialized detectors for component motion patterns (radial, circular, planar) that are consistent with the visual motion properties of cells in the medial superior temporal area (MST) of nonhuman primates. Here we use computational modeling and psychophysics to investigate the structural and functional role of these specialized detectors in performing a graded motion pattern (GMP) discrimination task. In the psychophysical task perceptual discrimination varied significantly with the type of motion pattern presented, suggesting perceptual correlates to the preferred motion bias reported in MST. Simulated perceptual discrimination in a population of independent MST-like neural responses showed inconsistent psychophysical performance that varied as a function of the visual motion properties within the population code. Robust psychophysical performance was achieved by fully interconnecting neural populations such that they inhibited nonpreferred units. Taken together, these results suggest that robust processing of the complex motion patterns associated with self-motion and optic flow may be mediated by an inhibitory structure of neural interactions in MST.