The influence of motion-defined form on the perception of spatially-defined form

Analysis of shape uses local apparent position rather than physical position

Objects are often identified by the shapes of their boundaries. Here, by measuring threshold amplitudes for detection of sinusoidal modulation of local position, orientation and centrifugal speed in a closed path of Gabor patches, we show that the positions of such boundaries are misperceived to accommodate local illusions of orientation context and motion induced positional bias. These two types of illusion are shown to occur independently, but the misperception of position is additive. We conclude that, in the analysis of shape, the visual system uses the apparent rather than the veridical boundary conformation.

Apparent shift in long-range motion trajectory by local pattern orientation

The present study shows that the apparent direction of a moving pattern is systematically affected by its orientation. We found that the perceived direction of motion of a single Gabor grating changing position in discrete steps interleaved by blank inter-stimulus interval (ISI) is biased toward the orientation of the grating. This orientation-induced motion shift peaks for grating orientations ~±15 deg away from the physical motion trajectory and was profound for relatively short distances. Orientation adaptation revealed that the directional shift is determined by the apparent –not the physical –orientation of the grating, and a subsequent experiment demonstrated that directional shift is also influenced by the orientation of the contrast-defined stimulus envelope. Results provide further evidence that the apparent trajectory of a motion stimulus is determined by interactions between motion and pattern information at relatively high levels of visual processing.

The role of motion and number of element locations in mirror symmetry perception

The human visual system has specialised mechanisms for encoding mirror-symmetry and for detecting symmetric motion-directions for objects that loom or recede from the observers. The contribution of motion to mirror-symmetry perception has never been investigated. Here we examine symmetry detection thresholds for stationary (static and dynamic flicker) and symmetrically moving patterns (inwards, outwards, random directions) with and without positional symmetry. We also measured motion detection and direction-discrimination thresholds for horizontal (left, right) and symmetrically moving patterns with and without positional symmetry. We found that symmetry detection thresholds were (a) significantly higher for static patterns, but there was no difference between the dynamic flicker and symmetrical motion conditions, and (b) higher than motion detection and direction-discrimination thresholds for horizontal or symmetrical motion, with or without positional symmetry. In addition, symmetrical motion was as easy to detect or discriminate as horizontal motion. We conclude that whilst symmetrical motion per se does not contribute to symmetry perception, limiting the lifetime of pattern elements does improve performance by increasing the number of element-locations as elements move from one location to the next. This may be explained by a temporal integration process in which weak, noisy symmetry signals are combined to produce a stronger signal.

The influence of orientation jitter and motion on contour saliency and object identification

One of the ultimate goals of vision research is to understand how some elements are grouped together and differentiated from others to form object representations in a complex visual scene. There exists an extensive literature on this grouping/segmentation problem, but most of the studies have used un-recognizable stimuli that have little to do with object recognition per se. We used Gabor-rendered outlines of real-world objects to study some relationships between bottom-up and top-down processes in both spatial- and motion form perception. We manipulated low-level properties, such as element orientation and local motion, while incorporating higher-level properties, such as object complexity and identity, and found that adding local motion improved overall performance in both object detection and object identification tasks. Adding orientation jitter effectively decreased object detection performance in both static and motion conditions, and increased reaction time for identification in the static condition. Orientation jitter had much less effect on reaction times for identification in the local motion condition than in the static condition. Both contour properties ("good continuation") and object properties (identifiability) had a positive effect on detection and reaction time for identification.

Apparent Motion by Edge Discontinuities

When the eyes move vertically across a jagged diamond, a local shift (LS) of edge discontinuities and a global shape distortion (GD) (ie expansion/contraction opposite to that expected by the aperture effect) are perceived. These phenomena cannot be accounted for by a local motion signals integration rule based either on the intersection of constraint lines or on the velocity vector summation. The threshold for GD perception and the salience of LS and GD (1 to 10 scale) were measured in two experiments by different methods and displays. In experiment 1 we induced GD through mimicking LS with a kinetic pattern constituted of a set of circular illusory apertures revealing drifting gratings. The point of subjective equality for compression/expansion was reached for gratings the linear extrapolations of which form an angle of 94.4°. In experiment 2 observers followed a dot moving along the vertical elongation axis of a static jagged diamond (with 70° or 90° angles), varying in the shape (triangular, wave, square), frequency, and amplitude of edge discontinuities. GD scores were correlated with LS scores that were inversely related to frequency/amplitude ratios of triangular edge discontinuities. Data are partially accounted for by averaging neighbouring local motion-capture vectors. Results prove that there are strong interrelations between phenomena in which visual motion affects visual localisation and phenomena involving apparent deformation of global shape.

Interaction between complex motion patterns in the perception of shape

We investigated how different types of complex motion patterns interact in the perception of shape. We used global dot-motion stimuli which consisted of two superimposed groups of dots; one group of dots moved along an ellipsoidal trajectory (target pattern), while the other group of dots was divided into quadrants with dots in alternating sectors moving in radial expanding and radial contracting directions (background pattern). In the first experiment, observers judged whether the major axis of an ellipsoidal motion pattern oriented at 45 degrees or -45 degrees from vertical lay to the right or to the left of a central vertical line. Ellipsoids with different aspect ratios, which controlled both the tilt (left or right of vertical) and the extent of ellipsoidal curvature, were presented to observers using method of constant stimuli. The appearance of the ellipsoidal target pattern was distorted in the presence of background motion. The aspect ratio of the target at which observers perceived the figure to be circular was approximately 0.86 (an aspect ratio of 1.0 indicates a circle), with the pattern's major axis lying in the two sectors that contained contracting motion. This finding may constitute evidence that background motion distorts the perception of space, resulting in a distorted target pattern. However, the distortion effect is limited to conditions for which the speed of the target pattern and background pattern was slow and high contrast, and for when dots forming the target and background patterns were of the same luminance polarity.

The perceived position shift of a pattern that contains internal motion is accompanied by a change in the pattern’s apparent size and shape

When the sinusoidal grating of a "Gabor pattern" is drifted, the apparent position of the pattern shifts in the direction of motion [De Valois, R. L., & De Valois, K. K. (1991). Vernier acuity with stationary moving Gabors. Vision Research, 31, 1619-1626]. We investigated the underlying cause of this illusion by determining whether the effect is a consequence of the internal motion shifting the perceived position of the whole pattern, or a consequence of a shift in the perceived location of the centroid (centre of mass) of the Gabor envelope. While each of these two possible distortions can account for a perceived positional offset, they give different predictions for the apparent size of the stimulus. A simple shift in perceived position results in no change in apparent size, while a centroid shift will likely result in either a decrease or an increase in the pattern's apparent size, depending on whether the trailing or leading edge of the Gabor stimulus is most affected by motion. We examined whether there is a change in the apparent size of Gabor patterns containing a range of grating motion speeds. We found that the perceived size of the pattern increased in the presence of motion as a function of speed, and is thus consistent with a centroid-shift explanation. We verified that this size change is a consequence of an increase in contrast at the leading edge, since the leading edge appears elongated relative to the trailing edge. We furthermore showed that the apparent-position shifts due to motion can be negated by displacing the centroid in the opposite direction to the motion.

A biologically plausible model of human radial frequency perception

Several recent studies have used radial frequency patterns to investigate intermediate-level shape perception, a critical precursor to object recognition. Here, we developed the first neural model of RF perception based on known V4 properties that exhibits many of the characteristics of human RF perception. The model is composed of two main parts: (1) recovery of object position using large-scale non-Fourier V4-like concentric units that respond at the center of concentric contour segments across orientations, and (2) curvature detectors that encode local shape information. Each curvature mechanism combines multiplicatively the responses of three oriented filters, the positions and orientation preferences of which determine the curvature mechanism's tuning properties for position, orientation, and degree of curvature. When responding to RF patterns, peak responses occur at points of maximum curvature. Shape is represented as curvature responses as a function of orientation around the object center, and the cross-correlation of that function with a sine wave peaks when the frequency of the sine wave matches the number of peaks in the stimulus. Cross-correlation strength can be used to model human performance. Model and human performance are comparable for detection, identification, and lateral masking tasks. Moreover, the model also shows size invariance of detection performance due to scaling of the curvature mechanisms. The model is then used to make novel predictions.

Global shape coding for motion-defined radial-frequency contours

The visual system is highly skilled at recovering the shape of complex objects defined exclusively by motion cues. But while low-level and high-level mechanisms involved in shape-from-motion have been studied extensively, intermediate computational stages remain poorly understood. In the present study, we used motion-defined radial-frequency contours--or motion RFs--to probe intermediate stages involved in the computation of motion-defined shape. Motion RFs consisted of a virtual circle of Gabor elements whose carriers drifted at speeds determined by a sinusoidal function of polar angle. Motion RFs elicited vivid percepts of shape, and observers could detect and discriminate radial frequencies up to approximately five cycles. Randomizing Gabor speeds over a small contour segment impaired detection and discrimination performance significantly more than predicted by probability summation. Threshold comparisons between spatial-RF and motion-RF contours ruled out that motion-induced shifts in perceived position (i.e., the DeValois effect) determine shape perception in motion RFs. Together, results indicate that the shape of motion RFs is processed by synergistic mechanisms that perform a global analysis of motion cues over space. These results are integrated with data on perceptual interactions between motion RFs and spatial-RFs and are discussed in terms of cue-specific and cue-invariant representations of object shape in human vision.

The spatial frequency and orientation selectivity of the mechanisms that extract motion-defined contours

The human visual system can undertake a specialized form of motion integration, one that enables the presence of extended spatial contours to be disambiguated from their backgrounds. We have shown previously that the visual system can selectively integrate local motion signals when their directions are along spatial contours and its efficiency is inversely related to the curvature of the contour involved (Ledgeway, T., & Hess, R. F. (2002). Vision Research, 42, 653-659). This integration primarily involves the direction, rather than the speed, of local motion signals. In the present study, we sought to investigate both the spatial frequency and orientation tuning of this specialized contour integration process, using a path detection paradigm. The results show that the tuning for spatial frequency is very broad, in line with previous studies that have examined this issue. In contrast, the orientation selectivity of the mechanism mediating contour extraction under these conditions is relatively narrowband. Thus, spatial frequency but not orientation pooling appears to take place prior to the extraction of motion-defined contours, a situation that is different from that previously shown for spatial contours composed of static, oriented elements.

Contributions of local orientation and position features to shape integration

Contour integration plays an important role in linking local elements into global shape and the binding strength among local elements depends on both orientation and position features. The very high sensitivity reported for detecting the sinusoidal deformation of circular contours may result from the presence and concordance of both orientation and position cues to shape difference. In this study, position and orientation-defined micropatch-sampled radial frequency (MSRF) patterns were employed, which permit the independent assessment of the contributions of local orientation and position features to shape integration. It was demonstrated that, while both local orientation and position features can encode shape deformation, the human visual system is more sensitive to orientation-defined shape difference than to position-defined shape difference. Furthermore, integration of the local orientation feature into shape is more than two times stronger than that of local position, and may involve a global pooling mechanism. Nevertheless, optimal shape discrimination performance requires the analysis of both local orientation and position features.