Evidence for scene-based motion correspondence

Self-reference modulates the perception of visual apparent motion

Visual apparent motion is a perceptual illusion where sequentially presented static stimuli containing no physically continuous motion are perceived as moving. In the current study, we examined whether and how self-reference, as a typical high-level information processing, could modulate perceptual categorization of the apparent motion in Ternus display, even when self-reference is task-irrelevant. Two frames were consecutively presented, with the first frame consisting of two identical stimuli (e.g., two rectangles) on the leftmost and the middle positions and the second frame consisting of two stimuli on the middle and the rightmost positions. Depending on the inter-stimulus interval (ISI) between the two frames, the display could be perceived as showing Element Motion (EM), with the peripheral stimulus moving from one side to the other while the middle stimulus remains stationary or flashes briefly at the middle position, or Group Motion (GM), with both stimuli appearing to move as a whole. Participants were tested in this configuration and then learned to associate different labels (Self, Friend, Stranger) with geometric shapes (Circle, Rectangle, Triangle). They were tested again in the new configuration. Results showed that after association (vs. before association), participants were more likely to perceive the Ternus display of self-associated shapes as GM, but this effect did not appear for friend-associated or stranger-associated shapes. Self-referential processing spatially "glues" the two stimuli in a frame with the concept of "Self," leading to a more dominant percept of GM.

Perception of Happening: How the Brain Deals with the No-History Problem

In physics, the temporal dimension has units of infinitesimally brief duration. Given this, how is it possible to perceive things, such as motion, music, and vibrotactile stimulation, that involve extension across many units of time? To address this problem, it is proposed that there is what is termed an "information construct of happening" (ICOH), a simultaneous representation of recent, temporally differentiated perceptual information on the millisecond time scale. The main features of the ICOH are (i) time marking, semantic labeling of all information in the ICOH with ordinal temporal information and distance from what is informationally identified as the present moment, (ii) vector informational features that specify kind, direction, and rate of change for every feature in a percept, and (iii) connectives, information relating vector informational features at adjacent temporal locations in the ICOH. The ICOH integrates products of perceptual processing with recent historical information in sensory memory on the subsecond time scale. Perceptual information about happening in informational sensory memory is encoded in semantic form that preserves connected semantic trails of vector and timing information. The basic properties of the ICOH must be supported by a general and widespread timing mechanism that generates ordinal and interval timing information and it is suggested that state-dependent networks may suffice for that purpose. Happening, therefore, is perceived at a moment and is constituted by an information structure of connected recent historical information.

Illusory size determines the perception of ambiguous apparent motion

The visual system constructs perceptions based on ambiguous information. For motion perception, the correspondence problem arises, i.e., the question of which object went where. We asked at which level of processing correspondence is solved – lower levels based on information that is directly available in the retinal input or higher levels based on information that has been abstracted beyond the input directly available at the retina? We used a Ponzo-like illusion to manipulate the perceived size and separations of elements in an ambiguous apparent motion display. Specifically, we presented Ternus displays – for which the type of motion that is perceived depends on how correspondence is resolved – at apparently different distances from the viewer using pictorial depth cues. We found that the perception of motion depended on the apparent depth of the displays, indicating that correspondence processes utilize information that is produced at higher-level processes.

Effects of Transient and Nontransient Changes of Surface Feature on Object Correspondence

Object correspondence is a fundamental problem in perception. Classic theories hold that the computation of correspondence is solely based on spatiotemporal information. Recent research showed that surface features also play an important role. However, the surface features of objects in many studies did not change throughout a trial. This study investigated the effect of feature change on object correspondence using the object-reviewing paradigm. Two moving objects underwent transient feature changes on color dimension (Experiment 1A) or a combination of three dimensions (Experiment 2A). Moreover, the objects moved behind four occluders to make the feature change nontransient (Experiments 1B and 2B). Object-specific preview benefits were reduced or eliminated when feature changes were transient, but the benefits were not affected when feature changes were nontransient. The effects of transient versus nontransient changes of surface feature in object correspondence are discussed.

How voluntary spatial attention influences feature biases in object correspondence

Our visual system is able to establish associations between corresponding images across space and time and to maintain the identity of objects, even though the information our retina receives is ambiguous. It has been shown that lower level factors-as, for example, spatiotemporal proximity-can affect this correspondence problem. In addition, higher level factors-as, for example, semantic knowledge-can influence correspondence, suggesting that correspondence might also be solved at a higher object-based level of processing, which could be mediated by attention. To test this hypothesis, we instructed participants to voluntarily direct their attention to individual elements in the Ternus display. In this ambiguous apparent motion display, three elements are aligned next to each other and shifted by one position from one frame to the next. This shift can be either perceived as all elements moving together (group motion) or as one element jumping across the others (element motion). We created a competitive Ternus display, in which the color of the elements was manipulated in such a way that the percept was biased toward element motion for one color and toward group motion for another color. If correspondence can be established at an object-based level, attending toward one of the biased elements should increase the likelihood that this element determines the correspondence solution and thereby that the biased motion is perceived. Our results were in line with this hypothesis providing support for an object-based correspondence process that is based on a one-to-one mapping of the most similar elements mediated via attention.

Competition between color and luminance in motion correspondence

The visual system needs to solve the correspondence problem (i.e., which elements belong together across space and time) to allow stable representations of objects. It has been shown that spatiotemporal and feature information can influence this correspondence process, but it is unclear how these factors interact with each other, especially when they are more or less prominent due to changes in contrast magnitude. We investigated this question using a variation of the Ternus display, an ambiguous apparent motion display, in which three elements can either be perceived as moving together (group motion) or as one element jumping across the others (element motion). In the first experiment, we biased the percept by presenting some of the elements with the same feature (isoluminant color or luminance), such that they were either compatible with group motion or with element motion (simple feature biases). To change the strength of the feature bias, we manipulated the contrast magnitude of the feature. In three more experiments we introduced competitive displays, in which some of the elements showed a color/luminance based element bias of varying contrast magnitude, while other elements showed a luminance/color based group bias of varying contrast magnitude (competing feature bias). We found that for a simple feature bias the contrast magnitude did not affect the strength of the bias. For competing feature biases, however, the contrast magnitude did influence correspondence, as the bias strength increased with contrast. The implications of our results for current motion and feature-based theories of correspondence are discussed.

Flicker-Defined Forms in the Ternus Display

Odic and Pratt (2008, Perception, 37, 1790-1804) proposed that the type of movement seen in the bistable Ternus display depends on the elements' temporal summation of contrast relative to the background. To test this theory, participants viewed a flicker-defined Ternus display where the elements had no temporal summation of contrast. Participants also viewed a luminance-defined control condition. Five interstimulus intervals (ISIs) (0, 20, 40, 60, and 80 ms) and two stimulus durations (SDs) (200 and 400 ms) were used in each condition. If temporal summation of contrast does not influence perceived group and end-to-end movement in flicker-defined forms, it was expected that the frequency of their reports would be equal to those in the luminance- defined control condition at the same ISIs and SDs. As predicted, the main effect of condition was not significant and participants reported both percepts at expected rates in both conditions, contrary to the predictions of Odic and Pratt (2008).

Taylor JE, Pratt J. Frogs Jump Forward: Semantic Knowledge Influences the Perception of Element Motion in the Ternus Display

The Ternus effect is a robust illusion of motion that produces element motion at short interstimulus intervals (ISIs; <50 ms) and group motion at longer ISIs (>50 ms). Previous research has shown that the nature of the stimuli (e.g., similarity, grouping), not just ISI, can influence the likelihood of perceiving element or group motion. We examined if semantic knowledge can also influence what type of illusory motion is perceived. In Experiment 1, we used a modified Ternus display with pictures of frogs in a jump-ready pose facing forwards or backwards to the direction of illusory motion. Participants perceived more element motion with the forward-facing frogs and more group motion with the backward-facing frogs. Experiment 2 tested whether this effect would still occur with line drawings of frogs, or if a more life-like image was necessary. Experiment 3 tested whether this effect was due to visual asymmetries inherent in the jumping pose. Experiment 4 tested whether frogs in a “non-jumping,” sedentary pose would replicate the original effect. These experiments elucidate the role of semantic knowledge in the Ternus effect. Prior knowledge of the movement of certain animate objects, in this case, frogs can also bias the perception of element or group motion.