Spatial versus temporal grouping in a modified Ternus display

Education and visual neuroscience: A mini-review

Neuroscience, especially visual neuroscience, is a burgeoning field that has greatly shaped the format and efficacy of education. Moreover, findings from visual neuroscience are an ongoing source of great progress in pedagogy. In this mini-review, I review existing evidence and areas of active research to describe the fundamental questions and general applications for visual neuroscience as it applies to education. First, I categorize the research questions and future directions for the role of visual neuroscience in education. Second, I juxtapose opposing views on the roles of neuroscience in education and reveal the "neuromyths" propagated under the guise of educational neuroscience. Third, I summarize the policies and practices applied in different countries and for different age ranges. Fourth, I address and discuss the merits of visual neuroscience in art education and of visual perception theories (e.g., those concerned with perceptual organization with respect to space and time) in reading education. I consider how vision-deprived students could benefit from current knowledge of brain plasticity and visual rehabilitation methods involving compensation from other sensory systems. I also consider the potential educational value of instructional methods based on statistical learning in the visual domain. Finally, I outline the accepted translational framework for applying findings from educational neuroscience to pedagogical theory.

How voluntary spatial attention influences feature biases in object correspondence

Our visual system is able to establish associations between corresponding images across space and time and to maintain the identity of objects, even though the information our retina receives is ambiguous. It has been shown that lower level factors-as, for example, spatiotemporal proximity-can affect this correspondence problem. In addition, higher level factors-as, for example, semantic knowledge-can influence correspondence, suggesting that correspondence might also be solved at a higher object-based level of processing, which could be mediated by attention. To test this hypothesis, we instructed participants to voluntarily direct their attention to individual elements in the Ternus display. In this ambiguous apparent motion display, three elements are aligned next to each other and shifted by one position from one frame to the next. This shift can be either perceived as all elements moving together (group motion) or as one element jumping across the others (element motion). We created a competitive Ternus display, in which the color of the elements was manipulated in such a way that the percept was biased toward element motion for one color and toward group motion for another color. If correspondence can be established at an object-based level, attending toward one of the biased elements should increase the likelihood that this element determines the correspondence solution and thereby that the biased motion is perceived. Our results were in line with this hypothesis providing support for an object-based correspondence process that is based on a one-to-one mapping of the most similar elements mediated via attention.

Competition between color and luminance in motion correspondence

The visual system needs to solve the correspondence problem (i.e., which elements belong together across space and time) to allow stable representations of objects. It has been shown that spatiotemporal and feature information can influence this correspondence process, but it is unclear how these factors interact with each other, especially when they are more or less prominent due to changes in contrast magnitude. We investigated this question using a variation of the Ternus display, an ambiguous apparent motion display, in which three elements can either be perceived as moving together (group motion) or as one element jumping across the others (element motion). In the first experiment, we biased the percept by presenting some of the elements with the same feature (isoluminant color or luminance), such that they were either compatible with group motion or with element motion (simple feature biases). To change the strength of the feature bias, we manipulated the contrast magnitude of the feature. In three more experiments we introduced competitive displays, in which some of the elements showed a color/luminance based element bias of varying contrast magnitude, while other elements showed a luminance/color based group bias of varying contrast magnitude (competing feature bias). We found that for a simple feature bias the contrast magnitude did not affect the strength of the bias. For competing feature biases, however, the contrast magnitude did influence correspondence, as the bias strength increased with contrast. The implications of our results for current motion and feature-based theories of correspondence are discussed.

Flicker-Defined Forms in the Ternus Display

Odic and Pratt (2008, Perception, 37, 1790-1804) proposed that the type of movement seen in the bistable Ternus display depends on the elements' temporal summation of contrast relative to the background. To test this theory, participants viewed a flicker-defined Ternus display where the elements had no temporal summation of contrast. Participants also viewed a luminance-defined control condition. Five interstimulus intervals (ISIs) (0, 20, 40, 60, and 80 ms) and two stimulus durations (SDs) (200 and 400 ms) were used in each condition. If temporal summation of contrast does not influence perceived group and end-to-end movement in flicker-defined forms, it was expected that the frequency of their reports would be equal to those in the luminance- defined control condition at the same ISIs and SDs. As predicted, the main effect of condition was not significant and participants reported both percepts at expected rates in both conditions, contrary to the predictions of Odic and Pratt (2008).

Evidence for scene-based motion correspondence

To maintain stable object representations as our eyes or the objects themselves move, the visual system must determine how newly sampled information relates to existing object representations. To solve this correspondence problem, the visual system uses not only spatiotemporal information (e.g., the spatial and temporal proximity between elements), but also feature information (e.g., the similarity in size or luminance between elements). Here we asked whether motion correspondence relies solely on image-based feature information, or whether it is influenced by scene-based information (e.g., the perceived sizes of surfaces or the perceived illumination conditions). We manipulated scene-based information separately from image-based information in the Ternus display, an ambiguous apparent-motion display, and found that scene-based information influences how motion correspondence is resolved, indicating that theories of motion correspondence that are based on "scene-blind" mechanisms are insufficient.

The role of spatiotemporal and spectral cues in segregating short sound events: evidence from auditory Ternus display

Previous studies using auditory sequences with rapid repetition of tones revealed that spatiotemporal cues and spectral cues are important cues used to fuse or segregate sound streams. However, the perceptual grouping was partially driven by the cognitive processing of the periodicity cues of the long sequence. Here, we investigate whether perceptual groupings (spatiotemporal grouping vs. frequency grouping) could also be applicable to short auditory sequences, where auditory perceptual organization is mainly subserved by lower levels of perceptual processing. To find the answer to that question, we conducted two experiments using an auditory Ternus display. The display was composed of three speakers (A, B and C), with each speaker consecutively emitting one sound consisting of two frames (AB and BC). Experiment 1 manipulated both spatial and temporal factors. We implemented three 'within-frame intervals' (WFIs, or intervals between A and B, and between B and C), seven 'inter-frame intervals' (IFIs, or intervals between AB and BC) and two different speaker layouts (inter-distance of speakers: near or far). Experiment 2 manipulated the differentiations of frequencies between two auditory frames, in addition to the spatiotemporal cues as in Experiment 1. Listeners were required to make two alternative forced choices (2AFC) to report the perception of a given Ternus display: element motion (auditory apparent motion from sound A to B to C) or group motion (auditory apparent motion from sound 'AB' to 'BC'). The results indicate that the perceptual grouping of short auditory sequences (materialized by the perceptual decisions of the auditory Ternus display) was modulated by temporal and spectral cues, with the latter contributing more to segregating auditory events. Spatial layout plays a less role in perceptual organization. These results could be accounted for by the 'peripheral channeling' theory.

A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization

In 1912, Max Wertheimer published his paper on phi motion, widely recognized as the start of Gestalt psychology. Because of its continued relevance in modern psychology, this centennial anniversary is an excellent opportunity to take stock of what Gestalt psychology has offered and how it has changed since its inception. We first introduce the key findings and ideas in the Berlin school of Gestalt psychology, and then briefly sketch its development, rise, and fall. Next, we discuss its empirical and conceptual problems, and indicate how they are addressed in contemporary research on perceptual grouping and figure-ground organization. In particular, we review the principles of grouping, both classical (e.g., proximity, similarity, common fate, good continuation, closure, symmetry, parallelism) and new (e.g., synchrony, common region, element and uniform connectedness), and their role in contour integration and completion. We then review classic and new image-based principles of figure-ground organization, how it is influenced by past experience and attention, and how it relates to shape and depth perception. After an integrated review of the neural mechanisms involved in contour grouping, border ownership, and figure-ground perception, we conclude by evaluating what modern vision science has offered compared to traditional Gestalt psychology, whether we can speak of a Gestalt revival, and where the remaining limitations and challenges lie. A better integration of this research tradition with the rest of vision science requires further progress regarding the conceptual and theoretical foundations of the Gestalt approach, which is the focus of a second review article.

Spatio-temporal priority revisited: the role of feature identity and similarity for object correspondence in apparent motion

We live in a dynamic environment in which objects change location over time. To maintain stable object representations the visual system must determine how newly sampled information relates to existing object representations, the correspondence problem. Spatiotemporal information is clearly an important factor that the visual system takes into account when solving the correspondence problem, but is feature information irrelevant as some theories suggest? The Ternus display provides a context in which to investigate solutions to the correspondence problem. Two sets of three horizontally aligned disks, shifted by one position, were presented in alternation. Depending on how correspondence is resolved, these displays are perceived either as one disk "jumping" from one end of the row to the other (element motion) or as a set of three disks shifting back and forth together (group motion). We manipulated a feature (e.g., color) of the disks such that, if features were taken into account by the correspondence process, it would bias the resolution of correspondence toward one version or the other. Features determined correspondence, whether they were luminance-defined or not. Moreover, correspondence could be established on the basis of similarity, when features were not identical between alternations. Finally, the stronger the feature information supported a certain correspondence solution the more it dominated spatiotemporal information.

Motion and tilt aftereffects occur largely in retinal, not in object, coordinates in the Ternus-Pikler display

Recent studies have shown that a variety of aftereffects occurs in a non-retinotopic frame of reference. These findings have been taken as strong evidence that remapping of visual information occurs in a hierarchic manner in the human cortex with an increasing magnitude from early to higher levels. Other studies, however, failed to find non-retinotopic aftereffects. These experiments all relied on paradigms involving eye movements. Recently, we have developed a new paradigm, based on the Ternus-Pikler display, which tests retinotopic vs. non-retinotopic processing without the involvement of eye movements. Using this paradigm, we found strong evidence that attention, form, and motion processing can occur in a non-retinotopic frame of reference. Here, we show that motion and tilt aftereffects are largely retinotopic.

Attention modulates spatio-temporal grouping

Dynamic stimuli are ubiquitous in natural viewing conditions implying that grouping operations need to operate, not only in space, but also jointly in space and time. Moreover, in natural viewing, attention plays an important role in controlling how resources are allocated. We investigated how attention interacts with spatio-temporal perceptual grouping by using a bistable stimulus, called the Ternus-Pikler display. Ternus-Pikler displays can give rise to two different motion percepts, called Element Motion (EM) and Group Motion (GM), the former dominating at short Inter-Stimulus Intervals (ISIs) and the latter at long ISIs. Our results indicate that GM grouping requires more attentional resources than EM grouping. Different theoretical accounts of perceptual grouping and attention are discussed and evaluated in the light of the current results.

Visual apparent motion can be modulated by task-irrelevant lexical information

Previous studies have repeatedly demonstrated the impact of Gestalt structural grouping principles upon the parsing of motion correspondence in ambiguous apparent motion. Here, by embedding Chinese characters in a visual Ternus display that comprised two stimulus frames, we showed that the perception of visual apparent motion can be modulated by activation of task-irrelevant lexical representations. Each frame had two disks, with the second disk of the first frame and the first disk of the second frame being presented at the same location. Observers could perceive either "element motion," in which the endmost disk is seen as moving back and forth while the middle disk at the central position remains stationary, or "group motion," in which both disks appear to move laterally as a whole. More reports of group motion, as opposed to element motion, were obtained when the embedded characters formed two-character compound words than when they formed nonwords, although this lexicality effect appeared to be attenuated by the use of the same characters at the overlapping position across the two frames. Thus, grouping of visual elements in a changing world can be guided by both structural principles and prior world knowledge, including lexical information.