Associative grouping: perceptual grouping of shapes by association

Learned associations serve as target proxies during difficult but not easy visual search

The target template contains information in memory that is used to guide attention during visual search and is typically thought of as containing features of the actual target object. However, when targets are hard to find, it is advantageous to use other information in the visual environment that is predictive of the target's location to help guide attention. The purpose of these studies was to test if newly learned associations between face and scene category images lead observers to use scene information as a proxy for the face target. Our results showed that scene information was used as a proxy for the target to guide attention but only when the target face was difficult to discriminate from the distractor face; when the faces were easy to distinguish, attention was no longer guided by the scene unless the scene was presented earlier. The results suggest that attention is flexibly guided by both target features as well as features of objects that are predictive of the target location. The degree to which each contributes to guiding attention depends on the efficiency with which that information can be used to decode the location of the target in the current moment. The results contribute to the view that attentional guidance is highly flexible in its use of information to rapidly locate the target.

Perceptual Grouping Strategies in a Letter Identification Task: Strategic Connections, Selection, and Segmentation

Although perceptual grouping has been widely studied, its mechanisms remain poorly understood. We propose a neural model of grouping that, through top-down control of its circuits, implements a grouping strategy involving both a connection strategy (which elements to connect) and a selection strategy (that defines spatiotemporal properties of a selection signal to segment target elements and facilitate identification). We apply the model to a letter discrimination task that investigated relationships among uniform connectedness and the grouping principles of proximity and shape similarity. Participants reported whether small circles formed a global letter E or H, and these circles could be connected by a line or be embedded in a matrix of squares. In the model, a good grouping strategy for this task consists of a connection strategy that connects circles but not squares for all conditions and a selection strategy that uses a selection signal of varying size, depending on whether squares were present. Consistent with empirical results, which were verified in two replication studies, model performance is worse with distractor squares, and line connectors improve performance only in the condition with squares. Rather than relying on abstract grouping principles, we show how the empirical results can be explained in terms of observers implementing a task-dependent grouping strategy that promotes overall performance.

When forgetting fosters learning: A neural network model for statistical learning

Learning often requires splitting continuous signals into recurring units, such as the discrete words constituting fluent speech; these units then need to be encoded in memory. A prominent candidate mechanism involves statistical learning of co-occurrence statistics like transitional probabilities (TPs), reflecting the idea that items from the same unit (e.g., syllables within a word) predict each other better than items from different units. TP computations are surprisingly flexible and sophisticated. Humans are sensitive to forward and backward TPs, compute TPs between adjacent items and longer-distance items, and even recognize TPs in novel units. We explain these hallmarks of statistical learning with a simple model with tunable, Hebbian excitatory connections and inhibitory interactions controlling the overall activation. With weak forgetting, activations are long-lasting, yielding associations among all items; with strong forgetting, no associations ensue as activations do not outlast stimuli; with intermediate forgetting, the network reproduces the hallmarks above. Forgetting thus is a key determinant of these sophisticated learning abilities. Further, in line with earlier dissociations between statistical learning and memory encoding, our model reproduces the hallmarks of statistical learning in the absence of a memory store in which items could be placed.

Statistically defined visual chunks engage object-based attention

Although objects are the fundamental units of our representation interpreting the environment around us, it is still not clear how we handle and organize the incoming sensory information to form object representations. By utilizing previously well-documented advantages of within-object over across-object information processing, here we test whether learning involuntarily consistent visual statistical properties of stimuli that are free of any traditional segmentation cues might be sufficient to create object-like behavioral effects. Using a visual statistical learning paradigm and measuring efficiency of 3-AFC search and object-based attention, we find that statistically defined and implicitly learned visual chunks bias observers' behavior in subsequent search tasks the same way as objects defined by visual boundaries do. These results suggest that learning consistent statistical contingencies based on the sensory input contributes to the emergence of object representations.

Distance perception warped by social relations: Social interaction information compresses distance

Though distance perception feeds the fundamental input that constructs a visual structure of the world, the suggestion has been made that it is constrained by this constructed structure. Instead of focusing on the physically defined structure, this study investigates whether and how social relations, especially the quality of social interaction (how individuals interact) rather than its content (what type of social interaction), precisely influences distance perception. The quality of social interaction was framed as an actor's intent and incurred outcome regarding another individual, whether helpful or harmful. Through visual animations, intent was operationalized as an agent's (i.e., actor's) intentional or unintentional act having an influence on another agent (i.e., affectee). Two experiments were conducted. In Experiment 1, the act was helpful, resulting in small or great beneficial consequences to the affectee. In Experiment 2, the act was harmful and resulted in small or great losses to the affectee. We found that when the help or harm had a large effect on others (the great-benefits or great-losses conditions), distance was perceived as shorter than when help or harm was minor, and the actor's intent did not affect distance perception. This suggests that, regardless of the type of social interaction, distance perception is mainly influenced by the outcome of an act not by the actor's intent. It implies that the perceived quality of social interaction creates a social constraint on distance perception. These findings are consistent with the idea that the intent and outcome of an action are assessed differently, and they help us understand how social relation penetrates the perceptual system.

Perceptual Grouping of Closed Contours Is Disrupted by the Interpretation of the Scene Layout

Closure is one of the grouping principles in perceptual organization. Studies have shown that closure can be affected by several factors, specifically by low-level image features. However, the effects of high-level non-image factors on grouping by closure are unknown. In two experiments we investigated how closure is affected when depth information is introduced to the 2D closed contours, whilst the other 2D features remain intact. The first experiment showed that the grouping of closed contours was disrupted by the manipulation in 3D layout. The second experiment showed that thus disruption resulted in the impairment of searching efficiency. These findings suggest that closure is not only determined by the image features, but also affected by the interpretation of the contextual scene layout.

Inversion Reveals Perceptual Asymmetries in the Configural Processing of Human Body

Ambiguous human bodies performing unimanual/unipedal actions are perceived more frequently as right-handed/footed rather than left-handed/footed, which suggests a perceptual and attentional bias toward the right side of others’ body. A bias toward the right arm of human bodies could be adaptive in social life, most social interactions occurring with right-handed individuals, and the implicit knowledge that the dominant hand of humans is usually placed on their right side might also be included in body configural information. Given that inversion disrupts configural processing for human bodies, we investigated whether inversion reduces the bias toward the right side of human bodies. Consistent with our hypothesis, when presented with ambiguous stimuli depicting humans performing lateralized actions or movements, participants perceived a greater proportion of right-handed figures when the stimuli were shown upright than when the stimuli were shown inverted. The present findings seem to confirm our hypothesis that body configural information may include some form of knowledge about the probable handedness of other individuals, although alternative accounts involving the role of experience cannot be ruled out.

The Relationship between Sitting and the Use of Symmetry As a Cue to Figure-Ground Assignment in 6.5-Month-Old Infants

Two experiments examined the relationship between emerging sitting ability and sensitivity to symmetry as a cue to figure-ground (FG) assignment in 6.5-month-old infants (N = 80). In each experiment, infants who could sit unassisted (as indicated by parental report in Experiment 1 and by an in-lab assessment in Experiment 2) exhibited sensitivity to symmetry as a cue to FG assignment, whereas non-sitting infants did not. Experiment 2 further revealed that sensitivity to this cue is not related to general cognitive abilities as indexed using a non-related visual habituation task. Results demonstrate an important relationship between motor development and visual perception and further suggest that the achievement of important motor milestones such as stable sitting may be related to qualitative changes in sensitivity to monocular depth assignment cues such as symmetry.

Neural Discriminability of Object Features Predicts Perceptual Organization

How does the neural representation of simple visual features affect perceptual operations, such as perceptual grouping? If the strength of feature representations in the brain is indicative of how the perceptual system partitions information into visual elements, then identifying the underlying neural representation may determine why things look the way they do. During functional MRI, participants viewed objects that varied along three feature dimensions: shape, color, and orientation. Afterward, participants performed an independent perceptual-grouping task outside the scanner to measure the strength of feature grouping. In lateral occipital cortex, neural feature discriminability, characterized using functional MRI multivariate pattern classification, positively predicted feature grouping strength: The more distinct the neural representations of a particular feature, the stronger the grouping was for that feature outside the scanner. Thus, variation in neural feature representation can be quantified to predict perceptual organization.

Changing viewer perspectives reveals constraints to implicit visual statistical learning

Statistical learning-learning environmental regularities to guide behavior-likely plays an important role in natural human behavior. One potential use is in search for valuable items. Because visual statistical learning can be acquired quickly and without intention or awareness, it could optimize search and thereby conserve energy. For this to be true, however, visual statistical learning needs to be viewpoint invariant, facilitating search even when people walk around. To test whether implicit visual statistical learning of spatial information is viewpoint independent, we asked participants to perform a visual search task from variable locations around a monitor placed flat on a stand. Unbeknownst to participants, the target was more often in some locations than others. In contrast to previous research on stationary observers, visual statistical learning failed to produce a search advantage for targets in high-probable regions that were stable within the environment but variable relative to the viewer. This failure was observed even when conditions for spatial updating were optimized. However, learning was successful when the rich locations were referenced relative to the viewer. We conclude that changing viewer perspective disrupts implicit learning of the target's location probability. This form of learning shows limited integration with spatial updating or spatiotopic representations.

Priming effects on the perceived grouping of ambiguous dot patterns

For ambiguous stimuli, complex dynamics guide processes of perceptual grouping. Previous studies have suggested two opposing effects on grouping that are produced by the preliminary stimulus state: one that enhances grouping towards the existing structure, and another that opposes this structure. To examine effects of the preliminary state on grouping directly, measurements were made of perceived grouping of dot patterns that followed a visual prime. Three stimuli were presented in sequence: prime, target, and mask. Targets were composed of an evenly spaced dot grid in which grouping was established by similarity in luminance. Subjects indicated the dominant perceived grouping. The prime either corresponded to or opposed the prevailing organization of the target. Contrary to the hypothesis, solid-line primes biased grouping away from the structure of the prime, even when the prevailing organization of dot patterns strongly favored the primes' structure. This effect occurred, although to a lesser extent, when primes did not occupy the same location of targets, but were presented in a marginal area surrounding the grid. Priming effects did not occur for primes constructed of dot patterns. Effects found here may be attributed to a forward masking effect by primes, which more effectively disrupts grouping of patterns matched to the prime. Effects may also be attributed to a type of pattern contrast, in which a grouped pattern dissimilar to primes gains salience. For the pattern contrast model, the partial activation of multiple grouped configurations is compared to the pattern of the solid-line primes.

Automatic feature-based grouping during multiple object tracking

Contour interpolation automatically binds targets with distractors to impair multiple object tracking (Keane, Mettler, Tsoi, & Kellman, 2011). Is interpolation special in this regard or can other features produce the same effect? To address this question, we examined the influence of eight features on tracking: color, contrast polarity, orientation, size, shape, depth, interpolation, and a combination (shape, color, size). In each case, subjects tracked 4 of 8 objects that began as undifferentiated shapes, changed features as motion began (to enable grouping), and returned to their undifferentiated states before halting. We found that intertarget grouping improved performance for all feature types except orientation and interpolation (Experiment 1 and Experiment 2). Most importantly, target-distractor grouping impaired performance for color, size, shape, combination, and interpolation. The impairments were, at times, large (>15% decrement in accuracy) and occurred relative to a homogeneous condition in which all objects had the same features at each moment of a trial (Experiment 2), and relative to a "diversity" condition in which targets and distractors had different features at each moment (Experiment 3). We conclude that feature-based grouping occurs for a variety of features besides interpolation, even when irrelevant to task instructions and contrary to the task demands, suggesting that interpolation is not unique in promoting automatic grouping in tracking tasks. Our results also imply that various kinds of features are encoded automatically and in parallel during tracking.

A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization

In 1912, Max Wertheimer published his paper on phi motion, widely recognized as the start of Gestalt psychology. Because of its continued relevance in modern psychology, this centennial anniversary is an excellent opportunity to take stock of what Gestalt psychology has offered and how it has changed since its inception. We first introduce the key findings and ideas in the Berlin school of Gestalt psychology, and then briefly sketch its development, rise, and fall. Next, we discuss its empirical and conceptual problems, and indicate how they are addressed in contemporary research on perceptual grouping and figure-ground organization. In particular, we review the principles of grouping, both classical (e.g., proximity, similarity, common fate, good continuation, closure, symmetry, parallelism) and new (e.g., synchrony, common region, element and uniform connectedness), and their role in contour integration and completion. We then review classic and new image-based principles of figure-ground organization, how it is influenced by past experience and attention, and how it relates to shape and depth perception. After an integrated review of the neural mechanisms involved in contour grouping, border ownership, and figure-ground perception, we conclude by evaluating what modern vision science has offered compared to traditional Gestalt psychology, whether we can speak of a Gestalt revival, and where the remaining limitations and challenges lie. A better integration of this research tradition with the rest of vision science requires further progress regarding the conceptual and theoretical foundations of the Gestalt approach, which is the focus of a second review article.

Selective Attention Warps Spatial Representation

Selective attention not only influences which objects in a display are perceived, but also directly changes the character of how they are perceived—for example, making attended objects appear larger or sharper. In studies of multiple-object tracking and probe detection, we explored the influence of sustained selective attention on where objects are seen to be in relation to each other in dynamic multi-object displays. Surprisingly, we found that sustained attention can warp the representation of space in a way that is object-specific: In immediate recall of the positions of objects that have just disappeared, space between targets is compressed, whereas space between distractors is expanded. These effects suggest that sustained attention can warp spatial representation in unexpected ways.

Transfer of associative grouping to novel perceptual contexts in infancy

Learning can be highly adaptive if associations learned in one context are generalized to novel contexts. We examined the development of such generalization in infancy in the context of grouping. In Experiment 1, 3- to 4-month-olds and 6- to 7-month-olds were habituated to shapes grouped via the organizational principle of common region and were tested with familiar and novel pairs as determined by the principle of proximity. Older infants generalized from common region to proximity, but younger infants did not. Younger infants failed to generalize when the task was easier (Experiment 2), and their failure was not due to inability to group via proximity (Experiment 3). However, in Experiment 4, even younger infants generalized grouping on the basis of connectedness to proximity. Thus, the ability to transfer learned associations of shapes to novel contexts is evident early in life, although it continues to undergo quantitative change during infancy. Moreover, the operation of this generalization mechanism may be induced by means of bootstrapping onto functional organizational principles, which is consistent with a developmental framework in which core processes scaffold learning.

How does Learning Impact Development in Infancy? The Case of Perceptual Organization

Pattern perception and organization are critical functions of the visual cognition system. Many organizational processes are available early in life, such that infants as young 3 months of age are able to readily utilize a variety of cues to organize visual patterns. However, other processes are not readily evident in young infants, and their development involves perceptual learning. We describe a theoretical framework that addresses perceptual learning in infancy and the manner in which it affects visual organization and development. It identifies five kinds of experiences that induce learning, and suggests that they work via attentional and unitization mechanisms to modify visual organization. In addition, the framework proposes that this kind of learning is abstract, domain general, functional at different ages in a qualitatively similar manner, and has a long-term impact on development through a memory reactivation process. Although most models of development assume that experience is fundamental to development, very little is actually known about the process by which experience affects development. The proposed framework is an attempt to account for this process in the domain of perception.

Object-Based Warping

Visual objects are high-level primitives that are fundamental to numerous perceptual functions, such as guidance of attention. We report that objects warp visual perception of space in such a way that spatial distances within objects appear to be larger than spatial distances in ground regions. When two dots were placed inside a rectangular object, they appeared farther apart from one another than two dots with identical spacing outside of the object. To investigate whether this effect was object based, we measured the distortion while manipulating the structure surrounding the dots. Object displays were constructed with a single object, multiple objects, a partially occluded object, and an illusory object. Nonobject displays were constructed to be comparable to object displays in low-level visual attributes. In all cases, the object displays resulted in a more powerful distortion of spatial perception than comparable non-object-based displays. These results suggest that perception of space within objects is warped.

Toward a neurobiology of delusions

Delusions are the false and often incorrigible beliefs that can cause severe suffering in mental illness. We cannot yet explain them in terms of underlying neurobiological abnormalities. However, by drawing on recent advances in the biological, computational and psychological processes of reinforcement learning, memory, and perception it may be feasible to account for delusions in terms of cognition and brain function. The account focuses on a particular parameter, prediction error--the mismatch between expectation and experience--that provides a computational mechanism common to cortical hierarchies, fronto-striatal circuits and the amygdala as well as parietal cortices. We suggest that delusions result from aberrations in how brain circuits specify hierarchical predictions, and how they compute and respond to prediction errors. Defects in these fundamental brain mechanisms can vitiate perception, memory, bodily agency and social learning such that individuals with delusions experience an internal and external world that healthy individuals would find difficult to comprehend. The present model attempts to provide a framework through which we can build a mechanistic and translational understanding of these puzzling symptoms.