Statistical extraction affects visually guided action

Grasping of Real-World Objects Is Not Biased by Ensemble Perception

The visual system is known to extract summary representations of visually similar objects which bias the perception of individual objects toward the ensemble average. Although vision plays a large role in guiding action, less is known about whether ensemble representation is informative for action. Motor behavior is tuned to the veridical dimensions of objects and generally considered resistant to perceptual biases. However, when the relevant grasp dimension is not available or is unconstrained, ensemble perception may be informative to behavior by providing gist information about surrounding objects. In the present study, we examined if summary representations of a surrounding ensemble display influenced grip aperture and orientation when participants reached-to-grasp a central circular target which had an explicit size but importantly no explicit orientation that the visuomotor system could selectively attend to. Maximum grip aperture and grip orientation were not biased by ensemble statistics during grasping, although participants were able to perceive and provide manual estimations of the average size and orientation of the ensemble display. Support vector machine classification of ensemble statistics achieved above-chance classification accuracy when trained on kinematic and electromyography data of the perceptual but not grasping conditions, supporting our univariate findings. These results suggest that even along unconstrained grasping dimensions, visually-guided behaviors toward real-world objects are not biased by ensemble processing.

A summary statistical representation influences perceptions but not visually or memory-guided grasping

A statistical summary representation (SSR) is a phenomenon wherein a target property (e.g., size) is encoded based on the average of the stimulus-set to which it belongs. An SSR has been demonstrated in obligatory judgment tasks; however, to our knowledge no work has examined whether it influences grasps to 3D targets. Here, participants completed a method of adjustment task, and visually and memory-guided grasps in conditions wherein differently sized 3D targets (widths: 20, 30 and 40 mm; height and depth = 10 mm) were presented with equal frequency (i.e., control) and when the smallest (i.e., 20-mm: small-target) and largest (i.e., 40-mm: large-target) targets were presented five times as often as the other targets in the stimulus-set. In the method of adjustment task, responses for the small- and large-target weighting conditions were smaller and larger than the control condition, respectively. In other words, an SSR biased perceptions in the direction of the most frequently presented target in the stimulus-set - a result consistent with the view that perceptions are supported by relative visual information laid down by the ventral visual pathway. In contrast, grip apertures were refractory to target-weighting and was a finding independent of the presence (i.e., visually guided) or absence (i.e., memory-guided) of visual feedback. Furthermore, two one-sided tests showed that peak grip apertures for the different target weighting conditions were within an equivalence boundary. Accordingly, an SSR does not influence 3D grasps and is a finding adding to a growing literature reporting that actions are supported by the absolute visuomotor networks of the dorsal visual pathway.

Statistical stability and set size exert distinct influences on visual search

Despite continuous retinal chaos, we perceive the world as stable and complete. This illusion is sustained over consecutive glances by reliance on statistical redundancies inherent in the visual environment. For instance, repeating the average size of a collection of differently sized items speeds visual search for a randomly located target regardless of trial-to-trial changes in local element size (Corbett & Melcher, 2014b). Here, we manipulate set size to investigate the potential role attention may play in these facilitative effects of statistical stability on visual search. Observers discriminated the left or right tilt of a Gabor target defined by a unique conjunction of orientation and spatial frequency in displays of Gabors with a stable or unstable mean size over successive trials. When set size was manipulated over sequences of successive trials, but held constant within a given sequence in Experiment 1, we observed distinct effects of statistical stability and attention, such that participants made faster correct responses as a function of stability and slower correct responses as a function of increasing set size. Replicating these main effects in Experiment 2, when set size was always unstable, provided converging evidence for discrete influences of statistical stability and attentional contributions to visual search. Overall, results support the proposal that our stable impressions of the surrounding environment and our abilities to attend salient events within that environment are distinctively governed by inherent statistical context and attentional processing demands.

Adaptation to average duration

There has been a recent surge of research examining how the visual system compresses information by representing the average properties of sets of similar objects to circumvent strict capacity limitations. Efficient representation by perceptual averaging helps to maintain the balance between the needs to perceive salient events in the surrounding environment and sustain the illusion of stable and complete perception. Whereas there have been many demonstrations that the visual system encodes spatial average properties, such as average orientation, average size, and average numerosity along single dimensions, there has been no investigation of whether the fundamental nature of average representations extends to the temporal domain. Here, we used an adaptation paradigm to demonstrate that the average duration of a set of sequentially presented stimuli negatively biases the perceived duration of subsequently presented information. This negative adaptation aftereffect is indicative of a fundamental visual property, providing the first evidence that average duration is encoded along a single visual dimension. Our results not only have important implications for how the visual system efficiently encodes redundant information to evaluate salient events as they unfold within the dynamic context of the surrounding environment, but also contribute to the long-standing debate regarding the neural underpinnings of temporal encoding.

Central tendency representation and exemplar matching in visual short-term memory

I address a recent extension of the generalized context model (GCM), a model which excludes prototypes, to the visual short-term memory (VSTM) literature, which is currently deluged with prototype effects. The paper includes a brief review whose aim is to discuss the background and key findings suggesting that prototypes have an obligatory influence on visual short-term memory responses in the same VSTM task that the GCM's random walk extension, EBRW, was extended to account for: Sternberg scanning. I present a new model that incorporates such "central tendency representations" in memory, as well as several other regularities of the literature, and compare its prediction and postdictions to those of the GCM on some unpublished Sternberg scanning data. The GCM cannot account for the pattern in those data without post hoc modifications but the pattern is predicted nicely by the central tendency representation model. Although the new model is certainly wrong, the review and modeling exercise suggest a reconsideration of prototype models may be warranted, at least in the VSTM literature.

Abandoning and modifying one action plan for alternatives

Visual scenes are often complex and crowded with many different objects. To interact effectively, we must choose one object at a time as a goal for action. Certain external cues can act as a stop signal, quickly cancelling an ongoing action. Less recognized are internal signals. These can come from recent experience, anticipated action outcomes, cognitive states, and when attention is captured by a salient object. These signals elevate one action plan over alternatives and can quickly modify an initial choice. Here, we focus on these internal processes responsible for selecting, abandoning and modifying action plans. We first highlight how the brain resolves competition among multiple action plans. Critical is the existence of parallel motor planning processes, which allow efficient and timely changes. Then, we discuss how the action system interplays with perception, attention and memory processes to bias action selection and suppress or modify erroneous selections. Subsequently, we show how tracking the continuous modification of action trajectories can provide a tool to read out changes in internal cognitive states. Taken together, we shed light on a broader view that sensorimotor networks can continuously modify actions through simultaneous evaluation of alternative activities in concert with widely distributed perceptual and cognitive networks.This article is part of the themed issue 'Movement suppression: brain mechanisms for stopping and stillness'.

The Whole Warps the Sum of Its Parts

The efficiency of averaging properties of sets without encoding redundant details is analogous to gestalt proposals that perception is parsimoniously organized as a function of recurrent order in the world. This similarity suggests that grouping and averaging are part of a broader set of strategies allowing the visual system to circumvent capacity limitations. To examine how gestalt grouping affects the manner in which information is averaged and remembered, I compared the error in observers' adjustments of remembered sizes of individual circles in two different mean-size sets defined by similarity, proximity, connectedness, or a common region. Overall, errors were more similar within the same gestalt-defined groups than between different gestalt-defined groups, such that the remembered sizes of individual circles were biased toward the mean size of their respective gestalt-defined groups. These results imply that gestalt grouping facilitates perceptual averaging to minimize the error with which individual items are encoded, thereby optimizing the efficiency of visual short-term memory.

Perceptual Averaging in Individuals with Autism Spectrum Disorder

There is mounting evidence that observers rely on statistical summaries of visual information to maintain stable and coherent perception. Sensitivity to the mean (or other prototypical value) of a visual feature (e.g., mean size) appears to be a pervasive process in human visual perception. Previous studies in individuals diagnosed with Autism Spectrum Disorder (ASD) have uncovered characteristic patterns of visual processing that suggest they may rely more on enhanced local representations of individual objects instead of computing such perceptual averages. To further explore the fundamental nature of abstract statistical representation in visual perception, we investigated perceptual averaging of mean size in a group of 12 high-functioning individuals diagnosed with ASD using simplified versions of two identification and adaptation tasks that elicited characteristic perceptual averaging effects in a control group of neurotypical participants. In Experiment 1, participants performed with above chance accuracy in recalling the mean size of a set of circles (mean task) despite poor accuracy in recalling individual circle sizes (member task). In Experiment 2, their judgments of single circle size were biased by mean size adaptation. Overall, these results suggest that individuals with ASD perceptually average information about sets of objects in the surrounding environment. Our results underscore the fundamental nature of perceptual averaging in vision, and further our understanding of how autistic individuals make sense of the external environment.

The capacity limitations of orientation summary statistics

The simultaneous-sequential method was used to test the processing capacity of establishing mean orientation summaries. Four clusters of oriented Gabor patches were presented in the peripheral visual field. One of the clusters had a mean orientation that was tilted either left or right, whereas the mean orientations of the other three clusters were roughly vertical. All four clusters were presented at the same time in the simultaneous condition, whereas the clusters appeared in temporal subsets of two in the sequential condition. Performance was lower when the means of all four clusters had to be processed concurrently than when only two had to be processed in the same amount of time. The advantage for establishing fewer summaries at a given time indicates that the processing of mean orientation engages limited-capacity processes (Exp. 1). This limitation cannot be attributed to crowding, low target-distractor discriminability, or a limited-capacity comparison process (Exps. 2 and 3). In contrast to the limitations of establishing multiple summary representations, establishing a single summary representation unfolds without interference (Exp. 4). When interpreted in the context of recent work on the capacity of summary statistics, these findings encourage a reevaluation of the view that early visual perception consists of creating summary statistic representations that unfold independently across multiple areas of the visual field.