Effect of colour pop-out on the recognition of letters in crowding conditions

Probing the Bottleneck of Awareness Formed by Foveal Crowding: A Neurophysiological Study

Crowding occurs when an easily identified isolated stimulus is surrounded by stimuli with similar properties, making it very difficult to identify. Crowding is suggested as a mechanism that creates a bottleneck in object recognition and awareness. Recently, we showed that brief presentation times at the fovea resulted in a significant crowding effect on target identification, impaired the target's color awareness, and resulted in a slower reaction time. However, when tagging the target with a red letter, the crowding effect is abolished. Crowding is widely considered a grouping; hence, it is pre-attentive. An event-related potential (ERP) study that investigated the spatial-temporal properties of crowding suggested the involvement of higher-level visual processing. Here, we investigated whether ERP's components may be affected by crowding and tagging, and whether the temporal advantage of ERP can be utilized to gain further information about the crowding mechanism. The participants reported target identification using our standard foveal crowing paradigm. It is assumed that crowding occurs due to a suppressive effect; thus, it can be probed by changes in perceptual (N1, ~160 ms) and attentive (P3 ~300-400 ms) components. We found a suppression effect (less negative ERP magnitude) in N1 under foveal crowding, which was recovered under tagging conditions. ERP's amplitude components (N1 and P3) and the behavioral proportion correct are highly correlated. These findings suggest that crowding is an early grouping mechanism that may be combined with later processing involving the segmentation mechanism.

On the relation between crowding and ensemble perception: Examining the role of attention

Ensemble perception of a crowd of stimuli is very accurate, even when individual stimuli are invisible due to crowding. The ability of high-precision ensemble perception can be an evolved compensatory mechanism for the limited attentional resolution caused by crowding. Thus the relationship of crowding and ensemble coding is like two sides of the same coin wherein attention may play a critical factor for their coexistence. The present study investigated whether crowding and ensemble coding were similarly modulated by attention, which can promote our understanding of their relation. Experiment 1 showed that diverting attention away from the target harmed the performance in both crowding and ensemble perception tasks regardless of stimulus density, but crowding was more severely harmed. Experiment 2 showed that directing attention toward the target bar enhanced the performance of crowding regardless of stimulus density. Ensemble perception of high-density bars was also enhanced but to a lesser extent, while ensemble perception of low-density bars was harmed. Together, our results indicate that crowding is strongly modulated by attention, whereas ensemble perception is only moderately modulated by attention, which conforms to the adaptive view.

Multidimensional feature interactions in visual crowding: When configural cues eliminate the polarity advantage

Crowding occurs when surrounding objects (flankers) impair target perception. A key property of crowding is the weaker interference when target and flankers strongly differ on a given dimension. For instance, identification of a target letter is usually superior with flankers of opposite versus the same contrast polarity as the target (the "polarity advantage"). High performance when target-flanker similarity is low has been attributed to the ungrouping of target and flankers. Here, we show that configural cues can override the usual advantage of low target-flanker similarity, and strong target-flanker grouping can reduce - instead of exacerbate - crowding. In Experiment 1, observers were presented with line triplets in the periphery and reported the tilt (left or right) of the central line. Target and flankers had the same (uniform condition) or opposite contrast polarity (alternating condition). Flanker configurations were either upright (||), unidirectionally tilted (\\ or //), or bidirectionally tilted (\/ or /\). Upright flankers yielded stronger crowding than unidirectional flankers, and weaker crowding than bidirectional flankers. Importantly, our results revealed a clear interaction between contrast polarity and flanker configuration. Triplets with upright and bidirectional flankers, but not unidirectional flankers, showed the polarity advantage. In Experiments 2 and 3, we showed that emergent features and redundancy masking (i.e. the reduction of the number of perceived items in repeating configurations) made it easier to discriminate between uniform triplets when flanker tilts were unidirectional (but not when bidirectional). We propose that the spatial configurations of uniform triplets with unidirectional flankers provided sufficient task-relevant information to enable a similar performance as with alternating triplets: strong-target flanker grouping alleviated crowding. We suggest that features which modulate crowding strength can interact non-additively, limiting the validity of typical crowding rules to contexts where only single, independent dimensions determine the effects of target-flanker similarity.

Broad attention uncovers benefits of stimulus uniformity in visual crowding

Crowding is the interference by surrounding objects (flankers) with target perception. Low target-flanker similarity usually yields weaker crowding than high similarity ('similarity rule') with less interference, e.g., by opposite- than same-contrast polarity flankers. The advantage of low target-flanker similarity has typically been shown with attentional selection of a single target object. Here, we investigated the validity of the similarity rule when broadening attention to multiple objects. In three experiments, we measured identification for crowded letters (Experiment 1), tumbling Ts (Experiment 2), and tilted lines (Experiment 3). Stimuli consisted of three items that were uniform or alternating in contrast polarity and were briefly presented at ten degrees eccentricity. Observers reported all items (full report) or only the left, central, or right item (single-item report). In Experiments 1 and 2, consistent with the similarity rule, single central item performance was superior with opposite- compared to same-contrast polarity flankers. With full report, the similarity rule was inverted: performance was better for uniform compared to alternating stimuli. In Experiment 3, contrast polarity did not affect performance. We demonstrated a reversal of the similarity rule under broadened attention, suggesting that stimulus uniformity benefits crowded object recognition when intentionally directing attention towards all stimulus elements. We propose that key properties of crowding have only limited validity as they may require a-priori differentiation of target and context.

The Effect of Changing Colours on Central Crowding Reading

Background:

Crowding can be defined as the impaired recognition of closely spaced objects. Changing colour and lighting enhance visual comfort and perceptual troubles that influence impaired vision reading.

Objective:

The current study was aimed to investigate the impact of changing the flanker distance and unflanked targets with colours on central crowding reading for subjects with their distant best correction (BCVA) equal to or greater than 6/6.

Methodology:

Six native English speakers (age: 18–38) who participated in a cross-section intervention study were asked to identify the orientation of the letter E (flanked or unflanked) in different directions around the central target in different colours (red, green, blue and black) on a white background.

Results:

Different colours affect central crowding (p<0.05). However, the central crowding reading of red was not affected by changing flankers (P > 0.05).

Conclusion:

Central reading crowding is visual crowding. Different colours affect central crowding. However, the central crowding reading in red was not affected by changes in flankers.

Dissecting (un)crowding

In crowding, perception of a target deteriorates in the presence of nearby flankers. Surprisingly, perception can be rescued from crowding if additional flankers are added (uncrowding). Uncrowding is a major challenge for all classic models of crowding and vision in general, because the global configuration of the entire stimulus is crucial. However, it is unclear which characteristics of the configuration impact (un)crowding. Here, we systematically dissected flanker configurations and showed that (un)crowding cannot be easily explained by the effects of the sub-parts or low-level features of the stimulus configuration. Our modeling results suggest that (un)crowding requires global processing. These results are well in line with previous studies showing the importance of global aspects in crowding.

Seemingly Uninvolved Players' Impact on Assistant Referees' Offside Decisions

Most studies on offside decision making in soccer have not addressed rather simplistic situational probabilities like the number of players involved in an offside situation. In three studies (one observational and two experimental), the authors tried to assess whether the number of players close to the offside situation can predict the quality of offside decision making. In all three studies, they found that the presence of additional players negatively affected the percentage of correct decisions. The exact relationship between the number of players and the decrease in decision-making performance differed between the studies, though. Importantly, there was a negative influence of the number of players on decision-making quality in Studies 2 and 3, even though the authors tried to add players clearly farther away from the offside line than the relevant pair of players. This points to a crowding effect as a potential explanation for why decision-making quality decreases with an increasing number of players.

Predicting how surface texture and shape combine in the human visual system to direct attention

Objects differ from one another along a multitude of visual features. The more distinct an object is from other objects in its surroundings, the easier it is to find it. However, it is still unknown how this distinctiveness advantage emerges in human vision. Here, we studied how visual distinctiveness signals along two feature dimensions—shape and surface texture—combine to determine the overall distinctiveness of an object in the scene. Distinctiveness scores between a target object and distractors were measured separately for shape and texture using a search task. These scores were then used to predict search times when a target differed from distractors along both shape and texture. Model comparison showed that the overall object distinctiveness was best predicted when shape and texture combined using a Euclidian metric, confirming the brain is computing independent distinctiveness scores for shape and texture and combining them to direct attention.

Binocular summation is affected by crowding and tagging

In perceptual crowding, a letter easily recognized on its own, becomes unrecognizable if it is surrounded by other letters, an effect that confers a limit on the visual processing. Models assume that crowding is a hallmark of the periphery but that it is almost absent in the fovea. However, recently it was shown that crowding occurs in the fovea of people with an abnormal development of functional vision (amblyopia), when the stimulus is presented for a very short time. When targets and flankers are dissimilar, the crowding is reduced (tagging). Since a combination of binocular inputs increases the processing load, we investigated whether color tagging the target reduces crowding in the fovea of subjects with normal vision and determined how crowding is combined with binocular vision. The crowding effect at the fovea was significantly reduced by tagging with a color target. Interestingly, whereas binocular summation for a single letter was expected to be about 40%, it was significantly reduced and almost absent under crowding conditions. Our results are consistent with the notion that the crowding effect produces a high processing load on visual processing, which interferes with other processes such as binocular summation. We assume that the tagging effect in our experiment improved the subject's abilities (sensitivity and RT) by creating a "segmentation", i.e., a visual simulated separation between the target letter and the background. Interestingly, tagging the target with a distinct color can eliminate or reduce the crowding effect and consequently, binocular summation recovers.

Flexible contextual modulation of naturalistic texture perception in peripheral vision

Peripheral vision comprises most of our visual field, and is essential in guiding visual behavior. Its characteristic capabilities and limitations, which distinguish it from foveal vision, have been explained by the most influential theory of peripheral vision as the product of representing the visual input using summary statistics. Despite its success, this account may provide a limited understanding of peripheral vision, because it neglects processes of perceptual grouping and segmentation. To test this hypothesis, we studied how contextual modulation, namely the modulation of the perception of a stimulus by its surrounds, interacts with segmentation in human peripheral vision. We used naturalistic textures, which are directly related to summary-statistics representations. We show that segmentation cues affect contextual modulation, and that this is not captured by our implementation of the summary-statistics model. We then characterize the effects of different texture statistics on contextual modulation, providing guidance for extending the model, as well as for probing neural mechanisms of peripheral vision.

Crowding and attention in a framework of neural network model

In this article, I present a framework that would accommodate the classic ideas of visual information processing together with more recent computational approaches. I used the current knowledge about visual crowding, capacity limitations, attention, and saliency to place these phenomena within a standard neural network model. I suggest some revisions to traditional mechanisms of attention and feature integration that are required to fit better into this framework. The results allow us to explain some apparent theoretical controversies in vision research, suggesting a rationale for the limited spatial extent of crowding, a role of saliency in crowding experiments, and several amendments to the feature integration theory. The scheme can be elaborated or modified by future research.

Topological difference between target and flankers alleviates crowding effect

In the crowding effect, object recognition in the periphery deteriorates when other items flank the target, especially if they share similarities. Here, we report that the similarity defined by topological property (differences in number of holes) influences the crowding effect. Orientation discrimination tasks suggested that the crowding effect was weaker with a topological different (TD) flanker than a topological equivalent (TE) flanker and an existing inward-outward anisotropy phenomenon. In another experiment, both an outer and an inner flanker were used to constitute four different conditions. The performance of an outer TD flanker and an inner TE flanker was superior to that of an outer TE flanker and an inner TD flanker, even though the items of the stimuli were the same. Different stimuli were used to control for local features. To eliminate the possible explanation of confusability, we selected pairs of letters with matched confusability, but one pair was TD and another was TE. The letter identification performance was better for the TD condition. Lastly, we investigated the digit identification under four conditions with varied spacing. Regardless of different spacing, the crowding effect was reduced by a topological different flanker. The results collectively suggest that topological property plays a role in the perceptual grouping, which modulates the crowding effect.

Neural Responses to a Putative Set-shifting Task in Children with Autism Spectrum Disorder

While much progress has been made toward understanding the neurobiology of social and communication deficits associated with autism spectrum disorder (ASD), less is known regarding the neurobiological basis of restricted and repetitive behaviors (RRBs) central to the ASD diagnosis. Symptom severity for RRBs in ASD is associated with cognitive inflexibility. Thus, understanding the neural mechanisms underlying cognitive inflexibility in ASD is critical for tailoring therapies to treat this understudied yet pervasive symptom. Here we used a set-shifting paradigm adopted from the developmental cognitive neuroscience literature involving flexible switching between stimulus categories to examine task performance and neural responses in children with ASD. Behaviorally, we found little evidence for group differences in performance on the set-shifting task. Compared with typically developing children, children with ASD exhibited greater activation of the parahippocampal gyrus during performance on trials requiring switching. These findings suggest that children with ASD may need to recruit memory-based neural systems to a greater degree when learning to flexibly associate stimuli with responses. LAY SUMMARY: Children with autism often struggle to behave in a flexible way when faced with unexpected challenges. We examined brain responses during a task thought to involve flexible thinking and found that compared with typically developing children, those with autism relied more on brain areas involved in learning and memory to complete the task. This study helps us to understand what types of cognitive tasks are best suited for exploring the neural basis of cognitive flexibility in children with autism. Autism Res 2020, 13: 1501-1515. © 2020 International Society for Autism Research, Wiley Periodicals, Inc.

Visual crowding effect in the parvocellular and magnocellular visual pathways

The crowding effect, defined as the detrimental effects of nearby items on visual object recognition, has been extensively investigated. Previous studies have primarily focused on finding the stage(s) in the visual hierarchy where crowding starts to limit target processing, while little attention has been focused on potential differences between the parvocellular (P) and magnocellular (M) pathways in crowding mechanisms. Here, we investigated the crowding effect in these parallel visual pathways. InExperiment 1, stimuli were designed to separately engage the P or M pathway, by tuning stimulus and background features (e.g., temporal frequency and color) to activate the targeted pathway and saturate the other pathway, respectively. Results showed that at the same eccentricity and with the same tasks, targets processed in the M pathway appeared to be more vulnerable to crowding effect. InExperiment 2, crowding effects were studied using three different types of stimuli and visual tasks (form, color, and motion), presumably with different degrees of dependence on the P and M pathways. Results revealed that color, motion, and form discrimination were increasingly more affected by crowding. We conclude that processing in the M and P pathways are differentially impacted by crowding; and importantly, crowding seems to affect processing of spatial forms more than other stimulus properties.

Grouping Effects on Foveal Spatial Interactions in Children

Purpose

Grouping of flankers from the target can modulate crowding in adults. Visual acuity in children is measured clinically using charts with targets and different flankers to enhance spatial interactions. We investigated grouping effects on interactions using visual acuity letters, flanked by contours and letters, in children.

Methods

Visual acuity for isolated and flanked letters was measured in 155 three- to 11-year old children and 32 adults. Flankers were one stroke width from the target and were a box or four bars and black or red letters. Magnitudes of interaction were flanked minus isolated logMAR acuities. Psychometric function slopes were also examined.

Results

Magnitudes of interaction by contours did not change significantly with age. They were 0.047 ± 0.014 logMAR more with bars than a box. Interaction from flanking letters reduced with age, adults being not different from 9- to 11-year-olds for black and red letter surrounds. It was weaker by 0.033 ± 0.013 logMAR when a black letter was surrounded by red rather than black letters. Psychometric function slopes for visual acuity were steepest for the youngest children (3-5 years).

Conclusions

For contour and letter flankers, grouping effects on interaction magnitude are age independent. Grouping bars into a box forming a single object reduces magnitude of effect. Grouping letter flankers by color and ungrouping them from the target reduce interaction magnitude by ∼8%, suggesting that luminance-defined form dominates. Differently colored letter flankers of high-luminance contrast on acuity charts could draw attention to the target but retain significant interaction strength.

Emergent features break the rules of crowding

Crowding is the deleterious influence of surrounding objects (flankers) on target identification. A central rule of crowding is that it is stronger when the target and the flankers are similar. Here, we show in three experiments how emergent features break this rule. Observers identified targets with various emergent features consisting of a pair of adjacent chevrons either pointing in opposite ('Diamonds' and 'Xs'), or the same (both up or down) directions. Targets were flanked by Diamonds or Xs, resulting in conditions with different levels of target-flanker similarity. Despite high target-flanker similarity, Diamonds were identified better than Xs when flanked by Diamonds. Participants' judgments of target conspicuity, however, showed that Diamonds were not perceived to stand out more strongly from X than Diamond flankers. Next, we asked observers to indicate whether all presented items were identical. We found superior performance with all Diamonds compared to all Xs, indicating that display uniformity judgments benefitted from the emergent features of Diamonds. Our results showed that emergent features and the information content of the entire display strongly modulated crowding. We suggest that conventional crowding rules only hold when target and flankers are artificially constrained to be mutually independent.

Disrupting uniformity: Feature contrasts that reduce crowding interfere with peripheral word recognition

Peripheral word recognition is impaired by crowding, the harmful influence of surrounding objects (flankers) on target identification. Crowding is usually weaker when the target and the flankers differ (for example in color). Here, we investigated whether reducing crowding at syllable boundaries improved peripheral word recognition. In Experiment 1, a target letter was flanked by single letters to the left and right and presented at 8° in the lower visual field. Target and flankers were either the same or different in regard to contrast polarity, color, luminance, and combined color/luminance. Crowding was reduced when the target differed from the flankers in contrast polarity, but not in any of the other conditions. Using the same color and luminance values as in Experiment 1, we measured recognition performance (speed and accuracy) for uniform (e.g., all letters black), congruent (e.g., alternating black and white syllables), and incongruent (e.g., alternating black and white non-syllables) words in Experiment 2. Participants verbally reported the target word, briefly displayed at 8° in the lower visual field. Congruent and incongruent words were recognized slower compared to uniform words in the opposite contrast polarity condition, but not in the other conditions. Our results show that the same feature contrast between the target and the flankers that yielded reduced crowding, deteriorated peripheral word recognition when applied to syllables and non-syllabic word parts. We suggest that a potential advantage of reduced crowding at syllable boundaries in word recognition is counteracted by the disruption of word uniformity.

Attentional Modulation of Visual Spatial Integration: Psychophysical Evidence Supported by Population Coding Modeling

Two prominent strategies that the human visual system uses to reduce incoming information are spatial integration and selective attention. Whereas spatial integration summarizes and combines information over the visual field, selective attention can single it out for scrutiny. The way in which these well-known mechanisms-with rather opposing effects-interact remains largely unknown. To address this, we had observers perform a gaze-contingent search task that nudged them to deploy either spatial or feature-based attention to maximize performance. We found that, depending on the type of attention employed, visual spatial integration strength changed either in a strong and localized or a more modest and global manner compared with a baseline condition. Population code modeling revealed that a single mechanism can account for both observations: Attention acts beyond the neuronal encoding stage to tune the spatial integration weights of neural populations. Our study shows how attention and integration interact to optimize the information flow through the brain.

Emergent features in the crowding zone: When target-flanker grouping surmounts crowding

Crowding is the impairment of target identification when the target is surrounded by nearby flankers. Two hallmarks of crowding are that it is stronger when the flankers are close to the target and when the target strongly groups with the flankers. Here we show the opposite of both. A chevron target (pointing up or down) was presented at 8° eccentricity in the right visual field. It was surrounded by four flankers. Three of the flankers varied (pointing left or right). The fourth, the critical flanker (CF), was fixed in one orientation (left, right, up, down), yielding different configurations with the target. The CF's distance to the target was varied. Target identification depended strongly on the distance and the orientation of the CF. Remarkably, when the target and the CF grouped into a good configuration and elicited an emergent feature, performance was high if the CF was close to the target. This effect was particularly strong when participants were informed about the different CF-target configurations before the experiment. Reducing crowding and grouping by asynchronous presentation of the CF and the other items abolished the effect. When participants reported the entire configuration of the CF and the target, performance rapidly decreased with increasing spacing when the CF and the target were different but not when they were the same, indicating different spatial extents of the corresponding grouping processes. Our results show that the features emerging from the configurations of the target and a flanker strongly modulate crowding. Strong target-flanker grouping can benefit performance.

On the brink: The demise of the item in visual search moves closer

We proposed to abandon the item as conceptual unit in visual search and adopt a fixation-based framework instead. We treat various themes raised by our commentators, including the nature of the Functional Visual Field and existing similar ideas, alongside the importance of items, covert attention, and top-down/contextual influences. We reflect on the current state of, and future directions for, visual search.

The Temporal Dynamic Relationship Between Attention and Crowding: Electrophysiological Evidence From an Event-Related Potential Study

Visual crowding is the difficulty experienced in identifying a target flanked by other objects within the peripheral visual field. Despite extensive research conducted on this topic, the precise relationship between attention and crowding is still debatable. One perspective suggests that crowding is a bottom-up and pre-attentive process, while another suggests that crowding is top-down and attentional. A third perspective proposes that crowding is a combination of bottom-up and top-down processes. To address this debate, the current study manipulated the attention and distance between targets and flankers, while simultaneously measuring event-related potentials, in human participants. Results indicated that, compared to uncrowded targets, crowded targets elicited more negative frontal N1 and P2 activity and a less negative occipital N1 activity, regardless of whether targets were attended or unattended, and a more positive occipital P2 activity when they were attended. Furthermore, the crowded minus uncrowded difference amplitude was more negative over the frontal region and more positive over the occipital region when the targets were attended, compared to when they were unattended during the N1 and P2 stages. This suggests that crowding, a concept that originates from Gestalt grouping, occurs automatically and can be modulated by attention.

Critical resolution: A superior measure of crowding

Visual object recognition is essential for adaptive interactions with the environment. It is fundamentally limited by crowding, a breakdown of object recognition in clutter. The spatial extent over which crowding occurs is proportional to the eccentricity of the target object, but nevertheless varies substantially depending on various stimulus factors (e.g. viewing time, contrast). However, a lack of studies jointly manipulating such factors precludes predictions of crowding in more heterogeneous scenes, such as the majority of real life situations.

To establish how such co-occurring variations affect crowding, we manipulated combinations of 1) flanker contrast and backward masking, 2) flanker contrast and presentation duration, and 3) flanker preview and pop-out while measuring participants’ ability to correctly report the orientation of a target stimulus. In all three experiments, combining two manipulations consistently modulated the spatial extent of crowding in a way that could not be predicted from an additive combination. However, a simple transformation of the measurement scale completely abolished these interactions and all effects became additive. Precise quantitative predictions of the magnitude of crowding when combining multiple manipulations are thus possible when it is expressed in terms of what we label the ‘critical resolution’. Critical resolution is proportional to the inverse of the smallest flanker free area surrounding the target object necessary for its unimpaired identification. It offers a more parsimonious description of crowding than the traditionally used critical spacing and may thus constitute a measure of fundamental importance for understanding object recognition.

Crowding for faces is determined by visual (not holistic) similarity: Evidence from judgements of eye position

Crowding (the disruption of object recognition in clutter) presents the fundamental limitation on peripheral vision. For simple objects, crowding is strong when target/flanker elements are similar and weak when they differ - a selectivity for target-flanker similarity. In contrast, the identification of upright holistically-processed face stimuli is more strongly impaired by upright than inverted flankers, whereas inverted face-targets are impaired by both - a pattern attributed to an additional stage of crowding selective for "holistic similarity" between faces. We propose instead that crowding is selective for target-flanker similarity in all stimuli, but that this selectivity is obscured by task difficulty with inverted face-targets. Using judgements of horizontal eye-position that are minimally affected by inversion, we find that crowding is strong when target-flanker orientations match and weak when they differ for both upright and inverted face-targets. By increasing task difficulty, we show that this selectivity for target-flanker similarity is obscured even for upright face-targets. We further demonstrate that this selectivity follows differences in the spatial order of facial features, rather than "holistic similarity" per se. There is consequently no need to invoke a distinct stage of holistic crowding for faces - crowding is selective for target-flanker similarity, even with complex stimuli such as faces.

The prevalence of synaesthesia depends on early language learning

According to one theory, synaesthesia develops, or is preserved, because it helps children learn. If so, it should be more common among adults who faced greater childhood learning challenges. In the largest survey of synaesthesia to date, the incidence of synaesthesia was compared among native speakers of languages with transparent (easier) and opaque (more difficult) orthographies. Contrary to our prediction, native speakers of Czech (transparent) were more likely to be synaesthetes than native speakers of English (opaque). However, exploratory analyses suggested that this was because more Czechs learned non-native second languages, which was strongly associated with synaesthesia, consistent with the learning hypothesis. Furthermore, the incidence of synaesthesia among speakers of opaque languages was double that among speakers of transparent languages other than Czech, also consistent with the learning hypothesis. These findings contribute to an emerging understanding of synaesthetic development as a complex and lengthy process with multiple causal influences.

Macaque monkeys experience visual crowding

In peripheral vision, objects that are easily discriminated on their own become less discriminable in the presence of surrounding clutter. This phenomenon is known as crowding.The neural mechanisms underlying crowding are not well understood. Better insight might come from single-neuron recording in nonhuman primates, provided they exhibit crowding; however, previous demonstrations of crowding have been confined to humans. In the present study, we set out to determine whether crowding occurs in rhesus macaque monkeys. We found that animals trained to identify a target letter among flankers displayed three hallmarks of crowding as established in humans. First, at a given eccentricity, increasing the spacing between the target and the flankers improved recognition accuracy. Second, the critical spacing, defined as the minimal spacing at which target discrimination was reliable, was proportional to eccentricity. Third, the critical spacing was largely unaffected by object size. We conclude that monkeys, like humans, experience crowding. These findings open the door to studies of crowding at the neuronal level in the monkey visual system.

Crowding, grouping, and object recognition: A matter of appearance

In crowding, the perception of a target strongly deteriorates when neighboring elements are presented. Crowding is usually assumed to have the following characteristics. (a) Crowding is determined only by nearby elements within a restricted region around the target (Bouma's law). (b) Increasing the number of flankers can only deteriorate performance. (c) Target-flanker interference is feature-specific. These characteristics are usually explained by pooling models, which are well in the spirit of classic models of object recognition. In this review, we summarize recent findings showing that crowding is not determined by the above characteristics, thus, challenging most models of crowding. We propose that the spatial configuration across the entire visual field determines crowding. Only when one understands how all elements of a visual scene group with each other, can one determine crowding strength. We put forward the hypothesis that appearance (i.e., how stimuli look) is a good predictor for crowding, because both crowding and appearance reflect the output of recurrent processing rather than interactions during the initial phase of visual processing.

The Bouma law of crowding, revised: critical spacing is equal across parts, not objects

Crowding is the inability to identify an object among flankers in the periphery. It is due to inappropriate incorporation of features from flanking objects in perception of the target. Crowding is characterized by measuring critical spacing, the minimum distance needed between a target and flankers to allow recognition. The existing Bouma law states that, at a given point and direction in the visual field, critical spacing, measured from the center of a target object to the center of a similar flanking object, is the same for all objects (Pelli & Tillman, 2008). Because flipping an object about its center preserves its center-to-center spacing to other objects, according to the Bouma law, crowding should be unaffected. However, because crowding is a result of feature combination, the location of features within an object might matter. In a series of experiments, we find that critical spacing is affected by the location of features within the flanker. For some flankers, a flip greatly reduces crowding even though it maintains target-flanker spacing and similarity. Our results suggest that the existing Bouma law applies to simple one-part objects, such as a single roman letter or a Gabor patch. Many objects consist of multiple parts; for example, a word is composed of multiple letters that crowd each other. To cope with such complex objects, we revise the Bouma law to say that critical spacing is equal across parts, rather than objects. This accounts for old and new findings.

Categorical membership modulates crowding: evidence from characters

Visual crowding is generally thought to affect recognition mostly or only at the level of feature combination. Calling this assertion into question, recent studies have shown that if a target object and its flankers belong to different categories crowding is weaker than if they belong to the same category. Nevertheless, these results can be explained in terms of featural differences between categories. The current study tests if category-level (i.e., high-level) interference in crowding occurs when featural differences are controlled for. First, replicating previous results, we found lower critical spacing for targets and flankers belonging to different categories. Second, we observed the same, albeit weaker, category-specific effect when objects in both categories had the exact same feature set, suggesting that category-specific effects persist even when featural differences are fully controlled for. Third, we manipulated the semantic content of the flankers while keeping their feature set constant, by using upright or rotated objects, and found that meaning modulated crowding. An exclusively feature-based account of crowding would predict no differences due to such changes in meaning. We conclude that crowding results from not only the well-documented feature-level interactions but also additional interactions at a level where objects are grouped by meaning.

The hierarchical sparse selection model of visual crowding

Because the environment is cluttered, objects rarely appear in isolation. The visual system must therefore attentionally select behaviorally relevant objects from among many irrelevant ones. A limit on our ability to select individual objects is revealed by the phenomenon of visual crowding: an object seen in the periphery, easily recognized in isolation, can become impossible to identify when surrounded by other, similar objects. The neural basis of crowding is hotly debated: while prevailing theories hold that crowded information is irrecoverable - destroyed due to over-integration in early stage visual processing - recent evidence demonstrates otherwise. Crowding can occur between high-level, configural object representations, and crowded objects can contribute with high precision to judgments about the "gist" of a group of objects, even when they are individually unrecognizable. While existing models can account for the basic diagnostic criteria of crowding (e.g., specific critical spacing, spatial anisotropies, and temporal tuning), no present model explains how crowding can operate simultaneously at multiple levels in the visual processing hierarchy, including at the level of whole objects. Here, we present a new model of visual crowding-the hierarchical sparse selection (HSS) model, which accounts for object-level crowding, as well as a number of puzzling findings in the recent literature. Counter to existing theories, we posit that crowding occurs not due to degraded visual representations in the brain, but due to impoverished sampling of visual representations for the sake of perception. The HSS model unifies findings from a disparate array of visual crowding studies and makes testable predictions about how information in crowded scenes can be accessed.

A crowdful of letters: disentangling the role of similarity, eccentricity and spatial frequencies in letter crowding

The present study investigated the joint impact of target-flanker similarity and of spatial frequency content on the crowding effect in letter identification. We presented spatial frequency filtered letters to neurologically intact non-dyslexic readers while manipulating target-flanker distance, target eccentricity and target-flanker confusability (letter similarity metric based on published letter confusion matrices). The results show that high target-flanker confusability magnifies crowding. They also reveal an intricate pattern of interactions of the spatial frequency content of the stimuli with target eccentricity, flanker distance and similarity. The findings are congruent with the notion that crowding results from the inappropriate pooling of target and flanker features and that this integration is more likely to match a response template at a subsequent decision stage with similar than dissimilar flankers. In addition, the evidence suggests that crowding from similar flankers is biased towards relatively high spatial frequencies and that crowding shifts towards lower spatial frequencies as target eccentricity is increased.

Grouping and crowding affect target appearance over different spatial scales

Crowding is the impairment of peripheral target perception by nearby flankers. A number of recent studies have shown that crowding shares many features with grouping. Here, we investigate whether effects of crowding and grouping on target perception are related by asking whether they operate over the same spatial scale. A target letter T had two sets of flanking Ts of varying orientations. The first set was presented close to the target, yielding strong crowding. The second set was either close enough to cause crowding on their own or too far to cause crowding on their own. The Ts of the second set had the same orientation that either matched the target's orientation (Grouped condition) or not (Ungrouped condition). In Experiment 1, the Grouped flankers reduced crowding independently of their distance from the target, suggesting that grouping operated over larger distances than crowding. In Experiments 2 and 3 we found that grouping did not affect sensitivity but produced a strong bias to report that the grouped orientation was present at the target location whether or not it was. Finally, we investigated whether this bias was a response or perceptual bias, rejecting the former in favor of a perceptual grouping explanation. We suggest that the effect of grouping is to assimilate the target to the identity of surrounding flankers when they are all the same, and that this shape assimilation effect differs in its spatial scale from the integration effect of crowding.

How do flanking objects affect reaching and grasping behavior in participants with macular disorders?

PURPOSE

To investigate how objects (flankers) placed on either side of a target affect reaching and grasping behavior in visually impaired (VI) subjects due to macular disorders compared with age-matched normals.

METHODS

Subjects reached out to grasp a cylindrical target placed on its own and when it had two identical objects (flankers) placed either half or one target diameter away on each side of the target. A motion analysis system (Vicon 460) recorded and reconstructed the 3-dimemsional (3D) hand and finger movements. Kinematic data for transport and grasping mechanisms were measured.

RESULTS

In subjects with VI, crowding effected the overall movement duration, time after maximum velocity, and maximum grip aperture. Maximum effect was shown when the flankers were placed close to the target (high-level crowding) with a decreased effect shown for flankers placed farther away (medium-level crowding). Compared with normals, subjects with VI generally took longer to initiate the hand movement and to complete the movement. Time after maximum velocity and time after maximum grip aperture were also longer in subjects with VI. No interaction effects were found for any of the indices for the different levels of crowding in the two visual groups.

CONCLUSIONS

Reaching and grasping behavior is compromised in subjects with VI due to macular disorders compared with normals, and crowding affected performance for both normal subjects and those with VI. Flankers placed half an object diameter away showed greater deterioration than those placed further away.

Substitution and pooling in crowding

Unless we fixate directly on it, it is hard to see an object among other objects. This breakdown in object recognition, called crowding, severely limits peripheral vision. The effect is more severe when objects are more similar. When observers mistake the identity of a target among flanker objects, they often report a flanker. Many have taken these flanker reports as evidence of internal substitution of the target by a flanker. Here, we ask observers to identify a target letter presented in between one similar and one dissimilar flanker letter. Simple substitution takes in only one letter, which is often the target but, by unwitting mistake, is sometimes a flanker. The opposite of substitution is pooling, which takes in more than one letter. Having taken only one letter, the substitution process knows only its identity, not its similarity to the target. Thus, it must report similar and dissimilar flankers equally often. Contrary to this prediction, the similar flanker is reported much more often than the dissimilar flanker, showing that rampant flanker substitution cannot account for most flanker reports. Mixture modeling shows that simple substitution can account for, at most, about half the trials. Pooling and nonpooling (simple substitution) together include all possible models of crowding. When observers are asked to identify a crowded object, at least half of their reports are pooled, based on a combination of information from target and flankers, rather than being based on a single letter.

The dependence of crowding on flanker complexity and target-flanker similarity

We examined the effects of the spatial complexity of flankers and target-flanker similarity on the performance of identifying crowded letters. On each trial, observers identified the middle character of random strings of three characters ("trigrams") briefly presented at 10° below fixation. We tested the 26 lowercase letters of the Times Roman and Courier fonts, a set of 79 characters (letters and non-letters) of the Times Roman font, and the uppercase letters of two highly complex ornamental fonts, Edwardian and Aristocrat. Spatial complexity of characters was quantified by the length of the morphological skeleton of each character, and target-flanker similarity was defined based on a psychometric similarity matrix. Our results showed that (1) letter identification error rate increases with flanker complexity up to a certain value, beyond which error rate becomes independent of flanker complexity; (2) the increase of error rate is slower for high-complexity target letters; (3) error rate increases with target-flanker similarity; and (4) mislocation error rate increases with target-flanker similarity. These findings, combined with the current understanding of the faulty feature integration account of crowding, provide some constraints of how the feature integration process could cause perceptual errors.

Asymmetries and idiosyncratic hot spots in crowding

Crowding (mutual scrambling of nearby peripheral stimuli) has several known asymmetries. We explored these and other asymmetries systematically across the visual field. Crowding strength for 16 target (Gabor) positions in the visual field (8 directions × 2 eccentricities) were determined by positioning a plaid mask made of two transparently overlaid Gabors either inward, outward, clockwise, or counter-clockwise around the target. Overall, we found a surprisingly large individual variation in crowding strength appearing as idiosyncratic hotspots across the visual field. No correlations were found between the idiosyncratic variations of crowding and visual acuity either across the visual field or across subjects. When averaged across observers the results replicated most of the previously reported asymmetries of crowding. No new types of asymmetries were observed, but we found that the inward-outward asymmetry of crowding is present only along the horizontal meridian. Most surprisingly, we discovered that this asymmetry increases two-fold, if the observer is forced to attend to both left and right visual fields. This indicates that besides other factors attention allocation has a strong effect on the crowding asymmetry.

Crowding in peripheral vision: why bigger is better

We enjoy the illusion that visual resolution is high across the entire field of vision. However, this illusion can be easily dispelled by trying to identify objects in a cluttered environment out of the corner of your eye. This reflects, in part, the well-known decline in visual resolution in peripheral vision; however, the main bottleneck for reading or object recognition in peripheral vision is crowding. Objects that can be easily identified in isolation seem indistinct and jumbled in clutter. Crowding is thought to reflect inappropriate integration of the target and flankers in peripheral vision [1, 2]. Here, we uncover and explain a paradox in peripheral crowding: under certain conditions, increasing the size or number of flanking rings results in a paradoxical decrease in the magnitude of crowding-i.e., the bigger or more numerous the flanks, the smaller the crowding. These surprising results are predicted by a model in which crowding is determined by the centroids of approximately 4-8 independent features within approximately 0.5x the target eccentricity. These features are then integrated into a texture beyond the stage of feature analysis. We speculate that this process may contribute to the illusion of high resolution across the field of vision.

Crowding--an essential bottleneck for object recognition: a mini-review

Crowding, generally defined as the deleterious influence of nearby contours on visual discrimination, is ubiquitous in spatial vision. Crowding impairs the ability to recognize objects in clutter. It has been extensively studied over the last 80 years or so, and much of the renewed interest is the hope that studying crowding may lead to a better understanding of the processes involved in object recognition. Crowding also has important clinical implications for patients with macular degeneration, amblyopia and dyslexia. There is no shortage of theories for crowding-from low-level receptive field models to high-level attention. The current picture is that crowding represents an essential bottleneck for object perception, impairing object perception in peripheral, amblyopic and possibly developing vision. Crowding is neither masking nor surround suppression. We can localize crowding to the cortex, perhaps as early as V1; however, there is a growing consensus for a two-stage model of crowding in which the first stage involves the detection of simple features (perhaps in V1), and a second stage is required for the integration or interpretation of the features as an object beyond V1. There is evidence for top-down effects in crowding, but the role of attention in this process remains unclear. The strong effect of learning in shrinking the spatial extent of crowding places strong constraints on possible models for crowding and for object recognition. The goal of this review is to try to provide a broad, balanced and succinct review that organizes and summarizes the diverse and scattered studies of crowding, and also helps to explain it to the non-specialist. A full understanding of crowding may allow us to understand this bottleneck to object recognition and the rules that govern the integration of features into objects.