Object-Based Visual Selection: Evidence From Perceptual Completion

Object-based suppression in target search but not in distractor inhibition

The present study investigated the effect of object representation on attentional priority regarding distractor inhibition and target search processes while the statistical regularities of singleton distractor location were biased. A color singleton distractor appeared more frequently at one of six stimulus locations, called the 'high-probability location,' to induce location-based suppression. Critically, three objects were presented, each of which paired two adjacent stimuli in a target display by adding background contours (Experiment 1) or using perceptual grouping (Experiments 2 and 3). The results revealed that attention capture by singleton distractors was hardly modulated by objects. In contrast, target selection was impeded at the location in the object containing the high-probability location compared to an equidistant location in a different object. This object-based suppression in target selection was evident when object-related features were parts of task-relevant features. These findings suggest that task-irrelevant objects modulate attentional suppression. Moreover, different features are engaged in determining attentional priority for distractor inhibition and target search processes.

Hierarchical Constraints on the Distribution of Attention in Dynamic Displays

Human vision is remarkably good at recovering the latent hierarchical structure of dynamic scenes. Here, we explore how visual attention operates with this hierarchical motion representation. The way in which attention responds to surface physical features has been extensively explored. However, we know little about how the distribution of attention can be distorted by the latent hierarchical structure. To explore this topic, we conducted two experiments to investigate the relationship between minimal graph distance (MGD), one key factor in hierarchical representation, and attentional distribution. In Experiment 1, we constructed three hierarchical structures consisting of two moving objects with different MGDs. In Experiment 2, we generated three moving objects from one hierarchy to eliminate the influence of different structures. Attention was probed by the classic congruent-incongruent cueing paradigm. Our results show that the cueing effect is significantly smaller when the MGD between two objects is shorter, which suggests that attention is not evenly distributed across multiple moving objects but distorted by their latent hierarchical structure. As neither the latent structure nor the graph distance was part of the explicit task, our results also imply that both the construction of hierarchical representation and the attention to that representation are spontaneous and automatic.

Spatial transfer of object-based statistical learning

A large number of recent studies have demonstrated that efficient attentional selection depends to a large extent on the ability to extract regularities present in the environment. Through statistical learning, attentional selection is facilitated by directing attention to locations in space that were relevant in the past while suppressing locations that previously were distracting. The current study shows that we are not only able to learn to prioritize locations in space but also locations within objects independent of space. Participants learned that within a specific object, particular locations within the object were more likely to contain relevant information than other locations. The current results show that this learned prioritization was bound to the object as the learned bias to prioritize a specific location within the object stayed in place even when the object moved to a completely different location in space. We conclude that in addition to spatial attention prioritization of locations in space, it is also possible to learn to prioritize relevant locations within specific objects. The current findings have implications for the inferred spatial priority map of attentional weights as this map cannot be strictly retinotopically organized.

The object-based shift direction anisotropy is modulated by the horizontal visual field meridian

Reallocating object-based attention across the visual field meridians is significantly faster horizontally than vertically (termed the shift direction anisotropy; SDA), implicating the meridians in reorienting object-based attention. Here, we tested the modulatory role of the meridians in the emergence of the SDA by manipulating meridian local feature contrast. Considering the notion of separate pools of attentional resources in each cortical hemisphere, we hypothesised that manipulating the horizontal meridian would selectively modulate the SDA. In four experiments, participants were presented with an "L"-shaped object and detected a target that appeared at either a cued location or at one of two equidistant non-cued locations at the far end of the horizontal or vertical object arm. Meridian local feature contrast was manipulated with perceptually strong enhancements (visible lines and colour contrast borders) and perceptually weak enhancements (illusory borders from line texture patterns and inducers). Weak enhancements of the meridians did not significantly modulate SDA magnitude; however, during perceptually strong enhancements of the horizontal meridian, the SDA was significantly reduced compared with both vertical meridian enhancement and no-enhancement conditions. Moreover, horizontal and vertical shift RTs were statistically equivalent when the horizontal meridian was enhanced with a visible line, our strongest manipulation, indicating the SDA was eliminated. These results suggest that the SDA emerges due to reallocating object-based attention across the horizontal meridian. We interpret this finding as evidence in support of the theory by which anatomical segregations of the visual system determine how pools of attentional resources resolve competition between and within cortical hemispheres.

Variability in the temporal dynamics of object-based attentional selection

Our attention can be directed to specific locations in our visual field (space-based attention), or to specific objects (object-based attention). However, object-based attention tends to be less pronounced than space-based attention and can vary greatly between individuals. Here we investigated whether the low prevalence of object-based effects is related to variability in the temporal dynamics of attentional selection. We manipulated cue-to-target intervals from 50 to 600 ms in a two-rectangle discrimination task. Space- and object-based effects were measured at the group level and for individual participants. We used bootstrapping to highlight cue-to-target intervals with maximal space- and object-based effects, and fast Fourier transform (FFT) to investigate rhythmic sampling of locations within and between objects. Whereas overall, space-based effects were robust and stable across all cue-to-target intervals for most participants, object-based effects were small and were only found for a small subset of participants in the different cue-to-target intervals. In the frequency domain, only a small number of participants exhibited significant periodicities, prompting the need for further investigation and consideration. Overall, our study suggests variability in the temporal dynamics of object-based effects underlying their low prevalence, a finding that needs to be further investigated in future studies.

The Architecture of Object-Based Attention

The allocation of attention to objects raises several intriguing questions: What are objects, how does attention access them, what anatomical regions are involved? Here, we review recent progress in the field to determine the mechanisms underlying object-based attention. First, findings from unconscious priming and cueing suggest that the preattentive targets of object-based attention can be fully developed object representations that have reached the level of identity. Next, the control of object-based attention appears to come from ventral visual areas specialized in object analysis that project downward to early visual areas. How feedback from object areas can accurately target the object's specific locations and features is unknown but recent work in autoencoding has made this plausible. Finally, we suggest that the three classic modes of attention may not be as independent as is commonly considered, and instead could all rely on object-based attention. Specifically, studies show that attention can be allocated to the separated members of a group-without affecting the space between them-matching the defining property of feature-based attention. At the same time, object-based attention directed to a single small item has the properties of space-based attention. We outline the architecture of object-based attention, the novel predictions it brings, and discuss how it works in parallel with other attention pathways.

A dynamic 1/f noise protocol to assess visual attention without biasing perceptual processing

Psychophysical paradigms measure visual attention via localized test items to which observers must react or whose features have to be discriminated. These items, however, potentially interfere with the intended measurement, as they bias observers' spatial and temporal attention to their location and presentation time. Furthermore, visual sensitivity for conventional test items naturally decreases with retinal eccentricity, which prevents direct comparison of central and peripheral attention assessments. We developed a stimulus that overcomes these limitations. A brief oriented discrimination signal is seamlessly embedded into a continuously changing 1/f noise field, such that observers cannot anticipate potential test locations or times. Using our new protocol, we demonstrate that local orientation discrimination accuracy for 1/f filtered signals is largely independent of retinal eccentricity. Moreover, we show that items present in the visual field indeed shape the distribution of visual attention, suggesting that classical studies investigating the spatiotemporal dynamics of visual attention via localized test items may have obtained a biased measure. We recommend our protocol as an efficient method to evaluate the behavioral and neurophysiological correlates of attentional orienting across space and time.

What is "Where": Physical Reasoning Informs Object Location

A central puzzle the visual system tries to solve is: "what is where?" While a great deal of research attempts to model object recognition ("what"), a comparatively smaller body of work seeks to model object location ("where"), especially in perceiving everyday objects. How do people locate an object, right now, in front of them? In three experiments collecting over 35,000 judgements on stimuli spanning different levels of realism (line drawings, real images, and crude forms), participants clicked "where" an object is, as if pointing to it. We modeled their responses with eight different methods, including both human response-based models (judgements of physical reasoning, spatial memory, free-response "click anywhere" judgements, and judgements of where people would grab the object), and image-based models (uniform distributions over the image, convex hull, saliency map, and medial axis). Physical reasoning was the best predictor of "where," performing significantly better than even spatial memory and free-response judgements. Our results offer insight into the perception of object locations while also raising interesting questions about the relationship between physical reasoning and visual perception.

Gestalt formation promotes awareness of suppressed visual stimuli during binocular rivalry

Continuous flash suppression leverages binocular rivalry to render observers unaware of a static image for several seconds. To achieve this effect, rapidly flashing noise masks are presented to the dominant eye while a static stimulus is presented to the non-dominant eye. Eventually "breakthrough" occurs, wherein awareness shifts to the static image shown to the non-dominant eye. We tested the hypothesis that Gestalt formation can promote breakthrough. In two experiments, we presented pacman-shaped objects that might or might not align to form illusory Kanizsa objects. To measure the inception of breakthrough, observers were instructed to press a key at the moment of partial breakthrough. After pressing the key, which stopped the trial, observers reported how many pacmen were seen and where they were located. Supporting the Gestalt hypothesis, breakthrough was faster when the pacmen were aligned and observers more often reported pairs of pacmen if they were aligned. To address whether these effects reflected illusory shape perception, a computational model was applied to the pacman report distributions and breakthrough times for an experiment with four pacmen. A full account of the data required an increased joint probability of reporting all four pacmen, suggesting an influence of a perceived illusory cross.

Statistical Learning Within Objects

Research has recently shown that efficient selection relies on the implicit extraction of environmental regularities, known as statistical learning. Although this has been demonstrated for scenes, similar learning arguably also occurs for objects. To test this, we developed a paradigm that allowed us to track attentional priority at specific object locations irrespective of the object's orientation in three experiments with young adults (all Ns = 80). Experiments 1a and 1b established within-object statistical learning by demonstrating increased attentional priority at relevant object parts (e.g., hammerhead). Experiment 2 extended this finding by demonstrating that learned priority generalized to viewpoints in which learning never took place. Together, these findings demonstrate that as a function of statistical learning, the visual system not only is able to tune attention relative to specific locations in space but also can develop preferential biases for specific parts of an object independently of the viewpoint of that object.

Learned feature regularities enable suppression of spatially overlapping stimuli

Contemporary theories of attentional control state that information can be prioritized based on selection history. Even though theories agree that selection history can impact representations of spatial location, which in turn helps guide attention, there remains disagreement on whether nonspatial features (e.g., color) are modulated in a similar way. While previous work has demonstrated color suppression using visual search tasks, it is possible that the location corresponding to the distractor was suppressed, consistent with a spatial mechanism of suppression. Here, we sought to rule out this possibility by testing whether similar suppression of a learned distractor color can occur for spatially overlapping visual stimuli. On a given trial, two spatially superimposed stimuli (line arrays) were tilted either left or right of vertical and presented in one of four distinct colors. Subjects performed a speeded report of the orientation of the “target” array with the most lines. Critically, the distractor array was regularly one color, and this high-probability color was never the color of the target array, which encouraged learned suppression. In two experiments, responses to the target array were fastest when the distractor array was in the high-probability color, suggesting participants suppressed the distractor color. Additionally, when regularities were removed, the high-probability distractor color continued to benefit speeded target identification for individual subjects (E1) but slowed target identification (E2) when presented in the target array. Together, these results indicate that learned suppression of feature-based regularities modulates target detection performance independent of spatial location and persists over time.

Divided attention effects in visual search are caused by objects not by space

Divided attention effects have been observed across a variety of stimuli and perceptual tasks, which have given rise to both object-based and space-based theories of divided attention. Object-based theories assert that processing information from multiple objects is limited, whereas space-based theories assert that processing information from multiple locations is limited. Extant results in the literature are collectively inconsistent with both simple object-based theories and simple space-based theories of divided attention. Using a visual search task with the extended simultaneous-sequential method to reveal capacity limitations, we found evidence of limited-capacity processing of object properties and unlimited-capacity processing of feature contrast. We found no evidence of a separate spatial limitation. A multiple pathway processing theory can account for these and a large body of previous results. According to this theory, tasks that require object processing must follow a limited-capacity pathway and therefore incur divided attention effects. Tasks that depend on only feature contrast can follow a separate unlimited-capacity processing pathway and therefore do not incur divided attention effects.

Awareness-independent gradual spread of object-based attention

Although attention can be directed at certain objects, how object-based attention spreads within an object and whether this spread interacts with awareness remain unclear. Using a modified spatial cuing paradigm with backward masking, we addressed these issues with either visible or invisible displays presenting the real (Experiment 1) and illusory (Experiment 2) U-shaped objects (UOs), whose ends and middles, the possible locations of the cue and target, have iso-eccentric distances from the fixation. These equidistant ends and middles of UOs offered us a unique opportunity to examine whether attention gradually spreads within a given object, i.e., within an UO, attention spreads from its cued-end to uncued-end via the uncued-middle. Despite the visibility (visible or invisible) of UOs, both experiments supported this gradual spread manner by showing a faster response of human participants (male and female) to the target in the uncued-middle than that in the uncued-end. Our results thus indicate a gradual spread of object-based attention and further reveal that this gradual spread is independent of both the “visual objectness” (whether the object is defined as the real or illusory boundaries) and conscious access to objects.

Effects of cue validity on attentional selection

Visual attention can be allocated to locations or objects, leading to enhanced processing of information at the specific location (space-based effects) or specific object (object-based effects). Previous studies have observed object-based effects to be smaller and less robust than space-based effects, with large individual differences in their temporal occurrence. Studies on space- and object-based effects are often based on a two-rectangle paradigm in which targets appear at cued locations more often than uncued locations. It is, however, unclear whether and how the target's spatial probability affects the temporal occurrence of these effects. In three experiments with different cue validities (80%, 50% and 33%), we systematically changed the interval between the cue and the target from 50 to 600 ms. On a group level and for individuals, we examined how cue validity affects the occurrence of object- and space-based effects. We observed that the magnitude and the prevalence of space-based effects heavily decreased with reduced cue validity. Object-based effects became even more sparse and turned increasingly negative with decreasing cue validity, representing a different-object rather than a same-object advantage. These findings indicate that changes in cue-validity affect both space- and object-based effects, but it does not account for the low prevalence and magnitude of object-based effects.

Can faces affect object-based attention? Evidence from online experiments

This study tested how human faces affect object-based attention (OBA) through two online experiments in a modified double-rectangle paradigm. The results of Experiment 1 revealed that faces did not elicit the OBA effect as non-face objects, which was caused by a longer response time (RT) when attention is focused on faces relative to non-face objects. In addition, by observing faster RTs when attention was engaged horizontally rather than vertically, we found a significant horizontal attention bias, which might override the OBA effect if vertical rectangles were the only items presented; these results were replicated in Experiment 2 (using only vertical rectangles) after directly measuring horizontal bias and excluding its influence on the OBA effect. This study suggested that faces cannot elicit the same-object advantage in the double-rectangle paradigm and provided a method to measure the OBA effect free from horizontal bias.

EXPRESS: Attention does not always help: the role of expectancy, divided, and spatial attention on illusory conjunctions

Humans have the subjective impression of a rich perceptual experience, but this perception is riddled with errors that might be produced by top-down expectancies or failures in feature integration. The role of attention in feature integration is still unclear. Some studies support the importance of attention in feature integration (Paul & Schyns, 2003), whereas others suggest that feature integration does not require attention (Humphreys, 2016). Understanding attention as a heterogeneous system, in this study we explored the role of divided (as opposed to focused - Experiment 1) attention, and endogenous-exogenous spatial orienting (Experiments 2 and 3) in feature integration. We also explored the role of feature expectancy, by presenting stimulus features that were completely unexpected to the participants. Results demonstrated that both endogenous and exogenous orienting improved feature integration while divided attention did not. Moreover, a strong and consistent feature expectancy effect was observed, demonstrating perceptual completion when an unexpected perceptual feature was presented in the scene. These results support the feature confirmation account (Humphreys, 2016), which proposes that attention is important for top-down matching of stable representations.

Capturing the objects of vision with neural networks

Human visual perception carves a scene at its physical joints, decomposing the world into objects, which are selectively attended, tracked and predicted as we engage our surroundings. Object representations emancipate perception from the sensory input, enabling us to keep in mind that which is out of sight and to use perceptual content as a basis for action and symbolic cognition. Human behavioural studies have documented how object representations emerge through grouping, amodal completion, proto-objects and object files. By contrast, deep neural network models of visual object recognition remain largely tethered to sensory input, despite achieving human-level performance at labelling objects. Here, we review related work in both fields and examine how these fields can help each other. The cognitive literature provides a starting point for the development of new experimental tasks that reveal mechanisms of human object perception and serve as benchmarks driving the development of deep neural network models that will put the object into object recognition.

Automatic object-based spatial selection depends on the distribution of sustained attention

Several space-based and object-based attention studies suggest these selection mechanisms may be voluntarily deployed, depending on task parameters and the attentional scope of the observer. Here, we sought to elucidate factors related to involuntary deployment of object-mediated space-based attention through two experiments. Experiment 1 used a modified flanker task where a target and nearby distractor were presented within the same or different object frames, such that an object-based attentional spread should be detrimental to performance. Results showed the presence of a flanker effect with no significant difference in magnitude between grouping conditions, indicating participants may have uniformly used a diffused attentional spotlight regardless of object segmentation. In a second experiment, we manipulated the extent of the observer’s sustained attentional scope via an inducer task to determine whether object-based selection depends on the initial spotlight size. The results revealed object-based effects solely when attention narrowly encompassed the target, but not when it was widened to include the distracting flanker. This suggests the deployment of object-based attention may occur when spatial attention is initially focused narrowly. Because selecting the whole object frame directly interfered with task goals, we conclude that object-based attention may not always fully conform to relevant task goals or operate in a goal-oriented manner. We discuss these results in the context of existing literature while proposing a reconciliation of previously inconsistent findings of object-based selection.

Attention can operate on object representations in visual sensory memory

Numerous studies have shown that attention can be allocated to various types of objects, such as low-level objects developed by perceptual organization and high-level objects developed by semantic associations. However, little is known about whether attention can also be affected solely by object representations in the brain, after the disappearance of physical objects. Here, we used a modified double-rectangle paradigm to investigate how attention is affected by object representation in visual sensory memory when the physical objects disappear for a short period of time before the target onset. By manipulating the interstimulus interval (ISI) between the offset of the objects and the onset of the target, an object-based attention effect, with shorter reaction times (RTs) for within-object relative to between-object conditions, was observed in the short-ISI (within 500 ms in Experiments 1a, 1b, 2, and 3) conditions while disappearing in the long-ISI (800 ms in Experiment 4) conditions. This result demonstrated that the mere presence of object representation in visual sensory memory, or the sensory memory-maintained object, can serve as an object unit that attention can operate on. This provides evidence for the relationship between object-based attention and visual sensory memory: object representation in visual sensory memory could affect attentional allocation, or attention can operate on a sensory memory-maintained object.

Feature-based attention is not confined by object boundaries: Spatially global enhancement of irrelevant features

Theories of visual attention differ in what they identify as the core unit of selection. Feature-based theories emphasize basic visual features (e.g., color, motion), demonstrated through enhancement of attended features throughout the visual field, while object-based theories propose that attention enhances all features belonging to the same object. These theories make distinct predictions about the processing of features that are not attended primarily: Object-based theories predict that such secondary, task-irrelevant features are enhanced within object boundaries, while feature-based theories predict enhancement of irrelevant features across locations, regardless of objecthood. To test these two accounts, we had participants attend a set of colored dots among distractor dots (moving coherently upward or downward) to detect brief luminance decreases, while simultaneously detecting speed changes in other sets of dots in the opposite visual field. In the first experiment, we demonstrate that participants have higher speed detection rates in the dot array that matched the motion direction of the attended color array, although motion direction was task-irrelevant. In a second experiment, we manipulated the probability that speed changes occurred in the matching motion direction and found that enhancement of the irrelevant motion direction persisted even when it was detrimental for task performance, suggesting that spatially global effects of feature-based attention cannot easily be flexibly adjusted. Overall, these results indicate that features that are not primarily attended are enhanced globally, surpassing object boundaries.

Phasic pupillary responses modulate object-based attentional prioritization

Visual attention studies have demonstrated that the shape of space-based selection can be governed by salient object contours: when a portion of an enclosed space is cued, the selected region extends to the full enclosure. Although this form of object-based attention (OBA) is well established, one continuing investigation focuses on whether this selection is obligatory or under voluntary control. We attempt to dissociate between these alternatives by interrogating the locus coeruleus-norepinephrine (LC-NE) system – known to fluctuate with top-down attention – during a classic two-rectangle paradigm in a sample of healthy human participants (N = 36). An endogenous spatial pre-cue directed voluntary space-based attention (SBA) to one end of a rectangular frame. We manipulated the reliability of the cue, such that targets appearing at an uncued location within the frame occurred at low or moderate frequencies. Phasic pupillary responses time-locked to the cue display served to noninvasively measure LC-NE activity, reflecting top-down processing of the spatial cue. If OBA is controlled analogously to SBA, then object selection should emerge only when it is behaviorally expedient and when LC-NE activity reflects a high degree of top-down attention to the cue display. Our results bore this out. Thus, we conclude that OBA was voluntarily controlled, and furthermore show that phasic norepinephrine may modulate attentional strategy.

Statistically defined visual chunks engage object-based attention

Although objects are the fundamental units of our representation interpreting the environment around us, it is still not clear how we handle and organize the incoming sensory information to form object representations. By utilizing previously well-documented advantages of within-object over across-object information processing, here we test whether learning involuntarily consistent visual statistical properties of stimuli that are free of any traditional segmentation cues might be sufficient to create object-like behavioral effects. Using a visual statistical learning paradigm and measuring efficiency of 3-AFC search and object-based attention, we find that statistically defined and implicitly learned visual chunks bias observers' behavior in subsequent search tasks the same way as objects defined by visual boundaries do. These results suggest that learning consistent statistical contingencies based on the sensory input contributes to the emergence of object representations.

Different temporal dynamics of object-based attentional allocation for reward and non-reward objects

Previous studies have confirmed that both non-reward objects (such as rectangles) and reward objects (such as banknotes) can guide the allocation of our attention; however, it is unclear whether the allocation mode of attention for reward objects is the same as for non-reward objects. This study aims to evaluate different modes of object-based attentional selection elicited by two types of objects: reward objects and non-reward objects. In our analysis, we used a two-rectangle paradigm in which two objects were presented visually. In a series of four experiments, we found a constant object-based effect with non-reward objects, such as rectangles and umbrellas, as stimuli in all of the stimulus onset asynchrony (SOA) conditions (Experiments 1 and 4), but the object-based effect disappeared only at longer SOA with reward objects such as monetary and food objects as stimuli (Experiments 2 and 3). Moreover, we found that monetary and food objects induced similar object-based effects. These results suggest that the temporal dynamics of object-based attentional allocation are different with respect to reward and non-reward objects, and different types of reward objects can guide attentional allocation in a similar way.

A region complexity effect masquerading as object-based attention

A large portion of the evidence for object-based attention comes from experiments using the two-rectangle paradigm introduced by Egly, Driver, and Rafal (1994), in which response times are longer when the two stimulus locations relevant to the task are on separate objects. In the new experiments presented here, response times are longer when the two locations are part of the same object but are separated by a concavity in the object, so that the region directly between the two locations is crossed by the object's boundaries. Response times when the two locations are separated by the concavity are not statistically different from when they are on two separate objects. The results are similar for a two-letter comparison task and for a spatial cuing task. Thus, in these experiments, the response time increase does not reflect the cost of shifting attention from object to object, because it appears when the two locations are on the same object, and it is not increased when they are on different objects. Instead, it seems to reflect the complexity of the region between the two stimulus locations. This finding raises questions about whether data from previous two-rectangle experiments should be attributed to object-based attention.

Target frequency modulates object-based attention

Decades of research have provided evidence that object representations contribute to attentional selection. However, most evidence for object-based attentional allocation is drawn from studies employing the two-rectangle paradigm where the target distribution is biased towards the cued object. It is thus unclear whether object-based attentional selection is from object representations or a consequence of spatial attention based on statistical imbalances. Here, we investigate the extent to which target frequency modulates object-based attention by systematically manipulating the frequency of target appearance in a particular spatial location within objects to equate spatial allocation, bias specific spatial locations, or bias objects. In four experiments, participants were presented with a variant of the two-rectangle paradigm in which one end of a rectangle was cued and performed a target discrimination task. Critically, the target location probabilities were parametrically manipulated. The target could appear equally in all ends within the objects (valid, invalid within-object, invalid between-object, diagonal) (Experiment 1) or with overall equality between objects but biased towards the invalid locations (Experiment 2). The target could also appear in three locations (valid, invalid within-object, invalid between-object) distributed equally between objects but biased towards the invalid between-object location (Experiment 3) or with an overall bias towards the invalid between-object location (Experiment 4). We observed that while objects bias attention, spatial biases are prioritized over object representations. Combined results suggest that object-based contribution to attentional guidance is the result of both spatial probabilities and object representations.

Object-based warping in three-dimensional environments

Object-based warping is a powerful visual illusion wherein space between features within figural regions is regularly overestimated compared with those within ground regions. Originally, the effect was only examined in displays of two-dimensional (2D) stimuli. The present study sought to examine whether object-based warping persists in more naturalistic viewing conditions, where additional contextual cues are present. Stimuli were presented with either three-dimensional (3D) printed objects (Experiment 1) or 3D objects in virtual reality (Experiments 2–4). The testing metric was actual distance of features (dots) compared with estimated distances made by participants. Responses for the 3D printed stimuli were measured with replica dots on a slide ruler device. The virtual reality experiments collected responses either with a computer mouse or motion-tracked controller and included manipulations of object type, spatial separation, viewing distance of stimuli, and head motion. A standard warping effect in 3D was observed in all experiments, although the effect was not present in one condition that elicits warping in 2D (Occluded Rectangle). The final experiment resolves this discrepancy by reducing the multicomponent object (Occluded Rectangle) to a single component figure, while demonstrating the influence of depth cues on the warping effect under occlusion. Collectively, these experiments reveal that object-based warping is a powerful effect, even in naturalistic settings.

Object-based attention generalizes to multisurface objects

When a part of an object is cued, targets presented in other locations on the same object are detected more rapidly and accurately than are targets on other objects. Often in object-based attention experiments, cues and targets appear not only on the same object but also on the same surface. In four psychophysical experiments, we examined whether the "object" of attentional selection was the entire object or one of its surfaces. In Experiment 1, facilitation effects were found for targets on uncued, adjacent surfaces on the same object, even when the cued and uncued surfaces were oriented differently in depth. This suggests that the "object-based" benefits of attention are not restricted to individual surfaces. Experiments 2a and 2b examined the interaction of perceptual grouping and object-based attention. In both experiments, cuing benefits extended across objects when the surfaces of those objects could be grouped, but the effects were not as strong as in Experiment 1, where the surfaces belonged to the same object. The cuing effect was strengthened in Experiment 3 by connecting the cued and target surfaces with an intermediate surface, making them appear to all belong to the same object. Together, the experiments suggest that the objects of attention do not necessarily map onto discrete physical objects defined by bounded surfaces. Instead, attentional selection can be allocated to perceptual groups of surfaces and objects in the same way as it can to a location or to groups of features that define a single object.

Object-based biased competition during covert spatial orienting

Biased-competition models assert that spatial attention facilitates visual perception by biasing competitive interactions in favor of relevant input. In line with this view, past work has shown that the benefits of covert spatial attention are greatest when targets must compete with interfering stimuli. Here we propose a boundary condition for the resolution of interference via exogenous attention: Attention resolves visual interference between targets and distractors, but only when they can be individuated into distinct representations. Thus, we propose that biased competition may be object-based. We replicated previous observations of larger attention effects when targets were flanked by irrelevant distractors (interference-present displays) than when targets were presented alone (interference-absent displays). Critically, we then showed that this amplification of cueing effects in the presence of interference is eliminated when strong crowding hampers individuation of the targets and distractors. Likewise, when targets were embedded within a noise mask that did not evoke the percept of an individuated distractor, the attention effects were equivalent across noise and lone-target displays. Thus, we conclude that exogenous spatial attention resolves interference in an object-based fashion that depends on the perception of individuated targets and distractors.

Location-Specific Orientation Set Is Independent of the Horizontal Benefit with or Without Object Boundaries

Chen and Cave (2019) showed that facilitation in visual comparison tasks that had previously been attributed to object-based attention could more directly be explained as facilitation in comparing two shapes that are configured horizontally rather than vertically. They also cued the orientation of the upcoming stimulus configuration without cuing its location and found an asymmetry: the orientation cue only enhanced performance for vertical configurations. The current study replicates the horizontal benefit in visual comparison and again demonstrates that it is independent of surrounding object boundaries. In these experiments, the cue is informative about the location of the target configuration as well as its orientation, and it enhances performance for both horizontal and vertical configurations; there is no asymmetry. Either a long or a short cue can enhance performance when it is valid. Thus, Chen and Cave’s cuing asymmetry seems to reflect unusual aspects of an attentional set for orientation that must be established without knowing the upcoming stimulus location. Taken together, these studies show that a location-specific cue enhances comparison independently of the horizontal advantage, while a location-nonspecific cue produces a different type of attentional set that does not enhance comparison in horizontal configurations.

Inversion produces opposite size illusions for faces and bodies

Faces are complex, multidimensional, and meaningful visual stimuli. Recently, Araragi, Aotani, & Kitaoka (2012) demonstrated an intriguing face size illusion whereby an inverted face is perceived as larger than a physically identical upright face. Like the face, the human body is a highly familiar and important stimulus in our lives. Here, we investigated the specificity of the size underestimation of upright faces illusion, testing whether similar effects also hold for bodies, hands, and everyday objects. Experiments 1a and 1b replicated the face-size illusion. No size illusion was observed for hands or objects. Unexpectedly, a reverse size illusion was observed for bodies, so that upright bodies were perceived as larger than their inverted counterparts. Experiment 2 showed that the face illusion was maintained even when the photographic contrast polarity of the stimuli was reversed, indicating that the visual system driving the illusion relies on geometric featural information rather than image contrast. In Experiment 2, the reverse size illusion for bodies failed to reach significance. Our findings show that size illusions caused by inversion show a high level of category specificity, with opposite illusions for faces and bodies.

The development of object-based attention in infants

We examined whether infants aged 6-8 months show object-based attention using the preferential looking method. In object-based attention, which is a prerequisite function for efficient real-world processing of various stimuli, a target that appears at a cued object is detected and processed faster than a target appearing at an uncued object. We presented 6- to 8-month-old infants with the visual stimuli consisting of two white vertical rectangles side by side, in which a target appearing at 1) the cued location, 2) the end opposite to the cued location, and 3) another rectangle's end following the cue, using an established paradigm, and measured each infant's first saccade to the target. We found that (1) infants of all ages could make the first saccade to the target appearing at the cued location, (2) only 8-month-old infants made the first saccade to the target appearing at the opposite end to the cued location more accurately than to the target appearing at the other rectangle's end. These results indicate that object-based attention might be acquired around 8 months compared with the spatial cueing effect that appears at around 6 months. Our findings suggest that the objects play a role in visual attention in 8-month-old infants.

Object-Based Attention on Social Units: Visual Selection of Hands Performing a Social Interaction

Traditionally, objects of attention are characterized either as full-fledged entities or either as elements grouped by Gestalt principles. Because humans appear to use social groups as units to explain social activities, we proposed that a socially defined group, according to social interaction information, would also be a possible object of attentional selection. This hypothesis was examined using displays with and without handshaking interactions. Results demonstrated that object-based attention, which was measured by an object-specific attentional advantage (i.e., shorter response times to targets on a single object), was extended to two hands performing a handshake but not to hands that did not perform meaningful social interactions, even when they did perform handshake-like actions. This finding cannot be attributed to the familiarity of the frequent co-occurrence of two handshaking hands. Hence, object-based attention can select a grouped object whose parts are connected within a meaningful social interaction. This finding implies that object-based attention is constrained by top-down information.

Using a model of human visual perception to improve deep learning

Deep learning algorithms achieve human-level (or better) performance on many tasks, but there still remain situations where humans learn better or faster. With regard to classification of images, we argue that some of those situations are because the human visual system represents information in a format that promotes good training and classification. To demonstrate this idea, we show how occluding objects can impair performance of a deep learning system that is trained to classify digits in the MNIST database. We describe a human inspired segmentation and interpolation algorithm that attempts to reconstruct occluded parts of an image, and we show that using this reconstruction algorithm to pre-process occluded images promotes training and classification performance.

Object width modulates object-based attentional selection

Visual input typically includes a myriad of objects, some of which are selected for further processing. While these objects vary in shape and size, most evidence supporting object-based guidance of attention is drawn from paradigms employing two identical objects. Importantly, object size is a readily perceived stimulus dimension, and whether it modulates the distribution of attention remains an open question. Across four experiments, the size of the objects in the display was manipulated in a modified version of the two-rectangle paradigm. In Experiment 1, two identical parallel rectangles of two sizes (thin or thick) were presented. Experiments 2-4 employed identical trapezoids (each having a thin and thick end), inverted in orientation. In the experiments, one end of an object was cued and participants performed either a T/L discrimination or a simple target-detection task. Combined results show that, in addition to the standard object-based attentional advantage, there was a further attentional benefit for processing information contained in the thick versus thin end of objects. Additionally, eye-tracking measures demonstrated increased saccade precision towards thick object ends, suggesting that Fitts's Law may play a role in object-based attentional shifts. Taken together, these results suggest that object-based attentional selection is modulated by object width.

Structure-Based Modulation of Inhibition of Return is Triggered by Object-Internal but not Occluding Shape Features

When attention is oriented to an object it is inhibited from returning to the same object following a short delay. This inhibition-of-return (IOR) effect is modulated by an edge discontinuity presented between cue and target—an effect referred to as structure-based modulation of IOR. Here we examined two alternative accounts for the structure-based modulation effect. On one account the modulation is caused by the presence of any intervening feature between cue and target. On another account the modulation is caused by edge-bounded (i.e., closed) regions of space, on which space-based selection mechanisms operate. We presented cues and targets on unsegmented and internally or externally segmented rectangles to examine the two alternative accounts for the effect. Contrary to the predictions of the two alternative accounts, structure-based modulation of IOR was found with the internally but not with the externally segmented displays. This supports our hypothesis that object-based IOR arises from perceptually complete and internally structured object representations.

Object-based processes in the planning of goal-directed hand movements

Theories in motor control suggest that the parameters specified during the planning of goal-directed hand movements to a visual target are defined in spatial parameters like direction and amplitude. Recent findings in the visual attention literature, however, argue widely for early object-based selection processes. The present experiments were designed to examine the contributions of object-based and space-based selection processes to the preparation time of goal-directed pointing movements. Therefore, a cue was presented at a specific location. The question addressed was whether the initiation of responses to uncued target stimuli could benefit from being either within the same object (object based) or presented at the same direction (space based). Experiment 1 replicated earlier findings of object-based benefits for non-goal-directed responses. Experiment 2 confirmed earlier findings of space-based benefits for goal-directed hand pointing movements. In Experiments 3 and 4, space-based and object-based manipulations were combined while requiring goal-directed hand pointing movements. The results clearly favour the notion that the selection processes for goal-directed pointing movements are primarily object based. Implications for theories on selective attention and action planning are discussed.

Attentional selection of multiple objects in the human visual system

Classic theories of object-based attention assume a single object of selection but real-world tasks, such as driving a car, often require attending to multiple objects simultaneously. However, whether object-based attention can operate on more than one object at a time remains unexplored. Here, we used functional magnetic resonance imaging (fMRI) to address this question as human participants performed object-based attention tasks that required simultaneous attention to two objects differing in either their features or locations. Simultaneous attention to two objects differing in features (face and house) did not show significantly different responses in the fusiform face area (FFA) or parahippocampal place area (PPA), respectively, compared to attending a single object (face or house), but did enhance the response in the inferior frontal gyrus (IFG). Simultaneous attention to two circular arcs differing in locations did not show significantly different responses in the primary visual cortex (V1) compared to attending a single circular arc, but did enhance the response in the intraparietal sulcus (IPS). These results suggest that object-based attention can simultaneously select at least two objects differing in their features or locations, processes mediated by the frontal and parietal cortex, respectively.

Perceptual completion of partly occluded contours during childhood

An early functional onset of perceptual completion has been extensively documented during the first several months after birth. However, there is no indication for the developmental time periods at which these skills become fully developed. We used a version of an object-based attention task in which children and adults performed a same-different size judgment of two features appearing at two of four possible ends of overlapping objects. Single-object over two-object superiority (i.e., faster judgments when the features appeared on the same object than when they appeared on different objects) was observed for a complete object as early as at 4 years of age. However, it is only at 5 years of age that such a single-object advantage was obtained also for an occluded object, and even then the advantage of the single-object and occluded-object conditions over the two-object condition was observed only when the two features in the two-object condition were spatially distant, demonstrating the critical role of spatial proximity in perceptual organization during childhood. The results suggest that perceptual completion during infancy and early childhood demonstrates some rudimentary perceptual skills that become more firmly established with age.

Prioritization to visual objects: Roles of sensory uncertainty

Two hypotheses, attentional prioritization and attentional spreading, have been proposed to account for object-based attention. The attentional-prioritization hypothesis posits that the positional uncertainty of targets is sufficient to resolve the controversy raised by the competing attentional-spreading hypothesis. Here we challenge the sufficiency of this explanation by showing that object-based attention is a function of sensory uncertainty in a task with consistent high positional uncertainty of the targets. In Experiment 1, object-based attention was modulated by sensory uncertainty induced by the noise from backward masking, showing an object-based effect under high as compared to low sensory uncertainty. This finding was replicated in Experiment 2 with increased task difficulty, to exclude that as a confounding factor, and in Experiment 3 with a psychophysical method, to obtain converging evidence using perceptual threshold measurement. Additionally, such a finding was not observed when sensory uncertainty was eliminated by replacing the backward-masking stimuli with perceptually dissimilar ones in Experiment 4. These results reveal that object-based attention is influenced by sensory uncertainty, even under high positional uncertainty of the targets. Our findings contradict the proposition of attentional spreading, proposing instead an automatic form of object-based attention due to enhancement of the perceptual representation. More importantly, the attentional-prioritization hypothesis based solely on positional uncertainty cannot sufficiently account for object-based attention, but needs to be developed by expanding the concept of uncertainty to include at least sensory uncertainty.

Saccade latency indexes exogenous and endogenous object-based attention

Classic studies of object-based attention have utilized keypress responses as the main dependent measure. However, people typically make saccades to fixate important objects. Recent work has shown that attention may act differently when it is deployed covertly versus in advance of a saccade. We further investigated the link between saccades and attention by examining whether object-based effects can be observed for saccades. We adapted the classical double-rectangle cueing paradigm of Egly, Driver, and Rafal (1994), and measured both the first saccade latency and the keypress reaction time (RT) to a target that appeared at the end of one of the two rectangles. Our results showed that saccade latencies exhibited higher sensitivity than did RTs for detecting effects of attention. We also assessed the generality of the attention effects by testing three types of cues: hybrid (predictive and peripheral), exogenous (nonpredictive and peripheral), and endogenous (predictive and central). We found that both RTs and saccade latencies exhibited effects of both space-based and object-based attentional selection. However, saccade latencies showed a more robust attentional modulation than RTs. For the exogenous cues, we observed a spatial inhibition of return along with an object-based effect, implying that object-based attention is independent of space-based attention. Overall, our results revealed an oculomotor correlate of object-based attention, suggesting that, in addition to spatial priority, object-level priority also affects saccade planning.

Target-object integration, attention distribution, and object orientation interactively modulate object-based selection

The representational basis of attentional selection can be object-based. Various studies have suggested, however, that object-based selection is less robust than spatial selection across experimental paradigms. We sought to examine the manner by which the following factors might explain this variation: Target-Object Integration (targets 'on' vs. part 'of' an object), Attention Distribution (narrow vs. wide), and Object Orientation (horizontal vs. vertical). In Experiment 1, participants discriminated between two targets presented 'on' an object in one session, or presented as a change 'of' an object in another session. There was no spatial cue-thus, attention was initially focused widely-and the objects were horizontal or vertical. We found evidence of object-based selection only when targets constituted a change 'of' an object. Additionally, object orientation modulated the sign of object-based selection: We observed a same-object advantage for horizontal objects, but a same-object cost for vertical objects. In Experiment 2, an informative cue preceded a single target presented 'on' an object or as a change 'of' an object (thus, attention was initially focused narrowly). Unlike in Experiment 1, we found evidence of object-based selection independent of target-object integration. We again found that the sign of selection was modulated by the objects' orientation. This result may reflect a meridian effect, which emerged due to anisotropies in the cortical representations when attention is oriented endogenously. Experiment 3 revealed that object orientation did not modulate object-based selection when attention was oriented exogenously. Our findings suggest that target-object integration, attention distribution, and object orientation modulate object-based selection, but only in combination.

Representing dynamic stimulus information during occlusion

Human observers maintain a representation of the visual features of objects when they become occluded. This representation facilitates the interpretation of occluded events and allows us to quickly identify objects upon reappearing. Here we investigated whether visual features that change over time are also represented during occlusion. To answer this question we used an illusion from the time perception domain in which the perceived duration of an event increases as its temporal frequency content increases. In the first experiment we demonstrate temporal frequency induced modulation of duration both when the object remains visible as well as when it becomes temporarily occluded. Additionally, we demonstrate that time dilation for temporarily occluded objects cannot be explained by modulations of duration as a result of pre- and post-occlusion presentation of the object. In a second experiment, we corroborate this finding by demonstrating that modulation of the perceived duration of occluded events depends on the expected temporal frequency content of the object during occlusion. Together these results demonstrate that the dynamic properties of an object are represented during occlusion. We conclude that the representations of occluded objects contain a wide range of features derived from the period when the object was still visible, including information about both the static and dynamic properties of the object.

The Effects of Spatial Endogenous Pre-cueing across Eccentricities

Frequently, we use expectations about likely locations of a target to guide the allocation of our attention. Despite the importance of this attentional process in everyday tasks, examination of pre-cueing effects on attention, particularly endogenous pre-cueing effects, has been relatively little explored outside an eccentricity of 20°. Given the visual field has functional subdivisions that attentional processes can differ significantly among the foveal, perifoveal, and more peripheral areas, how endogenous pre-cues that carry spatial information of targets influence our allocation of attention across a large visual field (especially in the more peripheral areas) remains unclear. We present two experiments examining how the expectation of the location of the target shapes the distribution of attention across eccentricities in the visual field. We measured participants’ ability to pick out a target among distractors in the visual field after the presentation of a highly valid cue indicating the size of the area in which the target was likely to occur, or the likely direction of the target (left or right side of the display). Our first experiment showed that participants had a higher target detection rate with faster responses, particularly at eccentricities of 20° and 30°. There was also a marginal advantage of pre-cueing effects when trials of the same size cue were blocked compared to when trials were mixed. Experiment 2 demonstrated a higher target detection rate when the target occurred at the cued direction. This pre-cueing effect was greater at larger eccentricities and with a longer cue-target interval. Our findings on the endogenous pre-cueing effects across a large visual area were summarized using a simple model to assist in conceptualizing the modifications of the distribution of attention over the visual field. We discuss our finding in light of cognitive penetration of perception, and highlight the importance of examining attentional process across a large area of the visual field.

Salient object changes influence overt attentional prioritization and object-based targeting in natural scenes

A change to an object in natural scenes attracts attention when it occurs during a fixation. However, when a change occurs during a saccade, and is masked by saccadic suppression, it typically does not capture the gaze in a bottom-up manner. In the present work, we investigated how the type and direction of salient changes to objects affect the prioritization and targeting of objects in natural scenes. We asked observers to look around a scene in preparation for a later memory test. After a period of time, an object in the scene was increased or decreased in salience either during a fixation (with a transient signal) or during a saccade (without transient signal), or it was not changed at all. Changes that were made during a fixation attracted the eyes both when the change involved an increase and a decrease in salience. However, changes that were made during a saccade only captured the eyes when the change was an increase in salience, relative to the baseline no-change condition. These results suggest that the prioritization of object changes can be influenced by the underlying salience of the changed object. In addition, object changes that occurred with a transient signal (which is itself a salient signal) resulted in more central object targeting. Taken together, our results suggest that salient signals in a natural scene are an important component in both object prioritization and targeting in natural scene viewing, insofar as they align with object locations.