Orientation-Selective Adaptation to Crowded Illusory Lines

Multi-level Crowding and the Paradox of Object Recognition in Clutter

In everyday life, we are constantly surrounded by complex and cluttered scenes. In such cluttered environments, visual perception is primarily limited by crowding, the deleterious influence of nearby objects on object recognition. For the past several decades, visual crowding was assumed to occur at a single stage, only between low-level features or object parts, thus dismantling, destroying, or filtering object information. A large and converging body of evidence has demonstrated that this assumption is false: crowding occurs at multiple stages of visual analysis, and information passes through crowding at each of these stages. This converging empirical evidence points to a seeming paradox: crowding happens at multiple levels, which would seem to impair object recognition, and yet visual information at each of those levels is maintained intact and influences subsequent higher-level visual processing. Thus, while crowding impairs the access we have to visual information at many levels, it does not impair the representation of that information. The resolution of this paradox reveals how the visual system strikes a balance between the limits of object selection and the desire to represent multiple levels of visual information throughout cluttered scenes. Understanding crowding is therefore key to resolving the relationship between the richness of object and scene representations and the limits of conscious object recognition.

Facial Expression Aftereffect Revealed by Adaption to Emotion-Invisible Dynamic Bubbled Faces

Visual adaptation is a powerful tool to probe the short-term plasticity of the visual system. Adapting to local features such as the oriented lines can distort our judgment of subsequently presented lines, the tilt aftereffect. The tilt aftereffect is believed to be processed at the low-level of the visual cortex, such as V1. Adaptation to faces, on the other hand, can produce significant aftereffects in high-level traits such as identity, expression, and ethnicity. However, whether face adaptation necessitate awareness of face features is debatable. In the current study, we investigated whether facial expression aftereffects (FEAE) can be generated by partially visible faces. We first generated partially visible faces using the bubbles technique, in which the face was seen through randomly positioned circular apertures, and selected the bubbled faces for which the subjects were unable to identify happy or sad expressions. When the subjects adapted to static displays of these partial faces, no significant FEAE was found. However, when the subjects adapted to a dynamic video display of a series of different partial faces, a significant FEAE was observed. In both conditions, subjects could not identify facial expression in the individual adapting faces. These results suggest that our visual system is able to integrate unrecognizable partial faces over a short period of time and that the integrated percept affects our judgment on subsequently presented faces. We conclude that FEAE can be generated by partial face with little facial expression cues, implying that our cognitive system fills-in the missing parts during adaptation, or the subcortical structures are activated by the bubbled faces without conscious recognition of emotion during adaptation.

Invisible motion contributes to simultaneous motion contrast

The purpose of the present study was two-fold. First we examined whether visible motion appearance was altered by the spatial interaction between invisible and visible motion. We addressed this issue by means of simultaneous motion contrast, in which a horizontal test grating with a counterphase luminance modulation was seen to have the opposite motion direction to a peripheral inducer grating with unidirectional upward or downward motion. Using a mirror stereoscope, observers viewed the inducer and test gratings with one eye, and continuous flashes of colorful squares forming an annulus shape with the other eye. The continuous flashes rendered the inducer subjectively invisible. The observers' task was to report whether the test grating moved upward or downward. Consequently, simultaneous motion contrast was observed even when the inducer was invisible (Experiment 1). Second, we examined whether the observers could correctly respond to the direction of invisible motion: It was impossible (Experiment 2).

Retinotopy of the face aftereffect

Physiological results for the size of face-specific units in inferotemporal cortex (IT) support an extraordinarily large range of possible sizes--from 2.5 degrees to 30 degrees or more. We use a behavioral test of face-specific aftereffects to measure the face analysis regions and find a coarse retinotopy consistent with receptive fields of intermediate size (10 degrees -12 degrees at 3 degrees eccentricity). In the first experiment, observers were adapted to a single face at 3 degrees from fixation. A test (a morph of the face and its anti-face) was then presented at different locations around fixation and subjects classified it as face or anti-face. The face aftereffect (FAE) was not constant at all test locations--it dropped to half its maximum value for tests 5 degrees from the adapting location. Simultaneous adaptation to both a face and its anti-face, placed at opposite locations across fixation, produced two separate regions of opposite aftereffects. However, with four stimuli, faces alternating with anti-faces equally spaced around fixation, the FAE was greatly reduced at all locations, implying a fairly coarse localization of the aftereffect. In the second experiment, observers adapted to a face and its anti-face presented either simultaneously or in alternation. Results showed that the simultaneous presentation of a face and its anti-face leads to stronger FAEs than sequential presentation, suggesting that face processing has a dynamic nature and its region of analysis is sharpened when there is more than one face in the scene. In the final experiment, a face and two anti-face flankers with different spatial offsets were presented during adaptation and the FAE was measured at the face location. Results showed that FAE at the face location was inhibited more as the distance of anti-face flankers to the face stimulus was reduced. This confirms the spatial extent of face analysis regions in a test with a fixed number of stimuli where only distance varied.

The initial interactions underlying binocular rivalry require visual awareness

Current theories of binocular vision suggest that the neural processes that resolve interocular conflict do not involve a single brain region but occur at multiple stages of visual processing. Here, using an adaptation paradigm, we explore the initial mechanisms involved in selecting a stimulus for perceptual dominance during binocular rivalry. When one or both eyes briefly viewed an adapting grating stimulus prior to the presentation of the adapting grating to one eye and an orthogonal, non-adapted grating to the other eye, participants more often reported perceptual dominance of the non-adapted grating. Crowding reduced awareness of the adapting grating. On trials in which subjects were unaware of the orientation of the adaptor grating, there was no effect of the adaptor on perceived dominance during rivalry; participants were just as likely to report dominance of the adapted or non-adapted grating. This implies that the initial events in binocular rivalry involve later stages of visual processing.

Illusory shape representation in the monkey inferior temporal cortex

Perceived boundaries without physical differences between shape and background are called illusory contours (ICs). ICs and real contours (RCs) activate the early processing stages of the macaque visual pathway and the occipitotemporal areas of the human visual system in a similar way. However, it is not known how these contours are processed further in the highest visual areas. We tested how the responses of inferior temporal cortical (IT) neurons of macaque monkeys change in relationship to figures with RCs or ICs. The same set of figures [coloured pictures, ICs and silhouettes (SILs)] was presented to awake, fixating rhesus monkeys while the single-cell activity was recorded in the anterior part of the IT. Most of the neurons responsive to RCs were also responsive to the same shapes presented as ICs. The average net firing rates, however, were significantly lower for the illusory stimuli than for the stimuli in the RC conditions, and the latency of the responses was significantly longer for the ICs than for the RCs. The shape selectivity was found to be different for coloured stimuli and ICs, and similar for SILs and ICs, suggesting the invariance of selectivity to shapes having the same contour but lacking internal surface information. These results suggest different modes of processing of RCs and ICs in the IT, which might explain the differences in their perception.

Subliminal attentional modulation in crowding condition

In the crowding phenomenon, recognition of a visual target is impaired by other similar visual stimuli (distracters) presented near the target. This effect may be due largely to insufficient resolution of spatial attention. We showed that attention could subliminally enhance orientation selective adaptation to illusory lines in the crowding condition where target-distractor separation is beyond the limit of spatial resolution of attention. Despite the traditionally held close link between attention and awareness, here we provided evidence for subliminal attentional modulation for orientation stimuli that could not have been consciously perceived.

Static motion aftereffect does not modulate positional representations in early visual areas

A stationary stimulus is perceived to drift in the opposite direction after adaptation to a moving stimulus (static motion aftereffect (MAE)). It is commonly assumed that positional effects from the static motion aftereffect are mediated by early visual areas. Here we psychophysically showed that these positional effects did not modulate illusory line-tilt aftereffect (TAE). Since illusory contours seem to be represented at relatively early stages of visual hierarchy, we suggest that the neural substrates underlying the perception of static motion aftereffect and illusory contours are different.