How recent experience affects the perception of ambiguous objects

Serial Dependence in Perception

Much evidence has shown that perception is biased towards previously presented similar stimuli, an effect recently termed serial dependence. Serial dependence affects nearly every aspect of perception, often causing gross perceptual distortions, especially for weak and ambiguous stimuli. Despite unwanted side-effects, empirical evidence and Bayesian modeling show that serial dependence acts to improve efficiency and is generally beneficial to the system. Consistent with models of predictive coding, the Bayesian priors of serial dependence are generated at high levels of cortical analysis, incorporating much perceptual experience, but feed back to lower sensory areas. These feedback loops may drive oscillations in the alpha range, linked strongly with serial dependence. The discovery of top-down predictive perceptual processes is not new, but the new, more quantitative approach characterizing serial dependence promises to lead to a deeper understanding of predictive perceptual processes and their underlying neural mechanisms.

Perceptual bias contextualized in visually ambiguous stimuli

The visual appearance of an object is a function of stimulus properties as well as perceptual biases imposed by the observer. The context-specific trade-off between both can be measured accurately in a perceptual judgment task, involving grouping by proximity in ambiguous dot lattices. Such grouping depends lawfully on a stimulus parameter of the dot lattices known as their aspect ratio (AR), whose effect is modulated by a perceptual bias representing the preference for a cardinal orientation. In two experiments, we investigated how preceding context can lead to bias modulation, either in a top-down fashion via visual working memory (VWM) or bottom-up via sensory priming. In Experiment 1, we embedded the perceptual judgment task in a change detection paradigm and studied how the factors of VWM load (complexity of the memory array) and content (congruency in orientation to the ensuing dot lattice) affect the prominence of perceptual bias. A robust vertical orientation bias was observed, which was increased by VWM load and modulated by congruent VWM content. In Experiment 2, dot lattices were preceded by oriented primes. Here, primes regardless of orientation elicited a vertical orientation bias in dot lattices compared to a neutral baseline. Taken together, the two experiments demonstrate that top-down context (VWM load and content) effectively controls orientation bias modulation, while bottom-up context (i.e., priming) merely acts as an undifferentiated trigger to perceptual bias. These findings characterize the temporal context sensitivity of Gestalt perception, shed light on the processes responsible for different perceptual outcomes of ambiguous stimuli, and identify some of the mechanisms controlling perceptual bias.

Examining the Impact of Human Face Stimulus on Shape-Contrast Effects during a Brief Presentation

Shape-contrast effects have been introduced to the investigations into face perception with the aim of exploring face adaptation in the context of norm-based coding. Research has indicated that shape-contrast effects occur even for shapes as complex as the human face. However, whether the complexity of face stimuli alters the magnitude of shape-contrast effects needs to be examined. In this study, emoticons and realistic human faces were used with the original white circle as the test stimuli. The results revealed that the shape-contrast effect was dependent on the stimulus. However, there was no significant difference between the shape-contrast effect evoked by upright faces and that evoked by inverted ones. This suggests that the face stimuli influenced the strength of the shape-contrast effect: the mechanism of this effect involved multiple stages of the visual system related to luminance and complexity, rather than the holistic face perception.

Interactions Between Rhythmic and Feature Predictions to Create Parallel Time-Content Associations

The brain is inherently proactive, constantly predicting the when (moment) and what (content) of future input in order to optimize information processing. Previous research on such predictions has mainly studied the "when" or "what" domain separately, missing to investigate the potential integration of both types of predictive information. In the absence of such integration, temporal cues are assumed to enhance any upcoming content at the predicted moment in time (general temporal predictor). However, if the when and what prediction domain were integrated, a much more flexible neural mechanism may be proposed in which temporal-feature interactions would allow for the creation of multiple concurrent time-content predictions (parallel time-content predictor). Here, we used a temporal association paradigm in two experiments in which sound identity was systematically paired with a specific time delay after the offset of a rhythmic visual input stream. In Experiment 1, we revealed that participants associated the time delay of presentation with the identity of the sound. In Experiment 2, we unexpectedly found that the strength of this temporal association was negatively related to the EEG steady-state evoked responses (SSVEP) in preceding trials, showing that after high neuronal responses participants responded inconsistent with the time-content associations, similar to adaptation mechanisms. In this experiment, time-content associations were only present for low SSVEP responses in previous trials. These results tentatively show that it is possible to represent multiple time-content paired predictions in parallel, however, future research is needed to investigate this interaction further.

Adaptation Aftereffects in the Perception of Crabs and Lobsters as Examples of Complex Natural Objects

To recognize a familiar object, incoming perceptual information is matched against object representations in memory. Mounting evidence suggests that these representations are not stable, but adapt flexibly to recently encountered perceptual information. This is evident in the form of aftereffects, where prolonged exposure to one object (adaptor) influences perception of the next (test stimulus). So far, adaptation aftereffects have been mainly shown for human faces and simple geometric shapes, and it has been concluded that face aftereffects partially derive from shape adaptation. However, it is largely unknown whether adaptation aftereffects generalize to other categories of complex, naturalistic biological objects, and if so, whether these effects can be explained by shape adaptation. To answer these questions, we conducted three experiments in which images of crabs and lobsters were presented in two versions: as complex, naturalistic images, or reduced to their simplified geometric shapes. In Experiment 1, we found robust adaptation aftereffects for the complex versions of the images, indicating that adaptation aftereffects generalize to animate objects other than faces. Experiment 2 showed adaptation aftereffects for the simplified stimuli, replicating previous findings on geometric shapes. Experiment 3 demonstrated that adaptation to the simplified animal shapes results in aftereffects on the complex naturalistic stimuli. Comparisons between experiments revealed that aftereffects were largest in the first experiment, in which complex stimuli served as adaptor and test stimuli. Together, these experiments show that the magnitude of adaptation aftereffects depends on the complexity of the adaptor, but not on that of the test stimuli, and that shape adaptation plays a role in - but cannot entirely account for - the object aftereffects.

Auditory to Visual Cross-Modal Adaptation for Emotion: Psychophysical and Neural Correlates

Adaptation is fundamental in sensory processing and has been studied extensively within the same sensory modality. However, little is known about adaptation across sensory modalities, especially in the context of high-level processing, such as the perception of emotion. Previous studies have shown that prolonged exposure to a face exhibiting one emotion, such as happiness, leads to contrastive biases in the perception of subsequently presented faces toward the opposite emotion, such as sadness. Such work has shown the importance of adaptation in calibrating face perception based on prior visual exposure. In the present study, we showed for the first time that emotion-laden sounds, like laughter, adapt the visual perception of emotional faces, that is, subjects more frequently perceived faces as sad after listening to a happy sound. Furthermore, via electroencephalography recordings and event-related potential analysis, we showed that there was a neural correlate underlying the perceptual bias: There was an attenuated response occurring at ∼ 400 ms to happy test faces and a quickened response to sad test faces, after exposure to a happy sound. Our results provide the first direct evidence for a behavioral cross-modal adaptation effect on the perception of facial emotion, and its neural correlate.

Intermanual Apparent Tactile Motion and Its Extension to 3D Interactions

Information provided by sensory systems is inherently ambiguous as to its source in the physical world. To arrive at a coherent representation, perception deploys heuristic rules and multimodal input, which potentially produce errors such as illusions. The current work uses these effects to create apparent tactile motion and illusory depth motion using sparse vibrotactile stimulation across the hands. Experiment 1 showed the effects of vibrotactile duration and temporal separation between the hands on the quality of perceived illusory linear motion. Experiment 2 indicated a compressed linear relation between the visual and tactile speeds, and established a linear function relating visual size to perceived tactile intensity at three durations. Experiment 3 introduced an "M-filter" algorithm that varies tactile stimulus amplitude by a parabolic function based on visual looming and receding. It demonstrated that the M-filters, accompanied by visual depth cues, can induce tactile motion in depth. Experiment 4 showed the M-filter algorithm is necessary to create tactile perception in depth, as opposed to apparent tactile motion. The current research has value for a basic understanding of haptic perception, as well as haptic applications that digitally generate perceptual representations of the distal world on small-sized devices in the space between the hands.

Adaptation Duration Dissociates Category-, Image-, and Person-Specific Processes on Face-Evoked Event-Related Potentials

Several studies demonstrated that face perception is biased by the prior presentation of another face, a phenomenon termed as face-related after-effect (FAE). FAE is linked to a neural signal-reduction at occipito-temporal areas and it can be observed in the amplitude modulation of the early event-related potential (ERP) components. Recently, macaque single-cell recording studies suggested that manipulating the duration of the adaptor makes the selective adaptation of different visual motion processing steps possible. To date, however, only a few studies tested the effects of adaptor duration on the electrophysiological correlates of human face processing directly. The goal of the current study was to test the effect of adaptor duration on the image-, identity-, and generic category-specific face processing steps. To this end, in a two-alternative forced choice familiarity decision task we used five adaptor durations (ranging from 200-5000 ms) and four adaptor categories: adaptor and test were identical images-Repetition Suppression (RS); adaptor and test were different images of the Same Identity (SameID); adaptor and test images depicted Different Identities (DiffID); the adaptor was a Fourier phase-randomized image (No). Behaviorally, a strong priming effect was observed in both accuracy and response times for RS compared with both DiffID and No. The electrophysiological results suggest that rapid adaptation leads to a category-specific modulation of P100, N170, and N250. In addition, both identity and image-specific processes affected the N250 component during rapid adaptation. On the other hand, prolonged (5000 ms) adaptation enhanced, and extended category-specific adaptation processes over all tested ERP components. Additionally, prolonged adaptation led to the emergence of image-, and identity-specific modulations on the N170 and P2 components as well. In other words, there was a clear dissociation among category, identity-, and image-specific processing steps in the case of longer (3500 and 5000 ms) but not for shorter durations (< 3500 ms), reflected in the gradual reduction of N170 and enhancement of P2 in the No, DiffID, SameID, and RS conditions. Our findings imply that by manipulating adaptation duration one can dissociate the various steps of human face processing, reflected in the ERP response.

How previous experience shapes perception in different sensory modalities

What has transpired immediately before has a strong influence on how sensory stimuli are processed and perceived. In particular, temporal context can have contrastive effects, repelling perception away from the interpretation of the context stimulus, and attractive effects (TCEs), whereby perception repeats upon successive presentations of the same stimulus. For decades, scientists have documented contrastive and attractive temporal context effects mostly with simple visual stimuli. But both types of effects also occur in other modalities, e.g., audition and touch, and for stimuli of varying complexity, raising the possibility that context effects reflect general computational principles of sensory systems. Neuroimaging shows that contrastive and attractive context effects arise from neural processes in different areas of the cerebral cortex, suggesting two separate operations with distinct functional roles. Bayesian models can provide a functional account of both context effects, whereby prior experience adjusts sensory systems to optimize perception of future stimuli.

Perceptual adaptation to structure-from-motion depends on the size of adaptor and probe objects, but not on the similarity of their shapes

Perceptual adaptation destabilizes the phenomenal appearance of multistable visual displays. Prolonged dominance of a perceptual state fatigues the associated neural population, lowering the likelihood of renewed perception of the same appearance (Nawrot & Blake in Perception & Psychophysics, 49, 230-44, 1991). Here, we used a selective adaptation paradigm to investigate perceptual adaptation for the illusory rotation of ambiguous structure-from-motion (SFM) displays. Specifically, we generated SFM objects with different three-dimensional shapes and presented them in random order, separating successive objects by brief blank periods, which included a mask. To assess the specificity of perceptual adaptation to the shape of SFM objects, we established the probability that a perceived direction of rotation persisted between successive objects of similar or dissimilar shape. We found that the strength of negative aftereffects depended on the volume, but not the shape, of adaptor and probe objects. More voluminous objects were both more effective as adaptor objects and more sensitive as probe objects. Surprisingly, we found these volume effects to be completely independent, since any relationship between two shapes (such as overlap between volumes, similarity of shape, or similarity of velocity profiles) failed to modulate the negative aftereffect. This pattern of results was the opposite of that observed for sensory memory of SFM objects, which reflects similarity between objects, but not volume of individual objects (Pastukhov et al. in Attention, Perception & Psychophysics, 75, 1215-1229, 2013). The disparate specificities of perceptual adaptation and sensory memory for identical SFM objects suggest that the two aftereffects engage distinct neural representations, consistent with recent brain imaging results (Schwiedrzik et al. in Cerebral Cortex, 2012).

Domain-specific genetic influence on visual-ambiguity resolution

The visual world is flooded with ambiguity. Generally, people can resolve the ambiguity almost instantaneously, as when they distinguish at a glance whether a maiden in a portrait by Picasso is in profile or facing front. However, perception of the same reality, though relatively stable at the individual level, can vary dramatically from person to person, manifesting idiosyncratic perceptual biases. What drives the heterogeneity of human vision as reflected in the resolution of visual ambiguity? Using the twin method, we demonstrated a significant genetic contribution to individual differences in the visual disambiguation of bistable biological-motion stimuli but not inanimate motion stimuli. These findings challenge the prevailing view that the way the human brain makes sense of visual input is largely shaped by a person's perceptual history. Rather, the visual perception of biologically salient information can be guided by adaptive mental "priors" that are genetically transmitted.

Dissociating the neural bases of repetition-priming and adaptation in the human brain for faces

The repetition of a given stimulus leads to the attenuation of the functional magnetic resonance imaging (fMRI) signal compared with unrepeated stimuli, a phenomenon called fMRI adaptation or repetition suppression (RS). Previous studies have related RS of the fMRI signal behaviorally both to improved performance for the repeated stimulus (priming) and to shifts of perception away from the first stimulus (adaptation-related aftereffects). Here we used identical task (sex discrimination), trial structure [ stimulus 1 (S1): 3,000 ms, interstimulus interval: 600 ms, stimulus 2 (S2): 300 ms], and S2 stimuli (androgynous faces) to test how RS of the face-specific areas of the occipito-temporal cortex relates to priming and aftereffects. By varying S1, we could induce priming (significantly faster reaction times when S1 and S2 were identical compared with different images) as well as sex-specific aftereffect [an increased ratio of male responses if S1 was a female face compared with ambiguous faces or to Fourier-randomized noise (FOU) images]. Presenting any face as S1 led to significant RS of the blood oxygen level-dependent signal in the fusiform and occipital face areas as well as in the lateral occipital cortex of both hemispheres compared with FOU, reflecting stimulus category-specific encoding. Additionally, while sex-specific adaptation effects were only observed in occipital face areas, primed trials led to a signal reduction in both face-selective regions. Altogether, these results suggest the differential neural mechanisms of adaptation and repetition priming.

Face adaptation effects: reviewing the impact of adapting information, time, and transfer

The ability to adapt is essential to live and survive in an ever-changing environment such as the human ecosystem. Here we review the literature on adaptation effects of face stimuli to give an overview of existing findings in this area, highlight gaps in its research literature, initiate new directions in face adaptation research, and help to design future adaptation studies. Furthermore, this review should lead to better understanding of the processing characteristics as well as the mental representations of face-relevant information. The review systematizes studies at a behavioral level in respect of a framework which includes three dimensions representing the major characteristics of studies in this field of research. These dimensions comprise (1) the specificity of adapting face information, e.g., identity, gender, or age aspects of the material to be adapted to (2) aspects of timing (e.g., the sustainability of adaptation effects) and (3) transfer relations between face images presented during adaptation and adaptation tests (e.g., images of the same or different identities). The review concludes with options for how to combine findings across different dimensions to demonstrate the relevance of our framework for future studies.

Not all face aftereffects are equal

After prolonged exposure to a female face, faces that had previously seemed androgynous are more likely to be judged as male. Similarly, after prolonged exposure to a face with expanded features, faces that had previously seemed normal are more likely to be judged as having contracted features. These facial aftereffects have both been attributed to the impact of adaptation upon a norm-based opponent code, akin to low-level analyses of colour. While a good deal of evidence is consistent with this, some recent data is contradictory, motivating a more rigorous test. In behaviourally matched tasks we compared the characteristics of aftereffects generated by adapting to colour, to expanded or contracted faces, and to male or female faces. In our experiments opponent coding predicted that the appearance of the adapting image should change and that adaptation should induce symmetrical shifts of two category boundaries. This combination of predictions was firmly supported for colour adaptation, somewhat supported for facial distortion aftereffects, but not supported for facial gender aftereffects. Interestingly, the two face aftereffects we tested generated discrepant patterns of response shifts. Our data suggest that superficially similar aftereffects can ensue from mechanisms that differ qualitatively, and therefore that not all high-level categorical face aftereffects can be attributed to a common coding strategy.

United we sense, divided we fail: context-driven perception of ambiguous visual stimuli

Ambiguous visual stimuli provide the brain with sensory information that contains conflicting evidence for multiple mutually exclusive interpretations. Two distinct aspects of the phenomenological experience associated with viewing ambiguous visual stimuli are the apparent stability of perception whenever one perceptual interpretation is dominant, and the instability of perception that causes perceptual dominance to alternate between perceptual interpretations upon extended viewing. This review summarizes several ways in which contextual information can help the brain resolve visual ambiguities and construct temporarily stable perceptual experiences. Temporal context through prior stimulation or internal brain states brought about by feedback from higher cortical processing levels may alter the response characteristics of specific neurons involved in rivalry resolution. Furthermore, spatial or crossmodal context may strengthen the neuronal representation of one of the possible perceptual interpretations and consequently bias the rivalry process towards it. We suggest that contextual influences on perceptual choices with ambiguous visual stimuli can be highly informative about the neuronal mechanisms of context-driven inference in the general processes of perceptual decision-making.

Opposite influence of perceptual memory on initial and prolonged perception of sensory ambiguity

Observers continually make unconscious inferences about the state of the world based on ambiguous sensory information. This process of perceptual decision-making may be optimized by learning from experience. We investigated the influence of previous perceptual experience on the interpretation of ambiguous visual information. Observers were pre-exposed to a perceptually stabilized sequence of an ambiguous structure-from-motion stimulus by means of intermittent presentation. At the subsequent re-appearance of the same ambiguous stimulus perception was initially biased toward the previously stabilized perceptual interpretation. However, prolonged viewing revealed a bias toward the alternative perceptual interpretation. The prevalence of the alternative percept during ongoing viewing was largely due to increased durations of this percept, as there was no reliable decrease in the durations of the pre-exposed percept. Moreover, the duration of the alternative percept was modulated by the specific characteristics of the pre-exposure, whereas the durations of the pre-exposed percept were not. The increase in duration of the alternative percept was larger when the pre-exposure had lasted longer and was larger after ambiguous pre-exposure than after unambiguous pre-exposure. Using a binocular rivalry stimulus we found analogous perceptual biases, while pre-exposure did not affect eye-bias. We conclude that previously perceived interpretations dominate at the onset of ambiguous sensory information, whereas alternative interpretations dominate prolonged viewing. Thus, at first instance ambiguous information seems to be judged using familiar percepts, while re-evaluation later on allows for alternative interpretations.

The activation of alternative response candidates: when do doubts kick in?

In the current study, we investigated at which moment during visual object categorization alternative interpretations are most strongly activated. According to an early activation account, we are uncertain about how to interpret the visual information early in the categorization process. This uncertainty will vanish over time and therefore, the number of possible response candidates decreases over time. According to a late activation account, the visual information is categorized quickly, but after extensive viewing alternative interpretations become more strongly activated. Therefore, the number of possible response candidates increases over time. To increase perceptual uncertainty we used morphed figures composed of a dominant and nondominant object. The similarity rating between morphed figures and their nondominant object was taken as indicator for the activation of the nondominant response candidate: high similarity indicates that the nondominant object is relatively strongly activated as an alternative response candidate. Presentation times were varied in order to distinguish between the early and late activation account. Using a Bayesian model selection approach, we found support for the late activation account, but not for the early activation account. It thus seems that in a late stage of the categorization process the influence of the nondominant response candidate is strongest.

Position specificity of adaptation-related face aftereffects

It has been shown that prolonged exposure to a human face leads to shape-selective visual aftereffects. It seems that these face-specific aftereffects (FAEs) have multiple components, related to the adaptation of earlier and higher level processing of visual stimuli. The largest magnitude of FAE, using long-term adaptation periods, is usually observed at the retinotopic position of the preceding adaptor stimulus. However, FAE is also detected, to a smaller degree, at other retinal positions in a spatially invariant way and this component depends less on the adaptation duration. Several lines of evidences suggest that while the position-specific FAE involves lower level areas of the ventral processing stream, the position-invariant FAE depends on the activation of higher level face-processing areas and the fusiform gyrus in particular. In the present paper, we summarize the available behavioural, electrophysiological and neuroimaging results regarding the spatial selectivity of FAE and discuss their implications for the visual stability of object representations across saccadic eye movements.

Neural attractor dynamics in object recognition

A widely held theory dating back to Donald Hebb posits neuronal attractor dynamics to underlie the retrieval of objects from long-term memory and the categorization of ambiguous stimuli, but empirical support for this notion had so far pointed more at self-sustained activity than at attractor dynamics per se. Complex perceptual effects modulating memory retrieval, including priming effects, are compatible with both attractor dynamics and alternative hypotheses, which seem to result in opposite predictions at the neuronal level. Recent recordings in monkeys indicate that attractor dynamics may indeed be observed, as it unfolds in time over a few hundred milliseconds, if neurons are probed in infero-temporal cortex during the categorization of ambiguous visual stimuli. Extending the analysis of such phenomena promises to take us beyond the perceptual periphery, where neuronal responses are still largely determined by sensory stimuli. Understanding the nature of transitions between attractor states opens the door to higher-level thought processes.