Serial dependence of facial identity reflects high-level face coding

Opposing serial dependencies revealed for sequences of auditory emotional stimuli

Our percept of the world is not solely determined by what we perceive and process at a given moment in time, but also depends on what we processed recently. In the present study, we investigate whether the perceived emotion of a spoken sentence is contingent upon the emotion of an auditory stimulus on the preceding trial (i.e., serial dependence). Thereto, participants were exposed to spoken sentences that varied in emotional affect by changing the prosody that ranged from 'happy' to 'fearful'. Participants were instructed to rate the emotion. We found a positive serial dependence for emotion processing whereby the perceived emotion was biased towards the emotion on the preceding trial. When we introduced 'no-go' trials (i.e., no rating was required), we found a negative serial dependence when participants knew in advance to withhold their response on a given trial (Experiment 2) and a positive serial dependence when participants received the information to withhold their response after the stimulus presentation (Experiment 3). We therefore established a robust serial dependence for emotion processing in speech and introduce a methodology to disentangle perceptual from post-perceptual processes. This approach can be applied to the vast majority of studies investigating sequential dependencies to separate positive from negative serial dependence.

Serial Dependence in Perception

Much evidence has shown that perception is biased towards previously presented similar stimuli, an effect recently termed serial dependence. Serial dependence affects nearly every aspect of perception, often causing gross perceptual distortions, especially for weak and ambiguous stimuli. Despite unwanted side-effects, empirical evidence and Bayesian modeling show that serial dependence acts to improve efficiency and is generally beneficial to the system. Consistent with models of predictive coding, the Bayesian priors of serial dependence are generated at high levels of cortical analysis, incorporating much perceptual experience, but feed back to lower sensory areas. These feedback loops may drive oscillations in the alpha range, linked strongly with serial dependence. The discovery of top-down predictive perceptual processes is not new, but the new, more quantitative approach characterizing serial dependence promises to lead to a deeper understanding of predictive perceptual processes and their underlying neural mechanisms.

Serial dependence bias can predict the overall estimation error in visual perception

Although visual feature estimations are accurate and precise, overall estimation errors (i.e., the difference between estimates and actual values) tend to show systematic patterns. For example, estimates of orientations are systematically biased away from horizontal and vertical orientations, showing an oblique illusion. Additionally, many recent studies have demonstrated that estimations of current visual features are systematically biased toward previously seen features, showing a serial dependence. However, no study examined whether the overall estimation errors were correlated with the serial dependence bias. To address this question, we enrolled three groups of participants to estimate orientation, motion speed, and point-light-walker direction. The results showed that the serial dependence bias explained over 20% of overall estimation errors in the three tasks, indicating that we could use the serial dependence bias to predict the overall estimation errors. The current study first demonstrated that the serial dependence bias was not independent from the overall estimation errors. This finding could inspire researchers to investigate the neural bases underlying the visual feature estimation and serial dependence.

Serial dependence in visual perception: A meta-analysis and review

Positive sequential dependencies are phenomena in which actions, perception, decisions, and memory of features or objects are systematically biased toward visual experiences from the recent past. Among many labels, serial dependencies have been referred to as priming, sequential dependencies, sequential effects, or serial effects. Despite extensive research on the topic, the field still lacks an operational definition of what counts as serial dependence. In this meta-analysis, we review the vast literature on serial dependence and quantitatively assess its key diagnostic characteristics across several different domains of visual perception. The meta-analyses fully characterize serial dependence in orientation, face, and numerosity perception. They show that serial dependence is defined by four main kinds of tuning: serial dependence decays with time (temporal-tuning), it depends on relative spatial location (spatial-tuning), it occurs only between similar features and objects (feature-tuning), and it is modulated by attention (attentional-tuning). We also review studies of serial dependence that report single observer data, highlighting the importance of individual differences in serial dependence. Finally, we discuss a range of outstanding questions and novel research avenues that are prompted by the meta-analyses. Together, the meta-analyses provide a full characterization of serial dependence as an operationally defined family of visual phenomena, and they outline several of the key diagnostic criteria for serial dependence that should serve as guideposts for future research.

EXPRESS: The Influence of Three-Dimensional Cues on Body Size Judgements

Research has shown that body size judgements are frequently biased, or inaccurate. Critically, judgement biases are further exaggerated for individuals with eating disorders, a finding that has been attributed to difficulties integrating body features into a perceptual whole. However, current understanding of which body features are integrated when judging body size is lacking. In this study, we examine whether individuals integrate three-dimensional (3D) cues to body volume when making body size judgements. Computer-generated body stimuli were presented in a 3D Virtual Reality (VR) environment. Participants (N = 412) were randomly assigned to one of two conditions: in one condition the to-be-judged body was displayed binocularly (containing 3D cues to body volume), in the other, bodies were presented monocularly (2D cues only). Across 150 trials, participants were required to make a body size judgement of a target female body from a third-person point of view using an unmarked visual analogue scale (VAS). It was found that 3D cues significantly influenced body size judgements. Namely, thin 3D bodies were judged smaller, and overweight 3D bodies were judged larger, than their 2D counterpart. Furthermore, to reconcile these effects, we present evidence that the two perceptual biases, regression to the mean and serial dependence, were reduced by the additional 3D feature information. Our findings increase our understanding of how body size is perceptually encoded and creates testable predictions for clinical populations exhibiting integration difficulties.

Illusion of visual stability through active perceptual serial dependence

Despite a noisy and ever-changing visual world, our perceptual experience seems remarkably stable over time. How does our visual system achieve this apparent stability? Here, we introduce a previously unknown visual illusion that shows direct evidence for an online mechanism continuously smoothing our percepts over time. As a result, a continuously seen physically changing object can be misperceived as unchanging. We find that online object appearance is captured by past visual experience up to 15 seconds ago. We propose that, because of an underlying active mechanism of serial dependence, the representation of the object is continuously merged over time, and the consequence is an illusory stability in which object appearance is biased toward the past. Our results provide a direct demonstration of the link between serial dependence in visual representations and perceived visual stability in everyday life.

Serial dependence of facial identity for own- and other-race faces

It is well established that individuals are better at recognising faces of their own-race compared with other-races; however, there is ongoing debate regarding the perceptual mechanisms that may be involved and therefore sensitive to face-race. Here, we ask whether serial dependence of facial identity, a bias where the perception of a face's identity is biased towards a previously presented face, shows an other-race effect. Serial dependence is associated with face recognition ability and appears to operate on high-level, face-selective representations, like other candidate mechanisms (e.g., holistic processing). We therefore expected to find an other-race effect for serial dependence for our Caucasian and Asian participants. While participants showed robust effects of serial dependence for all faces, only Caucasian participants showed stronger serial dependence for own-race faces. Intriguingly, we found that individual variation in own-race, but not other-race, serial dependence was significantly associated with face recognition abilities. Preliminary evidence also suggested that other-race contact is associated with other-race serial dependence. In conclusion, though we did not find an overall difference in serial dependence for own- versus other-race faces in both participant groups, our results highlight that this bias may be functionally different for own- versus other-race faces and sensitive to racial experience.

A shared mechanism for facial expression in human faces and face pareidolia

Facial expressions are vital for social communication, yet the underlying mechanisms are still being discovered. Illusory faces perceived in objects (face pareidolia) are errors of face detection that share some neural mechanisms with human face processing. However, it is unknown whether expression in illusory faces engages the same mechanisms as human faces. Here, using a serial dependence paradigm, we investigated whether illusory and human faces share a common expression mechanism. First, we found that images of face pareidolia are reliably rated for expression, within and between observers, despite varying greatly in visual features. Second, they exhibit positive serial dependence for perceived facial expression, meaning an illusory face (happy or angry) is perceived as more similar in expression to the preceding one, just as seen for human faces. This suggests illusory and human faces engage similar mechanisms of temporal continuity. Third, we found robust cross-domain serial dependence of perceived expression between illusory and human faces when they were interleaved, with serial effects larger when illusory faces preceded human faces than the reverse. Together, the results support a shared mechanism for facial expression between human faces and illusory faces and suggest that expression processing is not tightly bound to human facial features.

Autistic Traits are Associated with Less Precise Perceptual Integration of Face Identity

Face recognition difficulties are common in autism and could be a consequence of perceptual atypicalities that disrupt the ability to integrate current and prior information. We tested this theory by measuring the strength of serial dependence for faces (i.e. how likely is it that current perception of a face is biased towards a previously seen face) across the broader autism phenotype. Though serial dependence was not weaker in individuals with more autistic traits, more autistic traits were associated with greater integration of less similar faces. These results suggest that serial dependence is less specialised, and may not operate optimally, in individuals with more autistic traits and could therefore be a contributing factor to autism-linked face recognition difficulties.