The influence of prior expectations on facial expression discrimination in schizophrenia

Positive hysteresis in emotion recognition: Face processing visual regions are involved in perceptual persistence, which mediates interactions between anterior insula and medial prefrontal cortex

Facial emotion perception can be studied from the point of view of dynamic systems whose output may depend not only on current input but also on prior history - a phenomenon known as hysteresis. In cognitive neuroscience, hysteresis has been described as positive (perceptual persistence) or negative (fatigue of current percept) depending on whether perceptual switching occurs later or earlier than actual physical stimulus changes. However, its neural correlates remain elusive. We used dynamic transitions between emotional expressions and combined behavioral assessment with functional magnetic resonance imaging (fMRI) to investigate the underlying circuitry of perceptual hysteresis in facial emotion recognition. Our findings revealed the involvement of face-selective visual areas - fusiform face area (FFA) and superior temporal sulcus (STS) - in perceptual persistence as well as the right anterior insula. Moreover, functional connectivity analyses revealed an interplay between the right anterior insula and medial prefrontal cortex, which showed to be dependent on the presence of positive hysteresis. Our results support the hypothesis that high-order regions are involved in perceptual stabilization and decision during perceptual persistence (positive hysteresis) and add evidence to the role of the anterior insula as a hub of sensory information in perceptual decision-making.

Predictive waves in the autism-schizophrenia continuum: A novel biobehavioral model

The brain is a predictive machine. Converging data suggests a diametric predictive strategy from autism spectrum disorders (ASD) to schizophrenic spectrum disorders (SSD). Whereas perceptual inference in ASD is rigidly shaped by incoming sensory information, the SSD population is prone to overestimate the precision of their priors' models. Growing evidence considers brain oscillations pivotal biomarkers to understand how top-down predictions integrate bottom-up input. Starting from the conceptualization of ASD and SSD as oscillopathies, we introduce an integrated perspective that ascribes the maladjustments of the predictive mechanism to dysregulation of neural synchronization. According to this proposal, disturbances in the oscillatory profile do not allow the appropriate trade-off between descending predictive signal, overweighted in SSD, and ascending prediction errors, overweighted in ASD. These opposing imbalances both result in an ill-adapted reaction to external challenges. This approach offers a neuro-computational model capable of linking predictive coding theories with electrophysiological findings, aiming to increase knowledge on the neuronal foundations of the two spectra features and stimulate hypothesis-driven rehabilitation/research perspectives.

How positive emotional content overrules perceptual history effects: Hysteresis in emotion recognition

The human visual system is constantly processing multiple and often conflicting sensory cues to make perceptual decisions. Given the nonlinear nature of emotion recognition, this often leads to different percepts of the same physical facial expression. Moreover, the state of the emotion recognition system might depend on the trajectory of temporal context, potentially leading to a phenomenon known as perceptual hysteresis. Here, we aimed to explore temporal context-related mechanisms underlying perceptual hysteresis during emotion recognition. We hypothesized that dependence on recent perceptual experience might reveal important clues about the role of short-term memory on the perception of emotional stimuli. Behavioral data were acquired using reality-based, changing emotion expressions morphed from a source to a target emotion with different valences, always passing through a neutral expression. Participants identified the onset and offset of what they perceived as the neutral expression interval. Our results showed that current perception of emotional expression is affected by recent temporal context, thus revealing perceptual hysteresis. We also found a relation between recent perceptual history effects and stimulus emotional Content: The positive valence of the stimulus emotional content appeared to abolish perceptual history effects, whereas negatively loaded stimuli induced clear short-term memory effects and positive hysteresis. Our findings show direct competition between recent perceptual experience and stimulus emotional content during decision making, which affects the formation of current percepts in emotion recognition.

Emotional face prediction in rejection sensitive individuals: Evidence from event-related potentials

Human beings live in an uncertain world, but they continuously generate top-down predictions about emotional face information of other people around them. Although the prediction processing has repeatedly been investigated in the literature of prediction, little is known about the impact of rejection sensitive (RS) on individuals' emotional face prediction. To this end, high and low RS participants were asked to perform an identification task of emotional faces in which target faces were shown in either an angry or happy expression while their brain responses were recorded using an event-related potential (ERP) technique. The behavioral results suggested an effect of emotional face prediction. For the P100 component, low RS participants showed longer P100 peak latencies in the left than right hemisphere when they viewed predictable emotional faces. In addition, low RS participants showed larger N170 mean amplitudes for angry compared to happy faces when they perceived unpredictable faces, but not when these faces were predictable. This presumably reflected a sensibility to angry faces in the unpredictable trails. Interestingly, high RS participants did not demonstrate such a N170 difference, suggesting that high RS participants showed a reduced sensitivity to unpredictable angry faces. Furthermore, angry faces triggered increased LPP mean amplitudes compared to happy faces, which was consistent with the results of other ERP studies examining the processing of emotional faces. Finally, we observed significant negative correlations between behavioral and ERP prediction effect, indicating one consistency between the behavioral and electrophysiological data.

Stria terminalis, amygdala, and temporoparietal junction networks facilitate efficient emotion processing under expectations

Rapid emotion processing is an ecologically essential ability for survival in social environments in which threatening or advantageous encounters dynamically and rapidly occur. Efficient emotion recognition is subserved by different processes, depending on one's expectations; however, the underlying functional and structural circuitry is still poorly understood. In this study, we delineate brain networks that subserve fast recognition of emotion in situations either congruent or incongruent with prior expectations. For this purpose, we used multimodal neuroimaging and investigated performance on a dynamic emotion perception task. We show that the extended amygdala structural and functional networks relate to speed of emotion processing under threatening conditions. Specifically, increased microstructure of the right stria terminalis, an amygdala white-matter pathway, was related to faster detection of emotion during actual presentation of anger or after cueing anger. Moreover, functional connectivity of right amygdala with limbic regions was related to faster detection of anger congruent with cue, suggesting selective attention to threat. On the contrary, we found that faster detection of anger incongruent with cue engaged the ventral attention "reorienting" network. Faster detection of happiness, in either expectancy context, engaged a widespread frontotemporal-subcortical functional network. These findings shed light on the functional and structural circuitries that facilitate speed of emotion recognition and, for the first time, elucidate a role for the stria terminalis in human emotion processing.

No evidence for abnormal priors in early vision in schizophrenia

The predictive coding account of psychosis postulates the abnormal formation of prior beliefs in schizophrenia, resulting in psychotic symptoms. One domain in which priors play a crucial role is visual perception. For instance, our perception of brightness, line length, and motion direction are not merely based on a veridical extraction of sensory input but are also determined by expectation (or prior) of the stimulus. Formation of such priors is thought to be governed by the statistical regularities within natural scenes. Recently, the use of such priors has been attributed to a specific set of well-documented visual illusions, supporting the idea that perception is biased toward what is statistically more probable within the environment. The Predictive Coding account of psychosis proposes that patients form abnormal representations of statistical regularities in natural scenes, leading to altered perceptual experiences. Here we use classical vision experiments involving a specific set of visual illusions to directly test this hypothesis. We find that perceptual judgments for both patients and control participants are biased in accordance with reported probability distributions of natural scenes. Thus, despite there being a suggested link between visual abnormalities and psychotic symptoms in schizophrenia, our results provide no support for the notion that altered formation of priors is a general feature of the disorder. These data call for a refinement in the predictions of quantitative models of psychosis.

Neural correlates of dynamic emotion perception in schizophrenia and the influence of prior expectations

Impaired emotion perception is a well-established and stable deficit in schizophrenia; however, there is limited knowledge about the underlying aberrant cognitive and brain processes that result in emotion perception deficits. Recent influential work has shown that perceptual deficits in schizophrenia may result from aberrant precision in prior expectations, associated with disrupted activity in frontal regions. In the present study, we investigated the perception of dynamic, multisensory emotion, the influence of prior expectations and the underlying aberrant brain processes in schizophrenia. During a functional Magnetic Resonance Imaging scan, participants completed the Dynamic Emotion Perception task, which induces prior expectations with emotion instruction cues. We delineated neural responses and functional connectivity in whole-brain large-scale networks underlying emotion perception. Compared to healthy individuals, schizophrenia patients had lower accuracy specifically for emotions that were congruent with prior expectations. At the neural level, schizophrenia patients had less engagement of right inferior frontal and parietal regions, as well as right amygdala dysconnectivity during discrimination of emotions congruent with prior expectations. The results indicate that individuals with schizophrenia may have aberrant prior expectations about emotional expressions, associated with under-activity in inferior frontoparietal regions and right amygdala dysconnectivity, which results in impaired perception of emotion.

Dynamic emotion perception and prior expectancy

Social interactions require the ability to rapidly perceive emotion from various incoming dynamic, multisensory cues. Prior expectations reduce incoming emotional information and direct attention to cues that are aligned with what is expected. Studies to date have investigated the prior expectancy effect using static emotional images, despite the fact that dynamic stimuli would represent greater ecological validity. The objective of the study was to create a novel functional magnetic resonance imaging (fMRI) paradigm to examine the influence of prior expectations on naturalistic emotion perception. For this purpose, we developed a dynamic emotion perception task, which consisted of audio-visual videos that carry emotional information congruent or incongruent with prior expectations. The results show that emotional congruency was associated with activity in prefrontal regions, amygdala, and putamen, whereas emotional incongruency was associated with activity in temporoparietal junction and mid-cingulate gyrus. Supported by the behavioural results, our findings suggest that prior expectations are reinforced after repeated experience and learning, whereas unexpected emotions may rely on fast change detection processes. The results from the current study are compatible with the notion that the ability to automatically detect unexpected changes in complex dynamic environments allows for adaptive behaviours in potentially advantageous or threatening situations.

Top-down modulation of the perception of other people in schizophrenia and autism

Accurately and efficiently perceiving social cues such as body movements and facial expressions is important in social interaction. Accurate social perception of this kind does not solely rely on “bottom-up” visual processing but is also subject to modulation by “top-down” signals. For example, if instructed to look for signs of happiness rather than fear, participants are more likely to categorize facial expressions as happy—this prior expectation biases subsequent perception. Top-down modulation is also important in our reactions to others. For example, top-down control over imitation plays an important role in the development of smooth and harmonious social interactions. This paper highlights the importance of top-down modulation in our perception of, and reactions to, others. We discuss evidence that top-down modulation of social perception and imitation is atypical in Autism Spectrum Conditions and in schizophrenia, and we consider the effect this may have on the development of social interactions for individuals with these developmental disorders.