Why do you smile at me while I'm in pain? — Pain selectively modulates voluntary facial muscle responses to happy faces

Pain and related suffering reduce attention toward others

BACKGROUND

It has been proposed that the expression of pain-related suffering may lead to an enhanced focus on oneself and reduced attention toward the external world. This study aimed at investigating whether experimentally induced painrelated suffering may lead persons to withdraw into themselves, causing a reduced focus on external stimuli as reflected by impaired performance in a facial recognition task and heightened perception of internal stimuli measured by interoceptive awareness.

METHODS

Thirty-two participants had to recognize different emotional facial expressions (neutral, sad, angry, happy), or neutral geometrical figures under conditions of no pain, low, and high prolonged pain intensities. Interoceptive accuracy was measured using a heartbeat-detection task prior to and following the pain protocol.

RESULTS

Males but not females were slower to recognize facial expressions under the condition of high painful stimulation compared to the condition of no pain. In both, male and female participants, the difficulty in recognizing another person's emotions from a facial expression was directly related to the level of suffering and unpleasantness experienced during pain. Interoceptive accuracy was higher after the pain experiment. However, neither the initial interoceptive accuracy nor the change were significantly related to the pain ratings.

CONCLUSIONS

Our results suggest that long-lasting and intense painful stimuli, which induce suffering, lead to attentional shifts leading to withdrawal from others. These findings contribute to a better understanding of the social dynamics of pain and pain-related suffering.

Training machine learning algorithms for automatic facial coding: The role of emotional facial expressions' prototypicality

Automatic facial coding (AFC) is a promising new research tool to efficiently analyze emotional facial expressions. AFC is based on machine learning procedures to infer emotion categorization from facial movements (i.e., Action Units). State-of-the-art AFC accurately classifies intense and prototypical facial expressions, whereas it is less accurate for non-prototypical and less intense facial expressions. A potential reason might be that AFC is typically trained with standardized and prototypical facial expression inventories. Because AFC would be useful to analyze less prototypical research material as well, we set out to determine the role of prototypicality in the training material. We trained established machine learning algorithms either with standardized expressions from widely used research inventories or with unstandardized emotional facial expressions obtained in a typical laboratory setting and tested them on identical or cross-over material. All machine learning models' accuracies were comparable when trained and tested with held-out dataset from the same dataset (acc. = [83.4% to 92.5%]). Strikingly, we found a substantial drop in accuracies for models trained with the highly prototypical standardized dataset when tested in the unstandardized dataset (acc. = [52.8%; 69.8%]). However, when they were trained with unstandardized expressions and tested with standardized datasets, accuracies held up (acc. = [82.7%; 92.5%]). These findings demonstrate a strong impact of the training material's prototypicality on AFC's ability to classify emotional faces. Because AFC would be useful for analyzing emotional facial expressions in research or even naturalistic scenarios, future developments should include more naturalistic facial expressions for training. This approach will improve the generalizability of AFC to encode more naturalistic facial expressions and increase robustness for future applications of this promising technology.

Contextualising facial expressions: The effect of temporal context and individual differences on classification

The influence of context on facial expression classification is most often investigated using simple cues in static faces portraying basic expressions with a fixed emotional intensity. We examined (1) whether a perceptually rich, dynamic audiovisual context, presented in the form of movie clips (to achieve closer resemblance to real life), affected the subsequent classification of dynamic basic (happy) and non-basic (sarcastic) facial expressions and (2) whether people's susceptibility to contextual cues was related to their ability to classify facial expressions viewed in isolation. Participants classified facial expressions-gradually progressing from neutral to happy/sarcastic in increasing intensity-that followed movie clips. Classification was relatively more accurate and faster when the preceding context predicted the upcoming expression, compared with when the context did not. Speeded classifications suggested that predictive contexts reduced the emotional intensity required to be accurately classified. More importantly, we show for the first time that participants' accuracy in classifying expressions without an informative context correlated with the magnitude of the contextual effects experienced by them-poor classifiers of isolated expressions were more susceptible to a predictive context. Our findings support the emerging view that contextual cues and individual differences must be considered when explaining mechanisms underlying facial expression classification.

Observing physicians acting with different levels of empathy modulates later assessed pain tolerance

OBJECTIVES

The patient-physician relationship is essential for treatment success. Previous studies demonstrated that physicians who behave empathic in their interaction with patients have a positive effect on health outcomes. In this study, we investigated if the mere perception of physicians as empathic/not empathic modulates pain despite an emotionally neutral interaction with the patients.

METHODS

N = 60 women took part in an experimental study that simulated a clinical interaction. In the paradigm, each participant watched two immersive 360° videos via a head-mounted display from a patient's perspective. The physicians in the videos behaved either empathic or not empathic towards a third person. Importantly, these physicians remained emotionally neutral in the subsequent virtual interaction with the participants. Finally, participants received a controlled, painful pressure stimulus within the narratives of the videos.

RESULTS

The physicians in the high compared with the low empathy videos were rated as more empathic and more likable, indicating successful experimental manipulation. In spite of later neutral behaviour of physicians, this short observation of physicians' behaviour towards a third person was sufficient to modulate pain tolerance of the participants.

CONCLUSIONS

The finding of this study that the mere observation of physicians' behaviour towards a third person modulates pain, despite a neutral direct interaction with the participants, has important clinical implications. Further, the proposed paradigm enables investigating aspects of patient-physician communication that are difficult to examine in a clinical setting.

Pain Modulates Responses to Emotional Stimuli

Pain and emotion are common subjective experiences that play vital roles in daily life. Pain has been clinically confirmed to increase depressive mood. However, little is known about how pain modulates cognitive emotional judgment processing. A better understanding of this may help explain the effect of pain on the development of depressive moods. We recruited 30 adult participants to test their responses to pictures of scenes (Experiment 1) and faces (Experiment 2) that represented happy, neutral, and sad emotions, while experiencing painful (induced via topical capsaicin cream) and control (hand cream) treatments. Results showed that participants in the painful condition showed lower accuracy to emotional scene stimuli and longer reaction times to both emotional scene and face stimuli, relative to the control condition. In addition, the difference values of the reaction times between the painful and control conditions were larger for sad scenes than for happy or neutral scenes. These results suggest that pain alters attentional processing of emotional stimuli, especially with regards to sad scene stimuli, which may explain how painful stimuli affect the development of depressive moods.

Does my pain affect your disgust? Cross-modal influence of first-hand aversive experiences in the appraisal of others' facial expressions

BACKGROUND

Embodied models of social cognition argue that others' affective states are processed by re-enacting a sensory-specific representation of the same state in the observer. However, neuroimaging studies suggest that a reliable part of the representation shared between self and others is supramodal and relates to dimensions such as Unpleasantness or arousal, common to qualitatively different experiences. Here we investigated whether representations of first-hand pain and disgust influenced the subsequent evaluation of facial expressions in Modality-specific fashion, or in terms of Unpleasantness or arousal.

METHODS

Thirty volunteers were subjected to thermal painful and olfactory disgusting events, and subsequently were asked to classify computer-generated faces expressing pain (characterized by high Unpleasantness and arousal), disgust (high Unpleasantness and low arousal), surprise (low Unpleasantness and high arousal) and hybrid combinations thereof.

RESULTS

Thermal and olfactory events were associated with comparable Unpleasantness ratings and heart rate (but stronger galvanic response was found for painful temperatures). Furthermore, we found that the appraisal of facial expressions was biased by the prior stimulus, with more frequent pain classifications following thermal stimuli, and more frequent disgust classifications following olfactory stimuli. Critically, this modulation was cross-modal in nature, as each first-hand stimulation influenced in comparable fashion facial traits diagnostic of both pain and disgust, without instead generalizing to features of surprise.

CONCLUSION

Overall, these data support the presence of shared coding between one's aversive experiences and the appraisal of others' facial responses, which is best describable as supramodal representation of the Unpleasantness of the experience.

SIGNIFICANCE

These results extend previous findings about common representational coding between the experience of first-hand and others' pain. In particular, they highlight that reliable part of the information shared is supramodal in nature and relates to a broad dimension of Unpleasantness common also to painless aversive states such as disgust.

Compassionate faces: Evidence for distinctive facial expressions associated with specific prosocial motivations

Compassion is a complex cognitive, emotional and behavioural process that has important real-world consequences for the self and others. Considering this, it is important to understand how compassion is communicated. The current research investigated the expression and perception of compassion via the face. We generated exemplar images of two compassionate facial expressions induced from two mental imagery tasks with different compassionate motivations (Study 1). Our kind- and empathic compassion faces were perceived differently and the empathic-compassion expression was perceived as best depicting the general definition of compassion (Study 2). Our two composite faces differed in their perceived happiness, kindness, sadness, fear and concern, which speak to their underling motivation and emotional resonance. Finally, both faces were accurately discriminated when presented along a compassion continuum (Study 3). Our results demonstrate two perceptually and functionally distinct facial expressions of compassion, with potentially different consequences for the suffering of others.

Verbal instructions override the meaning of facial expressions

Psychological research has long acknowledged that facial expressions can implicitly trigger affective psychophysiological responses. However, whether verbal information can alter the meaning of facial emotions and corresponding response patterns has not been tested. This study examined emotional facial expressions as cues for instructed threat-of-shock or safety, with a focus on defensive responding. In addition, reversal instructions were introduced to test the impact of explicit safety instructions on fear extinction. Forty participants were instructed that they would receive unpleasant electric shocks, for instance, when viewing happy but not angry faces. In a second block, instructions were reversed (e.g., now angry faces cued shock). Happy, neutral, and angry faces were repeatedly presented, and auditory startle probes were delivered in half of the trials. The defensive startle reflex was potentiated for threat compared to safety cues. Importantly, this effect occurred regardless of whether threat was cued by happy or angry expressions. Although the typical pattern of response habituation was observed, defense activation to newly instructed threat cues remained significantly enhanced in the second part of the experiment, and it was more pronounced in more socially anxious participants. Thus, anxious individuals did not exhibit more pronounced defense activation compared to less anxious participants, but their defense activation was more persistent.

Face-to-face: Perceived personal relevance amplifies face processing

The human face conveys emotional and social information, but it is not well understood how these two aspects influence face perception. In order to model a group situation, two faces displaying happy, neutral or angry expressions were presented. Importantly, faces were either facing the observer, or they were presented in profile view directed towards, or looking away from each other. In Experiment 1 (n = 64), face pairs were rated regarding perceived relevance, wish-to-interact, and displayed interactivity, as well as valence and arousal. All variables revealed main effects of facial expression (emotional > neutral), face orientation (facing observer > towards > away) and interactions showed that evaluation of emotional faces strongly varies with their orientation. Experiment 2 (n = 33) examined the temporal dynamics of perceptual-attentional processing of these face constellations with event-related potentials. Processing of emotional and neutral faces differed significantly in N170 amplitudes, early posterior negativity (EPN), and sustained positive potentials. Importantly, selective emotional face processing varied as a function of face orientation, indicating early emotion-specific (N170, EPN) and late threat-specific effects (LPP, sustained positivity). Taken together, perceived personal relevance to the observer-conveyed by facial expression and face direction-amplifies emotional face processing within triadic group situations.

Facing two faces: Defense activation varies as a function of personal relevance

It can be unsettling to be watched by a group of people, and when they express anger or hostility, this can prime defensive behavior. In contrast, when others smile at us, this may be comforting. This study tested to which degree the impact of facial expressions (happy, neutral, and angry) varies with the personal relevance of a social situation. Modelling a triadic situation, two faces looked either directly at the participant, faced each other, or they were back to back. Results confirmed that this variation constitutes a gradient of personal relevance (directed frontally > towards > away), as reflected by corresponding defensive startle modulation and autonomic nervous system activity. This gradient was particularly pronounced for angry faces and it was steeper in participants with higher levels of social anxiety. Thus, sender-recipient constellations modulate the processing of facial emotions in favor of adequate behavioral responding (e.g., avoidance) in group settings.

Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains

In everyday life, multiple sensory channels jointly trigger emotional experiences and one channel may alter processing in another channel. For example, seeing an emotional facial expression and hearing the voice’s emotional tone will jointly create the emotional experience. This example, where auditory and visual input is related to social communication, has gained considerable attention by researchers. However, interactions of visual and auditory emotional information are not limited to social communication but can extend to much broader contexts including human, animal, and environmental cues. In this article, we review current research on audiovisual emotion processing beyond face-voice stimuli to develop a broader perspective on multimodal interactions in emotion processing. We argue that current concepts of multimodality should be extended in considering an ecologically valid variety of stimuli in audiovisual emotion processing. Therefore, we provide an overview of studies in which emotional sounds and interactions with complex pictures of scenes were investigated. In addition to behavioral studies, we focus on neuroimaging, electro- and peripher-physiological findings. Furthermore, we integrate these findings and identify similarities or differences. We conclude with suggestions for future research.

Mutual influences of pain and emotional face processing

The perception of unpleasant stimuli enhances whereas the perception of pleasant stimuli decreases pain perception. In contrast, the effects of pain on the processing of emotional stimuli are much less known. Especially given the recent interest in facial expressions of pain as a special category of emotional stimuli, a main topic in this research line is the mutual influence of pain and facial expression processing. Therefore, in this mini-review we selectively summarize research on the effects of emotional stimuli on pain, but more extensively turn to the opposite direction namely how pain influences concurrent processing of affective stimuli such as facial expressions. Based on the motivational priming theory one may hypothesize that the perception of pain enhances the processing of unpleasant stimuli and decreases the processing of pleasant stimuli. This review reveals that the literature is only partly consistent with this assumption: pain reduces the processing of pleasant pictures and happy facial expressions, but does not - or only partly - affect processing of unpleasant pictures. However, it was demonstrated that pain selectively enhances the processing of facial expressions if these are pain-related (i.e., facial expressions of pain). Extending a mere affective modulation theory, the latter results suggest pain-specific effects which may be explained by the perception-action model of empathy. Together, these results underscore the important mutual influence of pain and emotional face processing.

Avoidant decision making in social anxiety: the interaction of angry faces and emotional responses

Recent research indicates that angry facial expressions are preferentially processed and may facilitate automatic avoidance response, especially in socially anxious individuals. However, few studies have examined whether this bias also expresses itself in more complex cognitive processes and behavior such as decision making. We recently introduced a variation of the Iowa Gambling Task which allowed us to document the influence of task-irrelevant emotional cues on rational decision making. The present study used a modified gambling task to investigate the impact of angry facial expressions on decision making in 38 individuals with a wide range of social anxiety. Participants were to find out which choices were (dis-) advantageous to maximize overall gain. To create a decision conflict between approach of reward and avoidance of fear-relevant angry faces, advantageous choices were associated with angry facial expressions, whereas disadvantageous choices were associated with happy facial expressions. Results indicated that higher social avoidance predicted less advantageous decisions in the beginning of the task, i.e., when contingencies were still uncertain. Interactions with specific skin conductance responses further clarified that this initial avoidance only occurred in combination with elevated responses before choosing an angry facial expressions. In addition, an interaction between high trait anxiety and elevated responses to early losses predicted faster learning of an advantageous strategy. These effects were independent of intelligence, general risky decision-making, self-reported state anxiety, and depression. Thus, socially avoidant individuals who respond emotionally to angry facial expressions are more likely to show avoidance of these faces under uncertainty. This novel laboratory paradigm may be an appropriate analog for central features of social anxiety.

On the mutual effects of pain and emotion: facial pain expressions enhance pain perception and vice versa are perceived as more arousing when feeling pain

Perception of emotional stimuli alters the perception of pain. Although facial expressions are powerful emotional cues - the expression of pain especially plays a crucial role for the experience and communication of pain - research on their influence on pain perception is scarce. In addition, the opposite effect of pain on the processing of emotion has been elucidated even less. To further scrutinize mutual influences of emotion and pain, 22 participants were administered painful and nonpainful thermal stimuli while watching dynamic facial expressions depicting joy, fear, pain, and a neutral expression. As a control condition of low visual complexity, a central fixation cross was presented. Participants rated the intensity of the thermal stimuli and evaluated valence and arousal of the facial expressions. In addition, facial electromyography was recorded as an index of emotion and pain perception. Results show that faces per se, compared to the low-level control condition, decreased pain, suggesting a general attention modulation of pain by complex (social) stimuli. The facial response to painful stimulation revealed a significant correlation with pain intensity ratings. Most important, painful thermal stimuli increased the arousal of simultaneously presented pain expressions, and in turn, pain expressions resulted in higher pain ratings compared to all other facial expressions. These findings demonstrate that the modulation of pain and emotion is bidirectional with pain faces being mostly prone to having mutual influences, and support the view of interconnections between pain and emotion. Furthermore, the special relevance of pain faces for the processing of pain was demonstrated.

Faces in context: a review and systematization of contextual influences on affective face processing

Facial expressions are of eminent importance for social interaction as they convey information about other individuals’ emotions and social intentions. According to the predominant “basic emotion” approach, the perception of emotion in faces is based on the rapid, automatic categorization of prototypical, universal expressions. Consequently, the perception of facial expressions has typically been investigated using isolated, de-contextualized, static pictures of facial expressions that maximize the distinction between categories. However, in everyday life, an individual’s face is not perceived in isolation, but almost always appears within a situational context, which may arise from other people, the physical environment surrounding the face, as well as multichannel information from the sender. Furthermore, situational context may be provided by the perceiver, including already present social information gained from affective learning and implicit processing biases such as race bias. Thus, the perception of facial expressions is presumably always influenced by contextual variables. In this comprehensive review, we aim at (1) systematizing the contextual variables that may influence the perception of facial expressions and (2) summarizing experimental paradigms and findings that have been used to investigate these influences. The studies reviewed here demonstrate that perception and neural processing of facial expressions are substantially modified by contextual information, including verbal, visual, and auditory information presented together with the face as well as knowledge or processing biases already present in the observer. These findings further challenge the assumption of automatic, hardwired categorical emotion extraction mechanisms predicted by basic emotion theories. Taking into account a recent model on face processing, we discuss where and when these different contextual influences may take place, thus outlining potential avenues in future research.