Egocentric fairness perception: emotional reactions and individual differences in overt responses

Extensive research documents the existence of egocentric biases in the perception and application of justice norms. The origin of these biases remains poorly understood. We investigated both inter- and intra-individual differences in egocentric justice biases. Participants played an ultimatum game presumably with different anonymous players (simulated by a computer) in which they contributed differentially to the joint production of the initial endowment. We examined how contributions (low vs. high) affect proposers' offers and responders' acceptance decisions, as well as their fairness judgments and their emotional reactions to different types of offers (equal, equitable, unfair, and hyperfair). An egocentric bias in proposers' offers (indicating more flexible preferences) was found only in individualists and not in prosocials, suggesting differences in the motivations (or cognitions) underlying their choice of justice norms. Responders also showed egocentric biases in their judgments of fairness and in their emotional reactions to equal and equitable offers, but not in their acceptance decisions. Such dissociation might suggest that some form of emotion regulation occurred. Responders may evaluate offers on valence dimensions (e.g., goal conduciveness/outcome favorability and norm compatibility/justice) that are multiply interacting and potentially conflicting. The individual's acceptance/rejection decision reflects the relative weight attributed to competing appraisals. For this overt behavioral decision, the (personal) appraisal of outcome favorability that drives (analytical) acceptance of goal-conducive outcome seems to be stronger than the (social) appraisal of outcome fairness, which may trigger covert (emotional) rejection of offers that are incompatible with justice norms. Our data show that the emotional reaction patterns provide a more fine-grained readout of the overall evaluation of the proposer's action, the underlying emotional dynamics of which may, in real life, strongly determine future interactions with specific partners. Further research on the relationship between emotion and behavior in economic games is needed to explore potential dissociations and long-term effects.

Introducing the Geneva emotion recognition test: an example of Rasch-based test development

Existing tests to measure the ability to recognize other people's emotional expressions (emotion recognition ability [ERA]) mostly focus on a single modality (usually the face) and include only a small number of emotions, restricting their ecological validity. Further, their reliability is often unsatisfactory. The goal of the present study was to develop a new ERA test (Geneva Emotion Recognition Test [GERT]) that (a) features dynamic and multimodal actor portrayals (short videos with sound), (b) contains a large number of emotions, and (c) is based on modern psychometric principles (item response theory). We asked 295 participants to watch 108 actor portrayals and to choose, for each portrayal, which of 14 emotions had been expressed by the actor. We then applied the Rasch model independently to each of the 14 emotion portrayal subsets to select 83 final items for the GERT. Results showed that the model fits the emotion subtests and the overall GERT and that measurement precision is satisfactory. Consistent with previous findings, we found a decline in ERA with increasing age and an ERA advantage for women. To conclude, the GERT is a promising instrument to measure ERA in a more ecologically valid and comprehensive fashion than previous tests.

On the Acoustics of Emotion in Audio: What Speech, Music, and Sound have in Common

Without doubt, there is emotional information in almost any kind of sound received by humans every day: be it the affective state of a person transmitted by means of speech; the emotion intended by a composer while writing a musical piece, or conveyed by a musician while performing it; or the affective state connected to an acoustic event occurring in the environment, in the soundtrack of a movie, or in a radio play. In the field of affective computing, there is currently some loosely connected research concerning either of these phenomena, but a holistic computational model of affect in sound is still lacking. In turn, for tomorrow’s pervasive technical systems, including affective companions and robots, it is expected to be highly beneficial to understand the affective dimensions of “the sound that something makes,” in order to evaluate the system’s auditory environment and its own audio output. This article aims at a first step toward a holistic computational model: starting from standard acoustic feature extraction schemes in the domains of speech, music, and sound analysis, we interpret the worth of individual features across these three domains, considering four audio databases with observer annotations in the arousal and valence dimensions. In the results, we find that by selection of appropriate descriptors, cross-domain arousal, and valence regression is feasible achieving significant correlations with the observer annotations of up to 0.78 for arousal (training on sound and testing on enacted speech) and 0.60 for valence (training on enacted speech and testing on music). The high degree of cross-domain consistency in encoding the two main dimensions of affect may be attributable to the co-evolution of speech and music from multimodal affect bursts, including the integration of nature sounds for expressive effects.

The impact of emotion on perception, attention, memory, and decision-making

Reason and emotion have long been considered opposing forces. However, recent psychological and neuroscientific research has revealed that emotion and cognition are closely intertwined. Cognitive processing is needed to elicit emotional responses. At the same time, emotional responses modulate and guide cognition to enable adaptive responses to the environment. Emotion determines how we perceive our world, organise our memory, and make important decisions. In this review, we provide an overview of current theorising and research in the Affective Sciences. We describe how psychological theories of emotion conceptualise the interactions of cognitive and emotional processes. We then review recent research investigating how emotion impacts our perception, attention, memory, and decision-making. Drawing on studies with both healthy participants and clinical populations, we illustrate the mechanisms and neural substrates underlying the interactions of cognition and emotion.

Levels of valence

The distinction between the positive and the negative is fundamental in our emotional life. In appraisal theories, in particular in the component process model of emotion (Scherer, 1984, 2010), qualitatively different types of valence are proposed based on appraisals of (un)pleasantness, goal obstructiveness/conduciveness, low or high power, self-(in)congruence, and moral badness/goodness. This multifaceted conceptualization of valence is highly compatible with the frequent observation of mixed feelings in real life. However, it seems to contradict the one-dimensional conceptualization of valence often encountered in psychological theories, and the notion of valence as a common currency used to explain choice behavior. Here, we propose a framework to integrate the seemingly disparate conceptualizations of multifaceted valence and one-dimensional valence by suggesting that valence should be conceived at different levels, micro and macro. Micro-valences correspond to qualitatively different types of evaluations, potentially resulting in mixed feelings, whereas one-dimensional macro-valence corresponds to an integrative “common currency” to compare alternatives for choices. We propose that conceptualizing levels of valence may focus research attention on the mechanisms that relate valence at one level (micro) to valence at another level (macro), leading to new hypotheses, and addressing various concerns that have been raised about the valence concept, such as the valence-emotion relation.

Author Reply: The Unbearable Heaviness of Feeling

The comments by Brosch and Sander, de Sousa, Frijda, Kuppens, and Parkinson admirably complement the four main articles, adding layers of complexity, but perhaps at the expense of theoretical parsimony and stringency. Their suggestions are inspiring and heuristic, but we must not forget that science is about testing concrete predictions.

The Nature and Dynamics of Relevance and Valence Appraisals: Theoretical Advances and Recent Evidence

Appraisal theories of emotion have had a strong impact on the development of theory and experimental research in the domain of the affective sciences. While there is generally a high degree of convergence between theorists in this tradition, some central issues are open to debate. In this contribution three issues have been chosen for discussion: (a) varieties of relevance detection, (b) varieties of valence appraisal, and (c) sequential-cumulative effects of appraisal results. In addressing these issues, new theoretical ideas are suggested and an update of recent research on the sequence of appraisal processes is provided. Special emphasis is placed on nonverbal signatures of appraisal processes.

Human emotion experiences can be predicted on theoretical grounds: evidence from verbal labeling

In an effort to demonstrate that the verbal labeling of emotional experiences obeys lawful principles, we tested the feasibility of using an expert system called the Geneva Emotion Analyst (GEA), which generates predictions based on an appraisal theory of emotion. Several thousand respondents participated in an Internet survey that applied GEA to self-reported emotion experiences. Users recalled appraisals of emotion-eliciting events and labeled the experienced emotion with one or two words, generating a massive data set on realistic, intense emotions in everyday life. For a final sample of 5969 respondents we show that GEA achieves a high degree of predictive accuracy by matching a user's appraisal input to one of 13 theoretically predefined emotion prototypes. The first prediction was correct in 51% of the cases and the overall diagnosis was considered as at least partially correct or appropriate in more than 90% of all cases. These results support a component process model that encourages focused, hypothesis-guided research on elicitation and differentiation, memory storage and retrieval, and categorization and labeling of emotion episodes. We discuss the implications of these results for the study of emotion terms in natural language semantics.

Understanding the Mechanisms Underlying the Production of Facial Expression of Emotion: A Componential Perspective

We highlight the need to focus on the underlying determinants and production mechanisms to fully understand the nature of facial expression of emotion and to settle the theoretical debate about the meaning of motor expression. Although emotion theorists have generally remained rather vague about the details of the process, this has been a central concern of componential appraisal theories. We describe the fundamental assumptions and predictions of this approach regarding the patterning of facial expressions for different emotions. We also review recent evidence for the assumption that specific facial muscle movements may be reliable symptoms of certain appraisal outcomes and that facial expressions unfold over time on the basis of a sequence of appraisal check results.

Perceived Gesture Dynamics in Nonverbal Expression of Emotion

Recent judgment studies have shown that people are able to fairly correctly attribute emotional states to others' bodily expressions. It is, however, not clear which movement qualities are salient, and how this applies to emotional gesture during speech-based interaction. In this study we investigated how the expression of emotions that vary on three major emotion dimensions—that is, arousal, valence, and potency—affects the perception of dynamic arm gestures. Ten professional actors enacted 12 emotions in a scenario-based social interaction setting. Participants (N = 43) rated all emotional expressions with muted sound and blurred faces on six spatiotemporal characteristics of gestural arm movement that were found to be related to emotion in previous research (amount of movement, movement speed, force, fluency, size, and height/vertical position). Arousal and potency were found to be strong determinants of the perception of gestural dynamics, whereas the differences between positive or negative emotions were less pronounced. These results confirm the importance of arm movement in communicating major emotion dimensions and show that gesture forms an integrated part of multimodal nonverbal emotion communication.

The Difficulties in Emotion Regulation Scale (DERS)

Successful emotion regulation is a key aspect of efficient social functioning and personal well-being. Difficulties in emotion regulation lead to relationship impairments and are presumed to be involved in the onset and maintenance of some psychopathological disorders as well as inappropriate behaviors. Gratz and Roemer (2004 ) developed the Difficulties in Emotion Regulation Scale (DERS), a comprehensive instrument measuring emotion regulation problems that encompasses several dimensions on which difficulties can occur. The aim of the present work was to develop a French translation of this scale and to provide an initial validation of this instrument. The French version was created using translation and backtranslation procedures and was tested on 455 healthy students. Congruence between the original and the translated scales was .98 (Tucker’s phi) and internal consistency of the translation reached .92 (Cronbach’s α). Moreover, test-retest scores were highly correlated. Altogether, the initial validation of the French version of the DERS (DERS-F) offers satisfactory results and permits the use of this instrument to map difficulties in emotion regulation in both clinical and research contexts.

Definitions Come in Many Kinds: Reply to Comments

We conclude that the commentators seem to fundamentally agree on the substance of our proposal of a partial real definition of emotion as a dynamic episode which has to fulfill a certain number of conditions to count as a member of the class. We raise the issue of prescriptive functions of a definition, suggesting parallels to biomedical ontologies. We also clarify the issues of linguistic and cultural relativity and of differences in the nature of individual emotions.

Toward a Working Definition of Emotion

A definition of emotion common to the affective sciences is an urgent desideratum. Lack of such a definition is a constant source of numerous misunderstandings and a series of mostly fruitless debates. There is little hope that there ever will be agreement on a common definition of emotion, given the sacred traditions of the disciplines involved and the egos of the scholars working in these disciplines. Our aim here is more modest. We propose a list of elements for a working definition of emotion and discuss the justification for the inclusion of elements from our respective perspectives (philosophy and psychology). This working partial definition may at least serve as a litmus test to examine theories of emotion, old and new, across disciplinary boundaries.

Goal relevance and goal conduciveness appraisals lead to differential autonomic reactivity in emotional responding to performance feedback

Using an appraisal framework, the present experiment tested the hypothesis that goal relevance and goal conduciveness have an interactive effect on emotional responding. We expected that elicitation of positive or negative emotions in response to events that are conducive or obstructive to attainment of one's goals depends on the level of goal relevance. To test this hypothesis, we presented 119 participants with positive (success) or negative (failure) performance feedback of high or low relevance in an achievement context. Feeling self-report showed effects of conduciveness, but no interaction with relevance. Physiological reactivity showed the predicted interaction effect on cardiac autonomic regulation (CAR), with higher CAR for high-relevance conducive than obstructive conditions. Moreover, mean arterial pressure (MAP) and skin conductance level (SCL) differed between conducive and obstructive conditions, and heart rate (HR) and SCL differed between relevance conditions. Implications for the plausibility and current empirical support of the interaction hypothesis are discussed.

In the eye of the beholder? Universality and cultural specificity in the expression and perception of emotion

Do members of different cultures express (or "encode") emotions in the same fashion? How well can members of distinct cultures recognize (or "decode") each other's emotion expressions? The question of cultural universality versus specificity in emotional expression has been a hot topic of debate for more than half a century, but, despite a sizeable amount of empirical research produced to date, no convincing answers have emerged. We suggest that this unsatisfactory state of affairs is due largely to a lack of concern with the precise mechanisms involved in emotion expression and perception, and propose to use a modified Brunswikian lens model as an appropriate framework for research in this area. On this basis we provide a comprehensive review of the existing literature and point to research paradigms that are likely to provide the evidence required to resolve the debate on universality vs. cultural specificity of emotional expression. Applying this fresh perspective, our analysis reveals that, given the paucity of pertinent data, no firm conclusions can be drawn on actual expression (encoding) patterns across cultures (although there appear to be more similarities than differences), but that there is compelling evidence for intercultural continuity in decoding, or recognition, ability. We also note a growing body of research on the notion of ingroup advantage due to expression "dialects," above and beyond the general encoding or decoding patterns. We furthermore suggest that these empirical patterns could be explained by both universality in the underlying mechanisms and cultural specificity in the input to, and the regulation of, these expression and perception mechanisms. Overall, more evidence is needed, both to further elucidate these mechanisms and to inventory the patterns of cultural effects. We strongly recommend using more solid conceptual and theoretical perspectives, as well as more ecologically valid approaches, in designing future studies in emotion expression and perception research.

Reliable facial muscle activation enhances recognizability and credibility of emotional expression

We tested Ekman's (2003) suggestion that movements of a small number of reliable facial muscles are particularly trustworthy cues to experienced emotion because they tend to be difficult to produce voluntarily. On the basis of theoretical predictions, we identified two subsets of facial action units (AUs): reliable AUs and versatile AUs. A survey on the controllability of facial AUs confirmed that reliable AUs indeed seem more difficult to control than versatile AUs, although the distinction between the two sets of AUs should be understood as a difference in degree of controllability rather than a discrete categorization. Professional actors enacted a series of emotional states using method acting techniques, and their facial expressions were rated by independent judges. The effect of the two subsets of AUs (reliable AUs and versatile AUs) on identification of the emotion conveyed, its perceived authenticity, and perceived intensity was investigated. Activation of the reliable AUs had a stronger effect than that of versatile AUs on the identification, perceived authenticity, and perceived intensity of the emotion expressed. We found little evidence, however, for specific links between individual AUs and particular emotion categories. We conclude that reliable AUs may indeed convey trustworthy information about emotional processes but that most of these AUs are likely to be shared by several emotions rather than providing information about specific emotions. This study also suggests that the issue of reliable facial muscles may generalize beyond the Duchenne smile.

Stop laughing! Humor perception with and without expressive suppression

The neurophysiological study of emotion regulation focused on the strategy of reappraisal-i.e., the cognitive reinterpretation of a stimulus. Reappraisal reduces emotional expression, the experience of both negative and positive feelings, and the amplitude of an event-related potential (ERP)-the late positive potential (LPP). In contrast, the strategy of expressive suppression (ES), being the inhibition of emotional expression, has been reported to reduce subjective feelings of positive, but not negative emotion, and has not yet been investigated with ERPs. We focused on the LPP to assess the correlates of ES in the context of humor perception. Twenty-two female participants rated sequences of humorous (H) and non-humorous (NH) pictures, while their zygomaticus muscle was recorded. A spontaneous (SP) condition, in which participants attended naturally to the pictures, resulted in higher ratings of funniness, increased smiling, and increased LPP amplitude for H compared to NH stimuli. An ES condition, in which participants suppressed their facial reactions, resulted in reduced smiling, without affecting subjective ratings. LPP amplitude did not differ between H and NH stimuli during ES, suggesting equal allocation of processing resources to both stimuli. These results suggest that, similarly to reappraisal, ES modifies the way the brain processes positive emotional stimuli.

A psycho-ethological approach to social signal processing

The emerging field of social signal processing can benefit from a theoretical framework to guide future research activities. The present article aims at drawing attention to two areas of research that devoted considerable efforts to the understanding of social behaviour: ethology and social psychology. With a long tradition in the study of animal signals, ethology and evolutionary biology have developed theoretical concepts to account for the functional significance of signalling. For example, the consideration of divergent selective pressures responsible for the evolution of signalling and social cognition emphasized the importance of two classes of indicators: informative cues and communicative signals. Social psychology, on the other hand, investigates emotional expression and interpersonal relationships, with a focus on the mechanisms underlying the production and interpretation of social signals and cues. Based on the theoretical considerations developed in these two fields, we propose a model that integrates the processing of perceivable individual features (social signals and cues) with contextual information, and we suggest that output of computer-based processing systems should be derived in terms of functional significance rather than in terms of absolute conceptual meaning.