Emotional expressivity in singing. Assessing physiological and acoustic indicators of two opera singers' voice characteristics

In an earlier study, we analyzed how audio signals obtained from three professional opera singers varied when they sang one octave wide eight-tone scales in ten different emotional colors. The results showed systematic variations in voice source and long-term-average spectrum (LTAS) parameters associated with major emotion "families". For two of the singers, subglottal pressure (PSub) also was recorded, thus allowing analysis of an additional main physiological voice control parameter, glottal resistance (defined as the ratio between PSub and glottal flow), and related to glottal adduction. In the present study, we analyze voice source and LTAS parameters derived from the audio signal and their correlation with Psub and glottal resistance. The measured parameters showed a systematic relationship with the four emotion families observed in our previous study. They also varied systematically with values of the ten emotions along the valence, power, and arousal dimensions; valence showed a significant correlation with the ratio between acoustic voice source energy and subglottal pressure, while Power varied significantly with sound level and two measures related to the spectral dominance of the lowest spectrum partial. the fundamental.

Emotion processes and perceptual control of action choice

This editorial introduces an invited article by Andreas Eder on a new perceptual control theory of action choice, based on the comparison of real and simulated interoceptive signals generated by action alternatives. Eder extends the cognitive action-control framework, postulating a bi-directional connection between outcomes and actions by introducing "emotional feelings", defined as valued interoceptive signals from the body. An invited commentary by Agnes Moors compares this theory with her own goal-directed theory of action control. While agreeing on the central role of a control cycle and the goal-directed nature of emotional actions, Moors disagrees on the content of the representations involved in the control cycle and the nature of the feelings involved. A second commentary by Bob Bramson and Karin Roelofs discusses the issues of the distinction between perception control vs. action control, the need for biologically plausible implementation alternatives, and potential implications for psychopathology and clinical intervention. Finally, the potential relevance of predictive coding theory and the role of appraisal processes in emotion generation with respect to their bearing on action comparison and choice are discussed.

Emotion regulation via reappraisal - mechanisms and strategies

Emotion regulation, and in particular cognitive reappraisal. Gross has been booming in theory development and empirical research for the last two decades. A large number of publications have demonstrated the importance of these mechanisms for understanding and promoting well-being and mental health. It is thus timely for Cognition and Emotion to examine the current state of theory in this domain. The resultant invited article, authored by Uusberg, A., Ford, Uusberg, H., and Gross, aims to expand the scope of reappraisal theory by extending their recent reAppraisal model by suggesting different forms of goal commitment and situation construals. Their suggestions are commented on by Kashdan and Goodman from a purpose in life perspective, Ehring, and Woud from a clinical psychopathology perspective. In this editorial, I briefly discuss the lack of specification of the goal construct, which is central to the reappraisal model. Moreover, I point to recent evidence showing that problems may arise because of appraisal biases, in the case of individuals prone to inappropriate evaluations of situations. I suggest that future work in this domain could benefit from increased interaction between theorists and researchers working on appraisal and reappraisal processes.

Emotions, social coordination, and the danger of affective polarisation

Smooth social interaction requires interindividual coordination. This Theory Section addresses the nature of the processes involved and the potential dangers of malfunctioning coordination. In her invited article, Butler provides a general overview of the processes involved, including interpersonal synchronisation, and advocates a dynamic systems framework for further research. In their commentary, Carré and Cornejo concur in principle but highlight the importance of the meaning attributed to the spontaneous expressive movements in naturally occurring interactions and the nature of the respective social situations. Suhay, in her commentary from a political science perspective, highlights the need for synergy based on social coordination for successful democratic governing. In commenting on the problem of political polarisation because of malfunctioning social coordination, introduced by Butler, Suhay adds the important role played by social identity and emotion. Of particular importance are affective reactions based on "evaluative biases" in favour of information that bolsters one's views and rejection of information that challenges them. I conclude this editorial by referring to recent data on affective polarisation, pleading for more multidisciplinary research on the phenomenon, and arguing for a more substantial contribution from the cognitive and emotion sciences. In particular, I outline the "predictive coding" framework and the potential contributions from emotion science.

Learned helplessness revisited: biased evaluation of goals and action potential are major risk factors for emotional disturbance

The present theory section deals with learned helplessness produced by pervasive experiences of failure or negative events, leading to decreased motivation and risk for depression. In their target article, Boddez, van Dessel, and de Houwer apply this concept to different forms of psychological suffering and propose a goal-directed mechanism -generalisation over similar goals. Duda and Joormann define goal similarity by action-outcome contingencies and highlight individual differences in attribution styles. Brandstätter proposes incentive classes as the organising principle for goal similarity and explores outcomes such as deterioration of cognitive ability. Mikulincer and Lifshin focus on differences between goals and introduce the notion of motivated helplessness, serving as an anxiety buffer in uncontrollable life settings. Finally, potential contributions from emotion science are outlined, in particular individual differences and biases in appraising goals and coping potential likely to produce negative emotion dispositions. In conclusion, the need to elaborate a more comprehensive theoretical framework for helplessness that can guide empirical studies using multifactorial and longitudinal designs is emphasised. Given the strong increase in the prevalence of anxiety and depression worldwide, better understanding of predispositions and eliciting factors is needed for early diagnosis and the development of intervention programmes to reduce psychological suffering.

The mystery of emotional mimicry: multiple functions and processing levels in expression imitation

Mimicry of appearance or of facial, vocal, or gestural expressions emerges frequently among members of different species. When such mimicry directly relates to affective aspects of an interaction, researchers talk about "emotional mimicry". Emotional mimicry has been amply documented but its functionality is still debated. Why and when do people mimic the expressions of others, who benefits, the mimicker or the mimicked, and how do they benefit? Which processes underlie emotional mimicry? Is it completely automatic and unconscious or can it be deliberate and conscious? The current Theory Section addresses these questions from different theoretical perspectives. The invited article by Hess and Fischer focused on the role of mimicry in social regulation and social bonding. The invited comment by Krets and Akyüz highlights information gathering and prediction in social interaction. The invited comment by Bernhold and Giles emphasizes vocal communication and its role in interpersonal accommodation. In this editorial, I propose the different theoretical perspectives may be integrated by assuming a multilevel appraisal and response generation mechanism. I also suggest that emotional mimicry research may be broadened by including social learning, vocal imitation, interspecies comparisons, and affective computing approaches.

Appraisal Bias and Emotion Dispositions Are Risk Factors for Depression and Generalized Anxiety: Empirical Evidence

Appraisal theory of emotion predicts that appraisal biases may generate stable emotion dispositions, which can ultimately lead to affective disorders. One example is the habitual underestimation of one’s potential to cope with adverse events, which favors frequent experiences of sadness and worry and therefore increases the risk for development of depression and generalized anxiety disorders. To examine the relationships between these variables as potential risk factors, in Study 1, we used appraisal and emotion questions in the Swiss Household Panel (SHP), a nationwide representative sample, and analyzed data for N = 4,859 participants in one annual survey wave (Wave 14, SHP 2012) via theory-based hierarchical regressions. Path analysis of the nomological network linking frequent experiences of depression and anxiety to the emotion dispositions of sadness and worry, and measures of perceived coping potential (appraisal bias) supports the theoretical predictions and further identifies the effects of important background variables such as personality, motivation, and life events. Discriminant analysis shows that these predictors allow correct classification of close to 70% of the participants with elevated risk. In Study 2, we used established validated instruments to assess the risk for depression and anxiety disorders, as well as a recently validated scenario method to assess appraisal bias and emotion disposition in a survey with N = 152 students. The results correspond to the theoretical predictions and largely confirm the findings with the household survey. The results of both studies demonstrate the utility of using current emotion theory to provide new vistas for research on risk factors for affective disorders and to inform the development of appropriate interventions to reduce the level of risk.

Theories in cognition & emotion - social functions of emotion

It is widely recognised that emotions have important social functions, particularly with respect to the interaction between individual needs and preferences and socio-cultural norms and values. So far, however, a general theoretical framework has been missing for the social functions of emotion. In this issue of the special theory section of Cognition & Emotion, an invited article by Keltner et al. proposes an expanded version of social functionalist theory entitled "How emotions, relationships, and culture constitute each other", which attempts to remedy this situation. Two invited commentaries, by Manstead and Von Scheve, welcome this attempt but enumerate issues in need of further elaboration, such as the interaction between relational needs and cultural norms, the necessity to consider situational context and cultural differences, and a more stringent specification of "functionality". The remainder of the current introductory article briefly outlines some areas in need of attention from social emotion theories, such as the effect of social and technological change on the elicitation and regulation of emotions. Here, earlier work is cited that evokes the danger of a potential waning of shame and guilt feelings due to changing values, norms, and self-ideals (for example, the growing importance of self-related values such as freedom and the weakening of prosocial values such as the responsibility for the common good). Another problem is group polarisation leading to negative emotions such as hate and potential violence taken together, the contributions to this theory section highlight the importance of creating a comprehensive theoretical framework for studying the social functions of emotions.

Assessing Emotional Intelligence Abilities, Acquiescent and Extreme Responding in Situational Judgment Tests Using Principal Component Metrics

Principal Component Metrics is a novel theoretically-based and data-driven methodology that enables the evaluation of the internal structure at item level of maximum emotional intelligence tests. This method disentangles interindividual differences in emotional ability from acquiescent and extreme responding. Principal Component Metrics are applied to existing (Mayer-Salovey-Caruso Emotional Intelligence Test) and assembled (specifically, the Situational Test of Emotion Understanding, the Situational Test of Emotion Management, and the Geneva Emotion Recognition Test) emotional intelligence test batteries in an analysis of three samples (total N = 2,303 participants). In undertaking these analyses important aspects of the nomological network of emotional intelligence, acquiescent, and extreme responding are investigated. The current study adds a central piece of empirical validity evidence to the emotional intelligence domain. In the three different samples, theoretically predicted internal structures at item level were found using raw item scores. The validity of the indicators for emotional intelligence, acquiescent, and extreme responding was confirmed by their relationships across emotional intelligence tests and by their nomological networks. The current findings contribute to evaluating the efficacy of the emotional intelligence construct as well as the validity evidence surrounding the instruments that are currently designed for its assessment, in the process opening new perspectives for analyzing existing and constructing new emotional intelligence tests.

Linear and non-linear relationships among the dimensions representing the cognitive structure of emotion

While dimensional models play a key role in emotion psychology, no consensus has been reached about their number and nature. The current study sheds a new light on this central issue by examining linear and non-linear relationships among the dimensions in the cognitive emotion structure. The meaning of 80 emotion terms was evaluated on 68 features representing appraisals, action tendencies, bodily reactions, expressions, and subjective experiences by 213 English-speaking US, 156 French-speaking Swiss, and 194 Indonesian-speaking Indonesian students. In a two-dimensional valence and arousal representation, neither linear nor non-linear relationships were observed. In a four-dimensional valence, power, arousal, and novelty representation, both linear (e.g. a positive relationship between valence and power) and non-linear (e.g. a strong positive correlation between valence and power found only for positively valenced emotion terms) relationships were observed. Joy- and sadness-related emotion terms where about as well represented by the two- than by the four-dimensional representation. However, especially anger- and surprise-related terms were only adequately represented by the four-dimensional representation. These findings were generalisable across the three languages. Even though a two-dimensional structure fits the data well in general, four dimensions are needed to sufficiently represent the cognitive structure of the whole gamut of human emotions.

The rise of affectivism

Research over the past decades has demonstrated the explanatory power of emotions, feelings, motivations, moods, and other affective processes when trying to understand and predict how we think and behave. In this consensus article, we ask: has the increasingly recognized impact of affective phenomena ushered in a new era, the era of affectivism?

Dimensions and Clusters of Aesthetic Emotions: A Semantic Profile Analysis

Aesthetic emotions are elicited by different sensory impressions generated by music, visual arts, literature, theater, film, or nature scenes. Recently, the AESTHEMOS scale has been developed to facilitate the empirical assessment of such emotions. In this article we report a semantic profile analysis of aesthetic emotion terms that had been used for the development of this scale, using the GRID approach. This method consists of obtaining ratings of emotion terms on a set of meaning facets (features) which represent five components of the emotion process (appraisal, bodily reactions, action tendencies, expression, and feelings). The aims here were (a) to determine the dimensionality of the GRID features when applied to aesthetic emotions and compare it to published results for emotion terms in general, and (b) to examine the internal organization of the domain of aesthetic emotion terms in order to identify salient clusters of these items based on the similarity of their feature profiles on the GRID. Exploratory Principal Component Analyses suggest a four-dimensional structure of the semantic space consisting of valence, power, arousal, and novelty, converging with earlier GRID studies on large sets of standard emotion terms. Using cluster analyses, 15 clusters of aesthetic emotion terms with similar GRID feature profiles were identified, revealing the internal organization of the aesthetic emotion terms domain and meaningful subgroups of aesthetic emotions. While replication for further languages is required, these findings provide a solid basis for further research and methodological development in the realm of aesthetic emotions.

Comment: Advances in Studying the Vocal Expression of Emotion: Current Contributions and Further Options

I consider the five contributions in this special section as evidence that the research area dealing with the vocal expression of emotion is advancing rapidly, both in terms of the number of pertinent empirical studies and with respect to an ever increasing sophistication of methodology. I provide some suggestions on promising areas for future interdisciplinary research, including work on emotion expression in singing and the potential of vocal symptoms of emotional disorder. As to the popular discussion of the respective role of universality versus language/culture differences, I suggest to move on from exclusively studying the accuracy of recognition in judgment studies to a more differentiated approach adding production aspects, taking into account the multiple vocal and acoustic features that interact to communicate emotion.

Temporal Unfolding of Micro-valences in Facial Expression Evoked by Visual, Auditory, and Olfactory Stimuli

Appraisal theories suggest that valence appraisal should be differentiated into micro-valences, such as intrinsic pleasantness and goal-/need-related appraisals. In contrast to a macro-valence approach, this dissociation explains, among other things, the emergence of mixed or blended emotions. Here, we extend earlier research that showed that these valence types can be empirically dissociated. We examine the timing and the response patterns of these two micro-valences via measuring facial muscle activity changes (electromyography, EMG) over the brow and the cheek regions. In addition, we explore the effects of the sensory stimulus modality (vision, audition, and olfaction) on these patterns. The two micro-valences were manipulated in a social judgment task: first, intrinsic un/pleasantness (IP) was manipulated by exposing participants to appropriate stimuli presented in different sensory domains followed by a goal conduciveness/obstruction (GC) manipulation consisting of feedback on participants' judgments that were congruent or incongruent with their task-related goal. The results show significantly different EMG responses and timing patterns for both types of micro-valence, confirming the prediction that they are independent, consecutive parts of the appraisal process. Moreover, the lack of interaction effects with the sensory stimulus modality suggests high generalizability of the underlying appraisal mechanisms across different perception channels.

Culture‐specific appraisal biases contribute to emotion dispositions

We suggest that cultural factors may encourage the development of affective personality traits or emotional dispositions by producing or rewarding specific appraisal biases. To buttress this argument, we describe a putative mechanism and review the pertinent evidence: (a) an emotion disposition (trait affect) is a risk factor for experiencing certain emotions more readily and/or more frequently, (b) appraisal bias tends to cause certain emotions to be more readily experienced and may thus lead to the emergence of emotion dispositions and even emotional disturbances and (c) cultural goal, belief and value systems may encourage certain types of appraisal bias and may thus provide an explanation for vestiges of culture‐specific modal personality. Copyright © 2009 John Wiley & Sons, Ltd.

Evidence for the existence of emotion dispositions and the effects of appraisal bias

The concept of emotion disposition is proposed as an important dimension of individual differences. It refers to a stable tendency to experience certain emotions more or less frequently or intensely for similar classes of situations or events in daily experience than the majority of other people. In contrast to classic "trait affect" traditions, the theoretical framework described here proposes a specific mechanism based on the notion of appraisal bias, that is, the evaluation of events or situations in biased, often unrealistic, fashion. The bias toward internal versus external causal attribution is a classic example. It is suggested that such biases can affect virtually all appraisal criteria (e.g., novelty/expectedness, (un)pleasantness, goal conduciveness/obstruction, causation, control, power, and norm compliance), creating a disposition to experience specific emotions more frequently. In some cases, this process may lead to the development of affective disorders. Two studies are herein reported: (a) administering an emotion disposition assessment instrument to several thousand adults in personnel assessment contexts (N = 3,012), demonstrating the existence and intensity of emotion dispositions and identifying potential individual difference correlates; and (b) using an updated version of the instrument in a representative survey panel study (N = 190), assessing both emotion dispositions and appraisal biases, allowing analysis of their relationships (in addition to examining the effect of correlates). The results confirm the viability of the underlying theoretical assumptions as well as of the scenario method used for the assessment and provide leads for further research, particularly in the areas of emotional competence and affective disorders. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Are concepts of achievement-related emotions universal across cultures? A semantic profiling approach

Verifying that conceptualisations of emotions are consistent across languages and cultures is a critical precondition for meaningful cross-cultural research on emotional experience. For achievement-related emotions tied to successes or failures, such evidence is virtually non-existent. To address this gap, we compared Canadian, German, Colombian, and Chinese university students' (N _Total = 126) perceptions of affective, cognitive, motivational, physiological, and expressive characteristics of 16 achievement-related emotions using a psycholinguistic tool for profiling emotion concepts (Achievement Emotions CoreGRID). Cross-cultural similarity of emotion concepts quantified through double-entry intraclass correlations was generally high, and highest for their affective, cognitive, and motivational components. However, results also point to cultural variation, particularly for physiological and expressive components. Variation in perceived physiological characteristics was most pronounced for boredom, and for comparisons of Canada, Germany, and Colombia with China. Implications for theoretical propositions of universality of emotion concepts and future research on achievement-related emotions are discussed.

Investigating appraisal-driven facial expression and inference in emotion communication

Theory and research on emotion expression, both on production and recognition, has been dominated by a categorical emotion approach suggesting that discrete emotions are elicited and expressed via prototypical facial muscle configurations that can then be recognized by observers, presumably via template matching. This tradition is increasingly challenged by alternative theoretical approaches. In particular, appraisal theorists have suggested that specific elements of facial expressions are directly produced by the result of certain appraisals and have made detailed predictions about the facial patterns to be expected for these appraisal configurations. This approach has been extended to emotion perception, with theorists claiming that observers first infer individual appraisals and only then make categorical emotion judgments from the estimated appraisal patterns, using semantic inference rules. Here we report two studies that empirically examine the two central hypotheses proposed by this theoretical position: (a) that specific appraisals produce predicted patterns of facial muscle expressions and (b) that observers can infer a person's appraisals of ongoing events from the predicted facial expression configurations. The results show that (a) professional actors use many of the predicted facial action unit patterns to enact, in a realistic scenario setting, appraisal outcomes specified by experimental design, and (b) observers systematically infer specific appraisals from ecologically valid video recordings of marketing research participants as they view TV commercials (selected according to the likelihood of eliciting specific appraisals). The patterns of facial action units identified in these studies correspond largely to prior predictions and encourage further research on appraisal-driven expression and inference. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Appraisal-driven facial actions as building blocks for emotion inference

Although research on facial emotion recognition abounds, there has been little attention on the nature of the underlying mechanisms. In this article, using a "reverse engineering" approach, we suggest that emotion inference from facial expression mirrors the expression process. As a strong case can be made for an appraisal theory account of emotional expression, which holds that appraisal results directly determine the nature of facial muscle actions, we claim that observers first detect specific appraisals from different facial muscle actions and then use implicit inference rules to categorize and name specific emotions. We report three experiments in which, guided by theoretical predictions and past empirical evidence, we systematically manipulated specific facial action units individually and in different configurations via synthesized avatar expressions. Large, diverse groups of participants judged the resulting videos for the underlying appraisals and/or the ensuing emotions. The results confirm that participants can infer targeted appraisals and emotions from synthesized facial actions based on appraisal predictions. We also report evidence that the ability to correctly interpret the synthesized stimuli is highly correlated with emotion recognition ability as part of emotional competence. We conclude by highlighting the importance of adopting a theory-based experimental approach in future research, focusing on the dynamic unfolding of facial expressions of emotion. (PsycINFO Database Record

Analyzing Emotion Expression in Singing via Flow Glottograms, Long-Term-Average Spectra, and Expert Listener Evaluation

BACKGROUND

Acoustic aspects of emotional expressivity in speech have been analyzed extensively during recent decades. Emotional coloring is an important if not the most important property of sung performance, and therefore strictly controlled. Hence, emotional expressivity in singing may promote a deeper insight into vocal signaling of emotions. Furthermore, physiological voice source parameters can be assumed to facilitate the understanding of acoustical characteristics.

METHOD

Three highly experienced professional male singers sang scales on the vowel /ae/ or /a/ in 10 emotional colors (Neutral, Sadness, Tender, Calm, Joy, Contempt, Fear, Pride, Love, Arousal, and Anger). Sixteen voice experts classified the scales in a forced-choice listening test, and the result was compared with long-term-average spectrum (LTAS) parameters and with voice source parameters, derived from flow glottograms (FLOGG) that were obtained from inverse filtering the audio signal.

RESULTS

On the basis of component analysis, the emotions could be grouped into four "families", Anger-Contempt, Joy-Love-Pride, Calm-Tender-Neutral and Sad-Fear. Recognition of the intended emotion families by listeners reached accuracy levels far beyond chance level. For the LTAS and FLOGG parameters, vocal loudness had a paramount influence on all. Also after partialing out this factor, some significant correlations were found between FLOGG and LTAS parameters. These parameters could be sorted into groups that were associated with the emotion families.

CONCLUSIONS

(i) Both LTAS and FLOGG parameters varied significantly with the enactment intentions of the singers. (ii) Some aspects of the voice source are reflected in LTAS parameters. (iii) LTAS parameters affect listener judgment of the enacted emotions and the accuracy of the intended emotional coloring.

The Nomological Network of Emotion Recognition Ability

Abstract. The ability to recognize other people’s emotions from their face, voice, and body (emotion recognition ability, ERA) is crucial to successful functioning in private and professional life. The Geneva Emotion Recognition Test (GERT; Schlegel, Grandjean, & Scherer, 2014 ) is a new instrument to measure ERA in a more ecologically valid way than previous tests. In this article, we report the results of five studies examining the test’s construct validity with a total N of 1,284. We found that the GERT was highly positively correlated with other performance-based tests measuring ERA and emotional intelligence (EI), as well as with cognitive intelligence. GERT scores were also related to higher self-reported empathy, openness, and neuroticism, and to better social adjustment. Furthermore, higher GERT scores were related to lower anxiety, anger expressivity, and alexithymia. In line with previous findings, women scored higher than men and GERT performance declined with increasing age. Taken together, these results provide considerable evidence for the construct validity of the GERT and for ERA as an adaptive skill that likely facilitates better life outcomes.

Dynamic Facial Expression of Emotion and Observer Inference

Research on facial emotion expression has mostly focused on emotion recognition, assuming that a small number of discrete emotions is elicited and expressed via prototypical facial muscle configurations as captured in still photographs. These are expected to be recognized by observers, presumably via template matching. In contrast, appraisal theories of emotion propose a more dynamic approach, suggesting that specific elements of facial expressions are directly produced by the result of certain appraisals and predicting the facial patterns to be expected for certain appraisal configurations. This approach has recently been extended to emotion perception, claiming that observers first infer individual appraisals and only then make categorical emotion judgments based on the estimated appraisal patterns, using inference rules. Here, we report two related studies to empirically investigate the facial action unit configurations that are used by actors to convey specific emotions in short affect bursts and to examine to what extent observers can infer a person's emotions from the predicted facial expression configurations. The results show that (1) professional actors use many of the predicted facial action unit patterns to enact systematically specified appraisal outcomes in a realistic scenario setting, and (2) naïve observers infer the respective emotions based on highly similar facial movement configurations with a degree of accuracy comparable to earlier research findings. Based on estimates of underlying appraisal criteria for the different emotions we conclude that the patterns of facial action units identified in this research correspond largely to prior predictions and encourage further research on appraisal-driven expression and inference.

Studying appraisal-driven emotion processes: taking stock and moving to the future

Appraisal theories of emotion, and particularly the Component Process Model, have claimed over the past three decades that the different components of the emotion process (action tendencies, physiological reactions, expressions, and feeling experiences) are essentially driven by the results of multi-level cognitive appraisals and that the feeling component constitutes a central integration and representation of these processes. Given the complexity of the proposed architecture of emotion generation, comprehensive experimental tests of these predictions are difficult to perform and thus evidence has been slow to appear. Complementing earlier work on self-reported appraisal, a massive amount of empirical results from studies with experimental designs based on appraisal manipulation, using electroencephalographic and electromyographic measures, now confirms many of the theoretical predictions with respect to the effect of different appraisal checks, their interactions, and their exact timing. A major issue for future research is the nature of the coherence or synchronisation of the appraisal-driven components in the unfolding emotion process. It is suggested that interdisciplinary multi-team research will be needed to face the theoretical and methodological challenges of experimentally investigating the dynamics of the emotion process.

The Emotion Process: Event Appraisal and Component Differentiation

Much emotion research has focused on the end result of the emotion process, categorical emotions, as reported by the protagonist or diagnosed by the researcher, with the aim of differentiating these discrete states. In contrast, this review concentrates on the emotion process itself by examining how ( a) elicitation, or the appraisal of events, leads to ( b) differentiation, in particular, action tendencies accompanied by physiological responses and manifested in facial, vocal, and gestural expressions, before ( c) conscious representation or experience of these changes (feeling) and ( d) categorizing and labeling these changes according to the semantic profiles of emotion words. The review focuses on empirical, particularly experimental, studies from emotion research and neighboring domains that contribute to a better understanding of the unfolding emotion process and the underlying mechanisms, including the interactions among emotion components.

Brain Networks, Emotion Components, and Appraised Relevance

Modeling emotion processes remains a conceptual and methodological challenge in affective sciences. In responding to the other target articles in this special section on “Emotion and the Brain” and the comments on our article, we address the issue of potentially separate brain networks subserving the functions of the different emotion components. In particular, we discuss the suggested role of component synchronization in producing information integration for the dynamic emergence of a coherent emotion process, as well as the links between incentive salience (“wanting”) and concern-relevance in the elicitation of emotion.

An Appraisal-Driven Componential Approach to the Emotional Brain

This article suggests that methodological and conceptual advancements in affective sciences militate in favor of adopting an appraisal-driven componential approach to further investigate the emotional brain. Here we propose to operationalize this approach by distinguishing five functional networks of the emotional brain: (a) the elicitation network, (b) the expression network, (c) the autonomic reaction network, (d) the action tendency network, and (e) the feeling network, and discuss these networks in the context of the affective neuroscience literature. We also propose that further investigating the “appraising brain” is the royal road to better understand the elicitation network, and may be key to revealing the neural causal mechanisms underlying the emotion process as a whole.

The semantic structure of emotion words across languages is consistent with componential appraisal models of emotion

Appraisal theories of emotion, and particularly the Component Process Model, claim that the different components of the emotion process (action tendencies, physiological reactions, expressions, and feeling experiences) are essentially driven by the results of cognitive appraisals and that the feeling component constitutes a central integration and representation of these processes. Given the complexity of the proposed architecture, comprehensive experimental tests of these predictions are difficult to perform and to date are lacking. Encouraged by the "lexical sedimentation" hypothesis, here we propose an indirect examination of the compatibility of the theoretical assumptions with the semantic structure of a set of major emotion words as measured in a cross-language and cross-cultural study. Specifically, we performed a secondary analysis of the large-scale data set with ratings of affective features covering all components of the emotion process for 24 emotion words in 27 countries, constituting profiles of emotion-specific appraisals, action tendencies, physiological reactions, expressions, and feeling experiences. The results of a series of hierarchical regression analyses to examine the prediction of the theoretical model are highly consistent with the claim that appraisal patterns determine the structure of the response components, which in turn predict central dimensions of the feeling component.

Comment: Comorbidity Between Mental and Somatic Pathologies: Deficits in Emotional Competence as Health Risk Factors

I strongly endorse many of the suggestions made by the authors of the extremely useful reviews in this issue. In particular, the need to identify the complex causal mechanisms underlying the major health risk factors requires urgent attention of the research community. I suggest considering the important role of emotional disturbances as contributors to health risks given the empirically established comorbidity between mental and somatic illness. Better knowledge of these mechanisms is an essential prerequisite to develop tailored personalized prevention and intervention programs, including reliable and valid assessment of deficits.

Evidence of emotion-antecedent appraisal checks in electroencephalography and facial electromyography

In the present study, we applied Machine Learning (ML) methods to identify psychobiological markers of cognitive processes involved in the process of emotion elicitation as postulated by the Component Process Model (CPM). In particular, we focused on the automatic detection of five appraisal checks—novelty, intrinsic pleasantness, goal conduciveness, control, and power—in electroencephalography (EEG) and facial electromyography (EMG) signals. We also evaluated the effects on classification accuracy of averaging the raw physiological signals over different numbers of trials, and whether the use of minimal sets of EEG channels localized over specific scalp regions of interest are sufficient to discriminate between appraisal checks. We demonstrated the effectiveness of our approach on two data sets obtained from previous studies. Our results show that novelty and power appraisal checks can be consistently detected in EEG signals above chance level (binary tasks). For novelty, the best classification performance in terms of accuracy was achieved using features extracted from the whole scalp, and by averaging across 20 individual trials in the same experimental condition (UAR = 83.5 ± 4.2; N = 25). For power, the best performance was obtained by using the signals from four pre-selected EEG channels averaged across all trials available for each participant (UAR = 70.6 ± 5.3; N = 24). Together, our results indicate that accurate classification can be achieved with a relatively small number of trials and channels, but that averaging across a larger number of individual trials is beneficial for the classification for both appraisal checks. We were not able to detect any evidence of the appraisal checks under study in the EMG data. The proposed methodology is a promising tool for the study of the psychophysiological mechanisms underlying emotional episodes, and their application to the development of computerized tools (e.g., Brain-Computer Interface) for the study of cognitive processes involved in emotions.

The nomological network of emotion knowledge and emotion understanding in adults: evidence from two new performance-based tests

Emotion understanding, which can broadly be defined as expertise in the meaning of emotion, is a core component of emotional intelligence and facilitates better intra- and interpersonal outcomes. However, to date only very few standard tests to measure emotion understanding in healthy adults exist. Here, we present two new performance-based tests that were developed and are scored based on componential emotion theory and large-scale cross-cultural empirical findings. These instruments intend to measure facets of emotion understanding that are not included in existing tests. The first test (Geneva EMOtion Knowledge test - Blends; GEMOK-Blends) measures the ability to understand and label emotional experiences of a target person from a description of emotion features covering five emotion components (appraisal, feeling, action tendencies, expression, and physiology) embedded in a written vignette. The second test (GEMOK-Features) measures semantic knowledge about which features from each component are characteristic of emotion episodes described by a specific emotion label. In four studies, we found evidence for the good internal consistency and construct validity of these tests. Both tests were positively correlated with other emotional abilities and cognitive ability and showed meaningful associations with a variety of personality and demographic variables.

The expression of emotion in the singing voice: Acoustic patterns in vocal performance

There has been little research on the acoustic correlates of emotional expression in the singing voice. In this study, two pertinent questions are addressed: How does a singer's emotional interpretation of a musical piece affect acoustic parameters in the sung vocalizations? Are these patterns specific enough to allow statistical discrimination of the intended expressive targets? Eight professional opera singers were asked to sing the musical scale upwards and downwards (using meaningless content) to express different emotions, as if on stage. The studio recordings were acoustically analyzed with a standard set of parameters. The results show robust vocal signatures for the emotions studied. Overall, there is a major contrast between sadness and tenderness on the one hand, and anger, joy, and pride on the other. This is based on low vs high levels on the components of loudness, vocal dynamics, high perturbation variation, and a tendency for high low-frequency energy. This pattern can be explained by the high power and arousal characteristics of the emotions with high levels on these components. A multiple discriminant analysis yields classification accuracy greatly exceeding chance level, confirming the reliability of the acoustic patterns.

The effect of context and audio-visual modality on emotions elicited by a musical performance

In this work, we compared emotions induced by the same performance of Schubert Lieder during a live concert and in a laboratory viewing/listening setting to determine the extent to which laboratory research on affective reactions to music approximates real listening conditions in dedicated performances. We measured emotions experienced by volunteer members of an audience that attended a Lieder recital in a church (Context 1) and emotional reactions to an audio-video-recording of the same performance in a university lecture hall (Context 2). Three groups of participants were exposed to three presentation versions in Context 2: (1) an audio-visual recording, (2) an audio-only recording, and (3) a video-only recording. Participants achieved statistically higher levels of emotional convergence in the live performance than in the laboratory context, and the experience of particular emotions was determined by complex interactions between auditory and visual cues in the performance. This study demonstrates the contribution of the performance setting and the performers' appearance and nonverbal expression to emotion induction by music, encouraging further systematic research into the factors involved.

Effects of achievement contexts on the meaning structure of emotion words

Little is known about the impact of context on the meaning of emotion words. In the present study, we used a semantic profiling instrument (GRID) to investigate features representing five emotion components (appraisal, bodily reaction, expression, action tendencies, and feeling) of 11 emotion words in situational contexts involving success or failure. We compared these to the data from an earlier study in which participants evaluated the typicality of features out of context. Profile analyses identified features for which typicality changed as a function of context for all emotion words, except contentment, with appraisal features being most frequently affected. Those context effects occurred for both hypothesised basic and non-basic emotion words. Moreover, both data sets revealed a four-dimensional structure. The four dimensions were largely similar (valence, power, arousal, and novelty). The results suggest that context may not change the underlying dimensionality but affects facets of the meaning of emotion words.

Emotion Inferences from Vocal Expression Correlate Across Languages and Cultures

Whereas the perception of emotion from facial expression has been extensively studied cross-culturally, little is known about judges’ ability to infer emotion from vocal cues. This article reports the results from a study conducted in nine countries in Europe, the United States, and Asia on vocal emotion portrayals of anger, sadness, fear, joy, and neutral voice as produced by professional German actors. Data show an overall accuracy of 66% across all emotions and countries. Although accuracy was substantially better than chance, there were sizable differences ranging from 74% in Germany to 52% in Indonesia. However, patterns of confusion were very similar across all countries. These data suggest the existence of similar inference rules from vocal expression across cultures. Generally, accuracy decreased with increasing language dissimilarity from German in spite of the use of language-free speech samples. It is concluded that culture- and language-specific paralinguistic patterns may influence the decoding process.

The Role of Injustice in the Elicitation of Differential Emotional Reactions

Data from a large-scale study on emotional experiences in 37 countries are used to examine correlates of emotion-antecedent events being judged as unfair or unjust. This study included 2,921 students who reported situations in which they had experienced joy, anger; fear, sadness, disgust, shame, and guilt and described their situation appraisals and reactions. Anger-producing events were most frequently perceived as very unfair followed by disgust, sadness, fear, guilt, and shame. The results showed strong main effects of the perception of injustice for all negative emotions. Events experienced as unjust were described as more immoral, more obstructive to plans and goals, and having more negative effects on personal relationships. In addition, events regarded as unjust elicited feelings that were longer in duration and more intense. It is concluded that perceived injustice plays a powerful role in the elicitation of many different negative emotions and may serve as a mediating variable in emotion-antecedent appraisal.

Mapping Emotion Terms into Affective Space

Abstract. Recent empirical work on the semantics of emotion terms across many different cultures and languages, using a theoretical componential approach, suggested that four dimensions are needed to parsimoniously describe the semantic space of the emotion domain as reflected in emotion terms ( Fontaine, Scherer, Roesch, & Ellsworth, 2007 ; Fontaine, Scherer, & Soriano, 2013 ). In addition to valence, power, and arousal, a novelty dimension was discovered that mostly differentiated surprise from other emotions. Here, we further explore the existence and nature of the fourth dimension in semantic emotion space using a much larger and much more representative set of emotion terms. A group of 156 participants each rated 10 out of a set of 80 French emotion terms with respect to semantic meaning. The meaning of an emotion term was evaluated with respect to 68 emotion features representing the appraisal, action tendency, bodily reaction, expression, and feeling components of the emotion process. A principal component analysis confirmed the four-dimensional valence, power, arousal, and novelty structure. Moreover, this larger and much more representative set of emotion terms revealed that the novelty dimension not only differentiates surprise terms from other emotion terms, but also identifies substantial variation within the fear and joy emotion families.

The Look of Fear from the Eyes Varies with the Dynamic Sequence of Facial Actions

Abstract. Most research on the ability to interpret expressions from the eyes has utilized static information. This research investigates whether the dynamic sequence of facial actions in the eye region influences the judgments of perceivers. Dynamic fear expressions involving the eye region and eyebrows were created which systematically differed in the sequential occurrence of facial actions. Participants rated the intensity of sequential fear expressions, either in addition to a simultaneous, full-blown expression (Experiment 1) or in combination with different levels of eye gaze (Experiment 2). The results showed that the degree of attributed emotion and the appraisal ratings differed as a function of the sequence of facial expressions of fear, with direct gaze resulting in stronger subjective responses. The findings challenge current notions surrounding the study of static facial displays from the eyes and suggest that emotion perception is a dynamic process shaped by the time course of the facial actions of an expression. Possible implications for the field of affective computing and clinical research are discussed.

Temporal dynamics and potential neural sources of goal conduciveness, control, and power appraisal

A major emotion theory, the Component Process Model, predicts that emotion-antecedent appraisal proceeds sequentially (e.g., goal conduciveness>control>power appraisal). In a gambling task, feedback manipulated information about goal conduciveness (outcome: win, loss), control (perceived high and low control), and power appraisals (choice options to change the outcome). Using mean amplitudes of event-related potentials, we examine the sequential prediction of these appraisal criteria. Additionally, we apply source localization analysis to estimate the neural sources of the evoked components of interest. Early ERPs (230-300 ms) show main effects of goal conduciveness and power but no interaction effects suggesting goal obstructiveness assessment of task-relevant feedback information. Late ERPs (350-600 ms) reveal main effects of all appraisals and interaction effects representing the integration of all appraisal information. Source localization analysis suggests distinct neural sources for these appraisal criteria.

Path Models of Vocal Emotion Communication

We propose to use a comprehensive path model of vocal emotion communication, encompassing encoding, transmission, and decoding processes, to empirically model data sets on emotion expression and recognition. The utility of the approach is demonstrated for two data sets from two different cultures and languages, based on corpora of vocal emotion enactment by professional actors and emotion inference by naïve listeners. Lens model equations, hierarchical regression, and multivariate path analysis are used to compare the relative contributions of objectively measured acoustic cues in the enacted expressions and subjective voice cues as perceived by listeners to the variance in emotion inference from vocal expressions for four emotion families (fear, anger, happiness, and sadness). While the results confirm the central role of arousal in vocal emotion communication, the utility of applying an extended path modeling framework is demonstrated by the identification of unique combinations of distal cues and proximal percepts carrying information about specific emotion families, independent of arousal. The statistical models generated show that more sophisticated acoustic parameters need to be developed to explain the distal underpinnings of subjective voice quality percepts that account for much of the variance in emotion inference, in particular voice instability and roughness. The general approach advocated here, as well as the specific results, open up new research strategies for work in psychology (specifically emotion and social perception research) and engineering and computer science (specifically research and development in the domain of affective computing, particularly on automatic emotion detection and synthetic emotion expression in avatars).

Emotion perception from a componential perspective

The common conceptual understanding of emotion is that they are multi-componential, including subjective feelings, appraisals, psychophysiological activation, action tendencies, and motor expressions. Emotion perception, however, has traditionally been studied in terms of emotion labels, such as "happy", which do not clearly indicate whether one, some, or all emotion components are perceived. We examine whether emotion percepts are multi-componential and extend previous research by using more ecologically valid, dynamic, and multimodal stimuli and an alternative response measure. The results demonstrate that observers can reliably infer multiple types of information (subjective feelings, appraisals, action tendencies, and social messages) from complex emotion expressions. Furthermore, this finding appears to be robust to changes in response items. The results are discussed in light of their implications for research on emotion perception.

Appraisals Generate Specific Configurations of Facial Muscle Movements in a Gambling Task: Evidence for the Component Process Model of Emotion

Scherer’s Component Process Model provides a theoretical framework for research on the production mechanism of emotion and facial emotional expression. The model predicts that appraisal results drive facial expressions, which unfold sequentially and cumulatively over time. In two experiments, we examined facial muscle activity changes (via facial electromyography recordings over the corrugator, cheek, and frontalis regions) in response to events in a gambling task. These events were experimentally manipulated feedback stimuli which presented simultaneous information directly affecting goal conduciveness (gambling outcome: win, loss, or break-even) and power appraisals (Experiment 1 and 2), as well as control appraisal (Experiment 2). We repeatedly found main effects of goal conduciveness (starting ~600 ms), and power appraisals (starting ~800 ms after feedback onset). Control appraisal main effects were inconclusive. Interaction effects of goal conduciveness and power appraisals were obtained in both experiments (Experiment 1: over the corrugator and cheek regions; Experiment 2: over the frontalis region) suggesting amplified goal conduciveness effects when power was high in contrast to invariant goal conduciveness effects when power was low. Also an interaction of goal conduciveness and control appraisals was found over the cheek region, showing differential goal conduciveness effects when control was high and invariant effects when control was low. These interaction effects suggest that the appraisal of having sufficient control or power affects facial responses towards gambling outcomes. The result pattern suggests that corrugator and frontalis regions are primarily related to cognitive operations that process motivational pertinence, whereas the cheek region would be more influenced by coping implications. Our results provide first evidence demonstrating that cognitive-evaluative mechanisms related to goal conduciveness, control, and power appraisals affect facial expressions dynamically over time, immediately after an event is perceived. In addition, our results provide further indications for the chronography of appraisal-driven facial movements and the underlying cognitive processes.

Emotion categories and dimensions in the facial communication of affect: An integrated approach

We investigated the role of facial behavior in emotional communication, using both categorical and dimensional approaches. We used a corpus of enacted emotional expressions (GEMEP) in which professional actors are instructed, with the help of scenarios, to communicate a variety of emotional experiences. The results of Study 1 replicated earlier findings showing that only a minority of facial action units are associated with specific emotional categories. Likewise, facial behavior did not show a specific association with particular emotional dimensions. Study 2 showed that facial behavior plays a significant role both in the detection of emotions and in the judgment of their dimensional aspects, such as valence, arousal, dominance, and unpredictability. In addition, a mediation model revealed that the association between facial behavior and recognition of the signaler's emotional intentions is mediated by perceived emotional dimensions. We conclude that, from a production perspective, facial action units convey neither specific emotions nor specific emotional dimensions, but are associated with several emotions and several dimensions. From the perceiver's perspective, facial behavior facilitated both dimensional and categorical judgments, and the former mediated the effect of facial behavior on recognition accuracy. The classification of emotional expressions into discrete categories may, therefore, rely on the perception of more general dimensions such as valence and arousal and, presumably, the underlying appraisals that are inferred from facial movements.

When and Why Are Emotions Disturbed? Suggestions Based on Theory and Data From Emotion Research

Diagnosing emotion disturbances should be informed by current knowledge about normal emotion processes. I identify four major functions of emotion as well as sources for potential dysfunctions and suggest that emotions should only be diagnosed as pathological when they are clearly dysfunctional, which requires considering eliciting events, realistic person-specific appraisal patterns, and adaptive responses or action tendencies. Evidence from actuarial research on the reported length of naturally occurring emotion episodes (including potential determinants) illustrates appropriateness criteria for the clinical evaluation of emotion duration—an essential element in the DSM-5 symptom catalogue for major depression episodes, especially in bereavement. The need for more actuarial evidence on normal emotion responses and its consideration by the clinical community is highlighted.

Automated Recognition of Emotion Appraisals

Most computer models for the automatic recognition of emotion from nonverbal signals (e.g., facial or vocal expression) have adopted a discrete emotion perspective, i.e., they output a categorical emotion from a limited pool of candidate labels. The discrete perspective suffers from practical and theoretical drawbacks that limit the generalizability of such systems. The authors of this chapter propose instead to adopt an appraisal perspective in modeling emotion recognition, i.e., to infer the subjective cognitive evaluations that underlie both the nonverbal cues and the overall emotion states. In a first step, expressive features would be used to infer appraisals; in a second step, the inferred appraisals would be used to predict an emotion label. The first step is practically unexplored in emotion literature. Such a system would allow to (a) link models of emotion recognition and production, (b) add contextual information to the inference algorithm, and (c) allow detection of subtle emotion states.