Emotion recognition training using composite faces generalises across identities but not all emotions

Trial protocol for the Building Resilience through Socio-Emotional Training (ReSET) programme: a cluster randomised controlled trial of a new transdiagnostic preventative intervention for adolescents

BACKGROUND

Adolescence is a period of heightened vulnerability to developing mental health problems, and rates of mental health disorder in this age group have increased in the last decade. Preventing mental health problems developing before they become entrenched, particularly in adolescents who are at high risk, is an important research and clinical target. Here, we report the protocol for the trial of the 'Building Resilience through Socioemotional Training' (ReSET) intervention. ReSET is a new, preventative intervention that incorporates individual-based emotional training techniques and group-based social and communication skills training. We take a transdiagnostic approach, focusing on emotion processing and social mechanisms implicated in the onset and maintenance of various forms of psychopathology.

METHODS

A cluster randomised allocation design is adopted with randomisation at the school year level. Five-hundred and forty adolescents (aged 12-14) will be randomised to either receive the intervention or not (passive control). The intervention is comprised of weekly sessions over an 8-week period, supplemented by two individual sessions. The primary outcomes, psychopathology symptoms and mental wellbeing, will be assessed pre- and post-intervention, and at a 1-year follow-up. Secondary outcomes are task-based assessments of emotion processing, social network data based on peer nominations, and subjective ratings of social relationships. These measures will be taken at baseline, post-intervention and 1-year follow-up. A subgroup of participants and stakeholders will be invited to take part in focus groups to assess the acceptability of the intervention.

DISCUSSION

This project adopts a theory-based approach to the development of a new intervention designed to target the close connections between young people's emotions and their interpersonal relationships. By embedding the intervention within a school setting and using a cluster-randomised design, we aim to develop and test a feasible, scalable intervention to prevent the onset of psychopathology in adolescence.

TRIAL REGISTRATION

ISRCTN88585916. Trial registration date: 20/04/2023.

Assessing the effectiveness of online emotion recognition training in healthy volunteers

Facial emotion recognition (ER) difficulties are associated with mental health and neurodevelopmental conditions, including autism and poorer social functioning. ER interventions may therefore have clinical potential. We investigated the efficacy of ER training (ERT). We conducted three online studies with healthy volunteers completing one ERT session. Studies 1 and 2 included active and control/sham training groups and tested the efficacy of (i) four-emotion ERT (angry, happy, sad and scared) (n = 101), and (ii) six-emotion ERT (adding disgusted and surprised) (n = 109). Study 3 tested generalizability of ERT to non-trained stimuli with groups trained and tested on the same stimuli, or different stimuli (n = 120). Training effects on total correct hits were estimated using linear mixed effects models. We did not observe clear evidence of improvement in study 1 but note the effect was in the direction of improvement (b = 0.02, 95% confidence interval (CI) = -0.02 to 0.07). Study 2 indicated greater total hits following training (b = 0.07, 95% CI = 0.03-0.12). Study 3 demonstrated similar improvement across groups (b = -0.01, 95% CI = -0.05 to 0.02). Our results indicate improved ER (as measured by our task), which generalizes to different facial stimulus sets. Future studies should further explore generalizability, longer-term effects and ERT in populations with known ER difficulties.

Emotional bias training as a treatment for anxiety and depression: evidence from experimental medicine studies in healthy and medicated samples

BACKGROUND

Anxiety and depression are leading causes of disability worldwide, yet individuals are often unable to access appropriate treatment. There is a need to develop effective interventions that can be delivered remotely. Previous research has suggested that emotional processing biases are a potential target for intervention, and these may be altered through brief training programs.

METHODS

We report two experimental medicine studies of emotional bias training in two samples: individuals from the general population (n = 522) and individuals currently taking antidepressants to treat anxiety or depression (n = 212). Participants, recruited online, completed four sessions of EBT from their own home. Mental health and cognitive functioning outcomes were assessed at baseline, immediately post-training, and at 2-week follow-up.

RESULTS

In both studies, our intervention successfully trained participants to perceive ambiguous social information more positively. This persisted at a 2-week follow-up. There was no clear evidence that this change in emotional processing transferred to improvements in symptoms in the primary analyses. However, in both studies, there was weak evidence for improved quality of life following EBT amongst individuals with more depressive symptoms at baseline. No clear evidence of transfer effects was observed for self-reported daily stress, anhedonia or depressive symptoms. Exploratory analyses suggested that younger participants reported greater treatment gains.

CONCLUSIONS

These studies demonstrate the effectiveness of delivering a multi-session online training program to promote lasting cognitive changes. Given the inconsistent evidence for transfer effects, EBT requires further development before it can be considered as a treatment for anxiety and depression.

Emotional recognition training modifies neural response to emotional faces but does not improve mood in healthy volunteers with high levels of depressive symptoms

BACKGROUND

There is demand for new, effective and scalable treatments for depression, and development of new forms of cognitive bias modification (CBM) of negative emotional processing biases has been suggested as possible interventions to meet this need.

METHODS

We report two double blind RCTs, in which volunteers with high levels of depressive symptoms (Beck Depression Inventory ii (BDI-ii) > 14) completed a brief course of emotion recognition training (a novel form of CBM using faces) or sham training. In Study 1 (N = 36), participants completed a post-training emotion recognition task whilst undergoing functional magnetic resonance imaging to investigate neural correlates of CBM. In Study 2 (N = 190), measures of mood were assessed post-training, and at 2-week and 6-week follow-up.

RESULTS

In both studies, CBM resulted in an initial change in emotion recognition bias, which (in Study 2) persisted for 6 weeks after the end of training. In Study 1, CBM resulted in increases neural activation to happy faces, with this effect driven by an increase in neural activity in the medial prefrontal cortex and bilateral amygdala. In Study 2, CBM did not lead to a reduction in depressive symptoms on the BDI-ii, or on related measures of mood, motivation and persistence, or depressive interpretation bias at either 2 or 6-week follow-ups.

CONCLUSIONS

CBM of emotion recognition has effects on neural activity that are similar in some respects to those induced by Selective Serotonin Reuptake Inhibitors (SSRI) administration (Study 1), but we find no evidence that this had any later effect on self-reported mood in an analogue sample of non-clinical volunteers with low mood (Study 2).

Using Positive Emotion Training With Maltreated Youths to Reduce Anger Bias and Physical Aggression

Maltreated youths often overinterpret anger in others' emotional expressions, particularly expressions that are ambiguous, and this "anger bias" is associated with aggressive behavior. In the current experiment, we tested the effect of an emotion-training intervention on anger bias and subsequent aggression. Eighty-four youths, ages 8 to 17, who had been removed from home because of maltreatment and had screened positive for aggressive tendencies, served as participants. Over 4 days, youths completed positive emotion training, a computerized program in which youths classify emotional expressions. Youths in the treatment condition received feedback to encourage their recognition of happiness over anger in ambiguous expressions. Physical aggression up to 1 week posttraining was assessed on the basis of self- and staff reports. The intervention was effective in reducing youths' anger bias and somewhat so in reducing aggression-the latter of-which occurred infrequently, limiting power. Results offer direction for developmental research and cost-effective interventions for maltreated youths at risk for aggression and future justice-system involvement.

Perceived emotional expressions of composite faces

The eye and mouth regions serve as the primary sources of facial information regarding an individual's emotional state. The aim of this study was to provide a comprehensive assessment of the relative importance of those two information sources in the identification of different emotions. The stimuli were composite facial images, in which different expressions (Neutral, Anger, Disgust, Fear, Happiness, Contempt, and Surprise) were presented in the eyes and the mouth. Participants (21 women, 11 men, mean age 25 years) rated the expressions of 7 congruent and 42 incongruent composite faces by clicking on a point within the valence-arousal emotion space. Eye movements were also monitored. With most incongruent composite images, the perceived emotion corresponded to the expression of either the eye region or the mouth region or an average of those. The happy expression was different. Happy eyes often shifted the perceived emotion towards a slightly negative point in the valence-arousal space, not towards the location associated with a congruent happy expression. The eye-tracking data revealed significant effects of congruency, expressions and interaction on total dwell time. Our data indicate that whether a face that combines features from two emotional expressions leads to a percept based on only one of the expressions (categorical perception) or integration of the two expressions (dimensional perception), or something altogether different, strongly depends upon the expressions involved.

Arbitrary signals of trustworthiness - social judgments may rely on facial expressions even with experimentally manipulated valence

Generalization has been suggested as a basic mechanism in forming impressions about unfamiliar people. In this study, we investigated how social evaluations will be transferred to individual faces across contexts and to expressions across individuals. A total of 93 people (33 men, age: M = 29.95; SD = 13.74) were exposed to facial images which they had to evaluate. In the Association phase, we presented one individual with (1) a trustworthy, (2) an untrustworthy, (3) or an ambiguous expression, with either positive or negative descriptive sentence pairs. In the Evaluation phase participants were shown (1) a new individual with the same emotional facial expression as seen before, and (2) a neutral image of the previously presented individual. They were asked to judge the trustworthiness of each person. We found that the valence of the social description is transferred to both individuals and expressions. That is, the social evaluations (positive or negative) transferred between the images of two different individuals if they both displayed the same facial expression. The consistency between the facial expression and the description, however, had no effect on the evaluation of the same expression appearing on an unfamiliar face. Results suggest that in social evaluation of unfamiliar people invariant and dynamically changing facial traits are used to a similar extent and influence these judgements through the same associative process.

An investigation of emotion recognition training to reduce symptoms of social anxiety in adolescence

This study aimed to examine the effect of emotion recognition training on social anxiety symptoms among adolescents, aged 15-18 years. The study included a screening session, which identified participants who scored above a cut-off on a self-report measure of social anxiety for enrolment into a randomized controlled trial (Clinical Trials ID: NCT02550379). Participants were randomized to an intervention condition designed to increase the perception of happiness over disgust in ambiguous facial expressions or a sham intervention control condition, and completed self-report measures of social anxiety, fear of negative evaluation, anxiety-related disorders, and depressive symptoms. The intervention group demonstrated a strong shift in the balance point at which they perceived happiness over disgust in ambiguous facial expressions. This increase in positive perception was not associated with any changes in the primary outcome of social anxiety; however, some evidence of improvement in symptomatology was observed on one of a number of secondary outcomes. Those in the intervention group had lower depression symptoms at 2-week follow-up, compared to those in the control group who received the sham intervention training. Potential reasons for why the shift in balance point measurement was not associated with a concurrent shift in symptoms of social anxiety are discussed.

Cognitive bias modification for facial interpretation: a randomized controlled trial of transfer to self-report and cognitive measures in a healthy sample

Cognitive bias modification is a potential low-intensity intervention for mood disorders, but previous studies have shown mixed success. This study explored whether facial interpretation bias modification (FIBM), a similar paradigm designed to shift emotional interpretation (and/or perception) of faces would transfer to: (i) self-reported symptoms and (ii) a battery of cognitive tasks. In a preregistered, double-blind randomized controlled trial, healthy participants received eight online sessions of FIBM (N = 52) or eight sham sessions (N = 52). While we replicate that FIBM successfully shifts ambiguous facial expression interpretation in the intervention group, this failed to transfer to the majority of self-report or cognitive measures. There was, however, weak, inconclusive evidence of transfer to a self-report measure of stress, a cognitive measure of anhedonia, and evidence that results were moderated by trait anxiety (whereby transference was greatest in those with higher baseline symptoms). We discuss the need for work in both larger and clinical samples, while urging caution that these FIBM training effects may not transfer to clinically relevant domains.

Biased Facial-Emotion Perception in Mental Health Disorders: A Possible Target for Psychological Intervention?

Our perception of emotion in the faces of others affects our own behavior and mood. Indeed, individuals with mood disorders such as depression and aggression often show biases in facial-emotion perception. Here, we review recent and ongoing research suggesting that biased emotion perception may be on the causal pathway of the onset and maintenance of mood disorders, and hence a potential target for intervention. Simple cognitive-bias modification tasks that change participants’ perception of facial expressions of emotion have shown some promise as a therapeutic technique. We outline further directions for continued research investigating the robustness and clinical impact of emotion-bias modification in real-world settings.

Protocol for a between-group experimental study examining cultural differences in emotion processing between Malay and Caucasian adults with and without major depressive disorder

INTRODUCTION

Depression is a mood disorder that affects a significant proportion of the population worldwide. In Malaysia and Australia, the number of people diagnosed with depression is on the rise. It has been found that impairments in emotion processing and emotion regulation play a role in the development and maintenance of depression. This study is based on Matsumoto and Hwang's biocultural model of emotion and Triandis' Subjective Culture model. It aims to investigate the influence of culture on emotion processing among Malaysians and Australians with and without major depressive disorder (MDD).

METHODS AND ANALYSIS

This study will adopt a between-group design. Participants will include Malaysian Malays and Caucasian Australians with and without MDD (N=320). There will be four tasks involved in this study, namely: (1) the facial emotion recognition task, (2) the biological motion task, (3) the subjective experience task and (4) the emotion meaning task. It is hypothesised that there will be cultural differences in how participants with and without MDD respond to these emotion tasks and that, pan-culturally, MDD will influence accuracy rates in the facial emotion recognition task and the biological motion task.

ETHICS AND DISSEMINATION

This study is approved by the Universiti Putra Malaysia Research Ethics Committee (JKEUPM) and the Monash University Human Research Ethics Committee (MUHREC). Permission to conduct the study has also been obtained from the National Medical Research Register (NMRR; NMRR-15-2314-26919). On completion of the study, data will be kept by Universiti Putra Malaysia for a specific period of time before they are destroyed. Data will be published in a collective manner in the form of journal articles with no reference to a specific individual.