Labelling Facial Affect in Context in Adults with and without TBI

Facial affect recognition in context in adults with and without TBI

Introduction

Several studies have reported impaired emotion recognition in adults with traumatic brain injury (TBI), but studies have two major design features that limit application of results to real-world contexts: (1) participants choose from among lists of basic emotions, rather than generating emotion labels, and (2) images are typically presented in isolation rather than in context. To address these limitations, we created an open-labeling task with faces shown alone or in real-life scenes, to more closely approximate how adults with TBI label facial emotions beyond the lab.

Methods

Participants were 55 adults (29 female) with moderate to severe TBI and 55 uninjured comparison peers, individually matched for race, sex, and age. Participants viewed 60 photographs of faces, either alone or in the pictured person's real-life context, and were asked what that person was feeling. We calculated the percent of responses that were standard forced-choice-task options, and also used sentiment intensity analysis to compare verbal responses between the two groups. We tracked eye movements for a subset of participants, to explore whether gaze duration or number of fixations helped explain any group differences in labels.

Results

Over 50% of responses in both groups were words other than basic emotions on standard affect tasks, highlighting the importance of eliciting open-ended responses. Valence of labels by participants with TBI was attenuated relative to valence of Comparison group labels, i.e., TBI group responses were less positive to positive images and the same was true for negative images, although the TBI group responses had higher lexical diversity. There were no significant differences in gaze duration or number of fixations between groups.

Discussion

Results revealed qualitative differences in affect labels between adults with and without TBI that would not have emerged on standard forced-choice tasks. Verbal differences did not appear to be attributable to differences in gaze patterns, leaving open the question of mechanisms of atypical affect processing in adults with TBI.

Emotion recognition of faces and emoji in individuals with moderate-severe traumatic brain injury

BACKGROUND

Facial emotion recognition deficits are common after moderate-severe traumatic brain injury (TBI) and linked to poor social outcomes. We examine whether emotion recognition deficits extend to facial expressions depicted by emoji.

METHODS

Fifty-one individuals with moderate-severe TBI (25 female) and fifty-one neurotypical peers (26 female) viewed photos of human faces and emoji. Participants selected the best-fitting label from a set of basic emotions (anger, disgust, fear, sadness, neutral, surprise, happy) or social emotions (embarrassed, remorseful, anxious, neutral, flirting, confident, proud).

RESULTS

We analyzed the likelihood of correctly labeling an emotion by group (neurotypical, TBI), stimulus condition (basic faces, basic emoji, social emoji), sex (female, male), and their interactions. Participants with TBI did not significantly differ from neurotypical peers in overall emotion labeling accuracy. Both groups had poorer labeling accuracy for emoji compared to faces. Participants with TBI (but not neurotypical peers) had poorer accuracy for labeling social emotions depicted by emoji compared to basic emotions depicted by emoji. There were no effects of participant sex.

DISCUSSION

Because emotion representation is more ambiguous in emoji than human faces, studying emoji use and perception in TBI is an important consideration for understanding functional communication and social participation after brain injury.

Designing evidence-based support aids for social media access for individuals with moderate-severe traumatic brain injury: A preliminary acceptability study

Background

Adults with traumatic brain injury (TBI) report significant barriers to using current social media platforms, including cognitive overload and challenges in interpreting social cues. Rehabilitation providers may be tasked with helping to address these barriers.

Objectives

To develop technological supports to increase social media accessibility for people with TBI-related cognitive impairments and to obtain preliminary data on the perceived acceptability, ease of use, and utility of proposed technology aids.

Methods

We identified four major barriers to social media use among individuals with TBI: sensory overload, memory impairments, misreading of social cues, and a lack of confidence to actively engage on social media platforms. We describe the process of developing prototypes of support aids aimed at reducing these specific social media barriers. We created mock-ups of these prototypes and asked 46 community-dwelling adults with TBI (24 females) to rate the proposed aids in terms of their acceptability, ease of use, and utility.

Results

Across all aids, nearly one-third of respondents agreed they would use the proposed aids frequently, and the majority of respondents rated the proposed aids as easy to use. Respondents indicated that they would be more likely to use the memory and post-writing aids than the attention and social cue interpretation aids.

Conclusions

Findings provide initial support for social-media-specific technology aids to support social media access and social participation for adults with TBI. Results from this study have design implications for future development of evidence-based social media support aids. Future work should develop and deploy such aids and investigate user experience.

Validation of Affective Sentences: Extending Beyond Basic Emotion Categories

We use nonverbal and verbal emotion cues to determine how others are feeling. Most studies in vocal emotion perception do not consider the influence of verbal content, using sentences with nonsense words or words that carry no emotional meaning. These online studies aimed to validate 95 sentences with verbal content intended to convey 10 emotions. Participants were asked to select the emotion that best described the emotional meaning of the sentence. Study 1 included 436 participants and Study 2 included 193. The Simpson diversity index was applied as a measure of dispersion of responses. Across the two studies, 38 sentences were labelled as representing 10 emotion categories with a low degree of diversity in participant responses. Expanding current databases beyond basic emotion categories is important for researchers exploring the interaction between tone of voice and verbal content, and/or people's capacity to make subtle distinctions between their own and others' emotions.

Social cognition in patients with acquired brain lesions: An overview on an under-reported problem

Social cognition (SC) consists of mental representations of interpersonal relationships, which are used flexibly by the individual to promote functional social behaviors and achieve the goals. SC is a multidimensional construct and is supported by the activity of distributed neural networks in which different cortical and subcortical regions of the brain are involved. The review aims to evaluate the current literature on SC taking into account how it is compromised in acquired brain injury. Studies performed between 2010 and 2019 and fulfilling the selected criteria were searched on PubMed, Scopus, Cochrane and Web of Sciences databases. Impairment of SC is a neglected but common consequence of ABI, often leading to disordered interpersonal functioning and poor regulation of personal behavior with impaired social adaptation and quality of life of both the patient and his/her family. This review supports the idea that SC could have an important role in the management of neurological patients by both clinicians and caregivers.

Do executive function and theory of mind predict pragmatic abilities following traumatic brain injury? An analysis of sincere, deceitful and ironic communicative acts

Quality of life and social integration are strongly influenced by the ability to communicate and previous research has shown that pragmatic ability can be specifically impaired in individuals with traumatic brain injury (TBI). In addition, TBI usually results in damage to the frontotemporal lobes with a consequent impairment of cognitive functions, i.e., attention, memory, executive function (EF) and theory of mind (ToM). The role of the underlying cognitive deficits in determining the communicative-pragmatic difficulties of an individual with TBI is not yet completely clear. This study examined the relationship between the ability to understand and produce various kinds of communicative acts, (i.e., sincere, deceitful and ironic) and the above-mentioned cognitive and ToM abilities following TBI. Thirty-five individuals with TBI and thirty-five healthy controls were given tasks assessing their ability to comprehend and produce sincere, deceitful and ironic communicative acts belonging to the linguistic and extralinguistic scales of the Assessment Battery for Communication (ABaCo), together with a series of EF and ToM tasks. The results showed that, when compared to healthy individuals, participants with TBI performed poorly overall in the comprehension and production of all the pragmatic phenomena investigated, (i.e., sincere, deceitful and ironic communicative acts), and they also exhibited impaired performance at the level of all the cognitive functions examined. Individuals with TBI also showed a decreasing trend in performance in dealing with sincere, deceitful and ironic communicative acts, on both the comprehension and production subscales of the linguistic and extralinguistic scales. Furthermore, a hierarchical regression analysis revealed that - in patients with TBI but not in the controls - EF had a significant effect on the comprehension of linguistic and extralinguistic irony only, while the percentage of explained variance increased with the inclusion of theory of mind. Indeed, ToM had a significant role in determining patients' performance in the extralinguistic production of sincere and deceitful communicative acts, linguistic and extralinguistic comprehension of deceit and the linguistic production of irony. However, with regard to the performance of patients with TBI in the various pragmatic tasks investigated, (i.e., sincere, deceitful and ironic communicative acts), EF was able to explain the pattern of patients' scores in the linguistic and extralinguistic comprehension but not in production ability. Furthermore, ToM seemed not to be able to explain the decreasing trend in the performance of patients in managing the various kinds of communicative acts investigated.

Different aspects of facial affect recognition impairment following traumatic brain injury: The role of perceptual and interpretative abilities

It is well established that many individuals with traumatic brain injury (TBI) are impaired at facial affect recognition, yet little is known about the mechanisms underlying such deficits. In particular, little work has examined whether the breakdown of facial affect recognition abilities occurs at the perceptual level (e.g., recognizing a smile) or at the verbal categorization stage (e.g., assigning the label "happy" to a smiling face). The aim of the current study was to investigate the integrity of these two distinct facial affect recognition subskills in a sample of 38 individuals with moderate-to-severe TBI and 24 demographically matched healthy individuals. Participants were administered an affect matching (perceptual skills) and an affect labeling (verbal categorization skills) task. Statistical analyses revealed that, while individuals with TBI showed significantly higher levels of impairment in the verbal categorization task than in the perceptual task, they performed less well than healthy comparison participants on both tasks. These findings indicate that facial affect recognition impairment can occur at different cognitive stages following TBI, suggesting the necessity of careful screening to offer targeted treatment. Moreover, they provide further neuropsychological evidence supporting the notion that distinct types of subskills are necessary to achieve successful recognition of facial affects.

What's New in the Clinical Management of Disorders of Social Cognition?

Social cognition refers to the ability to use social cues to infer the meaning and intentions behind the behaviour of others in order to respond in a socially adaptive manner. It is increasingly recognised that disorders of social cognition, including problems with emotion perception, theory of mind, conversational inference, morality judgements, decision making and social inhibition, characterise many developmental and psychiatric disorders and are highly relevant to many with acquired brain injuries or diseases, especially the frontotemporal dementias. This review provides an introduction and overview of the papers in this special edition on social cognition and places these in the context of other recent research. In doing so, several current issues in the clinical management of social cognition are delineated. Given that social cognition seems to be a sensitive predictor of psychosocial function, the assessment of social cognition is seen by many clinicians to be important although which profession is responsible is yet to be resolved. Issues in how social cognition are assessed are discussed, including the importance of context to social cognition, its interactive nature and the need to recognise influences such as family upbringing, gender and emotional state on social cognitive performance. There also needs to be development of tests that address all aspects of social cognition, including decision making and inhibition. Finally, this review discusses intervention research. Interventions are especially well developed in relation to schizophrenia, and less well developed in brain injury. These appear to be generally effective although treatments for emotional self-awareness are yet to be developed.