Multimodal emotion integration in bipolar disorder: an investigation of involuntary cross-modal influences between facial and prosodic channels

Cognition in Bipolar Disorder: An Update for Clinicians

Bipolar disorder is associated with cognitive deficits, which persist across mood states and affect functional outcomes. This article provides an overview of recent progress in measuring cognition in bipolar disorder and its implications for both research and clinical practice. The authors summarize work conducted over the past decade that has helped guide researchers and clinicians in the appropriate measurement of cognitive functioning in bipolar disorder, the design of research studies targeting this domain for treatment, and the implementation of screening and psychoeducational tools in the clinic. Much of this work was conducted by the International Society for Bipolar Disorders Targeting Cognition Task Force. Here, the authors also highlight the need for clinicians to be informed about this aspect of illness and to be equipped with the necessary information to assess, track, and intervene on cognitive problems when appropriate. Finally, the article identifies gaps in the literature and suggests potential future directions for research in this area.

Characterisation of Deficits and Sex Differences in Verbal and Visual Memory/Learning in Bipolar Disorder

OBJECTIVE

Cognitive impairment is consistently reported in bipolar disorder (BD), but few studies have characterised which memory component processes are affected. Further, it is unknown whether the component processes underlying memory impairment are moderated by sex. The present study examined diagnosis and sex differences in both verbal and visual memory/learning domains in patients with BD and psychiatrically healthy controls.

METHOD

Verbal and visual memory/learning were measured using the Hopkins Verbal Learning Test-Revised (HVLT-R) and Brief Visuospatial Memory Test-Revised (BVMT-R). 114 patients with BD (n = 50 males, n = 64 females), were compared to 105 psychiatrically healthy controls (n = 42 males, n = 63 females).

RESULTS

Patients with BD had worse performance in verbal and visual immediate and total recall, verbal and visual delayed free recall, and verbal recognition discrimination scores, but there were no group differences in learning slopes and cumulative learning index scores. There were trends for BD females to outperform BD males in visual memory/learning free recall and cumulative learning, but these results did not survive multiple testing correction. These findings did not change in a secondary sensitivity analysis comparing only strictly euthymic BD patients to controls (n = 64).

CONCLUSION

The present study found trait-like verbal and visual memory/learning impairment in BD that was attributable to deficient encoding and/or consolidation processes rather than deficits in learning. We did not find marked sex differences in either visual or verbal memory/learning measures, although some trend level effects were apparent and deserve exploration in future studies.

Recognition of affective prosody in bipolar and depressive conditions: A systematic review and meta-analysis

BACKGROUND

Inconsistent results have been reported about the affective prosody recognition (APR) ability in patients with bipolar (BD) and depressive (DD) disorders. We aimed to (i) evaluate the magnitude of APR dysfunction in BD and DD patients, (ii) identify moderators for heterogeneous results, and (iii) highlight research trends in this field.

METHODS

A computerized literature search was conducted in five electronic databases from the inception to May 9th, 2022 to identify behavioural experiments that studied APR in BD or DD patients. Effect sizes were calculated using a random-effect model and recalculated after removing outliers and adjusting publication bias.

RESULTS

Twelve eligible articles totalling 16 studies were included in the meta-analysis, aggregating 612 patients and 809 healthy controls. Individual r² ranged from 0.008 to 0.355, six of which reached a medium-to-large association strength. A medium-to-large pooled effect size (Hedges g = -0.58, 95 % CI -0.75 to -0.40, p < 0.001) for overall APR impairment in BD and DD patients was obtained. The Beck Depression Inventory score and answer option number were significant moderators. Neuropsychological mechanisms, multi-modal interaction and comorbidity effects have become primary research concerns.

LIMITATIONS

Extant statistics were insufficient for disorder-specific analysis.

CONCLUSIONS

Current findings demonstrate deficits of overall APR in BD and DD patients at a medium-to-large magnitude. APR can clinically serve for early screening and prognosis, but the depression severity, task complexity and confounding variables influence patients' APR performance. Future studies should incorporate neuroimaging approaches and investigate the effects of tonal language stimuli and clinical interventions.

Negative bias effects during audiovisual emotional processing in major depression disorder

Aberrant affective neural processing and negative emotional bias are trait‐marks of major depression disorders (MDDs). However, most research on biased emotional perception in depression has only focused on unimodal experimental stimuli, the neural basis of potentially biased emotional processing of multimodal inputs remains unclear. Here, we addressed this issue by implementing an audiovisual emotional task during functional MRI scanning sessions with 37 patients with MDD and 37 gender‐, age‐ and education‐matched healthy controls. Participants were asked to distinguish laughing and crying sounds while being exposed to faces with different emotional valences as background. We combined general linear model and psychophysiological interaction analyses to identify abnormal local functional activity and integrative processes during audiovisual emotional processing in MDD patients. At the local neural level, MDD patients showed increased bias activity in the ventromedial prefrontal cortex (vmPFC) while listening to negative auditory stimuli and concurrently processing visual facial expressions, along with decreased dorsolateral prefrontal cortex (dlPFC) activity in both the positive and negative visual facial conditions. At the network level, MDD exhibited significantly decreased connectivity in areas involved in automatic emotional processes and voluntary control systems during perception of negative stimuli, including the vmPFC, dlPFC, insula, as well as the subcortical regions of posterior cingulate cortex and striatum. These findings support a multimodal emotion dysregulation hypothesis for MDD by demonstrating that negative bias effects may be facilitated by the excessive ventral bottom‐up negative emotional influences along with incapability in dorsal prefrontal top‐down control system.

Integrating Multilevel Functional Characteristics Reveals Aberrant Neural Patterns during Audiovisual Emotional Processing in Depression

Emotion dysregulation is one of the core features of major depressive disorder (MDD). However, most studies in depression have focused on unimodal emotion processing, whereas emotional perception in daily life is highly dependent on multimodal sensory inputs. Here, we proposed a novel multilevel discriminative framework to identify the altered neural patterns in processing audiovisual emotion in MDD. Seventy-four participants underwent an audiovisual emotional task functional magnetic resonance imaging scanning. Three levels of whole-brain functional features were extracted for each subject, including the task-evoked activation, task-modulated connectivity, combined activation and connectivity. Support vector machine classification and prediction models were built to identify MDD from controls and evaluate clinical relevance. We revealed that complex neural networks including the emotion regulation network (prefrontal areas and limbic-subcortical regions) and the multisensory integration network (lateral temporal cortex and motor areas) had the discriminative power. Moreover, by integrating comprehensive information of local and interactive processes, multilevel models could lead to a substantial increase in classification accuracy and depression severity prediction. Together, we highlight the high representational capacity of machine learning algorithms to characterize the complex network abnormalities associated with emotional regulation and multisensory integration in MDD. These findings provide novel evidence for the neural mechanisms underlying multimodal emotion dysregulation of depression.

Crossmodal Audiovisual Emotional Integration in Depression: An Event-Related Potential Study

Depression is related to the defect of emotion processing, and people's emotional processing is crossmodal. This article aims to investigate whether there is a difference in audiovisual emotional integration between the depression group and the normal group using a high-resolution event-related potential (ERP) technique. We designed a visual and/or auditory detection task. The behavioral results showed that the responses to bimodal audiovisual stimuli were faster than those to unimodal auditory or visual stimuli, indicating that crossmodal integration of emotional information occurred in both the depression and normal groups. The ERP results showed that the N2 amplitude induced by sadness was significantly higher than that induced by happiness. The participants in the depression group showed larger amplitudes of N1 and P2, and the average amplitude of LPP evoked in the frontocentral lobe in the depression group was significantly lower than that in the normal group. The results indicated that there are different audiovisual emotional processing mechanisms between depressed and non-depressed college students.

Multisensory Integration of Emotion in Schizophrenic Patients

Multisensory integration (MSI) of emotion has been increasingly recognized as an essential element of schizophrenic patients' impairments, leading to the breakdown of their interpersonal functioning. The present review provides an updated synopsis of schizophrenics' MSI abilities in emotion processing by examining relevant behavioral and neurological research. Existing behavioral studies have adopted well-established experimental paradigms to investigate how participants understand multisensory emotion stimuli, and interpret their reciprocal interactions. Yet it remains controversial with regard to congruence-induced facilitation effects, modality dominance effects, and generalized vs specific impairment hypotheses. Such inconsistencies are likely due to differences and variations in experimental manipulations, participants' clinical symptomatology, and cognitive abilities. Recent electrophysiological and neuroimaging research has revealed aberrant indices in event-related potential (ERP) and brain activation patterns, further suggesting impaired temporal processing and dysfunctional brain regions, connectivity and circuities at different stages of MSI in emotion processing. The limitations of existing studies and implications for future MSI work are discussed in light of research designs and techniques, study samples and stimuli, and clinical applications.

Affective cognition in bipolar disorder: A systematic review by the ISBD targeting cognition task force

BACKGROUND

Impairments in affective cognition are part of the neurocognitive profile and possible treatment targets in bipolar disorder (BD), but the findings are heterogeneous. The International Society of Bipolar Disorder (ISBD) Targeting Cognition Task Force conducted a systematic review to (i) identify the most consistent findings in affective cognition in BD, and (ii) provide suggestions for affective cognitive domains for future study and meta-analyses.

METHODS

The review included original studies reporting behavioral measures of affective cognition in BD patients vs controls following the procedures of the Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) statement. Searches were conducted on PubMed/MEDLINE, EMBASE, and PsychInfo from inception until November 2018.

RESULTS

A total of 106 articles were included (of which nine included data for several affective domains); 41 studies assessed emotional face processing; 23 studies investigated reactivity to emotional words and images; 3 investigated explicit emotion regulation; 17 assessed implicit emotion regulation; 31 assessed reward processing and affective decision making. In general, findings were inconsistent. The most consistent findings were trait-related difficulties in facial emotion recognition and implicit emotion regulation, and impairments in reward processing and affective decision making during mood episodes. Studies using eye-tracking and facial emotion analysis revealed subtle trait-related abnormalities in emotional reactivity.

CONCLUSION

The ISBD Task Force recommends facial expression recognition, implicit emotion regulation, and reward processing as domains for future research and meta-analyses. An important step to aid comparability between studies in the field would be to reach consensus on an affective cognition test battery for BD.

Taking It at "Face Value": The Use of Face Processing Strategies in Bipolar Disorder and Schizophrenia

OBJECTIVES

Use of appropriate face processing strategies is important for facial emotion recognition, which is known to be impaired in schizophrenia (SZ) and bipolar disorder (BD). There is preliminary evidence of abnormalities in the use of face processing strategies in the former, but there has been no explicit attempt to assess face processing in patients with BD.

METHODS

Twenty-eight BD I, 28 SZ, and 28 healthy control participants completed tasks assessing featural and configural face processing. The facial inversion effect was used as a proxy of second order configural face processing and compared to featural face processing performance (which is known to be relatively less affected by facial inversion).

RESULTS

Controls demonstrated the usual second-order inversion pattern. In the BD group, the absence of a second-order configural inversion effect in the presence of a disproportionate bias toward a featural inversion effect was evident. Despite reduced accuracy performance in the SZ group compared to controls, this group unexpectedly showed a normal second-order configural accuracy inversion pattern. This was in the context of a reverse inversion effect for response latency, suggesting a speed-versus-accuracy trade-off.

CONCLUSIONS

To our knowledge, this is the first study to explicitly examine and contrast face processing in BD and SZ. Our findings indicate a generalized impairment on face processing tasks in SZ, and the presence of a second-order configural face processing impairment in BD. It is possible that these face processing impairments represent a catalyst for the facial emotion recognition deficits that are commonly reported in the literature. (JINS, 2016, 22, 652-661).

Emotional Meaning in Context in Relation to Hypomanic Personality Traits: An ERP Study

The ability to integrate contextual information is important for the comprehension of emotional and social situations. While some studies have shown that emotional processes and social cognition are impaired in people with hypomanic personality trait, no results have been reported concerning the neurophysiological processes mediating the processing of emotional information during the integration of contextual social information in this population. We therefore chose to conduct an ERP study dealing with the integration of emotional information in a population with hypomanic personality trait. Healthy participants were evaluated using the Hypomanic Personality Scale (HPS), and ERPs were recorded during a linguistic task in which participants silently read sentence pairs describing short social situations. The first sentence implicitly conveyed the positive or negative emotional state of a character. The second sentence was emotionally congruent or incongruent with the first sentence. We analyzed the difference in the modulation of two components (N400 and LPC) in response to the emotional word present at the end of the “target” sentences as a function of the HPS score and the emotional valence of the context. Our results showed a possible modulation of the N400 component in response to both positive and negative context among the participants who scored high on the Mood Volatility subscale of the Hypomanic Personality Scale. These results seem to indicate that the participants with hypomanic personality traits exhibited specificities in the integration of emotions at the level of the early-mobilized neurocognitive processes (N400). Participants with hypomanic personality traits found it difficult to integrate negative emotional contexts, while simultaneously exhibiting an enhanced integration of positive emotional contexts.

Emotion regulation in bipolar disorder: profile and utility in predicting trait mania and depression propensity

Current emotion regulation research in BD has tended to focus on the extent to which patients control their emotions using different cognitive strategies. Fewer studies have investigated whether patients with BD have difficulties in regulating other dimensions of emotion that serve a functional purpose and are thereby more amenable to change. To overcome this paucity of research we utilised a multi-dimensional measure of emotion regulation to characterise the emotion regulation profile of BD, and examine its utility in predicting trait mania and depression propensity. Fifty BD patients and 52 healthy controls completed the Difficulties in Emotion Regulation Scale (DERS) and the General Behaviour Inventory (GBI). Results indicated that patients had difficulties in emotion regulation across a range of dimensions. Impulse control difficulties most parsimoniously predicted trait (hypo)mania propensity in BD patients, whilst poor access to mood regulation strategies predicted depressive propensity. Predictors of the propensity to experience these moods differed in the control group. These findings represent an important step toward informing the development of new treatment strategies to remediate emotion regulation difficulties and improve BD symptomatology.

Investigating facial affect processing in psychosis: a study using the Comprehensive Affective Testing System

Facial affect processing (FAP) deficits in schizophrenia (SZ) and bipolar disorder (BD) have been widely reported; although effect sizes vary across studies, and there are limited direct comparisons of the two groups. Further, there is debate as to the influence of both psychotic and mood symptoms on FAP. This study aimed to address these limitations by recruiting groups of psychosis patients with either a diagnosis of SZ or BD and comparing them to healthy controls (HC) on a well validated battery of four FAP subtests: affect discrimination, name affect, select affect and match affect. Overall, both groups performed more poorly than controls in terms of accuracy. In SZ, this was largely driven by impairments on three of the four subtests. The BD patients showed impaired performance specifically on the match affect subtest, a task that had a high cognitive load. FAP performance in the psychosis patients was correlated with severity of positive symptoms and mania. This study confirmed that FAP deficits are a consistent finding in SZ that occur independent of task specific methodology; whilst FAP deficits in BD are more subtle. Further work in this group is needed to replicate these results.