Increased subjective experience of non-target emotions in patients with frontotemporal dementia and Alzheimer's disease

Emotion expressions and cognitive impairments in the elderly: review of the contactless detection approach

The aging population in Canada has been increasing continuously throughout the past decades. Amongst this demographic, around 11% suffer from some form of cognitive decline. While diagnosis through traditional means (i.e., Magnetic Resonance Imagings (MRIs), positron emission tomography (PET) scans, cognitive assessments, etc.) has been successful at detecting this decline, there remains unexplored measures of cognitive health that could reduce stress and cost for the elderly population, including approaches for early detection and preventive methods. Such efforts could additionally contribute to reducing the pressure and stress on the Canadian healthcare system, as well as improve the quality of life of the elderly population. Previous evidence has demonstrated emotional facial expressions being altered in individuals with various cognitive conditions such as dementias, mild cognitive impairment, and geriatric depression. This review highlights the commonalities among these cognitive health conditions, and research behind the contactless assessment methods to monitor the health and cognitive well-being of the elderly population through emotion expression. The contactless detection approach covered by this review includes automated facial expression analysis (AFEA), electroencephalogram (EEG) technologies and heart rate variability (HRV). In conclusion, a discussion of the potentials of the existing technologies and future direction of a novel assessment design through fusion of AFEA, EEG and HRV measures to increase detection of cognitive decline in a contactless and remote manner will be presented.

Quantifying abnormal emotion processing: A novel computational assessment method and application in schizophrenia

Abnormal emotion processing is a core feature of schizophrenia spectrum disorders (SSDs) that encompasses multiple operations. While deficits in some areas have been well-characterized, we understand less about abnormalities in the emotion processing that happens through language, which is highly relevant for social life. Here, we introduce a novel method using deep learning to estimate emotion processing rapidly from spoken language, testing this approach in male-identified patients with SSDs (n = 37) and healthy controls (n = 51). Using free responses to evocative stimuli, we derived a measure of appropriateness, or "emotional alignment" (EA). We examined psychometric characteristics of EA and its sensitivity to a single-dose challenge of oxytocin, a neuropeptide shown to enhance the salience of socioemotional information in SSDs. Patients showed impaired EA relative to controls, and impairment correlated with poorer social cognitive skill and more severe motivation and pleasure deficits. Adding EA to a logistic regression model with language-based measures of formal thought disorder (FTD) improved classification of patients versus controls. Lastly, oxytocin administration improved EA but not FTD among patients. While additional validation work is needed, these initial results suggest that an automated assay using spoken language may be a promising approach to assess emotion processing in SSDs.

Diagnosis Framework for Probable Alzheimer's Disease and Mild Cognitive Impairment Based on Multi-Dimensional Emotion Features

BACKGROUND

Emotion and cognition are intercorrelated. Impaired emotion is common in populations with Alzheimer's disease (AD) and mild cognitive impairment (MCI), showing promises as an early detection approach.

OBJECTIVE

We aim to develop a novel automatic classification tool based on emotion features and machine learning.

METHODS

Older adults aged 60 years or over were recruited among residents in the long-term care facilities and the community. Participants included healthy control participants with normal cognition (HC, n = 26), patients with MCI (n = 23), and patients with probable AD (n = 30). Participants watched emotional film clips while multi-dimensional emotion data were collected, including mental features of Self-Assessment Manikin (SAM), physiological features of electrodermal activity (EDA), and facial expressions. Emotional features of EDA and facial expression were abstracted by using continuous decomposition analysis and EomNet, respectively. Bidirectional long short-term memory (Bi-LSTM) was used to train classification model. Hybrid fusion was used, including early feature fusion and late decision fusion. Data from 79 participants were utilized into deep machine learning analysis and hybrid fusion method.

RESULTS

By combining multiple emotion features, the model's performance of AUC value was highest in classification between HC and probable AD (AUC = 0.92), intermediate between MCI and probable AD (AUC = 0.88), and lowest between HC and MCI (AUC = 0.82).

CONCLUSIONS

Our method demonstrated an excellent predictive power to differentiate HC/MCI/AD by fusion of multiple emotion features. The proposed model provides a cost-effective and automated method that can assist in detecting probable AD and MCI from normal aging.

Diagnostic Efficacy and Clinical Relevance of Artificial Intelligence in Detecting Cognitive Decline

Cognitive impairment is an age-associated disorder of increasing prevalence as the aging population continues to grow. Classified based on the level of cognitive decline, memory, function, and capacity to conduct activities of daily living, cognitive impairment ranges from mild cognitive impairment to dementia. When considering the insidious nature of the etiologies responsible for varying degrees of cognitive impairment, early diagnosis may provide a clinical benefit through the facilitation of early treatment. Typical diagnosis relies heavily on evaluation in a primary care setting. However, there is evidence that other diagnostic tools may aid in an earlier diagnosis of the different underlying pathologies responsible for cognitive impairment. Artificial intelligence represents a new intersecting field with healthcare that may aid in the early detection of neurodegenerative disorders. When assessing the role of AI in detecting cognitive decline, it is important to consider both the diagnostic efficacy of AI algorithms and the clinical relevance and impact of early interventions as a result of early detection. Thus, this review highlights promising investigations and developments in the space of artificial intelligence and healthcare and their potential to impact patient outcomes.

Alterations in facial expressions in individuals at risk for psychosis: a facial electromyography approach using emotionally evocative film clips

BACKGROUND

Negative symptoms such as blunted facial expressivity are characteristic of schizophrenia. However, it is not well-understood if and what abnormalities are present in individuals at clinical high-risk (CHR) for psychosis.

METHODS

This experimental study employed facial electromyography (left zygomaticus major and left corrugator supercilia) in a sample of CHR individuals (N = 34) and healthy controls (N = 32) to detect alterations in facial expressions in response to emotionally evocative film clips and to determine links with symptoms.

RESULTS

Findings revealed that the CHR group showed facial blunting manifested in reduced zygomatic activity in response to an excitement (but not amusement, fear, or sadness) film clip compared to controls. Reductions in zygomatic activity in the CHR group emerged in response to the emotionally evocative peak period of the excitement film clip. Lower zygomaticus activity during the excitement clip was related to anxiety while lower rates of change in zygomatic activity during the excitement video clip were related to higher psychosis risk conversion scores.

CONCLUSIONS

Together, these findings inform vulnerability/disease driving mechanisms and biomarker and treatment development.

Beyond shallow feelings of complex affect: Non-motor correlates of subjective emotional experience in Parkinson's disease

Affective disorders in Parkinson's disease (PD) concern several components of emotion. However, research on subjective feeling in PD is scarce and has produced overall varying results. Therefore, in this study, we aimed to evaluate the subjective emotional experience and its relationship with autonomic symptoms and other non-motor features in PD patients. We used a battery of film excerpts to elicit Amusement, Anger, Disgust, Fear, Sadness, Tenderness, and Neutral State, in 28 PD patients and 17 healthy controls. Self-report scores of emotion category, intensity, and valence were analyzed. In the PD group, we explored the association between emotional self-reported scores and clinical scales assessing autonomic dysregulation, depression, REM sleep behavior disorder, and cognitive impairment. Patient clustering was assessed by considering relevant associations. Tenderness occurrence and intensity of Tenderness and Amusement were reduced in the PD patients. Tenderness occurrence was mainly associated with the overall cognitive status and the prevalence of gastrointestinal symptoms. In contrast, the intensity and valence reported for the experience of Amusement correlated with the prevalence of urinary symptoms. We identified five patient clusters, which differed significantly in their profile of non-motor symptoms and subjective feeling. Our findings further suggest the possible existence of a PD phenotype with more significant changes in subjective emotional experience. We concluded that the subjective experience of complex emotions is impaired in PD. Non-motor feature grouping suggests the existence of disease phenotypes profiled according to specific deficits in subjective emotional experience, with potential clinical implications for the adoption of precision medicine in PD. Further research on larger sample sizes, combining subjective and physiological measures of emotion with additional clinical features, is needed to extend our findings.

Incongruences Between Facial Expression and Self-Reported Emotional Reactivity in Frontotemporal Dementia and Related Disorders

OBJECTIVE

Emotional reactivity normally involves a synchronized coordination of subjective experience and facial expression. These aspects of emotional reactivity can be uncoupled by neurological illness and produce adverse consequences for patient and caregiver quality of life because of misunderstandings regarding the patient's presumed internal state. Frontotemporal dementia (FTD) is often associated with altered social and emotional functioning. FTD is a heterogeneous disease, and socioemotional changes in patients could result from altered internal experience, altered facial expressive ability, altered language skills, or other factors. The authors investigated how individuals with FTD subtypes differ from a healthy control group regarding the extent to which their facial expressivity aligns with their self-reported emotional experience.

METHODS

Using a compound measure of emotional reactivity to assess reactions to three emotionally provocative videos, the authors explored potential explanations for differences in alignment of facial expressivity with emotional experience, including parkinsonism, physiological reactivity, and nontarget verbal responses.

RESULTS

Participants with the three main subtypes of FTD all tended to express less emotion on their faces than they did through self-report.

CONCLUSIONS

Exploratory analyses suggest that reasons for this incongruence likely differ not only between but also within diagnostic subgroups.

Diminished preparatory physiological responses in frontotemporal lobar degeneration syndromes

Researchers typically study physiological responses either after stimulus onset or when the emotional valence of an upcoming stimulus is revealed. Yet, participants may also respond when they are told that an emotional stimulus is about to be presented even without knowing its valence. Increased physiological responding during this time may reflect a 'preparation for action'. The generation of such physiological responses may be supported by frontotemporal regions of the brain that are vulnerable to damage in frontotemporal lobar degeneration. We examined preparatory physiological responses and their structural and functional neural correlate in five frontotemporal lobar degeneration clinical subtypes (behavioural variant frontotemporal dementia, n = 67; semantic variant primary progressive aphasia, n = 35; non-fluent variant primary progressive aphasia, n = 30; corticobasal syndrome, n = 32; progressive supranuclear palsy, n = 30). Comparison groups included patients with Alzheimer's disease (n = 56) and healthy controls (n = 35). Preparatory responses were quantified as cardiac interbeat interval decreases (i.e. heart rate increases) from baseline to an 'instruction period', during which participants were told to watch the upcoming emotional film but not provided the film's valence. Patients' behavioural symptoms (apathy and disinhibition) were also evaluated via a caregiver-reported measure. Compared to healthy controls and Alzheimer's disease, the frontotemporal lobar degeneration group showed significantly smaller preparatory responses. When comparing each frontotemporal lobar degeneration clinical subtype with healthy controls and Alzheimer's disease, significant group differences emerged for behavioural variant frontotemporal dementia and progressive supranuclear palsy. Behavioural analyses revealed that frontotemporal lobar degeneration patients showed greater disinhibition and apathy compared to Alzheimer's disease patients. Further, these group differences in disinhibition (but not apathy) were mediated by patients' smaller preparatory responses. Voxel-based morphometry and resting-state functional MRI analyses revealed that across patients and healthy controls, smaller preparatory responses were associated with smaller volume and lower functional connectivity in a circuit that included the ventromedial prefrontal cortex and cortical and subcortical regions of the salience network. Diminished preparatory physiological responding in frontotemporal lobar degeneration may reflect a lack of preparation for actions that are appropriate for an upcoming situation, such as approaching or withdrawing from emotional stimuli. The ventromedial prefrontal cortex and salience network are critical for evaluating stimuli, thinking about the future, triggering peripheral physiological responses, and processing and interpreting interoceptive signals. Damage to these circuits in frontotemporal lobar degeneration may impair preparatory responses and help explain often-observed clinical symptoms such as disinhibition in these patients.

Automated analysis of facial emotions in subjects with cognitive impairment

Differences in expressing facial emotions are broadly observed in people with cognitive impairment. However, these differences have been difficult to objectively quantify and systematically evaluate among people with cognitive impairment across disease etiologies and severity. Therefore, a computer vision-based deep learning model for facial emotion recognition trained on 400.000 faces was utilized to analyze facial emotions expressed during a passive viewing memory test. In addition, this study was conducted on a large number of individuals (n = 493), including healthy controls and individuals with cognitive impairment due to diverse underlying etiologies and across different disease stages. Diagnoses included subjective cognitive impairment, Mild Cognitive Impairment (MCI) due to AD, MCI due to other etiologies, dementia due to Alzheimer's diseases (AD), and dementia due to other etiologies (e.g., Vascular Dementia, Frontotemporal Dementia, Lewy Body Dementia, etc.). The Montreal Cognitive Assessment (MoCA) was used to evaluate cognitive performance across all participants. A participant with a score of less than or equal to 24 was considered cognitively impaired (CI). Compared to cognitively unimpaired (CU) participants, CI participants expressed significantly less positive emotions, more negative emotions, and higher facial expressiveness during the test. In addition, classification analysis revealed that facial emotions expressed during the test allowed effective differentiation of CI from CU participants, largely independent of sex, race, age, education level, mood, and eye movements (derived from an eye-tracking-based digital biomarker for cognitive impairment). No screening methods reliably differentiated the underlying etiology of the cognitive impairment. The findings provide quantitative and comprehensive evidence that the expression of facial emotions is significantly different in people with cognitive impairment, and suggests this may be a useful tool for passive screening of cognitive impairment.

Emotional and Cognitive Empathy in Caregivers of Persons with Neurodegenerative Disease: Relationships with Caregiver Mental Health

Caregiving for a person with dementia or neurodegenerative disease (PWD) is associated with increased rates of depression and anxiety. As the population ages and dementia prevalence increases worldwide, mental health problems related to dementia caregiving will become an even more pressing public health concern. The present study assessed emotional empathy (physiological, behavioral, and self-reported emotional responses to a film depicting others suffering) and two measures of cognitive empathy (identifying the primary emotion experienced by another person; providing continuous ratings of the valence of another person's changing emotions) in relation to mental health (standard questionnaires) in 78 caregivers of PWDs. Greater emotional empathy (self-reported emotional responses) was associated with worse mental health, even after accounting for known risk factors. Neither measure of cognitive empathy was associated with mental health. A relationship between high levels of emotional empathy and poor mental health in caregivers suggests possible risk indicators and intervention targets.

The thermodynamics of cognition: A mathematical treatment

There is a general expectation that the laws of classical physics must apply to biology, particularly the neural system. The evoked cycle represents the brain's energy/information exchange with the physical environment through stimulus. Therefore, the thermodynamics of emotions might elucidate the neurological origin of intellectual evolution, and explain the psychological and health consequences of positive and negative emotional states based on their energy profiles. We utilized the Carnot cycle and Landauer's principle to analyze the energetic consequences of the brain's resting and evoked states during and after various cognitive states. Namely, positive emotional states can be represented by the reversed Carnot cycle, whereas negative emotional reactions trigger the Carnot cycle. The two conditions have contrasting energetic and entropic aftereffects with consequences for mental energy. The mathematics of the Carnot and reversed Carnot cycles, which can explain recent findings in human psychology, might be constructive in the scientific endeavor in turning psychology into hard science.

Smaller Volume in Left-Lateralized Brain Structures Correlates with Greater Experience of Negative Non-target Emotions in Neurodegenerative Diseases

Subjective emotional experience that is congruent with a given situation (i.e., target emotions) is critical for human survival (e.g., feeling disgusted in response to contaminated food motivates withdrawal behaviors). Neurodegenerative diseases including frontotemporal dementia and Alzheimer's disease affect brain regions critical for cognitive and emotional functioning, resulting in increased experience of emotions incongruent with the situation (i.e., non-target emotions, such as feeling happy when seeing someone grieving). We examined neuroanatomical correlates of subjective experience of non-target emotions in 147 patients with neurodegenerative diseases and 26 healthy individuals. Participants watched three films intended to elicit particular target emotions and rated their experience of negative and positive target and non-target emotions after watching each film. We found that smaller volume in left hemisphere regions (e.g., caudate, putamen, and dorsal anterior insula) was associated with greater experience of negative non-target emotions. Follow-up analyses confirmed that these effects were left-lateralized. No correlates emerged for positive non-target emotions. These findings suggest that volume loss in left-hemisphere regions produces a more diffuse, incongruent experience of non-target emotions. These findings provide a potential neuroanatomical basis for understanding how subjective emotional experience is constructed in the brain and how this can be disrupted in neurodegenerative disease.

The thermodynamic brain and the evolution of intellect: the role of mental energy

The living state is low entropy, highly complex organization, yet it is part of the energy cycle of the environment. Due to the recurring presence of the resting state, stimulus and its response form a thermodynamic cycle of perception that can be modeled by the Carnot engine. The endothermic reversed Carnot engine relies on energy from the environment to increase entropy (i.e., the synaptic complexity of the resting state). High entropy relies on mental energy, which represents intrinsic motivation and focuses on the future. It increases freedom of action. The Carnot engine can model exothermic, negative emotional states, which direct the focus on the past. The organism dumps entropy and energy to its environment, in the form of aggravation, anxiety, criticism, and physical violence. The loss of mental energy curtails freedom of action, forming apathy, depression, mental diseases, and immune problems. Our improving intuition about the brain's intelligent computations will allow the development of new treatments for mental disease and novel find applications in robotics and artificial intelligence.

Physiological, behavioral and subjective sadness reactivity in frontotemporal dementia subtypes

Frontotemporal dementia (FTD), a neurodegenerative disease broadly characterized by socioemotional impairments, includes three clinical subtypes: behavioral variant FTD (bvFTD), semantic variant primary progressive aphasia (svPPA) and non-fluent variant primary progressive aphasia (nfvPPA). Emerging evidence has shown emotional reactivity impairments in bvFTD and svPPA, whereas emotional reactivity in nfvPPA is far less studied. In 105 patients with FTD (49 bvFTD, 31 svPPA and 25 nfvPPA) and 27 healthy controls, we examined three aspects of emotional reactivity (physiology, facial behavior and subjective experience) in response to a sad film. In a subset of the sample, we also examined the neural correlates of diminished aspects of reactivity using voxel-based morphometry. Results indicated that all three subtypes of FTD showed diminished physiological responding in respiration rate and diastolic blood pressure; patients with bvFTD and svPPA also showed diminished subjective experience, and no subtypes showed diminished facial behavior. Moreover, there were differences among the clinical subtypes in brain regions where smaller volumes were associated with diminished sadness reactivity. These results show that emotion impairments extend to sadness reactivity in FTD and underscore the importance of considering different aspects of sadness reactivity in multiple clinical subtypes for characterizing emotional deficits and associated neurodegeneration in FTD.

Stress and Illness: A Role for Specific Emotions

Research on stress and disease has often afforded an important role to emotion, typically conceptualized in broad categories (e.g., negative emotions), viewed as playing a causal role (e.g., anger contributing to pathophysiology of cardiovascular disease), and measured using self-report inventories. In this article, I argue for the value of evaluating specific emotions, considering bidirectional causal influences, and assessing actual emotional responding when considering the role that emotions play in the stress-disease relationship. In terms of specificity, specific emotions (e.g., anger, sadness, and embarrassment) can be linked with particular health outcomes (e.g., cardiovascular disease and musculoskeletal disease). In terms of bidirectionality, the influences of emotions on disease as well as the influences of disease on emotional functioning can be considered. In terms of assessing actual emotional responding, emotions can be studied in vivo under controlled conditions that allow behavioral, physiological, and subjective responses to be measured during different kinds of emotional functioning (e.g., responding to emotional stimuli, interacting with relationship partners, and downregulating emotional responses). With these considerations in mind, I review early theories and empirical studies in psychosomatic medicine that considered the role of specific emotions and emotion-related behaviors. Studies from our laboratory are presented that illustrate a) differences in patterns of autonomic nervous system responding associated with specific emotions, b) relationships between specific emotions and particular health outcomes in the context of social relationships, c) age as a moderator of the relationship between specific emotions and well-being, d) bidirectional influences (emotions influencing disease and disease influencing emotional functioning), and e) impact of changes in emotional functioning in individuals with neurodegenerative diseases on the health of familial caregivers.

Resting parasympathetic dysfunction predicts prosocial helping deficits in behavioral variant frontotemporal dementia

In the behavioral variant of frontotemporal dementia (bvFTD), left-lateralized salience network dysfunction reduces basal activity in the parasympathetic nervous system, a branch of the autonomic nervous system that reduces arousal and fosters empathy and prosociality. Here we examined whether resting parasympathetic deficits in bvFTD related to diminished prosocial behavior. Eighty participants [30 with bvFTD, 25 with Alzheimer's disease (AD), and 25 healthy controls] completed a "helping task" in which we quantified participants' spontaneous reactions to an experimenter who struggled to find a lost key. Participants also underwent an assessment of baseline autonomic nervous system activity and structural magnetic resonance imaging. An exploratory factor analysis of participants' behaviors during the helping task revealed four factors: empathic concern, consolation, disengagement, and impatience. Patients with bvFTD had lower empathic concern and greater disengagement and impatience than the AD and healthy control groups. Patients with bvFTD had lower resting respiratory sinus arrhythmia and faster respiration and heart rates than patients with AD and healthy controls, a pattern consistent with parasympathetic dysfunction. Skin conductance level was also lower in bvFTD than in the other groups. Lower baseline respiratory sinus arrhythmia and faster baseline respiration rates, but not skin conductance level, predicted lower prosocial helping behaviors. Voxel-based morphometry analyses revealed that atrophy in the bilateral medial pulvinar nucleus of the thalamus, midcingulate cortex, and caudate was associated with lower empathic concern and consolation, and atrophy in the bilateral medial pulvinar nucleus of the thalamus, left frontoinsula, and left ventral striatum was associated with greater disengagement and impatience. Left-lateralized frontoinsula atrophy was associated with not only lower respiratory sinus arrhythmia but also with lower consolation and greater disengagement. This study offers evidence for prosocial behavior deficits in bvFTD and suggests that left-lateralized salience network atrophy reduces patients' resting parasympathetic activity and motivation to help others in need.

Psychiatric symptoms in preclinical behavioural-variant frontotemporal dementia in MAPT mutation carriers

OBJECTIVE

To characterise psychiatric symptoms in preclinical and early behavioural-variant frontotemporal dementia (bvFTD), a neurodegenerative disorder whose symptoms overlap with and are often mistaken for psychiatric illness.

METHODS

The present study reports findings from a systematic, global, prospective evaluation of psychiatric symptoms in 12 preclinical carriers of pathogenic MAPT mutations, not yet meeting bvFTD diagnostic criteria, and 46 familial non-carrier controls. Current psychiatric symptoms, informant-reported symptoms and lifetime prevalence of psychiatric disorders were assessed with The Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) and the Neuropsychiatric Inventory Questionnaire. Fisher exact test was used to compare carriers and non-carriers' lifetime prevalence of six DSM-IV disorders: major depressive disorder, panic attacks, alcohol abuse, generalised anxiety disorder, panic disorder, and depressive disorder not otherwise specified. Other DSM-IV disorders had insufficient prevalence across our sample for between-group comparisons, but are reported.

RESULTS

Non-carriers had greater prevalence of mood and anxiety disorders than has been reported for a general reference population. Preclinical carriers had lower lifetime prevalence of mood and anxiety disorders than non-carriers, except for depressive disorder not otherwise specified, an atypical syndrome comprising clinically significant depressive symptoms which fail to meet criteria for major depressive disorder.

CONCLUSION

Findings suggest that early psychiatric symptoms of emergent bvFTD may manifest as emotional blunting or mood changes not cleanly conforming to criteria for a DSM-defined mood disorder.

Greater Experience of Negative Non-Target Emotions by Patients with Neurodegenerative Diseases Is Related to Lower Emotional Well-Being in Caregivers

BACKGROUND

Behavioral symptoms in patients with neurodegenerative diseases can be particularly challenging for caregivers. Previously, we reported that patients with frontotemporal dementia (FTD) and Alzheimer's disease (AD) experienced emotions that were atypical or incongruent with a given situation (i.e., non-target emotions).

AIM

We tested the hypothesis that greater experience of non-target emotions by patients is associated with lower caregiver emotional well-being.

METHODS

178 patients with FTD, AD, or other neurodegenerative diseases and 35 healthy individuals watched 3 films designed to induce amusement, sadness, and disgust, and then reported their emotions during the films. Caregivers of the patients reported their own emotional well-being on the Medical Outcomes Study 36-item Short-Form Health Survey.

RESULTS

In response to the amusement and sadness (but not disgust) films, greater experience of non-target emotions by patients was related to lower caregiver emotional well-being. These effects were specific to patients' experience of negative non-target emotions (i.e., not found for positive non-target emotions or for negative or positive target emotions).

CONCLUSION

The findings reveal a previously unstudied patient behavior that is related to worse caregiver emotional well-being. Future research and clinical assessment may benefit from evaluating non-target emotions in patients.