51
|
Bagheri E, Esteban PG, Cao HL, Beir AD, Lefeber D, Vanderborght B. An Autonomous Cognitive Empathy Model Responsive to Users’ Facial Emotion Expressions. ACM T INTERACT INTEL 2020. [DOI: 10.1145/3341198] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
Successful social robot services depend on how robots can interact with users. The effective service can be obtained through smooth, engaged, and humanoid interactions in which robots react properly to a user’s affective state. This article proposes a novel Automatic Cognitive Empathy Model, ACEM, for humanoid robots to achieve longer and more engaged human-robot interactions (HRI) by considering humans’ emotions and replying to them appropriately. The proposed model continuously detects the affective states of a user based on facial expressions and generates desired, either parallel or reactive, empathic behaviors that are already adapted to the user’s personality. Users’ affective states are detected using a stacked autoencoder network that is trained and tested on the RAVDESS dataset.
The overall proposed empathic model is verified throughout an experiment, where different emotions are triggered in participants and then empathic behaviors are applied based on proposed hypothesis. The results confirm the effectiveness of the proposed model in terms of related social and friendship concepts that participants perceived during interaction with the robot.
Collapse
Affiliation(s)
- Elahe Bagheri
- Robotics and Multibody Mechanics Research Group, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
| | - Pablo G. Esteban
- Robotics and Multibody Mechanics Research Group, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
| | - Hoang-Long Cao
- Robotics and Multibody Mechanics Research Group, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
| | - Albert De Beir
- Robotics and Multibody Mechanics Research Group, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
| | - Dirk Lefeber
- Robotics and Multibody Mechanics Research Group, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
| | - Bram Vanderborght
- Robotics and Multibody Mechanics Research Group, Vrije Universiteit Brussel and Flanders Make, Brussels, Belgium
| |
Collapse
|
52
|
Dodich A, Crespi C, Santi GC, Cappa SF, Cerami C. Evaluation of Discriminative Detection Abilities of Social Cognition Measures for the Diagnosis of the Behavioral Variant of Frontotemporal Dementia: a Systematic Review. Neuropsychol Rev 2020; 31:251-266. [PMID: 33040199 DOI: 10.1007/s11065-020-09457-1] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2020] [Accepted: 09/21/2020] [Indexed: 12/16/2022]
Abstract
The use of social tasks in the neuropsychological assessment of the behavioral variant of frontotemporal dementia (bvFTD) is at present not required by diagnostic guidelines, despite extensive literature shows relevant social cognitive dysfunctions in such patients. In this systematic review, we explored the clinical maturity of social cognition measures in the diagnosis of bvFTD. Papers were selected according to the PRISMA guidelines by searching the PubMed and Medline databases. Only papers reporting indices of diagnostic accuracy and/or sensitivity/specificity in classifying bvFTD from controls or from other relevant diseases were considered. Quality of evidence was assessed through QUADAS-2. Among the 663 articles entered in the paper selection only 14 papers were eligible for the scope of the present review and showed an overall moderate-to-low quality. The major risk of bias was the lack of pathological confirmation. The evaluation of the accuracy of social cognition tasks in bvFTD detection compared to normal controls, as well as in the discrimination with Alzheimer's disease and psychiatric patients, is mainly focused on emotion recognition and theory of mind. However, the use of different cognitive measures, variable task formats and the limited normative data hamper study comparability. Although literature seems to suggest that emotion recognition and ToM tasks could be the best choice to ensure a high diagnostic accuracy in clinical settings, further comparative studies are required and no recommendation concerning the use of a specific social task in bvFTD diagnosis can be currently provided.
Collapse
Affiliation(s)
- Alessandra Dodich
- CeRiN, Centre for Mind/Brain Sciences-CIMeC, University of Trento, Rovereto, Italy
| | - Chiara Crespi
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy.,Cognitive Computational Neuroscience Research Unit, IRCCS Mondino Foundation, Pavia, Italy
| | - Gaia C Santi
- Scuola Universitaria Superiore IUSS Pavia, Pavia, Italy
| | - Stefano F Cappa
- Scuola Universitaria Superiore IUSS Pavia, Pavia, Italy.,Dementia Research Center, IRCCS Mondino Foundation, Pavia, Italy
| | - Chiara Cerami
- Cognitive Computational Neuroscience Research Unit, IRCCS Mondino Foundation, Pavia, Italy. .,Scuola Universitaria Superiore IUSS Pavia, Pavia, Italy.
| |
Collapse
|
53
|
Hofhansel L, Weidler C, Votinov M, Clemens B, Raine A, Habel U. Morphology of the criminal brain: gray matter reductions are linked to antisocial behavior in offenders. Brain Struct Funct 2020; 225:2017-2028. [PMID: 32591929 PMCID: PMC7473962 DOI: 10.1007/s00429-020-02106-6] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Accepted: 06/16/2020] [Indexed: 12/16/2022]
Abstract
Aggression and psychopathy are multifaceted conditions determined interpersonal and antisocial factors. Only a few studies analyze the link between these separate factors and specific brain morphology distinctively. A voxel-based morphometry (VBM) analysis was performed on 27 violent offenders and 27 controls aiming to associate sub-features of aggressive and psychopathic behavior with specific gray matter volumes. Trait aggression was assessed using two self-report tests (Aggression Questionnaire, AQ, and Reactive-Proactive-Aggression Questionnaire, RPQ) and psychopathy with the Psychopathy Checklist-Revised (PCL-R). Total and sub-scale scores of these tests were correlated to the brain morphometry of the offenders group in separate analyses. It was found that psychopathic behavior was negatively correlated with prefrontal gray matter volume and that this result was primarily driven by the antisocial behavior sub-scale of the PCL-R. Furthermore, less gray matter in right superior frontal and left inferior parietal regions with increasing antisocial behavior could be observed. One cluster comprising the right middle and superior temporal gyrus was negatively correlated with both, reactive aggression and antisocial behavior. These results outline (1) the importance of distinctively analyzing sub-features that contribute to aggressive and psychopathic behavior, given that the negative correlation of psychopathy global scores with prefrontal volume was driven by one single facet of the PCL-R scale (antisocial behavior). Moreover, these results indicate (2) fronto-temporo-parietal network deficits in antisocial, criminal offenders, with a particular strong effect in the temporal lobe.
Collapse
Affiliation(s)
- Lena Hofhansel
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstraße 30, 52074, Aachen, Germany.
- Institute of Neuroscience and Medicine (INM-10), Research Center Jülich, Jülich, Germany.
| | - Carmen Weidler
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstraße 30, 52074, Aachen, Germany
| | - Mikhail Votinov
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstraße 30, 52074, Aachen, Germany
- Institute of Neuroscience and Medicine (INM-10), Research Center Jülich, Jülich, Germany
| | - Benjamin Clemens
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstraße 30, 52074, Aachen, Germany
| | - Adrian Raine
- Departments of Criminology, Psychiatry, and Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Ute Habel
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstraße 30, 52074, Aachen, Germany
- Institute of Neuroscience and Medicine (INM-10), Research Center Jülich, Jülich, Germany
| |
Collapse
|
54
|
Cross-network interactions in social cognition: A review of findings on task related brain activation and connectivity. Cortex 2020; 130:142-157. [DOI: 10.1016/j.cortex.2020.05.006] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2019] [Revised: 04/06/2020] [Accepted: 05/13/2020] [Indexed: 01/17/2023]
|
55
|
Kogler L, Müller VI, Werminghausen E, Eickhoff SB, Derntl B. Do I feel or do I know? Neuroimaging meta-analyses on the multiple facets of empathy. Cortex 2020; 129:341-355. [PMID: 32562973 PMCID: PMC7390692 DOI: 10.1016/j.cortex.2020.04.031] [Citation(s) in RCA: 50] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Revised: 12/15/2019] [Accepted: 04/22/2020] [Indexed: 01/10/2023]
Abstract
Empathy is a multidimensional construct including affective and cognitive components while maintaining the distinction between one-self and others. Our meta-analyses focused on shared and distinct networks underlying cognitive (taking somebody else's perspective in emotional/painful situations) and affective (self-referentially feeling somebody else's emotions/pain) empathy for various states including painful and emotional situations. Furthermore, a comparison with direct pain experience was carried out. For cognitive empathy, consistent activation in the anterior dorsal medial frontal gyrus (dmPFG) and the supramarginal gyrus (SMG) occurred. For affective empathy, convergent activation of the posterior dmPFG and the inferior frontal gyrus (IFG) was found. Consistent activation of the anterior insula (AI), the anterior dmPFG and the SMG was observed for empathy for pain, while convergent recruitment of the temporo-parietal junction, precuneus, posterior dmPFG, and the IFG was revealed in the meta-analysis across empathy for emotion experiments. The AI and the dmPFG/mid-cingulate cortex (MCC) showed overlapping as well as distinct neural activation for pain processing and empathy for pain. Taken together, we were able to show difference in the meta-analytic networks across cognitive and affective empathy as well as for pain and empathy processing. Based on the current results, distinct functions along the midline structures of the brain during empathy processing are apparent. Our data are lending further support for a multidimensional concept of empathy.
Collapse
Affiliation(s)
- Lydia Kogler
- Department of Psychiatry and Psychotherapy, Medical Faculty, University of Tübingen, Tübingen, Germany; Department of Psychiatry, Psychotherapy and Psychosomatics, RWTH Aachen University, Aachen, Germany.
| | - Veronika I Müller
- Institute of Neuroscience und Medicine, INM-7, Research Centre Jülich, Jülich, Germany; Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Elena Werminghausen
- Department of Psychiatry, Psychotherapy and Psychosomatics, RWTH Aachen University, Aachen, Germany
| | - Simon B Eickhoff
- Institute of Neuroscience und Medicine, INM-7, Research Centre Jülich, Jülich, Germany; Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Birgit Derntl
- Department of Psychiatry and Psychotherapy, Medical Faculty, University of Tübingen, Tübingen, Germany; Center for Integrative Neuroscience, University of Tübingen, Tübingen, Germany; LEAD Graduate School & Research Network, University of Tübingen, Tübingen, Germany
| |
Collapse
|
56
|
Corradi-Dell’Acqua C, Ronchi R, Thomasson M, Bernati T, Saj A, Vuilleumier P. Deficits in cognitive and affective theory of mind relate to dissociated lesion patterns in prefrontal and insular cortex. Cortex 2020; 128:218-233. [DOI: 10.1016/j.cortex.2020.03.019] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2019] [Revised: 02/17/2020] [Accepted: 03/19/2020] [Indexed: 12/21/2022]
|
57
|
Abramson L, Uzefovsky F, Toccaceli V, Knafo-Noam A. The genetic and environmental origins of emotional and cognitive empathy: Review and meta-analyses of twin studies. Neurosci Biobehav Rev 2020; 114:113-133. [PMID: 32353470 DOI: 10.1016/j.neubiorev.2020.03.023] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2019] [Revised: 02/20/2020] [Accepted: 03/24/2020] [Indexed: 01/10/2023]
Abstract
Empathy is considered a cornerstone of human social experience, and as such has been widely investigated from psychological and neuroscientific approaches. To better understand the factors influencing individual differences in empathy, we reviewed and meta-analyzed the behavioral genetic literature of emotional empathy- sharing others' emotions (k=13), and cognitive empathy- understanding others' emotions (k = 15), as manifested in twin studies. Results showed that emotional empathy is more heritable, 48.3 % [41.3 %-50.6 %], than cognitive empathy, 26.9 % [18.1 %-35.8 %]. Moreover, cognitive empathy as examined by performance tests was affected by the environment shared by family members, 11.9 % [2.6 %-21.0 %], suggesting that emotional understanding is influenced, to some degree, by environmental factors that have similar effects on family members beyond their genetic relatedness. The effects of participants' age and the method used to asses empathy on the etiology of empathy were also examined. These findings have implications for understanding how individual differences in empathy are formed. After discussing these implications, we suggest theoretical and methodological future research directions that could potentially elucidate the relations between genes, brain, and empathy.
Collapse
|
58
|
|
59
|
Panzica F, Schiaffi E, Visani E, Franceschetti S, Giovagnoli AR. Gamma electroencephalographic coherence and theory of mind in healthy subjects. Epilepsy Behav 2019; 100:106435. [PMID: 31427268 DOI: 10.1016/j.yebeh.2019.07.036] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Revised: 06/06/2019] [Accepted: 07/11/2019] [Indexed: 11/17/2022]
Abstract
PURPOSE Structural brain imaging has revealed that damage to different brain regions may impair theory of mind (ToM) while functional imaging has shown that distributed neural circuits are activated by ToM and empathy. However, the coherence of the electroencephalogram (EEG) frequencies in a definite time span may change during these processes, indicating different neurophysiological correlates. This study evaluated the changes of EEG coherence during ToM tasks in comparison with Empathy, Physical causality, and baseline conditions, aiming to determine the neurophysiological correlates of ToM. METHODS Sixteen healthy adults underwent a visual activation paradigm using 30 comic strips concerning ToM, Empathy, or Physical causality during EEG recording. The interhemispheric coherence was estimated using a bivariate autoregressive (AR) parametric model. The coherence spectra were analyzed in the alpha, beta, and gamma frequency EEG bands. RESULTS Coherence analysis taking all of the responses showed that in the gamma band, in comparison with the Empathy, Physical causality, and baseline conditions, ToM was associated with significantly higher peaks between the frontal and parietal areas in the right hemisphere and, in comparison with the Physical causality and baseline conditions, in the left hemisphere. Analysis taking the correct responses confirmed these results. CONCLUSIONS In healthy adults, ToM processes are associated with immediate specific changes of brain connectivity, as expressed by high cortical coherence within the right frontal and parietal areas. These previously unexplored aspects indicate an online involvement of the right hemisphere networks in normal ToM. In patients with epilepsy, the study of EEG coherence during specific tasks may help determine the neural dysfunctions associated with impaired ToM. This article is part of the Special Issue "Epilepsy and social cognition across the lifespan".
Collapse
Affiliation(s)
- Ferruccio Panzica
- Unit of Neurophysiopathology, Department of Diagnostics and Applied Technology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Via Celoria 11, 20133 Milano, Italy.
| | - Elena Schiaffi
- Unit of Neurophysiopathology, Department of Diagnostics and Applied Technology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Via Celoria 11, 20133 Milano, Italy
| | - Elisa Visani
- Unit of Neurophysiopathology, Department of Diagnostics and Applied Technology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Via Celoria 11, 20133 Milano, Italy
| | - Silvana Franceschetti
- Unit of Neurophysiopathology, Department of Diagnostics and Applied Technology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Via Celoria 11, 20133 Milano, Italy
| | - Anna Rita Giovagnoli
- Unit of Neurology and Neuropathology, Department of Diagnostics and Technology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milano, Italy
| |
Collapse
|