1
|
von Eiff CI, Kauk J, Schweinberger SR. The Jena Audiovisual Stimuli of Morphed Emotional Pseudospeech (JAVMEPS): A database for emotional auditory-only, visual-only, and congruent and incongruent audiovisual voice and dynamic face stimuli with varying voice intensities. Behav Res Methods 2024; 56:5103-5115. [PMID: 37821750 PMCID: PMC11289065 DOI: 10.3758/s13428-023-02249-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/18/2023] [Indexed: 10/13/2023]
Abstract
We describe JAVMEPS, an audiovisual (AV) database for emotional voice and dynamic face stimuli, with voices varying in emotional intensity. JAVMEPS includes 2256 stimulus files comprising (A) recordings of 12 speakers, speaking four bisyllabic pseudowords with six naturalistic induced basic emotions plus neutral, in auditory-only, visual-only, and congruent AV conditions. It furthermore comprises (B) caricatures (140%), original voices (100%), and anti-caricatures (60%) for happy, fearful, angry, sad, disgusted, and surprised voices for eight speakers and two pseudowords. Crucially, JAVMEPS contains (C) precisely time-synchronized congruent and incongruent AV (and corresponding auditory-only) stimuli with two emotions (anger, surprise), (C1) with original intensity (ten speakers, four pseudowords), (C2) and with graded AV congruence (implemented via five voice morph levels, from caricatures to anti-caricatures; eight speakers, two pseudowords). We collected classification data for Stimulus Set A from 22 normal-hearing listeners and four cochlear implant users, for two pseudowords, in auditory-only, visual-only, and AV conditions. Normal-hearing individuals showed good classification performance (McorrAV = .59 to .92), with classification rates in the auditory-only condition ≥ .38 correct (surprise: .67, anger: .51). Despite compromised vocal emotion perception, CI users performed above chance levels of .14 for auditory-only stimuli, with best rates for surprise (.31) and anger (.30). We anticipate JAVMEPS to become a useful open resource for researchers into auditory emotion perception, especially when adaptive testing or calibration of task difficulty is desirable. With its time-synchronized congruent and incongruent stimuli, JAVMEPS can also contribute to filling a gap in research regarding dynamic audiovisual integration of emotion perception via behavioral or neurophysiological recordings.
Collapse
Affiliation(s)
- Celina I von Eiff
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University Jena, Am Steiger 3, 07743, Jena, Germany.
- Voice Research Unit, Institute of Psychology, Friedrich Schiller University Jena, Leutragraben 1, 07743, Jena, Germany.
- DFG SPP 2392 Visual Communication (ViCom), Frankfurt am Main, Germany.
- Jena University Hospital, 07747, Jena, Germany.
| | - Julian Kauk
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University Jena, Am Steiger 3, 07743, Jena, Germany
| | - Stefan R Schweinberger
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University Jena, Am Steiger 3, 07743, Jena, Germany.
- Voice Research Unit, Institute of Psychology, Friedrich Schiller University Jena, Leutragraben 1, 07743, Jena, Germany.
- DFG SPP 2392 Visual Communication (ViCom), Frankfurt am Main, Germany.
- Jena University Hospital, 07747, Jena, Germany.
| |
Collapse
|
2
|
Jiang W, Liu X, Xu Z, Zhou Z, Tie C, Liu X, Yang J, Li H, Lai W. Association between gaming disorder and regional homogeneity in highly involved male adult gamers: A pilot resting-state fMRI study. Brain Behav 2023; 13:e3315. [PMID: 37932960 PMCID: PMC10726794 DOI: 10.1002/brb3.3315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 10/25/2023] [Accepted: 10/26/2023] [Indexed: 11/08/2023] Open
Abstract
BACKGROUND Gaming behavior can induce cerebral changes that may be related to the neurobiological features of gaming disorder (GD). Additionally, individuals with higher levels of depression or impulsivity are more likely to experience GD. Therefore, the present pilot study explored potential neurobiological correlates of GD in the context of depression and impulsivity, after accounting for video gaming behavior. METHODS Using resting-state functional magnetic resonance imaging (fMRI), a cross-sectional study was conducted with 35 highly involved male adult gamers to examine potential associations between GD severity and regional homogeneity (ReHo) in the entire brain. A mediation model was used to test the role of ReHo in the possible links between depression/impulsivity and GD severity. RESULTS Individuals with greater GD severity showed increased ReHo in the right Heschl's gyrus and decreased ReHo in the right hippocampus (rHip). Furthermore, depression and impulsivity were negatively correlated with ReHo in the rHip, respectively. More importantly, ReHo in the rHip was found to mediate the associations between depression/impulsivity and GD. CONCLUSIONS These preliminary findings suggest that GD severity is related to ReHo in brain regions associated with learning/memory/mood and auditory function. Higher levels of depression or impulsivity may potentiate GD through the functional activity of the hippocampus. Our findings advance our understanding of the neurobiological differences behind GD symptoms in highly involved gamers.
Collapse
Affiliation(s)
- Wen‐tao Jiang
- Department of RadiologyShenzhen Mental Health Center/Shenzhen Kangning HospitalShenzhenGuangdongChina
| | - Xia Liu
- Department of RadiologyShenzhen Mental Health Center/Shenzhen Kangning HospitalShenzhenGuangdongChina
| | - Zi‐yun Xu
- Department of RadiologyShenzhen Mental Health Center/Shenzhen Kangning HospitalShenzhenGuangdongChina
| | - Zhi‐feng Zhou
- Department of RadiologyShenzhen Mental Health Center/Shenzhen Kangning HospitalShenzhenGuangdongChina
| | - Chang‐jun Tie
- Institute of Computing TechnologyChinese Academy of SciencesBeijingChina
- Peng Cheng LaboratoryShenzhenGuangdongChina
| | - Xiao‐ying Liu
- Department of Drug DependenceShenzhen Mental Health Center/Shenzhen Kangning HospitalShenzhenGuangdongChina
| | - Ji‐hui Yang
- Department of Drug DependenceShenzhen Mental Health Center/Shenzhen Kangning HospitalShenzhenGuangdongChina
| | - Hai Li
- Beijing Intelligent Brain Cloud, Inc.BeijingChina
| | - Wen‐tao Lai
- Department of RadiologyShenzhen Mental Health Center/Shenzhen Kangning HospitalShenzhenGuangdongChina
| |
Collapse
|
3
|
Cai XL, Pu CC, Zhou SZ, Wang Y, Huang J, Lui SSY, Møller A, Cheung EFC, Madsen KH, Xue R, Yu X, Chan RCK. Anterior cingulate glutamate levels associate with functional activation and connectivity during sensory integration in schizophrenia: a multimodal 1H-MRS and fMRI study. Psychol Med 2023; 53:4904-4914. [PMID: 35791929 DOI: 10.1017/s0033291722001817] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
BACKGROUND Glutamatergic dysfunction has been implicated in sensory integration deficits in schizophrenia, yet how glutamatergic function contributes to behavioural impairments and neural activities of sensory integration remains unknown. METHODS Fifty schizophrenia patients and 43 healthy controls completed behavioural assessments for sensory integration and underwent magnetic resonance spectroscopy (MRS) for measuring the anterior cingulate cortex (ACC) glutamate levels. The correlation between glutamate levels and behavioural sensory integration deficits was examined in each group. A subsample of 20 pairs of patients and controls further completed an audiovisual sensory integration functional magnetic resonance imaging (fMRI) task. Blood Oxygenation Level Dependent (BOLD) activation and task-dependent functional connectivity (FC) were assessed based on fMRI data. Full factorial analyses were performed to examine the Group-by-Glutamate Level interaction effects on fMRI measurements (group differences in correlation between glutamate levels and fMRI measurements) and the correlation between glutamate levels and fMRI measurements within each group. RESULTS We found that schizophrenia patients exhibited impaired sensory integration which was positively correlated with ACC glutamate levels. Multimodal analyses showed significantly Group-by-Glutamate Level interaction effects on BOLD activation as well as task-dependent FC in a 'cortico-subcortical-cortical' network (including medial frontal gyrus, precuneus, ACC, middle cingulate gyrus, thalamus and caudate) with positive correlations in patients and negative in controls. CONCLUSIONS Our findings indicate that ACC glutamate influences neural activities in a large-scale network during sensory integration, but the effects have opposite directionality between schizophrenia patients and healthy people. This implicates the crucial role of glutamatergic system in sensory integration processing in schizophrenia.
Collapse
Affiliation(s)
- Xin-Lu Cai
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Sino-Danish College, University of Chinese Academy of Sciences, Beijing, China
- Sino-Danish Centre for Education and Research, Beijing, China
| | - Cheng-Cheng Pu
- Peking University Sixth Hospital, Peking University Institute of Mental Health, Beijing, China
- NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, China
| | - Shu-Zhe Zhou
- Peking University Sixth Hospital, Peking University Institute of Mental Health, Beijing, China
- NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, China
| | - Yi Wang
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Jia Huang
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Simon S Y Lui
- Department of Psychiatry, School of Clinical Medicine, The University of Hong Kong, Hong Kong Special Administrative Region, China
| | - Arne Møller
- Sino-Danish College, University of Chinese Academy of Sciences, Beijing, China
- Sino-Danish Centre for Education and Research, Beijing, China
- Centre of Functionally Integrative Neuroscience, Aarhus University, Aarhus, Denmark
- Department of Nuclear Medicine and PET Centre, Aarhus University Hospital, Aarhus, Denmark
| | - Eric F C Cheung
- Castle Peak Hospital, Hong Kong Special Administrative Region, China
| | - Kristoffer H Madsen
- Sino-Danish Centre for Education and Research, Beijing, China
- Danish Research Centre for Magnetic Resonance, Centre for Functional and Diagnostic Imaging and Research, Copenhagen University Hospital, Amager and Hvidovre, Denmark
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Rong Xue
- Sino-Danish College, University of Chinese Academy of Sciences, Beijing, China
- Sino-Danish Centre for Education and Research, Beijing, China
- State Key Laboratory of Brain and Cognitive Science, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
- Beijing Institute for Brain Disorders, Beijing, China
| | - Xin Yu
- Peking University Sixth Hospital, Peking University Institute of Mental Health, Beijing, China
- NHC Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, China
| | - Raymond C K Chan
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Sino-Danish College, University of Chinese Academy of Sciences, Beijing, China
- Sino-Danish Centre for Education and Research, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- Department of Diagnostic Radiology, the University of Hong Kong, Hong Kong Special Administrative Region, China
| |
Collapse
|
4
|
Arias Sarah P, Hall L, Saitovitch A, Aucouturier JJ, Zilbovicius M, Johansson P. Pupil dilation reflects the dynamic integration of audiovisual emotional speech. Sci Rep 2023; 13:5507. [PMID: 37016041 PMCID: PMC10073148 DOI: 10.1038/s41598-023-32133-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 03/22/2023] [Indexed: 04/06/2023] Open
Abstract
Emotional speech perception is a multisensory process. When speaking with an individual we concurrently integrate the information from their voice and face to decode e.g., their feelings, moods, and emotions. However, the physiological reactions-such as the reflexive dilation of the pupil-associated to these processes remain mostly unknown. That is the aim of the current article, to investigate whether pupillary reactions can index the processes underlying the audiovisual integration of emotional signals. To investigate this question, we used an algorithm able to increase or decrease the smiles seen in a person's face or heard in their voice, while preserving the temporal synchrony between visual and auditory channels. Using this algorithm, we created congruent and incongruent audiovisual smiles, and investigated participants' gaze and pupillary reactions to manipulated stimuli. We found that pupil reactions can reflect emotional information mismatch in audiovisual speech. In our data, when participants were explicitly asked to extract emotional information from stimuli, the first fixation within emotionally mismatching areas (i.e., the mouth) triggered pupil dilation. These results reveal that pupil dilation can reflect the dynamic integration of audiovisual emotional speech and provide insights on how these reactions are triggered during stimulus perception.
Collapse
Affiliation(s)
- Pablo Arias Sarah
- Lund University Cognitive Science, Lund University, Lund, Sweden.
- STMS Lab, UMR 9912 (IRCAM/CNRS/SU), Paris, France.
- School of Neuroscience and Psychology, Glasgow University, Glasgow, UK.
| | - Lars Hall
- STMS Lab, UMR 9912 (IRCAM/CNRS/SU), Paris, France
| | - Ana Saitovitch
- U1000 Brain Imaging in Psychiatry, INSERM-CEA, Pediatric Radiology Service, Necker Enfants Malades Hospital, Paris V René Descartes University, Paris, France
| | - Jean-Julien Aucouturier
- Department of Robotics and Automation FEMTO-ST Institute (CNRS/Université de Bourgogne Franche Comté), Besançon, France
| | - Monica Zilbovicius
- U1000 Brain Imaging in Psychiatry, INSERM-CEA, Pediatric Radiology Service, Necker Enfants Malades Hospital, Paris V René Descartes University, Paris, France
| | | |
Collapse
|
5
|
Seitz KI, Ueltzhöffer K, Rademacher L, Paulus FM, Schmitz M, Herpertz SC, Bertsch K. Your smile won't affect me: Association between childhood maternal antipathy and adult neural reward function in a transdiagnostic sample. Transl Psychiatry 2023; 13:70. [PMID: 36828811 PMCID: PMC9958053 DOI: 10.1038/s41398-023-02364-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 02/01/2023] [Accepted: 02/09/2023] [Indexed: 02/26/2023] Open
Abstract
Aberrant activation in the ventral striatum (VS) during reward anticipation may be a key mechanism linking adverse childhood experiences (ACE) to transdiagnostic psychopathology. This study aimed to elucidate whether retrospectively reported ACE, specifically maternal antipathy, relate to monetary and social reward anticipation in a transdiagnostic adult sample. A cross-sectional neuroimaging study was conducted in 118 participants with varying levels of ACE, including 25 participants with posttraumatic stress disorder (PTSD), 32 with major depressive disorder (MDD), 29 with somatic symptom disorder (SSD), and 32 healthy volunteers (HVs). Participants underwent functional magnetic resonance imaging during a monetary and social incentive delay task, and completed a self-report measure of ACE, including maternal antipathy. Neural correlates of monetary and social reward anticipation and their association with ACE, particularly maternal antipathy, were analyzed. Participants showed elevated activation in brain regions underlying reward processing, including the VS, only while anticipating social, but not monetary rewards. Participants reporting higher levels of maternal antipathy exhibited reduced activation in the brain reward network, including the VS, only during social, but not monetary reward anticipation. Group affiliation moderated the association between maternal antipathy and VS activation to social reward anticipation, with significant associations found in participants with PTSD and HVs, but not in those with MDD and SSD. Results were not associated with general psychopathology or psychotropic medication use. Childhood maternal antipathy may confer risk for aberrant social reward anticipation in adulthood, and may thus be considered in interventions targeting reward expectations from social interactions.
Collapse
Affiliation(s)
- Katja I. Seitz
- grid.7700.00000 0001 2190 4373Department of General Psychiatry, Center for Psychosocial Medicine, Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Kai Ueltzhöffer
- grid.7700.00000 0001 2190 4373Department of General Psychiatry, Center for Psychosocial Medicine, Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Lena Rademacher
- grid.4562.50000 0001 0057 2672Social Neuroscience Lab, Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany ,grid.4562.50000 0001 0057 2672Center of Brain, Behavior and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Frieder M. Paulus
- grid.4562.50000 0001 0057 2672Social Neuroscience Lab, Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany ,grid.4562.50000 0001 0057 2672Center of Brain, Behavior and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| | - Marius Schmitz
- grid.7700.00000 0001 2190 4373Department of General Psychiatry, Center for Psychosocial Medicine, Medical Faculty, Heidelberg University, Heidelberg, Germany ,grid.5252.00000 0004 1936 973XDepartment of Psychology, Ludwig-Maximilians-University Munich, Munich, Germany
| | - Sabine C. Herpertz
- grid.7700.00000 0001 2190 4373Department of General Psychiatry, Center for Psychosocial Medicine, Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Katja Bertsch
- grid.7700.00000 0001 2190 4373Department of General Psychiatry, Center for Psychosocial Medicine, Medical Faculty, Heidelberg University, Heidelberg, Germany ,grid.5252.00000 0004 1936 973XDepartment of Psychology, Ludwig-Maximilians-University Munich, Munich, Germany
| |
Collapse
|
6
|
Scheliga S, Kellermann T, Lampert A, Rolke R, Spehr M, Habel U. Neural correlates of multisensory integration in the human brain: an ALE meta-analysis. Rev Neurosci 2023; 34:223-245. [PMID: 36084305 DOI: 10.1515/revneuro-2022-0065] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 07/22/2022] [Indexed: 02/07/2023]
Abstract
Previous fMRI research identified superior temporal sulcus as central integration area for audiovisual stimuli. However, less is known about a general multisensory integration network across senses. Therefore, we conducted activation likelihood estimation meta-analysis with multiple sensory modalities to identify a common brain network. We included 49 studies covering all Aristotelian senses i.e., auditory, visual, tactile, gustatory, and olfactory stimuli. Analysis revealed significant activation in bilateral superior temporal gyrus, middle temporal gyrus, thalamus, right insula, and left inferior frontal gyrus. We assume these regions to be part of a general multisensory integration network comprising different functional roles. Here, thalamus operate as first subcortical relay projecting sensory information to higher cortical integration centers in superior temporal gyrus/sulcus while conflict-processing brain regions as insula and inferior frontal gyrus facilitate integration of incongruent information. We additionally performed meta-analytic connectivity modelling and found each brain region showed co-activations within the identified multisensory integration network. Therefore, by including multiple sensory modalities in our meta-analysis the results may provide evidence for a common brain network that supports different functional roles for multisensory integration.
Collapse
Affiliation(s)
- Sebastian Scheliga
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty RWTH Aachen University, Pauwelsstraße 30, 52074 Aachen, Germany
| | - Thilo Kellermann
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty RWTH Aachen University, Pauwelsstraße 30, 52074 Aachen, Germany.,JARA-Institute Brain Structure Function Relationship, Pauwelsstraße 30, 52074 Aachen, Germany
| | - Angelika Lampert
- Institute of Physiology, Medical Faculty RWTH Aachen University, Pauwelsstraße 30, 52074 Aachen, Germany
| | - Roman Rolke
- Department of Palliative Medicine, Medical Faculty RWTH Aachen University, Pauwelsstraße 30, 52074 Aachen, Germany
| | - Marc Spehr
- Department of Chemosensation, RWTH Aachen University, Institute for Biology, Worringerweg 3, 52074 Aachen, Germany
| | - Ute Habel
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty RWTH Aachen University, Pauwelsstraße 30, 52074 Aachen, Germany.,JARA-Institute Brain Structure Function Relationship, Pauwelsstraße 30, 52074 Aachen, Germany
| |
Collapse
|
7
|
von Eiff CI, Frühholz S, Korth D, Guntinas-Lichius O, Schweinberger SR. Crossmodal benefits to vocal emotion perception in cochlear implant users. iScience 2022; 25:105711. [PMID: 36578321 PMCID: PMC9791346 DOI: 10.1016/j.isci.2022.105711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 10/17/2022] [Accepted: 11/29/2022] [Indexed: 12/03/2022] Open
Abstract
Speech comprehension counts as a benchmark outcome of cochlear implants (CIs)-disregarding the communicative importance of efficient integration of audiovisual (AV) socio-emotional information. We investigated effects of time-synchronized facial information on vocal emotion recognition (VER). In Experiment 1, 26 CI users and normal-hearing (NH) individuals classified emotions for auditory-only, AV congruent, or AV incongruent utterances. In Experiment 2, we compared crossmodal effects between groups with adaptive testing, calibrating auditory difficulty via voice morphs from emotional caricatures to anti-caricatures. CI users performed lower than NH individuals, and VER was correlated with life quality. Importantly, they showed larger benefits to VER with congruent facial emotional information even at equal auditory-only performance levels, suggesting that their larger crossmodal benefits result from deafness-related compensation rather than degraded acoustic representations. Crucially, vocal caricatures enhanced CI users' VER. Findings advocate AV stimuli during CI rehabilitation and suggest perspectives of caricaturing for both perceptual trainings and sound processor technology.
Collapse
Affiliation(s)
- Celina Isabelle von Eiff
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University Jena, 07743 Jena, Germany,Voice Research Unit, Institute of Psychology, Friedrich Schiller University Jena, 07743 Jena, Germany,DFG SPP 2392 Visual Communication (ViCom), Frankfurt am Main, Germany,Corresponding author
| | - Sascha Frühholz
- Department of Psychology (Cognitive and Affective Neuroscience), Faculty of Arts and Social Sciences, University of Zurich, 8050 Zurich, Switzerland,Department of Psychology, University of Oslo, 0373 Oslo, Norway
| | - Daniela Korth
- Department of Otorhinolaryngology, Jena University Hospital, 07747 Jena, Germany
| | | | - Stefan Robert Schweinberger
- Department for General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University Jena, 07743 Jena, Germany,Voice Research Unit, Institute of Psychology, Friedrich Schiller University Jena, 07743 Jena, Germany,DFG SPP 2392 Visual Communication (ViCom), Frankfurt am Main, Germany
| |
Collapse
|
8
|
Li M, Li X, Zhu W, Zhu J, Wang H, Gao Z, Wu X, Zhou S, Wang K, Yu Y. The contribution of the left precuneus to emotion memory in migraine without aura patients. Front Neurosci 2022; 16:905942. [PMID: 36330349 PMCID: PMC9624281 DOI: 10.3389/fnins.2022.905942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 09/27/2022] [Indexed: 11/30/2022] Open
Abstract
Background The impact of migraine without aura (MWoA) on cognitive function remains controversial, especially given the sparse literature on emotional memory. Methods Twenty seven MWoA patients and 25 healthy controls (HCs) were enrolled in this cross-sectional study. Emotional memory behavior was evaluated by combining incidental encoding with intentional encoding of five emotional categories of visual stimulus [positive valence + high arousal (PH), negative valence + high arousal (NH), positive valence + low arousal (PL), negative valence + low arousal (NL), and neutral (N)]. The recollection performance (Pr) was measured and compared. Then, the neural relevance was explored by correlating the Pr with gray matter volume (GMV) and resting-state functional connectivity (rs-FC) based on structural and functional magnetic resonance imaging. Results No significant differences in recollection performance or emotional enhancement of memory effect were observed. However, MWoA patients were more sensitive to the valence and arousal of emotional stimuli under incidental encoding. Significantly, the Pr-PH under incidental encoding and Pr-PL under intentional encoding were negatively correlated with the GMV of the left precuneus, and the rs-FC between the left precuneus and putamen was positively correlated with Pr-PL under intentional encoding in MWoA patients. Conclusion Our study demonstrated the tendency for the influence of migraine on emotional memory and revealed the left precuneus as a critical contributor to recollection performance, providing novel insights for understanding emotional memory and its neural mechanisms in MWoA patients.
Collapse
Affiliation(s)
- Meiqin Li
- The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xiaoshu Li
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Wanqiu Zhu
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Jiajia Zhu
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Haibao Wang
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Ziwen Gao
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Xingqi Wu
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Shanshan Zhou
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Kai Wang
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
- *Correspondence: Kai Wang,
| | - Yongqiang Yu
- The First Affiliated Hospital of Anhui Medical University, Hefei, China
- Yongqiang Yu,
| |
Collapse
|
9
|
The Role of the Interaction between the Inferior Parietal Lobule and Superior Temporal Gyrus in the Multisensory Go/No-go Task. Neuroimage 2022; 254:119140. [PMID: 35342002 DOI: 10.1016/j.neuroimage.2022.119140] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Revised: 03/19/2022] [Accepted: 03/22/2022] [Indexed: 11/23/2022] Open
Abstract
Information from multiple sensory modalities interacts. Using functional magnetic resonance imaging (fMRI), we aimed to identify the neural structures correlated with how cooccurring sound modulates the visual motor response execution. The reaction time (RT) to audiovisual stimuli was significantly faster than the RT to visual stimuli. Signal detection analyses showed no significant difference in the perceptual sensitivity (d') between audiovisual and visual stimuli, while the response criteria (β or c) of the audiovisual stimuli was decreased compared to the visual stimuli. The functional connectivity between the left inferior parietal lobule (IPL) and bilateral superior temporal gyrus (STG) was enhanced in Go processing compared with No-go processing of audiovisual stimuli. Furthermore, the left precentral gyrus (PreCG) showed enhanced functional connectivity with the bilateral STG and other areas of the ventral stream in Go processing compared with No-go processing of audiovisual stimuli. These results revealed that the neuronal network correlated with modulations of the motor response execution after the presentation of both visual stimuli along with cooccurring sound in a multisensory Go/Nogo task, including the left IPL, left PreCG, bilateral STG and some areas of the ventral stream. The role of the interaction between the IPL and STG in transforming audiovisual information into motor behavior is discussed. The current study provides a new perspective for exploring potential brain mechanisms underlying how humans execute appropriate behaviors on the basis of multisensory information.
Collapse
|
10
|
Li L, Zhang Y, Zhao Y, Li Z, Kemp GJ, Wu M, Gong Q. Cortical thickness abnormalities in patients with post-traumatic stress disorder: A vertex-based meta-analysis. Neurosci Biobehav Rev 2022; 134:104519. [PMID: 34979190 DOI: 10.1016/j.neubiorev.2021.104519] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 12/21/2021] [Accepted: 12/30/2021] [Indexed: 02/05/2023]
Abstract
Neuroimaging studies report altered cortical thickness in patients with post-traumatic stress disorder (PTSD), but the results are inconsistent. Using anisotropic effect-size seed-based d mapping (AES-SDM) software with its recently-developed meta-analytic thickness mask, we conducted a meta-analysis of published studies which used whole-brain surface-based morphometry, in order to define consistent cortical thickness alterations in PTSD patients. Eleven studies with 438 patients and 396 controls were included. Compared with all controls, patients with PTSD showed increased cortical thickness in right superior temporal gyrus, and in left and right superior frontal gyrus; the former survived in subgroup analysis of adult patients, and in subgroup comparison with only non-PTSD trauma-exposed controls, the latter in subgroup comparison with only non-trauma-exposed healthy controls. Cortical thickness in right superior frontal gyrus was positively associated with percentage of female patients, and cortical thickness in left superior frontal gyrus was positively associated with symptom severity measured by the clinician-administered PTSD scale. These robust results may help to elucidate the pathophysiology of PTSD.
Collapse
Affiliation(s)
- Lei Li
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, PR China; Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, Sichuan, China; Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, Sichuan, China
| | - Yu Zhang
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, PR China
| | - Youjin Zhao
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, PR China
| | - Zhenlin Li
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, PR China
| | - Graham J Kemp
- Liverpool Magnetic Resonance Imaging Centre and Institute of Life Course and Medical Sciences, University of Liverpool, Liverpool, UK
| | - Min Wu
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, PR China.
| | - Qiyong Gong
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, PR China; Department of Radiology, West China Xiamen Hospital of Sichuan University, Xiamen, Fujian, China.
| |
Collapse
|
11
|
Zhuo C, Chen G, Chen J, Yang L, Zhang Q, Li Q, Wang L, Ma X, Sun Y, Jia F, Tian H, Jiang D. Baseline global brain structural and functional alterations at the time of symptom onset can predict subsequent cognitive deterioration in drug-naïve first-episode schizophrenia patients: Evidence from a follow-up study. Front Psychiatry 2022; 13:1012428. [PMID: 36311504 PMCID: PMC9615917 DOI: 10.3389/fpsyt.2022.1012428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Accepted: 09/26/2022] [Indexed: 01/10/2023] Open
Abstract
Alterations in the global brain gray matter volume (gGMV) and global functional connectivity density (gFCD) play a pivotal role in the cognitive impairment and further deterioration in schizophrenia. This study aimed to assess the correlation between alterations in the gGMV and gFCD at baseline (ΔgGMV and ΔgFCD), and the subsequent alterations of cognitive function in schizophrenia patients after 2-year antipsychotic treatment. Global-brain magnetic resonance imaging scans were acquired from 877 drug-naïve, first-episode schizophrenia patients at baseline and after two years of antipsychotic treatment with adequate dosage and duration, and 200 healthy controls. According to ΔgGMV at baseline, schizophrenia patients were divided into mild, moderate, and severe alteration groups. The MATRICS consensus cognitive battery and Global Deficit Score (GDS) were used to assess cognitive impairment. We found that ΔgGMV and ΔgFCD at baseline were significantly correlated with the severity of the cognitive deterioration (ΔGDS). The correlation coefficient indicated a significant positive correlation between baseline ΔgFCD and subsequent cognitive deterioration, with a relatively stronger relation in the mild alteration group (r = 0.31). In addition, there was a significant positive correlation between baseline ΔgGMV and subsequent cognitive deterioration, with a stronger relation in the moderate and severe alteration groups (r = 0.303; r = 0.302, respectively). Our results showed that ΔgGMV and ΔgFCD are correlated with the severity of cognitive deterioration after completion of a 2-year antipsychotic treatment in schizophrenia patients. These findings suggest that baseline alterations in gGMV and gFCD hold potential for predicting subsequent cognitive decline in schizophrenia.
Collapse
Affiliation(s)
- Chuanjun Zhuo
- Key Laboratory of Sensory Information Processing Abnormalities in Schizophrenia (SIPAS_Lab), Tianjin Fourth Center Hospital, Nankai University Affiliated Tianjin Fourth Center Hospital, Tianjin Medical University Affiliated of Tianjin Fourth Center Hospital, Tianjin, China.,Department of Psychiatry, Wenzhou Seventh Peoples Hospital, Wenzhou, China.,Department of Psychiatry, Tianjin Anding Hospital, Tianjin Mental Health Center of Tianjin Medical University, Nankai University Affiliated Tianjin Anding Hospital, Tianjin, China
| | - Guangdong Chen
- Department of Psychiatry, Wenzhou Seventh Peoples Hospital, Wenzhou, China
| | - Jiayue Chen
- Key Laboratory of Sensory Information Processing Abnormalities in Schizophrenia (SIPAS_Lab), Tianjin Fourth Center Hospital, Nankai University Affiliated Tianjin Fourth Center Hospital, Tianjin Medical University Affiliated of Tianjin Fourth Center Hospital, Tianjin, China
| | - Lei Yang
- Key Laboratory of Sensory Information Processing Abnormalities in Schizophrenia (SIPAS_Lab), Tianjin Fourth Center Hospital, Nankai University Affiliated Tianjin Fourth Center Hospital, Tianjin Medical University Affiliated of Tianjin Fourth Center Hospital, Tianjin, China
| | - Qiuyu Zhang
- Key Laboratory of Sensory Information Processing Abnormalities in Schizophrenia (SIPAS_Lab), Tianjin Fourth Center Hospital, Nankai University Affiliated Tianjin Fourth Center Hospital, Tianjin Medical University Affiliated of Tianjin Fourth Center Hospital, Tianjin, China
| | - Qianchen Li
- Key Laboratory of Sensory Information Processing Abnormalities in Schizophrenia (SIPAS_Lab), Tianjin Fourth Center Hospital, Nankai University Affiliated Tianjin Fourth Center Hospital, Tianjin Medical University Affiliated of Tianjin Fourth Center Hospital, Tianjin, China
| | - Lina Wang
- Department of Psychiatry, Tianjin Anding Hospital, Tianjin Mental Health Center of Tianjin Medical University, Nankai University Affiliated Tianjin Anding Hospital, Tianjin, China
| | - Xiaoyan Ma
- Department of Psychiatry, Tianjin Anding Hospital, Tianjin Mental Health Center of Tianjin Medical University, Nankai University Affiliated Tianjin Anding Hospital, Tianjin, China
| | - Yun Sun
- Department of Psychiatry, Tianjin Anding Hospital, Tianjin Mental Health Center of Tianjin Medical University, Nankai University Affiliated Tianjin Anding Hospital, Tianjin, China
| | - Feng Jia
- Department of Psychiatry, Tianjin Anding Hospital, Tianjin Mental Health Center of Tianjin Medical University, Nankai University Affiliated Tianjin Anding Hospital, Tianjin, China
| | - Hongjun Tian
- Key Laboratory of Sensory Information Processing Abnormalities in Schizophrenia (SIPAS_Lab), Tianjin Fourth Center Hospital, Nankai University Affiliated Tianjin Fourth Center Hospital, Tianjin Medical University Affiliated of Tianjin Fourth Center Hospital, Tianjin, China
| | - Deguo Jiang
- Department of Psychiatry, Wenzhou Seventh Peoples Hospital, Wenzhou, China
| |
Collapse
|
12
|
Liang J, Li Y, Zhang Z, Luo W. Sound gaps boost emotional audiovisual integration independent of attention: Evidence from an ERP study. Biol Psychol 2021; 168:108246. [PMID: 34968556 DOI: 10.1016/j.biopsycho.2021.108246] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2021] [Revised: 12/18/2021] [Accepted: 12/23/2021] [Indexed: 11/02/2022]
Abstract
The emotion discrimination paradigm was adopted to study the effect of interrupted sound on visual emotional processing under different attentional states. There were two experiments: Experiment 1: judging facial expressions (explicit task), Experiment 2: judging the position of a bar (implicit task). In Experiment 1, ERP results showed that there was a sound gap accelerating the effect of P1 present only under neutral faces. In Experiment 2, the accelerating effect (P1) existed regardless of the emotional condition. Combining two experiments, P1 findings suggest that sound gap enhances bottom-up attention. The N170 and late positive component (LPC) were found to be regulated by emotion face in both experiments, with fear over the neutral. Comparing the two experiments, the explicit task induced a larger LPC than the implicit task. Overall, sound gaps boosted the audiovisual integration by bottom-up attention in early integration, while cognitive expectations led to top-down attention in late stages.
Collapse
Affiliation(s)
- Junyu Liang
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian 116029, Liaoning Province, China
| | - Yuchen Li
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian 116029, Liaoning Province, China
| | - Zhao Zhang
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Institute of Psychology, Weifang Medical University, Weifang 216053, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian 116029, Liaoning Province, China
| | - Wenbo Luo
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian 116029, Liaoning Province, China.
| |
Collapse
|
13
|
Wang X, Xie H, Chen T, Cotton AS, Salminen LE, Logue MW, Clarke-Rubright EK, Wall J, Dennis EL, O'Leary BM, Abdallah CG, Andrew E, Baugh LA, Bomyea J, Bruce SE, Bryant R, Choi K, Daniels JK, Davenport ND, Davidson RJ, DeBellis M, deRoon-Cassini T, Disner SG, Fani N, Fercho KA, Fitzgerald J, Forster GL, Frijling JL, Geuze E, Gomaa H, Gordon EM, Grupe D, Harpaz-Rotem I, Haswell CC, Herzog JI, Hofmann D, Hollifield M, Hosseini B, Hudson AR, Ipser J, Jahanshad N, Jovanovic T, Kaufman ML, King AP, Koch SBJ, Koerte IK, Korgaonkar MS, Krystal JH, Larson C, Lebois LAM, Levy I, Li G, Magnotta VA, Manthey A, May G, McLaughlin KA, Mueller SC, Nawijn L, Nelson SM, Neria Y, Nitschke JB, Olff M, Olson EA, Peverill M, Phan KL, Rashid FM, Ressler K, Rosso IM, Sambrook K, Schmahl C, Shenton ME, Sierk A, Simons JS, Simons RM, Sponheim SR, Stein MB, Stein DJ, Stevens JS, Straube T, Suarez-Jimenez B, Tamburrino M, Thomopoulos SI, van der Wee NJA, van der Werff SJA, van Erp TGM, van Rooij SJH, van Zuiden M, Varkevisser T, Veltman DJ, Vermeiren RRJM, Walter H, Wang L, Zhu Y, Zhu X, Thompson PM, Morey RA, Liberzon I. Cortical volume abnormalities in posttraumatic stress disorder: an ENIGMA-psychiatric genomics consortium PTSD workgroup mega-analysis. Mol Psychiatry 2021; 26:4331-4343. [PMID: 33288872 PMCID: PMC8180531 DOI: 10.1038/s41380-020-00967-1] [Citation(s) in RCA: 46] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/09/2020] [Revised: 10/29/2020] [Accepted: 11/18/2020] [Indexed: 01/31/2023]
Abstract
Studies of posttraumatic stress disorder (PTSD) report volume abnormalities in multiple regions of the cerebral cortex. However, findings for many regions, particularly regions outside commonly studied emotion-related prefrontal, insular, and limbic regions, are inconsistent and tentative. Also, few studies address the possibility that PTSD abnormalities may be confounded by comorbid depression. A mega-analysis investigating all cortical regions in a large sample of PTSD and control subjects can potentially provide new insight into these issues. Given this perspective, our group aggregated regional volumes data of 68 cortical regions across both hemispheres from 1379 PTSD patients to 2192 controls without PTSD after data were processed by 32 international laboratories using ENIGMA standardized procedures. We examined whether regional cortical volumes were different in PTSD vs. controls, were associated with posttraumatic stress symptom (PTSS) severity, or were affected by comorbid depression. Volumes of left and right lateral orbitofrontal gyri (LOFG), left superior temporal gyrus, and right insular, lingual and superior parietal gyri were significantly smaller, on average, in PTSD patients than controls (standardized coefficients = -0.111 to -0.068, FDR corrected P values < 0.039) and were significantly negatively correlated with PTSS severity. After adjusting for depression symptoms, the PTSD findings in left and right LOFG remained significant. These findings indicate that cortical volumes in PTSD patients are smaller in prefrontal regulatory regions, as well as in broader emotion and sensory processing cortical regions.
Collapse
Affiliation(s)
- Xin Wang
- Department of Psychiatry, University of Toledo, Toledo, OH, USA.
| | - Hong Xie
- Department of Neurosciences, University of Toledo, Toledo, OH, USA
| | - Tian Chen
- Department of Mathematics and Statistics, University of Toledo, Toledo, OH, USA
| | - Andrew S Cotton
- Department of Psychiatry, University of Toledo, Toledo, OH, USA
| | - Lauren E Salminen
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
| | - Mark W Logue
- National Center for PTSD, VA Boston Healthcare System, Boston, MA, USA
- Department of Psychiatry, Boston University School of Medicine, Boston, MA, USA
| | - Emily K Clarke-Rubright
- Brain Imaging and Analysis Center, Duke University, Durham, NC, USA
- VISN 6 MIRECC, Durham VA Health Care System, Durham, NC, USA
| | - John Wall
- Department of Neurosciences, University of Toledo, Toledo, OH, USA
| | - Emily L Dennis
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
- Department of Neurology, University of Utah, Salt Lake City, UT, USA
| | - Brian M O'Leary
- Department of Psychiatry, University of Toledo, Toledo, OH, USA
| | - Chadi G Abdallah
- Clinical Neuroscience Division, National Center for PTSD, VA Connecticut Healthcare System, West Haven, CT, USA
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA
| | | | - Lee A Baugh
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD, USA
- Center for Brain and Behavior Research, University of South Dakota, Vermillion, SD, USA
- Sioux Falls VA Health Care System, Sioux Falls, SD, USA
| | - Jessica Bomyea
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
| | - Steven E Bruce
- Center for Trauma Recovery, Department of Psychological Sciences, University of Missouri-St. Louis, St. Louis, MO, USA
| | - Richard Bryant
- School of Psychology, University of New South Wales, Sydney, NSW, Australia
| | - Kyle Choi
- Health Services Research Center, University of California, San Diego, La Jolla, CA, USA
| | - Judith K Daniels
- Department of Clinical Psychology, University of Groningen, Groningen, The Netherlands
| | - Nicholas D Davenport
- Minneapolis VA Health Care System, Minneapolis, MN, USA
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Richard J Davidson
- Center for Healthy Minds, University of Wisconsin-Madison, Madison, WI, USA
- Department of Psychology, University of Wisconsin-Madison, Madison, WI, USA
- Department of Psychiatry, University of Wisconsin-Madison, Madison, WI, USA
| | - Michael DeBellis
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
| | - Terri deRoon-Cassini
- Department of Surgery, Division of Trauma & Acute Care Surgery, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Seth G Disner
- Minneapolis VA Health Care System, Minneapolis, MN, USA
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Negar Fani
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, USA
| | - Kelene A Fercho
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD, USA
- Center for Brain and Behavior Research, University of South Dakota, Vermillion, SD, USA
- Sioux Falls VA Health Care System, Sioux Falls, SD, USA
- Civil Aerospace Medical Institute, US Federal Aviation Administration, Oklahoma City, OK, USA
| | | | - Gina L Forster
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD, USA
- Brain Health Research Centre, Department of Anatomy, University of Otago, Dunedin, New Zealand
| | - Jessie L Frijling
- Department of Psychiatry, Amsterdam University Medical Centers, Location Academic Medical Center, Amsterdam Neuroscience, University of Amsterdam, Amsterdam, The Netherlands
| | - Elbert Geuze
- Brain Center Rudolf Magnus, Department of Psychiatry, University Medical Center Utrecht, Utrecht, The Netherlands
- Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The Netherlands
| | - Hassaan Gomaa
- Department of Psychiatry and Behavioral Health, Penn State College of Medicine, Hershey, PA, USA
| | - Evan M Gordon
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, USA
| | - Dan Grupe
- Department of Psychology, University of Wisconsin-Madison, Madison, WI, USA
| | - Ilan Harpaz-Rotem
- Clinical Neuroscience Division, National Center for PTSD, VA Connecticut Healthcare System, West Haven, CT, USA
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA
| | - Courtney C Haswell
- Brain Imaging and Analysis Center, Duke University, Durham, NC, USA
- VISN 6 MIRECC, Durham VA Health Care System, Durham, NC, USA
| | - Julia I Herzog
- Department of Psychosomatic Medicine and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany
| | - David Hofmann
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Münster, Germany
| | - Michael Hollifield
- Program for Traumatic Stress, Tibor Rubin VA Medical Center, Long Beach, CA, USA
| | - Bobak Hosseini
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA
| | - Anna R Hudson
- Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium
| | - Jonathan Ipser
- Department of Psychiatry, University of Cape Town, Cape Town, South Africa
| | - Neda Jahanshad
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
| | - Tanja Jovanovic
- Department of Psychiatry and Behavioral Neurosciences, Wayne State University, Detroit, MI, USA
| | - Milissa L Kaufman
- Division of Women's Mental Health, McLean Hospital, Belmont, MA, USA
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Anthony P King
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, USA
| | - Saskia B J Koch
- Department of Psychiatry, Amsterdam University Medical Centers, Location Academic Medical Center, Amsterdam Neuroscience, University of Amsterdam, Amsterdam, The Netherlands
- Donders Institute for Brain, Cognition and Behavior, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - Inga K Koerte
- Psychiatry Neuroimaging Laboratory, Brigham and Women's Hospital, Boston, MA, USA
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Ludwig-Maximilians-Universität, Munich, Germany
| | - Mayuresh S Korgaonkar
- Brain Dynamics Centre, Westmead Institute of Medical Research, University of Sydney, Westmead, NSW, Australia
| | - John H Krystal
- Clinical Neuroscience Division, National Center for PTSD, VA Connecticut Healthcare System, West Haven, CT, USA
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA
| | - Christine Larson
- Department of Psychology, University of Wisconsin-Milwaukee, Milwaukee, WI, USA
| | - Lauren A M Lebois
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
- Division of Depression and Anxiety Disorders, McLean Hospital, Belmont, MA, USA
| | - Ifat Levy
- Clinical Neuroscience Division, National Center for PTSD, VA Connecticut Healthcare System, West Haven, CT, USA
- Department of Comparative Medicine, Yale University School of Medicine, New Haven, CT, USA
| | - Gen Li
- Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Vincent A Magnotta
- Departments of Radiology, Psychiatry, and Biomedical Engineering, University of Iowa, Iowa City, IA, USA
| | - Antje Manthey
- Charité Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Geoffrey May
- VISN 17 Center of Excellence for Research on Returning War Veterans, Doris Miller VA Medical Center, Waco, TX, USA
- Center for Vital Longevity, School of Behavioral and Brain Sciences, University of Texas at Dallas, Dallas, TX, USA
- Department of Psychology and Neuroscience, Baylor University, Waco, TX, USA
- Department of Psychiatry and Behavioral Science, Texas A&M University College of Medicine, College Station, TX, USA
| | | | - Sven C Mueller
- Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium
- Department of Personality, Psychological Assessment and Treatment, University of Deusto, Bilbao, Spain
| | - Laura Nawijn
- Department of Psychiatry, Amsterdam University Medical Centers, Location Academic Medical Center, Amsterdam Neuroscience, University of Amsterdam, Amsterdam, The Netherlands
- Department of Psychiatry, Amsterdam University Medical Centers, Location VU University Medical Center, VU University, Amsterdam, The Netherlands
| | - Steven M Nelson
- VISN 17 Center of Excellence for Research on Returning War Veterans, Doris Miller VA Medical Center, Waco, TX, USA
- Center for Vital Longevity, School of Behavioral and Brain Sciences, University of Texas at Dallas, Dallas, TX, USA
- Department of Psychology and Neuroscience, Baylor University, Waco, TX, USA
| | - Yuval Neria
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA
- New York State Psychiatric Institute, New York, NY, USA
| | - Jack B Nitschke
- Department of Psychiatry, University of Wisconsin-Madison, Madison, WI, USA
| | - Miranda Olff
- Department of Psychiatry, Amsterdam University Medical Centers, Location Academic Medical Center, Amsterdam Neuroscience, University of Amsterdam, Amsterdam, The Netherlands
- ARQ National Psychotrauma Centrum, Diemen, The Netherlands
| | - Elizabeth A Olson
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
- Center for Depression, Anxiety, and Stress Research, McLean Hospital, Belmont, MA, USA
| | - Matthew Peverill
- Department of Psychology, University of Washington, Seattle, WA, USA
| | - K Luan Phan
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA
- The Ohio State University Wexner Medical Center, Columbus, OH, USA
- Mental Health Service Line, Jesse Brown VA Medical Center, Chicago, IL, USA
| | - Faisal M Rashid
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
| | - Kerry Ressler
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
- Division of Depression and Anxiety Disorders, McLean Hospital, Belmont, MA, USA
| | - Isabelle M Rosso
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
- Center for Depression, Anxiety, and Stress Research, McLean Hospital, Belmont, MA, USA
| | - Kelly Sambrook
- Department of Radiology, University of Washington, Seattle, WA, USA
| | - Christian Schmahl
- Department of Psychosomatic Medicine and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany
- Department of Psychiatry, University of Western Ontario, London, ON, Canada
| | - Martha E Shenton
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
- Psychiatry Neuroimaging Laboratory, Brigham and Women's Hospital, Boston, MA, USA
- Department of Psychiatry, VA Boston Healthcare System, Brockton, MA, USA
- Department of Radiology, Harvard Medical School, Boston, MA, USA
| | - Anika Sierk
- Charité Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Jeffrey S Simons
- Sioux Falls VA Health Care System, Sioux Falls, SD, USA
- Department of Psychology, University of South Dakota, Vermillion, SD, USA
| | - Raluca M Simons
- Center for Brain and Behavior Research, University of South Dakota, Vermillion, SD, USA
- Department of Psychology, University of South Dakota, Vermillion, SD, USA
| | - Scott R Sponheim
- Minneapolis VA Health Care System, Minneapolis, MN, USA
- Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA
| | - Murray B Stein
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA
- Department of Family Medicine and Public Health, University of California, San Diego, La Jolla, CA, USA
| | - Dan J Stein
- SAMRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry and Neuroscience Institute, University of Cape Town, Cape Town, South Africa
| | - Jennifer S Stevens
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, USA
| | - Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Münster, Germany
| | - Benjamin Suarez-Jimenez
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA
- New York State Psychiatric Institute, New York, NY, USA
| | | | - Sophia I Thomopoulos
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
| | - Nic J A van der Wee
- Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands
- Leiden Institute for Brain and Cognition, Leiden, The Netherlands
| | - Steven J A van der Werff
- Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands
- Leiden Institute for Brain and Cognition, Leiden, The Netherlands
| | - Theo G M van Erp
- Clinical Translational Neuroscience Laboratory, Department of Psychiatry and Human Behavior, University of California, Irvine, Irvine, CA, USA
- Center for the Neurobiology of Learning and Memory, University of California, Irvine, Irvine, CA, USA
| | - Sanne J H van Rooij
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, USA
| | - Mirjam van Zuiden
- Department of Psychiatry, Amsterdam University Medical Centers, Location Academic Medical Center, Amsterdam Neuroscience, University of Amsterdam, Amsterdam, The Netherlands
| | - Tim Varkevisser
- Brain Center Rudolf Magnus, Department of Psychiatry, University Medical Center Utrecht, Utrecht, The Netherlands
- Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The Netherlands
| | - Dick J Veltman
- Department of Psychiatry, Amsterdam University Medical Centers, Location VU University Medical Center, VU University, Amsterdam, The Netherlands
| | - Robert R J M Vermeiren
- Child and Adolescent Psychiatry, Leiden University Medical Center, Leiden, The Netherlands
- Youz-Parnassia Group, Leiden, The Netherlands
| | - Henrik Walter
- Charité Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Li Wang
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- Laboratory for Traumatic Stress Studies, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
| | - Ye Zhu
- Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Xi Zhu
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA
- New York State Psychiatric Institute, New York, NY, USA
| | - Paul M Thompson
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
| | - Rajendra A Morey
- Brain Imaging and Analysis Center, Duke University, Durham, NC, USA
- VISN 6 MIRECC, Durham VA Health Care System, Durham, NC, USA
| | - Israel Liberzon
- Department of Psychiatry and Behavioral Science, Texas A&M University College of Medicine, College Station, TX, USA
| |
Collapse
|
14
|
Xu J, Dong H, Li N, Wang Z, Guo F, Wei J, Dang J. Weighted RSA: An Improved Framework on the Perception of Audio-visual Affective Speech in Left Insula and Superior Temporal Gyrus. Neuroscience 2021; 469:46-58. [PMID: 34119576 DOI: 10.1016/j.neuroscience.2021.06.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2021] [Revised: 05/16/2021] [Accepted: 06/02/2021] [Indexed: 12/24/2022]
Abstract
Being able to accurately perceive the emotion expressed by the facial or verbal expression from others is critical to successful social interaction. However, only few studies examined the multimodal interactions on speech emotion, and there is no consistence in studies on the speech emotion perception. It remains unclear, how the speech emotion of different valence is perceived on the multimodal stimuli by our human brain. In this paper, we conducted a functional magnetic resonance imaging (fMRI) study with an event-related design, using dynamic facial expressions and emotional speech stimuli to express different emotions, in order to explore the perception mechanism of speech emotion in audio-visual modality. The representational similarity analysis (RSA), whole-brain searchlight analysis, and conjunction analysis of emotion were used to interpret the representation of speech emotion in different aspects. Significantly, a weighted RSA approach was creatively proposed to evaluate the contribution of each candidate model to the best fitted model and provided a supplement to RSA. The results of weighted RSA indicated that the fitted models were superior to all candidate models and the weights could be used to explain the representation of ROIs. The bilateral amygdala has been shown to be associated with the processing of both positive and negative emotions except neutral emotion. It is indicated that the left posterior insula and the left anterior superior temporal gyrus (STG) play important roles in the perception of multimodal speech emotion.
Collapse
Affiliation(s)
- Junhai Xu
- College of Intelligence and Computing, Tianjin Key Lab of Cognitive Computing and Application, Tianjin University, Tianjin, China
| | - Haibin Dong
- College of Intelligence and Computing, Tianjin Key Lab of Cognitive Computing and Application, Tianjin University, Tianjin, China; State Grid Tianjin Electric Power Company, China
| | - Na Li
- College of Intelligence and Computing, Tianjin Key Lab of Cognitive Computing and Application, Tianjin University, Tianjin, China
| | - Zeyu Wang
- College of Intelligence and Computing, Tianjin Key Lab of Cognitive Computing and Application, Tianjin University, Tianjin, China
| | - Fei Guo
- School of Computer Science and Engineering, Central South University, Changsha 410083, China.
| | - Jianguo Wei
- College of Intelligence and Computing, Tianjin Key Lab of Cognitive Computing and Application, Tianjin University, Tianjin, China.
| | - Jianwu Dang
- College of Intelligence and Computing, Tianjin Key Lab of Cognitive Computing and Application, Tianjin University, Tianjin, China; School of Information Science, Japan Advanced Institute of Science and Technology, Japan
| |
Collapse
|
15
|
The adhesio interthalamica as a neuroanatomical marker of structural differences in healthy adult population. Brain Struct Funct 2021; 226:1871-1878. [PMID: 34014400 DOI: 10.1007/s00429-021-02297-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 05/08/2021] [Indexed: 10/21/2022]
Abstract
The adhesio interthalamica (AI) is a small midline brain structure that connects the left and right thalamus. According to in vivo data, between 2.3 and 22.3% of the general population lack the AI, and the question of whether this absence is more prevalent in males than in females is a matter of debate. Despite the existence of these demographic figures, it remains unclear how this distinctive feature affects healthy people, or what specific anatomic profile is related to the presence or absence of the AI. The aim of this study was to investigate whole-brain gray matter (GM) volumetric differences depending on the presence or absence of the AI. A total of 240 healthy adult volunteers completed one MRI scanning session. After the AI assessment, the data from 110 participants were included in the final sample, of which 12.9% of the participants (n = 31) presented complete AI absence vs. 32.9% of participants (n = 79) who presented complete AI presence. Then, whole-brain group comparison analysis revealed that the absent AI brain, compared to the present AI brain, was associated with lower GM volume in the premotor cortex, inferior frontal gyrus, and anterior temporal cortex. Interestingly, neuroscience research has linked emotional and cognitive control brain processing to the latter two regions. The importance of these findings lies in providing a neuroanatomical profile for the absent AI brain in healthy human adults.
Collapse
|
16
|
Modality-general and modality-specific audiovisual valence processing. Cortex 2021; 138:127-137. [PMID: 33684626 DOI: 10.1016/j.cortex.2021.01.022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 11/08/2020] [Accepted: 01/20/2021] [Indexed: 11/23/2022]
Abstract
A fundamental question in affective neuroscience is whether there is a common hedonic system for valence processing independent of modality, or there are distinct neural systems for different modalities. To address this question, we used both region of interest and whole-brain representational similarity analyses on functional magnetic resonance imaging data to identify modality-general and modality-specific brain areas involved in valence processing across visual and auditory modalities. First, region of interest analyses showed that the superior temporal cortex was associated with both modality-general and auditory-specific models, while the primary visual cortex was associated with the visual-specific model. Second, the whole-brain searchlight analyses also identified both modality-general and modality-specific representations. The modality-general regions included the superior temporal, medial superior frontal, inferior frontal, precuneus, precentral, postcentral, supramarginal, paracentral lobule and middle cingulate cortices. The modality-specific regions included both perceptual cortices and higher-order brain areas. The valence representations derived from individualized behavioral valence ratings were consistent with these results. Together, these findings suggest both modality-general and modality-specific representations of valence.
Collapse
|
17
|
Gao C, Xie W, Green JJ, Wedell DH, Jia X, Guo C, Shinkareva SV. Evoked and induced power oscillations linked to audiovisual integration of affect. Biol Psychol 2020; 158:108006. [PMID: 33301827 DOI: 10.1016/j.biopsycho.2020.108006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Revised: 10/28/2020] [Accepted: 11/30/2020] [Indexed: 12/16/2022]
Abstract
Our affective experiences are influenced by combined multisensory information. Although the enhanced effects of congruent audiovisual information on our affective experiences have been well documented, the role of neural oscillations in the audiovisual integration of affective signals remains unclear. First, it is unclear whether oscillatory activity changes as a function of valence. Second, the function of phase-locked and non-phase-locked power changes in audiovisual integration of affect has not yet been clearly distinguished. To fill this gap, the present study performed time-frequency analyses on EEG data acquired while participants perceived positive, neutral and negative naturalistic video and music clips. A comparison between the congruent audiovisual condition and the sum of unimodal conditions was used to identify supra-additive (Audiovisual > Visual + Auditory) or sub-additive (Audiovisual < Visual + Auditory) integration effects. The results showed that early evoked sub-additive theta and sustained induced supra-additive delta and beta activities are linked to audiovisual integration of affect regardless of affective content.
Collapse
Affiliation(s)
- Chuanji Gao
- Department of Psychology, Institute for Mind and Brain, University of South Carolina, Columbia, SC, 29201, USA
| | - Wanze Xie
- Children's Hospital, Harvard Medical School, Boston, MA, 02215, USA
| | - Jessica J Green
- Department of Psychology, Institute for Mind and Brain, University of South Carolina, Columbia, SC, 29201, USA
| | - Douglas H Wedell
- Department of Psychology, Institute for Mind and Brain, University of South Carolina, Columbia, SC, 29201, USA
| | - Xi Jia
- Beijing Key Laboratory of Learning and Cognition, School of Psychology, Capital Normal University, Beijing, 10048, PR China
| | - Chunyan Guo
- Beijing Key Laboratory of Learning and Cognition, School of Psychology, Capital Normal University, Beijing, 10048, PR China.
| | - Svetlana V Shinkareva
- Department of Psychology, Institute for Mind and Brain, University of South Carolina, Columbia, SC, 29201, USA.
| |
Collapse
|
18
|
Shinkareva SV, Gao C, Wedell D. Audiovisual Representations of Valence: a Cross-study Perspective. ACTA ACUST UNITED AC 2020; 1:237-246. [DOI: 10.1007/s42761-020-00023-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Accepted: 10/22/2020] [Indexed: 01/25/2023]
|
19
|
Maffei A, Polver S, Spironelli C, Angrilli A. EEG gamma activity to emotional movies in individuals with high traits of primary "successful" psychopathy. Brain Cogn 2020; 143:105599. [PMID: 32652444 DOI: 10.1016/j.bandc.2020.105599] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2020] [Revised: 06/26/2020] [Accepted: 06/28/2020] [Indexed: 12/22/2022]
Abstract
This study aimed to investigate emotional alterations in a community sample with primary psychopathic traits. Sixty males selected from a larger sample and divided in two groups, High (HP) and Low (LP) primary Psychopathy, watched 15 validated emotional movies divided in five categories (Erotic, Neutral, Fear, and the new Scenery and Compassion). Subjective responses and cortical activity in the EEG Gamma band (30-49 Hz) were recorded. Concerning self-reports, HP participants felt less anxious and anguished in response to Fear clips and less sad, touched and anguished by Compassion excerpts. Negative clips induced larger EEG Gamma activity in both groups compared to neutral and erotic movies, but Gamma activity to Fear movies was reduced in HP. This group showed also a small cortical response to positive Scenery movies, at the level of the Neutral ones. Source analysis showed in HP participants a reduced cortical activation to Fear in a large brain network, comprising the right prefrontal and temporal cortices and bilateral inferior parietal cortex. Results showed that primary psychopathy, in addition to the impaired response to Fear, was associated with a reduced response also to other specific categories of emotional stimuli, suggesting an altered affect on a broader scale.
Collapse
Affiliation(s)
- Antonio Maffei
- Department of General Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy
| | - Silvia Polver
- Department of General Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy
| | - Chiara Spironelli
- Department of General Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy; PNC - Padova Neuroscience Center, University of Padova, Via Orus 2, 35131 Padova, Italy
| | - Alessandro Angrilli
- Department of General Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy; IN CNR Institute of Neuroscience, Padova Section, Viale Colombo 3, 35131 Padova, Italy; PNC - Padova Neuroscience Center, University of Padova, Via Orus 2, 35131 Padova, Italy.
| |
Collapse
|
20
|
Gao C, Weber CE, Wedell DH, Shinkareva SV. An fMRI Study of Affective Congruence across Visual and Auditory Modalities. J Cogn Neurosci 2020; 32:1251-1262. [DOI: 10.1162/jocn_a_01553] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
Abstract
Evaluating multisensory emotional content is a part of normal day-to-day interactions. We used fMRI to examine brain areas sensitive to congruence of audiovisual valence and their overlap with areas sensitive to valence. Twenty-one participants watched audiovisual clips with either congruent or incongruent valence across visual and auditory modalities. We showed that affective congruence versus incongruence across visual and auditory modalities is identifiable on a trial-by-trial basis across participants. Representations of affective congruence were widely distributed with some overlap with the areas sensitive to valence. Regions of overlap included bilateral superior temporal cortex and right pregenual anterior cingulate. The overlap between the regions identified here and in the emotion congruence literature lends support to the idea that valence may be a key determinant of affective congruence processing across a variety of discrete emotions.
Collapse
|
21
|
A study in affect: Predicting valence from fMRI data. Neuropsychologia 2020; 143:107473. [DOI: 10.1016/j.neuropsychologia.2020.107473] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2019] [Revised: 04/10/2020] [Accepted: 04/19/2020] [Indexed: 12/19/2022]
|
22
|
Young AW, Frühholz S, Schweinberger SR. Face and Voice Perception: Understanding Commonalities and Differences. Trends Cogn Sci 2020; 24:398-410. [DOI: 10.1016/j.tics.2020.02.001] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2019] [Revised: 01/16/2020] [Accepted: 02/03/2020] [Indexed: 01/01/2023]
|