1
|
Robert P, Zatorre R, Gupta A, Sein J, Anton JL, Belin P, Thoret E, Morillon B. Auditory hemispheric asymmetry for actions and objects. Cereb Cortex 2024; 34:bhae292. [PMID: 39051660 DOI: 10.1093/cercor/bhae292] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 06/08/2024] [Accepted: 07/03/2024] [Indexed: 07/27/2024] Open
Abstract
What is the function of auditory hemispheric asymmetry? We propose that the identification of sound sources relies on the asymmetric processing of two complementary and perceptually relevant acoustic invariants: actions and objects. In a large dataset of environmental sounds, we observed that temporal and spectral modulations display only weak covariation. We then synthesized auditory stimuli by simulating various actions (frictions) occurring on different objects (solid surfaces). Behaviorally, discrimination of actions relies on temporal modulations, while discrimination of objects relies on spectral modulations. Functional magnetic resonance imaging data showed that actions and objects are decoded in the left and right hemispheres, respectively, in bilateral superior temporal and left inferior frontal regions. This asymmetry reflects a generic differential processing-through differential neural sensitivity to temporal and spectral modulations present in environmental sounds-that supports the efficient categorization of actions and objects. These results support an ecologically valid framework of the functional role of auditory brain asymmetry.
Collapse
Affiliation(s)
- Paul Robert
- Institut de Neurosciences des Systèmes (INS), Inserm/UMR1106, Aix Marseille University, 27 Bd Jean Moulin, Marseille 13005, France
| | - Robert Zatorre
- Montreal Neurological Institute (MNI), Cognitive Neuroscience Unit, McGill University, 3801 Rue University, Montréal, QC H3A 2B4, Canada
- Centre for Research in Brain, Language, and Music (CRBLM), McGill University, Faculty of Medicine 3640 de la Montagne, Montreal QC H3G 2A8, Canada
| | - Akanksha Gupta
- Institut de Neurosciences des Systèmes (INS), Inserm/UMR1106, Aix Marseille University, 27 Bd Jean Moulin, Marseille 13005, France
| | - Julien Sein
- Institut de Neurosciences de la Timone (INT), CNRS/UMR7289, Aix Marseille University, 27 Bd Jean Moulin, Marseille 13005, France
| | - Jean-Luc Anton
- Institut de Neurosciences de la Timone (INT), CNRS/UMR7289, Aix Marseille University, 27 Bd Jean Moulin, Marseille 13005, France
| | - Pascal Belin
- Institut de Neurosciences de la Timone (INT), CNRS/UMR7289, Aix Marseille University, 27 Bd Jean Moulin, Marseille 13005, France
| | - Etienne Thoret
- Institut de Neurosciences de la Timone (INT), CNRS/UMR7289, Aix Marseille University, 27 Bd Jean Moulin, Marseille 13005, France
- PRISM Laboratory, CNRS/UMR7061, Aix Marseille University, 31 Chemin Joseph Aiguier, Marseille, 13402 Cedex 20, France
- Laboratoire d'Informatique et Systèmes (LIS), CNRS/UMR7020, Aix Marseille University, 52 Av Escadrille Normandie Niemen, Marseille, 13397 Cedex 20, France
- Institute of Language, Communication, and the Brain (ILCB), Aix Marseille University, 5 avenue Pasteur, Aix-en-Provence, 13604 Cedex 1, France
| | - Benjamin Morillon
- Institut de Neurosciences des Systèmes (INS), Inserm/UMR1106, Aix Marseille University, 27 Bd Jean Moulin, Marseille 13005, France
| |
Collapse
|
2
|
Kuhnke P, Kiefer M, Hartwigsen G. Conceptual representations in the default, control and attention networks are task-dependent and cross-modal. BRAIN AND LANGUAGE 2023; 244:105313. [PMID: 37595340 DOI: 10.1016/j.bandl.2023.105313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 07/03/2023] [Accepted: 08/10/2023] [Indexed: 08/20/2023]
Abstract
Conceptual knowledge is central to human cognition. Neuroimaging studies suggest that conceptual processing involves modality-specific and multimodal brain regions in a task-dependent fashion. However, it remains unclear (1) to what extent conceptual feature representations are also modulated by the task, (2) whether conceptual representations in multimodal regions are indeed cross-modal, and (3) how the conceptual system relates to the large-scale functional brain networks. To address these issues, we conducted multivariate pattern analyses on fMRI data. 40 participants performed three tasks-lexical decision, sound judgment, and action judgment-on written words. We found that (1) conceptual feature representations are strongly modulated by the task, (2) conceptual representations in several multimodal regions are cross-modal, and (3) conceptual feature retrieval involves the default, frontoparietal control, and dorsal attention networks. Conceptual representations in these large-scale networks are task-dependent and cross-modal. Our findings support theories that assume conceptual processing to rely on a flexible, multi-level architecture.
Collapse
Affiliation(s)
- Philipp Kuhnke
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | | | - Gesa Hartwigsen
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
3
|
Heller LM, Smith JM. Identification of Everyday Sounds Affects Their Pleasantness. Front Psychol 2022; 13:894034. [PMID: 35936236 PMCID: PMC9347306 DOI: 10.3389/fpsyg.2022.894034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 06/20/2022] [Indexed: 11/19/2022] Open
Abstract
This study examines the role of source identification in the emotional response to everyday sounds. Although it is widely acknowledged that sound identification modulates the unpleasantness of sounds, this assumption is based on sparse evidence on a select few sounds. We gathered more robust evidence by having listeners judge the causal properties of sounds, such as actions, materials, and causal agents. Participants also identified and rated the pleasantness of the sounds. We included sounds from a variety of emotional categories, such as Neutral, Misophonic, Unpleasant, and Pleasant. The Misophonic category consists of everyday sounds that are uniquely distressing to a subset of listeners who suffer from Misophonia. Sounds from different emotional categories were paired together based on similar causal properties. This enabled us to test the prediction that a sound’s pleasantness should increase or decrease if it is misheard as being in a more or less pleasant emotional category, respectively. Furthermore, we were able to induce more misidentifications by imposing spectral degradation in the form of envelope vocoding. Several instances of misidentification were obtained, all of which showed pleasantness changes that agreed with our predictions.
Collapse
|
4
|
Kuhnke P, Kiefer M, Hartwigsen G. Task-Dependent Functional and Effective Connectivity during Conceptual Processing. Cereb Cortex 2021; 31:3475-3493. [PMID: 33677479 PMCID: PMC8196308 DOI: 10.1093/cercor/bhab026] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Revised: 01/21/2021] [Accepted: 01/22/2021] [Indexed: 11/13/2022] Open
Abstract
Conceptual knowledge is central to cognition. Previous neuroimaging research indicates that conceptual processing involves both modality-specific perceptual-motor areas and multimodal convergence zones. For example, our previous functional magnetic resonance imaging (fMRI) study revealed that both modality-specific and multimodal regions respond to sound and action features of concepts in a task-dependent fashion (Kuhnke P, Kiefer M, Hartwigsen G. 2020b. Task-dependent recruitment of modality-specific and multimodal regions during conceptual processing. Cereb Cortex. 30:3938–3959.). However, it remains unknown whether and how modality-specific and multimodal areas interact during conceptual tasks. Here, we asked 1) whether multimodal and modality-specific areas are functionally coupled during conceptual processing, 2) whether their coupling depends on the task, 3) whether information flows top-down, bottom-up or both, and 4) whether their coupling is behaviorally relevant. We combined psychophysiological interaction analyses with dynamic causal modeling on the fMRI data of our previous study. We found that functional coupling between multimodal and modality-specific areas strongly depended on the task, involved both top-down and bottom-up information flow, and predicted conceptually guided behavior. Notably, we also found coupling between different modality-specific areas and between different multimodal areas. These results suggest that functional coupling in the conceptual system is extensive, reciprocal, task-dependent, and behaviorally relevant. We propose a new model of the conceptual system that incorporates task-dependent functional interactions between modality-specific and multimodal areas.
Collapse
Affiliation(s)
- Philipp Kuhnke
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Markus Kiefer
- Department of Psychiatry, Ulm University, Ulm 89081, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| |
Collapse
|
5
|
Kuhnke P, Beaupain MC, Cheung VKM, Weise K, Kiefer M, Hartwigsen G. Left posterior inferior parietal cortex causally supports the retrieval of action knowledge. Neuroimage 2020; 219:117041. [PMID: 32534127 DOI: 10.1016/j.neuroimage.2020.117041] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Revised: 05/07/2020] [Accepted: 06/06/2020] [Indexed: 11/15/2022] Open
Abstract
Conceptual knowledge is central to human cognition. The left posterior inferior parietal lobe (pIPL) is implicated by neuroimaging studies as a multimodal hub representing conceptual knowledge related to various perceptual-motor modalities. However, the causal role of left pIPL in conceptual processing remains unclear. Here, we transiently disrupted left pIPL function with transcranial magnetic stimulation (TMS) to probe its causal relevance for the retrieval of action and sound knowledge. We compared effective TMS over left pIPL with sham TMS, while healthy participants performed three different tasks-lexical decision, action judgment, and sound judgment-on words with a high or low association to actions and sounds. We found that pIPL-TMS selectively impaired action judgments on low sound-low action words. For the first time, we directly related computational simulations of the TMS-induced electrical field to behavioral performance, which revealed that stronger stimulation of left pIPL is associated with worse performance for action but not sound judgments. These results indicate that left pIPL causally supports conceptual processing when action knowledge is task-relevant and cannot be compensated by sound knowledge. Our findings suggest that left pIPL is specialized for the retrieval of action knowledge, challenging the view of left pIPL as a multimodal conceptual hub.
Collapse
Affiliation(s)
- Philipp Kuhnke
- Lise Meitner Research Group 'Cognition and Plasticity', Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - Marie C Beaupain
- Lise Meitner Research Group 'Cognition and Plasticity', Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Vincent K M Cheung
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Konstantin Weise
- Methods and Development Group 'Brain Networks', Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | | | - Gesa Hartwigsen
- Lise Meitner Research Group 'Cognition and Plasticity', Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
6
|
Popp M, Trumpp NM, Sim EJ, Kiefer M. Brain Activation During Conceptual Processing of Action and Sound Verbs. Adv Cogn Psychol 2020; 15:236-255. [PMID: 32494311 PMCID: PMC7251527 DOI: 10.5709/acp-0272-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Grounded cognition approaches to conceptual representations postulate a close link between conceptual knowledge and the sensorimotor brain systems. The present fMRI study tested, whether a feature-specific representation of concepts, as previously demonstrated for nouns, can also be found for action- and sound-related verbs. Participants were presented with action- and soundrelated verbs along with pseudoverbs while performing a lexical decision task. Sound-related verbs activated auditory areas in the temporal cortex, whereas action-related verbs activated brain regions in the superior frontal gyrus and the cerebellum, albeit only at a more liberal threshold. This differential brain activation during conceptual verb processing partially overlapped with or was adjacent to brain regions activated during the functional localizers probing sound perception or action execution. Activity in brain areas involved in the processing of action information was parametrically modulated by ratings of action relevance. Comparisons of action- and sound-related verbs with pseudoverbs revealed activation for both verb categories in auditory and motor areas. In contrast to proposals of strong grounded cognition approaches, our study did not demonstrate a considerable overlap of activations for action- and sound-related verbs and for the corresponding functional localizer tasks. However, in line with weaker variants of grounded cognition theories, the differential activation pattern for action- and sound-related verbs was near corresponding sensorimotor brain regions depending on conceptual feature relevance. Possibly, action-sound coupling resulted in a mutual activation of the motor and the auditory system for both action- and sound-related verbs, thereby reducing the effect sizes for the differential contrasts.
Collapse
Affiliation(s)
- Margot Popp
- Ulm University, Department of Psychiatry, Ulm, Germany
| | | | - Eun-Jin Sim
- Ulm University, Department of Psychiatry, Ulm, Germany
| | - Markus Kiefer
- Ulm University, Department of Psychiatry, Ulm, Germany
| |
Collapse
|
7
|
Kuhnke P, Kiefer M, Hartwigsen G. Task-Dependent Recruitment of Modality-Specific and Multimodal Regions during Conceptual Processing. Cereb Cortex 2020; 30:3938-3959. [PMID: 32219378 PMCID: PMC7264643 DOI: 10.1093/cercor/bhaa010] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 01/08/2020] [Accepted: 01/15/2020] [Indexed: 01/12/2023] Open
Abstract
Conceptual knowledge is central to cognitive abilities such as word comprehension. Previous neuroimaging evidence indicates that concepts are at least partly composed of perceptual and motor features that are represented in the same modality-specific brain regions involved in actual perception and action. However, it is unclear to what extent the retrieval of perceptual-motor features and the resulting engagement of modality-specific regions depend on the concurrent task. To address this issue, we measured brain activity in 40 young and healthy participants using functional magnetic resonance imaging, while they performed three different tasks-lexical decision, sound judgment, and action judgment-on words that independently varied in their association with sounds and actions. We found neural activation for sound and action features of concepts selectively when they were task-relevant in brain regions also activated during auditory and motor tasks, respectively, as well as in higher-level, multimodal regions which were recruited during both sound and action feature retrieval. For the first time, we show that not only modality-specific perceptual-motor areas but also multimodal regions are engaged in conceptual processing in a flexible, task-dependent fashion, responding selectively to task-relevant conceptual features.
Collapse
Affiliation(s)
- Philipp Kuhnke
- Lise Meitner Research Group ‘Cognition and Plasticity’, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103 Leipzig, Germany
- Department of Neuropsychology, Research Group ‘Modulation of Language Networks’, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103 Leipzig, Germany
| | - Markus Kiefer
- Department of Psychiatry, Ulm University, Leimgrubenweg 12, 89075 Ulm, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group ‘Cognition and Plasticity’, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103 Leipzig, Germany
- Department of Neuropsychology, Research Group ‘Modulation of Language Networks’, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103 Leipzig, Germany
| |
Collapse
|
8
|
Popp M, Trumpp NM, Kiefer M. Processing of Action and Sound Verbs in Context: An FMRI Study. Transl Neurosci 2019; 10:200-222. [PMID: 31637047 PMCID: PMC6795028 DOI: 10.1515/tnsci-2019-0035] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Accepted: 07/17/2019] [Indexed: 01/28/2023] Open
Abstract
Recent theories propose a flexible recruitment of sensory and motor brain regions during conceptual processing depending on context and task. The present functional magnetic resonance imaging study investigated the influence of context and task on conceptual processing of action and sound verbs. Participants first performed an explicit semantic context decision task, in which action and sound verbs were presented together with a context noun. The same verbs were repeatedly presented in a subsequent implicit lexical decision task together with new action and sound verbs. Thereafter, motor and acoustic localizer tasks were administered to identify brain regions involved in perception and action. During the explicit task, we found differential activations to action and sound verbs near corresponding sensorimotor brain regions. During the implicit lexical decision task, differences between action and sound verbs were absent. However, feature-specific repetition effects were observed near corresponding sensorimotor brain regions. The present results suggest flexible conceptual representations depending on context and task. Feature-specific effects were observed only near, but not within corresponding sensorimotor brain regions, as defined by the localizer tasks. Our results therefore only provide limited evidence in favor of grounded cognition theories assuming a close link between the conceptual and the sensorimotor systems.
Collapse
Affiliation(s)
- Margot Popp
- Ulm University, Department of Psychiatry, Ulm, Germany
| | | | - Markus Kiefer
- Ulm University, Department of Psychiatry, Ulm, Germany
| |
Collapse
|
9
|
Rising tones and rustling noises: Metaphors in gestural depictions of sounds. PLoS One 2017; 12:e0181786. [PMID: 28750071 PMCID: PMC5547699 DOI: 10.1371/journal.pone.0181786] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2017] [Accepted: 07/06/2017] [Indexed: 11/19/2022] Open
Abstract
Communicating an auditory experience with words is a difficult task and, in consequence, people often rely on imitative non-verbal vocalizations and gestures. This work explored the combination of such vocalizations and gestures to communicate auditory sensations and representations elicited by non-vocal everyday sounds. Whereas our previous studies have analyzed vocal imitations, the present research focused on gestural depictions of sounds. To this end, two studies investigated the combination of gestures and non-verbal vocalizations. A first, observational study examined a set of vocal and gestural imitations of recordings of sounds representative of a typical everyday environment (ecological sounds) with manual annotations. A second, experimental study used non-ecological sounds whose parameters had been specifically designed to elicit the behaviors highlighted in the observational study, and used quantitative measures and inferential statistics. The results showed that these depicting gestures are based on systematic analogies between a referent sound, as interpreted by a receiver, and the visual aspects of the gestures: auditory-visual metaphors. The results also suggested a different role for vocalizations and gestures. Whereas the vocalizations reproduce all features of the referent sounds as faithfully as vocally possible, the gestures focus on one salient feature with metaphors based on auditory-visual correspondences. Both studies highlighted two metaphors consistently shared across participants: the spatial metaphor of pitch (mapping different pitches to different positions on the vertical dimension), and the rustling metaphor of random fluctuations (rapidly shaking of hands and fingers). We interpret these metaphors as the result of two kinds of representations elicited by sounds: auditory sensations (pitch and loudness) mapped to spatial position, and causal representations of the sound sources (e.g. rain drops, rustling leaves) pantomimed and embodied by the participants' gestures.
Collapse
|