1
|
Kurada HZ, Jiménez-Bravo M, Giacobbe C, Obeso I. Context, transparency and culture in motor resonance phenomena: Causal evidence of the motor cortex. Cortex 2024; 179:25-34. [PMID: 39098188 DOI: 10.1016/j.cortex.2024.07.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Revised: 05/15/2024] [Accepted: 07/11/2024] [Indexed: 08/06/2024]
Abstract
A connection between language and movement information in metaphorical and literal expressions activates the motor system. Despite numerous studies exploring distinctions between idioms and metaphors, a notable research gap remains in the specific effect of idioms with different transparency levels concerning motor resonance. Our primary focus was analysing the functional role of the primary motor cortex (M1) in processing hand motor verbs both in literal expressions and in two idiomatic contexts, i.e., opaque and transparent idioms. Additionally, we explored a potential language and cultural effect by comparing Turkish and Spanish speakers. An overt priming task with self-paced reading was used to judge the relatedness of a primer and a target sentence. We implemented a repetitive transcranial magnetic stimulation (TMS) protocol using continuous theta-burst stimulation (cTBS) compared to sham stimulation over the M1 in both Turkish and Spanish native speakers prior to the experimental task. Our findings reveal that the performance of Turkish and Spanish participants in processing hand motor actions was facilitated after the application of cTBS over the left M1. Moreover, brain stimulation specifically facilitated the processing of only transparent-but not opaque-idioms in both Spanish and Turkish participants. Our study reports distinct motor resonance results between different types of idioms with a parallel cross-cultural effect.
Collapse
Affiliation(s)
- Hazel Z Kurada
- Speech and Language Therapy Department, Faculty of Health Sciences, Ankara Medipol University, Ankara, Turkey.
| | - Miguel Jiménez-Bravo
- Department of Linguistics and Eastern Studies, Complutense University of Madrid, Madrid, Spain
| | - Chiara Giacobbe
- Department of Psychology, University of Campania Luigi Vanvitelli, Caserta, Italy
| | - Ignacio Obeso
- CINC-CSIC, Madrid, Spain; HM CINAC (Centro Integral de Neurociencias Abarca Campal), Hospital Universitario HM Puerta del Sur, HM Hospitales, Madrid, Spain.
| |
Collapse
|
2
|
Kim S, Binder JR, Humphries C, Conant LL. Decomposing unaccusativity: a statistical modelling approach. LANGUAGE, COGNITION AND NEUROSCIENCE 2024; 39:1189-1211. [PMID: 39479508 PMCID: PMC11521145 DOI: 10.1080/23273798.2024.2368119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Accepted: 06/05/2024] [Indexed: 11/02/2024]
Abstract
While the two types of intransitive verbs, i.e., unergative and unaccusative, are hypothesised to be syntactically represented, many have proposed a semantic account where abstract properties related to agentivity and telicity, often conceptualised as binary properties, determine the classification. Here we explore the extent to which graded, embodied features rooted in neurobiological systems contribute to the distinction, representing verb meanings as continuous human ratings over various experiential dimensions. Unlike prior studies that classified verbs based on categorical intuition, we assessed the degree of unaccusativity by acceptability of the prenominal past participle construction, one of the unaccusativity diagnostics. Five models were constructed to explain these data: categorical syntactic/semantic, feature-based event-semantic, experiential, and distributional models. The experiential model best explained the diagnostic test data, suggesting that the unaccusative/unergative distinction may be an emergent phenomenon related to differences in underlying experiential content. The experiential model's advantages, including interpretability and scalability, are also discussed.
Collapse
Affiliation(s)
- Songhee Kim
- Department of Neurology, Medical College of Wisconsin, Milwaukee, USA
| | - Jeffrey R. Binder
- Department of Neurology, Medical College of Wisconsin, Milwaukee, USA
| | - Colin Humphries
- Department of Neurology, Medical College of Wisconsin, Milwaukee, USA
| | - Lisa L. Conant
- Department of Neurology, Medical College of Wisconsin, Milwaukee, USA
| |
Collapse
|
3
|
Kuhnke P, Kiefer M, Hartwigsen G. Conceptual representations in the default, control and attention networks are task-dependent and cross-modal. BRAIN AND LANGUAGE 2023; 244:105313. [PMID: 37595340 DOI: 10.1016/j.bandl.2023.105313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 07/03/2023] [Accepted: 08/10/2023] [Indexed: 08/20/2023]
Abstract
Conceptual knowledge is central to human cognition. Neuroimaging studies suggest that conceptual processing involves modality-specific and multimodal brain regions in a task-dependent fashion. However, it remains unclear (1) to what extent conceptual feature representations are also modulated by the task, (2) whether conceptual representations in multimodal regions are indeed cross-modal, and (3) how the conceptual system relates to the large-scale functional brain networks. To address these issues, we conducted multivariate pattern analyses on fMRI data. 40 participants performed three tasks-lexical decision, sound judgment, and action judgment-on written words. We found that (1) conceptual feature representations are strongly modulated by the task, (2) conceptual representations in several multimodal regions are cross-modal, and (3) conceptual feature retrieval involves the default, frontoparietal control, and dorsal attention networks. Conceptual representations in these large-scale networks are task-dependent and cross-modal. Our findings support theories that assume conceptual processing to rely on a flexible, multi-level architecture.
Collapse
Affiliation(s)
- Philipp Kuhnke
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | | | - Gesa Hartwigsen
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
4
|
Lee J, Shin JA. The cross-linguistic comparison of perceptual strength norms for Korean, English and L2 English. Front Psychol 2023; 14:1188909. [PMID: 37538997 PMCID: PMC10395129 DOI: 10.3389/fpsyg.2023.1188909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 06/22/2023] [Indexed: 08/05/2023] Open
Abstract
This study aimed to establish perceptual strength norms for 1,000 words in the languages of Korean, English, and L2 English, in order to investigate the similarity and difference across languages as well as the influence of the environment on semantic processing. The perceptual strength norms, which are a collection of word profiles that summarize how a word is experienced through different sensory modalities including the five common senses and interoception, provide a valuable tool for testing embodiment cognition theory. The results of this study demonstrated that language users had parallel sensory experiences with concepts, and that L2 learners were also able to associate their sensory experiences with linguistic concepts. Additionally, the results highlighted the importance of incorporating interoception as a sensory modality in the development of perceptual strength norms, as it had a negative correlation with both vision and concreteness. This study was the first to establish norms for Korean and L2 English and directly compare languages using the identical and translation-equivalent word list.
Collapse
Affiliation(s)
- Jonghyun Lee
- Department of English Language and Literature, College of Humanities, Seoul National University, Seoul, Republic of Korea
| | - Jeong-Ah Shin
- Department of English Language and Literature, College of Humanities, Dongguk University, Seoul, Republic of Korea
| |
Collapse
|
5
|
Johari K, Lai VT, Riccardi N, Desai RH. Temporal features of concepts are grounded in time perception neural networks: An EEG study. BRAIN AND LANGUAGE 2023; 237:105220. [PMID: 36587493 PMCID: PMC10100101 DOI: 10.1016/j.bandl.2022.105220] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Revised: 11/18/2022] [Accepted: 12/16/2022] [Indexed: 06/17/2023]
Abstract
Experimental evidence suggests that modality-specific concept features such as action, motion, and sound partially rely on corresponding action/perception neural networks in the human brain.Little is known, however, about time-related features of concepts. We examined whether temporal features of concepts recruit networks that subserve time perception in the brain in an EEG study using event and object nouns. Results showed significantly larger ERPs for event duration vs object size judgments over right parietal electrodes, a region associated with temporal processing. Additionally, alpha/beta (10-15 Hz) neural oscillation showed a stronger desynchronization for event duration compared to object size in the right parietal electrodes. This difference was not seen in control tasks comparing event vs object valence, suggesting that it is not likely to reflect a general difference between event and object nouns. These results indicate that temporal features of words may be subserved by time perception circuits in the human brain.
Collapse
Affiliation(s)
- Karim Johari
- Human Neurophysiology and Neuromodulation Lab, Department of Communication Sciences and Disorders, Louisiana State University, Baton Rouge, LA, USA
| | - Vicky T Lai
- Department of Psychology, University of Arizona, Tucson, AZ, USA
| | - Nicholas Riccardi
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Rutvik H Desai
- Department of Psychology, University of South Carolina, Columbia, SC, USA; Institute for Mind and Brain, University of South Carolina, Columbia, SC, USA.
| |
Collapse
|
6
|
Bredikhin D, Agranovich O, Ulanov M, Koriakina M, Shestakova AN, Kadieva D, Kopytin G, Ermolovich E, Bermúdez-Margaretto B, Shtyrov Y, Jääskeläinen IP, Blagovechtchenski E. Altered evoked responses for motor-related words in children with upper limb motor impairments. Clin Neurophysiol 2023; 145:11-21. [PMID: 36395708 DOI: 10.1016/j.clinph.2022.10.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 09/30/2022] [Accepted: 10/14/2022] [Indexed: 11/15/2022]
Abstract
OBJECTIVE Obstetric brachial plexus palsy (OBPP) and amyoplasia, the classical type of arthrogryposis multiplex congenita, manifest themselves as highly limited mobility of the upper limb. At the same time, according to the embodiment cognition theories, the motor impairments might lead to the alteration of cognitive functions in OBPP/amyoplasia patients. In the current study, we examined whether OBPP/amyoplasia children exhibit altered processing of motor-related verbs. METHODS We conducted a case-control study using clinical population and control children. Oddball series were used to elicit mismatch negativity (MMN) EEG responses. The series consisted of limb-related verbs (deviant stimuli) and matched pseudowords (standard stimuli). 27 patients and 32 control children were included in the analysis. RESULTS We showed that MMN waveforms differed between OBPP/amyoplasia children and their control peers in the frontal and temporal electrodes when the stimuli contained hand-related verbs. In particular, the MMN peak latency in the OBPP/amyoplasia children was significantly delayed as compared with the healthy controls. At the same time, neither series with leg-related verbs nor series of pseudowords resulted in statistically significant differences. CONCLUSIONS Our findings suggest altered processing of hand-related verbs in OBPP/amyoplasia children with hand-related disabilities. SIGNIFICANCE Our results contribute to the growing evidence in support of the theory of embodied cognition, which proposes that various domains of cognition are shaped by bodily interactions with the environment.
Collapse
Affiliation(s)
- Dimitri Bredikhin
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia.
| | - Olga Agranovich
- Federal State Budgetary Institution the Turner Scientific Research Institute for Children's Orthopedics under the Ministry of Health of the Russian Federation, 196603 St. Petersburg, Russia.
| | - Maxim Ulanov
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia.
| | - Maria Koriakina
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia; Federal State Budgetary Institution the Turner Scientific Research Institute for Children's Orthopedics under the Ministry of Health of the Russian Federation, 196603 St. Petersburg, Russia.
| | - Anna N Shestakova
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia.
| | - Dzerassa Kadieva
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia.
| | - Grigory Kopytin
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia.
| | - Evgenia Ermolovich
- Federal State Budgetary Institution the Turner Scientific Research Institute for Children's Orthopedics under the Ministry of Health of the Russian Federation, 196603 St. Petersburg, Russia.
| | - Beatriz Bermúdez-Margaretto
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia; Facultad de Psicología, Instituto de Integración en la Comunidad - INICO, Universidad de Salamanca, Salamanca, Spain.
| | - Yury Shtyrov
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia; Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, 8000 Aarhus, Denmark.
| | - Iiro P Jääskeläinen
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia; Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, School of Science, Aalto University, 02150 Espoo, Finland.
| | - Evgeny Blagovechtchenski
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, 101000 Moscow, Russia; Federal State Budgetary Institution the Turner Scientific Research Institute for Children's Orthopedics under the Ministry of Health of the Russian Federation, 196603 St. Petersburg, Russia.
| |
Collapse
|
7
|
Zhang Y, Lemarchand R, Asyraff A, Hoffman P. Representation of motion concepts in occipitotemporal cortex: fMRI activation, decoding and connectivity analyses. Neuroimage 2022; 259:119450. [PMID: 35798252 DOI: 10.1016/j.neuroimage.2022.119450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Revised: 06/15/2022] [Accepted: 07/03/2022] [Indexed: 11/18/2022] Open
Abstract
Embodied theories of semantic cognition predict that brain regions involved in motion perception are engaged when people comprehend motion concepts expressed in language. Left lateral occipitotemporal cortex (LOTC) is implicated in both motion perception and motion concept processing but prior studies have produced mixed findings on which parts of this region are engaged by motion language. We scanned participants performing semantic judgements about sentences describing motion events and static events. We performed univariate analyses, multivariate pattern analyses (MVPA) and psychophysiological interaction (PPI) analyses to investigate the effect of motion on activity and connectivity in different parts of LOTC. In multivariate analyses that decoded whether a sentence described motion or not, the middle and posterior parts of LOTC showed above-chance level performance, with performance exceeding that of other brain regions. Univariate ROI analyses found the middle part of LOTC was more active for motion events than static ones. Finally, PPI analyses found that when processing motion events, the middle and posterior parts of LOTC (overlapping with motion perception regions), increased their connectivity with cognitive control regions. Taken together, these results indicate that the more posterior parts of LOTC, including motion perception cortex, respond differently to motion vs. static events. These findings are consistent with embodiment accounts of semantic processing, and suggest that understanding verbal descriptions of motion engages areas of the occipitotemporal cortex involved in perceiving motion.
Collapse
Affiliation(s)
- Yueyang Zhang
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, UK
| | - Rafael Lemarchand
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, UK
| | - Aliff Asyraff
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, UK
| | - Paul Hoffman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, UK.
| |
Collapse
|
8
|
Giacobbe C, Raimo S, Cropano M, Santangelo G. Neural correlates of embodied action language processing: a systematic review and meta-analytic study. Brain Imaging Behav 2022; 16:2353-2374. [PMID: 35754077 DOI: 10.1007/s11682-022-00680-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/21/2022] [Indexed: 12/01/2022]
Abstract
The neural correlates of action language processing are still debated within embodied cognition research and little is known about the flexible involvement of modality-specific pre-motor system and multimodal high-level temporo-parietal regions as a function of explicit and implicit tasks. A systematic review and the Activation likelihood estimation (ALE) meta-analyses on functional neuroimaging studies were performed to identify neural correlates of action language processing activated during explicit and implicit tasks. The contrast ALE meta-analysis revealed activation of modality-specific premotor area and inferior frontal areas during explicit action language tasks while a greater activation of posterior temporo-occipital areas emerged for implicit tasks. The conjunction analysis revealed overlap in the temporo-parietal multimodal high-level regions for both types of tasks. Functional specialization of the middle temporal gyrus was found where the more posterior-occipital part resulted activated during implicit action language tasks whereas the antero-lateral part was involved in explicit tasks. Our findings were discussed within a conceptual flexibility perspective about the involvement of both the modality-specific and multimodal brain system during action language processing depending on different types of tasks.
Collapse
Affiliation(s)
- Chiara Giacobbe
- Department of Psychology, University of Campania Luigi Vanvitelli, Viale Ellittico, 31, 81100, Caserta, Italy
| | - Simona Raimo
- Department of Medical and Surgical Sciences, University "Magna Graecia" of Catanzaro, Viale Europa, 88100, Catanzaro, Italy.
| | - Maria Cropano
- Department of Psychology, University of Campania Luigi Vanvitelli, Viale Ellittico, 31, 81100, Caserta, Italy
| | - Gabriella Santangelo
- Department of Psychology, University of Campania Luigi Vanvitelli, Viale Ellittico, 31, 81100, Caserta, Italy
| |
Collapse
|
9
|
Johari K, Riccardi N, Malyutina S, Modi M, Desai RH. HD-tDCS over motor cortex facilitates figurative and literal action sentence processing. Neuropsychologia 2021; 159:107955. [PMID: 34252418 DOI: 10.1016/j.neuropsychologia.2021.107955] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2020] [Revised: 07/06/2021] [Accepted: 07/06/2021] [Indexed: 11/29/2022]
Abstract
The extent to which action and perception systems of the brain are involved in semantic comprehension remains controversial. Whether figurative language, such as metaphors and idioms, is grounded in sensory-motor systems is especially contentious. Here, we used high-definition transcranial direct current stimulation (HD-tDCS) in healthy adults to examine the role of the left-hemisphere motor cortex during the comprehension of action sentences, relative to comprehension of sentences with visual verbs. Action sentences were divided into three types: literal, metaphoric, or idiomatic. This allowed us to ask whether processing of action verbs used in figurative contexts relies on motor cortex. The results revealed that action sentence comprehension response times were facilitated relative to the visual sentence control. Significant interaction relative to visual sentences was observed for literal, metaphoric, and idiomatic action sentences with HD-tDCS of the motor cortex. These results suggest that the left motor cortex is functionally involved in action sentence comprehension. Furthermore, this involvement exists when the action content of the sentences is figurative, for both idiomatic and metaphoric cases. The results provide evidence for functional links between conceptual and action systems of the brain.
Collapse
Affiliation(s)
- Karim Johari
- Human Brain Mapping Laboratory, Department of Neurosurgery, University of Iowa, Iowa City, IA, USA; Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Nicholas Riccardi
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | | | - Mirage Modi
- Weinberg College of Arts and Sciences, Northwestern University, Evanston, IL, USA
| | - Rutvik H Desai
- Department of Psychology, University of South Carolina, Columbia, SC, USA; Institute for Mind and Brain, University of South Carolina, Columbia, SC, USA.
| |
Collapse
|
10
|
Mohagheghian F, Khajehpour H, Samadzadehaghdam N, Eqlimi E, Jalilvand H, Makkiabadi B, Deevband MR. Altered effective brain network topology in tinnitus: An EEG source connectivity analysis. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
11
|
Popp M, Trumpp NM, Sim EJ, Kiefer M. Brain Activation During Conceptual Processing of Action and Sound Verbs. Adv Cogn Psychol 2020; 15:236-255. [PMID: 32494311 PMCID: PMC7251527 DOI: 10.5709/acp-0272-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Grounded cognition approaches to conceptual representations postulate a close link between conceptual knowledge and the sensorimotor brain systems. The present fMRI study tested, whether a feature-specific representation of concepts, as previously demonstrated for nouns, can also be found for action- and sound-related verbs. Participants were presented with action- and soundrelated verbs along with pseudoverbs while performing a lexical decision task. Sound-related verbs activated auditory areas in the temporal cortex, whereas action-related verbs activated brain regions in the superior frontal gyrus and the cerebellum, albeit only at a more liberal threshold. This differential brain activation during conceptual verb processing partially overlapped with or was adjacent to brain regions activated during the functional localizers probing sound perception or action execution. Activity in brain areas involved in the processing of action information was parametrically modulated by ratings of action relevance. Comparisons of action- and sound-related verbs with pseudoverbs revealed activation for both verb categories in auditory and motor areas. In contrast to proposals of strong grounded cognition approaches, our study did not demonstrate a considerable overlap of activations for action- and sound-related verbs and for the corresponding functional localizer tasks. However, in line with weaker variants of grounded cognition theories, the differential activation pattern for action- and sound-related verbs was near corresponding sensorimotor brain regions depending on conceptual feature relevance. Possibly, action-sound coupling resulted in a mutual activation of the motor and the auditory system for both action- and sound-related verbs, thereby reducing the effect sizes for the differential contrasts.
Collapse
Affiliation(s)
- Margot Popp
- Ulm University, Department of Psychiatry, Ulm, Germany
| | | | - Eun-Jin Sim
- Ulm University, Department of Psychiatry, Ulm, Germany
| | - Markus Kiefer
- Ulm University, Department of Psychiatry, Ulm, Germany
| |
Collapse
|
12
|
Kuhnke P, Kiefer M, Hartwigsen G. Task-Dependent Recruitment of Modality-Specific and Multimodal Regions during Conceptual Processing. Cereb Cortex 2020; 30:3938-3959. [PMID: 32219378 PMCID: PMC7264643 DOI: 10.1093/cercor/bhaa010] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 01/08/2020] [Accepted: 01/15/2020] [Indexed: 01/12/2023] Open
Abstract
Conceptual knowledge is central to cognitive abilities such as word comprehension. Previous neuroimaging evidence indicates that concepts are at least partly composed of perceptual and motor features that are represented in the same modality-specific brain regions involved in actual perception and action. However, it is unclear to what extent the retrieval of perceptual-motor features and the resulting engagement of modality-specific regions depend on the concurrent task. To address this issue, we measured brain activity in 40 young and healthy participants using functional magnetic resonance imaging, while they performed three different tasks-lexical decision, sound judgment, and action judgment-on words that independently varied in their association with sounds and actions. We found neural activation for sound and action features of concepts selectively when they were task-relevant in brain regions also activated during auditory and motor tasks, respectively, as well as in higher-level, multimodal regions which were recruited during both sound and action feature retrieval. For the first time, we show that not only modality-specific perceptual-motor areas but also multimodal regions are engaged in conceptual processing in a flexible, task-dependent fashion, responding selectively to task-relevant conceptual features.
Collapse
Affiliation(s)
- Philipp Kuhnke
- Lise Meitner Research Group ‘Cognition and Plasticity’, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103 Leipzig, Germany
- Department of Neuropsychology, Research Group ‘Modulation of Language Networks’, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103 Leipzig, Germany
| | - Markus Kiefer
- Department of Psychiatry, Ulm University, Leimgrubenweg 12, 89075 Ulm, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group ‘Cognition and Plasticity’, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103 Leipzig, Germany
- Department of Neuropsychology, Research Group ‘Modulation of Language Networks’, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstr. 1a, 04103 Leipzig, Germany
| |
Collapse
|
13
|
Hyder R, Højlund A, Jensen M, Østergaard K, Shtyrov Y. Objective assessment of automatic language comprehension mechanisms in the brain: Novel E/MEG paradigm. Psychophysiology 2020; 57:e13543. [DOI: 10.1111/psyp.13543] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2019] [Revised: 11/22/2019] [Accepted: 12/04/2019] [Indexed: 11/29/2022]
Affiliation(s)
- Rasha Hyder
- Center of Functionally Integrative Neuroscience (CFIN) Department of Clinical Medicine Aarhus University Aarhus Denmark
| | - Andreas Højlund
- Center of Functionally Integrative Neuroscience (CFIN) Department of Clinical Medicine Aarhus University Aarhus Denmark
| | - Mads Jensen
- Center of Functionally Integrative Neuroscience (CFIN) Department of Clinical Medicine Aarhus University Aarhus Denmark
| | - Karen Østergaard
- Sano Private Hospital Skælskør Denmark
- Department of Neurology Aarhus University Hospital (AUH) Aarhus Denmark
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN) Department of Clinical Medicine Aarhus University Aarhus Denmark
- Laboratory of Behavioural Neurodynamics Saint Petersburg State University Saint Petersburg Russia
| |
Collapse
|
14
|
Harpaintner M, Sim EJ, Trumpp NM, Ulrich M, Kiefer M. The grounding of abstract concepts in the motor and visual system: An fMRI study. Cortex 2020; 124:1-22. [DOI: 10.1016/j.cortex.2019.10.014] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Revised: 08/07/2019] [Accepted: 10/30/2019] [Indexed: 12/21/2022]
|
15
|
Popp M, Trumpp NM, Kiefer M. Processing of Action and Sound Verbs in Context: An FMRI Study. Transl Neurosci 2019; 10:200-222. [PMID: 31637047 PMCID: PMC6795028 DOI: 10.1515/tnsci-2019-0035] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Accepted: 07/17/2019] [Indexed: 01/28/2023] Open
Abstract
Recent theories propose a flexible recruitment of sensory and motor brain regions during conceptual processing depending on context and task. The present functional magnetic resonance imaging study investigated the influence of context and task on conceptual processing of action and sound verbs. Participants first performed an explicit semantic context decision task, in which action and sound verbs were presented together with a context noun. The same verbs were repeatedly presented in a subsequent implicit lexical decision task together with new action and sound verbs. Thereafter, motor and acoustic localizer tasks were administered to identify brain regions involved in perception and action. During the explicit task, we found differential activations to action and sound verbs near corresponding sensorimotor brain regions. During the implicit lexical decision task, differences between action and sound verbs were absent. However, feature-specific repetition effects were observed near corresponding sensorimotor brain regions. The present results suggest flexible conceptual representations depending on context and task. Feature-specific effects were observed only near, but not within corresponding sensorimotor brain regions, as defined by the localizer tasks. Our results therefore only provide limited evidence in favor of grounded cognition theories assuming a close link between the conceptual and the sensorimotor systems.
Collapse
Affiliation(s)
- Margot Popp
- Ulm University, Department of Psychiatry, Ulm, Germany
| | | | - Markus Kiefer
- Ulm University, Department of Psychiatry, Ulm, Germany
| |
Collapse
|
16
|
Humphries S, Klooster N, Cardillo E, Weintraub D, Rick J, Chatterjee A. From action to abstraction: The sensorimotor grounding of metaphor in Parkinson's disease. Cortex 2019; 121:362-384. [PMID: 31678683 DOI: 10.1016/j.cortex.2019.09.005] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Accepted: 09/06/2019] [Indexed: 10/25/2022]
Abstract
Embodied cognition theories propose that the semantic representations engaged in during language comprehension are partly supported by perceptual and motor systems, via simulation. Activation in modality-specific regions of cortex is associated with the comprehension of literal language that describes the analogous modalities, but studies addressing the grounding of non-literal or figurative language, such as metaphors, have yielded mixed results. Differences in the psycholinguistic characteristics of sentence stimuli across studies have likely contributed to this lack of consensus. Furthermore, previous studies have been largely correlational, whilst patient studies are a critical way of determining if intact sensorimotor function is necessary to understand language drawing on sensorimotor information. We designed a battery of metaphorical and literal sentence stimuli using action and sound words, with an unprecedented level of control over critical psycholinguistic variables, to test hypotheses about the grounding of metaphorical language. In this Registered Report, we assessed the comprehension of these sentences in 41 patients with Parkinson's disease, who were predicted to be disproportionately affected by the action sentences relative to the sound sentences, and compared their performance to that of 39 healthy age-matched controls who were predicted to show no difference in performance due to sensory modality. Using preregistered Bayesian model comparison methods, we found that PD patients' comprehension of literal action sentences was not impaired, while there was some evidence for a slowing of responses to action metaphors. Follow up exploratory analyses suggest that this response time modality effect was driven by one type of metaphor (predicate) and was absent in another (nominal), despite the fact that the action semantics were similar in both syntactic forms. These results suggest that the conditions under which PD patients demonstrate hypothesized embodiment effects are limited. We offer a critical assessment of the PD action language literature and discuss implications for the embodiment debate. In addition, we suggest how future studies could leverage Bayesian statistical methods to provide more convincing evidence for or against embodied cognition effects.
Collapse
|
17
|
Abstract
PURPOSE OF REVIEW This article summarizes the clinical and anatomic features of the three named variants of primary progressive aphasia (PPA): semantic variant PPA, nonfluent/agrammatic variant PPA, and logopenic variant PPA. Three stroke aphasia syndromes that resemble the PPA variants (Broca aphasia, Wernicke aphasia, and conduction aphasia) are also presented. RECENT FINDINGS Semantic variant PPA and Wernicke aphasia are characterized by fluent speech with naming and comprehension difficulty; these syndromes are associated with disease in different portions of the left temporal lobe. Patients with nonfluent/agrammatic variant PPA or Broca aphasia have nonfluent speech with grammatical difficulty; these syndromes are associated with disease centered in the left inferior frontal lobe. Patients with logopenic variant PPA or conduction aphasia have difficulty with repetition and word finding in conversational speech; these syndromes are associated with disease in the left inferior parietal lobe. While PPA and stroke aphasias resemble one another, this article also presents their distinguishing features. SUMMARY Primary progressive and stroke aphasia syndromes interrupt the left perisylvian language network, resulting in identifiable aphasic syndromes.
Collapse
|
18
|
Lemaitre G, Pyles JA, Halpern AR, Navolio N, Lehet M, Heller LM. Who's that Knocking at My Door? Neural Bases of Sound Source Identification. Cereb Cortex 2019; 28:805-818. [PMID: 28052922 DOI: 10.1093/cercor/bhw397] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2016] [Accepted: 12/14/2016] [Indexed: 11/13/2022] Open
Abstract
When hearing knocking on a door, a listener typically identifies both the action (forceful and repeated impacts) and the object (a thick wooden board) causing the sound. The current work studied the neural bases of sound source identification by switching listeners' attention toward these different aspects of a set of simple sounds during functional magnetic resonance imaging scanning: participants either discriminated the action or the material that caused the sounds, or they simply discriminated meaningless scrambled versions of them. Overall, discriminating action and material elicited neural activity in a left-lateralized frontoparietal network found in other studies of sound identification, wherein the inferior frontal sulcus and the ventral premotor cortex were under the control of selective attention and sensitive to task demand. More strikingly, discriminating materials elicited increased activity in cortical regions connecting auditory inputs to semantic, motor, and even visual representations, whereas discriminating actions did not increase activity in any regions. These results indicate that discriminating and identifying material requires deeper processing of the stimuli than discriminating actions. These results are consistent with previous studies suggesting that auditory perception is better suited to comprehend the actions than the objects producing sounds in the listeners' environment.
Collapse
Affiliation(s)
- Guillaume Lemaitre
- Carnegie Mellon University, Department of Psychology and Center for Neural Basis of Cognition, Pittsburgh, PA 15213, USA
| | - John A Pyles
- Carnegie Mellon University, Department of Psychology and Center for Neural Basis of Cognition, Pittsburgh, PA 15213, USA
| | - Andrea R Halpern
- Bucknell University, Department of Psychology, Lewisburg 17837, PA, USA
| | - Nicole Navolio
- Carnegie Mellon University, Department of Psychology and Center for Neural Basis of Cognition, Pittsburgh, PA 15213, USA
| | - Matthew Lehet
- Carnegie Mellon University, Department of Psychology and Center for Neural Basis of Cognition, Pittsburgh, PA 15213, USA
| | - Laurie M Heller
- Carnegie Mellon University, Department of Psychology and Center for Neural Basis of Cognition, Pittsburgh, PA 15213, USA
| |
Collapse
|
19
|
Moseley RL, Pulvermüller F. What can autism teach us about the role of sensorimotor systems in higher cognition? New clues from studies on language, action semantics, and abstract emotional concept processing. Cortex 2018; 100:149-190. [DOI: 10.1016/j.cortex.2017.11.019] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2017] [Revised: 05/17/2017] [Accepted: 11/21/2017] [Indexed: 01/08/2023]
|
20
|
Abstract
Primary progressive aphasia (PPA) refers to a disorder of declining language associated with neurodegenerative diseases such as frontotemporal degeneration and Alzheimer disease. Variants of PPA are important to recognize from a medical perspective because these syndromes are clinical markers suggesting specific underlying pathology. In this review, I discuss linguistic aspects of PPA syndromes that may prove informative for parsing our language mechanism and identifying the neural representation of fundamental elements of language. I focus on the representation of word meaning in a discussion of semantic variant PPA, grammatical comprehension and expression in a discussion of nonfluent/agrammatic variant PPA, the supporting role of short-term memory in a discussion of logopenic variant PPA, and components of language associated with discourse in a discussion of behavioral variant frontotemporal dementia. PPA provides a novel perspective that uniquely addresses facets of language and its disorders while complementing traditional aphasia syndromes that follow stroke.
Collapse
Affiliation(s)
- Murray Grossman
- Penn Frontotemporal Degeneration Center and Department of Neurology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| |
Collapse
|
21
|
Popp M, Trumpp NM, Kiefer M. Feature-Specific Event-Related Potential Effects to Action- and Sound-Related Verbs during Visual Word Recognition. Front Hum Neurosci 2016; 10:637. [PMID: 28018201 PMCID: PMC5156699 DOI: 10.3389/fnhum.2016.00637] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2016] [Accepted: 11/29/2016] [Indexed: 11/29/2022] Open
Abstract
Grounded cognition theories suggest that conceptual representations essentially depend on modality-specific sensory and motor systems. Feature-specific brain activation across different feature types such as action or audition has been intensively investigated in nouns, while feature-specific conceptual category differences in verbs mainly focused on body part specific effects. The present work aimed at assessing whether feature-specific event-related potential (ERP) differences between action and sound concepts, as previously observed in nouns, can also be found within the word class of verbs. In Experiment 1, participants were visually presented with carefully matched sound and action verbs within a lexical decision task, which provides implicit access to word meaning and minimizes strategic access to semantic word features. Experiment 2 tested whether pre-activating the verb concept in a context phase, in which the verb is presented with a related context noun, modulates subsequent feature-specific action vs. sound verb processing within the lexical decision task. In Experiment 1, ERP analyses revealed a differential ERP polarity pattern for action and sound verbs at parietal and central electrodes similar to previous results in nouns. Pre-activation of the meaning of verbs in the preceding context phase in Experiment 2 resulted in a polarity-reversal of feature-specific ERP effects in the lexical decision task compared with Experiment 1. This parallels analogous earlier findings for primed action and sound related nouns. In line with grounded cognitions theories, our ERP study provides evidence for a differential processing of action and sound verbs similar to earlier observation for concrete nouns. Although the localizational value of ERPs must be viewed with caution, our results indicate that the meaning of verbs is linked to different neural circuits depending on conceptual feature relevance.
Collapse
Affiliation(s)
- Margot Popp
- Department of Psychiatry, Ulm University Ulm, Germany
| | | | - Markus Kiefer
- Department of Psychiatry, Ulm University Ulm, Germany
| |
Collapse
|
22
|
Ostarek M, Vigliocco G. Reading sky and seeing a cloud: On the relevance of events for perceptual simulation. J Exp Psychol Learn Mem Cogn 2016; 43:579-590. [PMID: 27762581 PMCID: PMC5378009 DOI: 10.1037/xlm0000318] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Previous research has shown that processing words with an up/down association (e.g., bird, foot) can influence the subsequent identification of visual targets in congruent location (at the top/bottom of the screen). However, as facilitation and interference were found under similar conditions, the nature of the underlying mechanisms remained unclear. We propose that word comprehension relies on the perceptual simulation of a prototypical event involving the entity denoted by a word in order to provide a general account of the different findings. In 3 experiments, participants had to discriminate between 2 target pictures appearing at the top or the bottom of the screen by pressing the left versus right button. Immediately before the targets appeared, they saw an up/down word belonging to the target's event, an up/down word unrelated to the target, or a spatially neutral control word. Prime words belonging to target event facilitated identification of targets at a stimulus onset asynchrony (SOA) of 250 ms (Experiment 1), but only when presented in the vertical location where they are typically seen, indicating that targets were integrated in the simulations activated by the prime words. Moreover, at the same SOA, there was a robust facilitation effect for targets appearing in their typical location regardless of the prime type. However, when words were presented for 100 ms (Experiment 2) or 800 ms (Experiment 3), only a location nonspecific priming effect was found, suggesting that the visual system was not activated. Implications for theories of semantic processing are discussed. (PsycINFO Database Record
Collapse
Affiliation(s)
- Markus Ostarek
- Experimental Psychology Department, Division of Psychology and Language Sciences, University College London
| | - Gabriella Vigliocco
- Experimental Psychology Department, Division of Psychology and Language Sciences, University College London
| |
Collapse
|
23
|
Predicting brain activation patterns associated with individual lexical concepts based on five sensory-motor attributes. Neuropsychologia 2015; 76:17-26. [PMID: 25863238 DOI: 10.1016/j.neuropsychologia.2015.04.009] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2014] [Revised: 04/02/2015] [Accepted: 04/07/2015] [Indexed: 11/21/2022]
Abstract
While major advances have been made in uncovering the neural processes underlying perceptual representations, our grasp of how the brain gives rise to conceptual knowledge remains relatively poor. Recent work has provided strong evidence that concepts rely, at least in part, on the same sensory and motor neural systems through which they were acquired, but it is still unclear whether the neural code for concept representation uses information about sensory-motor features to discriminate between concepts. In the present study, we investigate this question by asking whether an encoding model based on five semantic attributes directly related to sensory-motor experience - sound, color, visual motion, shape, and manipulation - can successfully predict patterns of brain activation elicited by individual lexical concepts. We collected ratings on the relevance of these five attributes to the meaning of 820 words, and used these ratings as predictors in a multiple regression model of the fMRI signal associated with the words in a separate group of participants. The five resulting activation maps were then combined by linear summation to predict the distributed activation pattern elicited by a novel set of 80 test words. The encoding model predicted the activation patterns elicited by the test words significantly better than chance. As expected, prediction was successful for concrete but not for abstract concepts. Comparisons between encoding models based on different combinations of attributes indicate that all five attributes contribute to the representation of concrete concepts. Consistent with embodied theories of semantics, these results show, for the first time, that the distributed activation pattern associated with a concept combines information about different sensory-motor attributes according to their respective relevance. Future research should investigate how additional features of phenomenal experience contribute to the neural representation of conceptual knowledge.
Collapse
|
24
|
Fernandino L, Binder JR, Desai RH, Pendl SL, Humphries CJ, Gross WL, Conant LL, Seidenberg MS. Concept Representation Reflects Multimodal Abstraction: A Framework for Embodied Semantics. Cereb Cortex 2015; 26:2018-34. [PMID: 25750259 DOI: 10.1093/cercor/bhv020] [Citation(s) in RCA: 148] [Impact Index Per Article: 16.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Recent research indicates that sensory and motor cortical areas play a significant role in the neural representation of concepts. However, little is known about the overall architecture of this representational system, including the role played by higher level areas that integrate different types of sensory and motor information. The present study addressed this issue by investigating the simultaneous contributions of multiple sensory-motor modalities to semantic word processing. With a multivariate fMRI design, we examined activation associated with 5 sensory-motor attributes--color, shape, visual motion, sound, and manipulation--for 900 words. Regions responsive to each attribute were identified using independent ratings of the attributes' relevance to the meaning of each word. The results indicate that these aspects of conceptual knowledge are encoded in multimodal and higher level unimodal areas involved in processing the corresponding types of information during perception and action, in agreement with embodied theories of semantics. They also reveal a hierarchical system of abstracted sensory-motor representations incorporating a major division between object interaction and object perception processes.
Collapse
Affiliation(s)
| | | | - Rutvik H Desai
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | | | | | - William L Gross
- Department of Anesthesiology, Medical College of Wisconsin, Milwaukee, WI, USA
| | | | | |
Collapse
|
25
|
Buxbaum LJ, Shapiro AD, Coslett HB. Reply: apraxia: a gestural or a cognitive disorder? ACTA ACUST UNITED AC 2014; 138:e334. [PMID: 25173604 DOI: 10.1093/brain/awu240] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Affiliation(s)
- Laurel J Buxbaum
- 1 Moss Rehabilitation Research Institute, 50 Township Line Rd, Elkins Park, PA, 19027, USA
| | - Allison D Shapiro
- 2 Department of Psychological and Brain Sciences, University of California, Santa Barbara, CA, 93106, USA
| | - H Branch Coslett
- 3 Department of Neurology, University of Pennsylvania School of Medicine, 3400 Spruce St., Philadelphia, PA, USA
| |
Collapse
|
26
|
Moseley RL, Pulvermüller F. Nouns, verbs, objects, actions, and abstractions: local fMRI activity indexes semantics, not lexical categories. BRAIN AND LANGUAGE 2014; 132:28-42. [PMID: 24727103 PMCID: PMC4029073 DOI: 10.1016/j.bandl.2014.03.001] [Citation(s) in RCA: 67] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/14/2013] [Revised: 02/11/2014] [Accepted: 03/03/2014] [Indexed: 06/03/2023]
Abstract
Noun/verb dissociations in the literature defy interpretation due to the confound between lexical category and semantic meaning; nouns and verbs typically describe concrete objects and actions. Abstract words, pertaining to neither, are a critical test case: dissociations along lexical-grammatical lines would support models purporting lexical category as the principle governing brain organisation, whilst semantic models predict dissociation between concrete words but not abstract items. During fMRI scanning, participants read orthogonalised word categories of nouns and verbs, with or without concrete, sensorimotor meaning. Analysis of inferior frontal/insula, precentral and central areas revealed an interaction between lexical class and semantic factors with clear category differences between concrete nouns and verbs but not abstract ones. Though the brain stores the combinatorial and lexical-grammatical properties of words, our data show that topographical differences in brain activation, especially in the motor system and inferior frontal cortex, are driven by semantics and not by lexical class.
Collapse
Affiliation(s)
- Rachel L Moseley
- MRC Cognition and Brain Sciences, Unit, 15 Chaucer Road, CB2 7EF, Cambridge, UK; Autism Research Centre, Department of Psychiatry, University of Cambridge, Douglas House, 18b Trumpington Road, CB2 8AH, Cambridge, UK.
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Habelschwerdter Allee 45, 14195 Berlin, Germany.
| |
Collapse
|
27
|
Pulvermüller F, Moseley RL, Egorova N, Shebani Z, Boulenger V. Motor cognition–motor semantics: Action perception theory of cognition and communication. Neuropsychologia 2014; 55:71-84. [DOI: 10.1016/j.neuropsychologia.2013.12.002] [Citation(s) in RCA: 48] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2013] [Revised: 11/30/2013] [Accepted: 12/02/2013] [Indexed: 10/25/2022]
|
28
|
Ulrich M, Hoenig K, Grön G, Kiefer M. Brain Activation during Masked and Unmasked Semantic Priming: Commonalities and Differences. J Cogn Neurosci 2013; 25:2216-29. [DOI: 10.1162/jocn_a_00449] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
Using fMRI during a lexical decision task, we investigated the neural correlates of semantic priming under masked and unmasked prime presentation conditions in a repeated measurement design of the same group of 24 participants (14 women). The task was to discriminate between pseudowords and words. Masked and unmasked prime words differed in their degree of semantic relatedness with target stimuli. Neural correlates of priming were defined as significantly different neural activations upon semantically unrelated minus related trials. Left fusiform gyrus, left posterior inferior frontal gyrus, and bilateral pre-SMA showed priming effects independent of the masking condition. By contrast, bilateral superior temporal gyri, superior parietal lobules, and the SMA proper demonstrated greater neural priming in the unmasked compared with the masked condition. The inverted contrast (masked priming minus unmasked priming) did not show significant differences even at lowered thresholds of significance. The conjoint effects of priming in the left fusiform gyrus suggest its involvement as a direct consequence of the neural organization of semantic memory. Activity in brain regions showing significantly more neural priming in the unmasked condition possibly reflected participants' evaluation of the prime–target relationship, presumably in the context of semantic matching. The present results therefore indicate that masked and unmasked semantic priming partially depend on dissociable mechanisms at the neural and most likely also at the functional level.
Collapse
|
29
|
Pulvermüller F. Semantic embodiment, disembodiment or misembodiment? In search of meaning in modules and neuron circuits. BRAIN AND LANGUAGE 2013; 127:86-103. [PMID: 23932167 DOI: 10.1016/j.bandl.2013.05.015] [Citation(s) in RCA: 82] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2012] [Revised: 03/01/2013] [Accepted: 05/23/2013] [Indexed: 06/02/2023]
Abstract
"Embodied" proposals claim that the meaning of at least some words, concepts and constructions is grounded in knowledge about actions and objects. An alternative "disembodied" position locates semantics in a symbolic system functionally detached from sensorimotor modules. This latter view is not tenable theoretically and has been empirically falsified by neuroscience research. A minimally-embodied approach now claims that action-perception systems may "color", but not represent, meaning; however, such minimal embodiment (misembodiment?) still fails to explain why action and perception systems exert causal effects on the processing of symbols from specific semantic classes. Action perception theory (APT) offers neurobiological mechanisms for "embodied" referential, affective and action semantics along with "disembodied" mechanisms of semantic abstraction, generalization and symbol combination, which draw upon multimodal brain systems. In this sense, APT suggests integrative-neuromechanistic explanations of why both sensorimotor and multimodal areas of the human brain differentially contribute to specific facets of meaning and concepts.
Collapse
Affiliation(s)
- Friedemann Pulvermüller
- Brain Language Laboratory, Freie Universität Berlin, 14195 Berlin, Germany; Medical Research Council, Cognition and Brain Sciences Unit, Cambridge CB2 7EF, UK.
| |
Collapse
|
30
|
Trumpp NM, Traub F, Pulvermüller F, Kiefer M. Unconscious automatic brain activation of acoustic and action-related conceptual features during masked repetition priming. J Cogn Neurosci 2013; 26:352-64. [PMID: 24001008 DOI: 10.1162/jocn_a_00473] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Classical theories of semantic memory assume that concepts are represented in a unitary amodal memory system. In challenging this classical view, pure or hybrid modality-specific theories propose that conceptual representations are grounded in the sensory-motor brain areas, which typically process sensory and action-related information. Although neuroimaging studies provided evidence for a functional-anatomical link between conceptual processing of sensory or action-related features and the sensory-motor brain systems, it has been argued that aspects of such sensory-motor activation may not directly reflect conceptual processing but rather strategic imagery or postconceptual elaboration. In the present ERP study, we investigated masked effects of acoustic and action-related conceptual features to probe unconscious automatic conceptual processing in isolation. Subliminal feature-specific ERP effects at frontocentral electrodes were observed, which differed with regard to polarity, topography, and underlying brain electrical sources in congruency with earlier findings under conscious viewing conditions. These findings suggest that conceptual acoustic and action representations can also be unconsciously accessed, thereby excluding any postconceptual strategic processes. This study therefore further substantiates a grounding of conceptual and semantic processing in action and perception.
Collapse
|
31
|
Trumpp NM, Traub F, Kiefer M. Masked priming of conceptual features reveals differential brain activation during unconscious access to conceptual action and sound information. PLoS One 2013; 8:e65910. [PMID: 23741518 PMCID: PMC3669239 DOI: 10.1371/journal.pone.0065910] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2012] [Accepted: 05/04/2013] [Indexed: 01/08/2023] Open
Abstract
Previous neuroimaging studies suggested an involvement of sensory-motor brain systems during conceptual processing in support of grounded cognition theories of conceptual memory. However, in these studies with visible stimuli, contributions of strategic imagery or semantic elaboration processes to observed sensory-motor activity cannot be entirely excluded. In the present study, we therefore investigated the electrophysiological correlates of unconscious feature-specific priming of action- and sound-related concepts within a novel feature-priming paradigm to specifically probe automatic processing of conceptual features without the contribution of possibly confounding factors such as orthographic similarity or response congruency. Participants were presented with a masked subliminal prime word and a subsequent visible target word. In the feature-priming conditions primes as well as targets belonged to the same conceptual feature dimension (action or sound, e.g., typewriter or radio) whereas in the two non-priming conditions, either the primes or the targets consisted of matched control words with low feature relevance (e.g., butterfly or candle). Event-related potential analyses revealed unconscious feature-specific priming effects at fronto-central electrodes within 100 to 180 ms after target stimulus onset that differed with regard to topography and underlying neural generators. In congruency with previous findings under visible stimulation conditions, these differential subliminal ERP feature-priming effects demonstrate an unconscious automatic access to action versus sound features of concepts. The present results therefore support grounded cognition theory suggesting that activity in sensory and motor areas during conceptual processing can also occur unconsciously and is not mandatorily accompanied by a vivid conscious experience of the conceptual content such as in imagery.
Collapse
Affiliation(s)
| | - Felix Traub
- Department of Psychiatry, University of Ulm, Ulm, Germany
| | - Markus Kiefer
- Department of Psychiatry, University of Ulm, Ulm, Germany
- * E-mail:
| |
Collapse
|
32
|
Humphreys GF, Newling K, Jennings C, Gennari SP. Motion and actions in language: semantic representations in occipito-temporal cortex. BRAIN AND LANGUAGE 2013; 125:94-105. [PMID: 23454619 DOI: 10.1016/j.bandl.2013.01.008] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/27/2012] [Revised: 12/18/2012] [Accepted: 01/14/2013] [Indexed: 06/01/2023]
Abstract
Understanding verbs typically activates posterior temporal regions and, in some circumstances, motion perception area V5. However, the nature and role of this activation remains unclear: does language alone indeed activate V5? And are posterior temporal representations modality-specific motion representations, or supra-modal motion-independent event representations? Here, we address these issues by investigating human and object motion sentences compared to corresponding state descriptions. We adopted the blank screen paradigm, which is known to encourage visual imagery, and used a localizer to identify V5 and temporal structures responding to motion. Analyses in each individual brain suggested that language modulated activity in the posterior temporal lobe but not within V5 in most participants. Moreover, posterior temporal structures strongly responded to both motion sentences and human static sentences. These results suggest that descriptive language alone need not recruit V5 and instead engages more schematic event representations in temporal cortex encoding animacy and motion.
Collapse
Affiliation(s)
- Gina F Humphreys
- Department of Psychology, University of York, Heslington YO10 5DD, UK
| | | | | | | |
Collapse
|
33
|
Amoruso L, Gelormini C, Aboitiz F, Alvarez González M, Manes F, Cardona JF, Ibanez A. N400 ERPs for actions: building meaning in context. Front Hum Neurosci 2013; 7:57. [PMID: 23459873 PMCID: PMC3586681 DOI: 10.3389/fnhum.2013.00057] [Citation(s) in RCA: 75] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2012] [Accepted: 02/12/2013] [Indexed: 11/13/2022] Open
Abstract
Converging neuroscientific evidence suggests the existence of close links between language and sensorimotor cognition. Accordingly, during the comprehension of meaningful actions, our brain would recruit semantic-related operations similar to those associated with the processing of language information. Consistent with this view, electrophysiological findings show that the N400 component, traditionally linked to the semantic processing of linguistic material, can also be elicited by action-related material. This review outlines recent data from N400 studies that examine the understanding of action events. We focus on three specific domains, including everyday action comprehension, co-speech gesture integration, and the semantics involved in motor planning and execution. Based on the reviewed findings, we suggest that both negativities (the N400 and the action-N400) reflect a common neurocognitive mechanism involved in the construction of meaning through the expectancies created by previous experiences and current contextual information. To shed light on how this process is instantiated in the brain, a testable contextual fronto-temporo-parietal model is proposed.
Collapse
Affiliation(s)
- Lucía Amoruso
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- Institute of Neuroscience, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
| | - Carlos Gelormini
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
| | - Francisco Aboitiz
- Department of Psychiatry, Medical School, Interdisciplinary Center of Neuroscience, Pontificia Universidad CatólicaSantiago, Chile
| | | | - Facundo Manes
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- Institute of Neuroscience, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
| | - Juan F. Cardona
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- Institute of Neuroscience, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
| | - Agustín Ibanez
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- Institute of Neuroscience, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
- Laboratory of Cognitive and Social Neuroscience, Universidad Diego PortalesSantiago, Chile
| |
Collapse
|
34
|
Hauk O, Tschentscher N. The Body of Evidence: What Can Neuroscience Tell Us about Embodied Semantics? Front Psychol 2013; 4:50. [PMID: 23407791 PMCID: PMC3570773 DOI: 10.3389/fpsyg.2013.00050] [Citation(s) in RCA: 58] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2012] [Accepted: 01/23/2013] [Indexed: 02/05/2023] Open
Abstract
Semantic knowledge is based on the way we perceive and interact with the world. However, the jury is still out on the question: to what degree are neuronal systems that subserve acquisition of semantic knowledge, such as sensory-motor networks, involved in its representation and processing? We will begin with a critical evaluation of the main behavioral and neuroimaging methods with respect to their capability to define the functional roles of specific brain areas. Any behavioral or neuroscientific measure is a conflation of representations and processes. Hence, a combination of behavioral and neurophysiological interactions as well as time-course information is required to define the functional roles of brain areas. This will guide our review of the empirical literature. Most research in this area has been done on semantics of concrete words, where clear theoretical frameworks for an involvement of sensory-motor systems in semantics exist. Most of this evidence still stems from correlational studies that are ambiguous with respect to the behavioral relevance of effects. Evidence for causal effects of sensory-motor systems on semantic processes is still scarce but evolving. Relatively few neuroscientific studies so far have investigated the embodiment of abstract semantics for words, numbers, and arithmetic facts. Here, some correlational evidence exists, but data on causality are mostly absent. We conclude that neuroimaging data, just as behavioral data, have so far not disentangled the fundamental link between process and representation. Future studies should therefore put more emphasis on the effects of task and context on semantic processing. Strong conclusions can only be drawn from a combination of methods that provide time-course information, determine the connectivity among poly- or amodal and sensory-motor areas, link behavioral with neuroimaging measures, and allow causal inferences. We will conclude with suggestions on how this could be accomplished in future research.
Collapse
Affiliation(s)
- Olaf Hauk
- MRC Cognition and Brain Sciences Unit Cambridge, UK
| | | |
Collapse
|