1
|
Bonandrini R, Gornetti E, Paulesu E. A meta-analytical account of the functional lateralization of the reading network. Cortex 2024; 177:363-384. [PMID: 38936265 DOI: 10.1016/j.cortex.2024.05.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 03/25/2024] [Accepted: 05/29/2024] [Indexed: 06/29/2024]
Abstract
The observation that the neural correlates of reading are left-lateralized is ubiquitous in the cognitive neuroscience and neuropsychological literature. Still, reading is served by a constellation of neural units, and the extent to which these units are consistently left-lateralized is unclear. In this regard, the functional lateralization of the fusiform gyrus is of particular interest, by virtue of its hypothesized role as a "visual word form area". A quantitative Activation Likelihood Estimation meta-analysis was conducted on activation foci from 35 experiments investigating silent reading, and both a whole-brain and a bayesian ROI-based approach were used to assess the lateralization of the data submitted to meta-analysis. Perirolandic areas showed the highest level of left-lateralization, the fusiform cortex and the parietal cortex exhibited only a moderate pattern of left-lateralization, while in the occipital, insular cortices and in the cerebellum the lateralization turned out to be the lowest observed. The relatively limited functional lateralization of the fusiform gyrus was further explored in a regression analysis on the lateralization profile of each study. The functional lateralization of the fusiform gyrus during reading was positively associated with the lateralization of the precentral and inferior occipital gyri and negatively associated with the lateralization of the triangular portion of the inferior frontal gyrus and of the temporal pole. Overall, the present data highlight how lateralization patterns differ within the reading network. Furthermore, the present data highlight how the functional lateralization of the fusiform gyrus during reading is related to the degree of functional lateralization of other language brain areas.
Collapse
Affiliation(s)
| | - Edoardo Gornetti
- Department of Psychology, University of Milano-Bicocca, Milan, Italy; Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; The International Max Planck Research School for Language Sciences, Nijmegen, the Netherlands
| | - Eraldo Paulesu
- Department of Psychology, University of Milano-Bicocca, Milan, Italy; fMRI Unit, IRCCS Orthopedic Institute Galeazzi, Milan, Italy
| |
Collapse
|
2
|
Speed LJ, Eekhof LS, Mak M. The role of visual imagery in story reading: Evidence from aphantasia. Conscious Cogn 2024; 118:103645. [PMID: 38241954 DOI: 10.1016/j.concog.2024.103645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 12/01/2023] [Accepted: 01/09/2024] [Indexed: 01/21/2024]
Abstract
Aphantasia is a condition in which people are unable to experience visual imagery. Since visual imagery is thought to be key to language processing, we hypothesized the experience of a story would differ between individuals with aphantasia and controls. Forty-seven individuals with aphantasia were compared to fifty-one matched controls on their experience of reading a short story and their general reading habits. Aphantasics were less likely to be engaged with, interested in, and absorbed in the story, and experienced reduced emotional engagement with and sympathy for the story characters, compared to controls. Yet, aphantasics and controls did not differ in how much they liked or appreciated the story, and in general, the reading habits of the two groups also did not differ. Results have implications for embodied theories of language, suggesting visual imagery may influence how a story is experienced, but it is not the only route to story enjoyment.
Collapse
Affiliation(s)
- Laura J Speed
- Centre for Language Studies, Radboud University, Netherlands.
| | - Lynn S Eekhof
- Centre for Language Studies, Radboud University, Netherlands
| | - Marloes Mak
- Centre for Language Studies, Radboud University, Netherlands
| |
Collapse
|
3
|
Speed LJ, Iravani B, Lundström JN, Majid A. Losing the sense of smell does not disrupt processing of odor words. BRAIN AND LANGUAGE 2022; 235:105200. [PMID: 36347207 DOI: 10.1016/j.bandl.2022.105200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Revised: 09/14/2022] [Accepted: 10/27/2022] [Indexed: 06/16/2023]
Abstract
Whether language is grounded in action and perception has been a key question in cognitive science, yet little attention has been given to the sense of smell. We directly test whether smell is necessary for comprehension of odor language, by comparing language processing in a group of participants with no sense of smell (anosmics) to a group of control participants. We found no evidence for a difference in online comprehension of odor and taste language between anosmics and controls using a lexical decision task and a semantic similarity judgment task, suggesting olfaction is not critical to the comprehension of odor language. Contrary to predictions, anosmics were better at remembering odor words, and rated odor and taste words as more positively valenced than control participants. This study finds no detriment to odor language after losing the sense of smell, supporting the proposal that odor language is not grounded in odor perception.
Collapse
Affiliation(s)
- Laura J Speed
- Centre for Language Studies, Radboud University, Nijmegen, Netherlands.
| | - Behzad Iravani
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
| | - Johan N Lundström
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden; Stockholm University Brain Imaging Centre, Stockholm University, Stockholm, Sweden
| | - Asifa Majid
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| |
Collapse
|
4
|
Takatsuru Y, Motegi S, Nishikata T, Sato H, Yonemochi K. Frontal medial cortex and angular gyrus functional connectivity is related to sex and age differences in odor sensitivity. J Neuroimaging 2022; 32:611-616. [PMID: 35355361 DOI: 10.1111/jon.12994] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 02/23/2022] [Accepted: 03/13/2022] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND AND PURPOSE Odor preference is one of the key factors for the rehabilitation of the swallowing function. On the other hand, sensitivity to odor differs between sexes and decreases with age. These factors rely on brain neuronal circuits. However, it remains not fully clarified which neuronal circuit determines the sex and age differences in odor sensitivity. In this study, we carried out both the odor sensitivity test and functional MRI (fMRI) to find the key neuronal circuits determining sex and age differences in odor sensitivity. METHODS Healthy volunteers (28 males, aged 27-62 years, and 30 females, aged 21-59 years) participated in this study. Some of them (seven males and seven females) underwent fMRI. We prepared five odorous test substances and presented each substance at 1 minute intervals. After 5 minutes of questioning about food intake, the subjects were asked to recall each of the test substances presented from the list. In the fMRI study, all the subjects underwent 15 minutes of the prestimulation, stimulation with peppermint odor, and poststimulation sessions. RESULTS The odor test score was significantly higher in females than in males and showed an age-dependent decrease. We found four functional connectivities whose degrees were significantly different between males and females. One of them, the functional connectivity between the frontal medial cortex (MedFC) and the left angular gyrus (AG. l), showed an age-dependent change. CONCLUSIONS The functional MedFC-AG.l connectivity is one of the important neuronal circuits that affect the sex- and age-dependent odor sensitivity.
Collapse
Affiliation(s)
- Yusuke Takatsuru
- Division of Multidimensional Clinical Medicine, Department of Nutrition and Health Sciences, Toyo University, Itakura, Japan.,Department of Medicine, Johmoh Hospital, Maebashi, Japan
| | - Shunichi Motegi
- Department of Radiological Sciences, International University of Health and Welfare, Otawara, Japan
| | | | - Hideyasu Sato
- Department of Food Life Sciences, Toyo University, Itakura, Japan
| | - Keita Yonemochi
- Department of Radiological Technology, Gunma Prefectural College of Health Sciences, Maebashi, Japan
| |
Collapse
|
5
|
Borelli E, Butera C, Katirai A, Adams TCE, Aziz-Zadeh L. Impact of motor stroke on novel and conventional action metaphor comprehension. BRAIN AND LANGUAGE 2022; 226:105081. [PMID: 35051790 DOI: 10.1016/j.bandl.2022.105081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 12/17/2021] [Accepted: 01/07/2022] [Indexed: 06/14/2023]
Abstract
Previous studies indicate that damage to motor brain regions impacts comprehension of literal action-related language. However, whether such damage also impacts comprehension of action-metaphors remains unknown. Such a finding would support the notion that metaphors are grounded in sensorimotor representations. Here we tested this hypothesis by comparing comprehension of novel, conventional, and frozen action and non-action metaphors in 14 right-handed adults with right-sided mild to moderate paresis following left hemisphere motor stroke and 23 neurotypical participants. Consistent with our hypothesis, results indicated that only in the stroke group, accuracy for action metaphors was significantly lower than for non-action metaphors. Further, in the stroke group, accuracy was significantly worse in the following pattern: novel < conventional < frozen action metaphors. These results strongly support the notion that motor-related brain regions are important not only for literal action-related language comprehension, but also for action-related metaphor comprehension, especially for less familiar metaphors.
Collapse
Affiliation(s)
- Eleonora Borelli
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy; Center for Neuroscience and Neurotechnology, University of Modena and Reggio Emilia, Modena, Italy; Brain and Creativity Institute, University of Southern California, Los Angeles, CA, USA
| | - Christiana Butera
- Brain and Creativity Institute, University of Southern California, Los Angeles, CA, USA; Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA, USA
| | - Andrew Katirai
- Brain and Creativity Institute, University of Southern California, Los Angeles, CA, USA; Department of Medicine, University of California, Los Angeles, CA, USA
| | - Thomas C E Adams
- Brain and Creativity Institute, University of Southern California, Los Angeles, CA, USA; Department of Psychiatry, Cambridge Health Alliance, Cambridge, MA, USA
| | - Lisa Aziz-Zadeh
- Brain and Creativity Institute, University of Southern California, Los Angeles, CA, USA; Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA, USA.
| |
Collapse
|
6
|
Shebani Z, Nestor PJ, Pulvermüller F. What's "up"? Impaired Spatial Preposition Processing in Posterior Cortical Atrophy. Front Hum Neurosci 2021; 15:731104. [PMID: 34924976 PMCID: PMC8671304 DOI: 10.3389/fnhum.2021.731104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Accepted: 11/04/2021] [Indexed: 11/13/2022] Open
Abstract
This study seeks to confirm whether lesions in posterior regions of the brain involved in visuo-spatial processing are of functional relevance to the processing of words with spatial meaning. We investigated whether patients with Posterior Cortical Atrophy (PCA), an atypical form of Alzheimer’s Disease which predominantly affects parieto-occipital brain regions, is associated with deficits in working memory for spatial prepositions. Case series of patients with PCA and matched healthy controls performed tests of immediate and delayed serial recall on words from three lexico-semantic word categories: number words (twelve), spatial prepositions (behind) and function words (e.g., shall). The three word categories were closely matched for a number of psycholinguistic and semantic variables including length, bi-/tri-gram frequency, word frequency, valence and arousal. Relative to controls, memory performance of PCA patients on short word lists was significantly impaired on spatial prepositions in the delayed serial recall task. These results suggest that lesions in posterior parieto-occipital regions specifically impair the processing of spatial prepositions. Our findings point to a pertinent role of posterior cortical regions in the semantic processing of words with spatial meaning and provide strong support for modality-specific semantic theories that recognize the necessary contributions of sensorimotor regions to conceptual semantic processing.
Collapse
Affiliation(s)
- Zubaida Shebani
- Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom.,Psychology Department, Sultan Qaboos University, Muscat, Oman
| | - Peter J Nestor
- QLD Brain Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Friedemann Pulvermüller
- Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom.,Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany.,Einstein Center for Neurosciences, Charité University Medicine Berlin, Berlin, Germany
| |
Collapse
|
7
|
Abstract
Many words are strongly connected to the senses, such as vision, taste, and touch. In order to facilitate research on language and the senses, large sets of linguistic stimuli and their corresponding measures of sensory associations should be available. To aid in such investigations, we present a new set of sensory modality norms for over 24,000 Dutch words. The sensory norms comprise perceptual strength ratings in six perceptual modalities: audition, gustation, haptics, olfaction, vision, and interoception. The new norms improve on existing Dutch sensory norms in three ways: 1) they significantly expand on the number of words rated; 2) they include multiple word classes; 3) they add a new perceptual modality: interoception. We show that the sensory norms are able to predict word processing behavior and outperform existing ratings of sensory experience: concreteness and imageability. The data are available via the Open Science Framework (https://osf.io/ubvy2) and serve as a valuable resource for research into the relationship between language and perception.
Collapse
|
8
|
Macedonia M, Lehner AE, Repetto C. Positive effects of grasping virtual objects on memory for novel words in a second language. Sci Rep 2020; 10:10760. [PMID: 32612096 PMCID: PMC7329851 DOI: 10.1038/s41598-020-67539-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2019] [Accepted: 06/09/2020] [Indexed: 11/19/2022] Open
Abstract
Theories of embodied cognition describe language processing and representation as inherently connected to the sensorimotor experiences collected during acquisition. While children grasp their world, collect bodily experiences and name them, in second language (L2), students learn bilingual word lists. Experimental evidence shows that embodiment by mean of gestures enhances memory for words in L2. However, no study has been conducted on the effects of grasping in L2. In a virtual scenario, we trained 46 participants on 18 two- and three-syllabic words of Vimmi, an artificial corpus created for experimental purposes. The words were assigned concrete meanings of graspable objects. Six words were learned audio-visually, by reading the words projected on the wall and by hearing them. Another 6 words were trained by observation of virtual objects. Another 6 words were learned by observation and additional grasping the virtual objects. Thereafter participants were subministered free, cued recall, and reaction time tests in order to assess the word retention and the word recognition. After 30 days, the recall tests were repeated remotely to assess the memory in the long term. The results show that grasping of virtual objects can lead to superior memory performance and to lower reaction times during recognition.
Collapse
Affiliation(s)
- M Macedonia
- Department of Information Engineering, Johannes Kepler University, Linz, Austria.
- Linz Center of Mechatronics GmbH, Johannes Kepler University, Linz, Austria.
- Lise Meitner Research Group "Cognition and Plasticity", Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - A E Lehner
- Department of Linguistics, University of Vienna, Vienna, Austria
| | - C Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy
| |
Collapse
|
9
|
Boulenger V, Martel M, Bouvet C, Finos L, Krzonowski J, Farnè A, Roy AC. Feeling better: Tactile verbs speed up tactile detection. Brain Cogn 2020; 142:105582. [PMID: 32422452 DOI: 10.1016/j.bandc.2020.105582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2019] [Revised: 04/16/2020] [Accepted: 04/24/2020] [Indexed: 10/24/2022]
Abstract
Embodiment of action-related language into the motor system has been extensively documented. Yet the case of sensory words, especially referring to touch, remains overlooked. We investigated the influence of verbs denoting tactile sensations on tactile perception. In Experiment 1, participants detected tactile stimulations on their forearm, preceded by tactile or non-tactile verbs by one of three delays (170, 350, 500 ms) reflecting different word processing stages. Results revealed shorter reaction times to tactile stimulations following tactile than non-tactile verbs, irrespective of delay. To ensure that priming pertained to tactile, and not motor, verb properties, Experiment 2 compared the impact of tactile verbs to both action and non-tactile verbs, while stimulations were delivered on the index finger. No priming emerged following action verbs, therefore not supporting the motor-grounded interpretation. Facilitation by tactile verbs was however not observed, possibly owing to methodological changes. Experiment 3, identical to Experiment 2 except that stimulation was delivered to participants' forearm, replicated the priming effect. Importantly, tactile stimulations were detected faster after tactile than after both non-tactile and action verbs, indicating that verbs' tactile properties engaged resources shared with sensory perception. Our findings suggest that language conveying tactile information can activate somatosensory representations and subsequently promote tactile detection.
Collapse
Affiliation(s)
- Véronique Boulenger
- Laboratory Dynamique du Langage CNRS/Lyon 2 University UMR5596, Maisons des Sciences de l'Homme, 14 avenue Berthelot, 69007 Lyon, France.
| | - Marie Martel
- Laboratory Dynamique du Langage CNRS/Lyon 2 University UMR5596, Maisons des Sciences de l'Homme, 14 avenue Berthelot, 69007 Lyon, France; Department of Psychology, Royal Holloway, University of London, Egham TW20 0EY, London, England, United Kingdom
| | - Cécile Bouvet
- Laboratory Dynamique du Langage CNRS/Lyon 2 University UMR5596, Maisons des Sciences de l'Homme, 14 avenue Berthelot, 69007 Lyon, France
| | - Livio Finos
- Department of Statistical Sciences, University of Padova, Via Battisti, 241, 35121 Padova, Italy
| | - Jennifer Krzonowski
- Laboratory Dynamique du Langage CNRS/Lyon 2 University UMR5596, Maisons des Sciences de l'Homme, 14 avenue Berthelot, 69007 Lyon, France
| | - Alessandro Farnè
- Integrative Multisensory Perception Action & Cognition Team - ImpAct, Lyon Neuroscience Research Center, INSERM U1028, CNRS U5292, Lyon 1 University, 16 avenue du Doyen Lépine, 69500 Bron, France; Center for Mind/Brain Sciences (CIMeC), University of Trento, Palazzo Fedrigotti - corso Bettini, 31, 38068 -TN Rovereto, Italy
| | - Alice Catherine Roy
- Laboratory Dynamique du Langage CNRS/Lyon 2 University UMR5596, Maisons des Sciences de l'Homme, 14 avenue Berthelot, 69007 Lyon, France
| |
Collapse
|
10
|
The functional relevance of dorsal motor systems for processing tool nouns– evidence from patients with focal lesions. Neuropsychologia 2020; 141:107384. [DOI: 10.1016/j.neuropsychologia.2020.107384] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2019] [Revised: 11/17/2019] [Accepted: 02/09/2020] [Indexed: 02/03/2023]
|
11
|
Harpaintner M, Sim EJ, Trumpp NM, Ulrich M, Kiefer M. The grounding of abstract concepts in the motor and visual system: An fMRI study. Cortex 2020; 124:1-22. [DOI: 10.1016/j.cortex.2019.10.014] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Revised: 08/07/2019] [Accepted: 10/30/2019] [Indexed: 12/21/2022]
|
12
|
Popp M, Trumpp NM, Kiefer M. Processing of Action and Sound Verbs in Context: An FMRI Study. Transl Neurosci 2019; 10:200-222. [PMID: 31637047 PMCID: PMC6795028 DOI: 10.1515/tnsci-2019-0035] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Accepted: 07/17/2019] [Indexed: 01/28/2023] Open
Abstract
Recent theories propose a flexible recruitment of sensory and motor brain regions during conceptual processing depending on context and task. The present functional magnetic resonance imaging study investigated the influence of context and task on conceptual processing of action and sound verbs. Participants first performed an explicit semantic context decision task, in which action and sound verbs were presented together with a context noun. The same verbs were repeatedly presented in a subsequent implicit lexical decision task together with new action and sound verbs. Thereafter, motor and acoustic localizer tasks were administered to identify brain regions involved in perception and action. During the explicit task, we found differential activations to action and sound verbs near corresponding sensorimotor brain regions. During the implicit lexical decision task, differences between action and sound verbs were absent. However, feature-specific repetition effects were observed near corresponding sensorimotor brain regions. The present results suggest flexible conceptual representations depending on context and task. Feature-specific effects were observed only near, but not within corresponding sensorimotor brain regions, as defined by the localizer tasks. Our results therefore only provide limited evidence in favor of grounded cognition theories assuming a close link between the conceptual and the sensorimotor systems.
Collapse
Affiliation(s)
- Margot Popp
- Ulm University, Department of Psychiatry, Ulm, Germany
| | | | - Markus Kiefer
- Ulm University, Department of Psychiatry, Ulm, Germany
| |
Collapse
|
13
|
Speed LJ, Majid A. Grounding language in the neglected senses of touch, taste, and smell. Cogn Neuropsychol 2019; 37:363-392. [DOI: 10.1080/02643294.2019.1623188] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Laura J. Speed
- Department of Psychology, University of York, York, England
| | - Asifa Majid
- Department of Psychology, University of York, York, England
| |
Collapse
|
14
|
Gao C, Baucom LB, Kim J, Wang J, Wedell DH, Shinkareva SV. Distinguishing abstract from concrete concepts in supramodal brain regions. Neuropsychologia 2019; 131:102-110. [PMID: 31175884 DOI: 10.1016/j.neuropsychologia.2019.05.032] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2018] [Revised: 01/18/2019] [Accepted: 05/31/2019] [Indexed: 11/24/2022]
Abstract
Concrete words have been shown to have a processing advantage over abstract words, yet theoretical accounts and neural correlates underlying the distinction between concrete and abstract concepts are still unresolved. In an fMRI study, participants performed a property verification task on abstract and concrete concepts. Property comparisons of concrete concepts were predominantly based on either visual or haptic features. Multivariate pattern analysis successfully distinguished between abstract and concrete stimulus comparisons at the whole brain level. Multivariate searchlight analyses showed that posterior and middle cingulate cortices contained information that distinguished abstract from concrete concepts regardless of feature dominance. These results support the view that supramodal convergence zones play an important role in representation of concrete and abstract concepts.
Collapse
Affiliation(s)
- Chuanji Gao
- Department of Psychology, Institute of Mind and Brain, University of South Carolina, Columbia, 29201, USA
| | - Laura B Baucom
- Department of Psychology, Institute of Mind and Brain, University of South Carolina, Columbia, 29201, USA
| | - Jongwan Kim
- Department of Psychology, Institute of Mind and Brain, University of South Carolina, Columbia, 29201, USA
| | - Jing Wang
- Department of Psychology, Institute of Mind and Brain, University of South Carolina, Columbia, 29201, USA
| | - Douglas H Wedell
- Department of Psychology, Institute of Mind and Brain, University of South Carolina, Columbia, 29201, USA
| | - Svetlana V Shinkareva
- Department of Psychology, Institute of Mind and Brain, University of South Carolina, Columbia, 29201, USA.
| |
Collapse
|
15
|
Speed LJ, Majid A. An Exception to Mental Simulation: No Evidence for Embodied Odor Language. Cogn Sci 2018; 42:1146-1178. [PMID: 29442364 PMCID: PMC6001635 DOI: 10.1111/cogs.12593] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2017] [Revised: 10/30/2017] [Accepted: 12/20/2017] [Indexed: 11/28/2022]
Abstract
Do we mentally simulate olfactory information? We investigated mental simulation of odors and sounds in two experiments. Participants retained a word while they smelled an odor or heard a sound, then rated odor/sound intensity and recalled the word. Later odor/sound recognition was also tested, and pleasantness and familiarity judgments were collected. Word recall was slower when the sound and sound‐word mismatched (e.g., bee sound with the word typhoon). Sound recognition was higher when sounds were paired with a match or near‐match word (e.g., bee sound with bee or buzzer). This indicates sound‐words are mentally simulated. However, using the same paradigm no memory effects were observed for odor. Instead it appears odor‐words only affect lexical‐semantic representations, demonstrated by higher ratings of odor intensity and pleasantness when an odor was paired with a match or near‐match word (e.g., peach odor with peach or mango). These results suggest fundamental differences in how odor and sound‐words are represented.
Collapse
Affiliation(s)
| | - Asifa Majid
- Centre for Language Studies, Radboud University.,Max Planck Institute for Psycholinguistics.,Donders Institute for Brain, Cognition and Behaviour, Radboud University
| |
Collapse
|
16
|
Pulvermüller F. Neural reuse of action perception circuits for language, concepts and communication. Prog Neurobiol 2017; 160:1-44. [PMID: 28734837 DOI: 10.1016/j.pneurobio.2017.07.001] [Citation(s) in RCA: 124] [Impact Index Per Article: 17.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2017] [Revised: 05/12/2017] [Accepted: 07/13/2017] [Indexed: 10/19/2022]
Abstract
Neurocognitive and neurolinguistics theories make explicit statements relating specialized cognitive and linguistic processes to specific brain loci. These linking hypotheses are in need of neurobiological justification and explanation. Recent mathematical models of human language mechanisms constrained by fundamental neuroscience principles and established knowledge about comparative neuroanatomy offer explanations for where, when and how language is processed in the human brain. In these models, network structure and connectivity along with action- and perception-induced correlation of neuronal activity co-determine neurocognitive mechanisms. Language learning leads to the formation of action perception circuits (APCs) with specific distributions across cortical areas. Cognitive and linguistic processes such as speech production, comprehension, verbal working memory and prediction are modelled by activity dynamics in these APCs, and combinatorial and communicative-interactive knowledge is organized in the dynamics within, and connections between APCs. The network models and, in particular, the concept of distributionally-specific circuits, can account for some previously not well understood facts about the cortical 'hubs' for semantic processing and the motor system's role in language understanding and speech sound recognition. A review of experimental data evaluates predictions of the APC model and alternative theories, also providing detailed discussion of some seemingly contradictory findings. Throughout, recent disputes about the role of mirror neurons and grounded cognition in language and communication are assessed critically.
Collapse
Affiliation(s)
- Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy & Humanities, WE4, Freie Universität Berlin, 14195 Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, 10099 Berlin, Germany; Einstein Center for Neurosciences, Berlin 10117 Berlin, Germany.
| |
Collapse
|
17
|
Cosentino E, Baggio G, Kontinen J, Werning M. The Time-Course of Sentence Meaning Composition. N400 Effects of the Interaction between Context-Induced and Lexically Stored Affordances. Front Psychol 2017; 8:813. [PMID: 28603506 PMCID: PMC5445161 DOI: 10.3389/fpsyg.2017.00813] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2016] [Accepted: 05/03/2017] [Indexed: 11/13/2022] Open
Abstract
Contemporary semantic theories can be classified along two dimensions: (i) the way and time-course in which contextual factors influence sentence truth-conditions; and (ii) whether and to what extent comprehension involves sensory, motor and emotional processes. In order to explore this theoretical space, our ERP study investigates the time-course of the interaction between the lexically specified telic component of a noun (the function of the object to which the noun refers to, e.g., a funnel is generally used to pour liquids into containers) and an ad-hoc affordance contextually induced by the situation described in the discourse. We found that, if preceded by a neutral discourse context, a verb incongruent with the noun's telic component as in “She uses the funnel to hang her coat” elicited an enhanced N400 compared to a congruent verb as in “She uses the funnel to pour water into a container.” However, if the situation introduced in the preceding discourse induced a new function for the object as an ad-hoc affordance (e.g., the funnel is glued to the wall and the agent wants to hang the coat), we observed a crossing-over regarding the direction of the N400 effect: comparing the ad-hoc affordance-inducing context with the neutral context, the N400 for the incongruent verb was significantly reduced, whereas the N400 for the congruent verb was significantly enhanced. We explain these results as a consequence of the incorporation of the contextually triggered ad-hoc affordance into the meaning of the noun. Combining these results with an analysis of semantic similarity values between test sentences and contexts, we argue that one possibility is that the incorporation of an ad-hoc affordance may be explained on the basis of the mental simulation of concurrent motor information.
Collapse
Affiliation(s)
- Erica Cosentino
- Institute of Philosophy II, Ruhr University of BochumBochum, Germany
- *Correspondence: Erica Cosentino
| | - Giosuè Baggio
- Department of Language and Literature, Norwegian University of Science and TechnologyTrondheim, Norway
| | - Jarmo Kontinen
- Institute of Philosophy II, Ruhr University of BochumBochum, Germany
| | - Markus Werning
- Institute of Philosophy II, Ruhr University of BochumBochum, Germany
| |
Collapse
|
18
|
Abstract
There is general agreement that perisylvian language cortex plays a major role in lexical and semantic processing; but the contribution of additional, more widespread, brain areas in the processing of different semantic word categories remains controversial. We investigated word processing in two groups of patients whose neurodegenerative diseases preferentially affect specific parts of the brain, to determine whether their performance would vary as a function of semantic categories proposed to recruit those brain regions. Cohorts with (i) Semantic Dementia (SD), who have anterior temporal-lobe atrophy, and (ii) Posterior Cortical Atrophy (PCA), who have predominantly parieto-occipital atrophy, performed a lexical decision test on words from five different lexico-semantic categories: colour (e.g., yellow), form (oval), number (seven), spatial prepositions (under) and function words (also). Sets of pseudo-word foils matched the target words in length and bi-/tri-gram frequency. Word-frequency was matched between the two visual word categories (colour and form) and across the three other categories (number, prepositions, and function words). Age-matched healthy individuals served as controls. Although broad word processing deficits were apparent in both patient groups, the deficit was strongest for colour words in SD and for spatial prepositions in PCA. The patterns of performance on the lexical decision task demonstrate (a) general lexicosemantic processing deficits in both groups, though more prominent in SD than in PCA, and (b) differential involvement of anterior-temporal and posterior-parietal cortex in the processing of specific semantic categories of words.
Collapse
|
19
|
Tajima CI, Tajima S, Koida K, Komatsu H, Aihara K, Suzuki H. Population Code Dynamics in Categorical Perception. Sci Rep 2016; 6:22536. [PMID: 26935275 PMCID: PMC4776180 DOI: 10.1038/srep22536] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2015] [Accepted: 02/17/2016] [Indexed: 11/08/2022] Open
Abstract
Categorical perception is a ubiquitous function in sensory information processing, and is reported to have important influences on the recognition of presented and/or memorized stimuli. However, such complex interactions among categorical perception and other aspects of sensory processing have not been explained well in a unified manner. Here, we propose a recurrent neural network model to process categorical information of stimuli, which approximately realizes a hierarchical Bayesian estimation on stimuli. The model accounts for a wide variety of neurophysiological and cognitive phenomena in a consistent framework. In particular, the reported complexity of categorical effects, including (i) task-dependent modulation of neural response, (ii) clustering of neural population representation, (iii) temporal evolution of perceptual color memory, and (iv) a non-uniform discrimination threshold, are explained as different aspects of a single model. Moreover, we directly examine key model behaviors in the monkey visual cortex by analyzing neural population dynamics during categorization and discrimination of color stimuli. We find that the categorical task causes temporally-evolving biases in the neuronal population representations toward the focal colors, which supports the proposed model. These results suggest that categorical perception can be achieved by recurrent neural dynamics that approximates optimal probabilistic inference in the changing environment.
Collapse
Affiliation(s)
- Chihiro I. Tajima
- Graduate School of Information Science and Technology, the University of Tokyo. 7-3-1 Hongo, Bunkyo, Tokyo 113-8656, Japan
| | - Satohiro Tajima
- Department of Basic Neuroscience, University of Geneva. CMU, 1 rue Michel Servet, 1211 Genève, Switzerland
| | - Kowa Koida
- EIIRIS, Toyohashi University of Technology. 1-1 Hibarigaoka, Tempaku, Toyohashi, Aichi, 441-8580, Japan
| | - Hidehiko Komatsu
- National Institute for Physiological Sciences. 38 Nishigonaka Myodaiji, Okazaki, Aichi, 444-8585, Japan
| | - Kazuyuki Aihara
- Graduate School of Information Science and Technology, the University of Tokyo. 7-3-1 Hongo, Bunkyo, Tokyo 113-8656, Japan
- National Institute for Physiological Sciences. 38 Nishigonaka Myodaiji, Okazaki, Aichi, 444-8585, Japan
- Institute of Industrial Science, the University of Tokyo. 4-6-1 Komaba, Meguro, Tokyo 153-8505, Japan
| | - Hideyuki Suzuki
- Graduate School of Information Science and Technology, the University of Tokyo. 7-3-1 Hongo, Bunkyo, Tokyo 113-8656, Japan
| |
Collapse
|
20
|
Garagnani M, Pulvermüller F. Conceptual grounding of language in action and perception: a neurocomputational model of the emergence of category specificity and semantic hubs. Eur J Neurosci 2016; 43:721-37. [PMID: 26660067 PMCID: PMC4982106 DOI: 10.1111/ejn.13145] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2015] [Revised: 11/29/2015] [Accepted: 11/30/2015] [Indexed: 12/19/2022]
Abstract
Current neurobiological accounts of language and cognition offer diverging views on the questions of 'where' and 'how' semantic information is stored and processed in the human brain. Neuroimaging data showing consistent activation of different multi-modal areas during word and sentence comprehension suggest that all meanings are processed indistinctively, by a set of general semantic centres or 'hubs'. However, words belonging to specific semantic categories selectively activate modality-preferential areas; for example, action-related words spark activity in dorsal motor cortex, whereas object-related ones activate ventral visual areas. The evidence for category-specific and category-general semantic areas begs for a unifying explanation, able to integrate the emergence of both. Here, a neurobiological model offering such an explanation is described. Using a neural architecture replicating anatomical and neurophysiological features of frontal, occipital and temporal cortices, basic aspects of word learning and semantic grounding in action and perception were simulated. As the network underwent training, distributed lexico-semantic circuits spontaneously emerged. These circuits exhibited different cortical distributions that reached into dorsal-motor or ventral-visual areas, reflecting the correlated category-specific sensorimotor patterns that co-occurred during action- or object-related semantic grounding, respectively. Crucially, substantial numbers of neurons of both types of distributed circuits emerged in areas interfacing between modality-preferential regions, i.e. in multimodal connection hubs, which therefore became loci of general semantic binding. By relating neuroanatomical structure and cellular-level learning mechanisms with system-level cognitive function, this model offers a neurobiological account of category-general and category-specific semantic areas based on the different cortical distributions of the underlying semantic circuits.
Collapse
Affiliation(s)
- Max Garagnani
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Habelschwerdter Allee 45, 14195, Berlin, Germany
- Centre for Robotics and Neural Systems (CRNS), University of Plymouth, Plymouth, Devon, UK
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Habelschwerdter Allee 45, 14195, Berlin, Germany
| |
Collapse
|
21
|
Abdullah A, Khan IH, Basuhail A, Hussain A. A Novel Near-Infrared Spectroscopy Based Spatiotemporal Cognition Study of the Human Brain Using Clustering. Cognit Comput 2015. [DOI: 10.1007/s12559-015-9358-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
22
|
Murdaugh DL, Maximo JO, Kana RK. Changes in intrinsic connectivity of the brain's reading network following intervention in children with autism. Hum Brain Mapp 2015; 36:2965-79. [PMID: 26058572 DOI: 10.1002/hbm.22821] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2014] [Revised: 03/30/2015] [Accepted: 04/06/2015] [Indexed: 01/14/2023] Open
Abstract
While task-based neuroimaging studies have identified alterations in neural circuitry underlying language processing in children with autism spectrum disorders [ASD], resting state functional magnetic resonance imaging [rsfMRI] is a promising alternative to the constraints posed by task-based fMRI. This study used rsfMRI, in a longitudinal design, to study the impact of a reading intervention on connectivity of the brain regions involved in reading comprehension in children with ASD. Functional connectivity was examined using group independent component analysis (GICA) and seed-based correlation analysis of Broca's and Wernicke's areas, in three groups of participants: an experimental group of ASD children (ASD-EXP), a wait list control group of ASD children (ASD-WLC), and a group of typically developing (TD) control children. Both GICA and seed-based analyses revealed stronger functional connectivity of Broca's and Wernicke's areas in the ASD-EXP group postintervention. Additionally, improvement in reading comprehension in the ASD-EXP group was correlated with greater connectivity in both Broca's and Wernicke's area in the GICA identified reading network component. In addition, increased connectivity between the Broca's area and right postcentral and right STG, and the Wernicke's area and LIFG, were also correlated with greater improvement in reading comprehension. Overall, this study revealed widespread changes in functional connectivity of the brain's reading network as a result of intervention in children with ASD. These novel findings provide valuable insights into the neuroplasticity of brain areas underlying reading and the impact of intensive intervention in modifying them in children with ASD.
Collapse
Affiliation(s)
- Donna L Murdaugh
- Department of Psychology, University of Alabama at Birmingham, Birmingham, AL
| | - Jose O Maximo
- Department of Psychology, University of Alabama at Birmingham, Birmingham, AL
| | - Rajesh K Kana
- Department of Psychology, University of Alabama at Birmingham, Birmingham, AL
| |
Collapse
|
23
|
Verb gapping: an action-gap compatibility study. Acta Psychol (Amst) 2015; 156:104-13. [PMID: 25103783 DOI: 10.1016/j.actpsy.2014.07.009] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2013] [Revised: 05/29/2014] [Accepted: 07/15/2014] [Indexed: 11/21/2022] Open
Abstract
This study addresses the processing of verb-gapping sentences, e.g., John closes a juice bottle and Jim [ ] a lemonade bottle. The goal was to explore if there would be an interaction between language comprehension and motor action not only for overt action verbs but also for gapped verbs. Participants read gapping sentences that either described clockwise or counter-clockwise manual rotations (e.g., closes vs. opens a juice bottle). Adopting a paradigm developed by Zwaan and Taylor (2006), sentence presentation was frame-by-frame. Participants proceeded from frame to frame by turning a knob either clockwise or counter clockwise. Analyses of the frame reading-times yielded a significant effect of compatibility between the linguistically conveyed action and the knob turning for the overt-verb (e.g., closes/opens a juice bottle) as well as for the gapped-verb frame (e.g., a lemonade bottle) - with longer reading times in the match condition than in the mismatch condition - but not for any of the other frames (e.g., and Jim). The results are promising in providing novel evidence for the real-time reactivation of gapped verbs and in suggesting that action simulation is not bound to the processing of overt verbs.
Collapse
|
24
|
Tomasino B, Fabbro F, Brambilla P. How do conceptual representations interact with processing demands: An fMRI study on action- and abstract-related words. Brain Res 2014; 1591:38-52. [PMID: 25446003 DOI: 10.1016/j.brainres.2014.10.008] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2014] [Revised: 09/30/2014] [Accepted: 10/05/2014] [Indexed: 11/28/2022]
Abstract
This fMRI study investigated the functional mechanisms related to mental simulation of abstract- and action-related words and measured the effect of the type of stimulus (Abstract vs. action verbs) and the type of task (imagery vs. control task) to explore how conceptual representations interact with processing demands. A significant task by stimuli interaction showed that action-related words activated the left sensorimotor cortex during explicit imagery (as compared to the control task), whereas abstract-related verbs did not automatically activate this area. Rather, as we made sure that Abstract verbs were not associated with motor states (as tested in a rating study of our stimulus list), imagery elicited by abstract verb processing (as compared to Action verbs, and controlled for letter detection) differentially activated a right hemisphere neural network including the right supramarginal (SMG) gyrus and the precuneus which might be related to mental imagery of emotion-related scenes and not to the semantics of the stimuli per se. Our results confirmed the view that the activation of the sensorimotor cortex during language processing of abstract- and action-related words is strategy-dependent.
Collapse
Affiliation(s)
- Barbara Tomasino
- Scientific Institute IRCCS "E. Medea", Polo FVG, San Vito al Tagliamento (PN), Italy.
| | - Franco Fabbro
- Scientific Institute IRCCS "E. Medea", Polo FVG, San Vito al Tagliamento (PN), Italy; Dipartimento di Scienze Umane, Università di Udine, Italy
| | - Paolo Brambilla
- Scientific Institute IRCCS "E. Medea", Polo FVG, San Vito al Tagliamento (PN), Italy; DISM, Inter-University Centre for Behavioral Neurosciences, University of Udine, Udine, Italy
| |
Collapse
|
25
|
Fargier R, Ploux S, Cheylus A, Reboul A, Paulignan Y, Nazir TA. Differentiating Semantic Categories during the Acquisition of Novel Words: Correspondence Analysis Applied to Event-related Potentials. J Cogn Neurosci 2014; 26:2552-63. [DOI: 10.1162/jocn_a_00669] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
Growing evidence suggests that semantic knowledge is represented in distributed neural networks that include modality-specific structures. Here, we examined the processes underlying the acquisition of words from different semantic categories to determine whether the emergence of visual- and action-based categories could be tracked back to their acquisition. For this, we applied correspondence analysis (CA) to ERPs recorded at various moments during acquisition. CA is a multivariate statistical technique typically used to reveal distance relationships between words of a corpus. Applied to ERPs, it allows isolating factors that best explain variations in the data across time and electrodes. Participants were asked to learn new action and visual words by associating novel pseudowords with the execution of hand movements or the observation of visual images. Words were probed before and after training on two consecutive days. To capture processes that unfold during lexical access, CA was applied on the 100–400 msec post-word onset interval. CA isolated two factors that organized the data as a function of test sessions and word categories. Conventional ERP analyses further revealed a category-specific increase in the negativity of the ERPs to action and visual words at the frontal and occipital electrodes, respectively. The distinct neural processes underlying action and visual words can thus be tracked back to the acquisition of word-referent relationships and may have its origin in association learning. Given current evidence for the flexibility of language-induced sensory-motor activity, we argue that these associative links may serve functions beyond word understanding, that is, the elaboration of situation models.
Collapse
|
26
|
Lewis G, Poeppel D. The role of visual representations during the lexical access of spoken words. BRAIN AND LANGUAGE 2014; 134:1-10. [PMID: 24814579 PMCID: PMC4385754 DOI: 10.1016/j.bandl.2014.03.008] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2013] [Revised: 03/10/2014] [Accepted: 03/22/2014] [Indexed: 05/31/2023]
Abstract
Do visual representations contribute to spoken word recognition? We examine, using MEG, the effects of sublexical and lexical variables at superior temporal (ST) areas and the posterior middle temporal gyrus (pMTG) compared with that of word imageability at visual cortices. Embodied accounts predict early modulation of visual areas by imageability--concurrently with or prior to modulation of pMTG by lexical variables. Participants responded to speech stimuli varying continuously in imageability during lexical decision with simultaneous MEG recording. We employed the linguistic variables in a new type of correlational time course analysis to assess trial-by-trial activation in occipital, ST, and pMTG regions of interest (ROIs). The linguistic variables modulated the ROIs during different time windows. Critically, visual regions reflected an imageability effect prior to effects of lexicality on pMTG. This surprising effect supports a view on which sensory aspects of a lexical item are not a consequence of lexical activation.
Collapse
Affiliation(s)
- Gwyneth Lewis
- Department of Psychology, New York University, 6 Washington Place, 2nd floor, New York, NY 10003, United States.
| | - David Poeppel
- Department of Psychology, New York University, 6 Washington Place, 2nd floor, New York, NY 10003, United States
| |
Collapse
|
27
|
To move or not to move: Subthalamic deep brain stimulation effects on implicit motor simulation. Brain Res 2014; 1574:14-25. [DOI: 10.1016/j.brainres.2014.06.009] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2014] [Revised: 05/13/2014] [Accepted: 06/06/2014] [Indexed: 11/23/2022]
|
28
|
Moseley RL, Pulvermüller F. Nouns, verbs, objects, actions, and abstractions: local fMRI activity indexes semantics, not lexical categories. BRAIN AND LANGUAGE 2014; 132:28-42. [PMID: 24727103 PMCID: PMC4029073 DOI: 10.1016/j.bandl.2014.03.001] [Citation(s) in RCA: 65] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/14/2013] [Revised: 02/11/2014] [Accepted: 03/03/2014] [Indexed: 06/03/2023]
Abstract
Noun/verb dissociations in the literature defy interpretation due to the confound between lexical category and semantic meaning; nouns and verbs typically describe concrete objects and actions. Abstract words, pertaining to neither, are a critical test case: dissociations along lexical-grammatical lines would support models purporting lexical category as the principle governing brain organisation, whilst semantic models predict dissociation between concrete words but not abstract items. During fMRI scanning, participants read orthogonalised word categories of nouns and verbs, with or without concrete, sensorimotor meaning. Analysis of inferior frontal/insula, precentral and central areas revealed an interaction between lexical class and semantic factors with clear category differences between concrete nouns and verbs but not abstract ones. Though the brain stores the combinatorial and lexical-grammatical properties of words, our data show that topographical differences in brain activation, especially in the motor system and inferior frontal cortex, are driven by semantics and not by lexical class.
Collapse
Affiliation(s)
- Rachel L Moseley
- MRC Cognition and Brain Sciences, Unit, 15 Chaucer Road, CB2 7EF, Cambridge, UK; Autism Research Centre, Department of Psychiatry, University of Cambridge, Douglas House, 18b Trumpington Road, CB2 8AH, Cambridge, UK.
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Habelschwerdter Allee 45, 14195 Berlin, Germany.
| |
Collapse
|
29
|
Pulvermüller F, Moseley RL, Egorova N, Shebani Z, Boulenger V. Motor cognition–motor semantics: Action perception theory of cognition and communication. Neuropsychologia 2014; 55:71-84. [DOI: 10.1016/j.neuropsychologia.2013.12.002] [Citation(s) in RCA: 48] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2013] [Revised: 11/30/2013] [Accepted: 12/02/2013] [Indexed: 10/25/2022]
|
30
|
Pulvermüller F. Semantic embodiment, disembodiment or misembodiment? In search of meaning in modules and neuron circuits. BRAIN AND LANGUAGE 2013; 127:86-103. [PMID: 23932167 DOI: 10.1016/j.bandl.2013.05.015] [Citation(s) in RCA: 82] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2012] [Revised: 03/01/2013] [Accepted: 05/23/2013] [Indexed: 06/02/2023]
Abstract
"Embodied" proposals claim that the meaning of at least some words, concepts and constructions is grounded in knowledge about actions and objects. An alternative "disembodied" position locates semantics in a symbolic system functionally detached from sensorimotor modules. This latter view is not tenable theoretically and has been empirically falsified by neuroscience research. A minimally-embodied approach now claims that action-perception systems may "color", but not represent, meaning; however, such minimal embodiment (misembodiment?) still fails to explain why action and perception systems exert causal effects on the processing of symbols from specific semantic classes. Action perception theory (APT) offers neurobiological mechanisms for "embodied" referential, affective and action semantics along with "disembodied" mechanisms of semantic abstraction, generalization and symbol combination, which draw upon multimodal brain systems. In this sense, APT suggests integrative-neuromechanistic explanations of why both sensorimotor and multimodal areas of the human brain differentially contribute to specific facets of meaning and concepts.
Collapse
Affiliation(s)
- Friedemann Pulvermüller
- Brain Language Laboratory, Freie Universität Berlin, 14195 Berlin, Germany; Medical Research Council, Cognition and Brain Sciences Unit, Cambridge CB2 7EF, UK.
| |
Collapse
|
31
|
Bedny M, Saxe R. Insights into the origins of knowledge from the cognitive neuroscience of blindness. Cogn Neuropsychol 2013; 29:56-84. [PMID: 23017086 DOI: 10.1080/02643294.2012.713342] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Children learn about the world through senses such as touch, smell, vision, and audition, but they conceive of the world in terms of objects, events, agents, and their mental states. A fundamental question in cognitive science is how nature and nurture contribute to the development of such conceptual categories. What innate mechanisms do children bring to the learning problem? How does experience contribute to development? In this article we discuss insights into these longstanding questions from cognitive neuroscience studies of blindness. Despite drastically different sensory experiences, behavioural and neuroscientific work suggests that blind children acquire typical concepts of objects, actions, and mental states. Blind people think and talk about these categories in ways that are similar to sighted people. Neuroimaging reveals that blind people make such judgements relying on the same neural mechanisms as sighted people. One way to interpret these findings is that neurocognitive development is largely hardwired, and so differences in experience have little consequence. Contrary to this interpretation, neuroimaging studies also show that blindness profoundly reorganizes the visual system. Most strikingly, developmental blindness enables "visual" circuits to participate in high-level cognitive functions, including language processing. Thus, blindness qualitatively changes sensory representations, but leaves conceptual representations largely unchanged. The effect of sensory experience on concepts is modest, despite the brain's potential for neuroplasticity.
Collapse
Affiliation(s)
- Marina Bedny
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, 02139, USA.
| | | |
Collapse
|
32
|
Hauk O, Tschentscher N. The Body of Evidence: What Can Neuroscience Tell Us about Embodied Semantics? Front Psychol 2013; 4:50. [PMID: 23407791 PMCID: PMC3570773 DOI: 10.3389/fpsyg.2013.00050] [Citation(s) in RCA: 59] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2012] [Accepted: 01/23/2013] [Indexed: 02/05/2023] Open
Abstract
Semantic knowledge is based on the way we perceive and interact with the world. However, the jury is still out on the question: to what degree are neuronal systems that subserve acquisition of semantic knowledge, such as sensory-motor networks, involved in its representation and processing? We will begin with a critical evaluation of the main behavioral and neuroimaging methods with respect to their capability to define the functional roles of specific brain areas. Any behavioral or neuroscientific measure is a conflation of representations and processes. Hence, a combination of behavioral and neurophysiological interactions as well as time-course information is required to define the functional roles of brain areas. This will guide our review of the empirical literature. Most research in this area has been done on semantics of concrete words, where clear theoretical frameworks for an involvement of sensory-motor systems in semantics exist. Most of this evidence still stems from correlational studies that are ambiguous with respect to the behavioral relevance of effects. Evidence for causal effects of sensory-motor systems on semantic processes is still scarce but evolving. Relatively few neuroscientific studies so far have investigated the embodiment of abstract semantics for words, numbers, and arithmetic facts. Here, some correlational evidence exists, but data on causality are mostly absent. We conclude that neuroimaging data, just as behavioral data, have so far not disentangled the fundamental link between process and representation. Future studies should therefore put more emphasis on the effects of task and context on semantic processing. Strong conclusions can only be drawn from a combination of methods that provide time-course information, determine the connectivity among poly- or amodal and sensory-motor areas, link behavioral with neuroimaging measures, and allow causal inferences. We will conclude with suggestions on how this could be accomplished in future research.
Collapse
Affiliation(s)
- Olaf Hauk
- MRC Cognition and Brain Sciences Unit Cambridge, UK
| | | |
Collapse
|
33
|
Tomasino B, Rumiati RI. At the mercy of strategies: the role of motor representations in language understanding. Front Psychol 2013; 4:27. [PMID: 23382722 PMCID: PMC3562995 DOI: 10.3389/fpsyg.2013.00027] [Citation(s) in RCA: 45] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2012] [Accepted: 01/10/2013] [Indexed: 11/13/2022] Open
Abstract
Classical cognitive theories hold that word representations in the brain are abstract and amodal, and are independent of the objects’ sensorimotor properties they refer to. An alternative hypothesis emphasizes the importance of bodily processes in cognition: the representation of a concept appears to be crucially dependent upon perceptual-motor processes that relate to it. Thus, understanding action-related words would rely upon the same motor structures that also support the execution of the same actions. In this context, motor simulation represents a key component. Our approach is to draw parallels between the literature on mental rotation and the literature on action verb/sentence processing. Here we will discuss recent studies on mental imagery, mental rotation, and language that clearly demonstrate how motor simulation is neither automatic nor necessary to language understanding. These studies have shown that motor representations can or cannot be activated depending on the type of strategy the participants adopt to perform tasks involving motor phrases. On the one hand, participants may imagine the movement with the body parts used to carry out the actions described by the verbs (i.e., motor strategy); on the other, individuals may solve the task without simulating the corresponding movements (i.e., visual strategy). While it is not surprising that the motor strategy is at work when participants process action-related verbs, it is however striking that sensorimotor activation has been reported also for imageable concrete words with no motor content, for “non-words” with regular phonology, for pseudo-verb stimuli, and also for negations. Based on the extant literature, we will argue that implicit motor imagery is not uniquely used when a body-related stimulus is encountered, and that it is not the type of stimulus that automatically triggers the motor simulation but the type of strategy. Finally, we will also comment on the view that sensorimotor activations are subjected to a top-down modulation.
Collapse
Affiliation(s)
- Barbara Tomasino
- Istituto di Ricovero e Cura a Carattere Scientifico "Eugenio Medea" San Vito al Tagliamento, Italy
| | | |
Collapse
|
34
|
Thaler A, Mirelman A, Helmich RC, van Nuenen BFL, Rosenberg-Katz K, Gurevich T, Orr-Urtreger A, Marder K, Bressman S, Bloem BR, Giladi N, Hendler T. Neural correlates of executive functions in healthy G2019S LRRK2 mutation carriers. Cortex 2013; 49:2501-11. [PMID: 23357204 DOI: 10.1016/j.cortex.2012.12.017] [Citation(s) in RCA: 40] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2012] [Revised: 11/26/2012] [Accepted: 12/17/2012] [Indexed: 01/17/2023]
Abstract
INTRODUCTION The G2019S mutation in the leucine rich repeat kinase 2 (LRRK2) gene is prevalent among Ashkenazi Jewish patients with Parkinson's disease (PD). Cognitive deficits are common in early stage PD. We aimed to characterize the effect of the G2019S mutation on neural mechanisms of executive function processing by testing whether healthy mutation carriers who are an "at risk" population for the future development of PD differed from non-carriers on an functional magnetic resonance imaging (fMRI) Stroop interference task. METHODS Cognitive performance and task related cerebral activity were measured in 40 healthy first-degree relatives of Ashkenazi PD patients (19 carriers and 21 non-carriers of the G2019S mutation). Both regional differences in neural activity and seed region driven functional connectivity methods were performed using fMRI. RESULTS Compared to non-carriers, mutation carriers had greater baseline deactivation and increased task related activity in the right inferior parietal lobe, right precuneus and right fusiform gyrus. Whole brain functional connectivity analysis revealed stronger coupling between these regions and both basal ganglia structures as well as cortical regions in the carrier group. Non-manifesting G2019S mutation carriers and non-carriers performed similarly on the task and on all other assessed measures, so behavioral differences in task performance and baseline cognitive functions cannot explain the observed imaging differences. CONCLUSIONS G2019S carriers, at risk for developing PD, had similar behavioral performance as non-carriers during the Stroop task, but increased activity in brain regions that have previously been found to be part of the ventral attention system together with stronger coupling between task related areas and structures that make up the ventral and dorsal attention system as well as the basal ganglia-thalamocortical network. This suggests a neural compensatory mechanism that enables intact cognitive performance in asymptomatic mutation carriers.
Collapse
Affiliation(s)
- Avner Thaler
- Movement Disorders Unit, Department of Neurology, Tel-Aviv Sourasky Medical Center, Israel; Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
35
|
Category-specific semantic memory: converging evidence from bold fMRI and Alzheimer's disease. Neuroimage 2012; 68:263-74. [PMID: 23220494 DOI: 10.1016/j.neuroimage.2012.11.057] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2011] [Revised: 09/30/2012] [Accepted: 11/26/2012] [Indexed: 01/18/2023] Open
Abstract
Patients with Alzheimer's disease have category-specific semantic memory difficulty for natural relative to manufactured objects. We assessed the basis for this deficit by asking healthy adults and patients to judge whether pairs of words share a feature (e.g. "banana:lemon-COLOR"). In an fMRI study, healthy adults showed gray matter (GM) activation of temporal-occipital cortex (TOC) where visual-perceptual features may be represented, and prefrontal cortex (PFC) which may contribute to feature selection. Tractography revealed dorsal and ventral stream white matter (WM) projections between PFC and TOC. Patients had greater difficulty with natural than manufactured objects. This was associated with greater overlap between diseased GM areas correlated with natural kinds in patients and fMRI activation in healthy adults for natural kinds. The dorsal WM projection between PFC and TOC in patients correlated only with judgments of natural kinds. Patients thus remained dependent on the same neural network as controls during judgments of natural kinds, despite disease in these areas. For manufactured objects, patients' judgments showed limited correlations with PFC and TOC GM areas activated by controls, and did not correlate with the PFC-TOC dorsal WM tract. Regions outside of the PFC-TOC network thus may help support patients' judgments of manufactured objects. We conclude that a large-scale neural network for semantic memory implicates both feature knowledge representations in modality-specific association cortex and heteromodal regions important for accessing this knowledge, and that patients' relative deficit for natural kinds is due in part to their dependence on this network despite disease in these areas.
Collapse
|
36
|
Aravena P, Delevoye-Turrell Y, Deprez V, Cheylus A, Paulignan Y, Frak V, Nazir T. Grip force reveals the context sensitivity of language-induced motor activity during "action words" processing: evidence from sentential negation. PLoS One 2012; 7:e50287. [PMID: 23227164 PMCID: PMC3515598 DOI: 10.1371/journal.pone.0050287] [Citation(s) in RCA: 68] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2012] [Accepted: 10/22/2012] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND Studies demonstrating the involvement of motor brain structures in language processing typically focus on time windows beyond the latencies of lexical-semantic access. Consequently, such studies remain inconclusive regarding whether motor brain structures are recruited directly in language processing or through post-linguistic conceptual imagery. In the present study, we introduce a grip-force sensor that allows online measurements of language-induced motor activity during sentence listening. We use this tool to investigate whether language-induced motor activity remains constant or is modulated in negative, as opposed to affirmative, linguistic contexts. METHODOLOGY/PRINCIPAL FINDINGS Participants listened to spoken action target words in either affirmative or negative sentences while holding a sensor in a precision grip. The participants were asked to count the sentences containing the name of a country to ensure attention. The grip force signal was recorded continuously. The action words elicited an automatic and significant enhancement of the grip force starting at approximately 300 ms after target word onset in affirmative sentences; however, no comparable grip force modulation was observed when these action words occurred in negative contexts. CONCLUSIONS/SIGNIFICANCE Our findings demonstrate that this simple experimental paradigm can be used to study the online crosstalk between language and the motor systems in an ecological and economical manner. Our data further confirm that the motor brain structures that can be called upon during action word processing are not mandatorily involved; the crosstalk is asymmetrically governed by the linguistic context and not vice versa.
Collapse
Affiliation(s)
- Pia Aravena
- L2C2-Institut des Sciences Cognitives, CNRS/UCBL, Université Claude Bernard Lyon1, Lyon, France.
| | | | | | | | | | | | | |
Collapse
|
37
|
Barrós-Loscertales A, González J, Pulvermüller F, Ventura-Campos N, Bustamante JC, Costumero V, Parcet MA, Ávila C. Reading salt activates gustatory brain regions: fMRI evidence for semantic grounding in a novel sensory modality. Cereb Cortex 2012; 22:2554-63. [PMID: 22123940 PMCID: PMC4705335 DOI: 10.1093/cercor/bhr324] [Citation(s) in RCA: 95] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Because many words are typically used in the context of their referent objects and actions, distributed cortical circuits for these words may bind information about their form with perceptual and motor aspects of their meaning. Previous work has demonstrated such semantic grounding for sensorimotor, visual, auditory, and olfactory knowledge linked to words, which is manifest in activation of the corresponding areas of the cortex. Here, we explore the brain basis of gustatory semantic links of words whose meaning is primarily related to taste. In a blocked functional magnetic resonance imaging design, Spanish taste words and control words matched for a range of factors (including valence, arousal, image-ability, frequency of use, number of letters and syllables) were presented to 59 right-handed participants in a passive reading task. Whereas all the words activated the left inferior frontal (BA44/45) and the posterior middle and superior temporal gyri (BA21/22), taste-related words produced a significantly stronger activation in these same areas and also in the anterior insula, frontal operculum, lateral orbitofrontal gyrus, and thalamus among others. As these areas comprise primary and secondary gustatory cortices, we conclude that the meaning of taste words is grounded in distributed cortical circuits reaching into areas that process taste sensations.
Collapse
Affiliation(s)
- Alfonso Barrós-Loscertales
- Departamento de Psicología Básica, Clínica y Psicobiología, Facultad de Ciencias Humanas y Sociales, Universitat Jaume I, Avd. Vicente Sos Baynat s/n, Castelló 12071, Spain.
| | | | | | | | | | | | | | | |
Collapse
|
38
|
Papeo L, Rumiati RI, Cecchetto C, Tomasino B. On-line changing of thinking about words: the effect of cognitive context on neural responses to verb reading. J Cogn Neurosci 2012; 24:2348-62. [PMID: 22971086 DOI: 10.1162/jocn_a_00291] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Activity in frontocentral motor regions is routinely reported when individuals process action words and is often interpreted as the implicit simulation of the word content. We hypothesized that these neural responses are not invariant components of action word processing but are modulated by the context in which they are evoked. Using fMRI, we assessed the relative weight of stimulus features (i.e., the intrinsic semantics of words) and contextual factors, in eliciting word-related sensorimotor activity. Participants silently read action-related and state verbs after performing a mental rotation task engaging either a motor strategy (i.e., referring visual stimuli to their own bodily movements) or a visuospatial strategy. The mental rotation tasks were used to induce, respectively, a motor and a nonmotor "cognitive context" into the following silent reading. Irrespective of the verb category, reading in the motor context, compared with reading in the nonmotor context, increased the activity in the left primary motor cortex, the bilateral premotor cortex, and the right somatosensory cortex. Thus, the cognitive context induced by the preceding motor strategy-based mental rotation modulated word-related sensorimotor responses, possibly reflecting the strategy of referring a word meaning to one's own bodily activity. This pattern, common to action and state verbs, suggests that the context in which words are encountered prevails over the intrinsic semantics of the stimuli in mediating the recruitment of sensorimotor regions.
Collapse
Affiliation(s)
- Liuba Papeo
- SISSA, Area of Neuroscience, Trieste, Italy.
| | | | | | | |
Collapse
|
39
|
van Dam WO, van Dongen EV, Bekkering H, Rueschemeyer SA. Context-dependent changes in functional connectivity of auditory cortices during the perception of object words. J Cogn Neurosci 2012; 24:2108-19. [PMID: 22721380 DOI: 10.1162/jocn_a_00264] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Embodied theories hold that cognitive concepts are grounded in our sensorimotor systems. Specifically, a number of behavioral and neuroimaging studies have buttressed the idea that language concepts are represented in areas involved in perception and action [Pulvermueller, F. Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6, 576-582, 2005; Barsalou, L. W. Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-660, 1999]. Proponents of a strong embodied account argue that activity in perception/action areas is triggered automatically upon encountering a word and reflect static semantic representations. In contrast to what would be expected if lexical semantic representations are automatically triggered upon encountering a word, a number of studies failed to find motor-related activity for words with a putative action-semantic component [Raposo, A., Moss, H. E., Stamatakis, E. A., & Tyler, L. K. Modulation of motor and premotor cortices by actions, action words and action sentences. Neuropsychologia, 47, 388-396, 2009; Rueschemeyer, S.-A., Brass, M., & Friederici, A. D. Comprehending prehending: Neural correlates of processing verbs with motor stems. Journal of Cognitive Neuroscience, 19, 855-865, 2007]. In a recent fMRI study, Van Dam and colleagues [Van Dam, W. O., Van Dijk, M., Bekkering, H., & Rueschemeyer, S.-A. Flexibility in embodied lexical-semantic representations. Human Brain Mapping, in press] showed that the degree to which a modality-specific region contributes to a representation considerably changes as a function of context. In the current study, we presented words for which both motor and visual properties (e.g., tennis ball, boxing glove) were important in constituting the concept. Our aim was to corroborate on earlier findings of flexible and context-dependent language representations by testing whether functional integration between auditory brain regions and perception/action areas is modulated by context. Functional connectivity was investigated by means of a psychophysiological interaction analysis, in which we found that bilateral superior temporal gyrus was more strongly connected with brain regions relevant for coding action information: (1) for Action Color words vs. Abstract words, and (2) for Action Color words presented in a context that emphasized action vs. a context that emphasized color properties.
Collapse
|
40
|
Conceptual representations in mind and brain: Theoretical developments, current evidence and future directions. Cortex 2012; 48:805-25. [DOI: 10.1016/j.cortex.2011.04.006] [Citation(s) in RCA: 477] [Impact Index Per Article: 39.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2010] [Revised: 02/18/2011] [Accepted: 04/04/2011] [Indexed: 11/17/2022]
|
41
|
Chiou R, Stelter M, Rich AN. Beyond colour perception: auditory-visual synaesthesia induces experiences of geometric objects in specific locations. Cortex 2012; 49:1750-63. [PMID: 22673231 DOI: 10.1016/j.cortex.2012.04.006] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2011] [Revised: 12/10/2011] [Accepted: 04/15/2012] [Indexed: 11/27/2022]
Abstract
Our brain constantly integrates signals across different senses. Auditory-visual synaesthesia is an unusual form of cross-modal integration in which sounds evoke involuntary visual experiences. Previous research primarily focuses on synaesthetic colour, but little is known about non-colour synaesthetic visual features. Here we studied a group of synaesthetes for whom sounds elicit consistent visual experiences of coloured 'geometric objects' located at specific spatial location. Changes in auditory pitch alter the brightness, size, and spatial height of synaesthetic experiences in a systematic manner resembling the cross-modal correspondences of non-synaesthetes, implying synaesthesia may recruit cognitive/neural mechanisms for 'normal' cross-modal processes. To objectively assess the impact of synaesthetic objects on behaviour, we devised a multi-feature cross-modal synaesthetic congruency paradigm and asked participants to perform speeded colour or shape discrimination. We found irrelevant sounds influenced performance, as quantified by congruency effects, demonstrating that synaesthetes were not able to suppress their synaesthetic experiences even when these were irrelevant for the task. Furthermore, we found some evidence for task-specific effects consistent with feature-based attention acting on the constituent features of synaesthetic objects: synaesthetic colours appeared to have a stronger impact on performance than synaesthetic shapes when synaesthetes attended to colour, and vice versa when they attended to shape. We provide the first objective evidence that visual synaesthetic experience can involve multiple features forming object-like percepts and suggest that each feature can be selected by attention despite it being internally generated. These findings suggest theories of the brain mechanisms of synaesthesia need to incorporate a broader neural network underpinning multiple visual features, perceptual knowledge, and feature integration, rather than solely focussing on colour-sensitive areas.
Collapse
Affiliation(s)
- Rocco Chiou
- Department of Cognitive Science, and ARC Centre of Excellence in Cognition and its Disorders, Macquarie University, Australia.
| | | | | |
Collapse
|
42
|
Neural representations of unfamiliar objects are modulated by sensorimotor experience. Cortex 2012; 49:1110-25. [PMID: 22608404 DOI: 10.1016/j.cortex.2012.03.023] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2012] [Revised: 03/01/2012] [Accepted: 03/28/2012] [Indexed: 11/21/2022]
Abstract
Sensory/functional accounts of semantic memory organization emphasize that object representations in the brain reflect the modalities involved in object knowledge acquisition. The present study aimed to elucidate the impact of different types of object-related sensorimotor experience on the neural representations of novel objects. Sixteen subjects engaged in an object matching task while their brain activity was assessed with functional magnetic resonance imaging (fMRI), before and after they acquired knowledge about previously unfamiliar objects. In three training sessions subjects learned about object function, actively manipulating only one set of objects (manipulation training objects, MTO), and visually exploring a second set (visual training objects, VTO). A third object set served as control condition and was not part of the training (no training objects, NTO). While training-related activation increases were observed in the fronto-parietal cortex for both VTO and MTO, post training activity in the left inferior/middle frontal gyrus and the left posterior inferior parietal lobule was higher for MTO than VTO and NTO. As revealed by Dynamic Causal Modeling of effective connectivity between the regions with enhanced post training activity, these effects were likely caused, respectively, by a down-regulation of a fronto-parietal tool use network in response to VTO, and by an increased connectivity for MTO. This pattern of findings indicates that the modalities involved in sensorimotor experience influence the formation of neural representations of objects in semantic memory, with manipulation experience specifically yielding higher activity in regions of the fronto-parietal cortex.
Collapse
|
43
|
Pulvermüller F, Cook C, Hauk O. Inflection in action: Semantic motor system activation to noun- and verb-containing phrases is modulated by the presence of overt grammatical markers. Neuroimage 2011; 60:1367-79. [PMID: 22206964 DOI: 10.1016/j.neuroimage.2011.12.020] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2011] [Revised: 12/04/2011] [Accepted: 12/13/2011] [Indexed: 11/26/2022] Open
Abstract
A recent breakthrough in understanding brain-language mechanisms is the discovery of local motor cortex activations that index specific meaning features of words, phrases and sentences. The words "talk" and "walk" activate different parts of the motor cortex, reflecting the body part relationship of actions the linguistic items are typically used to speak about. It has been suggested that such semantic motor mapping can be explained by behaviorist theories, based on conditioning mechanisms also effective in Pavlov's dog when it salivates to bell sounds. In contrast, a neurobiological approach to language predicts modulation of semantic activation by grammatical, including inflectional-morphological, information. Here, we test these competing predictions by putting action words into different phrasal contexts invoking morphosyntactic and morphophonological processes and demonstrate that semantic motor mappings are modulated by grammatical sentence properties, especially the presence of overtly realized inflectional affixes on nouns or verbs embedded in grammatical phrases. Mechanistic neuroscience theories taking into account both meaning and grammar, including morphology and syntax, are required to explain these observations. A direct comparison between phrases containing nouns and verbs revealed a tendency towards greater activation to noun phrases in left-inferior premotor cortex and posterior Broca's region (BA 44), thus questioning previous suggestions that left inferiorfrontal areas might be dedicated to verb processing per se.
Collapse
|
44
|
Yang J, Shu H, Bi Y, Liu Y, Wang X. Dissociation and association of the embodied representation of tool-use verbs and hand verbs: An fMRI study. BRAIN AND LANGUAGE 2011; 119:167-174. [PMID: 21741081 DOI: 10.1016/j.bandl.2011.06.001] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/07/2011] [Revised: 05/28/2011] [Accepted: 06/05/2011] [Indexed: 05/31/2023]
Abstract
Embodied semantic theories suppose that representation of word meaning and actual sensory-motor processing are implemented in overlapping systems. According to this view, association and dissociation of different word meaning should correspond to dissociation and association of the described sensory-motor processing. Previous studies demonstrate that although tool-use actions and hand actions have overlapping neural substrates, tool-use actions show greater activations in frontal-parietal-temporal regions that are responsible for motor control and tool knowledge processing. In the present study, we examined the association and the dissociation of the semantic representation of tool-use verbs and hand action verbs. Chinese verbs describing tool-use or hand actions without tools were included, and a passive reading task was employed. All verb conditions showed common activations in areas of left middle frontal gyrus, left inferior frontal gyrus (BA 44/45) and left inferior parietal lobule relative to rest, and all conditions showed significant effects in premotor areas within the mask of hand motion effects. Contrasts between tool-use verbs and hand verbs demonstrated that tool verbs elicited stronger activity in left superior parietal lobule, left middle frontal gyrus and left posterior middle temporal gyrus. Additionally, psychophysiological interaction analyses demonstrated that tool verbs indicated greater connectivity among these regions. These results suggest that the brain regions involved in tool-use action processing also play more important roles in tool-use verb processing and that similar systems may be responsible for word meaning representation and actual sensory-motor processing.
Collapse
Affiliation(s)
- Jie Yang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China.
| | | | | | | | | |
Collapse
|
45
|
Boulenger V, Shtyrov Y, Pulvermüller F. When do you grasp the idea? MEG evidence for instantaneous idiom understanding. Neuroimage 2011; 59:3502-13. [PMID: 22100772 DOI: 10.1016/j.neuroimage.2011.11.011] [Citation(s) in RCA: 85] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2011] [Revised: 10/24/2011] [Accepted: 11/03/2011] [Indexed: 12/21/2022] Open
Abstract
We investigated the time-course of cortical activation during comprehension of literal and idiomatic sentences using MEG and anatomically guided distributed source analysis. Previous fMRI work had shown that the comprehension of sentences including action-related words elicits somatotopic semantic activation along the motor strip, reflecting meaning aspects of constituent words. Furthermore, idioms more strongly activated temporal pole and prefrontal cortex than literal sentences. Here we show that, compared to literal sentences, processing of idioms in a silent reading task modulates anterior fronto-temporal activity very early-on, already 150-250 ms after the sentences' critical disambiguating words ("kick the habit"). In parallel, the meaning of action words embedded in sentences is reflected by somatotopic activation of precentral motor systems. As neural reflections of constituent parts of idiomatic sentences are manifest at the same early latencies as brain indexes of idiomatic vs. literal meaning processing, we suggest that within ¼ of a second, compositional and abstract context-driven semantic processes in parallel contribute to the understanding of idiom meaning.
Collapse
|
46
|
van Dam WO, van Dijk M, Bekkering H, Rueschemeyer SA. Flexibility in embodied lexical-semantic representations. Hum Brain Mapp 2011; 33:2322-33. [PMID: 21976384 DOI: 10.1002/hbm.21365] [Citation(s) in RCA: 80] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2011] [Revised: 04/13/2011] [Accepted: 05/02/2011] [Indexed: 11/06/2022] Open
Abstract
According to an embodied view of language comprehension, language concepts are grounded in our perceptual systems. Evidence for the idea that concepts are grounded in areas involved in action and perception comes from both behavioral and neuroimaging studies (Glenberg [1997]: Behav Brain Sci 20:1-55; Barsalou [1999]: Behav Brain Sci 22:577-660; Pulvermueller [1999]: Behav Brain Sci 22:253-336; Barsalou et al. [2003]: Trends Cogn Sci 7:84-91). However, the results from several studies indicate that the activation of information in perception and action areas is not a purely automatic process (Raposo et al. [2009]: Neuropsychologia 47:388-396; Rueschemeyer et al. [2007]: J Cogn Neurosci 19:855-865). These findings suggest that embodied representations are flexible. In these studies, flexibility is characterized by the relative presence or absence of activation in our perceptual systems. However, even if the context in which a word is presented does not undermine a motor interpretation, it is possible that the degree to which a modality-specific region contributes to a representation depends on the context in which conceptual features are retrieved. In the present study, we investigated this issue by presenting word stimuli for which both motor and visual properties (e.g., Tennis ball, Boxing glove) were important in constituting the concept. Conform with the idea that language representations are flexible and context dependent, we demonstrate that the degree to which a modality-specific region contributes to a representation considerably changes as a function of context.
Collapse
Affiliation(s)
- Wessel O van Dam
- Donders Institute for Brain, Cognition and Behavior, Radboud University Nijmegen, The Netherlands.
| | | | | | | |
Collapse
|
47
|
Moseley R, Carota F, Hauk O, Mohr B, Pulvermüller F. A role for the motor system in binding abstract emotional meaning. ACTA ACUST UNITED AC 2011; 22:1634-47. [PMID: 21914634 PMCID: PMC3377965 DOI: 10.1093/cercor/bhr238] [Citation(s) in RCA: 115] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Sensorimotor areas activate to action- and object-related words, but their role in abstract meaning processing is still debated. Abstract emotion words denoting body internal states are a critical test case because they lack referential links to objects. If actions expressing emotion are crucial for learning correspondences between word forms and emotions, emotion word–evoked activity should emerge in motor brain systems controlling the face and arms, which typically express emotions. To test this hypothesis, we recruited 18 native speakers and used event-related functional magnetic resonance imaging to compare brain activation evoked by abstract emotion words to that by face- and arm-related action words. In addition to limbic regions, emotion words indeed sparked precentral cortex, including body-part–specific areas activated somatotopically by face words or arm words. Control items, including hash mark strings and animal words, failed to activate precentral areas. We conclude that, similar to their role in action word processing, activation of frontocentral motor systems in the dorsal stream reflects the semantic binding of sign and meaning of abstract words denoting emotions and possibly other body internal states.
Collapse
Affiliation(s)
- Rachel Moseley
- Medical Research Council, Cognition and Brain Sciences Unit, Cambridge, CB2 7EF, UK.
| | | | | | | | | |
Collapse
|
48
|
McCrea SM, Robinson TP. Visual Puzzles, Figure Weights, and Cancellation: Some Preliminary Hypotheses on the Functional and Neural Substrates of These Three New WAIS-IV Subtests. ISRN NEUROLOGY 2011; 2011:123173. [PMID: 22389807 PMCID: PMC3263563 DOI: 10.5402/2011/123173] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/21/2011] [Accepted: 04/20/2011] [Indexed: 11/23/2022]
Abstract
In this study, five consecutive patients with focal strokes and/or cortical excisions were examined with the Wechsler Adult Intelligence Scale and Wechsler Memory Scale-Fourth Editions along with a comprehensive battery of other neuropsychological tasks. All five of the lesions were large and typically involved frontal, temporal, and/or parietal lobes and were lateralized to one hemisphere. The clinical case method was used to determine the cognitive neuropsychological correlates of mental rotation (Visual Puzzles), Piagetian balance beam (Figure Weights), and visual search (Cancellation) tasks. The pattern of results on Visual Puzzles and Figure Weights suggested that both subtests involve predominately right frontoparietal networks involved in visual working memory. It appeared that Visual Puzzles could also critically rely on the integrity of the left temporoparietal junction. The left temporoparietal junction could be involved in temporal ordering and integration of local elements into a nonverbal gestalt. In contrast, the Figure Weights task appears to critically involve the right temporoparietal junction involved in numerical magnitude estimation. Cancellation was sensitive to left frontotemporal lesions and not right posterior parietal lesions typical of other visual search tasks. In addition, the Cancellation subtest was sensitive to verbal search strategies and perhaps object-based attention demands, thereby constituting a unique task in comparison with previous visual search tasks.
Collapse
Affiliation(s)
- Simon M McCrea
- Department of Neuropsychology, Wascana Rehabilitation Centre, 2180-23rd Avenue, Regina, Saskatchewan, Canada S4S 0A5
| | | |
Collapse
|
49
|
Fliessbach K, Buerger C, Trautner P, Elger CE, Weber B. Differential effects of semantic processing on memory encoding. Hum Brain Mapp 2011; 31:1653-64. [PMID: 20162599 DOI: 10.1002/hbm.20969] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
Deeper semantic processing of words leads to enhanced memory encoding (depth of processing effect). The left inferior prefrontal cortex (LIPC) and the left hippocampus are known to be involved in this effect. We tested the hypothesis that different semantic encoding processes contribute qualitatively differently to memory encoding. In a memory experiment using functional magnetic resonance imaging, we compared three different encoding tasks: a nonsemantic alphabetical, an animacy decision, and a size comparison tasks. Recognition memory was tested subsequently. We hypothesized that the size comparison task would activate brain areas involved in the processing of object features and that this would be associated with successful memory encoding. Results showed that the size comparison task led to significantly better memory encoding than the two other tasks. As with the animacy decision task, it led to stronger activation of the LIPC and left hippocampus than the nonsemantic task. Both regions also had stronger activations for later remembered than for nonremembered words. The size comparison task additionally led to stronger activation in the left anterior fusiform gyrus, which was also associated with successful memory encoding. We conclude that different types of semantic processing affect memory encoding based on distinguishable brain processes.
Collapse
Affiliation(s)
- Klaus Fliessbach
- Department of Epileptology, University of Bonn Medical Center, Bonn, Germany.
| | | | | | | | | |
Collapse
|
50
|
Bramão I, Faísca L, Forkstam C, Reis A, Petersson KM. Cortical brain regions associated with color processing: an FMRI study. Open Neuroimag J 2010; 4:164-73. [PMID: 21270939 PMCID: PMC3026336 DOI: 10.2174/1874440001004010164] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2010] [Revised: 04/02/2010] [Accepted: 05/07/2010] [Indexed: 12/04/2022] Open
Abstract
To clarify whether the neural pathways concerning color processing are the same for natural objects, for artifacts objects and for non-objects we examined brain responses measured with functional magnetic resonance imaging (FMRI) during a covert naming task including the factors color (color vs. black&white (B&W)) and stimulus type (natural vs. artifacts vs. non-objects). Our results indicate that the superior parietal lobule and precuneus (BA 7) bilaterally, the right hippocampus and the right fusifom gyrus (V4) make part of a network responsible for color processing both for natural objects and artifacts, but not for non-objects. When color objects (both natural and artifacts) were contrasted with color non-objects we observed activations in the right parahippocampal gyrus (BA 35/36), the superior parietal lobule (BA 7) bilaterally, the left inferior middle temporal region (BA 20/21) and the inferior and superior frontal regions (BA 10/11/47). These additional activations suggest that colored objects recruit brain regions that are related to visual semantic information/retrieval and brain regions related to visuo-spatial processing. Overall, the results suggest that color information is an attribute that can improve object recognition (behavioral results) and activate a specific neural network related to visual semantic information that is more extensive than for B&W objects during object recognition.
Collapse
Affiliation(s)
- Inês Bramão
- Cognitive Neuroscience Research Group, Deparmento de Psicologia, Faculdade de Ciências Humanas e Sociais, & Institute of Biotechnology & Bioengineering/CBME, Universidade do Algarve, Faro, Portugal
| | | | | | | | | |
Collapse
|