1
|
Simon M, Lazzouni L, Campbell E, Delcenserie A, Muise-Hennessey A, Newman AJ, Champoux F, Lepore F. Enhancement of visual biological motion recognition in early-deaf adults: Functional and behavioral correlates. PLoS One 2020; 15:e0236800. [PMID: 32776962 PMCID: PMC7416928 DOI: 10.1371/journal.pone.0236800] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 07/15/2020] [Indexed: 11/19/2022] Open
Abstract
Deafness leads to brain modifications that are generally associated with a cross-modal activity of the auditory cortex, particularly for visual stimulations. In the present study, we explore the cortical processing of biological motion that conveyed either non-communicative (pantomimes) or communicative (emblems) information, in early-deaf and hearing individuals, using fMRI analyses. Behaviorally, deaf individuals showed an advantage in detecting communicative gestures relative to hearing individuals. Deaf individuals also showed significantly greater activation in the superior temporal cortex (including the planum temporale and primary auditory cortex) than hearing individuals. The activation levels in this region were correlated with deaf individuals’ response times. This study provides neural and behavioral evidence that cross-modal plasticity leads to functional advantages in the processing of biological motion following lifelong auditory deprivation.
Collapse
Affiliation(s)
- Marie Simon
- Département de Psychologie, Centre de recherche en neuropsychologie et cognition, Université de Montréal, Québec, Canada
- * E-mail:
| | - Latifa Lazzouni
- Département de Psychologie, Centre de recherche en neuropsychologie et cognition, Université de Montréal, Québec, Canada
| | - Emma Campbell
- Département de Psychologie, Centre de recherche en neuropsychologie et cognition, Université de Montréal, Québec, Canada
| | - Audrey Delcenserie
- Département de Psychologie, Centre de recherche en neuropsychologie et cognition, Université de Montréal, Québec, Canada
- École d’orthophonie et d’audiologie, Université de Montréal, Montréal, Québec, Canada
| | - Alexandria Muise-Hennessey
- Department of Psychology and Neuroscience, NeuroCognitive Imaging Lab, Dalhousie University, Halifax, Nova Scotia, Canada
| | - Aaron J. Newman
- Department of Psychology and Neuroscience, NeuroCognitive Imaging Lab, Dalhousie University, Halifax, Nova Scotia, Canada
| | - François Champoux
- École d’orthophonie et d’audiologie, Université de Montréal, Montréal, Québec, Canada
- Centre de recherche de l’Institut Universitaire de Gériatrie de Montréal, Montréal, Québec, Canada
| | - Franco Lepore
- Département de Psychologie, Centre de recherche en neuropsychologie et cognition, Université de Montréal, Québec, Canada
| |
Collapse
|
2
|
Rudner M, Orfanidou E, Kästner L, Cardin V, Woll B, Capek CM, Rönnberg J. Neural Networks Supporting Phoneme Monitoring Are Modulated by Phonology but Not Lexicality or Iconicity: Evidence From British and Swedish Sign Language. Front Hum Neurosci 2019; 13:374. [PMID: 31695602 PMCID: PMC6817460 DOI: 10.3389/fnhum.2019.00374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2018] [Accepted: 10/03/2019] [Indexed: 11/18/2022] Open
Abstract
Sign languages are natural languages in the visual domain. Because they lack a written form, they provide a sharper tool than spoken languages for investigating lexicality effects which may be confounded by orthographic processing. In a previous study, we showed that the neural networks supporting phoneme monitoring in deaf British Sign Language (BSL) users are modulated by phonology but not lexicality or iconicity. In the present study, we investigated whether this pattern generalizes to deaf Swedish Sign Language (SSL) users. British and SSLs have a largely overlapping phoneme inventory but are mutually unintelligible because lexical overlap is small. This is important because it means that even when signs lexicalized in BSL are unintelligible to users of SSL they are usually still phonologically acceptable. During fMRI scanning, deaf users of the two different sign languages monitored signs that were lexicalized in either one or both of those languages for phonologically contrastive elements. Neural activation patterns relating to different linguistic levels of processing were similar across SLs; in particular, we found no effect of lexicality, supporting the notion that apparent lexicality effects on sublexical processing of speech may be driven by orthographic strategies. As expected, we found an effect of phonology but not iconicity. Further, there was a difference in neural activation between the two groups in a motion-processing region of the left occipital cortex, possibly driven by cultural differences, such as education. Importantly, this difference was not modulated by the linguistic characteristics of the material, underscoring the robustness of the neural activation patterns relating to different linguistic levels of processing.
Collapse
Affiliation(s)
- Mary Rudner
- Linnaeus Centre HEAD, Swedish Institute for Disability Research, Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
| | - Eleni Orfanidou
- Deafness, Cognition and Language Research Centre, Department of Experimental Psychology, University College London, London, United Kingdom.,School of Psychology, University of Crete, Rethymno, Greece
| | - Lena Kästner
- Deafness, Cognition and Language Research Centre, Department of Experimental Psychology, University College London, London, United Kingdom.,Department of Philosophy, Saarland University, Saarbrücken, Germany
| | - Velia Cardin
- Linnaeus Centre HEAD, Swedish Institute for Disability Research, Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden.,Deafness, Cognition and Language Research Centre, Department of Experimental Psychology, University College London, London, United Kingdom.,School of Psychology, University of East Anglia, Norwich, United Kingdom
| | - Bencie Woll
- Deafness, Cognition and Language Research Centre, Department of Experimental Psychology, University College London, London, United Kingdom
| | - Cheryl M Capek
- Division of Neuroscience & Experimental Psychology, School of Biological Sciences, University of Manchester, Manchester, United Kingdom
| | - Jerker Rönnberg
- Linnaeus Centre HEAD, Swedish Institute for Disability Research, Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
| |
Collapse
|
3
|
Margolesky J, C Luca C, Singer C. Rapid Eye Movement Sleep Behavior Disorder Manifesting as Sign Language in a Patient with Dementia with Lewy Bodies. Mov Disord Clin Pract 2017; 4:623-624. [DOI: 10.1002/mdc3.12486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2017] [Revised: 02/12/2017] [Accepted: 02/21/2017] [Indexed: 11/05/2022] Open
Affiliation(s)
| | - Corneliu C Luca
- University of Miami Miller School of Medicine; Miami Florida
| | - Carlos Singer
- University of Miami Miller School of Medicine; Miami Florida
| |
Collapse
|
4
|
Häberling IS, Corballis PM, Corballis MC. Language, gesture, and handedness: Evidence for independent lateralized networks. Cortex 2016; 82:72-85. [DOI: 10.1016/j.cortex.2016.06.003] [Citation(s) in RCA: 60] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2015] [Revised: 02/25/2016] [Accepted: 06/06/2016] [Indexed: 12/16/2022]
|
5
|
|
6
|
Möttönen R, Farmer H, Watkins KE. Neural basis of understanding communicative actions: Changes associated with knowing the actor's intention and the meanings of the actions. Neuropsychologia 2016; 81:230-237. [PMID: 26752450 PMCID: PMC4749541 DOI: 10.1016/j.neuropsychologia.2016.01.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2015] [Revised: 12/14/2015] [Accepted: 01/01/2016] [Indexed: 11/16/2022]
Abstract
People can communicate by using hand actions, e.g., signs. Understanding communicative actions requires that the observer knows that the actor has an intention to communicate and the meanings of the actions. Here, we investigated how this prior knowledge affects processing of observed actions. We used functional MRI to determine changes in action processing when non-signers were told that the observed actions are communicative (i.e., signs) and learned the meanings of half of the actions. Processing of hand actions activated the left and right inferior frontal gyrus (IFG, BA 44 and 45) when the communicative intention of the actor was known, even when the meanings of the actions remained unknown. These regions were not active when the observers did not know about the communicative nature of the hand actions. These findings suggest that the left and right IFG play a role in understanding the intention of the actor, but do not process visuospatial features of the communicative actions. Knowing the meanings of the hand actions further enhanced activity in the anterior part of the IFG (BA 45), the inferior parietal lobule and posterior inferior and middle temporal gyri in the left hemisphere. These left-hemisphere language regions could provide a link between meanings and observed actions. In sum, the findings provide evidence for the segregation of the networks involved in the neural processing of visuospatial features of communicative hand actions and those involved in understanding the actor’s intention and the meanings of the actions. Participants observed hand actions before and after learning that they are signs. Learning-induced changes in brain activity measured using fMRI. No activity in mirror neuron system when actions were not known to be communicative. Knowing the actor’s intention to communicate activated IFG and IPL. Knowing meanings of the actions increased activity in left IFG (BA 45), IPL and MTG.
Collapse
Affiliation(s)
- Riikka Möttönen
- Department of Experimental Psychology, University of Oxford, South Parks Road, Oxford OX1 3UD, UK; Centre for Functional Magnetic Resonance Imaging of the Brain (FMRIB), University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK.
| | - Harry Farmer
- Department of Experimental Psychology, University of Oxford, South Parks Road, Oxford OX1 3UD, UK
| | - Kate E Watkins
- Department of Experimental Psychology, University of Oxford, South Parks Road, Oxford OX1 3UD, UK; Centre for Functional Magnetic Resonance Imaging of the Brain (FMRIB), University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK
| |
Collapse
|
7
|
Cardin V, Orfanidou E, Kästner L, Rönnberg J, Woll B, Capek CM, Rudner M. Monitoring Different Phonological Parameters of Sign Language Engages the Same Cortical Language Network but Distinctive Perceptual Ones. J Cogn Neurosci 2016; 28:20-40. [DOI: 10.1162/jocn_a_00872] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
The study of signed languages allows the dissociation of sensorimotor and cognitive neural components of the language signal. Here we investigated the neurocognitive processes underlying the monitoring of two phonological parameters of sign languages: handshape and location. Our goal was to determine if brain regions processing sensorimotor characteristics of different phonological parameters of sign languages were also involved in phonological processing, with their activity being modulated by the linguistic content of manual actions. We conducted an fMRI experiment using manual actions varying in phonological structure and semantics: (1) signs of a familiar sign language (British Sign Language), (2) signs of an unfamiliar sign language (Swedish Sign Language), and (3) invented nonsigns that violate the phonological rules of British Sign Language and Swedish Sign Language or consist of nonoccurring combinations of phonological parameters. Three groups of participants were tested: deaf native signers, deaf nonsigners, and hearing nonsigners. Results show that the linguistic processing of different phonological parameters of sign language is independent of the sensorimotor characteristics of the language signal. Handshape and location were processed by different perceptual and task-related brain networks but recruited the same language areas. The semantic content of the stimuli did not influence this process, but phonological structure did, with nonsigns being associated with longer RTs and stronger activations in an action observation network in all participants and in the supramarginal gyrus exclusively in deaf signers. These results suggest higher processing demands for stimuli that contravene the phonological rules of a signed language, independently of previous knowledge of signed languages. We suggest that the phonological characteristics of a language may arise as a consequence of more efficient neural processing for its perception and production.
Collapse
Affiliation(s)
| | | | - Lena Kästner
- 1University College London
- 4Humboldt-Universität zu Berlin
| | | | | | | | | |
Collapse
|
8
|
Häberling IS, Corballis MC. Cerebellar asymmetry, cortical asymmetry and handedness: Two independent networks. Laterality 2015; 21:397-414. [PMID: 26582534 DOI: 10.1080/1357650x.2015.1110161] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
In 46 right-handers and 46 left-handers, we used functional magnetic resonance imaging to record activity in the frontal lobes while they generated words, the temporal lobe while they made synonym judgments, and the parietal lobe while they watched videos of manual actions. In each case we also recorded activity in the cerebellum. Laterality indices showed a significant left-hemispheric bias in each cortical lobe and a right-hemispheric bias in the cerebellum for the 2 language tasks, but not during action observation. Cerebellar asymmetry also correlated negatively with frontal and temporal asymmetry, reflecting contralateral connections, but not with parietal asymmetry. A factor analysis of the inter-correlations among laterality indices revealed 2 factors, implying independent lateralized networks, with cerebellar asymmetry strongly linked to a language network in frontal and temporal cortices, and handedness strongly linked to an action-observation network in the parietal lobe.
Collapse
|
9
|
Neural systems supporting linguistic structure, linguistic experience, and symbolic communication in sign language and gesture. Proc Natl Acad Sci U S A 2015; 112:11684-9. [PMID: 26283352 DOI: 10.1073/pnas.1510527112] [Citation(s) in RCA: 51] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Sign languages used by deaf communities around the world possess the same structural and organizational properties as spoken languages: In particular, they are richly expressive and also tightly grammatically constrained. They therefore offer the opportunity to investigate the extent to which the neural organization for language is modality independent, as well as to identify ways in which modality influences this organization. The fact that sign languages share the visual-manual modality with a nonlinguistic symbolic communicative system-gesture-further allows us to investigate where the boundaries lie between language and symbolic communication more generally. In the present study, we had three goals: to investigate the neural processing of linguistic structure in American Sign Language (using verbs of motion classifier constructions, which may lie at the boundary between language and gesture); to determine whether we could dissociate the brain systems involved in deriving meaning from symbolic communication (including both language and gesture) from those specifically engaged by linguistically structured content (sign language); and to assess whether sign language experience influences the neural systems used for understanding nonlinguistic gesture. The results demonstrated that even sign language constructions that appear on the surface to be similar to gesture are processed within the left-lateralized frontal-temporal network used for spoken languages-supporting claims that these constructions are linguistically structured. Moreover, although nonsigners engage regions involved in human action perception to process communicative, symbolic gestures, signers instead engage parts of the language-processing network-demonstrating an influence of experience on the perception of nonlinguistic stimuli.
Collapse
|
10
|
Proverbio AM, Gabaro V, Orlandi A, Zani A. Semantic brain areas are involved in gesture comprehension: An electrical neuroimaging study. BRAIN AND LANGUAGE 2015; 147:30-40. [PMID: 26011745 DOI: 10.1016/j.bandl.2015.05.002] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/04/2014] [Revised: 04/13/2015] [Accepted: 05/02/2015] [Indexed: 06/04/2023]
Abstract
While the mechanism of sign language comprehension in deaf people has been widely investigated, little is known about the neural underpinnings of spontaneous gesture comprehension in healthy speakers. Bioelectrical responses to 800 pictures of actors showing common Italian gestures (e.g., emblems, deictic or iconic gestures) were recorded in 14 persons. Stimuli were selected from a wider corpus of 1122 gestures. Half of the pictures were preceded by an incongruent description. ERPs were recorded from 128 sites while participants decided whether the stimulus was congruent. Congruent pictures elicited a posterior P300 followed by late positivity, while incongruent gestures elicited an anterior N400 response. N400 generators were investigated with swLORETA reconstruction. Processing of congruent gestures activated face- and body-related visual areas (e.g., BA19, BA37, BA22), the left angular gyrus, mirror fronto/parietal areas. The incongruent-congruent contrast particularly stimulated linguistic and semantic brain areas, such as the left medial and the superior temporal lobe.
Collapse
Affiliation(s)
- Alice Mado Proverbio
- NeuroMI-Milan Center for Neuroscience, Dept. of Psychology, University of Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy.
| | - Veronica Gabaro
- NeuroMI-Milan Center for Neuroscience, Dept. of Psychology, University of Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy
| | - Andrea Orlandi
- NeuroMI-Milan Center for Neuroscience, Dept. of Psychology, University of Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milan, Italy; Institute of Bioimaging and Molecular Physiology, IBFM-CNR, Milan, Italy
| | - Alberto Zani
- Institute of Bioimaging and Molecular Physiology, IBFM-CNR, Milan, Italy
| |
Collapse
|
11
|
An fMRI study on sunk cost effect. Brain Res 2013; 1519:63-70. [DOI: 10.1016/j.brainres.2013.05.001] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2013] [Revised: 04/04/2013] [Accepted: 05/01/2013] [Indexed: 11/22/2022]
|