Brain activations associated with sign production using word and picture inputs in deaf signers

Linguistic network in early deaf individuals: A neuroimaging meta-analysis

This meta-analysis summarizes evidence from 44 neuroimaging experiments and characterizes the general linguistic network in early deaf individuals. Meta-analytic comparisons with hearing individuals found that a specific set of regions (in particular the left inferior frontal gyrus and posterior middle temporal gyrus) participates in supramodal language processing. In addition to previously described modality-specific differences, the present study showed that the left calcarine gyrus and the right caudate were additionally recruited in deaf compared with hearing individuals. In addition, this study showed that the bilateral posterior superior temporal gyrus is shaped by cross-modal plasticity, whereas the left frontotemporal areas are shaped by early language experience. Although an overall left-lateralized pattern for language processing was observed in the early deaf individuals, regional lateralization was altered in the inferior frontal gyrus and anterior temporal lobe. These findings indicate that the core language network functions in a modality-independent manner, and provide a foundation for determining the contributions of sensory and linguistic experiences in shaping the neural bases of language processing.

New Perspectives on the Neurobiology of Sign Languages

The first 40 years of research on the neurobiology of sign languages (1960-2000) established that the same key left hemisphere brain regions support both signed and spoken languages, based primarily on evidence from signers with brain injury and at the end of the 20th century, based on evidence from emerging functional neuroimaging technologies (positron emission tomography and fMRI). Building on this earlier work, this review focuses on what we have learned about the neurobiology of sign languages in the last 15-20 years, what controversies remain unresolved, and directions for future research. Production and comprehension processes are addressed separately in order to capture whether and how output and input differences between sign and speech impact the neural substrates supporting language. In addition, the review includes aspects of language that are unique to sign languages, such as pervasive lexical iconicity, fingerspelling, linguistic facial expressions, and depictive classifier constructions. Summary sketches of the neural networks supporting sign language production and comprehension are provided with the hope that these will inspire future research as we begin to develop a more complete neurobiological model of sign language processing.

Review article: Structural brain alterations in prelingually deaf

Functional studies show that our brain has a remarkable ability to reorganize itself in the absence of one or more sensory modalities. In this review, we gathered all the available articles investigating structural alterations in congenitally deaf subjects. Some concentrated only on specific regions of interest (e.g., auditory areas), while others examined the whole brain. The majority of structural alterations were observed in the auditory white matter and were more pronounced in the right hemisphere. A decreased white matter volume or fractional anisotropy in the auditory areas were the most common findings in congenitally deaf subjects. Only a few studies observed alterations in the auditory grey matter. Preservation of the grey matter might be due to the cross-modal plasticity as well as due to the lack of sensitivity of methods used for microstructural alterations of grey matter. Structural alterations were also observed in the frontal, visual, and other cerebral regions as well as in the cerebellum. The observed structural brain alterations in the deaf can probably be attributed mainly to the cross-modal plasticity in the absence of sound input and use of sign instead of spoken language.

Neural Activity During Mental Rotation in Deaf Signers: The Influence of Long-Term Sign Language Experience

OBJECTIVES

Mental rotation is the brain's visuospatial understanding of what objects are and where they belong. Previous research indicated that deaf signers showed behavioral enhancement for nonlinguistic visual tasks, including mental rotation. In this study, we investigated the neural difference of mental rotation processing between deaf signers and hearing nonsigners using blood oxygen level-dependent (BOLD) functional magnetic resonance imaging (fMRI).

DESIGN

The participants performed a block-designed experiment, consisting of alternating blocks of comparison and rotation periods, separated by a baseline or fixation period. Mental rotation tasks were performed using three-dimensional figures. fMRI images were acquired during the entire experiment, and the fMRI data were analyzed with Analysis of Functional NeuroImages. A factorial design analysis of variance was designed for fMRI analyses. The differences of activation were analyzed for the main effects of group and task, as well as for the interaction of group by task.

RESULTS

The study showed differences in activated areas between deaf signers and hearing nonsigners on the mental rotation of three-dimensional figures. Subtracting activations of fixation from activations of rotation, both groups showed consistent activation in bilateral occipital lobe, bilateral parietal lobe, and bilateral posterior temporal lobe. There were different main effects of task (rotation versus comparison) with significant activation clusters in the bilateral precuneus, the right middle frontal gyrus, the bilateral medial frontal gyrus, the right interior frontal gyrus, the right superior frontal gyrus, the right anterior cingulate, and the bilateral posterior cingulate. There were significant interaction effects of group by task in the bilateral anterior cingulate, the right inferior frontal gyrus, the left superior frontal gyrus, the left posterior cingulate, the left middle temporal gyrus, and the right inferior parietal lobe. In simple effects of deaf and hearing groups with rotation minus comparison, deaf signers mainly showed activity in the right hemisphere, while hearing nonsigners showed bilateral activity. In the simple effects of rotation task, decreased activities were shown for deaf signers compared with hearing nonsigners throughout several regions, including the bilateral parahippocampal gyrus, the left posterior cingulate cortex, the right anterior cingulate cortex, and the right inferior parietal lobe.

CONCLUSION

Decreased activations in several brain regions of deaf signers when compared to hearing nonsigners reflected increased neural efficiency and a precise functional circuitry, which was generated through long-term experience with sign language processing. In addition, we inferred tentatively that there may be a lateralization pattern to the right hemisphere for deaf signers when performing mental rotation tasks.

How bilingualism protects the brain from aging: Insights from bimodal bilinguals

Bilingual experience can delay cognitive decline during aging. A general hypothesis is that the executive control system of bilinguals faces an increased load due to controlling two languages, and this increased load results in a more "tuned brain" that eventually creates a neural reserve. Here we explored whether such a neuroprotective effect is independent of language modality, i.e., not limited to bilinguals who speak two languages but also occurs for bilinguals who use a spoken and a signed language. We addressed this issue by comparing bimodal bilinguals to monolinguals in order to detect age-induced structural brain changes and to determine whether we can detect the same beneficial effects on brain structure, in terms of preservation of gray matter volume (GMV), for bimodal bilinguals as has been reported for unimodal bilinguals. Our GMV analyses revealed a significant interaction effect of age × group in the bilateral anterior temporal lobes, left hippocampus/amygdala, and left insula where bimodal bilinguals showed slight GMV increases while monolinguals showed significant age-induced GMV decreases. We further found through cortical surface-based measurements that this effect was present for surface area and not for cortical thickness. Moreover, to further explore the hypothesis that overall bilingualism provides neuroprotection, we carried out a direct comparison of GMV, extracted from the brain regions reported above, between bimodal bilinguals, unimodal bilinguals, and monolinguals. Bilinguals, regardless of language modality, exhibited higher GMV compared to monolinguals. This finding highlights the general beneficial effects provided by experience handling two language systems, whether signed or spoken. Hum Brain Mapp 38:4109-4124, 2017. © 2017 Wiley Periodicals, Inc.

The neural circuits recruited for the production of signs and fingerspelled words

Signing differs from typical non-linguistic hand actions because movements are not visually guided, finger movements are complex (particularly for fingerspelling), and signs are not produced as holistic gestures. We used positron emission tomography to investigate the neural circuits involved in the production of American Sign Language (ASL). Different types of signs (one-handed (articulated in neutral space), two-handed (neutral space), and one-handed body-anchored signs) were elicited by asking deaf native signers to produce sign translations of English words. Participants also fingerspelled (one-handed) printed English words. For the baseline task, participants indicated whether a word contained a descending letter. Fingerspelling engaged ipsilateral motor cortex and cerebellar cortex in contrast to both one-handed signs and the descender baseline task, which may reflect greater timing demands and complexity of handshape sequences required for fingerspelling. Greater activation in the visual word form area was also observed for fingerspelled words compared to one-handed signs. Body-anchored signs engaged bilateral superior parietal cortex to a greater extent than the descender baseline task and neutral space signs, reflecting the motor control and proprioceptive monitoring required to direct the hand toward a specific location on the body. Less activation in parts of the motor circuit was observed for two-handed signs compared to one-handed signs, possibly because, for half of the signs, handshape and movement goals were spread across the two limbs. Finally, the conjunction analysis comparing each sign type with the descender baseline task revealed common activation in the supramarginal gyrus bilaterally, which we interpret as reflecting phonological retrieval and encoding processes.

With or without semantic mediation: retrieval of lexical representations in sign production

How are lexical representations retrieved during sign production? Similar to spoken languages, lexical representation in sign language must be accessed through semantics when naming pictures. However, it remains an open issue whether lexical representations in sign language can be accessed via routes that bypass semantics when retrieval is elicited by written words. Here we address this issue by exploring under which circumstances sign retrieval is sensitive to semantic context. To this end we replicate in sign language production the cumulative semantic cost: The observation that naming latencies increase monotonically with each additional within-category item that is named in a sequence of pictures. In the experiment reported here, deaf participants signed sequences of pictures or signed sequences of Italian written words using Italian Sign Language. The results showed a cumulative semantic cost in picture naming but, strikingly, not in word naming. This suggests that only picture naming required access to semantics, whereas deaf signers accessed the sign language lexicon directly (i.e., bypassing semantics) when naming written words. The implications of these findings for the architecture of the sign production system are discussed in the context of current models of lexical access in spoken language production.

Structural alterations of brain grey and white matter in early deaf adults

Functional and structural brain alterations in the absence of the auditory input have been described, but the observed structural brain changes in the deaf are not uniform. Some of the previous researchers focused only on the auditory areas, while others investigated the whole brain or other selected regions of interest. Majority of studies revealed decreased white matter (WM) volume or altered WM microstructure and preserved grey matter (GM) structure of the auditory areas in the deaf. However, preserved WM and increased or decreased GM volume of the auditory areas in the deaf have also been reported. Several structural alterations in the deaf were found also outside the auditory areas, but these regions differ between the studies. The observed differences between the studies could be due to the use of different single-analysis techniques, or the diverse population sample and its size, or possibly due to the usage of hearing aids by some participating deaf subjects. To overcome the aforementioned limitations four different image-processing techniques were used to investigate changes in the brain morphology of prelingually deaf adults who have never used hearing aids. GM and WM volume of the Heschl's gyrus (HG) were measured using manual volumetry, while whole brain GM volume, thickness and surface area were assessed by voxel-based morphometry (VBM) and surface-based analysis. The microstructural properties of the WM were evaluated by diffusion tensor imaging (DTI). The data were compared between 14 congenitally deaf adults and 14 sex- and age-matched normal hearing controls. Manual volumetry revealed preserved GM volume of the bilateral HG and significantly decreased WM volume of the left HG in the deaf. VBM showed increased cerebellar GM volume in the deaf, while no statistically significant differences were observed in the GM thickness or surface area between the groups. The results of the DTI analysis showed WM microstructural alterations between the groups in the bilateral auditory areas, including the superior temporal gyrus, the HG, the planum temporale and the planum polare, which were more extensive in the right hemisphere. Fractional anisotropy (FA) was significantly reduced in the right and axial diffusivity (AD) in the left auditory areas in the deaf. FA and AD were significantly reduced also in several other brain areas outside the auditory cortex in the deaf. The use of four different methods used in our study, although showing changes that are not directly related, provides additional information and supports the conclusion that in prelingually deaf subjects structural alterations are present both in the auditory areas and elsewhere. Our results support the findings of those studies showing that early deafness results in decreased WM volume and microstructural WM alterations in the auditory areas. As we observed WM microstructural alteration also in several other areas and increased GM volume in the cerebellum in the deaf, we can conclude that early deafness results in widespread structural brain changes. These probably reflect atrophy or degradation as well as compensatory cross-modal reorganisation in the absence of the auditory input and the use of the sign language.

How sensory-motor systems impact the neural organization for language: direct contrasts between spoken and signed language

To investigate the impact of sensory-motor systems on the neural organization for language, we conducted an H₂¹⁵O-PET study of sign and spoken word production (picture-naming) and an fMRI study of sign and audio-visual spoken language comprehension (detection of a semantically anomalous sentence) with hearing bilinguals who are native users of American Sign Language (ASL) and English. Directly contrasting speech and sign production revealed greater activation in bilateral parietal cortex for signing, while speaking resulted in greater activation in bilateral superior temporal cortex (STC) and right frontal cortex, likely reflecting auditory feedback control. Surprisingly, the language production contrast revealed a relative increase in activation in bilateral occipital cortex for speaking. We speculate that greater activation in visual cortex for speaking may actually reflect cortical attenuation when signing, which functions to distinguish self-produced from externally generated visual input. Directly contrasting speech and sign comprehension revealed greater activation in bilateral STC for speech and greater activation in bilateral occipital-temporal cortex for sign. Sign comprehension, like sign production, engaged bilateral parietal cortex to a greater extent than spoken language. We hypothesize that posterior parietal activation in part reflects processing related to spatial classifier constructions in ASL and that anterior parietal activation may reflect covert imitation that functions as a predictive model during sign comprehension. The conjunction analysis for comprehension revealed that both speech and sign bilaterally engaged the inferior frontal gyrus (with more extensive activation on the left) and the superior temporal sulcus, suggesting an invariant bilateral perisylvian language system. We conclude that surface level differences between sign and spoken languages should not be dismissed and are critical for understanding the neurobiology of language.

Second language experience modulates functional brain network for the native language production in bimodal bilinguals

The functional brain network of a bilingual's first language (L1) plays a crucial role in shaping that of his or her second language (L2). However, it is less clear how L2 acquisition changes the functional network of L1 processing in bilinguals. In this study, we demonstrate that in bimodal (Chinese spoken-sign) bilinguals, the functional network supporting L1 production (spoken language) has been reorganized to accommodate the network underlying L2 production (sign language). Using functional magnetic resonance imaging (fMRI) and a picture naming task, we find greater recruitment of the right supramarginal gyrus (RSMG), the right temporal gyrus (RSTG), and the right superior occipital gyrus (RSOG) for bilingual speakers versus monolingual speakers during L1 production. In addition, our second experiment reveals that these regions reflect either automatic activation of L2 (RSOG) or extra cognitive coordination (RSMG and RSTG) between both languages during L1 production. The functional connectivity between these regions, as well as between other regions that are L1- or L2-specific, is enhanced during L1 production in bimodal bilinguals as compared to their monolingual peers. These findings suggest that L1 production in bimodal bilinguals involves an interaction between L1 and L2, supporting the claim that learning a second language does, in fact, change the functional brain network of the first language.