Functional connectivity in task-negative network of the Deaf: effects of sign language experience

Prediction underlying comprehension of human motion: an analysis of Deaf signer and non-signer EEG in response to visual stimuli

Introduction

Sensory inference and top-down predictive processing, reflected in human neural activity, play a critical role in higher-order cognitive processes, such as language comprehension. However, the neurobiological bases of predictive processing in higher-order cognitive processes are not well-understood.

Methods

This study used electroencephalography (EEG) to track participants' cortical dynamics in response to Austrian Sign Language and reversed sign language videos, measuring neural coherence to optical flow in the visual signal. We then used machine learning to assess entropy-based relevance of specific frequencies and regions of interest to brain state classification accuracy.

Results

EEG features highly relevant for classification were distributed across language processing-related regions in Deaf signers (frontal cortex and left hemisphere), while in non-signers such features were concentrated in visual and spatial processing regions.

Discussion

The results highlight functional significance of predictive processing time windows for sign language comprehension and biological motion processing, and the role of long-term experience (learning) in minimizing prediction error.

Arithmetic in the signing brain: Differences and similarities in arithmetic processing between deaf signers and hearing non-signers

Deaf signers and hearing non-signers have previously been shown to recruit partially different brain regions during simple arithmetic. In light of the triple code model, the differences were interpreted as relating to stronger recruitment of the verbal system of numerical processing, that is, left angular and inferior frontal gyrus, in hearing non-signers, and of the quantity system of numerical processing, that is, right horizontal intraparietal sulcus, for deaf signers. The main aim of the present study was to better understand similarities and differences in the neural correlates supporting arithmetic in deaf compared to hearing individuals. Twenty-nine adult deaf signers and 29 hearing non-signers were enrolled in an functional magnetic resonance imaging study of simple and difficult subtraction and multiplication. Brain imaging data were analyzed using whole-brain analysis, region of interest analysis, and functional connectivity analysis. Although the groups were matched on age, gender, and nonverbal intelligence, the deaf group performed generally poorer than the hearing group in arithmetic. Nevertheless, we found generally similar networks to be involved for both groups, the only exception being the involvement of the left inferior frontal gyrus. This region was activated significantly stronger for the hearing compared to the deaf group but showed stronger functional connectivity with the left superior temporal gyrus in the deaf, compared to the hearing, group. These results lend no support to increased recruitment of the quantity system in deaf signers. Perhaps the reason for performance differences is to be found in other brain regions not included in the original triple code model.

Brain Gray Matter Atrophy and Functional Connectivity Remodeling in Patients With Chronic LHON

Purpose

The aim of this study was to investigate the brain gray matter volume (GMV) and spontaneous functional connectivity (FC) changes in patients with chronic Leber's hereditary optic neuropathy (LHON), and their relations with clinical measures.

Methods

A total of 32 patients with chronic LHON and matched sighted healthy controls (HC) underwent neuro-ophthalmologic examinations and multimodel magnetic resonance imaging (MRI) scans. Voxel-based morphometry (VBM) was used to detect the GMV differences between the LHON and HC. Furthermore, resting-state FC analysis using the VBM-identified clusters as seeds was carried out to detect potential functional reorganization in the LHON. Finally, the associations between the neuroimaging and clinical measures were performed.

Results

The average peripapillary retinal nerve fiber layer (RNFL) thickness of the chronic LHON was significantly thinner (T = −16.421, p < 0.001), and the mean defect of the visual field was significantly higher (T = 11.28, p < 0.001) than the HC. VBM analysis demonstrated a significantly lower GMV of bilateral calcarine gyri (CGs) in the LHON than in the HC (p < 0.05). Moreover, in comparison with the HC, the LHON had significantly lower FC between the centroid of the identified left CG and ipsilateral superior occipital gyrus (SOG) and higher FC between this cluster and the ipsilateral posterior cingulate gyrus (p < 0.05, corrected). Finally, the GMV of the left CG was negatively correlated with the LHON duration (r = −0.535, p = 0.002), and the FC between the left CG and the ipsilateral posterior cingulate gyrus of the LHON was negatively correlated with the average peripapillary RNFL thickness (r = −0.522, p = 0.003).

Conclusion

The atrophied primary visual cortex of the chronic LHON may be caused by transneuronal degeneration following the retinal damage. Moreover, our findings suggest that the functional organization of the atrophied primary visual cortex has been reshaped in the chronic LHON.

Reorganization of large-scale brain networks in deaf signing adults: The role of auditory cortex in functional reorganization following deafness

If the brain is deprived of input from one or more senses during development, functional and structural reorganization of the deprived regions takes place. However, little is known about how sensory deprivation affects large-scale brain networks. In the present study, we use data-driven independent component analysis (ICA) to characterize large-scale brain networks in 15 deaf early signers and 24 hearing non-signers based on resting-state functional MRI data. We found differences between the groups in independent components representing the left lateralized control network, the default network, the ventral somatomotor network, and the attention network. In addition, we showed stronger functional connectivity for deaf compared to hearing individuals from the middle and superior temporal cortices to the cingulate cortex, insular cortex, cuneus and precuneus, supramarginal gyrus, supplementary motor area, and cerebellum crus 1, and stronger connectivity for hearing non-signers to hippocampus, middle and superior frontal gyri, pre- and postcentral gyri, and cerebellum crus 8. These results show that deafness induces large-scale network reorganization, with the middle/superior temporal cortex as a central node of plasticity. Cross-modal reorganization may be associated with behavioral adaptations to the environment, including superior ability in some visual functions such as visual working memory and visual attention, in deaf signers.

Early deafness leads to re-shaping of functional connectivity beyond the auditory cortex

Early sensory deprivation, such as deafness, shapes brain development in multiple ways. Deprived auditory areas become engaged in the processing of stimuli from the remaining modalities and in high-level cognitive tasks. Yet, structural and functional changes were also observed in non-deprived brain areas, which may suggest the whole-brain network changes in deaf individuals. To explore this possibility, we compared the resting-state functional network organization of the brain in early deaf adults and hearing controls and examined global network segregation and integration. Relative to hearing controls, deaf adults exhibited decreased network segregation and an altered modular structure. In the deaf, regions of the salience network were coupled with the fronto-parietal network, while in the hearing controls, they were coupled with other large-scale networks. Deaf adults showed weaker connections between auditory and somatomotor regions, stronger coupling between the fronto-parietal network and several other large-scale networks (visual, memory, cingulo-opercular and somatomotor), and an enlargement of the default mode network. Our findings suggest that brain plasticity in deaf adults is not limited to changes in the auditory cortex but additionally alters the coupling between other large-scale networks and the development of functional brain modules. These widespread functional connectivity changes may provide a mechanism for the superior behavioral performance of the deaf in visual and attentional tasks.

Working memory network plasticity after exercise intervention detected by task and resting-state functional MRI

The current study examined the effects of an 11-week exercise intervention on brain activity during a working memory (WM) task and resting-state functional network connectivity in deaf children. Twenty-six deaf children were randomly assigned to either an 11-week exercise intervention or control conditions. Before and after the exercise intervention, all participants were scanned with functional magnetic resonance imaging (fMRI) during N-back task performance and a resting state. The behavioural results showed that the exercise intervention improved WM performance. Task activation analyses showed an increase in the parietal, occipital, and temporal gyri and hippocampus and hippocampus (HIP). In addition, WM performance improvements were associated with greater activation in the left HIP region. Resting-state functional connectivity (Rs-FC) between HIP and certain other brain areas shown a significant interaction of group (exercise versus no exercise) and time (pre- and postintervention). Moreover, connectivity between the left HIP and left middle frontal gyrus was related to improved WM performance. These data extend current knowledge by indicating that an exercise intervention can improve WM in deaf children, and these enhancements may be related to the WM network plasticity changes induced by exercise.

Review article: Structural brain alterations in prelingually deaf

Functional studies show that our brain has a remarkable ability to reorganize itself in the absence of one or more sensory modalities. In this review, we gathered all the available articles investigating structural alterations in congenitally deaf subjects. Some concentrated only on specific regions of interest (e.g., auditory areas), while others examined the whole brain. The majority of structural alterations were observed in the auditory white matter and were more pronounced in the right hemisphere. A decreased white matter volume or fractional anisotropy in the auditory areas were the most common findings in congenitally deaf subjects. Only a few studies observed alterations in the auditory grey matter. Preservation of the grey matter might be due to the cross-modal plasticity as well as due to the lack of sensitivity of methods used for microstructural alterations of grey matter. Structural alterations were also observed in the frontal, visual, and other cerebral regions as well as in the cerebellum. The observed structural brain alterations in the deaf can probably be attributed mainly to the cross-modal plasticity in the absence of sound input and use of sign instead of spoken language.

Age of acquisition effects differ across linguistic domains in sign language: EEG evidence

One of the key questions in the study of human language acquisition is the extent to which the development of neural processing networks for different components of language are modulated by exposure to linguistic stimuli. Sign languages offer a unique perspective on this issue, because prelingually Deaf children who receive access to complex linguistic input later in life provide a window into brain maturation in the absence of language, and subsequent neuroplasticity of neurolinguistic networks during late language learning. While the duration of sensitive periods of acquisition of linguistic subsystems (sound, vocabulary, and syntactic structure) is well established on the basis of L2 acquisition in spoken language, for sign languages, the relative timelines for development of neural processing networks for linguistic sub-domains are unknown. We examined neural responses of a group of Deaf signers who received access to signed input at varying ages to three linguistic phenomena at the levels of classifier signs, syntactic structure, and information structure. The amplitude of the N400 response to the marked word order condition negatively correlated with the age of acquisition for syntax and information structure, indicating increased cognitive load in these conditions. Additionally, the combination of behavioral and neural data suggested that late learners preferentially relied on classifiers over word order for meaning extraction. This suggests that late acquisition of sign language significantly increases cognitive load during analysis of syntax and information structure, but not word-level meaning.

Arithmetic in the adult deaf signing brain

We have previously shown that deaf signers recruit partially different brain regions during simple arithmetic compared to a group of hearing non-signers, despite similar performance. Specifically, hearing individuals show more widespread activation in brain areas that have been related to the verbal system of numerical processing, i.e., the left angular and inferior frontal gyrus, whereas deaf individuals engaged brain areas that have been related to the quantity system of numerical processing, i.e., the right horizontal intraparietal sulcus. This indicates that compared to hearing non-signers, deaf signers can successfully make use of processes located in partially different brain areas during simple arithmetic. In this study, which is a conceptual replication and extension of the above-presented study, the main aim is to understand similarities and differences in neural correlates supporting arithmetic in deaf compared to hearing individuals. The primary objective is to investigate the role of the right horizontal intraparietal gyrus, the left inferior frontal gyrus, the hippocampus, and the left angular gyrus during simple and difficult arithmetic and how these regions are connected to each other. A second objective is to explore what other brain regions support arithmetic in deaf signers. Up to 34 adult deaf signers and the same amount of hearing non-signers will be enrolled in an functional magnetic resonance imaging study that will include simple and difficult subtraction and multiplication. Brain imaging data will be analyzed using whole-brain analysis, region of interest analysis and connectivity analysis. This is the first study to investigate neural underpinnings of arithmetic of different difficulties in deaf individuals.

Syllable as a unit of information transfer in linguistic communication: The entropy syllable parsing model

To understand human language-both spoken and signed-the listener or viewer has to parse the continuous external signal into components. The question of what those components are (e.g., phrases, words, sounds, phonemes?) has been a subject of long-standing debate. We re-frame this question to ask: What properties of the incoming visual or auditory signal are indispensable to eliciting language comprehension? In this review, we assess the phenomenon of language parsing from modality-independent viewpoint. We show that the interplay between dynamic changes in the entropy of the signal and between neural entrainment to the signal at syllable level (4-5 Hz range) is causally related to language comprehension in both speech and sign language. This modality-independent Entropy Syllable Parsing model for the linguistic signal offers insight into the mechanisms of language processing, suggesting common neurocomputational bases for syllables in speech and sign language. This article is categorized under: Linguistics > Linguistic Theory Linguistics > Language in Mind and Brain Linguistics > Computational Models of Language Psychology > Language.

The power of language: Functional brain network topology of deaf and hearing in relation to sign language experience

Prolonged auditory sensory deprivation leads to brain reorganization. This is indicated by functional enhancement in remaining sensory systems and known as cross-modal plasticity. In this study we investigated differences in functional brain network topology between deaf and hearing individuals. We also studied altered functional network responses between deaf and hearing individuals with a recording paradigm containing an eyes-closed and eyes-open condition. Electroencephalography activity was recorded in a group of sign language-trained deaf (N = 71) and hearing people (N = 122) living in rural Africa. Functional brain networks were constructed from the functional connectivity between fourteen electrodes distributed over the scalp. Functional connectivity was quantified with the phase lag index based on bandpass filtered epochs of brain signal. We studied the functional connectivity between the auditory, somatosensory and visual cortex and performed whole-brain minimum spanning tree analysis to capture network backbone characteristics. Functional connectivity between different regions involved in sensory information processing tended to be stronger in deaf people during the eyes-closed condition in both the alpha and beta frequency band. Furthermore, we found differences in functional backbone topology between deaf and hearing individuals. The backbone topology altered during transition from the eyes-closed to eyes-open condition irrespective of deafness, but was more pronounced in deaf individuals. The transition of backbone strength was different between individuals with congenital, pre-lingual or post-lingual deafness. Functional backbone characteristics correlated with the experience of sign language. Overall, our study revealed more insights in functional network reorganization caused by auditory deprivation and cross-modal plasticity. It further supports the idea of a brain plasticity potential in deaf and hearing people. The association between network organization and acquired sign language experience reflects the ability of ongoing brain adaptation in people with hearing disabilities.

Shared neural and cognitive mechanisms in action and language: The multiscale information transfer framework

This review compares how humans process action and language sequences produced by other humans. On the one hand, we identify commonalities between action and language processing in terms of cognitive mechanisms (e.g., perceptual segmentation, predictive processing, integration across multiple temporal scales), neural resources (e.g., the left inferior frontal cortex), and processing algorithms (e.g., comprehension based on changes in signal entropy). On the other hand, drawing on sign language with its particularly strong motor component, we also highlight what differentiates (both oral and signed) linguistic communication from nonlinguistic action sequences. We propose the multiscale information transfer framework (MSIT) as a way of integrating these insights and highlight directions into which future empirical research inspired by the MSIT framework might fruitfully evolve. This article is categorized under: Psychology > Language Linguistics > Language in Mind and Brain Psychology > Motor Skill and Performance Psychology > Prediction.

Functional Neuroanatomy of Second Language Sentence Comprehension: An fMRI Study of Late Learners of American Sign Language

The neurobiology of sentence comprehension is well-studied but the properties and characteristics of sentence processing networks remain unclear and highly debated. Sign languages (i.e., visual-manual languages), like spoken languages, have complex grammatical structures and thus can provide valuable insights into the specificity and function of brain regions supporting sentence comprehension. The present study aims to characterize how these well-studied spoken language networks can adapt in adults to be responsive to sign language sentences, which contain combinatorial semantic and syntactic visual-spatial linguistic information. Twenty native English-speaking undergraduates who had completed introductory American Sign Language (ASL) courses viewed videos of the following conditions during fMRI acquisition: signed sentences, signed word lists, English sentences and English word lists. Overall our results indicate that native language (L1) sentence processing resources are responsive to ASL sentence structures in late L2 learners, but that certain L1 sentence processing regions respond differently to L2 ASL sentences, likely due to the nature of their contribution to language comprehension. For example, L1 sentence regions in Broca's area were significantly more responsive to L2 than L1 sentences, supporting the hypothesis that Broca's area contributes to sentence comprehension as a cognitive resource when increased processing is required. Anterior temporal L1 sentence regions were sensitive to L2 ASL sentence structure, but demonstrated no significant differences in activation to L1 than L2, suggesting its contribution to sentence processing is modality-independent. Posterior superior temporal L1 sentence regions also responded to ASL sentence structure but were more activated by English than ASL sentences. An exploratory analysis of the neural correlates of L2 ASL proficiency indicates that ASL proficiency is positively correlated with increased activations in response to ASL sentences in L1 sentence processing regions. Overall these results suggest that well-established fronto-temporal spoken language networks involved in sentence processing exhibit functional plasticity with late L2 ASL exposure, and thus are adaptable to syntactic structures widely different than those in an individual's native language. Our findings also provide valuable insights into the unique contributions of the inferior frontal and superior temporal regions that are frequently implicated in sentence comprehension but whose exact roles remain highly debated.

Pattern of neural divergence in adults with prelingual deafness: Based on structural brain analysis

Sensory input for hearing plays a significant role in the development of human brain. Absence of an early auditory input leads to the alteration of important neural regions, which in turn results in a complex process known as cross-modal neuroplasticity. Previous studies related to the structural brain alteration of adult deaf individuals have shown inconsistent results. To address this issue, we investigated the brain morphology in 50 prelingual adult deaf individuals and compared it with the same number of individuals with normal hearing, using structural magnetic resonance imaging and three inter-related but completely distinct analysis methods namely univariate approach (voxel based morphometry), multivariate approach (source based morphometry), and projection based cortical thickness. The findings from all these inter-related analyses suggest alterations in important neural regions such as bilateral superior temporal gyrus, bilateral inferior temporal, bilateral fusiform gyrus, and bilateral middle frontal. These findings also justify a strong ventral visual pathway in the deaf group. We suggest that these morphological alterations in important brain regions are due to the compensatory cross-modal reorganization.

Subject preference emerges as cross-modal strategy for linguistic processing

Research on spoken languages has identified a "subject preference" processing strategy for tackling input that is syntactically ambiguous as to whether a sentence-initial NP is a subject or object. The present study documents that the "subject preference" strategy is also seen in the processing of a sign language, supporting the hypothesis that the "subject"-first strategy is universal and not dependent on the language modality (spoken vs. signed). Deaf signers of Austrian Sign Language (ÖGS) were shown videos of locally ambiguous signed sentences in SOV and OSV word orders. Electroencephalogram (EEG) data indicated higher cognitive load in response to OSV stimuli (i.e. a negativity for OSV compared to SOV), indicative of syntactic reanalysis cost. A finding that is specific to the visual modality is that the ERP (event-related potential) effect reflecting linguistic reanalysis occurred earlier than might have been expected, that is, before the time point when the path movement of the disambiguating sign was visible. We suggest that in the visual modality, transitional movement of the articulators prior to the disambiguating verb position or co-occurring non-manual (face/body) markings were used in resolving the local ambiguity in ÖGS. Thus, whereas the processing strategy of "subject preference" is cross-modal at the linguistic level, the cues that enable the processor to apply that strategy differ in signing as compared to speech.

Current and future methodologies for quantitative analysis of information transfer in sign language and gesture data

State-of-the-art methods of analysis of video data now include motion capture and optical flow from video recordings. These techniques allow for biological differentiation between visual communication and noncommunicative motion, enabling further inquiry into neural bases of communication. The requirements for additional noninvasive methods of data collection and automatic analysis of natural gesture and sign language are discussed.

Altered brain network dynamics in youths with autism spectrum disorder

The heterogeneity of behavioral manifestation of autism spectrum disorders (ASDs) requires a model which incorporates understanding of dynamic differences in neural processing between ASD and typically developing (TD) populations. We use network approach to characterization of spatiotemporal dynamics of EEG data in TD and ASD youths. EEG recorded during both wakeful rest (resting state) and a social–visual task was analyzed using cross-correlation analysis of the 32-channel time series to produce weighted, undirected graphs corresponding to functional brain networks. The stability of these networks was assessed by novel use of the L¹-norm for matrix entries (edit distance). There were a significantly larger number of stable networks observed in the resting condition compared to the task condition in both populations. In resting state, stable networks persisted for a significantly longer time in children with ASD than in TD children; networks in ASD children also had larger diameter, indicative of long-range connectivity. The resulting analysis combines key features of microstate and network analyses of EEG.

Grey matter connectivity within and between auditory, language and visual systems in prelingually deaf adolescents

PURPOSE

Previous studies have shown brain reorganizations after early deprivation of auditory sensory. However, changes of grey matter connectivity have not been investigated in prelingually deaf adolescents yet. In the present study, we aimed to investigate changes of grey matter connectivity within and between auditory, language and visual systems in prelingually deaf adolescents.

METHODS

We recruited 16 prelingually deaf adolescents and 16 age-and gender-matched normal controls, and extracted the grey matter volume as the structural characteristic from 14 regions of interest involved in auditory, language or visual processing to investigate the changes of grey matter connectivity within and between auditory, language and visual systems. Sparse inverse covariance estimation (SICE) was utilized to construct grey matter connectivity between these brain regions.

RESULTS

The results show that prelingually deaf adolescents present weaker grey matter connectivity within auditory and visual systems, and connectivity between language and visual systems declined. Notably, significantly increased brain connectivity was found between auditory and visual systems in prelingually deaf adolescents.

CONCLUSIONS

Our results indicate "cross-modal" plasticity after deprivation of the auditory input in prelingually deaf adolescents, especially between auditory and visual systems. Besides, auditory deprivation and visual deficits might affect the connectivity pattern within language and visual systems in prelingually deaf adolescents.

Resting-state low-frequency fluctuations reflect individual differences in spoken language learning

A major challenge in language learning studies is to identify objective, pre-training predictors of success. Variation in the low-frequency fluctuations (LFFs) of spontaneous brain activity measured by resting-state functional magnetic resonance imaging (RS-fMRI) has been found to reflect individual differences in cognitive measures. In the present study, we aimed to investigate the extent to which initial spontaneous brain activity is related to individual differences in spoken language learning. We acquired RS-fMRI data and subsequently trained participants on a sound-to-word learning paradigm in which they learned to use foreign pitch patterns (from Mandarin Chinese) to signal word meaning. We performed amplitude of spontaneous low-frequency fluctuation (ALFF) analysis, graph theory-based analysis, and independent component analysis (ICA) to identify functional components of the LFFs in the resting-state. First, we examined the ALFF as a regional measure and showed that regional ALFFs in the left superior temporal gyrus were positively correlated with learning performance, whereas ALFFs in the default mode network (DMN) regions were negatively correlated with learning performance. Furthermore, the graph theory-based analysis indicated that the degree and local efficiency of the left superior temporal gyrus were positively correlated with learning performance. Finally, the default mode network and several task-positive resting-state networks (RSNs) were identified via the ICA. The "competition" (i.e., negative correlation) between the DMN and the dorsal attention network was negatively correlated with learning performance. Our results demonstrate that a) spontaneous brain activity can predict future language learning outcome without prior hypotheses (e.g., selection of regions of interest--ROIs) and b) both regional dynamics and network-level interactions in the resting brain can account for individual differences in future spoken language learning success.