White matter structure in the right planum temporale region correlates with visual motion detection thresholds in deaf people

Neuroplastic changes in functional wiring in sensory cortices of the congenitally deaf: A network analysis

Congenital sensory deprivation induces significant changes in the structural and functional organisation of the brain. These are well-characterised by cross-modal plasticity, in which deprived cortical areas are recruited to process information from non-affected sensory modalities, as well as by other neuroplastic alterations within regions dedicated to the remaining senses. Here, we analysed visual and auditory networks of congenitally deaf and hearing individuals during different visual tasks to assess changes in network community structure and connectivity patterns due to congenital deafness. In the hearing group, the nodes are clearly divided into three communities (visual, auditory and subcortical), whereas in the deaf group a fourth community consisting mainly of bilateral superior temporal sulcus and temporo-insular regions is present. Perhaps more importantly, the right lateral geniculate body, as well as bilateral thalamus and pulvinar joined the auditory community of the deaf. Moreover, there is stronger connectivity between bilateral thalamic and pulvinar and auditory areas in the deaf group, when compared to the hearing group. No differences were found in the number of connections of these nodes to visual areas. Our findings reveal substantial neuroplastic changes occurring within the auditory and visual networks caused by deafness, emphasising the dynamic nature of the sensory systems in response to congenital deafness. Specifically, these results indicate that in the deaf but not the hearing group, subcortical thalamic nuclei are highly connected to auditory areas during processing of visual information, suggesting that these relay areas may be responsible for rerouting visual information to the auditory cortex under congenital deafness.

The Extent of Hearing Input Affects the Plasticity of the Auditory Cortex in Children With Hearing Loss: A Preliminary Study

PURPOSE

This study investigated to what extent residual hearing and rehabilitation options (e.g., hearing aids [HAs]) affect the auditory cortex in children with hearing loss.

METHOD

Twenty-one children with bilateral congenital sensorineural hearing loss who were candidates for cochlear implantation were recruited. Voxel-based morphometry analysis was conducted to assess the gray matter (GM) volume in the auditory cortex. Children's residual hearing was measured by pure-tone audiometry at different frequencies. Multiple linear regression models were conducted to examine the effects of residual hearing and the use of HAs on GM volume in the auditory cortex with the control of age and gender.

RESULTS

Children with more residual hearing at high frequencies had larger GM volume ratio (corrected by total intracranial volume) in the left Heschl's gyrus (r = -.545, p = .013). An interaction effect between residual hearing and the use of HAs suggested that the effect of residual hearing on GM ratio was moderated by the use of HAs (β = -.791, p = .020). Compared with children with less residual hearing, children who had more residual hearing benefited more from longer use of HAs in terms of a larger GM ratio.

CONCLUSIONS

Our preliminary findings highlight the impact of residual hearing on the neuroanatomy of the auditory cortex in children with hearing loss. Moreover, our results call for more auditory input via HAs for children with more residual hearing to preserve the auditory cortex before cochlear implantation. For children with less residual hearing who might receive limited benefit from HAs, an early cochlear implant would be necessary.

Cross-modal integration and plasticity in the superior temporal cortex

In congenitally deaf people, temporal regions typically believed to be primarily auditory enhance their response to nonauditory information. The neural mechanisms and functional principles underlying this phenomenon, as well as its impact on auditory recovery after sensory restoration, yet remain debated. In this chapter, we demonstrate that the cross-modal recruitment of temporal regions by visual inputs in congenitally deaf people follows organizational principles known to be present in the hearing brain. We propose that the functional and structural mechanisms allowing optimal convergence of multisensory information in the temporal cortex of hearing people also provide the neural scaffolding for feeding visual or tactile information into the deafened temporal areas. Innate in their nature, such anatomo-functional links between the auditory and other sensory systems would represent the common substrate of both early multisensory integration and expression of selective cross-modal plasticity in the superior temporal cortex.

Reduced flash lag illusion in early deaf individuals

When a brief flash is quickly presented aligned with a moving target, the flash typically appears to lag behind the moving stimulus. This effect is widely known in the literature as a flash-lag illusion (FLI). The flash-lag is an example of a motion-induced position shift. Since auditory deprivation leads to both enhanced visual skills and impaired temporal abilities, both crucial for the perception of the flash-lag effect, here we hypothesized that lack of audition could influence the FLI. 13 early deaf and 18 hearing individuals were tested in a visual FLI paradigm to investigate this hypothesis. As expected, results demonstrated a reduction of the flash-lag effect following early deafness, both in the central and peripheral visual fields. Moreover, only for deaf individuals, there is a positive correlation between the flash-lag effect in the peripheral and central visual field, suggesting that the mechanisms underlying the effect in the center of the visual field expand to the periphery following deafness. Overall, these findings reveal that lack of audition early in life profoundly impacts early visual processing underlying the flash-lag effect.

Hearing loss impacts gray and white matter across the lifespan: Systematic review, meta-analysis and meta-regression

Hearing loss is a heterogeneous disorder thought to affect brain reorganization across the lifespan. Here, structural alterations of the brain due to hearing loss are assessed by using unique effect size metrics based on Cohen's d and Hedges' g. These metrics are used to map coordinates of gray matter (GM) and white matter (WM) alterations from bilateral congenital and acquired hearing loss populations. A systematic review and meta-analysis revealed m = 72 studies with structural alterations measured with magnetic resonance imaging (MRI) (bilateral = 64, unilateral = 8). The bilateral studies categorized hearing loss into congenital and acquired cases (n = 7,445) and control cases (n = 2,924), containing 66,545 datapoint metrics. Hearing loss was found to affect GM and underlying WM in nearly every region of the brain. In congenital hearing loss, GM decreased most in the frontal lobe. Similarly, acquired hearing loss had a decrease in frontal lobe GM, albeit the insula was most decreased. In congenital, WM underlying the frontal lobe GM was most decreased. In congenital, the right hemisphere was more negatively impacted than the left hemisphere; however, in acquired, this was the opposite. The WM alterations most frequently underlined GM alterations in congenital hearing loss, while acquired hearing loss studies did not frequently assess the WM metric. Future studies should use the endophenotype of hearing loss as a prognostic template for discerning clinical outcomes.

Effects of deafness and sign language experience on the human brain: voxel-based and surface-based morphometry

We investigated how deafness and sign language experience affect the human brain by comparing neuroanatomical structures across congenitally deaf signers (n = 30), hearing native signers (n = 30), and hearing sign-naïve controls (n = 30). Both voxel-based and surface-based morphometry results revealed deafness-related structural changes in visual cortices (grey matter), right frontal lobe (gyrification), and left Heschl's gyrus (white matter). The comparisons also revealed changes associated with lifelong signing experience: expansions in the surface area within left anterior temporal and left occipital lobes, and a reduction in cortical thickness in the right occipital lobe for deaf and hearing signers. Structural changes within these brain regions may be related to adaptations in the neural networks involved in processing signed language (e.g. visual perception of face and body movements). Hearing native signers also had unique neuroanatomical changes (e.g. reduced gyrification in premotor areas), perhaps due to lifelong experience with both a spoken and a signed language.

Increased Right Posterior STS Recruitment Without Enhanced Directional-Tuning During Tactile Motion Processing in Early Deaf Individuals

Upon early sensory deprivation, the remaining modalities often exhibit cross-modal reorganization, such as primary auditory cortex (PAC) recruitment for visual motion processing in early deafness (ED). Previous studies of compensatory plasticity in ED individuals have given less attention to tactile motion processing. In the current study, we aimed to examine the effects of early auditory deprivation on tactile motion processing. We simulated four directions of tactile motion on each participant's right index finger and characterized their tactile motion responses and directional-tuning profiles using population receptive field analysis. Similar tactile motion responses were found within primary (SI) and secondary (SII) somatosensory cortices between ED and hearing control groups, whereas ED individuals showed a reduced proportion of voxels with directionally tuned responses in SI contralateral to stimulation. There were also significant but minimal responses to tactile motion within PAC for both groups. While early deaf individuals show significantly larger recruitment of right posterior superior temporal sulcus (pSTS) region upon tactile motion stimulation, there was no evidence of enhanced directional tuning. Greater recruitment of right pSTS region is consistent with prior studies reporting reorganization of multimodal areas due to sensory deprivation. The absence of increased directional tuning within the right pSTS region may suggest a more distributed population of neurons dedicated to processing tactile spatial information as a consequence of early auditory deprivation.

The Impact of Early Deafness on Brain Plasticity: A Systematic Review of the White and Gray Matter Changes

Background: Auditory deprivation alters cortical and subcortical brain regions, primarily linked to auditory and language processing, resulting in behavioral consequences. Neuroimaging studies have reported various degrees of structural changes, yet multiple variables in deafness profiles need to be considered for proper interpretation of results. To date, many inconsistencies are reported in the gray and white matter alterations following early profound deafness. The purpose of this study was to provide the first systematic review synthesizing gray and white matter changes in deaf individuals.

Methods: We conducted a systematic review according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement in 27 studies comprising 626 deaf individuals.

Results: Evidence shows that auditory deprivation significantly alters the white matter across the primary and secondary auditory cortices. The most consistent alteration across studies was in the bilateral superior temporal gyri. Furthermore, reductions in the fractional anisotropy of white matter fibers comprising in inferior fronto-occipital fasciculus, the superior longitudinal fasciculus, and the subcortical auditory pathway are reported. The reviewed studies also suggest that gray and white matter integrity is sensitive to early sign language acquisition, attenuating the effect of auditory deprivation on neurocognitive development.

Conclusions: These findings suggest that understanding cortical reorganization through gray and white matter changes in auditory and non-auditory areas is an important factor in the development of auditory rehabilitation strategies in the deaf population.

The Cross-Modal Effects of Sensory Deprivation on Spatial and Temporal Processes in Vision and Audition: A Systematic Review on Behavioral and Neuroimaging Research since 2000

One of the most significant effects of neural plasticity manifests in the case of sensory deprivation when cortical areas that were originally specialized for the functions of the deprived sense take over the processing of another modality. Vision and audition represent two important senses needed to navigate through space and time. Therefore, the current systematic review discusses the cross-modal behavioral and neural consequences of deafness and blindness by focusing on spatial and temporal processing abilities, respectively. In addition, movement processing is evaluated as compiling both spatial and temporal information. We examine whether the sense that is not primarily affected changes in its own properties or in the properties of the deprived modality (i.e., temporal processing as the main specialization of audition and spatial processing as the main specialization of vision). References to the metamodal organization, supramodal functioning, and the revised neural recycling theory are made to address global brain organization and plasticity principles. Generally, according to the reviewed studies, behavioral performance is enhanced in those aspects for which both the deprived and the overtaking senses provide adequate processing resources. Furthermore, the behavioral enhancements observed in the overtaking sense (i.e., vision in the case of deafness and audition in the case of blindness) are clearly limited by the processing resources of the overtaking modality. Thus, the brain regions that were previously recruited during the behavioral performance of the deprived sense now support a similar behavioral performance for the overtaking sense. This finding suggests a more input-unspecific and processing principle-based organization of the brain. Finally, we highlight the importance of controlling for and stating factors that might impact neural plasticity and the need for further research into visual temporal processing in deaf subjects.

What and How the Deaf Brain Sees

Over the past decade, there has been an unprecedented level of interest and progress into understanding visual processing in the brain of the deaf. Specifically, when the brain is deprived of input from one sensory modality (such as hearing), it often compensates with supranormal performance in one or more of the intact sensory systems (such as vision). Recent psychophysical, functional imaging, and reversible deactivation studies have converged to define the specific visual abilities that are enhanced in the deaf, as well as the cortical loci that undergo crossmodal plasticity in the deaf and are responsible for mediating these superior visual functions. Examination of these investigations reveals that central visual functions, such as object and facial discrimination, and peripheral visual functions, such as motion detection, visual localization, visuomotor synchronization, and Vernier acuity (measured in the periphery), are specifically enhanced in the deaf, compared with hearing participants. Furthermore, the cortical loci identified to mediate these functions reside in deaf auditory cortex: BA 41, BA 42, and BA 22, in addition to the rostral area, planum temporale, Te3, and temporal voice area in humans; primary auditory cortex, anterior auditory field, dorsal zone of auditory cortex, auditory field of the anterior ectosylvian sulcus, and posterior auditory field in cats; and primary auditory cortex and anterior auditory field in both ferrets and mice. Overall, the findings from these studies show that crossmodal reorganization in auditory cortex of the deaf is responsible for the superior visual abilities of the deaf.

Prefrontal-Temporal Pathway Mediates the Cross-Modal and Cognitive Reorganization in Sensorineural Hearing Loss With or Without Tinnitus: A Multimodal MRI Study

Objective: Hearing loss, one main risk factor of tinnitus and hyperacusis, is believed to involve significant central functional abnormalities. The recruitment of the auditory cortex in non-auditory sensory and higher-order cognitive processing has been demonstrated in the hearing-deprived brain. The dorsolateral prefrontal cortex (dlPFC), which has dense anatomical connections with the auditory pathway, is known to play a crucial role in multi-sensory integration, auditory regulation, and cognitive processing. This study aimed to verify the role of the dlPFC in the cross-modal reorganization and cognitive participation of the auditory cortex in long-term sensorineural hearing loss (SNHL) by combining functional and structural measurements.

Methods: Thirty five patients with long-term bilateral SNHL and 35 matched healthy controls underwent structural imaging, resting-state functional magnetic resonance imaging (rs-fMRI), diffusion tensor imaging (DTI), and neuropsychological assessments. Ten SNHL patients were with subjective tinnitus.

Results: No differences in gray matter volume, spontaneous neural activity, or diffusion characteristics in the dlPFC were found between the SNHL and control groups. The functional connectivity (FC) between the dlPFC and the auditory cortex and visual areas, such as the cuneus, fusiform, lingual cortex, and calcarine sulcus was increased in patients with SNHL. ANOVA and post hoc tests revealed similar FC alterations in the SNHL patients with and without tinnitus when compared with the normal hearing controls, and SNHL patients with and without tinnitus showed no difference in the dlPFC FC. The FC in the auditory cortex was associated with the symbol digit modality test (SDMT) scores in the SNHL patients, which reflect attentional function, processing speed, and visual working memory. Hearing-related FC with the dlPFC was found in the lingual cortex. A tract-based spatial statistics (TBSS) analysis revealed decreased fractional anisotropy (FA) values, mainly in the temporal inferior fronto-occipital fasciculus (IFOF), which showed remarkable negative correlations with the mean hearing thresholds in SNHL.

Conclusion: Higher functional coupling between the dlPFC and auditory and visual areas, accompanied by decreased FA along the IFOF connecting the frontal cortex and the occipito-temporal area, might mediate cross-modal plasticity via top-down regulation and facilitate the involvement of the auditory cortex in higher-order cognitive processing following long-term SNHL.

Inefficient Involvement of Insula in Sensorineural Hearing Loss

The insular cortex plays an important role in multimodal sensory processing, audio-visual integration and emotion; however, little is known about how the insula is affected by auditory deprivation due to sensorineural hearing loss (SNHL). To address this issue, we used structural and functional magnetic resonance imaging to determine if the neural activity within the insula and its interregional functional connectivity (FC) was disrupted by SNHL and if these alterations were correlated clinical measures of emotion and cognition. Thirty-five SNHL subjects and 54 Controls enrolled in our study underwent auditory evaluation, neuropsychological assessments, functional and structure MRI, respectively. Twenty five patients and 20 Controls underwent arterial spin labeling scanning. FC of six insula subdivisions were assessed and the FC results were compared to the neuropsychological tests. Interregional connections were also compared among insula-associated networks, including salience network (SN), default mode network (DMN), and central executive network (CEN). Compared to Controls, SNHL subjects demonstrated hyperperfusion in the insula and significantly decreased FC between some insula subdivisions and other brain regions, including thalamus, putamen, precentral gyrus, postcentral gyrus, mid-cingulate cortex, dorsolateral prefrontal cortex, rolandic operculum. Anxiety, depression and cognitive impairments were correlated with FC values. Abnormal interactions among SN, DMN, and CEN were observed in SNHL group. Our result provides support for the "inefficient high-order control" theory of the insula in which the auditory deprivation caused by SNHL contributes to impaired sensory integration and central deficits in emotional and cognitive processing.

Structural reorganization of the early visual cortex following Braille training in sighted adults

Training can induce cross-modal plasticity in the human cortex. A well-known example of this phenomenon is the recruitment of visual areas for tactile and auditory processing. It remains unclear to what extent such plasticity is associated with changes in anatomy. Here we enrolled 29 sighted adults into a nine-month tactile Braille-reading training, and used voxel-based morphometry and diffusion tensor imaging to describe the resulting anatomical changes. In addition, we collected resting-state fMRI data to relate these changes to functional connectivity between visual and somatosensory-motor cortices. Following Braille-training, we observed substantial grey and white matter reorganization in the anterior part of early visual cortex (peripheral visual field). Moreover, relative to its posterior, foveal part, the peripheral representation of early visual cortex had stronger functional connections to somatosensory and motor cortices even before the onset of training. Previous studies show that the early visual cortex can be functionally recruited for tactile discrimination, including recognition of Braille characters. Our results demonstrate that reorganization in this region induced by tactile training can also be anatomical. This change most likely reflects a strengthening of existing connectivity between the peripheral visual cortex and somatosensory cortices, which suggests a putative mechanism for cross-modal recruitment of visual areas.

Feeling the Beat: Bouncing Synchronization to Vibrotactile Music in Hearing and Early Deaf People

The ability to dance relies on the ability to synchronize movements to a perceived musical beat. Typically, beat synchronization is studied with auditory stimuli. However, in many typical social dancing situations, music can also be perceived as vibrations when objects that generate sounds also generate vibrations. This vibrotactile musical perception is of particular relevance for deaf people, who rely on non-auditory sensory information for dancing. In the present study, we investigated beat synchronization to vibrotactile electronic dance music in hearing and deaf people. We tested seven deaf and 14 hearing individuals on their ability to bounce in time with the tempo of vibrotactile stimuli (no sound) delivered through a vibrating platform. The corresponding auditory stimuli (no vibrations) were used in an additional condition in the hearing group. We collected movement data using a camera-based motion capture system and subjected it to a phase-locking analysis to assess synchronization quality. The vast majority of participants were able to precisely time their bounces to the vibrations, with no difference in performance between the two groups. In addition, we found higher performance for the auditory condition compared to the vibrotactile condition in the hearing group. Our results thus show that accurate tactile-motor synchronization in a dance-like context occurs regardless of auditory experience, though auditory-motor synchronization is of superior quality.

Increased cross-modal functional connectivity in cochlear implant users

Previous studies have reported increased cross-modal auditory and visual cortical activation in cochlear implant (CI) users, suggesting cross-modal reorganization of both visual and auditory cortices in CI users as a consequence of sensory deprivation and restoration. How these processes affect the functional connectivity of the auditory and visual system in CI users is however unknown. We here investigated task-induced intra-modal functional connectivity between hemispheres for both visual and auditory cortices and cross-modal functional connectivity between visual and auditory cortices using functional near infrared spectroscopy in post-lingually deaf CI users and age-matched normal hearing controls. Compared to controls, CI users exhibited decreased intra-modal functional connectivity between hemispheres and increased cross-modal functional connectivity between visual and left auditory cortices for both visual and auditory stimulus processing. Importantly, the difference between cross-modal functional connectivity for visual and for auditory stimuli correlated with speech recognition outcome in CI users. Higher cross-modal connectivity for auditory than for visual stimuli was associated with better speech recognition abilities, pointing to a new pattern of functional reorganization that is related to successful hearing restoration with a CI.

Cortical Correlates of the Auditory Frequency-Following and Onset Responses: EEG and fMRI Evidence

The frequency-following response (FFR) is a measure of the brain's periodic sound encoding. It is of increasing importance for studying the human auditory nervous system due to numerous associations with auditory cognition and dysfunction. Although the FFR is widely interpreted as originating from brainstem nuclei, a recent study using MEG suggested that there is also a right-lateralized contribution from the auditory cortex at the fundamental frequency (Coffey et al., 2016b). Our objectives in the present work were to validate and better localize this result using a completely different neuroimaging modality and to document the relationships between the FFR, the onset response, and cortical activity. Using a combination of EEG, fMRI, and diffusion-weighted imaging, we show that activity in the right auditory cortex is related to individual differences in FFR-fundamental frequency (f₀) strength, a finding that was replicated with two independent stimulus sets, with and without acoustic energy at the fundamental frequency. We demonstrate a dissociation between this FFR-f₀-sensitive response in the right and an area in left auditory cortex that is sensitive to individual differences in the timing of initial response to sound onset. Relationships to timing and their lateralization are supported by parallels in the microstructure of the underlying white matter, implicating a mechanism involving neural conduction efficiency. These data confirm that the FFR has a cortical contribution and suggest ways in which auditory neuroscience may be advanced by connecting early sound representation to measures of higher-level sound processing and cognitive function.

SIGNIFICANCE STATEMENT

The frequency-following response (FFR) is an EEG signal that is used to explore how the auditory system encodes temporal regularities in sound and is related to differences in auditory function between individuals. It is known that brainstem nuclei contribute to the FFR, but recent findings of an additional cortical source are more controversial. Here, we use fMRI to validate and extend the prediction from MEG data of a right auditory cortex contribution to the FFR. We also demonstrate a dissociation between FFR-related cortical activity from that related to the latency of the response to sound onset, which is found in left auditory cortex. The findings provide a clearer picture of cortical processes for analysis of sound features.