White matter connectivity between occipital and temporal regions involved in face and voice processing in hearing and early deaf individuals

A systematic review of altered resting-state networks in early deafness and implications for cochlear implantation outcomes

Auditory deprivation following congenital/pre-lingual deafness (C/PD) can drastically affect brain development and its functional organisation. This systematic review intends to extend current knowledge of the impact of C/PD and deafness duration on brain resting-state networks (RSNs), review changes in RSNs and spoken language outcomes post-cochlear implant (CI) and draw conclusions for future research. The systematic literature search followed the PRISMA guideline. Two independent reviewers searched four electronic databases using combined keywords: 'auditory deprivation', 'congenital/prelingual deafness', 'resting-state functional connectivity' (RSFC), 'resting-state fMRI' and 'cochlear implant'. Seventeen studies (16 cross-sectional and one longitudinal) met the inclusion criteria. Using the Crowe Critical Appraisal Tool, the publications' quality was rated between 65.0% and 92.5% (mean: 84.10%), ≥80% in 13 out of 17 studies. A few studies were deficient in sampling and/or ethical considerations. According to the findings, early auditory deprivation results in enhanced RSFC between the auditory network and brain networks involved in non-verbal communication, and high levels of spontaneous neural activity in the auditory cortex before CI are evidence of occupied auditory cortical areas with other sensory modalities (cross-modal plasticity) and sub-optimal CI outcomes. Overall, current evidence supports the idea that moreover intramodal and cross-modal plasticity, the entire brain adaptation following auditory deprivation contributes to spoken language development and compensatory behaviours.

Connectome alterations following perinatal deafness in the cat

Following sensory deprivation, areas and networks in the brain may adapt and reorganize to compensate for the loss of input. These adaptations are manifestations of compensatory crossmodal plasticity, which has been documented in both human and animal models of deafness-including the domestic cat. Although there are abundant examples of structural plasticity in deaf felines from retrograde tracer-based studies, there is a lack of diffusion-based knowledge involving this model compared to the current breadth of human research. The purpose of this study was to explore white matter structural adaptations in the perinatally-deafened cat via tractography, increasing the methodological overlap between species. Plasticity was examined by identifying unique group connections and assessing altered connectional strength throughout the entirety of the brain. Results revealed a largely preserved connectome containing a limited number of group-specific or altered connections focused within and between sensory networks, which is generally corroborated by deaf feline anatomical tracer literature. Furthermore, five hubs of cortical plasticity and altered communication following perinatal deafness were observed. The limited differences found in the present study suggest that deafness-induced crossmodal plasticity is largely built upon intrinsic structural connections, with limited remodeling of underlying white matter.

Functional to structural plasticity in unilateral sudden sensorineural hearing loss: neuroimaging evidence

A cortical plasticity after long-duration single side deafness (SSD) is advocated with neuroimaging evidence while little is known about the short-duration SSDs. In this case-cohort study, we recruited unilateral sudden sensorineural hearing loss (SSNHL) patients and age-, gender-matched health controls (HC), followed by comprehensive neuroimaging analyses. The primary outcome measures were temporal alterations of varied dynamic functional network connectivity (dFNC) states, neurovascular coupling (NVC) and brain region volume at different stages of SSNHL. The secondary outcome measures were pure-tone audiograms of SSNHL patients before and after treatment. A total of 38 SSNHL patients (21 [55%] male; mean [standard deviation] age, 45.05 [15.83] years) and 44 HC (28 [64%] male; mean [standard deviation] age, 43.55 [12.80] years) were enrolled. SSNHL patients were categorized into subgroups based on the time from disease onset to the initial magnetic resonance imaging scan: early- (n = 16; 1-6 days), intermediate- (n = 9; 7-13 days), and late- stage (n = 13; 14-30 days) groups. We first identified slow state transitions between varied dFNC states at early-stage SSNHL, then revealed the decreased NVC restricted to the auditory cortex at the intermediate- and late-stage SSNHL. Finally, a significantly decreased volume of the left medial superior frontal gyrus (SFGmed) was observed only in the late-stage SSNHL cohort. Furthermore, the volume of the left SFGmed is robustly correlated with both disease duration and patient prognosis. Our study offered neuroimaging evidence for the evolvement from functional to structural brain alterations of SSNHL patients with disease duration less than 1 month, which may explain, from a neuroimaging perspective, why early-stage SSNHL patients have better therapeutic responses and hearing recovery.

Visual Deprivation Alters Functional Connectivity of Neural Networks for Voice Recognition: A Resting-State fMRI Study

Humans recognize one another by identifying their voices and faces. For sighted people, the integration of voice and face signals in corresponding brain networks plays an important role in facilitating the process. However, individuals with vision loss primarily resort to voice cues to recognize a person's identity. It remains unclear how the neural systems for voice recognition reorganize in the blind. In the present study, we collected behavioral and resting-state fMRI data from 20 early blind (5 females; mean age = 22.6 years) and 22 sighted control (7 females; mean age = 23.7 years) individuals. We aimed to investigate the alterations in the resting-state functional connectivity (FC) among the voice- and face-sensitive areas in blind subjects in comparison with controls. We found that the intranetwork connections among voice-sensitive areas, including amygdala-posterior "temporal voice areas" (TVAp), amygdala-anterior "temporal voice areas" (TVAa), and amygdala-inferior frontal gyrus (IFG) were enhanced in the early blind. The blind group also showed increased FCs of "fusiform face area" (FFA)-IFG and "occipital face area" (OFA)-IFG but decreased FCs between the face-sensitive areas (i.e., FFA and OFA) and TVAa. Moreover, the voice-recognition accuracy was positively related to the strength of TVAp-FFA in the sighted, and the strength of amygdala-FFA in the blind. These findings indicate that visual deprivation shapes functional connectivity by increasing the intranetwork connections among voice-sensitive areas while decreasing the internetwork connections between the voice- and face-sensitive areas. Moreover, the face-sensitive areas are still involved in the voice-recognition process in blind individuals through pathways such as the subcortical-occipital or occipitofrontal connections, which may benefit the visually impaired greatly during voice processing.

Enriched learning: behavior, brain, and computation

The presence of complementary information across multiple sensory or motor modalities during learning, referred to as multimodal enrichment, can markedly benefit learning outcomes. Why is this? Here, we integrate cognitive, neuroscientific, and computational approaches to understanding the effectiveness of enrichment and discuss recent neuroscience findings indicating that crossmodal responses in sensory and motor brain regions causally contribute to the behavioral benefits of enrichment. The findings provide novel evidence for multimodal theories of enriched learning, challenge assumptions of longstanding cognitive theories, and provide counterevidence to unimodal neurobiologically inspired theories. Enriched educational methods are likely effective not only because they may engage greater levels of attention or deeper levels of processing, but also because multimodal interactions in the brain can enhance learning and memory.

White matter structural network alterations in congenital bilateral profound sensorineural hearing loss children: A graph theory analysis

Functional magnetic resonance imaging (fMRI) studies have revealed a functional reorganization in patients with sensorineural hearing loss (SNHL). The structural basement of functional changes has also been investigated recently. Graph theory analysis brings a new understanding of the structural connectome and topological features in central neural system diseases. However, little is known about the structural network connectome changes in SNHL patients, especially in children. We explored the differences in topologic organization, rich-club organization, and structural connection between children with congenital bilateral profound SNHL and normal hearing under the age of three using graph theory analysis and probabilistic tractography. Compared with the normal-hearing (NH) group, the SNHL group showed no difference in global and nodal topological parameters. Increased structural connection strength were found in the right cortico-striatal-thalamus-cortical circuity. Decreased cross-hemisphere connections were found between the right precuneus and the left auditory cortex as well as the left subcortical regions. Rich-club organization analysis found increased local connection in the SNHL group. These results revealed structural organizations after hearing deprivation in congenital bilateral profound SNHL children.

In vivo Correlation Tensor MRI reveals microscopic kurtosis in the human brain on a clinical 3T scanner

Diffusion MRI (dMRI) has become one of the most important imaging modalities for noninvasively probing tissue microstructure. Diffusional Kurtosis MRI (DKI) quantifies the degree of non-gaussian diffusion, which in turn has been shown to increase sensitivity towards, e.g., disease and orientation mapping in neural tissue. However, the specificity of DKI is limited as different sources can contribute to the total intravoxel diffusional kurtosis, including: variance in diffusion tensor magnitudes (K_iso), variance due to diffusion anisotropy (K_aniso), and microscopic kurtosis (μK) related to restricted diffusion, microstructural disorder, and/or exchange. Interestingly, μK is typically ignored in diffusion MRI signal modeling as it is assumed to be negligible in neural tissues. However, recently, Correlation Tensor MRI (CTI) based on Double-Diffusion-Encoding (DDE) was introduced for kurtosis source separation, revealing non negligible μK in preclinical imaging. Here, we implemented CTI for the first time on a clinical 3T scanner and investigated the sources of total kurtosis in healthy subjects. A robust framework for kurtosis source separation in humans is introduced, followed by estimation of μK (and the other kurtosis sources) in the healthy brain. Using this clinical CTI approach, we find that μK significantly contributes to total diffusional kurtosis both in gray and white matter tissue but, as expected, not in the ventricles. The first μK maps of the human brain are presented, revealing that the spatial distribution of μK provides a unique source of contrast, appearing different from isotropic and anisotropic kurtosis counterparts. Moreover, group average templates of these kurtosis sources have been generated for the first time, which corroborated our findings at the underlying individual-level maps. We further show that the common practice of ignoring μK and assuming the multiple gaussian component approximation for kurtosis source estimation introduces significant bias in the estimation of other kurtosis sources and, perhaps even worse, compromises their interpretation. Finally, a twofold acceleration of CTI is discussed in the context of potential future clinical applications. We conclude that CTI has much potential for future in vivo microstructural characterizations in healthy and pathological tissue.

Associations Between Sign Language Skills and Resting-State Functional Connectivity in Deaf Early Signers

The processing of a language involves a neural language network including temporal, parietal, and frontal cortical regions. This applies to spoken as well as signed languages. Previous research suggests that spoken language proficiency is associated with resting-state functional connectivity (rsFC) between language regions and other regions of the brain. Given the similarities in neural activation for spoken and signed languages, rsFC-behavior associations should also exist for sign language tasks. In this study, we explored the associations between rsFC and two types of linguistic skills in sign language: phonological processing skill and accuracy in elicited sentence production. Fifteen adult, deaf early signers were enrolled in a resting-state functional magnetic resonance imaging (fMRI) study. In addition to fMRI data, behavioral tests of sign language phonological processing and sentence reproduction were administered. Using seed-to-voxel connectivity analysis, we investigated associations between behavioral proficiency and rsFC from language-relevant nodes: bilateral inferior frontal gyrus (IFG) and posterior superior temporal gyrus (STG). Results showed that worse sentence processing skill was associated with stronger positive rsFC between the left IFG and left sensorimotor regions. Further, sign language phonological processing skill was associated with positive rsFC from right IFG to middle frontal gyrus/frontal pole although this association could possibly be explained by domain-general cognitive functions. Our findings suggest a possible connection between rsFC and developmental language outcomes in deaf individuals.

Cross-modal integration and plasticity in the superior temporal cortex

In congenitally deaf people, temporal regions typically believed to be primarily auditory enhance their response to nonauditory information. The neural mechanisms and functional principles underlying this phenomenon, as well as its impact on auditory recovery after sensory restoration, yet remain debated. In this chapter, we demonstrate that the cross-modal recruitment of temporal regions by visual inputs in congenitally deaf people follows organizational principles known to be present in the hearing brain. We propose that the functional and structural mechanisms allowing optimal convergence of multisensory information in the temporal cortex of hearing people also provide the neural scaffolding for feeding visual or tactile information into the deafened temporal areas. Innate in their nature, such anatomo-functional links between the auditory and other sensory systems would represent the common substrate of both early multisensory integration and expression of selective cross-modal plasticity in the superior temporal cortex.

'Visual' cortices of congenitally blind adults are sensitive to response selection demands in a go/no-go task

Studies of occipital cortex plasticity in blindness provide insight into how intrinsic constraints interact with experience to determine cortical specialization. We tested the cognitive nature and anatomical origins of occipital responses during non-verbal, non-spatial auditory tasks. In a go/no-go task, congenitally blind (N=23) and sighted (N=24) individuals heard rapidly occurring (<1/s) non-verbal sounds and made one of two button presses (frequent-go 50%, infrequent-go 25%) or withheld a response (no-go, 25%). Rapid and frequent button presses heighten response selection/inhibition demands on the no-go trials: In sighted and blind adults a right-lateralized prefrontal (PFC) network responded most to no-go trials, followed by infrequent-go and finally frequent-go trials. In the blind group only, a right-lateralized occipital network showed the same response profile and the laterality of occipital and PFC responses was correlated across blind individuals. A second experiment with spoken sentences and equations (N=16) found that no-go responses in occipital cortex are distinct from previously identified occipital responses to spoken language. Finally, in resting-state data (N=30 blind, N=31 blindfolded sighted), no-go responsive 'visual' cortex of blind relative to sighted participants was more synchronized with PFC and less synchronized with primary auditory and sensory-motor cortices. No-go responsive occipital cortex showed higher resting-state correlations with no-go responsive PFC than language responsive inferior frontal cortex. We conclude that in blindness, a right-lateralized occipital network responds to non-verbal executive processes, including response selection. These results suggest that connectivity with fronto-parietal executive networks is a key mechanism for plasticity in blindness.

Direct Structural Connections between Auditory and Visual Motion-Selective Regions in Humans

In humans, the occipital middle-temporal region (hMT⁺/V5) specializes in the processing of visual motion, while the planum temporale (hPT) specializes in auditory motion processing. It has been hypothesized that these regions might communicate directly to achieve fast and optimal exchange of multisensory motion information. Here we investigated, for the first time in humans (male and female), the presence of direct white matter connections between visual and auditory motion-selective regions using a combined fMRI and diffusion MRI approach. We found evidence supporting the potential existence of direct white matter connections between individually and functionally defined hMT⁺/V5 and hPT. We show that projections between hMT⁺/V5 and hPT do not overlap with large white matter bundles, such as the inferior longitudinal fasciculus and the inferior frontal occipital fasciculus. Moreover, we did not find evidence suggesting the presence of projections between the fusiform face area and hPT, supporting the functional specificity of hMT⁺/V5-hPT connections. Finally, the potential presence of hMT⁺/V5-hPT connections was corroborated in a large sample of participants (n = 114) from the human connectome project. Together, this study provides a first indication for potential direct occipitotemporal projections between hMT⁺/V5 and hPT, which may support the exchange of motion information between functionally specialized auditory and visual regions.SIGNIFICANCE STATEMENT Perceiving and integrating moving signal across the senses is arguably one of the most important perceptual skills for the survival of living organisms. In order to create a unified representation of movement, the brain must therefore integrate motion information from separate senses. Our study provides support for the potential existence of direct connections between motion-selective regions in the occipital/visual (hMT⁺/V5) and temporal/auditory (hPT) cortices in humans. This connection could represent the structural scaffolding for the rapid and optimal exchange and integration of multisensory motion information. These findings suggest the existence of computationally specific pathways that allow information flow between areas that share a similar computational goal.

Clinical Diagnosis of White Matter Softening in Premature Infants Based on Electroencephalogram (EEG)

Periventricular white matter softening in preterm infants can lead to severe sequelae and greatly affects the quality of life of preterm infants, and early diagnosis is of great clinical significance and value. The purpose of this study is to select a diagnostic test scientifically and rationally, to interpret and evaluate the results of the diagnostic test, and to evaluate the selected diagnostic method. Although DWI is a sensitive method for early diagnosis of PVL, it is not suitable for critical preterm infants. Therefore, according to clinical research data and the basic hardware conditions of our hospital, video EEG was chosen as the target diagnostic test method to explore whether VEEG can be used for early diagnosis of PVL. According to the results of this study, video EEG may play an important role in the early diagnosis of PVL, and it is believed that video EEG can be used as an auxiliary examination tool, especially for some critical preterm infants who are not suitable for DWI examination, and it can be used as an electrophysiological examination index for the preliminary diagnosis of periventricular white matter softening in preterm infants to indicate that the clinic should carry out necessary and appropriate diagnostic tests. The timely intervention and the results of VEEG are valuable for the assessment of the prognosis of critically ill preterm infants as raw data. However, the use of VEEG to screen clinically suspicious PVL preterm infants is a new attempt, and although good results have been achieved in foreign countries, this study has been conducted only recently in China and requires further exploration.

Visual motion processing recruits regions selective for auditory motion in early deaf individuals

In early deaf individuals, the auditory deprived temporal brain regions become engaged in visual processing. In our study we tested further the hypothesis that intrinsic functional specialization guides the expression of cross-modal responses in the deprived auditory cortex. We used functional MRI to characterize the brain response to horizontal, radial and stochastic visual motion in early deaf and hearing individuals matched for the use of oral or sign language. Visual motion showed enhanced response in the 'deaf' mid-lateral planum temporale, a region selective to auditory motion as demonstrated by a separate auditory motion localizer in hearing people. Moreover, multivariate pattern analysis revealed that this reorganized temporal region showed enhanced decoding of motion categories in the deaf group, while visual motion-selective region hMT+/V5 showed reduced decoding when compared to hearing people. Dynamic Causal Modelling revealed that the 'deaf' motion-selective temporal region shows a specific increase of its functional interactions with hMT+/V5 and is now part of a large-scale visual motion selective network. In addition, we observed preferential responses to radial, compared to horizontal, visual motion in the 'deaf' right superior temporal cortex region that also show preferential response to approaching/receding sounds in the hearing brain. Overall, our results suggest that the early experience of auditory deprivation interacts with intrinsic constraints and triggers a large-scale reallocation of computational load between auditory and visual brain regions that typically support the multisensory processing of motion information.

A common variant of the NOTCH4 gene modulates functional connectivity of the occipital cortex and its relationship with schizotypal traits

BACKGROUND

Schizotypal traits are considered as inheritable traits and the endophenotype for schizophrenia. A common variant in the NOTCH4 gene, rs204993, has been linked with schizophrenia, but the neural underpinnings are largely unknown.

METHODS

In present study, we compared the differences of brain functions between different genotypes of rs204993 and its relationship with schizotypal traits among 402 Chinese Han healthy volunteers. The brain function was evaluated with functional connectivity strength (FCS) using the resting-state functional magnetic resonance image(rs-fMRI). The schizotypal traits were measured by the schizotypal personality questionnaire (SPQ).

RESULTS

Our results showed that carriers with the AA genotype showed reduced FCS in the left occipital cortex when compared with carriers with the AG and GG genotypes, and the carriers with the AG genotype showed reduced FCS in the left occipital cortex when compared with carriers with the GG genotype. The FCS values in the left occipital lobe were negatively associated with the SPQ scores and its subscale scores within the carriers with the GG genotype, but not within the carriers with AA or AG genotype.

CONCLUSION

Our results suggested that the common variant in the NOTCH4 gene, rs204993, modulates the function of the occipital cortex, which may contribute to schizotypal traits. These findings provide insight for genetic effects on schizotypal traits and its potential neural substrate.

Categorical representation from sound and sight in the ventral occipito-temporal cortex of sighted and blind

Is vision necessary for the development of the categorical organization of the Ventral Occipito-Temporal Cortex (VOTC)? We used fMRI to characterize VOTC responses to eight categories presented acoustically in sighted and early blind individuals, and visually in a separate sighted group. We observed that VOTC reliably encodes sound categories in sighted and blind people using a representational structure and connectivity partially similar to the one found in vision. Sound categories were, however, more reliably encoded in the blind than the sighted group, using a representational format closer to the one found in vision. Crucially, VOTC in blind represents the categorical membership of sounds rather than their acoustic features. Our results suggest that sounds trigger categorical responses in the VOTC of congenitally blind and sighted people that partially match the topography and functional profile of the visual response, despite qualitative nuances in the categorical organization of VOTC between modalities and groups.

The world is full of rich and dynamic visual information. To avoid information overload, the human brain groups inputs into categories such as faces, houses, or tools. A part of the brain called the ventral occipito-temporal cortex (VOTC) helps categorize visual information. Specific parts of the VOTC prefer different types of visual input; for example, one part may tend to respond more to faces, whilst another may prefer houses. However, it is not clear how the VOTC characterizes information.

One idea is that similarities between certain types of visual information may drive how information is organized in the VOTC. For example, looking at faces requires using central vision, while looking at houses requires using peripheral vision. Furthermore, all faces have a roundish shape while houses tend to have a more rectangular shape. Another possibility, however, is that the categorization of different inputs cannot be explained just by vision, and is also be driven by higher-level aspects of each category. For instance, how humans use or interact with something may also influence how an input is categorized. If categories are established depending (at least partially) on these higher-level aspects, rather than purely through visual likeness, it is likely that the VOTC would respond similarly to both sounds and images representing these categories.

Now, Mattioni et al. have tested how individuals with and without sight respond to eight different categories of information to find out whether or not categorization is driven purely by visual likeness. Each category was presented to participants using sounds while measuring their brain activity. In addition, a group of participants who could see were also presented with the categories visually. Mattioni et al. then compared what happened in the VOTC of the three groups – sighted people presented with sounds, blind people presented with sounds, and sighted people presented with images – in response to each category.

The experiment revealed that the VOTC organizes both auditory and visual information in a similar way. However, there were more similarities between the way blind people categorized auditory information and how sighted people categorized visual information than between how sighted people categorized each type of input. Mattioni et al. also found that the region of the VOTC that responds to inanimate objects massively overlapped across the three groups, whereas the part of the VOTC that responds to living things was more variable.

These findings suggest that the way that the VOTC organizes information is, at least partly, independent from vision. The experiments also provide some information about how the brain reorganizes in people who are born blind. Further studies may reveal how differences in the VOTC of people with and without sight affect regions typically associated with auditory categorization, and potentially explain how the brain reorganizes in people who become blind later in life.

Structural neuroimaging of the altered brain stemming from pediatric and adolescent hearing loss-Scientific and clinical challenges

There has been a spurt in structural neuroimaging studies of the effect of hearing loss on the brain. Specifically, magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI) technologies provide an opportunity to quantify changes in gray and white matter structures at the macroscopic scale. To date, there have been 32 MRI and 23 DTI studies that have analyzed structural differences accruing from pre- or peri-lingual pediatric hearing loss with congenital or early onset etiology and postlingual hearing loss in pre-to-late adolescence. Additionally, there have been 15 prospective clinical structural neuroimaging studies of children and adolescents being evaluated for cochlear implants. The results of the 70 studies are summarized in two figures and three tables. Plastic changes in the brain are seen to be multifocal rather than diffuse, that is, differences are consistent across regions implicated in the hearing, speech and language networks regardless of modes of communication and amplification. Structures in that play an important role in cognition are affected to a lesser extent. A limitation of these studies is the emphasis on volumetric measures and on homogeneous groups of subjects with hearing loss. It is suggested that additional measures of morphometry and connectivity could contribute to a greater understanding of the effect of hearing loss on the brain. Then an interpretation of the observed macroscopic structural differences is given. This is followed by discussion of how structural imaging can be combined with functional imaging to provide biomarkers for longitudinal tracking of amplification. This article is categorized under: Developmental Biology > Developmental Processes in Health and Disease Translational, Genomic, and Systems Medicine > Translational Medicine Laboratory Methods and Technologies > Imaging.

Differences in Emotion Recognition From Body and Face Cues Between Deaf and Hearing Individuals

Deaf individuals may compensate for the lack of the auditory input by showing enhanced capacities in certain visual tasks. Here we assessed whether this also applies to recognition of emotions expressed by bodily and facial cues. In Experiment 1, we compared deaf participants and hearing controls in a task measuring recognition of the six basic emotions expressed by actors in a series of video-clips in which either the face, the body, or both the face and body were visible. In Experiment 2, we measured the weight of body and face cues in conveying emotional information when intense genuine emotions are expressed, a situation in which face expressions alone may have ambiguous valence. We found that deaf individuals were better at identifying disgust and fear from body cues (Experiment 1) and in integrating face and body cues in case of intense negative genuine emotions (Experiment 2). Our findings support the capacity of deaf individuals to compensate for the lack of the auditory input enhancing perceptual and attentional capacities in the spared modalities, showing that this capacity extends to the affective domain.