Evidence for Cerebellar Contributions to Adaptive Plasticity in Speech Perception

The Cerebellum Is Sensitive to the Lexical Properties of Words During Spoken Language Comprehension

Over the past few decades, research into the function of the cerebellum has expanded far beyond the motor domain. A growing number of studies are probing the role of specific cerebellar subregions, such as Crus I and Crus II, in higher-order cognitive functions including receptive language processing. In the current fMRI study, we show evidence for the cerebellum's sensitivity to variation in two well-studied psycholinguistic properties of words-lexical frequency and phonological neighborhood density-during passive, continuous listening of a podcast. To determine whether, and how, activity in the cerebellum correlates with these lexical properties, we modeled each word separately using an amplitude-modulated regressor, time-locked to the onset of each word. At the group level, significant effects of both lexical properties landed in expected cerebellar subregions: Crus I and Crus II. The BOLD signal correlated with variation in each lexical property, consistent with both language-specific and domain-general mechanisms. Activation patterns at the individual level also showed that effects of phonological neighborhood and lexical frequency landed in Crus I and Crus II as the most probable sites, though there was activation seen in other lobules (especially for frequency). Although the exact cerebellar mechanisms used during speech and language processing are not yet evident, these findings highlight the cerebellum's role in word-level processing during continuous listening.

What we do (not) know about the mechanisms underlying adaptive speech perception: A computational framework and review

Speech from unfamiliar talkers can be difficult to comprehend initially. These difficulties tend to dissipate with exposure, sometimes within minutes or less. Adaptivity in response to unfamiliar input is now considered a fundamental property of speech perception, and research over the past two decades has made substantial progress in identifying its characteristics. The mechanisms underlying adaptive speech perception, however, remain unknown. Past work has attributed facilitatory effects of exposure to any one of three qualitatively different hypothesized mechanisms: (1) low-level, pre-linguistic, signal normalization, (2) changes in/selection of linguistic representations, or (3) changes in post-perceptual decision-making. Direct comparisons of these hypotheses, or combinations thereof, have been lacking. We describe a general computational framework for adaptive speech perception (ASP) that-for the first time-implements all three mechanisms. We demonstrate how the framework can be used to derive predictions for experiments on perception from the acoustic properties of the stimuli. Using this approach, we find that-at the level of data analysis presently employed by most studies in the field-the signature results of influential experimental paradigms do not distinguish between the three mechanisms. This highlights the need for a change in research practices, so that future experiments provide more informative results. We recommend specific changes to experimental paradigms and data analysis. All data and code for this study are shared via OSF, including the R markdown document that this article is generated from, and an R library that implements the models we present.

An Inverse Relationship Between Gray Matter Volume and Speech-in-Noise Performance in Tinnitus Patients with Normal Hearing Sensitivity

Speech-in-noise (SiN) recognition difficulties are often reported in patients with tinnitus. Although brain structural changes such as reduced gray matter (GM) volume in auditory and cognitive processing regions have been reported in the tinnitus population, it remains unclear how such changes influence speech understanding, such as SiN performance. In this study, pure-tone audiometry and Quick Speech-in-Noise test were conducted on individuals with tinnitus and normal hearing and hearing-matched controls. T1-weighted structural MRI images were obtained from all participants. After preprocessing, GM volumes were compared between tinnitus and control groups using whole-brain and region-of-interest analyses. Further, regression analyses were performed to examine the correlation between regional GM volume and SiN scores in each group. The results showed decreased GM volume in the right inferior frontal gyrus in the tinnitus group relative to the control group. In the tinnitus group, SiN performance showed a negative correlation with GM volume in the left cerebellum (Crus I/II) and the left superior temporal gyrus; no significant correlation between SiN performance and regional GM volume was found in the control group. Even with clinically defined normal hearing and comparable SiN performance relative to controls, tinnitus appears to change the association between SiN recognition and regional GM volume. This change may reflect compensatory mechanisms utilized by individuals with tinnitus who maintain behavioral performance.

The role of the basal ganglia and cerebellum in adaptation to others' speech rate and rhythm: A study of patients with Parkinson's disease and cerebellar degeneration

BACKGROUND

Spoken language is constantly undergoing change: Speakers within and across social and regional groups influence each other's speech, leading to the emergence and drifts of accents in a language. These processes are driven by mutual unintentional imitation of the phonetic details of others' speech in conversational interactions, suggesting that continuous auditory-motor adaptation takes place in interactive language use and plasticity of auditory-motor representations of speech persists across the lifespan. The brain mechanisms underlying this large-scale social-linguistic behavior are still poorly understood.

RESEARCH AIM

To investigate the role of cerebellar and basal ganglia dysfunctions in unintended adaptation to the speech rhythm and articulation rate of a second speaker.

METHODS

Twelve patients with spinocerebellar ataxia type 6 (SCA6), 15 patients with Parkinson's disease (PD), and 27 neurologically healthy controls (CTRL) participated in two interactive speech tasks, i.e., sentence repetition and "turn-taking" (i.e., dyadic interaction with sentences produced by a model speaker). Production of scripted sentences was used as a control task. Two types of sentence rhythm were distinguished, i.e., regular and irregular, and model speech rate was manipulated in 12 steps between 2.9 and 4.0 syllables per second. Acoustic analyses of the participants' utterances were performed to determine the extent to which participants adapted their speech rate and rhythm to the model.

RESULTS

Neurologically healthy speakers showed significant adaptation of rate in all conditions, and of rhythm in the repetition task and partly also the turn-taking task. Patients with PD showed a stronger propensity to adapt than the controls. In contrast, the patients with cerebellar degeneration were largely insensitive to the model speaker's rate and rhythm. Contrary to expectations, sentences with an irregular speech rhythm exerted a stronger adaptive attraction than regular sentences in the two patient groups.

CONCLUSIONS

Cerebellar degeneration inhibits the propensity to covertly adapt to others' speech. Striatal dysfunction in Parkinson's disease spares or even promotes the tendency to accommodate to other speakers' speech rate and rhythm.

Cerebellar Contributions to Social Cognition in ASD: A Predictive Processing Framework

Functional, structural, and cytoarchitectural differences in the cerebellum are consistently reported in Autism Spectrum Disorders (ASD). Despite this, the mechanisms governing cerebellar contributions to ASD, particularly within the sociocognitive domain, are not well understood. Recently, it has been suggested that several core features of ASD may be associated with challenges creating and using prior expectations or predictions to rapidly adapt to changing stimuli or situations, also known as adaptive prediction. Importantly, neuroimaging, clinical, and animal work find that the cerebellum supports adaptive prediction in both motor and non-motor domains. Perturbations to the cerebellum via injury or neuromodulation have been associated with impairments in predictive skills. Here, we review evidence for a cerebellar role in social cognition and adaptive prediction across individuals with and without ASD.

Frontotemporal activation differs between perception of simulated cochlear implant speech and speech in background noise: An image-based fNIRS study

In this study we used functional near-infrared spectroscopy (fNIRS) to investigate neural responses in normal-hearing adults as a function of speech recognition accuracy, intelligibility of the speech stimulus, and the manner in which speech is distorted. Participants listened to sentences and reported aloud what they heard. Speech quality was distorted artificially by vocoding (simulated cochlear implant speech) or naturally by adding background noise. Each type of distortion included high and low-intelligibility conditions. Sentences in quiet were used as baseline comparison. fNIRS data were analyzed using a newly developed image reconstruction approach. First, elevated cortical responses in the middle temporal gyrus (MTG) and middle frontal gyrus (MFG) were associated with speech recognition during the low-intelligibility conditions. Second, activation in the MTG was associated with recognition of vocoded speech with low intelligibility, whereas MFG activity was largely driven by recognition of speech in background noise, suggesting that the cortical response varies as a function of distortion type. Lastly, an accuracy effect in the MFG demonstrated significantly higher activation during correct perception relative to incorrect perception of speech. These results suggest that normal-hearing adults (i.e., untrained listeners of vocoded stimuli) do not exploit the same attentional mechanisms of the frontal cortex used to resolve naturally degraded speech and may instead rely on segmental and phonetic analyses in the temporal lobe to discriminate vocoded speech.

Cerebellar volumes and language functions in school-aged children born very preterm

BACKGROUND

Volumes of cerebellar posterior lobes have been associated with cognitive skills, such as language functioning. Children born very preterm (VPT) often have language problems. However, only total cerebellar volume has been associated with language functioning, with contradicting results. The objective of this study was to ascertain whether total cerebellar structures or specific posterior lobular structures are associated with language ability of school-aged VPT children.

METHODS

This is a prospective cohort study of 42 school-aged VPT children without major handicaps. Structural MRI was performed and the cerebellum segmentation pipeline was used for segmentation of separate lobules. Narrative retelling assessment was performed and language content and language structure scores were extracted. Linear regression analyses were used to associate language scores with whole gray matter (GM) cerebellar volume and right Crus I+II GM volume.

RESULTS

Whole cerebellar GM volume was not significantly associated with language content nor with language structure; however, right Crus I+II GM volume was significantly associated with language content (β = 0.192 (CI = 0.033, 0.351), p = 0.020).

CONCLUSIONS

GM volume of Crus I+II appears to be associated with language functions in school-aged VPT children without major handicaps, while whole cerebellar volume is not. This study showed the importance of studying cerebellar lobules separately, rather than whole cerebellar volume only, in relation to VPT children's language functions.

IMPACT

GM volume of Crus I+II is associated with semantic language functions in school-aged very preterm children without overt brain injury, whereas whole cerebellar volume is not. This study showed the importance of studying cerebellar lobules separately, rather than whole cerebellar volume only, in relation to very preterm children's language functions. This study might impact future research in very preterm children. Lobular structures rather than whole cerebellar structures should be the region of interest in relation to language functions.

Speech Perception under the Tent: A Domain-general Predictive Role for the Cerebellum

The role of the cerebellum in speech perception remains a mystery. Given its uniform architecture, we tested the hypothesis that it implements a domain-general predictive mechanism whose role in speech is determined by connectivity. We collated all neuroimaging studies reporting cerebellar activity in the Neurosynth database (n = 8206). From this set, we found all studies involving passive speech and sound perception (n = 72, 64% speech, 12.5% sounds, 12.5% music, and 11% tones) and speech production and articulation (n = 175). Standard and coactivation neuroimaging meta-analyses were used to compare cerebellar and associated cortical activations between passive perception and production. We found distinct regions of perception- and production-related activity in the cerebellum and regions of perception-production overlap. Each of these regions had distinct patterns of cortico-cerebellar connectivity. To test for domain-generality versus specificity, we identified all psychological and task-related terms in the Neurosynth database that predicted activity in cerebellar regions associated with passive perception and production. Regions in the cerebellum activated by speech perception were associated with domain-general terms related to prediction. One hallmark of predictive processing is metabolic savings (i.e., decreases in neural activity when events are predicted). To test the hypothesis that the cerebellum plays a predictive role in speech perception, we examined cortical activation between studies reporting cerebellar activation and those without cerebellar activation during speech perception. When the cerebellum was active during speech perception, there was far less cortical activation than when it was inactive. The results suggest that the cerebellum implements a domain-general mechanism related to prediction during speech perception.

Second-language word recognition in noise: Interdependent neuromodulatory effects of semantic context and crosslinguistic interactions driven by word form similarity

Spoken language comprehension is a fundamental component of our cognitive skills. We are quite proficient at deciphering words from the auditory input despite the fact that the speech we hear is often masked by noise such as background babble originating from talkers other than the one we are attending to. To perceive spoken language as intended, we rely on prior linguistic knowledge and context. Prior knowledge includes all sounds and words that are familiar to a listener and depends on linguistic experience. For bilinguals, the phonetic and lexical repertoire encompasses two languages, and the degree of overlap between word forms across languages affects the degree to which they influence one another during auditory word recognition. To support spoken word recognition, listeners often rely on semantic information (i.e., the words we hear are usually related in a meaningful way). Although the number of multilinguals across the globe is increasing, little is known about how crosslinguistic effects (i.e., word overlap) interact with semantic context and affect the flexible neural systems that support accurate word recognition. The current multi-echo functional magnetic resonance imaging (fMRI) study addresses this question by examining how prime-target word pair semantic relationships interact with the target word's form similarity (cognate status) to the translation equivalent in the dominant language (L1) during accurate word recognition of a non-dominant (L2) language. We tested 26 early-proficient Spanish-Basque (L1-L2) bilinguals. When L2 targets matching L1 translation-equivalent phonological word forms were preceded by unrelated semantic contexts that drive lexical competition, a flexible language control (fronto-parietal-subcortical) network was upregulated, whereas when they were preceded by related semantic contexts that reduce lexical competition, it was downregulated. We conclude that an interplay between semantic and crosslinguistic effects regulates flexible control mechanisms of speech processing to facilitate L2 word recognition, in noise.

Dissociable Auditory Cortico-Cerebellar Pathways in the Human Brain Estimated by Intrinsic Functional Connectivity

The cerebellum, a structure historically associated with motor control, has more recently been implicated in several higher-order auditory-cognitive functions. However, the exact functional pathways that mediate cerebellar influences on auditory cortex (AC) remain unclear. Here, we sought to identify auditory cortico-cerebellar pathways based on intrinsic functional connectivity magnetic resonance imaging. In contrast to previous connectivity studies that principally consider the AC as a single functionally homogenous unit, we mapped the cerebellar connectivity across different parts of the AC. Our results reveal that auditory subareas demonstrating different levels of interindividual functional variability are functionally coupled with distinct cerebellar regions. Moreover, auditory and sensorimotor areas show divergent cortico-cerebellar connectivity patterns, although sensorimotor areas proximal to the AC are often functionally grouped with the AC in previous connectivity-based network analyses. Lastly, we found that the AC can be functionally segmented into highly similar subareas based on either cortico-cerebellar or cortico-cortical functional connectivity, suggesting the existence of multiple parallel auditory cortico-cerebellar circuits that involve different subareas of the AC. Overall, the present study revealed multiple auditory cortico-cerebellar pathways and provided a fine-grained map of AC subareas, indicative of the critical role of the cerebellum in auditory processing and multisensory integration.

Adaptation to mis-pronounced speech: evidence for a prefrontal-cortex repair mechanism

Speech is a complex and ambiguous acoustic signal that varies significantly within and across speakers. Despite the processing challenge that such variability poses, humans adapt to systematic variations in pronunciation rapidly. The goal of this study is to uncover the neurobiological bases of the attunement process that enables such fluent comprehension. Twenty-four native English participants listened to words spoken by a “canonical” American speaker and two non-canonical speakers, and performed a word-picture matching task, while magnetoencephalography was recorded. Non-canonical speech was created by including systematic phonological substitutions within the word (e.g. [s] → [sh]). Activity in the auditory cortex (superior temporal gyrus) was greater in response to substituted phonemes, and, critically, this was not attenuated by exposure. By contrast, prefrontal regions showed an interaction between the presence of a substitution and the amount of exposure: activity decreased for canonical speech over time, whereas responses to non-canonical speech remained consistently elevated. Grainger causality analyses further revealed that prefrontal responses serve to modulate activity in auditory regions, suggesting the recruitment of top-down processing to decode non-canonical pronunciations. In sum, our results suggest that the behavioural deficit in processing mispronounced phonemes may be due to a disruption to the typical exchange of information between the prefrontal and auditory cortices as observed for canonical speech.

Adaptive Plasticity Under Adverse Listening Conditions is Disrupted in Developmental Dyslexia

OBJECTIVE

Acoustic distortions to the speech signal impair spoken language recognition, but healthy listeners exhibit adaptive plasticity consistent with rapid adjustments in how the distorted speech input maps to speech representations, perhaps through engagement of supervised error-driven learning. This puts adaptive plasticity in speech perception in an interesting position with regard to developmental dyslexia inasmuch as dyslexia impacts speech processing and may involve dysfunction in neurobiological systems hypothesized to be involved in adaptive plasticity.

METHOD

Here, we examined typical young adult listeners (N = 17), and those with dyslexia (N = 16), as they reported the identity of native-language monosyllabic spoken words to which signal processing had been applied to create a systematic acoustic distortion. During training, all participants experienced incremental signal distortion increases to mildly distorted speech along with orthographic and auditory feedback indicating word identity following response across a brief, 250-trial training block. During pretest and posttest phases, no feedback was provided to participants.

RESULTS

Word recognition across severely distorted speech was poor at pretest and equivalent across groups. Training led to improved word recognition for the most severely distorted speech at posttest, with evidence that adaptive plasticity generalized to support recognition of new tokens not previously experienced under distortion. However, training-related recognition gains for listeners with dyslexia were significantly less robust than for control listeners.

CONCLUSIONS

Less efficient adaptive plasticity to speech distortions may impact the ability of individuals with dyslexia to deal with variability arising from sources like acoustic noise and foreign-accented speech.

Neural Representation of Articulable and Inarticulable Novel Sound Contrasts: The Role of the Dorsal Stream

The extent that articulatory information embedded in incoming speech contributes to the formation of new perceptual categories for speech sounds has been a matter of discourse for decades. It has been theorized that the acquisition of new speech sound categories requires a network of sensory and speech motor cortical areas (the "dorsal stream") to successfully integrate auditory and articulatory information. However, it is possible that these brain regions are not sensitive specifically to articulatory information, but instead are sensitive to the abstract phonological categories being learned. We tested this hypothesis by training participants over the course of several days on an articulable non-native speech contrast and acoustically matched inarticulable nonspeech analogues. After reaching comparable levels of proficiency with the two sets of stimuli, activation was measured in fMRI as participants passively listened to both sound types. Decoding of category membership for the articulable speech contrast alone revealed a series of left and right hemisphere regions outside of the dorsal stream that have previously been implicated in the emergence of non-native speech sound categories, while no regions could successfully decode the inarticulable nonspeech contrast. Although activation patterns in the left inferior frontal gyrus, the middle temporal gyrus, and the supplementary motor area provided better information for decoding articulable (speech) sounds compared to the inarticulable (sine wave) sounds, the finding that dorsal stream regions do not emerge as good decoders of the articulable contrast alone suggests that other factors, including the strength and structure of the emerging speech categories are more likely drivers of dorsal stream activation for novel sound learning.

Cortical presentation of language functions in patients after total laryngectomy: a fMRI study

Purpose

The aim of this study is to use functional magnetic resonance (fMRI) to analyse the cortical presentation of selected language functions in patients after a total laryngectomy.

Methods

Eighteen patients after total laryngectomy treated with electrolarynx speech and 18 volunteers were included. The mean number of patients’ post-operative speech rehabilitation sessions was five (range of 3–8 sessions). Four paradigms were used, including noun generation, pseudoword reading, reading phrases with pseudowords, and nonliteral sign reproduction.

Results

In noun, the most significant difference between the groups was the stronger activation of both lingual gyri in the volunteers. Pseudoword reading resulted in stronger activations in patients than in volunteers in the lingual gyri, the right cerebellum, the right Broca’s area, and the right parietal operculum. Reading phrases with pseudowords involved different parts of the Brodmann area 40. During nonliteral sign reproduction, there was a stronger activation of the left Broca’s area in volunteers and a stronger activation of the left premotor cortex in patients.

Conclusion

This study provides evidence of altered cortical activation in response to language tasks in patients after a laryngectomy compared with healthy volunteers, which may be considered brain plasticity in response to a laryngectomy.

Neural Basis of Sensorimotor Plasticity in Speech Motor Adaptation

When we speak, we get correlated sensory feedback from speech sounds and from the muscles and soft tissues of the vocal tract. Here we dissociate the contributions of auditory and somatosensory feedback to identify brain networks that underlie the somatic contribution to speech motor learning. The technique uses a robotic device that selectively alters somatosensory inputs in combination with resting-state fMRI scans that reveal learning-related changes in functional connectivity. A partial correlation analysis is used to identify connectivity changes that are not explained by the time course of activity in any other learning-related areas. This analysis revealed changes related to behavioral improvements in movement and separately, to changes in auditory perception: Speech motor adaptation itself was associated with connectivity changes that were primarily in non-motor areas of brain, specifically, to a strengthening of connectivity between auditory and somatosensory cortex and between presupplementary motor area and the inferior parietal lobule. In contrast, connectively changes associated with alterations to auditory perception were restricted to speech motor areas, specifically, primary motor cortex and inferior frontal gyrus. Overall, our findings show that during adaptation, somatosensory inputs result in a broad range of changes in connectivity in areas associated with speech motor control and learning.

Brain networks involved in accented speech processing

We investigated the neural correlates of accented speech processing (ASP) with an fMRI study that overcame prior limitations in this line of research: we preserved intelligibility by using two regional accents that differ in prosody but only mildly in phonetics (Latin American and Castilian Spanish), and we used independent component analysis to identify brain networks as opposed to isolated regions. ASP engaged a speech perception network composed primarily of structures related with the processing of prosody (cerebellum, putamen, and thalamus). This network also included anterior fronto-temporal areas associated with lexical-semantic processing and a portion of the inferior frontal gyrus linked to executive control. ASP also recruited domain-general executive control networks related with cognitive demands (dorsal attentional and default mode networks) and the processing of salient events (salience network). Finally, the reward network showed a preference for the native accent, presumably revealing people's sense of social belonging.

Can perceptual training alter the effect of visual biofeedback in speech-motor learning?

Recent work showing that a period of perceptual training can modulate the magnitude of speech-motor learning in a perturbed auditory feedback task could inform clinical interventions or second-language training strategies. The present study investigated the influence of perceptual training on a clinically and pedagogically relevant task of vocally matching a visually presented speech target using visual-acoustic biofeedback. Forty female adults aged 18-35 yr received perceptual training targeting the English /æ-ɛ/ contrast, randomly assigned to a condition that shifted the perceptual boundary toward either /æ/ or /ɛ/. Participants were then asked to produce the word head while modifying their output to match a visually presented acoustic target corresponding with a slightly higher first formant (F1, closer to /æ/). By analogy to findings from previous research, it was predicted that individuals whose boundary was shifted toward /æ/ would also show a greater magnitude of change in the visual biofeedback task. After perceptual training, the groups showed the predicted difference in perceptual boundary location, but they did not differ in their performance on the biofeedback matching task. It is proposed that the explicit versus implicit nature of the tasks used might account for the difference between this study and previous findings.

Learning to decipher time-compressed speech: Robust acquisition with a slight difficulty in generalization among young adults with developmental dyslexia

Learning to decipher acoustically distorted speech serves as a test case for the study of language-related skill acquisition in persons with developmental dyslexia (DD). Deciphering this type of input is rarely learned explicitly and does not yield conscious insights. Problems in implicit and procedural skill learning have been proposed as possible causes of DD. Here we examined the learning of time-compressed (accelerated) speech and its generalization to novel materials among young adults with DD compared to typical readers (TD). All participants completed a training session that involved judging the semantic plausibility of sentences, during which the level of time-compression was changed using an adaptive (staircase) procedure according to each participant's performance. In the test, phase learning (test on same items) and generalization (test on new items and same items spoken by a new speaker) were assessed. Both groups showed robust gains after training. Moreover, after training, the initial disadvantage of the DD group was no longer significant. After training, both groups experienced relative difficulties in deciphering learned tokens spoken by a different voice, though participants with DD were less able to generalize the gains to deciphering new tokens. Thus, DD individuals benefited from repeated experience with time-compressed speech no less than typical readers, but their evolving skill was apparently more dependent on the specific characteristics of the tokens. Atypical generalization, which indicates that perceptual learning is contingent on lower-level features of the input though does not necessarily point to impaired learning potential per se, may explain some of the contradictory findings in published studies of speech perception in DD.

Cerebellar Contributions to Language in Typical and Atypical Development: A Review

In this review, we present the growing literature suggesting, from a variety of angles, that the cerebellum contributes to higher-order cognitive functions, rather than simply sensorimotor functions, and more specifically to language and its development. The cerebellum's association with language function is determined by the specific cortico-cerebellar connectivity to the right cerebellum from the left cortical hemisphere. The findings we review suggest that the cerebellum plays an important role as part of a broader language network, and also implies that the cerebellum may be a potential new therapeutic target to treat speech and language deficits, especially during development.

Predictive processing increases intelligibility of acoustically distorted speech: Behavioral and neural correlates

INTRODUCTION

We examined which brain areas are involved in the comprehension of acoustically distorted speech using an experimental paradigm where the same distorted sentence can be perceived at different levels of intelligibility. This change in intelligibility occurs via a single intervening presentation of the intact version of the sentence, and the effect lasts at least on the order of minutes. Since the acoustic structure of the distorted stimulus is kept fixed and only intelligibility is varied, this allows one to study brain activity related to speech comprehension specifically.

METHODS

In a functional magnetic resonance imaging (fMRI) experiment, a stimulus set contained a block of six distorted sentences. This was followed by the intact counterparts of the sentences, after which the sentences were presented in distorted form again. A total of 18 such sets were presented to 20 human subjects.

RESULTS

The blood oxygenation level dependent (BOLD)-responses elicited by the distorted sentences which came after the disambiguating, intact sentences were contrasted with the responses to the sentences presented before disambiguation. This revealed increased activity in the bilateral frontal pole, the dorsal anterior cingulate/paracingulate cortex, and the right frontal operculum. Decreased BOLD responses were observed in the posterior insula, Heschl's gyrus, and the posterior superior temporal sulcus.

CONCLUSIONS

The brain areas that showed BOLD-enhancement for increased sentence comprehension have been associated with executive functions and with the mapping of incoming sensory information to representations stored in episodic memory. Thus, the comprehension of acoustically distorted speech may be associated with the engagement of memory-related subsystems. Further, activity in the primary auditory cortex was modulated by prior experience, possibly in a predictive coding framework. Our results suggest that memory biases the perception of ambiguous sensory information toward interpretations that have the highest probability to be correct based on previous experience.

Cerebellar tDCS Modulates Neural Circuits during Semantic Prediction: A Combined tDCS-fMRI Study

It has been proposed that the cerebellum acquires internal models of mental processes that enable prediction, allowing for the optimization of behavior. In language, semantic prediction speeds speech production and comprehension. Right cerebellar lobules VI and VII (including Crus I/II) are engaged during a variety of language processes and are functionally connected with cerebral cortical language networks. Further, right posterolateral cerebellar neuromodulation modifies behavior during predictive language processing. These data are consistent with a role for the cerebellum in semantic processing and semantic prediction. We combined transcranial direct current stimulation (tDCS) and fMRI to assess the behavioral and neural consequences of cerebellar tDCS during a sentence completion task. Task-based and resting-state fMRI data were acquired in healthy human adults (n = 32; μ = 23.1 years) both before and after 20 min of 1.5 mA anodal (n = 18) or sham (n = 14) tDCS applied to the right posterolateral cerebellum. In the sentence completion task, the first four words of the sentence modulated the predictability of the final target word. In some sentences, the preceding context strongly predicted the target word, whereas other sentences were nonpredictive. Completion of predictive sentences increased activation in right Crus I/II of the cerebellum. Relative to sham tDCS, anodal tDCS increased activation in right Crus I/II during semantic prediction and enhanced resting-state functional connectivity between hubs of the reading/language networks. These results are consistent with a role for the right posterolateral cerebellum beyond motor aspects of language, and suggest that cerebellar internal models of linguistic stimuli support semantic prediction.SIGNIFICANCE STATEMENT Cerebellar involvement in language tasks and language networks is now well established, yet the specific cerebellar contribution to language processing remains unclear. It is thought that the cerebellum acquires internal models of mental processes that enable prediction, allowing for the optimization of behavior. Here we combined neuroimaging and neuromodulation to provide evidence that the cerebellum is specifically involved in semantic prediction during sentence processing. We found that activation within right Crus I/II was enhanced when semantic predictions were made, and we show that modulation of this region with transcranial direct current stimulation alters both activation patterns and functional connectivity within whole-brain language networks. For the first time, these data show that cerebellar neuromodulation impacts activation patterns specifically during predictive language processing.

Cerebellar tDCS dissociates the timing of perceptual decisions from perceptual change in speech

Neuroimaging studies suggest that the cerebellum might play a role in both speech perception and speech perceptual learning. However, it remains unclear what this role is: does the cerebellum help shape the perceptual decision, or does it contribute to the timing of perceptual decisions? To test this, we used transcranial direct current stimulation (tDCS) in combination with a speech perception task. Participants experienced a series of speech perceptual tests designed to measure and then manipulate (via training) their perception of a phonetic contrast. One group received cerebellar tDCS during speech perceptual learning, and a different group received sham tDCS during the same task. Both groups showed similar learning-related changes in speech perception that transferred to a different phonetic contrast. For both trained and untrained speech perceptual decisions, cerebellar tDCS significantly increased the time it took participants to indicate their decisions with a keyboard press. By analyzing perceptual responses made by both hands, we present evidence that cerebellar tDCS disrupted the timing of perceptual decisions, while leaving the eventual decision unaltered. In support of this conclusion, we use the drift diffusion model to decompose the data into processes that determine the outcome of perceptual decision-making and those that do not. The modeling suggests that cerebellar tDCS disrupted processes unrelated to decision-making. Taken together, the empirical data and modeling demonstrate that right cerebellar tDCS dissociates the timing of perceptual decisions from perceptual change. The results provide initial evidence in healthy humans that the cerebellum critically contributes to speech timing in the perceptual domain.

The cerebellum, internal models and prediction in 'non-motor' aspects of language: A critical review

The emergence of studies on cerebellar contributions in 'non-motor' aspects of predictive language processing has long been awaited by researchers investigating the neural foundations of language and cognition. Despite (i) progress in research implicating the cerebellum in language processing, (ii) the widely-accepted nature of the uniform, multi-modal computation that the cerebellum implements in the form of internal models, as well as (iii) the long tradition of psycholinguistic studies addressing prediction mechanisms, research directly addressing cerebellar contributions to 'non-motor' predictive language processing has only surfaced in the last five years. This paper provides the first review of this novel field, along with a critical assessment of the studies conducted so far. While encouraging, the evidence for cerebellar involvement in 'non-motor' aspects of predictive language processing remains inconclusive under further scrutiny. Future directions are finally discussed with respect to outstanding questions in this novel field of research.

Dimension-Based Statistical Learning Affects Both Speech Perception and Production

Multiple acoustic dimensions signal speech categories. However, dimensions vary in their informativeness; some are more diagnostic of category membership than others. Speech categorization reflects these dimensional regularities such that diagnostic dimensions carry more "perceptual weight" and more effectively signal category membership to native listeners. Yet perceptual weights are malleable. When short-term experience deviates from long-term language norms, such as in a foreign accent, the perceptual weight of acoustic dimensions in signaling speech category membership rapidly adjusts. The present study investigated whether rapid adjustments in listeners' perceptual weights in response to speech that deviates from the norms also affects listeners' own speech productions. In a word recognition task, the correlation between two acoustic dimensions signaling consonant categories, fundamental frequency (F0) and voice onset time (VOT), matched the correlation typical of English, and then shifted to an "artificial accent" that reversed the relationship, and then shifted back. Brief, incidental exposure to the artificial accent caused participants to down-weight perceptual reliance on F0, consistent with previous research. Throughout the task, participants were intermittently prompted with pictures to produce these same words. In the block in which listeners heard the artificial accent with a reversed F0 × VOT correlation, F0 was a less robust cue to voicing in listeners' own speech productions. The statistical regularities of short-term speech input affect both speech perception and production, as evidenced via shifts in how acoustic dimensions are weighted.

Adaptive plasticity in speech perception: Effects of external information and internal predictions

When listeners encounter speech under adverse listening conditions, adaptive adjustments in perception can improve comprehension over time. In some cases, these adaptive changes require the presence of external information that disambiguates the distorted speech signals, whereas in other cases mere exposure is sufficient. Both external (e.g., written feedback) and internal (e.g., prior word knowledge) sources of information can be used to generate predictions about the correct mapping of a distorted speech signal. We hypothesize that these predictions provide a basis for determining the discrepancy between the expected and actual speech signal that can be used to guide adaptive changes in perception. This study provides the first empirical investigation that manipulates external and internal factors through (a) the availability of explicit external disambiguating information via the presence or absence of postresponse orthographic information paired with a repetition of the degraded stimulus, and (b) the accuracy of internally generated predictions; an acoustic distortion is introduced either abruptly or incrementally. The results demonstrate that the impact of external information on adaptive plasticity is contingent upon whether the intelligibility of the stimuli permits accurate internally generated predictions during exposure. External information sources enhance adaptive plasticity only when input signals are severely degraded and cannot reliably access internal predictions. This is consistent with a computational framework for adaptive plasticity in which error-driven supervised learning relies on the ability to compute sensory prediction error signals from both internal and external sources of information. (PsycINFO Database Record

Cerebellar contributions to motor control and language comprehension: searching for common computational principles

The past 25 years have seen the functional domain of the cerebellum extend beyond the realm of motor control, with considerable discussion of how this subcortical structure contributes to cognitive domains including attention, memory, and language. Drawing on evidence from neuroanatomy, physiology, neuropsychology, and computational work, sophisticated models have been developed to describe cerebellar function in sensorimotor control and learning. In contrast, mechanistic accounts of how the cerebellum contributes to cognition have remained elusive. Inspired by the homogeneous cerebellar microanatomy and a desire for parsimony, many researchers have sought to extend mechanistic ideas from motor control to cognition. One influential hypothesis centers on the idea that the cerebellum implements internal models, representations of the context-specific dynamics of an agent's interactions with the environment, enabling predictive control. We briefly review cerebellar anatomy and physiology, to review the internal model hypothesis as applied in the motor domain, before turning to extensions of these ideas in the linguistic domain, focusing on speech perception and semantic processing. While recent findings are consistent with this computational generalization, they also raise challenging questions regarding the nature of cerebellar learning, and may thus inspire revisions of our views on the role of the cerebellum in sensorimotor control.

An fMRI study investigating effects of conceptually related sentences on the perception of degraded speech

Prior research has shown that the perception of degraded speech is influenced by within sentence meaning and recruits one or more components of a frontal-temporal-parietal network. The goal of the current study is to examine whether the overall conceptual meaning of a sentence, made up of one set of words, influences the perception of a second acoustically degraded sentence, made up of a different set of words. Using functional magnetic resonance imaging (fMRI), we presented an acoustically clear sentence followed by an acoustically degraded sentence and manipulated the semantic relationship between them: Related in meaning (but consisting of different content words), Unrelated in meaning, or Same. Results showed that listeners' word recognition accuracy for the acoustically degraded sentences was significantly higher when the target sentence was preceded by a conceptually related compared to a conceptually unrelated sentence. Sensitivity to conceptual relationships was associated with enhanced activity in middle and inferior frontal, temporal, and parietal areas. In addition, the left middle frontal gyrus (LMFG), left inferior frontal gyrus (LIFG), and left middle temporal gyrus (LMTG) showed activity that correlated with individual performance on the Related condition. The superior temporal gyrus (STG) showed increased activation in the Same condition suggesting that it is sensitive to perceptual similarity rather than the integration of meaning between the sentence pairs. A fronto-temporo-parietal network appears to consolidate information sources across multiple levels of language (acoustic, lexical, syntactic, semantic) to build, and ultimately integrate conceptual information across sentences and facilitate the perception of a degraded speech signal. However, the nature of the sources of information that are available differentially recruit specific regions and modulate their activity within this network. Implications of these findings for the functional architecture of the network are considered.

Dimension-based statistical learning of vowels

Speech perception depends on long-term representations that reflect regularities of the native language. However, listeners rapidly adapt when speech acoustics deviate from these regularities due to talker idiosyncrasies such as foreign accents and dialects. To better understand these dual aspects of speech perception, we probe native English listeners' baseline perceptual weighting of 2 acoustic dimensions (spectral quality and vowel duration) toward vowel categorization and examine how they subsequently adapt to an "artificial accent" that deviates from English norms in the correlation between the 2 dimensions. At baseline, listeners rely relatively more on spectral quality than vowel duration to signal vowel category, but duration nonetheless contributes. Upon encountering an "artificial accent" in which the spectral-duration correlation is perturbed relative to English language norms, listeners rapidly down-weight reliance on duration. Listeners exhibit this type of short-term statistical learning even in the context of nonwords, confirming that lexical information is not necessary to this form of adaptive plasticity in speech perception. Moreover, learning generalizes to both novel lexical contexts and acoustically distinct altered voices. These findings are discussed in the context of a mechanistic proposal for how supervised learning may contribute to this type of adaptive plasticity in speech perception.

Spectral density affects the intelligibility of tone-vocoded speech: Implications for cochlear implant simulations

For small numbers of channels, tone vocoders using low envelope cutoff frequencies are less intelligible than noise vocoders, even though the noise carriers introduce random fluctuations into the crucial envelope information. Here it is shown that using tone carriers with a denser spectrum improves performance considerably over typical tone vocoders, at least equaling, and often surpassing, the performance possible with noise vocoders. In short, the spectral sparseness of tone vocoded sounds for low channel numbers, separate from the degradations introduced by using only a small number of channels, is an important limitation on the intelligibility of tone-vocoded speech.

Incidental learning of sound categories is impaired in developmental dyslexia

Developmental dyslexia is commonly thought to arise from specific phonological impairments. However, recent evidence is consistent with the possibility that phonological impairments arise as symptoms of an underlying dysfunction of procedural learning. The nature of the link between impaired procedural learning and phonological dysfunction is unresolved. Motivated by the observation that speech processing involves the acquisition of procedural category knowledge, the present study investigates the possibility that procedural learning impairment may affect phonological processing by interfering with the typical course of phonetic category learning. The present study tests this hypothesis while controlling for linguistic experience and possible speech-specific deficits by comparing auditory category learning across artificial, nonlinguistic sounds among dyslexic adults and matched controls in a specialized first-person shooter videogame that has been shown to engage procedural learning. Nonspeech auditory category learning was assessed online via within-game measures and also with a post-training task involving overt categorization of familiar and novel sound exemplars. Each measure reveals that dyslexic participants do not acquire procedural category knowledge as effectively as age- and cognitive-ability matched controls. This difference cannot be explained by differences in perceptual acuity for the sounds. Moreover, poor nonspeech category learning is associated with slower phonological processing. Whereas phonological processing impairments have been emphasized as the cause of dyslexia, the current results suggest that impaired auditory category learning, general in nature and not specific to speech signals, could contribute to phonological deficits in dyslexia with subsequent negative effects on language acquisition and reading. Implications for the neuro-cognitive mechanisms of developmental dyslexia are discussed.

Speech motor brain regions are differentially recruited during perception of native and foreign-accented phonemes for first and second language listeners

Brain imaging studies indicate that speech motor areas are recruited for auditory speech perception, especially when intelligibility is low due to environmental noise or when speech is accented. The purpose of the present study was to determine the relative contribution of brain regions to the processing of speech containing phonetic categories from one's own language, speech with accented samples of one's native phonetic categories, and speech with unfamiliar phonetic categories. To that end, native English and Japanese speakers identified the speech sounds /r/ and /l/ that were produced by native English speakers (unaccented) and Japanese speakers (foreign-accented) while functional magnetic resonance imaging measured their brain activity. For native English speakers, the Japanese accented speech was more difficult to categorize than the unaccented English speech. In contrast, Japanese speakers have difficulty distinguishing between /r/ and /l/, so both the Japanese accented and English unaccented speech were difficult to categorize. Brain regions involved with listening to foreign-accented productions of a first language included primarily the right cerebellum, left ventral inferior premotor cortex PMvi, and Broca's area. Brain regions most involved with listening to a second-language phonetic contrast (foreign-accented and unaccented productions) also included the left PMvi and the right cerebellum. Additionally, increased activity was observed in the right PMvi, the left and right ventral superior premotor cortex PMvs, and the left cerebellum. These results support a role for speech motor regions during the perception of foreign-accented native speech and for perception of difficult second-language phonetic contrasts.

Speech perception under adverse conditions: insights from behavioral, computational, and neuroscience research

Adult speech perception reflects the long-term regularities of the native language, but it is also flexible such that it accommodates and adapts to adverse listening conditions and short-term deviations from native-language norms. The purpose of this article is to examine how the broader neuroscience literature can inform and advance research efforts in understanding the neural basis of flexibility and adaptive plasticity in speech perception. Specifically, we highlight the potential role of learning algorithms that rely on prediction error signals and discuss specific neural structures that are likely to contribute to such learning. To this end, we review behavioral studies, computational accounts, and neuroimaging findings related to adaptive plasticity in speech perception. Already, a few studies have alluded to a potential role of these mechanisms in adaptive plasticity in speech perception. Furthermore, we consider research topics in neuroscience that offer insight into how perception can be adaptively tuned to short-term deviations while balancing the need to maintain stability in the perception of learned long-term regularities. Consideration of the application and limitations of these algorithms in characterizing flexible speech perception under adverse conditions promises to inform theoretical models of speech.