Facilitation of inferior frontal cortex by transcranial direct current stimulation induces perceptual learning of severely degraded speech

Speech perception following transcranial direct current stimulation (tDCS) over left superior temporal gyrus (STG) (including Wernicke's area) versus inferior frontal gyrus (IFG) (including Broca's area)

Imaging and neurocognitive studies have searched for the brain areas involved in speech perception, specifically when speech is accompanied by noise, attempting to identify the underlying neural mechanism(s). Transcranial direct current stimulation (tDCS), a noninvasive, painless cortical neuromodulation technique, has been used to either excite or inhibit brain activity in order to better understand the neural mechanism underlying speech perception in noise. In the present study, anodal (excitatory) and cathodal (inhibitory) stimulations were performed on 48 participants, either over the left Inferior Frontal Gyrus (IFG), which includes Broca's area (n = 10 anodal, and n = 10 cathodal) or over the left Superior Temporal Gyrus (STG), which includes Wernicke's area (n = 13 anodal, n = 15 cathodal). Speech perception was measured using a sentence recognition task accompanied by white noise with a signal-to-noise ratio of -10 dB. Speech perception performance was measured four times: at baseline, after each of the two sessions of stimulation (one active and one sham session, the order of which was randomized between participants), and at a two-week follow-up session. Groups receiving anodal and cathodal stimulation over the left IFG did not show an effect of stimulation type. For groups receiving left STG stimulation, anodal stimulation resulted in higher scores, regardless of whether it was given before or after sham stimulation. However, cathodal stimulation showed an effect only when active stimulation was applied following sham stimulation. These results showed that tDCS had a direct effect on improving speech perception only over left STG. Furthermore, while anodal stimulation was effective in whatever order it was given, cathodal stimulation was effective only following sham stimulation, thereby allowing some amount of training. These findings carry both theoretical and clinical implications for the relationship between the DMN's left IFG and left STG areas during speech perception accompanied by background noise.

Automatic imitation of speech is enhanced for non-native sounds

Simulation accounts of speech perception posit that speech is covertly imitated to support perception in a top-down manner. Behaviourally, covert imitation is measured through the stimulus-response compatibility (SRC) task. In each trial of a speech SRC task, participants produce a target speech sound whilst perceiving a speech distractor that either matches the target (compatible condition) or does not (incompatible condition). The degree to which the distractor is covertly imitated is captured by the automatic imitation effect, computed as the difference in response times (RTs) between compatible and incompatible trials. Simulation accounts disagree on whether covert imitation is enhanced when speech perception is challenging or instead when the speech signal is most familiar to the speaker. To test these accounts, we conducted three experiments in which participants completed SRC tasks with native and non-native sounds. Experiment 1 uncovered larger automatic imitation effects in an SRC task with non-native sounds than with native sounds. Experiment 2 replicated the finding online, demonstrating its robustness and the applicability of speech SRC tasks online. Experiment 3 intermixed native and non-native sounds within a single SRC task to disentangle effects of perceiving non-native sounds from confounding effects of producing non-native speech actions. This last experiment confirmed that automatic imitation is enhanced for non-native speech distractors, supporting a compensatory function of covert imitation in speech perception. The experiment also uncovered a separate effect of producing non-native speech actions on enhancing automatic imitation effects.

How does the human brain process noisy speech in real life? Insights from the second-person neuroscience perspective

Comprehending speech with the existence of background noise is of great importance for human life. In the past decades, a large number of psychological, cognitive and neuroscientific research has explored the neurocognitive mechanisms of speech-in-noise comprehension. However, as limited by the low ecological validity of the speech stimuli and the experimental paradigm, as well as the inadequate attention on the high-order linguistic and extralinguistic processes, there remains much unknown about how the brain processes noisy speech in real-life scenarios. A recently emerging approach, i.e., the second-person neuroscience approach, provides a novel conceptual framework. It measures both of the speaker's and the listener's neural activities, and estimates the speaker-listener neural coupling with regarding of the speaker's production-related neural activity as a standardized reference. The second-person approach not only promotes the use of naturalistic speech but also allows for free communication between speaker and listener as in a close-to-life context. In this review, we first briefly review the previous discoveries about how the brain processes speech in noise; then, we introduce the principles and advantages of the second-person neuroscience approach and discuss its implications to unravel the linguistic and extralinguistic processes during speech-in-noise comprehension; finally, we conclude by proposing some critical issues and calls for more research interests in the second-person approach, which would further extend the present knowledge about how people comprehend speech in noise.

Cocktail party training induces increased speech intelligibility and decreased cortical activity in bilateral inferior frontal gyri. A functional near-infrared study

The human brain networks responsible for selectively listening to a voice amid other talkers remain to be clarified. The present study aimed to investigate relationships between cortical activity and performance in a speech-in-speech task, before (Experiment I) and after training-induced improvements (Experiment II). In Experiment I, 74 participants performed a speech-in-speech task while their cortical activity was measured using a functional near infrared spectroscopy (fNIRS) device. One target talker and one masker talker were simultaneously presented at three different target-to-masker ratios (TMRs): adverse, intermediate and favorable. Behavioral results show that performance may increase monotonically with TMR in some participants and failed to decrease, or even improved, in the adverse-TMR condition for others. On the neural level, an extensive brain network including the frontal (left prefrontal cortex, right dorsolateral prefrontal cortex and bilateral inferior frontal gyri) and temporal (bilateral auditory cortex) regions was more solicited by the intermediate condition than the two others. Additionally, bilateral frontal gyri and left auditory cortex activities were found to be positively correlated with behavioral performance in the adverse-TMR condition. In Experiment II, 27 participants, whose performance was the poorest in the adverse-TMR condition of Experiment I, were trained to improve performance in that condition. Results show significant performance improvements along with decreased activity in bilateral inferior frontal gyri, the right dorsolateral prefrontal cortex, the left inferior parietal cortex and the right auditory cortex in the adverse-TMR condition after training. Arguably, lower neural activity reflects higher efficiency in processing masker inhibition after speech-in-speech training. As speech-in-noise tasks also imply frontal and temporal regions, we suggest that regardless of the type of masking (speech or noise) the complexity of the task will prompt the implication of a similar brain network. Furthermore, the initial significant cognitive recruitment will be reduced following a training leading to an economy of cognitive resources.

Speaker-listener neural coupling reveals a right-lateralized mechanism for non-native speech-in-noise comprehension

While the increasingly globalized world has brought more and more demands for non-native language communication, the prevalence of background noise in everyday life poses a great challenge to non-native speech comprehension. The present study employed an interbrain approach based on functional near-infrared spectroscopy (fNIRS) to explore how people adapt to comprehend non-native speech information in noise. A group of Korean participants who acquired Chinese as their non-native language was invited to listen to Chinese narratives at 4 noise levels (no noise, 2 dB, -6 dB, and - 9 dB). These narratives were real-life stories spoken by native Chinese speakers. Processing of the non-native speech was associated with significant fNIRS-based listener-speaker neural couplings mainly over the right hemisphere at both the listener's and the speaker's sides. More importantly, the neural couplings from the listener's right superior temporal gyrus, the right middle temporal gyrus, as well as the right postcentral gyrus were found to be positively correlated with their individual comprehension performance at the strongest noise level (-9 dB). These results provide interbrain evidence in support of the right-lateralized mechanism for non-native speech processing and suggest that both an auditory-based and a sensorimotor-based mechanism contributed to the non-native speech-in-noise comprehension.

Processing of Degraded Speech in Brain Disorders

The speech we hear every day is typically "degraded" by competing sounds and the idiosyncratic vocal characteristics of individual speakers. While the comprehension of "degraded" speech is normally automatic, it depends on dynamic and adaptive processing across distributed neural networks. This presents the brain with an immense computational challenge, making degraded speech processing vulnerable to a range of brain disorders. Therefore, it is likely to be a sensitive marker of neural circuit dysfunction and an index of retained neural plasticity. Considering experimental methods for studying degraded speech and factors that affect its processing in healthy individuals, we review the evidence for altered degraded speech processing in major neurodegenerative diseases, traumatic brain injury and stroke. We develop a predictive coding framework for understanding deficits of degraded speech processing in these disorders, focussing on the "language-led dementias"-the primary progressive aphasias. We conclude by considering prospects for using degraded speech as a probe of language network pathophysiology, a diagnostic tool and a target for therapeutic intervention.

Boosting Learning Efficacy with Noninvasive Brain Stimulation in Intact and Brain-Damaged Humans

Numerous behavioral studies have shown that visual function can improve with training, although perceptual refinements generally require weeks to months of training to attain. This, along with questions about long-term retention of learning, limits practical and clinical applications of many such paradigms. Here, we show for the first time in female and male human participants that just 10 d of visual training coupled with transcranial random noise stimulation (tRNS) over visual areas causes dramatic improvements in visual motion perception. Relative to control conditions and anodal stimulation, tRNS-enhanced learning was at least twice as fast, and, crucially, it persisted for 6 months after the end of training and stimulation. Notably, tRNS also boosted learning in patients with chronic cortical blindness, leading to recovery of motion processing in the blind field after just 10 d of training, a period too short to elicit enhancements with training alone. In sum, our results reveal a remarkable enhancement of the capacity for long-lasting plastic and restorative changes when a neuromodulatory intervention is coupled with visual training.SIGNIFICANCE STATEMENT Our work demonstrates that visual training coupled with brain stimulation can dramatically reduce the training period from months to weeks, and lead to fast improvement in neurotypical subjects and chronic cortically blind patients, indicating the potential of our procedure to help restore damaged visual abilities for currently untreatable visual dysfunctions. Together, these results indicate the critical role of early visual areas in perceptual learning and reveal its capacity for long-lasting plastic changes promoted by neuromodulatory intervention.

Listening under difficult conditions: An activation likelihood estimation meta-analysis

The brain networks supporting speech identification and comprehension under difficult listening conditions are not well specified. The networks hypothesized to underlie effortful listening include regions responsible for executive control. We conducted meta-analyses of auditory neuroimaging studies to determine whether a common activation pattern of the frontal lobe supports effortful listening under different speech manipulations. Fifty-three functional neuroimaging studies investigating speech perception were divided into three independent Activation Likelihood Estimate analyses based on the type of speech manipulation paradigm used: Speech-in-noise (SIN, 16 studies, involving 224 participants); spectrally degraded speech using filtering techniques (15 studies involving 270 participants); and linguistic complexity (i.e., levels of syntactic, lexical and semantic intricacy/density, 22 studies, involving 348 participants). Meta-analysis of the SIN studies revealed higher effort was associated with activation in left inferior frontal gyrus (IFG), left inferior parietal lobule, and right insula. Studies using spectrally degraded speech demonstrated increased activation of the insula bilaterally and the left superior temporal gyrus (STG). Studies manipulating linguistic complexity showed activation in the left IFG, right middle frontal gyrus, left middle temporal gyrus and bilateral STG. Planned contrasts revealed left IFG activation in linguistic complexity studies, which differed from activation patterns observed in SIN or spectral degradation studies. Although there were no significant overlap in prefrontal activation across these three speech manipulation paradigms, SIN and spectral degradation showed overlapping regions in left and right insula. These findings provide evidence that there is regional specialization within the left IFG and differential executive networks underlie effortful listening.

Transcranial electric stimulation for the investigation of speech perception and comprehension

Transcranial electric stimulation (tES), comprising transcranial direct current stimulation (tDCS) and transcranial alternating current stimulation (tACS), involves applying weak electrical current to the scalp, which can be used to modulate membrane potentials and thereby modify neural activity. Critically, behavioural or perceptual consequences of this modulation provide evidence for a causal role of neural activity in the stimulated brain region for the observed outcome. We present tES as a tool for the investigation of which neural responses are necessary for successful speech perception and comprehension. We summarise existing studies, along with challenges that need to be overcome, potential solutions, and future directions. We conclude that, although standardised stimulation parameters still need to be established, tES is a promising tool for revealing the neural basis of speech processing. Future research can use this method to explore the causal role of brain regions and neural processes for the perception and comprehension of speech.

The hearing ear is always found close to the speaking tongue: Review of the role of the motor system in speech perception

Does "the motor system" play "a role" in speech perception? If so, where, how, and when? We conducted a systematic review that addresses these questions using both qualitative and quantitative methods. The qualitative review of behavioural, computational modelling, non-human animal, brain damage/disorder, electrical stimulation/recording, and neuroimaging research suggests that distributed brain regions involved in producing speech play specific, dynamic, and contextually determined roles in speech perception. The quantitative review employed region and network based neuroimaging meta-analyses and a novel text mining method to describe relative contributions of nodes in distributed brain networks. Supporting the qualitative review, results show a specific functional correspondence between regions involved in non-linguistic movement of the articulators, covertly and overtly producing speech, and the perception of both nonword and word sounds. This distributed set of cortical and subcortical speech production regions are ubiquitously active and form multiple networks whose topologies dynamically change with listening context. Results are inconsistent with motor and acoustic only models of speech perception and classical and contemporary dual-stream models of the organization of language and the brain. Instead, results are more consistent with complex network models in which multiple speech production related networks and subnetworks dynamically self-organize to constrain interpretation of indeterminant acoustic patterns as listening context requires.

The surprising temporal specificity of direct-current stimulation

As studies increasingly use transcranial direct-current stimulation (tDCS) to manipulate brain activity, surprising results are emerging. Specifically, research combining tDCS with electrophysiology is showing that the long-lasting effects of tDCS can counter-intuitively influence specific neural mechanisms active for as little as 100 ms during the flow of human information processing.

Transcranial direct current stimulation (tDCS) of frontal cortex decreases performance on the WAIS-IV intelligence test

Transcranial direct current stimulation (tDCS) modulates excitability of motor cortex. However, there is conflicting evidence about the efficacy of this non-invasive brain stimulation modality to modulate performance on cognitive tasks. Previous work has tested the effect of tDCS on specific facets of cognition and executive processing. However, no randomized, double-blind, sham-controlled study has looked at the effects of tDCS on a comprehensive battery of cognitive processes. The objective of this study was to test if tDCS had an effect on performance on a comprehensive assay of cognitive processes, a standardized intelligence quotient (IQ) test. The study consisted of two substudies and followed a double-blind, between-subjects, sham-controlled design. In total, 41 healthy adult participants were included in the final analysis. These participants completed the Wechsler Adult Intelligence Scale, Fourth Edition (WAIS-IV) as a baseline measure. At least one week later, participants in substudy 1 received either bilateral tDCS (anodes over both F4 and F3, cathode over Cz, 2 mA at each anode for 20 min) or active sham tDCS (2 mA for 40 s), and participants in substudy 2 received either right or left tDCS (anode over either F4 or F3, cathode over Cz, 2 mA for 20 min). In both studies, the WAIS-IV was immediately administered following stimulation to assess for performance differences induced by bilateral and unilateral tDCS. Compared to sham stimulation, right, left, and bilateral tDCS reduced improvement between sessions on Full Scale IQ and the Perceptual Reasoning Index. This demonstration that frontal tDCS selectively degraded improvement on specific metrics of the WAIS-IV raises important questions about the often proposed role of tDCS in cognitive enhancement.

Repetitive transcranial magnetic stimulation over left angular gyrus modulates the predictability gain in degraded speech comprehension

Increased neural activity in left angular gyrus (AG) accompanies successful comprehension of acoustically degraded but highly predictable sentences, as previous functional imaging studies have shown. However, it remains unclear whether the left AG is causally relevant for the comprehension of degraded speech. Here, we applied transient virtual lesions to either the left AG or superior parietal lobe (SPL, as a control area) with repetitive transcranial magnetic stimulation (rTMS) while healthy volunteers listened to and repeated sentences with high- versus low-predictable endings and different noise vocoding levels. We expected that rTMS of AG should selectively modulate the predictability gain (i.e., the comprehension benefit from sentences with high-predictable endings) at a medium degradation level. We found that rTMS of AG indeed reduced the predictability gain at a medium degradation level of 4-band noise vocoding (relative to control rTMS of SPL). In contrast, the behavioral perturbation induced by rTMS changed with increased signal quality. Hence, at 8-band noise vocoding, rTMS over AG versus SPL decreased the number of correctly repeated keywords for sentences with low-predictable endings. Together, these results show that the degree of the rTMS interference depended jointly on signal quality and predictability. Our results provide the first causal evidence that the left AG is a critical node for facilitating speech comprehension in challenging listening conditions.

Emergence of category-level sensitivities in non-native speech sound learning

Over the course of development, speech sounds that are contrastive in one's native language tend to become perceived categorically: that is, listeners are unaware of variation within phonetic categories while showing excellent sensitivity to speech sounds that span linguistically meaningful phonetic category boundaries. The end stage of this developmental process is that the perceptual systems that handle acoustic-phonetic information show special tuning to native language contrasts, and as such, category-level information appears to be present at even fairly low levels of the neural processing stream. Research on adults acquiring non-native speech categories offers an avenue for investigating the interplay of category-level information and perceptual sensitivities to these sounds as speech categories emerge. In particular, one can observe the neural changes that unfold as listeners learn not only to perceive acoustic distinctions that mark non-native speech sound contrasts, but also to map these distinctions onto category-level representations. An emergent literature on the neural basis of novel and non-native speech sound learning offers new insight into this question. In this review, I will examine this literature in order to answer two key questions. First, where in the neural pathway does sensitivity to category-level phonetic information first emerge over the trajectory of speech sound learning? Second, how do frontal and temporal brain areas work in concert over the course of non-native speech sound learning? Finally, in the context of this literature I will describe a model of speech sound learning in which rapidly-adapting access to categorical information in the frontal lobes modulates the sensitivity of stable, slowly-adapting responses in the temporal lobes.