Increasing diversity of neural responses to speech sounds across the central auditory pathway

Perception of vocoded speech in domestic dogs

Humans have an impressive ability to comprehend signal-degraded speech; however, the extent to which comprehension of degraded speech relies on human-specific features of speech perception vs. more general cognitive processes is unknown. Since dogs live alongside humans and regularly hear speech, they can be used as a model to differentiate between these possibilities. One often-studied type of degraded speech is noise-vocoded speech (sometimes thought of as cochlear-implant-simulation speech). Noise-vocoded speech is made by dividing the speech signal into frequency bands (channels), identifying the amplitude envelope of each individual band, and then using these envelopes to modulate bands of noise centered over the same frequency regions - the result is a signal with preserved temporal cues, but vastly reduced frequency information. Here, we tested dogs' recognition of familiar words produced in 16-channel vocoded speech. In the first study, dogs heard their names and unfamiliar dogs' names (foils) in vocoded speech as well as natural speech. In the second study, dogs heard 16-channel vocoded speech only. Dogs listened longer to their vocoded name than vocoded foils in both experiments, showing that they can comprehend a 16-channel vocoded version of their name without prior exposure to vocoded speech, and without immediate exposure to the natural-speech version of their name. Dogs' name recognition in the second study was mediated by the number of phonemes in the dogs' name, suggesting that phonological context plays a role in degraded speech comprehension.

Characterization and closed-loop control of infrared thalamocortical stimulation produces spatially constrained single-unit responses

Deep brain stimulation (DBS) is a powerful tool for the treatment of circuitopathy-related neurological and psychiatric diseases and disorders such as Parkinson's disease and obsessive-compulsive disorder, as well as a critical research tool for perturbing neural circuits and exploring neuroprostheses. Electrically mediated DBS, however, is limited by the spread of stimulus currents into tissue unrelated to disease course and treatment, potentially causing undesirable patient side effects. In this work, we utilize infrared neural stimulation (INS), an optical neuromodulation technique that uses near to midinfrared light to drive graded excitatory and inhibitory responses in nerves and neurons, to facilitate an optical and spatially constrained DBS paradigm. INS has been shown to provide spatially constrained responses in cortical neurons and, unlike other optical techniques, does not require genetic modification of the neural target. We show that INS produces graded, biophysically relevant single-unit responses with robust information transfer in rat thalamocortical circuits. Importantly, we show that cortical spread of activation from thalamic INS produces more spatially constrained response profiles than conventional electrical stimulation. Owing to observed spatial precision of INS, we used deep reinforcement learning (RL) for closed-loop control of thalamocortical circuits, creating real-time representations of stimulus-response dynamics while driving cortical neurons to precise firing patterns. Our data suggest that INS can serve as a targeted and dynamic stimulation paradigm for both open and closed-loop DBS.

Intracranial electrophysiology of spectrally degraded speech in the human cortex

Introduction

Cochlear implants (CIs) are the treatment of choice for severe to profound hearing loss. Variability in CI outcomes remains despite advances in technology and is attributed in part to differences in cortical processing. Studying these differences in CI users is technically challenging. Spectrally degraded stimuli presented to normal-hearing individuals approximate input to the central auditory system in CI users. This study used intracranial electroencephalography (iEEG) to investigate cortical processing of spectrally degraded speech.

Methods

Participants were adult neurosurgical epilepsy patients. Stimuli were utterances /aba/ and /ada/, spectrally degraded using a noise vocoder (1-4 bands) or presented without vocoding. The stimuli were presented in a two-alternative forced choice task. Cortical activity was recorded using depth and subdural iEEG electrodes. Electrode coverage included auditory core in posteromedial Heschl's gyrus (HGPM), superior temporal gyrus (STG), ventral and dorsal auditory-related areas, and prefrontal and sensorimotor cortex. Analysis focused on high gamma (70-150 Hz) power augmentation and alpha (8-14 Hz) suppression.

Results

Chance task performance occurred with 1-2 spectral bands and was near-ceiling for clear stimuli. Performance was variable with 3-4 bands, permitting identification of good and poor performers. There was no relationship between task performance and participants demographic, audiometric, neuropsychological, or clinical profiles. Several response patterns were identified based on magnitude and differences between stimulus conditions. HGPM responded strongly to all stimuli. A preference for clear speech emerged within non-core auditory cortex. Good performers typically had strong responses to all stimuli along the dorsal stream, including posterior STG, supramarginal, and precentral gyrus; a minority of sites in STG and supramarginal gyrus had a preference for vocoded stimuli. In poor performers, responses were typically restricted to clear speech. Alpha suppression was more pronounced in good performers. In contrast, poor performers exhibited a greater involvement of posterior middle temporal gyrus when listening to clear speech.

Discussion

Responses to noise-vocoded speech provide insights into potential factors underlying CI outcome variability. The results emphasize differences in the balance of neural processing along the dorsal and ventral stream between good and poor performers, identify specific cortical regions that may have diagnostic and prognostic utility, and suggest potential targets for neuromodulation-based CI rehabilitation strategies.

Degraded inferior colliculus responses to complex sounds in prenatally exposed VPA rats

BACKGROUND

Individuals with autism spectrum disorders (ASD) often exhibit altered sensory processing and deficits in language development. Prenatal exposure to valproic acid (VPA) increases the risk for ASD and impairs both receptive and expressive language. Like individuals with ASD, rodents prenatally exposed to VPA exhibit degraded auditory cortical processing and abnormal neural activity to sounds. Disrupted neuronal morphology has been documented in earlier processing areas of the auditory pathway in VPA-exposed rodents, but there are no studies documenting early auditory pathway physiology. Therefore, the objective of this study is to characterize inferior colliculus (IC) responses to different sounds in rats prenatally exposed to VPA compared to saline-exposed rats.

METHODS

In vivo extracellular multiunit recordings from the inferior colliculus were collected in response to tones, speech sounds, and noise burst trains.

RESULTS

Our results indicate that the overall response to speech sounds was degraded in VPA-exposed rats compared to saline-exposed controls, but responses to tones and noise burst trains were unaltered.

CONCLUSIONS

These results are consistent with observations in individuals with autism that neural responses to complex sounds, like speech, are often altered, and lays the foundation for future studies of potential therapeutics to improve auditory processing in the VPA rat model of ASD.

Spatially specific, closed-loop infrared thalamocortical deep brain stimulation

Deep brain stimulation (DBS) is a powerful tool for the treatment of circuitopathy-related neurological and psychiatric diseases and disorders such as Parkinson's disease and obsessive-compulsive disorder, as well as a critical research tool for perturbing neural circuits and exploring neuroprostheses. Electrically-mediated DBS, however, is limited by the spread of stimulus currents into tissue unrelated to disease course and treatment, potentially causing undesirable patient side effects. In this work, we utilize infrared neural stimulation (INS), an optical neuromodulation technique that uses near to mid-infrared light to drive graded excitatory and inhibitory responses in nerves and neurons, to facilitate an optical and spatially constrained DBS paradigm. INS has been shown to provide spatially constrained responses in cortical neurons and, unlike other optical techniques, does not require genetic modification of the neural target. We show that INS produces graded, biophysically relevant single-unit responses with robust information transfer in thalamocortical circuits. Importantly, we show that cortical spread of activation from thalamic INS produces more spatially constrained response profiles than conventional electrical stimulation. Owing to observed spatial precision of INS, we used deep reinforcement learning for closed-loop control of thalamocortical circuits, creating real-time representations of stimulus-response dynamics while driving cortical neurons to precise firing patterns. Our data suggest that INS can serve as a targeted and dynamic stimulation paradigm for both open and closed-loop DBS.

Hybrid auditory fMRI: In pursuit of increasing data acquisition while decreasing the impact of scanner noise

BACKGROUND

Two challenges in auditory fMRI include the loud scanner noise during sound presentation and slow data acquisition. Here, we introduce a new auditory imaging protocol, termed "hybrid", that alleviates these obstacles.

NEW METHOD

We designed a within-subject experiment (N = 14) wherein language-driven activity was measured by hybrid, interleaved silent (ISSS), and continuous multiband acquisition. To determine the advantage of noise attenuation during sound presentation, hybrid was compared to multiband. To identify the benefits of increased temporal resolution, hybrid was compared to ISSS. Data were evaluated by whole-brain univariate general linear modeling (GLM) and multivariate pattern analysis (MVPA).

RESULTS

Comparison with existing methods: CONCLUSIONS: Our data revealed that hybrid imaging restored neural activity in the canonical language network that was absent due to the loud noise or slow sampling in the conventional imaging protocols. With its noise-attenuated sound presentation windows and increased acquisition speed, the hybrid protocol is well-suited for auditory fMRI research tracking neural activity pertaining to fast, time-varying acoustic events.

Pairing vagus nerve stimulation with tones drives plasticity across the auditory pathway

Previous studies have demonstrated that pairing vagus nerve stimulation (VNS) with sounds can enhance the primary auditory cortex (A1) response to the paired sound. The neural response to sounds following VNS-sound pairing in other subcortical and cortical auditory fields has not been documented. We predicted that VNS-tone pairing would increase neural responses to the paired tone frequency across the auditory pathway. In this study, we paired VNS with the presentation of a 9-kHz tone 300 times a day for 20 days. We recorded neural responses to tones from 2,950 sites in the inferior colliculus (IC), A1, anterior auditory field (AAF), and posterior auditory field (PAF) 24 h after the last pairing session in anesthetized rats. We found that VNS-tone pairing increased the percentage of IC, A1, AAF, and PAF that responds to the paired tone frequency. Across all tested auditory fields, the response strength to tones was strengthened in VNS-tone paired rats compared with control rats. VNS-tone pairing reduced spontaneous activity, frequency selectivity, and response threshold across the auditory pathway. This is the first study to document both cortical and subcortical plasticity following VNS-sound pairing. Our findings suggest that VNS paired with sound presentation is an effective method to enhance auditory processing.NEW & NOTEWORTHY Previous studies have reported primary auditory cortex plasticity following vagus nerve stimulation (VNS) paired with a sound. This study extends previous findings by documenting that fields across the auditory pathway are altered by VNS-tone pairing. VNS-tone pairing increases the percentage of each field that responds to the paired tone frequency. This is the first study to document both cortical and subcortical plasticity following VNS-sound pairing.

Mice can learn phonetic categories

Speech is perceived as a series of relatively invariant phonemes despite extreme variability in the acoustic signal. To be perceived as nearly-identical phonemes, speech sounds that vary continuously over a range of acoustic parameters must be perceptually discretized by the auditory system. Such many-to-one mappings of undifferentiated sensory information to a finite number of discrete categories are ubiquitous in perception. Although many mechanistic models of phonetic perception have been proposed, they remain largely unconstrained by neurobiological data. Current human neurophysiological methods lack the necessary spatiotemporal resolution to provide it: speech is too fast, and the neural circuitry involved is too small. This study demonstrates that mice are capable of learning generalizable phonetic categories, and can thus serve as a model for phonetic perception. Mice learned to discriminate consonants and generalized consonant identity across novel vowel contexts and speakers, consistent with true category learning. A mouse model, given the powerful genetic and electrophysiological tools for probing neural circuits available for them, has the potential to powerfully augment a mechanistic understanding of phonetic perception.

Temporal Coding of Voice Pitch Contours in Mandarin Tones

Accurate perception of time-variant pitch is important for speech recognition, particularly for tonal languages with different lexical tones such as Mandarin, in which different tones convey different semantic information. Previous studies reported that the auditory nerve and cochlear nucleus can encode different pitches through phase-locked neural activities. However, little is known about how the inferior colliculus (IC) encodes the time-variant periodicity pitch of natural speech. In this study, the Mandarin syllable /ba/ pronounced with four lexical tones (flat, rising, falling then rising and falling) were used as stimuli. Local field potentials (LFPs) and single neuron activity were simultaneously recorded from 90 sites within contralateral IC of six urethane-anesthetized and decerebrate guinea pigs in response to the four stimuli. Analysis of the temporal information of LFPs showed that 93% of the LFPs exhibited robust encoding of periodicity pitch. Pitch strength of LFPs derived from the autocorrelogram was significantly (p < 0.001) stronger for rising tones than flat and falling tones. Pitch strength are also significantly increased (p < 0.05) with the characteristic frequency (CF). On the other hand, only 47% (42 or 90) of single neuron activities were significantly synchronized to the fundamental frequency of the stimulus suggesting that the temporal spiking pattern of single IC neuron could encode the time variant periodicity pitch of speech robustly. The difference between the number of LFPs and single neurons that encode the time-variant F0 voice pitch supports the notion of a transition at the level of IC from direct temporal coding in the spike trains of individual neurons to other form of neural representation.

Individual Differences in Human Auditory Processing: Insights From Single-Trial Auditory Midbrain Activity in an Animal Model

Auditory-evoked potentials are classically defined as the summations of synchronous firing along the auditory neuraxis. Converging evidence supports a model whereby timing jitter in neural coding compromises listening and causes variable scalp-recorded potentials. Yet the intrinsic noise of human scalp recordings precludes a full understanding of the biological origins of individual differences in listening skills. To delineate the mechanisms contributing to these phenomena, in vivo extracellular activity was recorded from inferior colliculus in guinea pigs to speech in quiet and noise. Here we show that trial-by-trial timing jitter is a mechanism contributing to auditory response variability. Identical variability patterns were observed in scalp recordings in human children, implicating jittered timing as a factor underlying reduced coding of dynamic speech features and speech in noise. Moreover, intertrial variability in human listeners is tied to language development. Together, these findings suggest that variable timing in inferior colliculus blurs the neural coding of speech in noise, and propose a consequence of this timing jitter for human behavior. These results hint both at the mechanisms underlying speech processing in general, and at what may go awry in individuals with listening difficulties.

Neural representation of different mandarin tones in the inferior colliculus of the guinea pig

Mandarin speech has four different tones and the coding mechanism underlying tone identification still remain unclear. Here in the inferior colliculus (IC) of anesthetized guinea pigs, we recorded single neuron activities to one word with four tones using tungsten electrode. Peri-stimulus time histograms (PSTHs) and inter-spike-interval (ISI) were used to evaluate the neural response. The results showed that PSTHs grouped into frequency band reflected the spectrotemporal patterns of different tones; average population PSTHs matched envelops of different tones; and the peaks of histogram of ISIs in three time segments exhibited a displacement which reflected the profile of fundamental frequency (F0). These preliminary results suggested IC neurons could encode the spectrotemporal acoustic features of different Mandarin tones.

Speech training alters consonant and vowel responses in multiple auditory cortex fields

Speech sounds evoke unique neural activity patterns in primary auditory cortex (A1). Extensive speech sound discrimination training alters A1 responses. While the neighboring auditory cortical fields each contain information about speech sound identity, each field processes speech sounds differently. We hypothesized that while all fields would exhibit training-induced plasticity following speech training, there would be unique differences in how each field changes. In this study, rats were trained to discriminate speech sounds by consonant or vowel in quiet and in varying levels of background speech-shaped noise. Local field potential and multiunit responses were recorded from four auditory cortex fields in rats that had received 10 weeks of speech discrimination training. Our results reveal that training alters speech evoked responses in each of the auditory fields tested. The neural response to consonants was significantly stronger in anterior auditory field (AAF) and A1 following speech training. The neural response to vowels following speech training was significantly weaker in ventral auditory field (VAF) and posterior auditory field (PAF). This differential plasticity of consonant and vowel sound responses may result from the greater paired pulse depression, expanded low frequency tuning, reduced frequency selectivity, and lower tone thresholds, which occurred across the four auditory fields. These findings suggest that alterations in the distributed processing of behaviorally relevant sounds may contribute to robust speech discrimination.

Degraded speech sound processing in a rat model of fragile X syndrome

Fragile X syndrome is the most common inherited form of intellectual disability and the leading genetic cause of autism. Impaired phonological processing in fragile X syndrome interferes with the development of language skills. Although auditory cortex responses are known to be abnormal in fragile X syndrome, it is not clear how these differences impact speech sound processing. This study provides the first evidence that the cortical representation of speech sounds is impaired in Fmr1 knockout rats, despite normal speech discrimination behavior. Evoked potentials and spiking activity in response to speech sounds, noise burst trains, and tones were significantly degraded in primary auditory cortex, anterior auditory field and the ventral auditory field. Neurometric analysis of speech evoked activity using a pattern classifier confirmed that activity in these fields contains significantly less information about speech sound identity in Fmr1 knockout rats compared to control rats. Responses were normal in the posterior auditory field, which is associated with sound localization. The greatest impairment was observed in the ventral auditory field, which is related to emotional regulation. Dysfunction in the ventral auditory field may contribute to poor emotional regulation in fragile X syndrome and may help explain the observation that later auditory evoked responses are more disturbed in fragile X syndrome compared to earlier responses. Rodent models of fragile X syndrome are likely to prove useful for understanding the biological basis of fragile X syndrome and for testing candidate therapies.

Similarity of cortical activity patterns predicts generalization behavior

Humans and animals readily generalize previously learned knowledge to new situations. Determining similarity is critical for assigning category membership to a novel stimulus. We tested the hypothesis that category membership is initially encoded by the similarity of the activity pattern evoked by a novel stimulus to the patterns from known categories. We provide behavioral and neurophysiological evidence that activity patterns in primary auditory cortex contain sufficient information to explain behavioral categorization of novel speech sounds by rats. Our results suggest that category membership might be encoded by the similarity of the activity pattern evoked by a novel speech sound to the patterns evoked by known sounds. Categorization based on featureless pattern matching may represent a general neural mechanism for ensuring accurate generalization across sensory and cognitive systems.