Functional asymmetries in the representation of noise-vocoded speech

Sensory temporal sampling in time: an integrated model of the TSF and neural noise hypothesis as an etiological pathway for dyslexia

Much progress has been made in research on the causal mechanisms of developmental dyslexia. In recent years, the "temporal sampling" account of dyslexia has evolved considerably, with contributions from neurogenetics and novel imaging methods resulting in a much more complex etiological view of the disorder. The original temporal sampling framework implicates disrupted neural entrainment to speech as a causal factor for atypical phonological representations. Yet, empirical findings have not provided clear evidence of a low-level etiology for this endophenotype. In contrast, the neural noise hypothesis presents a theoretical view of the manifestation of dyslexia from the level of genes to behavior. However, its relative novelty (published in 2017) means that empirical research focused on specific predictions is sparse. The current paper reviews dyslexia research using a dual framework from the temporal sampling and neural noise hypotheses and discusses the complementary nature of these two views of dyslexia. We present an argument for an integrated model of sensory temporal sampling as an etiological pathway for dyslexia. Finally, we conclude with a brief discussion of outstanding questions.

Spectrotemporal modulation provides a unifying framework for auditory cortical asymmetries

The principles underlying functional asymmetries in cortex remain debated. For example, it is accepted that speech is processed bilaterally in auditory cortex, but a left hemisphere dominance emerges when the input is interpreted linguistically. The mechanisms, however, are contested: what sound features or processing principles underlie laterality? Recent findings across species (humans, canines, bats) provide converging evidence that spectrotemporal sound features drive asymmetrical responses. Typically, accounts invoke models wherein the hemispheres differ in time-frequency resolution or integration window size. We develop a framework that builds on and unifies prevailing models, using spectrotemporal modulation space. Using signal processing techniques motivated by neural responses, we test this approach employing behavioral and neurophysiological measures. We show how psychophysical judgments align with spectrotemporal modulations and then characterize the neural sensitivities to temporal and spectral modulations. We demonstrate differential contributions from both hemispheres, with a left lateralization for temporal modulations and a weaker right lateralization for spectral modulations. We argue that representations in the modulation domain provide a more mechanistic basis to account for lateralization in auditory cortex.

Amplitude modulation rate dependent topographic organization of the auditory steady-state response in human auditory cortex

Periodic modulations of an acoustic feature, such as amplitude over a certain frequency range, leads to phase locking of neural responses to the envelope of the modulation. Using electrophysiological methods this neural activity pattern, also called the auditory steady-state response (aSSR), is visible following frequency transformation of the evoked response as a clear spectral peak at the modulation frequency. Despite several studies employing the aSSR that show, for example, strongest responses for ∼40 Hz and an overall right-hemispheric dominance, it has not been investigated so far to what extent within auditory cortex different modulation frequencies elicit aSSRs at a homogenous source or whether the localization of the aSSR is topographically organized in a systematic manner. The latter would be suggested by previous neuroimaging works in monkeys and humans showing a periodotopic organization within and across distinct auditory fields. However, the sluggishness of the signal from these neuroimaging works prohibit inferences with regards to the fine-temporal features of the neural response. In the present study, we employed amplitude-modulated (AM) sounds over a range between 4 and 85 Hz to elicit aSSRs while recording brain activity via magnetoencephalography (MEG). Using beamforming and a fine spatially resolved grid restricted to auditory cortical processing regions, our study revealed a topographic representation of the aSSR that depends on AM rate, in particular in the medial-lateral (bilateral) and posterior-anterior (right auditory cortex) direction. In summary, our findings confirm previous studies that showing different AM rates to elicit maximal response in distinct neural populations. They extend these findings however by also showing that these respective neural ensembles in auditory cortex actually phase lock their activity over a wide modulation frequency range.

Evaluating signal-correlated noise as a control task with language-related gamma activity on electrocorticography

OBJECTIVE

Our recent electrocorticography (ECoG) study suggested reverse speech, a widely used control task, to be a poor control for non-language-related auditory activity. We hypothesized that this may be due to retained perception as a human voice. We report a follow-up ECoG study in which we contrast forward and reverse speech with a signal-correlated noise (SCN) control task that cannot be perceived as a human voice.

METHODS

Ten patients were presented 90 audible stimuli, including 30 each of corresponding forward speech, reverse speech, and SCN trials, during ECoG recording with evaluation of gamma activity between 50 and 150 Hz.

RESULTS

Sites of the lateral temporal gyri activated throughout speech stimuli were generally less activated by SCN, while some temporal sites seemed to process both human and non-human sounds. Reverse speech trials were associated with activities across the temporal lobe similar to those associated with forward speech.

CONCLUSIONS

Findings herein externally validate functional neuroimaging studies utilizing SCN as a control for non-language-specific auditory function. Our findings are consistent with the notion that stimuli perceived as originating from a human voice are poor controls for non-language auditory function.

SIGNIFICANCE

Our findings have implications in functional neuroimaging research as well as improved clinical mapping of auditory functions.

Do temporal processes underlie left hemisphere dominance in speech perception?

It is not unusual to find it stated as a fact that the left hemisphere is specialized for the processing of rapid, or temporal aspects of sound, and that the dominance of the left hemisphere in the perception of speech can be a consequence of this specialization. In this review we explore the history of this claim and assess the weight of this assumption. We will demonstrate that instead of a supposed sensitivity of the left temporal lobe for the acoustic properties of speech, it is the right temporal lobe which shows a marked preference for certain properties of sounds, for example longer durations, or variations in pitch. We finish by outlining some alternative factors that contribute to the left lateralization of speech perception.

Suppression of competing speech through entrainment of cortical oscillations

People are highly skilled at attending to one speaker in the presence of competitors, but the neural mechanisms supporting this remain unclear. Recent studies have argued that the auditory system enhances the gain of a speech stream relative to competitors by entraining (or "phase-locking") to the rhythmic structure in its acoustic envelope, thus ensuring that syllables arrive during periods of high neuronal excitability. We hypothesized that such a mechanism could also suppress a competing speech stream by ensuring that syllables arrive during periods of low neuronal excitability. To test this, we analyzed high-density EEG recorded from human adults while they attended to one of two competing, naturalistic speech streams. By calculating the cross-correlation between the EEG channels and the speech envelopes, we found evidence of entrainment to the attended speech's acoustic envelope as well as weaker yet significant entrainment to the unattended speech's envelope. An independent component analysis (ICA) decomposition of the data revealed sources in the posterior temporal cortices that displayed robust correlations to both the attended and unattended envelopes. Critically, in these components the signs of the correlations when attended were opposite those when unattended, consistent with the hypothesized entrainment-based suppressive mechanism.

Language development after cochlear implantation: an epigenetic model

Growing evidence supports the notion that dynamic gene expression, subject to epigenetic control, organizes multiple influences to enable a child to learn to listen and to talk. Here, we review neurobiological and genetic influences on spoken language development in the context of results of a longitudinal trial of cochlear implantation of young children with severe to profound sensorineural hearing loss in the Childhood Development after Cochlear Implantation study. We specifically examine the results of cochlear implantation in participants who were congenitally deaf (N = 116). Prior to intervention, these participants were subject to naturally imposed constraints in sensory (acoustic-phonologic) inputs during critical phases of development when spoken language skills are typically achieved rapidly. Their candidacy for a cochlear implant was prompted by delays (n = 20) or an essential absence of spoken language acquisition (n = 96). Observations thus present an opportunity to evaluate the impact of factors that influence the emergence of spoken language, particularly in the context of hearing restoration in sensitive periods for language acquisition. Outcomes demonstrate considerable variation in spoken language learning, although significant advantages exist for the congenitally deaf children implanted prior to 18 months of age. While age at implantation carries high predictive value in forecasting performance on measures of spoken language, several factors show significant association, particularly those related to parent-child interactions. Importantly, the significance of environmental variables in their predictive value for language development varies with age at implantation. These observations are considered in the context of an epigenetic model in which dynamic genomic expression can modulate aspects of auditory learning, offering insights into factors that can influence a child's acquisition of spoken language after cochlear implantation. Increased understanding of these interactions could lead to targeted interventions that interact with the epigenome to influence language outcomes with intervention, particularly in periods in which development is subject to time-sensitive experience.

Neural coding of continuous speech in auditory cortex during monaural and dichotic listening

The cortical representation of the acoustic features of continuous speech is the foundation of speech perception. In this study, noninvasive magnetoencephalography (MEG) recordings are obtained from human subjects actively listening to spoken narratives, in both simple and cocktail party-like auditory scenes. By modeling how acoustic features of speech are encoded in ongoing MEG activity as a spectrotemporal response function, we demonstrate that the slow temporal modulations of speech in a broad spectral region are represented bilaterally in auditory cortex by a phase-locked temporal code. For speech presented monaurally to either ear, this phase-locked response is always more faithful in the right hemisphere, but with a shorter latency in the hemisphere contralateral to the stimulated ear. When different spoken narratives are presented to each ear simultaneously (dichotic listening), the resulting cortical neural activity precisely encodes the acoustic features of both of the spoken narratives, but slightly weakened and delayed compared with the monaural response. Critically, the early sensory response to the attended speech is considerably stronger than that to the unattended speech, demonstrating top-down attentional gain control. This attentional gain is substantial even during the subjects' very first exposure to the speech mixture and therefore largely independent of knowledge of the speech content. Together, these findings characterize how the spectrotemporal features of speech are encoded in human auditory cortex and establish a single-trial-based paradigm to study the neural basis underlying the cocktail party phenomenon.