Bilateral speech comprehension reflects differential sensitivity to spectral and temporal features

Linguistic modulation of the neural encoding of phonemes

Speech comprehension entails the neural mapping of the acoustic speech signal onto learned linguistic units. This acousto-linguistic transformation is bi-directional, whereby higher-level linguistic processes (e.g. semantics) modulate the acoustic analysis of individual linguistic units. Here, we investigated the cortical topography and linguistic modulation of the most fundamental linguistic unit, the phoneme. We presented natural speech and "phoneme quilts" (pseudo-randomly shuffled phonemes) in either a familiar (English) or unfamiliar (Korean) language to native English speakers while recording functional magnetic resonance imaging. This allowed us to dissociate the contribution of acoustic vs. linguistic processes toward phoneme analysis. We show that (i) the acoustic analysis of phonemes is modulated by linguistic analysis and (ii) that for this modulation, both of acoustic and phonetic information need to be incorporated. These results suggest that the linguistic modulation of cortical sensitivity to phoneme classes minimizes prediction error during natural speech perception, thereby aiding speech comprehension in challenging listening situations.

tDCS of right-hemispheric Wernicke's area homologue affects contextual learning of novel lexicon

Numerous studies have shown robust evidence of the right hemisphere's involvement in the language function, for instance in the processing of intonation, grammar, word meanings, metaphors, etc. However, its role in lexicon acquisition remains obscure. We applied transcranial direct current stimulation (tDCS) over the right-hemispheric homologue of Wernicke's area to assess its putative involvement in the processing of different types of novel semantics. After receiving 15 min of anodal, cathodal, or sham (placebo) tDCS, three groups of healthy participants learnt novel concrete and abstract words in the context of short stories. Learning outcomes were assessed using a battery of tests immediately after this contextual learning session and 24 h later. As a result, an inhibitory effect of cathodal tDCS and a facilitatory effect of anodal tDCS were found for abstract word acquisition only. We also found a significant drop in task performance on the second day of the assessment for both word types in all the stimulation groups, suggesting no significant influence of tDCS on the post-learning consolidation of new memory traces. The results suggest an involvement of Wernicke's right-hemispheric counterpart in initial encoding (but not consolidation) of abstract semantics, which may be explained either by the right hemispheres direct role in processing lexical semantics or by an indirect impact of tDCS on contralateral (left-hemispheric) cortical areas through cross-callosal connections.

Auditory language comprehension among children and adolescents with autism spectrum disorder: An ALE meta-analysis of fMRI studies

Difficulties in auditory language comprehension are common among children and adolescents with autism spectrum disorder. However, findings regarding the underlying neural mechanisms remain mixed, and few studies have systematically explored the overall patterns of these findings. Therefore, this study aims to systematically review and meta-analyze the functional magnetic resonance imaging evidence of neural activation patterns while engaging in auditory language comprehension tasks among children and adolescents with autism. Using activation likelihood estimation, we conducted a series of meta-analyses to investigate neural activation patterns during auditory language comprehension tasks compared to baseline conditions in autism and non-autism groups and compared the activation patterns of the groups, respectively. Eight studies were included in the within-group analyses, and seven were included in the between-group analysis. The within-group analyses revealed that the bilateral superior temporal gyrus was activated during auditory language comprehension tasks in both groups, whereas the left superior frontal gyrus and dorsal medial prefrontal cortex were activated only in the non-autism group. Furthermore, the between-group analysis showed that children and adolescents with autism, compared to those without autism, showed reduced activation in the right superior temporal gyrus, left middle temporal gyrus, and insula, whereas the autism group did not show increased activation in any of the regions relative to the non-autism group. Overall, these findings contribute to our understanding of the potential neural mechanisms underlying difficulties in auditory language comprehension in children and adolescents with autism and provide practical implications for early screening and language-related interventions for children and adolescents with autism.

Effects of Memantine on the Auditory Steady-State and Harmonic Responses to 40 Hz Stimulation Across Species

BACKGROUND

Click trains elicit an auditory steady-state response (ASSR) at the driving frequency (1F) and its integer multiple frequencies (2F, 3F, etc.) called harmonics; we call this harmonic response the steady-state harmonic response (SSHR). We describe the 40 Hz ASSR (1F) and 80 Hz SSHR (2F) in humans and rats and their sensitivity to the uncompetitive NMDA antagonist memantine.

METHODS

In humans (healthy control participants, n = 25; patients with schizophrenia, n = 28), electroencephalography was recorded after placebo or 20 mg memantine in a within-participant crossover design. ASSR used 1 ms, 85-dB clicks presented in 250 40/s 500-ms trains. In freely moving rats (n = 9), electroencephalography was acquired after memantine (0, 0.3, 1, 3 mg/kg) in a within-participant crossover design; 65-dB click trains used 5-mV monophasic, 1-ms square waves (40/s).

RESULTS

Across species, ASSR at 1F generated greater evoked power (EP) than the 2F SSHR. 1F > 2F intertrial coherence (ITC) was also detected in humans, but the opposite relationship (ITC: 2F > 1F) was seen in rats. EP and ITC at 1F were deficient in patients and were enhanced by memantine across species. EP and ITC at 2F were deficient in patients. Measures at 2F were generally insensitive to memantine across species, although in humans the ITC harmonic ratio (1F:2F) was modestly enhanced by memantine, and in rats, both the EP and ITC harmonic ratios were significantly enhanced by memantine.

CONCLUSIONS

ASSR and SSHR are robust, nonredundant electroencephalography signals that are suitable for cross-species analyses that reveal potentially meaningful differences across species, diagnoses, and drugs.

Click-train evoked steady state harmonic response as a novel pharmacodynamic biomarker of cortical oscillatory synchrony

Sensory networks naturally entrain to rhythmic stimuli like a click train delivered at a particular frequency. Such synchronization is integral to information processing, can be measured by electroencephalography (EEG) and is an accessible index of neural network function. Click trains evoke neural entrainment not only at the driving frequency (F), referred to as the auditory steady state response (ASSR), but also at its higher multiples called the steady state harmonic response (SSHR). Since harmonics play an important and non-redundant role in acoustic information processing, we hypothesized that SSHR may differ from ASSR in presentation and pharmacological sensitivity. In female SD rats, a 2 s-long train stimulus was used to evoke ASSR at 20 Hz and its SSHR at 40, 60 and 80 Hz, recorded from a prefrontal epidural electrode. Narrow band evoked responses were evident at all frequencies; signal power was strongest at 20 Hz while phase synchrony was strongest at 80 Hz. SSHR at 40 Hz took the longest time (∼180 ms from stimulus onset) to establish synchrony. The NMDA antagonist MK801 (0.025-0.1 mg/kg) did not consistently affect 20 Hz ASSR phase synchrony but robustly and dose-dependently attenuated synchrony of all SSHR. Evoked power was attenuated by MK801 at 20 Hz ASSR and 40 Hz SSHR only. Thus, presentation as well as pharmacological sensitivity distinguished SSHR from ASSR, making them non-redundant markers of cortical network function. SSHR is a novel and promising translational biomarker of cortical oscillatory dynamics that may have important applications in CNS drug development and personalized medicine.

Metamodal Coupling of Vibrotactile and Auditory Speech Processing Systems through Matched Stimulus Representations

It has been postulated that the brain is organized by "metamodal," sensory-independent cortical modules capable of performing tasks (e.g., word recognition) in both "standard" and novel sensory modalities. Still, this theory has primarily been tested in sensory-deprived individuals, with mixed evidence in neurotypical subjects, thereby limiting its support as a general principle of brain organization. Critically, current theories of metamodal processing do not specify requirements for successful metamodal processing at the level of neural representations. Specification at this level may be particularly important in neurotypical individuals, where novel sensory modalities must interface with existing representations for the standard sense. Here we hypothesized that effective metamodal engagement of a cortical area requires congruence between stimulus representations in the standard and novel sensory modalities in that region. To test this, we first used fMRI to identify bilateral auditory speech representations. We then trained 20 human participants (12 female) to recognize vibrotactile versions of auditory words using one of two auditory-to-vibrotactile algorithms. The vocoded algorithm attempted to match the encoding scheme of auditory speech while the token-based algorithm did not. Crucially, using fMRI, we found that only in the vocoded group did trained-vibrotactile stimuli recruit speech representations in the superior temporal gyrus and lead to increased coupling between them and somatosensory areas. Our results advance our understanding of brain organization by providing new insight into unlocking the metamodal potential of the brain, thereby benefitting the design of novel sensory substitution devices that aim to tap into existing processing streams in the brain.SIGNIFICANCE STATEMENT It has been proposed that the brain is organized by "metamodal," sensory-independent modules specialized for performing certain tasks. This idea has inspired therapeutic applications, such as sensory substitution devices, for example, enabling blind individuals "to see" by transforming visual input into soundscapes. Yet, other studies have failed to demonstrate metamodal engagement. Here, we tested the hypothesis that metamodal engagement in neurotypical individuals requires matching the encoding schemes between stimuli from the novel and standard sensory modalities. We trained two groups of subjects to recognize words generated by one of two auditory-to-vibrotactile transformations. Critically, only vibrotactile stimuli that were matched to the neural encoding of auditory speech engaged auditory speech areas after training. This suggests that matching encoding schemes is critical to unlocking the brain's metamodal potential.

Emotional sounds in space: asymmetrical representation within early-stage auditory areas

Evidence from behavioral studies suggests that the spatial origin of sounds may influence the perception of emotional valence. Using 7T fMRI we have investigated the impact of the categories of sound (vocalizations; non-vocalizations), emotional valence (positive, neutral, negative) and spatial origin (left, center, right) on the encoding in early-stage auditory areas and in the voice area. The combination of these different characteristics resulted in a total of 18 conditions (2 categories x 3 valences x 3 lateralizations), which were presented in a pseudo-randomized order in blocks of 11 different sounds (of the same condition) in 12 distinct runs of 6 min. In addition, two localizers, i.e., tonotopy mapping; human vocalizations, were used to define regions of interest. A three-way repeated measure ANOVA on the BOLD responses revealed bilateral significant effects and interactions in the primary auditory cortex, the lateral early-stage auditory areas, and the voice area. Positive vocalizations presented on the left side yielded greater activity in the ipsilateral and contralateral primary auditory cortex than did neutral or negative vocalizations or any other stimuli at any of the three positions. Right, but not left area L3 responded more strongly to (i) positive vocalizations presented ipsi- or contralaterally than to neutral or negative vocalizations presented at the same positions; and (ii) to neutral than positive or negative non-vocalizations presented contralaterally. Furthermore, comparison with a previous study indicates that spatial cues may render emotional valence more salient within the early-stage auditory areas.

Preserved functional organization of human auditory cortex in individuals missing one temporal lobe from infancy

Human cortical responses to natural sounds, measured with fMRI, can be approximated as the weighted sum of a small number of canonical response patterns (components), each having interpretable functional and anatomical properties. Here, we asked whether this organization is preserved in cases where only one temporal lobe is available due to early brain damage by investigating a unique family: one sibling born without a left temporal lobe, another without a right temporal lobe, and a third anatomically neurotypical. We analyzed fMRI responses to diverse natural sounds within the intact hemispheres of these individuals and compared them to 12 neurotypical participants. All siblings manifested the neurotypical auditory responses in their intact hemispheres. These results suggest that the development of the auditory cortex in each hemisphere does not depend on the existence of the other hemisphere, highlighting the redundancy and equipotentiality of the bilateral auditory system.

Hemispheric asymmetries for music and speech: Spectrotemporal modulations and top-down influences

Hemispheric asymmetries in auditory cognition have been recognized for a long time, but their neural basis is still debated. Here I focus on specialization for processing of speech and music, the two most important auditory communication systems that humans possess. A great deal of evidence from lesion studies and functional imaging suggests that aspects of music linked to the processing of pitch patterns depend more on right than left auditory networks. A complementary specialization for temporal resolution has been suggested for left auditory networks. These diverse findings can be integrated within the context of the spectrotemporal modulation framework, which has been developed as a way to characterize efficient neuronal encoding of complex sounds. Recent studies show that degradation of spectral modulation impairs melody perception but not speech content, whereas degradation of temporal modulation has the opposite effect. Neural responses in the right and left auditory cortex in those studies are linked to processing of spectral and temporal modulations, respectively. These findings provide a unifying model to understand asymmetries in terms of sensitivity to acoustical features of communication sounds in humans. However, this explanation does not account for evidence that asymmetries can shift as a function of learning, attention, or other top-down factors. Therefore, it seems likely that asymmetries arise both from bottom-up specialization for acoustical modulations and top-down influences coming from hierarchically higher components of the system. Such interactions can be understood in terms of predictive coding mechanisms for perception.

Neural processing of poems and songs is based on melodic properties

The neural processing of speech and music is still a matter of debate. A long tradition that assumes shared processing capacities for the two domains contrasts with views that assume domain-specific processing. We here contribute to this topic by investigating, in a functional magnetic imaging (fMRI) study, ecologically valid stimuli that are identical in wording and differ only in that one group is typically spoken (or silently read), whereas the other is sung: poems and their respective musical settings. We focus on the melodic properties of spoken poems and their sung musical counterparts by looking at proportions of significant autocorrelations (PSA) based on pitch values extracted from their recordings. Following earlier studies, we assumed a bias of poem-processing towards the left and a bias for song-processing on the right hemisphere. Furthermore, PSA values of poems and songs were expected to explain variance in left- vs. right-temporal brain areas, while continuous liking ratings obtained in the scanner should modulate activity in the reward network. Overall, poem processing compared to song processing relied on left temporal regions, including the superior temporal gyrus, whereas song processing compared to poem processing recruited more right temporal areas, including Heschl's gyrus and the superior temporal gyrus. PSA values co-varied with activation in bilateral temporal regions for poems, and in right-dominant fronto-temporal regions for songs. Continuous liking ratings were correlated with activity in the default mode network for both poems and songs. The pattern of results suggests that the neural processing of poems and their musical settings is based on their melodic properties, supported by bilateral temporal auditory areas and an additional right fronto-temporal network known to be implicated in the processing of melodies in songs. These findings take a middle ground in providing evidence for specific processing circuits for speech and music in the left and right hemisphere, but simultaneously for shared processing of melodic aspects of both poems and their musical settings in the right temporal cortex. Thus, we demonstrate the neurobiological plausibility of assuming the importance of melodic properties in spoken and sung aesthetic language alike, along with the involvement of the default mode network in the aesthetic appreciation of these properties.

Development of Atypical Reading at Ages 5 to 9 Years and Processing of Speech Envelope Modulations in the Brain

Different studies have suggested that during speech processing readers with dyslexia present atypical levels of neural entrainment as well as atypical functional hemispherical asymmetries in comparison with typical readers. In this study, we evaluated these differences in children and the variation with age before and after starting with formal reading instruction. Synchronized neural auditory processing activity was quantified based on auditory steady-state responses (ASSRs) from EEG recordings. The stimulation was modulated at syllabic and phonemic fluctuation rates present in speech. We measured the brain activation patterns and the hemispherical asymmetries in children at three age points (5, 7, and 9 years old). Despite the well-known heterogeneity during developmental stages, especially in children and in dyslexia, we could extract meaningful common oscillatory patterns. The analyses included (1) the estimations of source localization, (2) hemispherical preferences using a laterality index, measures of neural entrainment, (3) signal-to-noise ratios (SNRs), and (4) connectivity using phase coherence measures. In this longitudinal study, we confirmed that the existence of atypical levels of neural entrainment and connectivity already exists at pre-reading stages. Overall, these measures reflected a lower ability of the dyslectic brain to synchronize with syllabic rate stimulation. In addition, our findings reinforced the hypothesis of a later maturation of the processing of beta rhythms in dyslexia. This investigation emphasizes the importance of longitudinal studies in dyslexia, especially in children, where neural oscillatory patterns as well as differences between typical and atypical developing children can vary in the span of a year.

Multiscale temporal integration organizes hierarchical computation in human auditory cortex

To derive meaning from sound, the brain must integrate information across many timescales. What computations underlie multiscale integration in human auditory cortex? Evidence suggests that auditory cortex analyses sound using both generic acoustic representations (for example, spectrotemporal modulation tuning) and category-specific computations, but the timescales over which these putatively distinct computations integrate remain unclear. To answer this question, we developed a general method to estimate sensory integration windows-the time window when stimuli alter the neural response-and applied our method to intracranial recordings from neurosurgical patients. We show that human auditory cortex integrates hierarchically across diverse timescales spanning from ~50 to 400 ms. Moreover, we find that neural populations with short and long integration windows exhibit distinct functional properties: short-integration electrodes (less than ~200 ms) show prominent spectrotemporal modulation selectivity, while long-integration electrodes (greater than ~200 ms) show prominent category selectivity. These findings reveal how multiscale integration organizes auditory computation in the human brain.

Common principles in the lateralisation of auditory cortex structure and function for vocal communication in primates and rodents

This review summarises recent findings on the lateralisation of communicative sound processing in the auditory cortex (AC) of humans, non-human primates, and rodents. Functional imaging in humans has demonstrated a left hemispheric preference for some acoustic features of speech, but it is unclear to which degree this is caused by bottom-up acoustic feature selectivity or top-down modulation from language areas. Although non-human primates show a less pronounced functional lateralisation in AC, the properties of AC fields and behavioral asymmetries are qualitatively similar. Rodent studies demonstrate microstructural circuits that might underlie bottom-up acoustic feature selectivity in both hemispheres. Functionally, the left AC in the mouse appears to be specifically tuned to communication calls, whereas the right AC may have a more 'generalist' role. Rodents also show anatomical AC lateralisation, such as differences in size and connectivity. Several of these functional and anatomical characteristics are also lateralized in human AC. Thus, complex vocal communication processing shares common features among rodents and primates. We argue that a synthesis of results from humans, non-human primates, and rodents is necessary to identify the neural circuitry of vocal communication processing. However, data from different species and methods are often difficult to compare. Recent advances may enable better integration of methods across species. Efforts to standardise data formats and analysis tools would benefit comparative research and enable synergies between psychological and biological research in the area of vocal communication processing.

Neural oscillations track natural but not artificial fast speech: Novel insights from speech-brain coupling using MEG

Neural oscillations contribute to speech parsing via cortical tracking of hierarchical linguistic structures, including syllable rate. While the properties of neural entrainment have been largely probed with speech stimuli at either normal or artificially accelerated rates, the important case of natural fast speech has been largely overlooked. Using magnetoencephalography, we found that listening to naturally-produced speech was associated with cortico-acoustic coupling, both at normal (∼6 syllables/s) and fast (∼9 syllables/s) rates, with a corresponding shift in peak entrainment frequency. Interestingly, time-compressed sentences did not yield such coupling, despite being generated at the same rate as the natural fast sentences. Additionally, neural activity in right motor cortex exhibited stronger tuning to natural fast rather than to artificially accelerated speech, and showed evidence for stronger phase-coupling with left temporo-parietal and motor areas. These findings are highly relevant for our understanding of the role played by auditory and motor cortex oscillations in the perception of naturally produced speech.

Atypical processing in neural source analysis of speech envelope modulations in adolescents with dyslexia

Different studies have suggested that language and developmental disorders such as dyslexia are associated with a disturbance of auditory entrainment and of the functional hemispheric asymmetries during speech processing. These disorders typically result from an issue in the phonological component of language that causes problems to represent and manipulate the phonological structure of words at the syllable and/or phoneme level. We used Auditory Steady-State Responses (ASSRs) in EEG recordings to investigate the brain activation and hemisphere asymmetry of theta, alpha, beta and low-gamma range oscillations in typical readers and readers with dyslexia. The aim was to analyse whether the group differences found in previous electrode level studies were caused by a different source activation pattern or conversely was an effect that could be found on the active brain sources. We could not find differences in the brain locations of the main active brain sources. However, we observed differences in the extracted waveforms. The group average of the first DSS component of all signal-to-noise ratios of ASSR at source level was higher than the group averages at the electrode level. These analyses included a lower alpha synchronisation in adolescents with dyslexia and the possibility of compensatory mechanisms in theta, beta and low-gamma frequency bands. The main brain auditory sources were located in cortical regions around the auditory cortex. Thus, the differences observed in auditory EEG experiments would, according to our findings, have their origin in the intrinsic oscillatory mechanisms of the brain cortical sources related to speech perception.

Frontotemporal activation differs between perception of simulated cochlear implant speech and speech in background noise: An image-based fNIRS study

In this study we used functional near-infrared spectroscopy (fNIRS) to investigate neural responses in normal-hearing adults as a function of speech recognition accuracy, intelligibility of the speech stimulus, and the manner in which speech is distorted. Participants listened to sentences and reported aloud what they heard. Speech quality was distorted artificially by vocoding (simulated cochlear implant speech) or naturally by adding background noise. Each type of distortion included high and low-intelligibility conditions. Sentences in quiet were used as baseline comparison. fNIRS data were analyzed using a newly developed image reconstruction approach. First, elevated cortical responses in the middle temporal gyrus (MTG) and middle frontal gyrus (MFG) were associated with speech recognition during the low-intelligibility conditions. Second, activation in the MTG was associated with recognition of vocoded speech with low intelligibility, whereas MFG activity was largely driven by recognition of speech in background noise, suggesting that the cortical response varies as a function of distortion type. Lastly, an accuracy effect in the MFG demonstrated significantly higher activation during correct perception relative to incorrect perception of speech. These results suggest that normal-hearing adults (i.e., untrained listeners of vocoded stimuli) do not exploit the same attentional mechanisms of the frontal cortex used to resolve naturally degraded speech and may instead rely on segmental and phonetic analyses in the temporal lobe to discriminate vocoded speech.

Multisensory deficits in dyslexia may result from a locus coeruleus attentional network dysfunction

A fundamental educational requirement of beginning reading is to learn, access, and rapidly process associations between novel visuospatial symbols and their phonological representations in speech. Children with difficulties in such cross-modal integration are often divided into dyslexia subtypes, based on whether their primary problem is with the written or spoken component of decoding. The present review suggests that starting in infancy, perceptions of audiovisual speech are integrated by mutual oscillatory phase-resetting between sensory cortices, and throughout development visual and auditory experiences are coupled into unified perceptions. Entirely separate subtypes are incompatible with this view. Visual or auditory deficits will invariably affect processing to some degree in both domains. It is suggested that poor auditory/visual integration may be diagnostic for both forms of dyslexia, stemming from an encoding weakness in the early cross-sensory binding of audiovisual speech. The review presents a model of dyslexia as a dysfunction of the large-scale ventral and dorsal attention networks controlling such binding. Excessive glutamatergic neuronal excitability of the attention networks by the Locus coeruleus-norepinephrine system may interfere with multisensory integration, with deleterious effects on the acquisition of reading by degrading graphene/phoneme conversion.

Functional Topography of Auditory Areas Derived From the Combination of Electrophysiological Recordings and Cortical Electrical Stimulation

The posterior part of the superior temporal gyrus (STG) has long been known to be a crucial hub for auditory and language processing, at the crossroad of the functionally defined ventral and dorsal pathways. Anatomical studies have shown that this "auditory cortex" is composed of several cytoarchitectonic areas whose limits do not consistently match macro-anatomic landmarks like gyral and sulcal borders. The only method to record and accurately distinguish neuronal activity from the different auditory sub-fields of primary auditory cortex, located in the tip of Heschl and deeply buried in the Sylvian fissure, is to use stereotaxically implanted depth electrodes (Stereo-EEG) for pre-surgical evaluation of patients with epilepsy. In this prospective, we focused on how anatomo-functional delineation in Heschl's gyrus (HG), Planum Temporale (PT), the posterior part of the STG anterior to HG, the posterior superior temporal sulcus (STS), and the region at the parietal-temporal boundary commonly labeled "SPT" can be achieved using data from electrical cortical stimulation combined with electrophysiological recordings during listening to pure tones and syllables. We show the differences in functional roles between the primary and non-primary auditory areas, in the left and the right hemispheres. We discuss how these findings help understanding the auditory semiology of certain epileptic seizures and, more generally, the neural substrate of hemispheric specialization for language.

From acoustic to linguistic analysis of temporal speech structure: Acousto-linguistic transformation during speech perception using speech quilts

Speech perception entails the mapping of the acoustic waveform to linguistic representations. For this transformation to succeed, the speech signal needs to be tracked over various temporal windows at high temporal precision in order to decode linguistic units ranging from phonemes (tens of milliseconds) to sentences (seconds). Here, we tested the hypothesis that cortical processing of speech-specific temporal structure is modulated by higher-level linguistic analysis. Using fMRI, we measured BOLD signal changes to 4 s long speech quilts with variable temporal structure (30, 120, 480, 960 ms segment lengths), as well as natural speech, created from a familiar (English) or foreign (Korean) language. We found evidence for the acoustic analysis of temporal speech properties in superior temporal sulcus (STS): the BOLD signal increased as a function of temporal speech structure in both familiar and foreign languages. However, activity in left inferior gyrus (IFG) revealed evidence for linguistic processing of temporal speech properties: the BOLD signal increased as a function of temporal speech structure only in familiar, but not in foreign speech. Network connectivity analyses suggested that left IFG modulates the processing of temporal speech structure in primary and non-primary auditory cortex, which in turn sensitizes the analysis of temporal speech structure in STS. The results thus suggest that acousto-linguistic transformation of temporal speech structure is achieved by a cortical network comprising primary and non-primary auditory cortex, STS, and left IFG.

Task-induced brain functional connectivity as a representation of schema for mediating unsupervised and supervised learning dynamics in language acquisition

INTRODUCTION

Based on the schema theory advanced by Rumelhart and Norman, we shed light on the individual variability in brain dynamics induced by hybridization of learning methodologies, particularly alternating unsupervised learning and supervised learning in language acquisition. The concept of "schema" implies a latent knowledge structure that a learner holds and updates as intrinsic to his or her cognitive space for guiding the processing of newly arriving information.

METHODS

We replicated the cognitive experiment of Onnis and Thiessen on implicit statistical learning ability in language acquisition but included additional factors of prosodic variables and explicit supervised learning. Functional magnetic resonance imaging was performed to identify the functional network connections for schema updating by alternately using unsupervised and supervised artificial grammar learning tasks to segment potential words.

RESULTS

Regardless of the quality of task performance, the default mode network represented the first stage of spontaneous unsupervised learning, and the wrap-up accomplishment for successful subjects of the whole hybrid learning in concurrence with the task-related auditory language networks. Furthermore, subjects who could easily "tune" the schema for recording a high task precision rate resorted even at an early stage to a self-supervised learning, or "superlearning," as a set of different learning mechanisms that act in synergy to trigger widespread neuro-transformation with a focus on the cerebellum.

CONCLUSIONS

Investigation of the brain dynamics revealed by functional connectivity imaging analysis was able to differentiate the synchronized neural responses with respect to learning methods and the order effect that affects hybrid learning.

Modality-specific frequency band activity during neural entrainment to auditory and visual rhythms

Rhythm perception depends on the ability to predict the onset of rhythmic events. Previous studies indicate beta band modulation is involved in predicting the onset of auditory rhythmic events (Fujioka et al., 2009, 2012; Snyder & Large, 2005). We sought to determine if similar processes are recruited for prediction of visual rhythms by investigating whether beta band activity plays a role in a modality-dependent manner for rhythm perception. We looked at electroencephalography time-frequency neural correlates of prediction using an omission paradigm with auditory and visual rhythms. By using omissions, we can separate out predictive timing activity from stimulus-driven activity. We hypothesized that there would be modality-independent markers of rhythm prediction in induced beta band oscillatory activity, and our results support this hypothesis. We find induced and evoked predictive timing in both auditory and visual modalities. Additionally, we performed an exploratory-independent components-based spatial clustering analysis, and describe all resulting clusters. This analysis reveals that there may be overlapping networks of predictive beta activity based on common activation in the parietal and right frontal regions, auditory-specific predictive beta in bilateral sensorimotor regions, and visually specific predictive beta in midline central, and bilateral temporal/parietal regions. This analysis also shows evoked predictive beta activity in the left sensorimotor region specific to auditory rhythms and implicates modality-dependent networks for auditory and visual rhythm perception.

Cortical Regions Activated by Spectrally Degraded Speech in Adults With Single Sided Deafness or Bilateral Normal Hearing

Those with profound sensorineural hearing loss from single sided deafness (SSD) generally experience greater cognitive effort and fatigue in adverse sound environments. We studied cases with right ear, SSD compared to normal hearing (NH) individuals. SSD cases were significantly less correct in naming last words in spectrally degraded 8- and 16-band vocoded sentences, despite high semantic predictability. Group differences were not significant for less intelligible 4-band sentences, irrespective of predictability. SSD also had diminished BOLD percent signal changes to these same sentences in left hemisphere (LH) cortical regions of early auditory, association auditory, inferior frontal, premotor, inferior parietal, dorsolateral prefrontal, posterior cingulate, temporal-parietal-occipital junction, and posterior opercular. Cortical regions with lower amplitude responses in SSD than NH were mostly components of a LH language network, previously noted as concerned with speech recognition. Recorded BOLD signal magnitudes were averages from all vertices within predefined parcels from these cortex regions. Parcels from different regions in SSD showed significantly larger signal magnitudes to sentences of greater intelligibility (e.g., 8- or 16- vs. 4-band) in all except early auditory and posterior cingulate cortex. Significantly lower response magnitudes occurred in SSD than NH in regions prior studies found responsible for phonetics and phonology of speech, cognitive extraction of meaning, controlled retrieval of word meaning, and semantics. The findings suggested reduced activation of a LH fronto-temporo-parietal network in SSD contributed to difficulty processing speech for word meaning and sentence semantics. Effortful listening experienced by SSD might reflect diminished activation to degraded speech in the affected LH language network parcels. SSD showed no compensatory activity in matched right hemisphere parcels.

Neural entrainment to speech and nonspeech in dyslexia: Conceptual replication and extension of previous investigations

Whether phonological deficits in developmental dyslexia are associated with impaired neural sampling of auditory information is still under debate. Previous findings suggested that dyslexic participants showed atypical neural entrainment to slow and/or fast temporal modulations in speech, which might affect prosodic/syllabic and phonemic processing respectively. However, the large methodological variations across these studies do not allow us to draw clear conclusions on the nature of the entrainment deficit in dyslexia. Using magnetoencephalography, we measured neural entrainment to nonspeech and speech in both groups. We first aimed to conceptually replicate previous studies on auditory entrainment in dyslexia, using the same measurement methods as in previous studies, and also using new measurement methods (cross-correlation analyses) to better characterize the synchronization between stimulus and brain response. We failed to observe any of the significant group differences that had previously been reported in delta, theta and gamma frequency bands, whether using speech or nonspeech stimuli. However, when analyzing amplitude cross-correlations between noise stimuli and brain responses, we found that control participants showed larger responses than dyslexic participants in the delta range in the right hemisphere and in the gamma range in the left hemisphere. Overall, our results are weakly consistent with the hypothesis that dyslexic individuals show an atypical entrainment to temporal modulations. Our attempt at replicating previously published results highlights the multiple weaknesses of this research area, particularly low statistical power due to small sample size, and the lack of methodological standards inducing considerable heterogeneity of measurement and analysis methods across studies.

Newer Paradigms in Language Neurobiology

The field of language research has seen tremendous progress in the last two decades. Advances in neuro-imaging and stimulation mapping have changed the way we conceive the neural basis of speech and language processing. In the past, the Wernicke-Lichtheim model was the most influential model explaining the neuro-anatomical basis of language. More recently, the concept of dual stream language processing has emerged, wherein separate dorsal and ventral networks are synergistically involved in phonological (sound to articulation) and semantic (sound to meaning) processing respectively. In this review article, we highlight new insights and approaches to the neurobiology of language, across different aspects of language processing like perception, comprehension, production, hemisphere lateralization, role of subcortical structures and effect of damage to language networks.

Rapid computations of spectrotemporal prediction error support perception of degraded speech

Human speech perception can be described as Bayesian perceptual inference but how are these Bayesian computations instantiated neurally? We used magnetoencephalographic recordings of brain responses to degraded spoken words and experimentally manipulated signal quality and prior knowledge. We first demonstrate that spectrotemporal modulations in speech are more strongly represented in neural responses than alternative speech representations (e.g. spectrogram or articulatory features). Critically, we found an interaction between speech signal quality and expectations from prior written text on the quality of neural representations; increased signal quality enhanced neural representations of speech that mismatched with prior expectations, but led to greater suppression of speech that matched prior expectations. This interaction is a unique neural signature of prediction error computations and is apparent in neural responses within 100 ms of speech input. Our findings contribute to the detailed specification of a computational model of speech perception based on predictive coding frameworks.

Electrophysiology of the Human Superior Temporal Sulcus during Speech Processing

The superior temporal sulcus (STS) is a crucial hub for speech perception and can be studied with high spatiotemporal resolution using electrodes targeting mesial temporal structures in epilepsy patients. Goals of the current study were to clarify functional distinctions between the upper (STSU) and the lower (STSL) bank, hemispheric asymmetries, and activity during self-initiated speech. Electrophysiologic properties were characterized using semantic categorization and dialog-based tasks. Gamma-band activity and alpha-band suppression were used as complementary measures of STS activation. Gamma responses to auditory stimuli were weaker in STSL compared with STSU and had longer onset latencies. Activity in anterior STS was larger during speaking than listening; the opposite pattern was observed more posteriorly. Opposite hemispheric asymmetries were found for alpha suppression in STSU and STSL. Alpha suppression in the STS emerged earlier than in core auditory cortex, suggesting feedback signaling within the auditory cortical hierarchy. STSL was the only region where gamma responses to words presented in the semantic categorization tasks were larger in subjects with superior task performance. More pronounced alpha suppression was associated with better task performance in Heschl's gyrus, superior temporal gyrus, and STS. Functional differences between STSU and STSL warrant their separate assessment in future studies.

Four new cytoarchitectonic areas surrounding the primary and early auditory cortex in human brains

The architectonical organization of putatively higher auditory areas in the human superior temporal gyrus and sulcus is not yet well understood. To provide a coherent map of this part of the brain, which is involved in language and other functions, we examined the cytoarchitecture and cortical parcellation of this region in histological sections of ten human postmortem brains using an observer-independent mapping approach. Two new areas were identified in the temporo-insular region (areas TeI, TI). TeI is medially adjacent to the primary auditory cortex (area Te1). TI is located between TeI and the insular cortex. Laterally adjacent to previously mapped areas Te2 and Te3, two new areas (STS1, STS2) were identified in the superior temporal sulcus. All four areas were mapped over their whole extent in serial, cell-body stained sections, and their cytoarchitecture was analyzed using quantitative image analysis and multivariate statistics. Interestingly, area TeI, which is located between area Te1 and area TI at the transition to the insula, was more similar in cytoarchitecture to lateral area Te2.1 than to the directly adjacent areas TI and Te1. Such structural similarity of areas medially and laterally to Te1 would be in line with the core-belt-parabelt concept in macaques. The cytoarchitectonic probabilistic maps of all areas show the localization of the areas and their interindividual variability. The new maps are publicly available and provide a basis to further explore structural-functional relationship of the language network in the temporal cortex.

Asymmetric sampling in human auditory cortex reveals spectral processing hierarchy

Speech perception is mediated by both left and right auditory cortices but with differential sensitivity to specific acoustic information contained in the speech signal. A detailed description of this functional asymmetry is missing, and the underlying models are widely debated. We analyzed cortical responses from 96 epilepsy patients with electrode implantation in left or right primary, secondary, and/or association auditory cortex (AAC). We presented short acoustic transients to noninvasively estimate the dynamical properties of multiple functional regions along the auditory cortical hierarchy. We show remarkably similar bimodal spectral response profiles in left and right primary and secondary regions, with evoked activity composed of dynamics in the theta (around 4–8 Hz) and beta–gamma (around 15–40 Hz) ranges. Beyond these first cortical levels of auditory processing, a hemispheric asymmetry emerged, with delta and beta band (3/15 Hz) responsivity prevailing in the right hemisphere and theta and gamma band (6/40 Hz) activity prevailing in the left. This asymmetry is also present during syllables presentation, but the evoked responses in AAC are more heterogeneous, with the co-occurrence of alpha (around 10 Hz) and gamma (>25 Hz) activity bilaterally. These intracranial data provide a more fine-grained and nuanced characterization of cortical auditory processing in the 2 hemispheres, shedding light on the neural dynamics that potentially shape auditory and speech processing at different levels of the cortical hierarchy.

Capitalizing on intracranial data from 96 epileptic patients, this study precisely estimates the processing timescales along the cortical auditory hierarchy and reveals that an asymmetric sampling emerges in associative areas.

Distinct sensitivity to spectrotemporal modulation supports brain asymmetry for speech and melody

Does brain asymmetry for speech and music emerge from acoustical cues or from domain-specific neural networks? We selectively filtered temporal or spectral modulations in sung speech stimuli for which verbal and melodic content was crossed and balanced. Perception of speech decreased only with degradation of temporal information, whereas perception of melodies decreased only with spectral degradation. Functional magnetic resonance imaging data showed that the neural decoding of speech and melodies depends on activity patterns in left and right auditory regions, respectively. This asymmetry is supported by specific sensitivity to spectrotemporal modulation rates within each region. Finally, the effects of degradation on perception were paralleled by their effects on neural classification. Our results suggest a match between acoustical properties of communicative signals and neural specializations adapted to that purpose.

The Causal Role of Left and Right Superior Temporal Gyri in Speech Perception in Noise: A Transcranial Magnetic Stimulation Study

Successful perception of speech in everyday listening conditions requires effective listening strategies to overcome common acoustic distortions, such as background noise. Convergent evidence from neuroimaging and clinical studies identify activation within the temporal lobes as key to successful speech perception. However, current neurobiological models disagree on whether the left temporal lobe is sufficient for successful speech perception or whether bilateral processing is required. We addressed this issue using TMS to selectively disrupt processing in either the left or right superior temporal gyrus (STG) of healthy participants to test whether the left temporal lobe is sufficient or whether both left and right STG are essential. Participants repeated keywords from sentences presented in background noise in a speech reception threshold task while receiving online repetitive TMS separately to the left STG, right STG, or vertex or while receiving no TMS. Results show an equal drop in performance following application of TMS to either left or right STG during the task. A separate group of participants performed a visual discrimination threshold task to control for the confounding side effects of TMS. Results show no effect of TMS on the control task, supporting the notion that the results of Experiment 1 can be attributed to modulation of cortical functioning in STG rather than to side effects associated with online TMS. These results indicate that successful speech perception in everyday listening conditions requires both left and right STG and thus have ramifications for our understanding of the neural organization of spoken language processing.

Brain activity patterns of phonemic representations are atypical in beginning readers with family risk for dyslexia

There is an ongoing debate whether phonological deficits in dyslexics should be attributed to (a) less specified representations of speech sounds, like suggested by studies in young children with a familial risk for dyslexia, or (b) to an impaired access to these phonemic representations, as suggested by studies in adults with dyslexia. These conflicting findings are rooted in between study differences in sample characteristics and/or testing techniques. The current study uses the same multivariate functional MRI (fMRI) approach as previously used in adults with dyslexia to investigate phonemic representations in 30 beginning readers with a familial risk and 24 beginning readers without a familial risk of dyslexia, of whom 20 were later retrospectively classified as dyslexic. Based on fMRI response patterns evoked by listening to different utterances of /bA/ and /dA/ sounds, multivoxel analyses indicate that the underlying activation patterns of the two phonemes were distinct in children with a low family risk but not in children with high family risk. However, no group differences were observed between children that were later classified as typical versus dyslexic readers, regardless of their family risk status, indicating that poor phonemic representations constitute a risk for dyslexia but are not sufficient to result in reading problems. We hypothesize that poor phonemic representations are trait (family risk) and not state (dyslexia) dependent, and that representational deficits only lead to reading difficulties when they are present in conjunction with other neuroanatomical or-functional deficits.

Spectrotemporal modulation provides a unifying framework for auditory cortical asymmetries

The principles underlying functional asymmetries in cortex remain debated. For example, it is accepted that speech is processed bilaterally in auditory cortex, but a left hemisphere dominance emerges when the input is interpreted linguistically. The mechanisms, however, are contested: what sound features or processing principles underlie laterality? Recent findings across species (humans, canines, bats) provide converging evidence that spectrotemporal sound features drive asymmetrical responses. Typically, accounts invoke models wherein the hemispheres differ in time-frequency resolution or integration window size. We develop a framework that builds on and unifies prevailing models, using spectrotemporal modulation space. Using signal processing techniques motivated by neural responses, we test this approach employing behavioral and neurophysiological measures. We show how psychophysical judgments align with spectrotemporal modulations and then characterize the neural sensitivities to temporal and spectral modulations. We demonstrate differential contributions from both hemispheres, with a left lateralization for temporal modulations and a weaker right lateralization for spectral modulations. We argue that representations in the modulation domain provide a more mechanistic basis to account for lateralization in auditory cortex.

Tracking the microstructural properties of the main white matter pathways underlying speech processing in simultaneous interpreters

Due to the high linguistic and cognitive demands placed on real-time language translation, professional simultaneous interpreters (SIs) have previously been proposed to serve as a reasonable model for evaluating experience-dependent brain properties. However, currently it is still unknown whether intensive language training during adulthood might be reflected in microstructural changes in language-related white matter pathways contributing to sound-to-meaning mapping, auditory-motor integration, and verbal memory functions. Accordingly, we used a fully automated probabilistic tractography algorithm and compared the white matter microstructure of the bilateral inferior longitudinal fasciculus (ILF), uncinate fasciculus (UF), and arcuate fasciculus (AF, long and anterior segments) between professional SIs and multilingual control participants. In addition, we classically re-evaluated the three constitutional elements of the AF (long, anterior, and posterior segments) using a deterministic manual dissection procedure. Automated probabilistic tractography demonstrated overall reduced mean fractional anisotropy (FA) and increased radial diffusivity (RD) in SIs in the fiber tracts of the left hemisphere (LH). Furthermore, SIs exhibited reduced mean FA in the bilateral AF. However, according to manual dissection, this effect was limited to the anterior AF segment and accompanied by increased mean RD. Deterministic AF reconstruction also uncovered increased mean FA in the right and RD in the left long AF segment in SIs compared to controls. These results point to a relationship between simultaneous interpreting and white matter organization of pathways underlying speech and language processing in the language-dominant LH as well as of the AF.

Development of perception and perceptual learning for multi-timescale filtered speech

The perception of temporally changing auditory signals has a gradual developmental trajectory. Speech is a time-varying signal, and slow changes in speech (filtered at 0-4 Hz) are preferentially processed by the right hemisphere, while the left extracts faster changes (filtered at 22-40 Hz). This work examined the ability of 8- to 19-year-olds to both perceive and learn to perceive filtered speech presented diotically for each filter type (low vs high) and dichotically for preferred or non-preferred laterality. Across conditions, performance improved with increasing age, indicating that the ability to perceive filtered speech continues to develop into adolescence. Across age, performance was best when both bands were presented dichotically, but with no benefit for presentation to the preferred hemisphere. Listeners thus integrated slow and fast transitions between the two ears, benefitting from more signal information, but not in a hemisphere-specific manner. After accounting for potential ceiling effects, learning was greatest when both bands were presented dichotically. These results do not support the idea that cochlear implants could be improved by providing differentially filtered information to each ear. Listeners who started with poorer performance learned more, a factor which could contribute to the positive cochlear implant outcomes typically seen in younger children.

White matter pathways for prosodic structure building: A case study

The relevance of left dorsal and ventral fiber pathways for syntactic and semantic comprehension is well established, while pathways for prosody are little explored. The present study examined linguistic prosodic structure building in a patient whose right arcuate/superior longitudinal fascicles and posterior corpus callosum were transiently compromised by a vasogenic peritumoral edema. Compared to ten matched healthy controls, the patient's ability to detect irregular prosodic structure significantly improved between pre- and post-surgical assessment. This recovery was accompanied by an increase in average fractional anisotropy (FA) in right dorsal and posterior transcallosal fiber tracts. Neither general cognitive abilities nor (non-prosodic) syntactic comprehension nor FA in right ventral and left dorsal fiber tracts showed a similar pre-post increase. Together, these findings suggest a contribution of right dorsal and inter-hemispheric pathways to prosody perception, including the right-dorsal tracking and structuring of prosodic pitch contours that is transcallosally informed by concurrent syntactic information.

The revolution will not be controlled: natural stimuli in speech neuroscience

Humans have a unique ability to produce and consume rich, complex, and varied language in order to communicate ideas to one another. Still, outside of natural reading, the most common methods for studying how our brains process speech or understand language use only isolated words or simple sentences. Recent studies have upset this status quo by employing complex natural stimuli and measuring how the brain responds to language as it is used. In this article we argue that natural stimuli offer many advantages over simplified, controlled stimuli for studying how language is processed by the brain. Furthermore, the downsides of using natural language stimuli can be mitigated using modern statistical and computational techniques.

Focal versus distributed temporal cortex activity for speech sound category assignment

When listening to speech, phonemes are represented in a distributed fashion in our temporal and prefrontal cortices. How these representations are selected in a phonemic decision context, and in particular whether distributed or focal neural information is required for explicit phoneme recognition, is unclear. We hypothesized that focal and early neural encoding of acoustic signals is sufficiently informative to access speech sound representations and permit phoneme recognition. We tested this hypothesis by combining a simple speech-phoneme categorization task with univariate and multivariate analyses of fMRI, magnetoencephalography, intracortical, and clinical data. We show that neural information available focally in the temporal cortex prior to decision-related neural activity is specific enough to account for human phonemic identification.

Percepts and words can be decoded from distributed neural activity measures. However, the existence of widespread representations might conflict with the more classical notions of hierarchical processing and efficient coding, which are especially relevant in speech processing. Using fMRI and magnetoencephalography during syllable identification, we show that sensory and decisional activity colocalize to a restricted part of the posterior superior temporal gyrus (pSTG). Next, using intracortical recordings, we demonstrate that early and focal neural activity in this region distinguishes correct from incorrect decisions and can be machine-decoded to classify syllables. Crucially, significant machine decoding was possible from neuronal activity sampled across different regions of the temporal and frontal lobes, despite weak or absent sensory or decision-related responses. These findings show that speech-sound categorization relies on an efficient readout of focal pSTG neural activity, while more distributed activity patterns, although classifiable by machine learning, instead reflect collateral processes of sensory perception and decision.

Neuronal populations in the occipital cortex of the blind synchronize to the temporal dynamics of speech

The occipital cortex of early blind individuals (EB) activates during speech processing, challenging the notion of a hard-wired neurobiology of language. But, at what stage of speech processing do occipital regions participate in EB? Here we demonstrate that parieto-occipital regions in EB enhance their synchronization to acoustic fluctuations in human speech in the theta-range (corresponding to syllabic rate), irrespective of speech intelligibility. Crucially, enhanced synchronization to the intelligibility of speech was selectively observed in primary visual cortex in EB, suggesting that this region is at the interface between speech perception and comprehension. Moreover, EB showed overall enhanced functional connectivity between temporal and occipital cortices that are sensitive to speech intelligibility and altered directionality when compared to the sighted group. These findings suggest that the occipital cortex of the blind adopts an architecture that allows the tracking of speech material, and therefore does not fully abstract from the reorganized sensory inputs it receives.

Monaural-driven Functional Changes within and Beyond the Auditory Cortical Network: Evidence from Long-term Unilateral Hearing Impairment

Long-term unilateral hearing impairment (UHI) results in changes in hearing and psychoacoustic performance that are likely related to cortical reorganization. However, the underlying functional changes in the brain are not yet fully understood. Here, we studied alterations in inter- and intra-hemispheric resting-state functional connectivity (RSFC) in 38 patients with long-term UHI caused by acoustic neuroma. Resting-state fMRI data from 17 patients with left-sided hearing impairment (LHI), 21 patients with right-sided hearing impairment (RHI) and 21 healthy controls (HCs) were collected. We applied voxel-mirrored homotopic connectivity analysis to investigate the interhemispheric interactions. To study alterations in between-network interactions, we used four cytoarchitectonically identified subregions in the auditory cortex as "seeds" for whole-brain RSFC analysis. We found that long-term imbalanced auditory input to the brain resulted in (1) enhanced interhemispheric RSFC between the contralateral and ipsilateral auditory networks and (2) differential patterns of altered RSFCs with other sensory (visual and somatomotor) and higher-order (default mode and ventral attention) networks among the four auditory cortical subregions. These altered RSFCs within and beyond the auditory network were dependent on the side of hearing impairment. The results were reproducible when the analysis was restricted to patients with severe-to-profound UHI and patients with hearing-impairment durations greater than 24 months. Together, we demonstrated that long-term UHI drove cortical functional changes within and beyond the auditory network, providing empirical evidence for the association between brain changes and hearing disorders.

The neural oscillations of speech processing and language comprehension: state of the art and emerging mechanisms

Neural oscillations subserve a broad range of functions in speech processing and language comprehension. On the one hand, speech contains-somewhat-repetitive trains of air pressure bursts that occur at three dominant amplitude modulation frequencies, physically marking the linguistically meaningful progressions of phonemes, syllables and intonational phrase boundaries. To these acoustic events, neural oscillations of isomorphous operating frequencies are thought to synchronise, presumably resulting in an implicit temporal alignment of periods of neural excitability to linguistically meaningful spectral information on the three low-level linguistic description levels. On the other hand, speech is a carrier signal that codes for high-level linguistic meaning, such as syntactic structure and semantic information-which cannot be read from stimulus acoustics, but must be acquired during language acquisition and decoded for language comprehension. Neural oscillations subserve the processing of both syntactic structure and semantic information. Here, I synthesise a mapping from each linguistic processing domain to a unique set of subserving oscillatory mechanisms-the mapping is plausible given the role ascribed to different oscillatory mechanisms in different subfunctions of cortical information processing and faithful to the underlying electrophysiology. In sum, the present article provides an accessible and extensive review of the functional mechanisms that neural oscillations subserve in speech processing and language comprehension.

Speech perception in autism spectrum disorder: An activation likelihood estimation meta-analysis

Autism spectrum disorder (ASD) is often characterized by atypical language profiles and auditory and speech processing. These can contribute to aberrant language and social communication skills in ASD. The study of the neural basis of speech perception in ASD can serve as a potential neurobiological marker of ASD early on, but mixed results across studies renders it difficult to find a reliable neural characterization of speech processing in ASD. To this aim, the present study examined the functional neural basis of speech perception in ASD versus typical development (TD) using an activation likelihood estimation (ALE) meta-analysis of 18 qualifying studies. The present study included separate analyses for TD and ASD, which allowed us to examine patterns of within-group brain activation as well as both common and distinct patterns of brain activation across the ASD and TD groups. Overall, ASD and TD showed mostly common brain activation of speech processing in bilateral superior temporal gyrus (STG) and left inferior frontal gyrus (IFG). However, the results revealed trends for some distinct activation in the TD group showing additional activation in higher-order brain areas including left superior frontal gyrus (SFG), left medial frontal gyrus (MFG), and right IFG. These results provide a more reliable neural characterization of speech processing in ASD relative to previous single neuroimaging studies and motivate future work to investigate how these brain signatures relate to behavioral measures of speech processing in ASD.

Song Processing in the Zebra Finch Auditory Forebrain Reflects Asymmetric Sensitivity to Temporal and Spectral Structure

Despite being commonly referenced throughout neuroscientific research on songbirds, reports of hemispheric specialization in the processing of song remain controversial. The notion of such asymmetries in songbirds is further complicated by evidence that both cerebral hemispheres in humans may be specialized for different aspects of speech perception. Some studies suggest that the auditory neural substrates in the left and right hemispheres of humans process temporal and spectral elements within speech sounds, respectively. To determine whether songbirds process their conspecific songs in such a complementary, bilateral manner, we performed functional magnetic resonance imaging (fMRI) on 15 isoflurane anesthetized adult male zebra finches (Taeniopygia guttata) while presenting them with (1) non-manipulated, (2) spectrally-filtered (reduced spectral structure), and (3) temporally-filtered (reduced temporal structure) conspecific song. Our results revealed sensitivity of both primary (Field L) and secondary (caudomedial nidopallium, NCM) auditory regions to changes in spectral and temporal structure of song. On the one hand, temporally-filtered song elicited a bilateral decrease in neural responses compared to the other stimulus types. On the other hand, spectrally filtered song elicited significantly greater responses in left Field L and NCM than temporally filtered or non-manipulated song while concurrently reducing the response relative to non-manipulated song in the right auditory forebrain. The latter hemispheric difference in sensitivity to manipulations of spectral structure in song, suggests that there is an asymmetry in spectral and temporal domain processing in the zebra finch auditory forebrain bearing some resemblance to what has been observed in human auditory cortex.

The Role of Slow Speech Amplitude Envelope for Speech Processing and Reading Development

This study examined the putative link between the entrainment to the slow rhythmic structure of speech, speech intelligibility and reading by means of a behavioral paradigm. Two groups of 20 children (Grades 2 and 5) were asked to recall a pseudoword embedded in sentences presented either in quiet or noisy listening conditions. Half of the sentences were primed with their syllabic and prosodic amplitude envelope to determine whether a boost in auditory entrainment to these speech features enhanced pseudoword intelligibility. Priming improved pseudoword recall performance only for the older children both in a quiet and a noisy listening environment, and such benefit from the prime correlated with reading skills and pseudoword recall. Our results support the role of syllabic and prosodic tracking of speech in reading development.

Changes in brain activity following intensive voice treatment in children with cerebral palsy

Eight children (3 females; 8-16 years) with motor speech disorders secondary to cerebral palsy underwent 4 weeks of an intensive neuroplasticity-principled voice treatment protocol, LSVT LOUD^® , followed by a structured 12-week maintenance program. Children were asked to overtly produce phonation (ah) at conversational loudness, cued-phonation at perceived twice-conversational loudness, a series of single words, and a prosodic imitation task while being scanned using fMRI, immediately pre- and post-treatment and 12 weeks following a maintenance program. Eight age- and sex-matched controls were scanned at each of the same three time points. Based on the speech and language literature, 16 bilateral regions of interest were selected a priori to detect potential neural changes following treatment. Reduced neural activity in the motor areas (decreased motor system effort) before and immediately after treatment, and increased activity in the anterior cingulate gyrus after treatment (increased contribution of decision making processes) were observed in the group with cerebral palsy compared to the control group. Using graphical models, post-treatment changes in connectivity were observed between the left supramarginal gyrus and the right supramarginal gyrus and the left precentral gyrus for the children with cerebral palsy, suggesting LSVT LOUD enhanced contributions of the feedback system in the speech production network instead of high reliance on feedforward control system and the somatosensory target map for regulating vocal effort. Network pruning indicates greater processing efficiency and the recruitment of the auditory and somatosensory feedback control systems following intensive treatment. Hum Brain Mapp 38:4413-4429, 2017. © 2017 Wiley Periodicals, Inc.

Modulation of Auditory Evoked Magnetic Fields Elicited by Successive Frequency-Modulated (FM) Sweeps

In our daily life, we are successively exposed to frequency-modulated (FM) sounds that play an important role in speech and species-specific communication. Previous studies demonstrated that repetitive exposure to identical pure tones resulted in decreased neural activity. However, the effects of repetitively presented FM sounds on neural activity in the human auditory cortex remain unclear. In the present study, we used magnetoencephalography to investigate auditory evoked N1m responses elicited by four successive temporally repeated and superimposed FM sweeps in three sequences: (1) four FM sweeps were identical, (2) four FM sweeps had the same FM direction and rate, but different carrier frequencies, (3) four FM sweeps differed with respect to the FM rate and/or direction and their carrier frequencies. In contrast to our expectations, the results obtained demonstrated that N1m responses were maximal when the four FM sweeps were identical and minimal when they were distinct. These results suggest that the neural processing of repetitive FM sweeps in the human auditory cortex may differ from that of repetitive pure tones.

Auditory cortical delta-entrainment interacts with oscillatory power in multiple fronto-parietal networks

The timing of slow auditory cortical activity aligns to the rhythmic fluctuations in speech. This entrainment is considered to be a marker of the prosodic and syllabic encoding of speech, and has been shown to correlate with intelligibility. Yet, whether and how auditory cortical entrainment is influenced by the activity in other speech–relevant areas remains unknown. Using source-localized MEG data, we quantified the dependency of auditory entrainment on the state of oscillatory activity in fronto-parietal regions. We found that delta band entrainment interacted with the oscillatory activity in three distinct networks. First, entrainment in the left anterior superior temporal gyrus (STG) was modulated by beta power in orbitofrontal areas, possibly reflecting predictive top-down modulations of auditory encoding. Second, entrainment in the left Heschl's Gyrus and anterior STG was dependent on alpha power in central areas, in line with the importance of motor structures for phonological analysis. And third, entrainment in the right posterior STG modulated theta power in parietal areas, consistent with the engagement of semantic memory. These results illustrate the topographical network interactions of auditory delta entrainment and reveal distinct cross-frequency mechanisms by which entrainment can interact with different cognitive processes underlying speech perception.

•

We study auditory cortical speech entrainment from a network perspective.

•

Found three distinct networks interacting with delta-entrainment in auditory cortex.

•

Entrainment is modulated by frontal beta power, possibly indexing predictions.

•

Central alpha power interacts with entrainment, suggesting motor involvement.

•

Parietal theta is modulated by entrainment, suggesting working memory compensation.

Recruitment of Language-, Emotion- and Speech-Timing Associated Brain Regions for Expressing Emotional Prosody: Investigation of Functional Neuroanatomy with fMRI

We aimed to progress understanding of prosodic emotion expression by establishing brain regions active when expressing specific emotions, those activated irrespective of the target emotion, and those whose activation intensity varied depending on individual performance. BOLD contrast data were acquired whilst participants spoke non-sense words in happy, angry or neutral tones, or performed jaw-movements. Emotion-specific analyses demonstrated that when expressing angry prosody, activated brain regions included the inferior frontal and superior temporal gyri, the insula, and the basal ganglia. When expressing happy prosody, the activated brain regions also included the superior temporal gyrus, insula, and basal ganglia, with additional activation in the anterior cingulate. Conjunction analysis confirmed that the superior temporal gyrus and basal ganglia were activated regardless of the specific emotion concerned. Nevertheless, disjunctive comparisons between the expression of angry and happy prosody established that anterior cingulate activity was significantly higher for angry prosody than for happy prosody production. Degree of inferior frontal gyrus activity correlated with the ability to express the target emotion through prosody. We conclude that expressing prosodic emotions (vs. neutral intonation) requires generic brain regions involved in comprehending numerous aspects of language, emotion-related processes such as experiencing emotions, and in the time-critical integration of speech information.

Electrocorticographic Activation within Human Auditory Cortex during Dialog-Based Language and Cognitive Testing

Current models of cortical speech and language processing include multiple regions within the temporal lobe of both hemispheres. Human communication, by necessity, involves complex interactions between regions subserving speech and language processing with those involved in more general cognitive functions. To assess these interactions, we utilized an ecologically salient conversation-based approach. This approach mandates that we first clarify activity patterns at the earliest stages of cortical speech processing. Therefore, we examined high gamma (70–150 Hz) responses within the electrocorticogram (ECoG) recorded simultaneously from Heschl’s gyrus (HG) and lateral surface of the superior temporal gyrus (STG). Subjects were neurosurgical patients undergoing evaluation for treatment of medically intractable epilepsy. They performed an expanded version of the Mini-mental state examination (MMSE), which included additional spelling, naming, and memory-based tasks. ECoG was recorded from HG and the STG using multicontact depth and subdural electrode arrays, respectively. Differences in high gamma activity during listening to the interviewer and the subject’s self-generated verbal responses were quantified for each recording site and across sites within HG and STG. The expanded MMSE produced widespread activation in auditory cortex of both hemispheres. No significant difference was found between activity during listening to the interviewer’s questions and the subject’s answers in posteromedial HG (auditory core cortex). A different pattern was observed throughout anterolateral HG and posterior and middle portions of lateral STG (non-core auditory cortical areas), where activity was significantly greater during listening compared to speaking. No systematic task-specific differences in the degree of suppression during speaking relative to listening were found in posterior and middle STG. Individual sites could, however, exhibit task-related variability in the degree of suppression during speaking compared to listening. The current study demonstrates that ECoG recordings can be acquired in time-efficient dialog-based paradigms, permitting examination of language and cognition in an ecologically salient manner. The results obtained from auditory cortex serve as a foundation for future studies addressing patterns of activity beyond auditory cortex that subserve human communication.