Functional heterogeneity of inferior frontal gyrus is shaped by linguistic experience

Neural correlates of lexical stress processing in a foreign free-stress language

INTRODUCTION

The paper examines the discrimination of lexical stress contrasts in a foreign language from a neural perspective. The aim of the study was to identify the areas associated with word stress processing (in comparison with vowel processing), when listeners of a fixed-stress language have to process stress in a foreign free-stress language.

METHODS

We asked French-speaking participants to process stress and vowel contrasts in Spanish, a foreign language that the participants did not know. Participants performed a discrimination task on Spanish word pairs differing either with respect to word stress (penultimate or final stressed word) or with respect to the final vowel while functional magnetic resonance imaging data was acquired.

RESULTS

Behavioral results showed lower accuracy and longer reaction times for discriminating stress contrasts than vowel contrasts. The contrast Stress > Vowel revealed an increased bilateral activation of regions shown to be associated with stress processing (i.e., supplementary motor area, insula, middle/superior temporal gyrus), as well as a stronger involvement of areas related to more domain-general cognitive control functions (i.e., bilateral inferior frontal gyrus). The contrast Vowel > Stress showed an increased activation in regions typically associated with the default mode network (known for decreasing its activity during attentionally more demanding tasks).

CONCLUSION

When processing Spanish stress contrasts as compared to processing vowel contrasts, native listeners of French activated to a higher degree anterior networks including regions related to cognitive control. They also show a decrease in regions related to the default mode network. These findings, together with the behavioral results, reflect the higher cognitive demand, and therefore, the larger difficulties, for French-speaking listeners during stress processing as compared to vowel processing.

Start shallow and grow deep: The development of a Hebrew reading brain

Brain plasticity implies that readers of different orthographies can have different reading networks. Theoretical models suggest that reading acquisition in transparent orthographies relies on mapping smaller orthographic units to phonology, than reading opaque orthographies; but what are the neural mechanisms underlying this difference? Hebrew has a transparent (pointed) script used for beginners, and a non-transparent script used for skilled readers. The current study examined the developmental changes in brain regions associated with phonological and orthographic processes during reading pointed and un-pointed words. Our results highlight some changes that are universal in reading development, such as a developmental increase in frontal involvement (in bilateral inferior frontal gyrus (IFG) pars opercularis), and increase in left asymmetry (in IFG pars opercularis and superior temporal gyrus, STG) of the reading network. Our results also showed a developmental increase in activation in STG, which stands in contrast to previous studies in other orthographies. We further found an interaction of word length and diacritics in bilateral STG and VWFA across both groups. These findings suggest that children slightly adjust their reading depending on orthographic transparency, relying on smaller units when reading a transparent script and on larger units when reading an opaque script. Our results also showed that phonological abilities across groups correlated with activation in the VWFA, regardless of transparency, supporting the continued role of phonology at all levels of orthographic transparency. Our findings are consistent with multiple route reading models, in which both phonological and orthographic processing of multiple size units continue to play a role in children's reading of transparent and opaque scripts during reading development. The results further demonstrate the importance of taking into account differences between orthographies when constructing neural models of reading acquisition.

Children's Neural Sensitivity to Prosodic Features of Natural Speech and Its Significance to Speech Development in Cochlear Implanted Children

Catchy utterances, such as proverbs, verses, and nursery rhymes (i.e., "No pain, no gain" in English), contain strong-prosodic (SP) features and are child-friendly in repeating and memorizing; yet the way those prosodic features encoded by neural activity and their influence on speech development in children are still largely unknown. Using functional near-infrared spectroscopy (fNIRS), this study investigated the cortical responses to the perception of natural speech sentences with strong/weak-prosodic (SP/WP) features and evaluated the speech communication ability in 21 pre-lingually deaf children with cochlear implantation (CI) and 25 normal hearing (NH) children. A comprehensive evaluation of speech communication ability was conducted on all the participants to explore the potential correlations between neural activities and children's speech development. The SP information evoked right-lateralized cortical responses across a broad brain network in NH children and facilitated the early integration of linguistic information, highlighting children's neural sensitivity to natural SP sentences. In contrast, children with CI showed significantly weaker cortical activation and characteristic deficits in speech perception with SP features, suggesting hearing loss at the early age of life, causing significantly impaired sensitivity to prosodic features of sentences. Importantly, the level of neural sensitivity to SP sentences was significantly related to the speech behaviors of all children participants. These findings demonstrate the significance of speech prosodic features in children's speech development.

Language processing in Internet use disorder: Task-based fMRI study

Internet use disorder (IUD) is generally conceptualized as a fast-growing behavioral addiction. Several structural and functional brain alterations have been revealed in this condition, but previous behavioral studies indicated that language systems may also be impaired. We used a silent word generation task to induce brain activation in Broca’s area and other parts of the language system. Blood-oxygen-level-dependent activation analysis and psychophysiological interaction analysis were applied to assess functional brain changes. IUD was measured by the Problematic Internet Use Questionnaire and two additional questions concerning usage time and subjective rating of addiction. According to our key findings, areas strongly related to the default mode network were altered in IUD during the task. Moreover, Broca’s area showed altered functional connectivity with other language network and occipital areas in IUD. These findings may address the neural background of decreased verbal fluency performance previously reported in the literature, and we emphasize that beside the brain’s reward and inhibitory control systems, the language system is the next candidate to be involved in the pathogenesis of IUD.

Aging Affects Subcortical Pitch Information Encoding Differently in Humans With Different Language Backgrounds

Aging and language background have been shown to affect pitch information encoding at the subcortical level. To study the individual and compounded effects on subcortical pitch information encoding, Frequency Following Responses were recorded from subjects across various ages and language backgrounds. Differences were found in pitch information encoding strength and accuracy among the groups, indicating that language experience and aging affect accuracy and magnitude of pitch information encoding ability at the subcortical level. Moreover, stronger effects of aging were seen in the magnitude of phase-locking in the native language speaker groups, while language background appears to have more impact on the accuracy of pitch tracking in older adult groups.

Task-induced brain functional connectivity as a representation of schema for mediating unsupervised and supervised learning dynamics in language acquisition

INTRODUCTION

Based on the schema theory advanced by Rumelhart and Norman, we shed light on the individual variability in brain dynamics induced by hybridization of learning methodologies, particularly alternating unsupervised learning and supervised learning in language acquisition. The concept of "schema" implies a latent knowledge structure that a learner holds and updates as intrinsic to his or her cognitive space for guiding the processing of newly arriving information.

METHODS

We replicated the cognitive experiment of Onnis and Thiessen on implicit statistical learning ability in language acquisition but included additional factors of prosodic variables and explicit supervised learning. Functional magnetic resonance imaging was performed to identify the functional network connections for schema updating by alternately using unsupervised and supervised artificial grammar learning tasks to segment potential words.

RESULTS

Regardless of the quality of task performance, the default mode network represented the first stage of spontaneous unsupervised learning, and the wrap-up accomplishment for successful subjects of the whole hybrid learning in concurrence with the task-related auditory language networks. Furthermore, subjects who could easily "tune" the schema for recording a high task precision rate resorted even at an early stage to a self-supervised learning, or "superlearning," as a set of different learning mechanisms that act in synergy to trigger widespread neuro-transformation with a focus on the cerebellum.

CONCLUSIONS

Investigation of the brain dynamics revealed by functional connectivity imaging analysis was able to differentiate the synchronized neural responses with respect to learning methods and the order effect that affects hybrid learning.

Myeloarchitectonic Asymmetries of Language Regions in the Human Brain

One prominent theory in neuroscience and psychology assumes that cortical regions for language are left hemisphere lateralized in the human brain. In the current study, we used a novel technique, quantitative magnetic resonance imaging (qMRI), to examine interhemispheric asymmetries in language regions in terms of macromolecular tissue volume (MTV) and quantitative longitudinal relaxation time (T1) maps in the living human brain. These two measures are known to reflect cortical myeloarchitecture from the microstructural perspective. One hundred and fifteen adults (55 male, 60 female) were examined for their myeloarchitectonic asymmetries of language regions. We found that the cortical myeloarchitecture of inferior frontal areas including the pars opercularis, pars triangularis, and pars orbitalis is left lateralized, while that of the middle temporal gyrus, Heschl’s gyrus, and planum temporale is right lateralized. Moreover, the leftward lateralization of myelination structure is significantly correlated with language skills measured by phonemic and speech tone awareness. This study reveals for the first time a mixed pattern of myeloarchitectonic asymmetries, which calls for a general theory to accommodate the full complexity of principles underlying human hemispheric specialization.

Acoustics versus linguistics? Context is Part and Parcel to lateralized processing of the parts and parcels of speech

The purpose of this review is to provide an accessible exploration of key considerations of lateralization in speech and non-speech perception using clear and defined language. From these considerations, the primary arguments for each side of the linguistics versus acoustics debate are outlined and explored in context of emerging integrative theories. This theoretical approach entails a perspective that linguistic and acoustic features differentially contribute to leftward bias, depending on the given context. Such contextual factors include stimulus parameters and variables of stimulus presentation (e.g., noise/silence and monaural/binaural) and variances in individuals (sex, handedness, age, and behavioural ability). Discussion of these factors and their interaction is also aimed towards providing an outline of variables that require consideration when developing and reviewing methodology of acoustic and linguistic processing laterality studies. Thus, there are three primary aims in the present paper: (1) to provide the reader with key theoretical perspectives from the acoustics/linguistics debate and a synthesis of the two viewpoints, (2) to highlight key caveats for generalizing findings regarding predominant models of speech laterality, and (3) to provide a practical guide for methodological control using predominant behavioural measures (i.e., gap detection and dichotic listening tasks) and/or neurophysiological measures (i.e., mismatch negativity) of speech laterality.

Asymmetry of Auditory-Motor Speech Processing is Determined by Language Experience

Speech processing relies on interactions between auditory and motor systems and is asymmetrically organized in the human brain. The left auditory system is specialized for processing of phonemes, whereas the right is specialized for processing of pitch changes in speech affecting prosody. In speakers of tonal languages, however, processing of pitch (i.e., tone) changes that alter word meaning is left-lateralized indicating that linguistic function and language experience shape speech processing asymmetries. Here, we investigated the asymmetry of motor contributions to auditory speech processing in male and female speakers of tonal and non-tonal languages. We temporarily disrupted the right or left speech motor cortex using transcranial magnetic stimulation (TMS) and measured the impact of these disruptions on auditory discrimination (mismatch negativity; MMN) responses to phoneme and tone changes in sequences of syllables using electroencephalography (EEG). We found that the effect of motor disruptions on processing of tone changes differed between language groups: disruption of the right speech motor cortex suppressed responses to tone changes in non-tonal language speakers, whereas disruption of the left speech motor cortex suppressed responses to tone changes in tonal language speakers. In non-tonal language speakers, the effects of disruption of left speech motor cortex on responses to tone changes were inconclusive. For phoneme changes, disruption of left but not right speech motor cortex suppressed responses in both language groups. We conclude that the contributions of the right and left speech motor cortex to auditory speech processing are determined by the functional roles of acoustic cues in the listener's native language.SIGNIFICANCE STATEMENT The principles underlying hemispheric asymmetries of auditory speech processing remain debated. The asymmetry of processing of speech sounds is affected by low-level acoustic cues, but also by their linguistic function. By combining transcranial magnetic stimulation (TMS) and electroencephalography (EEG), we investigated the asymmetry of motor contributions to auditory speech processing in tonal and non-tonal language speakers. We provide causal evidence that the functional role of the acoustic cues in the listener's native language affects the asymmetry of motor influences on auditory speech discrimination ability [indexed by mismatch negativity (MMN) responses]. Lateralized top-down motor influences can affect asymmetry of speech processing in the auditory system.

The Influence of Tonal and Atonal Bilingualism on Children's Lexical and Non-Lexical Tone Perception

This study examined how bilingualism in an atonal language, in addition to a tonal language, influences lexical and non-lexical tone perception and word learning during childhood. Forty children aged 5;3-7;2, bilingual either in English and Mandarin or English and another atonal language, were tested on Mandarin lexical tone discrimination, level-pitch sine-wave tone discrimination, and learning of novel words differing minimally in Mandarin lexical tone. Mandarin-English bilingual children discriminated between and learned novel words differing minimally in Mandarin lexical tone more accurately than their atonal-English bilingual peers. However, Mandarin-English and atonal-English bilingual children discriminated between level-pitch sine-wave tones with similar accuracy. Moreover, atonal-English bilingual children showed a tendency to perceive differing Mandarin lexical and level-pitch sine-wave tones as identical, whereas their Mandarin-English peers showed no such tendency. These results indicate that bilingualism in a tonal language in addition to an atonal language-but not bilingualism in two atonal languages-allows for continued sensitivity to lexical tone beyond infancy. Moreover, they suggest that although tonal-atonal bilingualism does not enhance sensitivity to differences in pitch between sine-wave tones beyond infancy any more effectively than atonal-atonal bilingualism, it protects against the development of biases to perceive differing lexical and non-lexical tones as identical. Together, the results indicate that, beyond infancy, tonal-atonal bilinguals process lexical tones using different cognitive mechanisms than atonal-atonal bilinguals, but that both groups process level-pitch non-lexical tone using the same cognitive mechanisms.

Neural correlates and functional connectivity of lexical tone processing in reading

Lexical tone processing in speech is mediated by bilateral superior temporal and inferior prefrontal regions, but little is known concerning the neural circuitries of lexical tone phonology in reading. Using fMRI, we examined the neural systems for lexical tone in visual Chinese word recognition. We found that the extraction of lexical tone phonology in print was subserved by bilateral fronto-parietal regions. Seed-to-voxel analyses showed that functionally connected cortical regions involved right inferior frontal gyrus and SMA, right middle frontal gyrus and right inferior parietal lobule, and SMA and bilateral cingulate gyri. Our results indicate that in Chinese tone reading, a bilateral network of frontal, parietal, motor, and cingulate regions is engaged, without involvement of temporal regions crucial for tone identification in auditory domain. Although neural couplings for lexical tone processing are different in speech and reading to some degree, the motor cortex seems to be a key component independent of modality.

Abnormal resting-state functional network centrality in patients with high myopia: evidence from a voxel-wise degree centrality analysis

AIM

To investigate the functional networks underlying the brain-activity changes of patients with high myopia using the voxel-wise degree centrality (DC) method.

METHODS

In total, 38 patients with high myopia (HM) (17 males and 21 females), whose binocular refractive diopter were -6.00 to -7.00 D, and 38 healthy controls (17 males and 21 females), closely matched in age, sex, and education levels, participated in the study. Spontaneous brain activities were evaluated using the voxel-wise DC method. The receiver operating characteristic curve was measured to distinguish patients with HM from healthy controls. Correlation analysis was used to explore the relationship between the observed mean DC values of the different brain areas and the behavioral performance.

RESULTS

Compared with healthy controls, HM patients had significantly decreased DC values in the right inferior frontal gyrus/insula, right middle frontal gyrus, and right supramarginal/inferior parietal lobule (P<0.05). In contrast, HM patients had significantly increased DC values in the right cerebellum posterior lobe, left precentral gyrus/postcentral gyrus, and right middle cingulate gyrus (P<0.05). However, no relationship was found between the observed mean DC values of the different brain areas and the behavioral performance (P>0.05).

CONCLUSION

HM is associated with abnormalities in many brain regions, which may indicate the neural mechanisms of HM. The altered DC values may be used as a useful biomarker for the brain activity changes in HM patients.

The Functional Neuroanatomy of Lexical Tone Perception: An Activation Likelihood Estimation Meta-Analysis

In tonal language such as Chinese, lexical tone serves as a phonemic feature in determining word meaning. Meanwhile, it is close to prosody in terms of suprasegmental pitch variations and larynx-based articulation. The important yet mixed nature of lexical tone has evoked considerable studies, but no consensus has been reached on its functional neuroanatomy. This meta-analysis aimed at uncovering the neural network of lexical tone perception in comparison with that of phoneme and prosody in a unified framework. Independent Activation Likelihood Estimation meta-analyses were conducted for different linguistic elements: lexical tone by native tonal language speakers, lexical tone by non-tonal language speakers, phoneme, word-level prosody, and sentence-level prosody. Results showed that lexical tone and prosody studies demonstrated more extensive activations in the right than the left auditory cortex, whereas the opposite pattern was found for phoneme studies. Only tonal language speakers consistently recruited the left anterior superior temporal gyrus (STG) for processing lexical tone, an area implicated in phoneme processing and word-form recognition. Moreover, an anterior-lateral to posterior-medial gradient of activation as a function of element timescale was revealed in the right STG, in which the activation for lexical tone lied between that for phoneme and that for prosody. Another topological pattern was shown on the left precentral gyrus (preCG), with the activation for lexical tone overlapped with that for prosody but ventral to that for phoneme. These findings provide evidence that the neural network for lexical tone perception is hybrid with those for phoneme and prosody. That is, resembling prosody, lexical tone perception, regardless of language experience, involved right auditory cortex, with activation localized between sites engaged by phonemic and prosodic processing, suggesting a hierarchical organization of representations in the right auditory cortex. For tonal language speakers, lexical tone additionally engaged the left STG lexical mapping network, consistent with the phonemic representation. Similarly, when processing lexical tone, only tonal language speakers engaged the left preCG site implicated in prosody perception, consistent with tonal language speakers having stronger articulatory representations for lexical tone in the laryngeal sensorimotor network. A dynamic dual-stream model for lexical tone perception was proposed and discussed.

Cooperative cortical network for categorical processing of Chinese lexical tone

The variation of pitch in speech not only creates the intonation for affective communication but also signals different meaning of a word in tonal languages, like Chinese. Due to its subtle and brisk pitch contour distinction between tone categories, the underlying neural processing mechanism is largely unknown. Using direct recordings of the human brain, we found categorical neural responses to lexical tones over a distributed cooperative network that included not only the auditory areas in the temporal cortex but also motor areas in the frontal cortex. Strong causal links from the temporal cortex to the motor cortex were discovered, which provides new evidence of top-down influence and sensory–motor interaction during speech perception.

In tonal languages such as Chinese, lexical tone with varying pitch contours serves as a key feature to provide contrast in word meaning. Similar to phoneme processing, behavioral studies have suggested that Chinese tone is categorically perceived. However, its underlying neural mechanism remains poorly understood. By conducting cortical surface recordings in surgical patients, we revealed a cooperative cortical network along with its dynamics responsible for this categorical perception. Based on an oddball paradigm, we found amplified neural dissimilarity between cross-category tone pairs, rather than between within-category tone pairs, over cortical sites covering both the ventral and dorsal streams of speech processing. The bilateral superior temporal gyrus (STG) and the middle temporal gyrus (MTG) exhibited increased response latencies and enlarged neural dissimilarity, suggesting a ventral hierarchy that gradually differentiates the acoustic features of lexical tones. In addition, the bilateral motor cortices were also found to be involved in categorical processing, interacting with both the STG and the MTG and exhibiting a response latency in between. Moreover, the motor cortex received enhanced Granger causal influence from the semantic hub, the anterior temporal lobe, in the right hemisphere. These unique data suggest that there exists a distributed cooperative cortical network supporting the categorical processing of lexical tone in tonal language speakers, not only encompassing a bilateral temporal hierarchy that is shared by categorical processing of phonemes but also involving intensive speech–motor interactions over the right hemisphere, which might be the unique machinery responsible for the reliable discrimination of tone identities.

A Meta-Analytic Study of the Neural Systems for Auditory Processing of Lexical Tones

The neural systems of lexical tone processing have been studied for many years. However, previous findings have been mixed with regard to the hemispheric specialization for the perception of linguistic pitch patterns in native speakers of tonal language. In this study, we performed two activation likelihood estimation (ALE) meta-analyses, one on neuroimaging studies of auditory processing of lexical tones in tonal languages (17 studies), and the other on auditory processing of lexical information in non-tonal languages as a control analysis for comparison (15 studies). The lexical tone ALE analysis showed significant brain activations in bilateral inferior prefrontal regions, bilateral superior temporal regions and the right caudate, while the control ALE analysis showed significant cortical activity in the left inferior frontal gyrus and left temporo-parietal regions. However, we failed to obtain significant differences from the contrast analysis between two auditory conditions, which might be caused by the limited number of studies available for comparison. Although the current study lacks evidence to argue for a lexical tone specific activation pattern, our results provide clues and directions for future investigations on this topic, more sophisticated methods are needed to explore this question in more depth as well.

Pitch Perception in Tone Language-Speaking Adults With and Without Autism Spectrum Disorders

Enhanced low-level pitch perception has been universally reported in autism spectrum disorders (ASD). This study examined whether tone language speakers with ASD exhibit this advantage. The pitch perception skill of 20 Cantonese-speaking adults with ASD was compared with that of 20 neurotypical individuals. Participants discriminated pairs of real syllable, pseudo-syllable (syllables that do not conform the phonotactic rules or are accidental gaps), and non-speech (syllables with attenuated high-frequency segmental content) stimuli contrasting pitch levels. The results revealed significantly higher discrimination ability in both groups for the non-speech stimuli than for the pseudo-syllables with one semitone difference. No significant group differences were noted. Different from previous findings, post hoc analysis found that enhanced pitch perception was observed in a subgroup of participants with ASD showing no history of delayed speech onset. The tone language experience may have modulated the pitch processing mechanism in the speakers in both ASD and non-ASD groups.

Production of Korean Idiomatic Utterances Following Left- and Right-Hemisphere Damage: Acoustic Studies

PURPOSE

This study investigates the effects of left- and right-hemisphere damage (LHD and RHD) on the production of idiomatic or literal expressions utilizing acoustic analyses.

METHOD

Twenty-one native speakers of Korean with LHD or RHD and in a healthy control (HC) group produced 6 ditropically ambiguous (idiomatic or literal) sentences in 2 different speech tasks: elicitation and repetition. Utterances were analyzed using durational and fundamental-frequency (F0) measures. Listeners' goodness ratings (how well each utterance represented its category: idiomatic or literal) were correlated with acoustic measures.

RESULTS

During the elicitation tasks, the LHD group differed significantly from the HC group in durational measures. Significant differences between the RHD and HC groups were seen in F0 measures. However, for the repetition tasks, the LHD and RHD groups produced utterances comparable to the HC group's performance. Using regression analysis, selected F0 cues were found to be significant predictors for goodness ratings by listeners.

CONCLUSIONS

Using elicitation, speakers in the LHD group were deficient in producing durational cues, whereas RHD negatively affected the production of F0 cues. Performance differed for elicitation and repetition, indicating a task effect. Listeners' goodness ratings were highly correlated with the production of certain acoustic cues. Both the acoustic and functional hypotheses of hemispheric specialization were supported for idiom production.

Neural distance amplification of lexical tone in human auditory cortex

In tonal languages, like Chinese, lexical tone serves as a key feature to provide contrast in word meaning. Behavior studies suggest that Mandarin Chinese tone is categorically perceived. However, the neural mechanism underlying Mandarin tone perception is still poorly understood. In this study, an Oddball paradigm was designed by selecting two standard-deviant stimulus pairs with same physical distance but different category labels, among the synthesized tones with continuously varying pitch contours. Using electrocorticography (ECoG) recording over human auditory cortex, high temporal and spatial resolution cortical neural signals were used for the first time to investigate the cortical processing of lexical tone. Here, we found different neural responses to the two standard-deviant tone pairs, and the difference increased from low to high level along the hierarchy of human auditory cortex. In the two dimensional neural space, cross-category neural distance of lexical tones is selectively amplified on those high level electrodes. These findings support a hierarchical and categorical model of Mandarin tone perception, and favor the using of high-level electrodes for a better performance of lexical tone discrimination in speech brain computer interface.

Processing Cantonese lexical tones: Evidence from oddball paradigms

Two event-related potential (ERP) experiments were conducted to investigate whether Cantonese lexical tones are processed with general auditory perception mechanisms and/or a special speech module. Two tonal features (f0 direction and f0 height deviation) were manipulated to reflect acoustic processing, and the contrast between syllables and hums was used to reveal the involvement of a speech module. Experiment 1 adopted a passive oddball paradigm to study a relatively early stage of tonal processing. Mismatch negativity (MMN) and novelty P3 (P3a) were modulated by the interaction between tonal feature and stimulus type. Similar interactions were found for N2 and P3 in Experiment 2, where more in-depth tonal processing was examined with an active oddball paradigm. Moreover, detecting tonal deviants of syllables elicited N1 and P2 that were not found in hum detection. Together, these findings suggest that the processing of lexical tone relies on both acoustic and linguistic processes from the early stage. Another noteworthy finding is the absence of brain lateralization in both experiments, which challenges the use of a lateralization pattern as evidence for processing lexical tones through a special speech module.

Music perception: information flow within the human auditory cortices

Information processing of all acoustic stimuli involves temporal lobe regions referred to as auditory cortices, which receive direct afferents from the auditory thalamus. However, the perception of music (as well as speech or spoken language) is a complex process that also involves secondary and association cortices that conform a large functional network. Using different analytical techniques and stimulation paradigms, several studies have shown that certain areas are particularly sensitive to specific acoustic characteristics inherent to music (e.g., rhythm). This chapter reviews the functional anatomy of the auditory cortices, and highlights specific experiments that suggest the existence of distinct cortical networks for the perception of music and speech.

Brainstem encoding of speech and musical stimuli in congenital amusia: evidence from Cantonese speakers

Congenital amusia is a neurodevelopmental disorder of musical processing that also impacts subtle aspects of speech processing. It remains debated at what stage(s) of auditory processing deficits in amusia arise. In this study, we investigated whether amusia originates from impaired subcortical encoding of speech (in quiet and noise) and musical sounds in the brainstem. Fourteen Cantonese-speaking amusics and 14 matched controls passively listened to six Cantonese lexical tones in quiet, two Cantonese tones in noise (signal-to-noise ratios at 0 and 20 dB), and two cello tones in quiet while their frequency-following responses (FFRs) to these tones were recorded. All participants also completed a behavioral lexical tone identification task. The results indicated normal brainstem encoding of pitch in speech (in quiet and noise) and musical stimuli in amusics relative to controls, as measured by FFR pitch strength, pitch error, and stimulus-to-response correlation. There was also no group difference in neural conduction time or FFR amplitudes. Both groups demonstrated better FFRs to speech (in quiet and noise) than to musical stimuli. However, a significant group difference was observed for tone identification, with amusics showing significantly lower accuracy than controls. Analysis of the tone confusion matrices suggested that amusics were more likely than controls to confuse between tones that shared similar acoustic features. Interestingly, this deficit in lexical tone identification was not coupled with brainstem abnormality for either speech or musical stimuli. Together, our results suggest that the amusic brainstem is not functioning abnormally, although higher-order linguistic pitch processing is impaired in amusia. This finding has significant implications for theories of central auditory processing, requiring further investigations into how different stages of auditory processing interact in the human brain.

Cortical plasticity induced by rapid Hebbian learning of novel tonal word-forms: evidence from mismatch negativity

Although several experiments reported rapid cortical plasticity induced by passive exposure to novel segmental patterns, few studies have devoted attention to the neural dynamics during the rapid learning of novel tonal word-forms in tonal languages, such as Chinese. In the current study, native speakers of Mandarin Chinese were exposed to acoustically matched real and novel segment-tone patterns. By recording their Mismatch Negativity (MMN) responses (an ERP indicator of long-term memory traces for spoken words), we found enhanced MMNs to the novel word-forms over the left-hemispheric region in the late exposure phase relative to the early exposure phase. In contrast, no significant changes were identified in MMN responses to the real word during familiarisation. Our results suggest a rapid Hebbian learning mechanism in the human neocortex which develops long-term memory traces for a novel segment-tone pattern by establishing new associations between the segmental and tonal representations.

Mapping the unconscious maintenance of a lost first language

Optimal periods during early development facilitate the formation of perceptual representations, laying the framework for future learning. A crucial question is whether such early representations are maintained in the brain over time without continued input. Using functional MRI, we show that internationally adopted (IA) children from China, exposed exclusively to French since adoption (mean age of adoption, 12.8 mo), maintained neural representations of their birth language despite functionally losing that language and having no conscious recollection of it. Their neural patterns during a Chinese lexical tone discrimination task matched those observed in Chinese/French bilinguals who have had continual exposure to Chinese since birth and differed from monolingual French speakers who had never been exposed to Chinese. They processed lexical tone as linguistically relevant, despite having no Chinese exposure for 12.6 y, on average, and no conscious recollection of that language. More specifically, IA participants recruited left superior temporal gyrus/planum temporale, matching the pattern observed in Chinese/French bilinguals. In contrast, French speakers who had never been exposed to Chinese did not recruit this region and instead activated right superior temporal gyrus. We show that neural representations are not overwritten and suggest a special status for language input obtained during the first year of development.

Neural signatures of lexical tone reading

Research on how lexical tone is neuroanatomically represented in the human brain is central to our understanding of cortical regions subserving language. Past studies have exclusively focused on tone perception of the spoken language, and little is known as to the lexical tone processing in reading visual words and its associated brain mechanisms. In this study, we performed two experiments to identify neural substrates in Chinese tone reading. First, we used a tone judgment paradigm to investigate tone processing of visually presented Chinese characters. We found that, relative to baseline, tone perception of printed Chinese characters were mediated by strong brain activation in bilateral frontal regions, left inferior parietal lobule, left posterior middle/medial temporal gyrus, left inferior temporal region, bilateral visual systems, and cerebellum. Surprisingly, no activation was found in superior temporal regions, brain sites well known for speech tone processing. In activation likelihood estimation (ALE) meta-analysis to combine results of relevant published studies, we attempted to elucidate whether the left temporal cortex activities identified in Experiment one is consistent with those found in previous studies of auditory lexical tone perception. ALE results showed that only the left superior temporal gyrus and putamen were critical in auditory lexical tone processing. These findings suggest that activation in the superior temporal cortex associated with lexical tone perception is modality-dependent.

Multiparametric MRI characterization and prediction in autism spectrum disorder using graph theory and machine learning

This study employed graph theory and machine learning analysis of multiparametric MRI data to improve characterization and prediction in autism spectrum disorders (ASD). Data from 127 children with ASD (13.5±6.0 years) and 153 age- and gender-matched typically developing children (14.5±5.7 years) were selected from the multi-center Functional Connectome Project. Regional gray matter volume and cortical thickness increased, whereas white matter volume decreased in ASD compared to controls. Small-world network analysis of quantitative MRI data demonstrated decreased global efficiency based on gray matter cortical thickness but not with functional connectivity MRI (fcMRI) or volumetry. An integrative model of 22 quantitative imaging features was used for classification and prediction of phenotypic features that included the autism diagnostic observation schedule, the revised autism diagnostic interview, and intelligence quotient scores. Among the 22 imaging features, four (caudate volume, caudate-cortical functional connectivity and inferior frontal gyrus functional connectivity) were found to be highly informative, markedly improving classification and prediction accuracy when compared with the single imaging features. This approach could potentially serve as a biomarker in prognosis, diagnosis, and monitoring disease progression.

Temporal relation between top-down and bottom-up processing in lexical tone perception

Speech perception entails both top-down processing that relies primarily on language experience and bottom-up processing that depends mainly on instant auditory input. Previous models of speech perception often claim that bottom-up processing occurs in an early time window, whereas top-down processing takes place in a late time window after stimulus onset. In this paper, we evaluated the temporal relation of both types of processing in lexical tone perception. We conducted a series of event-related potential (ERP) experiments that recruited Mandarin participants and adopted three experimental paradigms, namely dichotic listening, lexical decision with phonological priming, and semantic violation. By systematically analyzing the lateralization patterns of the early and late ERP components that are observed in these experiments, we discovered that: auditory processing of pitch variations in tones, as a bottom-up effect, elicited greater right hemisphere activation; in contrast, linguistic processing of lexical tones, as a top-down effect, elicited greater left hemisphere activation. We also found that both types of processing co-occurred in both the early (around 200 ms) and late (around 300–500 ms) time windows, which supported a parallel model of lexical tone perception. Unlike the previous view that language processing is special and performed by dedicated neural circuitry, our study have elucidated that language processing can be decomposed into general cognitive functions (e.g., sensory and memory) and share neural resources with these functions.

Perceptual pitch deficits coexist with pitch production difficulties in music but not Mandarin speech

Congenital amusia is a musical disorder that mainly affects pitch perception. Among Mandarin speakers, some amusics also have difficulties in processing lexical tones (tone agnosics). To examine to what extent these perceptual deficits may be related to pitch production impairments in music and Mandarin speech, eight amusics, eight tone agnosics, and 12 age- and IQ-matched normal native Mandarin speakers were asked to imitate music note sequences and Mandarin words of comparable lengths. The results indicated that both the amusics and tone agnosics underperformed the controls on musical pitch production. However, tone agnosics performed no worse than the amusics, suggesting that lexical tone perception deficits may not aggravate musical pitch production difficulties. Moreover, these three groups were all able to imitate lexical tones with perfect intelligibility. Taken together, the current study shows that perceptual musical pitch and lexical tone deficits might coexist with musical pitch production difficulties. But at the same time these perceptual pitch deficits might not affect lexical tone production or the intelligibility of the speech words that were produced. The perception-production relationship for pitch among individuals with perceptual pitch deficits may be, therefore, domain-dependent.

Role of semantic paradigms for optimization of language mapping in clinical FMRI studies

BACKGROUND AND PURPOSE

The optimal paradigm choice for language mapping in clinical fMRI studies is challenging due to the variability in activation among different paradigms, the contribution to activation of cognitive processes other than language, and the difficulties in monitoring patient performance. In this study, we compared language localization and lateralization between 2 commonly used clinical language paradigms and 3 newly designed dual-choice semantic paradigms to define a streamlined and adequate language-mapping protocol.

MATERIALS AND METHODS

Twelve healthy volunteers performed 5 language paradigms: Silent Word Generation, Sentence Completion, Visual Antonym Pair, Auditory Antonym Pair, and Noun-Verb Association. Group analysis was performed to assess statistically significant differences in fMRI percentage signal change and lateralization index among these paradigms in 5 ROIs: inferior frontal gyrus, superior frontal gyrus, middle frontal gyrus for expressive language activation, middle temporal gyrus, and superior temporal gyrus for receptive language activation.

RESULTS

In the expressive ROIs, Silent Word Generation was the most robust and best lateralizing paradigm (greater percentage signal change and lateralization index than semantic paradigms at P < .01 and P < .05 levels, respectively). In the receptive region of interest, Sentence Completion and Noun-Verb Association were the most robust activators (greater percentage signal change than other paradigms, P < .01). All except Auditory Antonym Pair were good lateralizing tasks (the lateralization index was significantly lower than other paradigms, P < .05).

CONCLUSIONS

The combination of Silent Word Generation and ≥1 visual semantic paradigm, such as Sentence Completion and Noun-Verb Association, is adequate to determine language localization and lateralization; Noun-Verb Association has the additional advantage of objective monitoring of patient performance.

Hemispheric lateralization for early auditory processing of lexical tones: dependence on pitch level and pitch contour

In Mandarin Chinese, a tonal language, pitch level and pitch contour are two dimensions of lexical tones according to their acoustic features (i.e., pitch patterns). A change in pitch level features a step change whereas that in pitch contour features a continuous variation in voice pitch. Currently, relatively little is known about the hemispheric lateralization for the processing of each dimension. To address this issue, we made whole-head electrical recordings of mismatch negativity in native Chinese speakers in response to the contrast of Chinese lexical tones in each dimension. We found that pre-attentive auditory processing of pitch level was obviously lateralized to the right hemisphere whereas there is a tendency for that of pitch contour to be lateralized to the left. We also found that the brain responded faster to pitch level than to pitch contour at a pre-attentive stage. These results indicate that the hemispheric lateralization for early auditory processing of lexical tones depends on the pitch level and pitch contour, and suggest an underlying inter-hemispheric interactive mechanism for the processing.

Access to lexical meaning in pitch-flattened Chinese sentences: an fMRI study

Chinese is a tonal language in which variation in pitch is used to distinguish word meanings. Thus, in order to understand a word, listeners have to extract the pitch patterns in addition to its phonemes. Can the correct word meaning still be accessed in sentence contexts if pitch patterns of words are altered? If so, how is this accomplished? The present study attempts to address such questions with event-related functional magnetic resonance imaging (fMRI). Native speakers of Mandarin Chinese listened to normal and pitch-flattened (monotone) speech inside the scanner. The behavioral results indicated that they rated monotone sentences as intelligible as normal sentences, and performed equally well in a dictation test on the two types of sentences. The fMRI results showed that both types of sentences elicited similar activation in the left insular, middle and inferior temporal gyri, but the monotone sentences elicited greater activation in the left planum temporale (PT) compared with normal sentences. These results demonstrate that lexical meaning can still be accessed in pitch-flattened Chinese sentences, and that this process is realized by automatic recovery of the phonological representations of lexical tones from the altered tonal patterns. Our findings suggest that the details of spoken pitch patterns are not essential for adequate lexical-semantic processing during sentence comprehension even in tonal languages like Mandarin Chinese, given that listeners can automatically use additional neural and cognitive resources to recover distorted tonal patterns in sentences.

Reading acquisition reorganizes the phonological awareness network only in alphabetic writing systems

It is unknown how experience with different types of orthographies influences the neural basis of oral language processing. In order to determine the effects of alphabetic and nonalphabetic writing systems, the current study examined the influence of learning to read on oral language in English and Chinese speakers. Children (8-12 years olds) and adults made rhyming judgments to pairs of spoken words during functional magnetic resonance imaging (fMRI). Developmental increases were seen only for English speakers in the left hemisphere phonological network (superior temporal gyrus (STG), inferior parietal lobule, and inferior frontal gyrus). The increase in the STG was more pronounced for words with conflicting orthography (e.g. pint-mint; jazz-has) even though access to orthography was irrelevant to the task. Moreover, higher reading skill was correlated with greater activation in the STG only for English speaking children. The effects suggest that learning to read reorganizes the phonological awareness network only for alphabetic and not logographic writing systems because of differences in the principles for mapping between orthographic and phonological representations. The reorganization of the auditory cortex may result in better phonological awareness skills in alphabetic readers.

A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading

The anatomy of language has been investigated with PET or fMRI for more than 20 years. Here I attempt to provide an overview of the brain areas associated with heard speech, speech production and reading. The conclusions of many hundreds of studies were considered, grouped according to the type of processing, and reported in the order that they were published. Many findings have been replicated time and time again leading to some consistent and undisputable conclusions. These are summarised in an anatomical model that indicates the location of the language areas and the most consistent functions that have been assigned to them. The implications for cognitive models of language processing are also considered. In particular, a distinction can be made between processes that are localized to specific structures (e.g. sensory and motor processing) and processes where specialisation arises in the distributed pattern of activation over many different areas that each participate in multiple functions. For example, phonological processing of heard speech is supported by the functional integration of auditory processing and articulation; and orthographic processing is supported by the functional integration of visual processing, articulation and semantics. Future studies will undoubtedly be able to improve the spatial precision with which functional regions can be dissociated but the greatest challenge will be to understand how different brain regions interact with one another in their attempts to comprehend and produce language.

Perception of words and pitch patterns in song and speech

This functional magnetic resonance imaging study examines shared and distinct cortical areas involved in the auditory perception of song and speech at the level of their underlying constituents: words and pitch patterns. Univariate and multivariate analyses were performed to isolate the neural correlates of the word- and pitch-based discrimination between song and speech, corrected for rhythmic differences in both. Therefore, six conditions, arranged in a subtractive hierarchy were created: sung sentences including words, pitch and rhythm; hummed speech prosody and song melody containing only pitch patterns and rhythm; and as a control the pure musical or speech rhythm. Systematic contrasts between these balanced conditions following their hierarchical organization showed a great overlap between song and speech at all levels in the bilateral temporal lobe, but suggested a differential role of the inferior frontal gyrus (IFG) and intraparietal sulcus (IPS) in processing song and speech. While the left IFG coded for spoken words and showed predominance over the right IFG in prosodic pitch processing, an opposite lateralization was found for pitch in song. The IPS showed sensitivity to discrete pitch relations in song as opposed to the gliding pitch in speech. Finally, the superior temporal gyrus and premotor cortex coded for general differences between words and pitch patterns, irrespective of whether they were sung or spoken. Thus, song and speech share many features which are reflected in a fundamental similarity of brain areas involved in their perception. However, fine-grained acoustic differences on word and pitch level are reflected in the IPS and the lateralized activity of the IFG.

Congenital Amusia (or Tone-Deafness) Interferes with Pitch Processing in Tone Languages

Congenital amusia is a neurogenetic disorder that affects music processing and that is ascribed to a deficit in pitch processing. We investigated whether this deficit extended to pitch processing in speech, notably the pitch changes used to contrast lexical tones in tonal languages. Congenital amusics and matched controls, all non-tonal language speakers, were tested for lexical tone discrimination in Mandarin Chinese (Experiment 1) and in Thai (Experiment 2). Tones were presented in pairs and participants were required to make same/different judgments. Experiment 2 additionally included musical analogs of Thai tones for comparison. Performance of congenital amusics was inferior to that of controls for all materials, suggesting a domain-general pitch-processing deficit. The pitch deficit of amusia is thus not limited to music, but may compromise the ability to process and learn tonal languages. Combined with acoustic analyses of the tone material, the present findings provide new insights into the nature of the pitch-processing deficit exhibited by amusics.

Cortical language mapping using electrical cortical stimulation for Mandarin-speaking patients with epilepsy: a report of six case studies

OBJECTIVE

The goal of this study was to summarize the results of language cortex mapping using electrical cortical stimulation with modified language tasks for Mandarin-speaking patients with epilepsy.

METHODS

Electrical currents were delivered through implanted subdural electrodes to six Mandarin-speaking patients before epilepsy surgery. The current intensities inducing any language disturbance during comprehension, repetition, and speech tasks were recorded, and individual cortical mapping was completed to guide subsequent resection, with the distance between mapped language sites and resected zones kept at a minimum of 0.5 cm. Language function was reassessed and followed up after surgery.

RESULTS

Language cortices were successfully identified in three patients, but demonstrated great variability in distribution. There seemed to be no difference in the intensity threshold that induced language interference. None of the six patients exhibited language deficits postsurgery.

CONCLUSIONS

Electrical cortical stimulation with modified language tasks is valid for identification of cortices underlying Mandarin processing. The great variability in language cortex distribution enhances the necessity of individual language cortical mapping in epilepsy surgery.

Common and distinct neural substrates for the perception of speech rhythm and intonation

The present study examines the neural substrates for the perception of speech rhythm and intonation. Subjects listened passively to synthesized speech stimuli that contained no semantic and phonological information, in three conditions: (1) continuous speech stimuli with fixed syllable duration and fundamental frequency in the standard condition, (2) stimuli with varying vocalic durations of syllables in the speech rhythm condition, and (3) stimuli with varying fundamental frequency in the intonation condition. Compared to the standard condition, speech rhythm activated the right middle superior temporal gyrus (mSTG), whereas intonation activated the bilateral superior temporal gyrus and sulcus (STG/STS) and the right posterior STS. Conjunction analysis further revealed that rhythm and intonation activated a common area in the right mSTG but compared to speech rhythm, intonation elicited additional activations in the right anterior STS. Findings from the current study reveal that the right mSTG plays an important role in prosodic processing. Implications of our findings are discussed with respect to neurocognitive theories of auditory processing.

Categorical perception of lexical tones in Chinese revealed by mismatch negativity

The present study investigated the neurophysiological correlates of categorical perception of Chinese lexical tones in Mandarin Chinese. Relative to standard stimuli, both within- and across-category deviants elicited mismatch negativity (MMN) in bilateral frontal-central recording sites. The MMN elicited in the right sites was marginally larger than in the left sites, which reflects the role of the right hemisphere in acoustic processing. At the same time, relative to within-category deviants, the across-category deviants elicited larger MMN in the left recording sites, reflecting the long-term phonemic traces of lexical tones. These results provide strong neurophysiological evidence in support of categorical perception of lexical tones in Chinese. More important, they demonstrate that acoustic and phonological information is processed in parallel within the MMN time window for the perception of lexical tones. Finally, homologous nonspeech stimuli elicited similar MMN patterns, indicating that lexical tone knowledge influences the perception of nonspeech signals.