Just-noticeable difference of tone pitch contour change for Mandarin congenital amusics

Mandarin-Speaking Amusics' Online Recognition of Tone and Intonation

PURPOSE

Congenital amusia is a neurogenetic disorder of musical pitch processing. Its linguistic consequences have been examined separately for speech intonations and lexical tones. However, in a tonal language such as Chinese, the processing of intonations and lexical tones interacts with each other during online speech perception. Whether and how the musical pitch disorder might affect linguistic pitch processing during online speech perception remains unknown.

METHOD

We investigated this question with intonation (question vs. statement) and lexical tone (rising Tone 2 vs. falling Tone 4) identification tasks using the same set of sentences, comparing behavioral and event-related potential measurements between Mandarin-speaking amusics and matched controls. We specifically focused on the amusics without behavioral lexical tone deficits (the majority, i.e., pure amusics).

RESULTS

Results showed that, despite relative to normal performance when tested in word lexical tone test, pure amusics demonstrated inferior recognition than controls during sentence tone and intonation identification. Compared to controls, pure amusics had larger N400 amplitudes in question stimuli during tone task and smaller P600 amplitudes in intonation task.

CONCLUSION

These data indicate that musical pitch disorder affects both tone and intonation processing during sentence processing even for pure amusics, whose lexical tone processing was intact when tested with words.

Tone Deafness in Music Does Not Preclude Distributional Learning of Nonnative Tonal Languages in Individuals With Congenital Amusia

PURPOSE

Previous studies have shown that individuals with congenital amusia exhibit deficient pitch processing across music and language domains. This study investigated whether adult Chinese-speaking listeners with amusia were still able to learn Thai lexical tones based on stimulus frequency of statistical distribution via distributional learning, despite their degraded lexical tone perception.

METHOD

Following a pretest-training-posttest design, 21 amusics and 23 typical, musically intact listeners were assigned into bimodal and unimodal distribution conditions. Listeners were asked to discriminate minimal pairs of Thai mid-level tone and falling tone superimposed on variable base syllables and uttered by different speakers. The perceptual accuracy for each test session and improvement from pretest to posttest were collected and analyzed between the two groups using generalized mixed-effects models.

RESULTS

When discriminating Thai lexical tones, amusics were less accurate than typical listeners. Nonetheless, similarly to control listeners, perceptual gains from pretest to posttest were observed in bimodally rather than unimodally trained amusics, as evidenced by both trained and nontrained test words.

CONCLUSIONS

Amusics are able to learn lexical tones in a second or foreign context of speech. This extends previous research by showing that amusics' distributional learning of linguistic pitch remains largely preserved despite their degraded pitch processing. It is thus likely that manifestations of amusia in speech could not result from their abnormal statistical learning mechanism. This study meanwhile provides a heuristic approach for future studies to apply this paradigm into amusics' treatment to mitigate their pitch-processing disorder.

The Musical Abilities, Pleiotropy, Language, and Environment (MAPLE) Framework for Understanding Musicality-Language Links Across the Lifespan

Using individual differences approaches, a growing body of literature finds positive associations between musicality and language-related abilities, complementing prior findings of links between musical training and language skills. Despite these associations, musicality has been often overlooked in mainstream models of individual differences in language acquisition and development. To better understand the biological basis of these individual differences, we propose the Musical Abilities, Pleiotropy, Language, and Environment (MAPLE) framework. This novel integrative framework posits that musical and language-related abilities likely share some common genetic architecture (i.e., genetic pleiotropy) in addition to some degree of overlapping neural endophenotypes, and genetic influences on musically and linguistically enriched environments. Drawing upon recent advances in genomic methodologies for unraveling pleiotropy, we outline testable predictions for future research on language development and how its underlying neurobiological substrates may be supported by genetic pleiotropy with musicality. In support of the MAPLE framework, we review and discuss findings from over seventy behavioral and neural studies, highlighting that musicality is robustly associated with individual differences in a range of speech-language skills required for communication and development. These include speech perception-in-noise, prosodic perception, morphosyntactic skills, phonological skills, reading skills, and aspects of second/foreign language learning. Overall, the current work provides a clear agenda and framework for studying musicality-language links using individual differences approaches, with an emphasis on leveraging advances in the genomics of complex musicality and language traits.

Pre-attentive fundamental frequency processing in Mandarin-speaking children with cochlear implants as revealed by the peak latency of positive mismatch response

Introduction

Fundamental frequency (F0) serves as the primary acoustic cue for Mandarin tone perception. Recent behavioral studies suggest that F0 information may be differently processed between Mandarin-speaking normal-hearing (NH) children and children with cochlear implants (CIs), which may partially explain the unsatisfactory outcome of lexical tone recognition using CIs with tonal language-oriented speech processing strategies. The aim of the current study was to provide neural evidence of F0 processing in Mandarin-speaking kindergarten-aged children with CIs compared with NH children.

Methods

Positive mismatch responses (p-MMRs) to the change of the two acoustic dimensions of F0 (F0 contour and F0 level) in Mandarin-speaking kindergarten-aged children with CIs (n = 19) and their age-matched NH peers (n = 21).

Results

The two groups of children did not show any significant difference on the mean amplitude of p-MMR to either F0 contour or F0 level change. While the CI group exhibited a significantly shorter peak latency of p-MMR to F0 contour change than to F0 level change, an opposite pattern was observed in the NH group.

Discussion

This study revealed a higher sensitivity to F0 contour change than to F0 level change in children with CIs, which was different from that in NH children. The neural evidence of discrepant F0 processing between children with CIs and NH children in this study was consistent with the previously reported behavioral findings and may serve as a reference for the development and improvement of tonal language-oriented speech processing strategies.

Audiovisual Mandarin Lexical Tone Perception in Quiet and Noisy Contexts: The Influence of Visual Cues and Speech Rate

PURPOSE

Armed with the theory of embodied cognition proposing tight interactions between perception, motor, and cognition, this study aimed to test the hypothesis that speech rate-altered Mandarin lexical tone perception in quiet and noisy environments could be affected by the bodily dynamic cross-modal information.

METHOD

Fifty-three adult listeners completed a Mandarin tone perception task with 720 tone stimuli in auditory-only (AO), auditory-facial (AF), and auditory-facial-plus-gestural (AFG) modalities, at fast, normal, and slow speech rates under quiet and noisy conditions. In AF and AFG modalities, both congruent and incongruent audiovisual information were designed and presented. Generalized linear mixed-effects models were constructed to analyze the accuracy of tone perception across different conditions.

RESULTS

In Mandarin tone perception, the magnitude of enhancement of AF and AFG cues across three speech rates was significantly higher than that of the AO cue in the adverse context of noise, yet additional metaphoric gestures did not show significant differences from the facial information. Furthermore, the performance of auditory tone perception at the fast speech rate was significantly better than that at the normal speech rate when the inputs were incongruent between auditory and visual channels in quiet.

CONCLUSIONS

This study provided compelling evidence showing that integrated audiovisual information plays a vital role not only in improving lexical tone perception in noise but also in modulating the effects of speech rate on Mandarin tone perception in quiet for native listeners. Our findings, supporting the theory of embodied cognition, are implicational for speech and hearing rehabilitation among both young and old clinical populations.

The Perception of Lexical Tone and Intonation in Whispered Speech by Mandarin-Speaking Congenital Amusics

PURPOSE

A fundamental feature of human speech is variation, including the manner of phonation, as exemplified in the case of whispered speech. In this study, we employed whispered speech to examine an unresolved issue about congenital amusia, a neurodevelopmental disorder of musical pitch processing, which also affects speech pitch processing such as lexical tone and intonation perception. The controversy concerns whether amusia is a pitch-processing disorder or can affect speech processing beyond pitch.

METHOD

We examined lexical tone and intonation recognition in 19 Mandarin-speaking amusics and 19 matched controls in phonated and whispered speech, where fundamental frequency (f _o) information is either present or absent.

RESULTS

The results revealed that the performance of congenital amusics was inferior to that of controls in lexical tone identification in both phonated and whispered speech. These impairments were also detected in identifying intonation (statements/questions) in phonated and whispered modes. Across the experiments, regression models revealed that f _o and non-f _o (duration, intensity, and formant frequency) acoustic cues predicted tone and intonation recognition in phonated speech, whereas non-f _o cues predicted tone and intonation recognition in whispered speech. There were significant differences between amusics and controls in the use of both f _o and non-f _o cues.

CONCLUSION

The results provided the first evidence that the impairments of amusics in lexical tone and intonation identification prevail into whispered speech and support the hypothesis that the deficits of amusia extend beyond pitch processing.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.19302275.

Just-Noticeable Differences of Fundamental Frequency Change in Mandarin-Speaking Children with Cochlear Implants

Fundamental frequency (F0) provides the primary acoustic cue for lexical tone perception in tonal languages but remains poorly represented in cochlear implant (CI) systems. Currently, there is still a lack of understanding of sensitivity to F0 change in CI users who speak tonal languages. In the present study, just-noticeable differences (JNDs) of F0 contour and F0 level changes in Mandarin-speaking children with CIs were measured and compared with those in their age-matched normal-hearing (NH) peers. Results showed that children with CIs demonstrated significantly larger JND of F0 contour (JND-C) change and F0 level (JND-L) change compared to NH children. Further within-group comparison revealed that the JND-C change was significantly smaller than the JND-L change among children with CIs, whereas the opposite pattern was observed among NH children. No significant correlations were seen between JND-C change/JND-L change and age at implantation /duration of CI use. The contrast between children with CIs and NH children in sensitivity to F0 contour and F0 level change suggests different mechanisms of F0 processing in these two groups as a result of different hearing experiences.

Individuals With Congenital Amusia Show Degraded Speech Perception but Preserved Statistical Learning for Tone Languages

PURPOSE

Individuals with congenital amusia exhibit degraded speech perception. This study examined whether adult Chinese Mandarin listeners with amusia were still able to extract the statistical regularities of Mandarin speech sounds, despite their degraded speech perception.

METHOD

Using the gating paradigm with monosyllabic syllable-tone words, we tested 19 Mandarin-speaking amusics and 19 musically intact controls. Listeners heard increasingly longer fragments of the acoustic signal across eight duration-blocked gates. The stimuli varied in syllable token frequency and syllable-tone co-occurrence probability. The correct syllable-tone word, correct syllable-only, correct tone-only, and correct syllable-incorrect tone responses were compared respectively between the two groups using mixed-effects models.

RESULTS

Amusics were less accurate than controls in terms of the correct word, correct syllable-only, and correct tone-only responses. Amusics, however, showed consistent patterns of top-down processing, as indicated by more accurate responses to high-frequency syllables, high-probability tones, and tone errors all in manners similar to those of the control listeners.

CONCLUSIONS

Amusics are able to learn syllable and tone statistical regularities from the language input. This extends previous work by showing that amusics can track phonological segment and pitch cues despite their degraded speech perception. The observed speech deficits in amusics are therefore not due to an abnormal statistical learning mechanism. These results support rehabilitation programs aimed at improving amusics' sensitivity to pitch.

Dissociation of tone merger and congenital amusia in Hong Kong Cantonese

While the issue of individual variation has been widely studied in second language learning or processing, it is less well understood how perceptual and musical aptitude differences can explain individual variation in native speech processing. In the current study, we make use of tone merger in Hong Kong Cantonese, an ongoing sound change that concerns the merging of tones in perception, production or both in a portion of native speakers, to examine the possible relationship between tone merger and musical and pitch abilities. Although a previous study has reported the occurrence of tone merger independently of musical training, it has not been investigated before whether tone-merging individuals, especially those merging tones in perception, would have inferior musical perception and fine-grained pitch sensitivities, given the close relationship of speech and music. To this end, we tested three groups of tone-merging individuals with various tone perception and production profiles on musical perception and pitch threshold tasks, in comparison to a group of Cantonese speakers with congenital amusia, and another group of controls without tone merger or amusia. Additionally, the amusics were compared with tone-merging individuals on the details of their tone discrimination and production profiles. The results showed a clear dissociation of tone merger and amusia, with the tone-merging individuals exhibiting intact musical and pitch abilities; on the other hand, the amusics demonstrated widespread difficulties in tone discrimination yet intact tone production, in contrast to the highly selective confusion of a specific tone pair in production or discrimination in tone-merging individuals. These findings provide the first evidence that tone merger and amusia are distinct from each other, and further suggest that the cause of tone merger may lie elsewhere rather than being driven by musical or pitch deficits. We also discussed issues arising from the current findings regarding the neural mechanisms of tone merger and amusia.

Effects of Amateur Musical Experience on Categorical Perception of Lexical Tones by Native Chinese Adults: An ERP Study

Music impacting on speech processing is vividly evidenced in most reports involving professional musicians, while the question of whether the facilitative effects of music are limited to experts or may extend to amateurs remains to be resolved. Previous research has suggested that analogous to language experience, musicianship also modulates lexical tone perception but the influence of amateur musical experience in adulthood is poorly understood. Furthermore, little is known about how acoustic information and phonological information of lexical tones are processed by amateur musicians. This study aimed to provide neural evidence of cortical plasticity by examining categorical perception of lexical tones in Chinese adults with amateur musical experience relative to the non-musician counterparts. Fifteen adult Chinese amateur musicians and an equal number of non-musicians participated in an event-related potential (ERP) experiment. Their mismatch negativities (MMNs) to lexical tones from Mandarin Tone 2–Tone 4 continuum and non-speech tone analogs were measured. It was hypothesized that amateur musicians would exhibit different MMNs to their non-musician counterparts in processing two aspects of information in lexical tones. Results showed that the MMN mean amplitude evoked by within-category deviants was significantly larger for amateur musicians than non-musicians regardless of speech or non-speech condition. This implies the strengthened processing of acoustic information by adult amateur musicians without the need of focused attention, as the detection of subtle acoustic nuances of pitch was measurably improved. In addition, the MMN peak latency elicited by across-category deviants was significantly shorter than that by within-category deviants for both groups, indicative of the earlier processing of phonological information than acoustic information of lexical tones at the pre-attentive stage. The results mentioned above suggest that cortical plasticity can still be induced in adulthood, hence non-musicians should be defined more strictly than before. Besides, the current study enlarges the population demonstrating the beneficial effects of musical experience on perceptual and cognitive functions, namely, the effects of enhanced speech processing from music are not confined to a small group of experts but extend to a large population of amateurs.

Vowel and Tone Identification for Mandarin Congenital Amusics: Effects of Vowel Type and Semantic Content

Purpose This study aimed to explore the effects of Mandarin congenital amusia with or without lexical tone deficit (i.e., tone agnosia and pure amusia) on Mandarin vowel and tone identification in different types of vowels (e.g., monophthong, diphthongs, and triphthongs) embedded in consonant-vowel contexts with and without semantic content. Method Thirteen pure amusics (i.e., amusics with normal lexical processing), 5 tone agnosics (i.e., with lexical tone deficit), and 12 controls were screened with Montreal Battery of Evaluation of Amusia and lexical tone tests (Nan et al., 2010; Peretz et al., 2003). Vowel-plus-tone identification tasks with the factors of vowel type and syllables with and without semantic content (e.g., real and nonsense words) were examined among the 3 groups, and identification scores were calculated in 3 formats: vowel-plus-tone identification, vowel identification, and tone identification. Results Tone agnosics showed significantly poorer performances on identifications of vowel, tone, and vowel plus tone across monophthongs, diphthongs, and triphthongs in both real and nonsense words compared to pure amusics and controls. Their deficits were similar across the 3 types of vowels, while the deficit on vowel-plus-tone identification was more severe in nonsense words than in real words. On the other hand, pure amusics performed similarly with controls across all these conditions. Conclusions Tone agnosia might affect both musical pitch and phonological processing, resulting in deficits in lexical tone and vowel perception. On the contrary, pure amusics's effect is primarily on musical pitch perception but not on lexical tone or phonemic deficit. Vowel type did not affect speech deficits for tone agnosics, while they relied more on semantic content as a compensation.

The Montreal Protocol for Identification of Amusia

The Montreal Battery for the Evaluation of Amusia (MBEA; Peretz, Champod, & Hyde Annals of the New York Academy of Sciences, 999, 58-75, 2003) is an empirically grounded quantitative tool that is widely used to identify individuals with congenital amusia. The use of such a standardized measure ensures that the individuals tested will conform to a specific neuropsychological profile, allowing for comparisons across studies and research groups. Recently, a number of researchers have published credible critiques of the usefulness of the MBEA as a diagnostic tool for amusia. Here we argue that the MBEA and its online counterpart, the AMUSIA tests (Peretz et al. Music Perception, 25, 331-343, 2008), should be considered steps in a screening process for amusia, rather than standalone diagnostic tools. The goal of this article is to present, in detailed and easily replicable format, the full protocol through which congenital amusics should be identified. In providing information that has often gone unreported in published articles, we aim to clarify the strengths and limitations of the MBEA and to make recommendations for its continued use by the research community as part of the Montreal Protocol for Identification of Amusia.

Lower-level acoustics underlie higher-level phonological categories in lexical tone perception

The pitch-processing deficit associated with congenital amusia has been shown to be transferable to lexical tone processing. However, it remains unclear whether the tone perception difficulties of amusics are merely due to the domain-general deficit in acoustic processing or additionally caused by impaired higher-level phonological operations. Answers to this question can shed light on the influence of lower-level acoustic processing on higher-level phonological processing. Using a modified categorical perception paradigm, the present study indicates that the acoustic processing deficit systematically extends to higher-level phonological processing. These findings suggest that lower-level acoustics underlie higher-level phonological categories in lexical tone perception.

The lateralized arcuate fasciculus in developmental pitch disorders among mandarin amusics: left for speech and right for music

The arcuate fasciculus (AF) is a neural fiber tract that is critical to speech and music development. Although the predominant role of the left AF in speech development is relatively clear, how the AF engages in music development is not understood. Congenital amusia is a special neurodevelopmental condition, which not only affects musical pitch but also speech tone processing. Using diffusion tensor tractography, we aimed at understanding the role of AF in music and speech processing by examining the neural connectivity characteristics of the bilateral AF among thirty Mandarin amusics. Compared to age- and intelligence quotient (IQ)-matched controls, amusics demonstrated increased connectivity as reflected by the increased fractional anisotropy in the right posterior AF but decreased connectivity as reflected by the decreased volume in the right anterior AF. Moreover, greater fractional anisotropy in the left direct AF was correlated with worse performance in speech tone perception among amusics. This study is the first to examine the neural connectivity of AF in the neurodevelopmental condition of amusia as a result of disrupted music pitch and speech tone processing. We found abnormal white matter structural connectivity in the right AF for the amusic individuals. Moreover, we demonstrated that the white matter microstructural properties of the left direct AF is modulated by lexical tone deficits among the amusic individuals. These data support the notion of distinctive pitch processing systems between music and speech.

Categorical Perception of Mandarin Chinese Tones 1-2 and Tones 1-4: Effects of Aging and Signal Duration

PURPOSE

The purpose of this study was to investigate the aging effect on the categorical perception of Mandarin Chinese tones with varied fundamental frequency (F0) contours and signal duration.

METHOD

Both younger and older native Chinese listeners with normal hearing were recruited in 2 experiments: tone identification and tone discrimination on a series of stimuli with the F0 contour systematically varying from the flat tone to the rising-falling tones. Apart from F0 contour, tone duration was manipulated at 3 levels: 100, 200, and 400 ms.

RESULTS

Results suggested that, compared with younger listeners, older listeners performed with shallower slope in the identification function and smaller peakedness in the discrimination function, particularly for Tones 1 and 2, whereas for Tones 1 and 4, comparable categorical perception was found between younger and older listeners.

CONCLUSIONS

The current study suggested that longer duration facilitated categorical perception in the flat-rising tones for the older listeners. Such an aging effect was not found with the flat-falling tones, suggesting that the aging-related deficit in categorical perception might relate to different tone types. Aging resulted in less categoricality of Mandarin tone perception for the flat-rising tones with short duration like 100 ms, possibly due to the aging-related decline in temporal processing.

Neural bases of congenital amusia in tonal language speakers

Congenital amusia is a lifelong neurodevelopmental disorder of fine-grained pitch processing. In this fMRI study, we examined the neural bases of congenial amusia in speakers of a tonal language - Cantonese. Previous studies on non-tonal language speakers suggest that the neural deficits of congenital amusia lie in the music-selective neural circuitry in the right inferior frontal gyrus (IFG). However, it is unclear whether this finding can generalize to congenital amusics in tonal languages. Tonal language experience has been reported to shape the neural processing of pitch, which raises the question of how tonal language experience affects the neural bases of congenital amusia. To investigate this question, we examined the neural circuitries sub-serving the processing of relative pitch interval in pitch-matched Cantonese level tone and musical stimuli in 11 Cantonese-speaking amusics and 11 musically intact controls. Cantonese-speaking amusics exhibited abnormal brain activities in a widely distributed neural network during the processing of lexical tone and musical stimuli. Whereas the controls exhibited significant activation in the right superior temporal gyrus (STG) in the lexical tone condition and in the cerebellum regardless of the lexical tone and music conditions, no activation was found in the amusics in those regions, which likely reflects a dysfunctional neural mechanism of relative pitch processing in the amusics. Furthermore, the amusics showed abnormally strong activation of the right middle frontal gyrus and precuneus when the pitch stimuli were repeated, which presumably reflect deficits of attending to repeated pitch stimuli or encoding them into working memory. No significant group difference was found in the right IFG in either the whole-brain analysis or region-of-interest analysis. These findings imply that the neural deficits in tonal language speakers might differ from those in non-tonal language speakers, and overlap partly with the neural circuitries of lexical tone processing (e.g. right STG).