Effects of vowel coproduction on the timecourse of tone recognition

How Tone, Intonation and Emotion Shape the Development of Infants’ Fundamental Frequency Perception

Fundamental frequency (ƒ₀), perceived as pitch, is the first and arguably most salient auditory component humans are exposed to since the beginning of life. It carries multiple linguistic (e.g., word meaning) and paralinguistic (e.g., speakers’ emotion) functions in speech and communication. The mappings between these functions and ƒ₀ features vary within a language and differ cross-linguistically. For instance, a rising pitch can be perceived as a question in English but a lexical tone in Mandarin. Such variations mean that infants must learn the specific mappings based on their respective linguistic and social environments. To date, canonical theoretical frameworks and most empirical studies do not view or consider the multi-functionality of ƒ₀, but typically focus on individual functions. More importantly, despite the eventual mastery of ƒ₀ in communication, it is unclear how infants learn to decompose and recognize these overlapping functions carried by ƒ₀. In this paper, we review the symbioses and synergies of the lexical, intonational, and emotional functions that can be carried by ƒ₀ and are being acquired throughout infancy. On the basis of our review, we put forward the Learnability Hypothesis that infants decompose and acquire multiple ƒ₀ functions through native/environmental experiences. Under this hypothesis, we propose representative cases such as the synergy scenario, where infants use visual cues to disambiguate and decompose the different ƒ₀ functions. Further, viable ways to test the scenarios derived from this hypothesis are suggested across auditory and visual modalities. Discovering how infants learn to master the diverse functions carried by ƒ₀ can increase our understanding of linguistic systems, auditory processing and communication functions.

The Roles of Consonant, Rime, and Tone in Mandarin Spoken Word Recognition: An Eye-Tracking Study

This study investigated the relative role of sub-syllabic components (initial consonant, rime, and tone) in spoken word recognition of Mandarin Chinese using an eye-tracking experiment with a visual world paradigm. Native Mandarin speakers (all born and grew up in Beijing) were presented with four pictures and an auditory stimulus. They were required to click the picture according to the sound stimulus they heard, and their eye movements were tracked during this process. For a target word (e.g., tang2 "candy"), nine conditions of competitors were constructed in terms of the amount of their phonological overlap with the target: consonant competitor (e.g., ti1 "ladder"), rime competitor (e.g., lang4 "wave"), tone competitor (e.g., niu2 "cow"), consonant plus rime competitor (e.g., tang1"soup"), consonant plus tone competitor (e.g., tou2 "head"), rime plus tone competitor (e.g., yang2 "sheep"), cohort competitor (e.g., ta3 "tower"), cohort plus tone competitor (e.g., tao2 "peach"), and baseline competitor (e.g., xue3 "snow"). A growth curve analysis was conducted with the fixation to competitors, targets, and distractors, and the results showed that (1) competitors with consonant or rime overlap can be adequately activated, while tone overlap plays a weaker role since additional tonal information can strengthen the competitive effect only when it was added to a candidate that already bears much phonological similarity with the target. (2) Mandarin words are processed in an incremental way in the time course of word recognition since different partially overlapping competitors could be activated immediately; (3) like the pattern found in English, both cohort and rime competitors were activated to compete for lexical activation, but these two competitors were not temporally distinctive and mainly differed in the size of their competitive effects. Generally, the gradation of activation based on the phonological similarity between target and candidates found in this study was in line with the continuous mapping models and may reflect a strategy of native speakers shaped by the informative characteristics of the interaction among different sub-syllabic components.

Word-initial consonant-vowel coordination in a lexical pitch-accent language

Previous research has acknowledged the effect of prosody on inter-gestural coordination, but specifically the effect of tones is still understudied. This paper has a two-fold purpose. First, it aims to explore effects of the Swedish word accents on word-initial consonant-vowel (CV) coarticulation. Second, it aims to revisit the existing evidence for tonal integration. Based on Articulatory Phonology, it has been suggested that tones - in tone languages - are integrated in the gestural organization of a syllable-initial CV sequence in the same manner as would an additional consonant (CCV), indicated by a time lag between the gestural onsets of the C and the V gesture (CV onset time lag). However, we argue that the existing evidence is inconclusive, because previous cross-linguistic research has used small-scale data sets (one to seven speakers), and we still lack a well-grounded consensus on how gestural onsets are to be measured. This study uses Electromagnetic Articulography (EMA) to investigate word-initial CV coordination in a lexical pitch-accent language (Swedish) with a binary tonal word accent distinction: a tonal fall and a tonal rise, respectively. A selection of 13 spatial, temporal or coordinative measures of bilabial and tongue body data from 19 speakers, and acoustic f_o data, were examined to study the CV sequence /ma/. Mixed effects regression models revealed a longer tongue body movement in the rising tone context and small but significant differences in tongue body height, in the closing and the opening of the lips, as well as in the CV onset time lag between the two tonal contexts. We argue that these effects are biomechanical in nature, due to the physiological connections between the tongue, the jaw, and the larynx. In addition, our results suggest either synchronized CV onsets or a CV onset time lag (as in tone languages), depending on the timing landmarks used. In order to evaluate such results as evidence for or against the integration of tone in CV coarticulation, we argue that future research needs to compare data from a variety of languages using a considerable number of speakers. The present study provides new reference values for such comparisons.

Prosody leaks into the memories of words

The average predictability (aka informativity) of a word in context has been shown to condition word duration (Seyfarth, 2014). All else being equal, words that tend to occur in more predictable environments are shorter than words that tend to occur in less predictable environments. One account of the informativity effect on duration is that the acoustic details of probabilistic reduction are stored as part of a word's mental representation. Other research has argued that predictability effects are tied to prosodic structure in integral ways. With the aim of assessing a potential prosodic basis for informativity effects in speech production, this study extends past work in two directions; it investigated informativity effects in another large language, Mandarin Chinese, and broadened the study beyond word duration to additional acoustic dimensions, pitch and intensity, known to index prosodic prominence. The acoustic information of content words was extracted from a large telephone conversation speech corpus with over 400,000 tokens and 6000 word types spoken by 1655 individuals and analyzed for the effect of informativity using frequency statistics estimated from a 431 million word subtitle corpus. Results indicated that words with low informativity have shorter durations, replicating the effect found in English. In addition, informativity had significant effects on maximum pitch and intensity, two phonetic dimensions related to prosodic prominence. Extending this interpretation, these results suggest that predictability is closely linked to prosodic prominence, and that the lexical representation of a word includes phonetic details associated with its average prosodic prominence in discourse. In other words, the lexicon absorbs prosodic influences on speech production.