Do speakers have access to a mental syllabary? ERP comparison of high frequency and novel syllable production

Facilitation effect of token syllable frequency in Chinese spoken word production

Syllable frequency effects in spoken word production have been interpreted as evidence that speakers store syllable-sized motor programmes for phonetic encoding in alphabetic languages such as English or Dutch. However, the cognitive mechanism underlying the syllable frequency effect in Chinese spoken word production remains unknown. To investigate the locus of the syllable frequency effect in spoken Chinese, this study used a picture-word interference (PWI) task in which participants were asked to name the picture while ignoring the distractor word. The design included two variables: the syllable frequency of the target words (high vs. low) and the phonological relationships between distractor and target words (shared atonic syllable or not; related vs. unrelated). We manipulated mixed token and type syllable frequency in Experiment 1, and token syllable frequency but controlled type syllable frequency in Experiment 2. The results showed a facilitation effect of mixed syllable frequency and a similar facilitation effect of token syllable frequency. Importantly, the syllable frequency effect was found to be independent of the phonological facilitation effect. These results suggest that token syllable frequency played a dominant role in the observed facilitation effect, providing evidence that the syllable frequency effect arises in the phonetic encoding of Chinese spoken word production.

Predictability Associated With Reduction in Phonetic Signals Without Semantics-The Case of Glossolalia

Glossolalia can be regarded as an instance of speech production in which practitioners produce syllables in seemingly random sequences. However, a closer inspection of glossalalia's statistical properties reveals that sequences show a Zipfian pattern similar to natural languages, with some syllables being more probable than others. It is well established that statistical properties of sequences are implicitly learned, and that these statistical properties correlate with changes in kinematic and speech behavior. For speech, this means that more predictable items are phonetically shorter. Accordingly, we hypothesized for glossolalia that if practitioners have learned a serial pattern in glossolalia in the same manner as in natural languages, its statistical properties should correlate with its phonetic characteristics. Our hypothesis was supported. We find significantly shorter syllables associated with higher syllable probabilities in glossolalia. We discuss this finding in relation to theories about the sources of probability-related changes in the speech signal.

Time-course of phonetic (motor speech) encoding in utterance production

Speaking involves the preparation of the linguistic content of an utterance and of the motor programs leading to articulation. The temporal dynamics of linguistic versus motor-speech (phonetic) encoding is highly debated: phonetic encoding has been associated either to the last quarter of an utterance preparation time (∼150ms before articulation), or to virtually the entire planning time, simultaneously with linguistic encoding. We (i) review the evidence on the time-course of motor-speech encoding based on EEG/MEG event-related (ERP) studies and (ii) strive to replicate the early effects of phonological-phonetic factors in referential word production by reanalysing a large EEG/ERP dataset. The review indicates that motor-speech encoding is engaged during at least the last 300ms preceding articulation (about half of a word planning lag). By contrast, the very early involvement of phonological-phonetic factors could be replicated only partially and is not as robust as in the second half of the utterance planning time-window.

Speech Errors in the Production of Initial Consonant Clusters: The Roles of Frequency and Sonority

PURPOSE

One of the central questions in speech production research is to what degree certain structures have an inherent difficulty and to what degree repeated encounter and practice make them easier to process. The goal of this article was to determine the extent to which frequency and sonority distance of consonant clusters predict production difficulties.

METHOD

We used a tongue twister paradigm to elicit speech errors on syllable-initial German consonant clusters and investigated the relative influences of cluster frequency and sonority distance between the consonants of a cluster on production accuracy. Native speakers of German produced pairs of monosyllabic pseudowords beginning with consonant clusters at a high speech rate.

RESULTS

Error rates decreased with increasing frequency of the consonant clusters. A high sonority distance, on the other hand, did not facilitate a cluster's production, but speech errors led to optimized sonority structure for a subgroup of clusters. In addition, the combination of consonant clusters in a stimulus pair has a great impact on production accuracy.

CONCLUSION

These results suggest that both frequency of use and sonority distance codetermine production ease, as well as syntagmatic competition between adjacent sound sequences.

The combined effects of contextual predictability and noise on the acoustic realisation of German syllables

Speakers tend to speak clearly in noisy environments, while they tend to reserve effort by shortening word duration in predictable contexts. It is unclear how these two communicative demands are met. The current study investigates the acoustic realizations of syllables in predictable vs unpredictable contexts across different background noise levels. Thirty-eight German native speakers produced 60 CV syllables in two predictability contexts in three noise conditions (reference = quiet, 0 dB and -10 dB signal-to-noise ratio). Duration, intensity (average and range), F0 (median), and vowel formants of the target syllables were analysed. The presence of noise yielded significantly longer duration, higher average intensity, larger intensity range, and higher F0. Noise levels affected intensity (average and range) and F0. Low predictability syllables exhibited longer duration and larger intensity range. However, no interaction was found between noise and predictability. This suggests that noise-related modifications might be independent of predictability-related changes, with implications for including channel-based and message-based formulations in speech production.

Can we use the internet to study speech production? Yes we can! Evidence contrasting online versus laboratory naming latencies and errors

The closure of cognitive psychology labs around the world due to the COVID-19 pandemic has prevented in-person testing. This has caused a particular challenge for speech production researchers, as before the pandemic there were no studies demonstrating that reliable overt speech production data could be collected via the internet. Here, we present evidence that both accurate and reliable overt articulation data can be collected from internet-based speech production experiments. We tested 100 participants in a picture naming paradigm, where we manipulated the word and phonotactic frequency of the picture names. We compared our results to a lab-based study conducted on different participants which used the same materials and design. We found a significant word frequency effect but no phonotactic frequency effect, fully replicating the lab-based results. Effect sizes were similar between experiments, but with significantly longer latencies in the internet-collected data. We found no evidence that internet upload or download speed affected either naming latencies or errors. In addition, we carried out a permutation-style analysis which recommends a minimum sample size of 40 participants for online production paradigms. In sum, our study demonstrates that internet-based testing of speech production is a feasible and promising endeavour, with less challenges than many researchers (anecdotally) assumed.

Behavioral and Brain Responses Highlight the Role of Usage in the Preparation of Multiword Utterances for Production

Usage-based theories assume that all aspects of language processing are shaped by the distributional properties of the language. The frequency not only of words but also of larger chunks plays a major role in language processing. These theories predict that the frequency of phrases influences the time needed to prepare these phrases for production and their acoustic duration. By contrast, dominant psycholinguistic models of utterance production predict no such effects. In these models, the system keeps track of the frequency of individual words but not of co-occurrences. This study investigates the extent to which the frequency of phrases impacts naming latencies and acoustic duration with a balanced design, where the same words are recombined to build high- and low-frequency phrases. The brain signal of participants is recorded so as to obtain information on the electrophysiological bases and functional locus of frequency effects. Forty-seven participants named pictures using high- and low-frequency adjective-noun phrases. Naming latencies were shorter for high-frequency than low-frequency phrases. There was no evidence that phrase frequency impacted acoustic duration. The electrophysiological signal differed between high- and low-frequency phrases in time windows that do not overlap with conceptualization or articulation processes. These findings suggest that phrase frequency influences the preparation of phrases for production, irrespective of the lexical properties of the constituents, and that this effect originates at least partly when speakers access and encode linguistic representations. Moreover, this study provides information on how the brain signal recorded during the preparation of utterances changes with the frequency of word combinations.

The Same Ultra-Rapid Parallel Brain Dynamics Underpin the Production and Perception of Speech

The temporal dynamics by which linguistic information becomes available is one of the key properties to understand how language is organized in the brain. An unresolved debate between different brain language models is whether words, the building blocks of language, are activated in a sequential or parallel manner. In this study, we approached this issue from a novel perspective by directly comparing the time course of word component activation in speech production versus perception. In an overt object naming task and a passive listening task, we analyzed with mixed linear models at the single-trial level the event-related brain potentials elicited by the same lexico-semantic and phonological word knowledge in the two language modalities. Results revealed that both word components manifested simultaneously as early as 75 ms after stimulus onset in production and perception; differences between the language modalities only became apparent after 300 ms of processing. The data provide evidence for ultra-rapid parallel dynamics of language processing and are interpreted within a neural assembly framework where words recruit the same integrated cell assemblies across production and perception. These word assemblies ignite early on in parallel and only later on reverberate in a behavior-specific manner.

Morphological facilitation and semantic interference in compound production: An ERP study

This study investigates the production of nominal compounds (Experiment 1) and simple nouns (Experiment 2) in a picture-word interference (PWI) paradigm to test models of morpho-lexical representation and processing. The continuous electroencephalogram (EEG) was registered and event-related brain potentials [ERPs] were analyzed in addition to picture-naming latencies. Experiment 1 used morphologically and semantically related distractor words to tap into different pre-articulatory planning stages during compound production. Relative to unrelated distractors, naming was speeded when distractors corresponded to morphemes of the compound (sun or flower for the target sunflower), but slowed when distractors were from the same semantic category as the compound (tulip ➔ sunflower). Distractors from the same category as the compound's first constituent (moon ➔ sunflower) had no influence. The diverging effects for semantic and morphological distractors replicate results from earlier studies. ERPs revealed different effects of morphological and semantic distractors with an interesting time course: morphological effects had an earlier onset. Comparable to the naming latencies, no ERP effects were obtained for distractors from the same semantic category as the compound's first constituent. Experiment 2 investigated the effectiveness of the latter distractors, presenting them with pictures of the compounds' first constituents (e.g., moon ➔ sun). Interference was confirmed both behaviorally and in the ERPs, showing that the absence of an effect in Experiment 1 was not due to the materials used. Considering current models of speech production, the data are best explained by a cascading flow of activation throughout semantic, lexical and morpho-phonological steps of speech planning.

Neural dynamics of speech and non-speech motor planning

As the speech apparatus is also involved in producing non-speech movements, understanding whether speech and non-speech planning are controlled by the same brain mechanisms is central to the comprehension of motor speech planning. A crucial issue is whether a specialized motor planning/control system is dedicated to speech or if the motor planning/control system is shared across oromotor behaviors. We investigated the EEG/ERP spatio-temporal dynamics of the motor planning processes preceding articulation by comparing the production of non-speech gestures matched to monosyllabic words and non-words. To isolate motor from pre-motor planning, we used a delayed production task combined with an articulatory suppression task. Results suggest that the planning processes preceding articulation for non-speech, words and non-words recruit the same neural networks but with different involvement for non-speech and speech. The results support the idea of shared motor planning/control systems for speech and non-speech but with different dynamics for each oromotor behavior.

Identifying the Speech Production Stages in Early and Late Adulthood by Using Electroencephalography

Structural changes in the brain take place throughout one’s life. Changes related to cognitive decline may delay the stages of the speech production process in the aging brain. For example, semantic memory decline and poor inhibition may delay the retrieval of a concept from the mental lexicon. Electroencephalography (EEG) is a valuable method for identifying the timing of speech production stages. So far, studies using EEG mainly focused on a particular speech production stage in a particular group of subjects. Differences between subject groups and between methodologies have complicated identifying time windows of the speech production stages. For the current study, the speech production stages lemma retrieval, lexeme retrieval, phonological encoding, and phonetic encoding were tracked using a 64-channel EEG in 20 younger adults and 20 older adults. Picture-naming tasks were used to identify lemma retrieval, using semantic interference through previously named pictures from the same semantic category, and lexeme retrieval, using words with varying age of acquisition. Non-word reading was used to target phonological encoding (using non-words with a variable number of phonemes) and phonetic encoding (using non-words that differed in spoken syllable frequency). Stimulus-locked and response-locked cluster-based permutation analyses were used to identify the timing of these stages in the full time course of speech production from stimulus presentation until 100 ms before response onset in both subject groups. It was found that the timing of each speech production stage could be identified. Even though older adults showed longer response times for every task, only the timing of the lexeme retrieval stage was later for the older adults compared to the younger adults, while no such delay was found for the timing of the other stages. The results of a second cluster-based permutation analysis indicated that clusters that were observed in the timing of the stages for one group were absent in the other subject group, which was mainly the case in stimulus-locked time windows. A z-score mapping analysis was used to compare the scalp distributions related to the stages between the older and younger adults. No differences between both groups were observed with respect to scalp distributions, suggesting that the same groups of neurons are involved in the four stages, regardless of the adults’ age, even though the timing of the individual stages is different in both groups.

Variation in the speech signal as a window into the cognitive architecture of language production

The pronunciation of words is highly variable. This variation provides crucial information about the cognitive architecture of the language production system. This review summarizes key empirical findings about variation phenomena, integrating corpus, acoustic, articulatory, and chronometric data from phonetic and psycholinguistic studies. It examines how these data constrain our current understanding of word production processes and highlights major challenges and open issues that should be addressed in future research.

Speech and nonspeech: What are we talking about?

Understanding of the behavioural, cognitive and neural underpinnings of speech production is of interest theoretically, and is important for understanding disorders of speech production and how to assess and treat such disorders in the clinic. This paper addresses two claims about the neuromotor control of speech production: (1) speech is subserved by a distinct, specialised motor control system and (2) speech is holistic and cannot be decomposed into smaller primitives. Both claims have gained traction in recent literature, and are central to a task-dependent model of speech motor control. The purpose of this paper is to stimulate thinking about speech production, its disorders and the clinical implications of these claims. The paper poses several conceptual and empirical challenges for these claims - including the critical importance of defining speech. The emerging conclusion is that a task-dependent model is called into question as its two central claims are founded on ill-defined and inconsistently applied concepts. The paper concludes with discussion of methodological and clinical implications, including the potential utility of diadochokinetic (DDK) tasks in assessment of motor speech disorders and the contraindication of nonspeech oral motor exercises to improve speech function.

Electrophysiological characterization of facilitation and interference in the picture-word interference paradigm

The picture-word interference paradigm is often used to investigate the processes underlying word production. In this paradigm, participants name pictures while ignoring distractor words. The aim of this study is to investigate the processes underlying this task and how/when they differ from those involved in simple picture naming. It examines the electrophysiological signature of general interference (longer response times with than without distractors) and facilitation (shorter response times for distractor-word stimuli overlapping in phonemes/orthography) effects. Mass univariate analyses are used to determine the temporal boundaries and spatial distribution of these effects without a priori restrictions in the time/space dimensions. Topographic pattern analyses complement this information by indicating whether (and when) the neural networks differ across conditions. Results suggest that the general interference effect has two loci, the grammatical encoding and the phonological encoding of the target word, with different neural networks involved in the two tasks during part of the grammatical encoding process. Furthermore, the electrophysiological signature of interference and facilitation effects in the time window of phonological encoding is highly similar, suggesting that the two effects could result from the same underlying mechanism. These findings are discussed in the light of existing accounts of interference and facilitation effects.

Neurophysiological Modulations of Non-Verbal and Verbal Dual-Tasks Interference during Word Planning

Running a concurrent task while speaking clearly interferes with speech planning, but whether verbal vs. non-verbal tasks interfere with the same processes is virtually unknown. We investigated the neural dynamics of dual-task interference on word production using event-related potentials (ERPs) with either tones or syllables as concurrent stimuli. Participants produced words from pictures in three conditions: without distractors, while passively listening to distractors and during a distractor detection task. Production latencies increased for tasks with higher attentional demand and were longer for syllables relative to tones. ERP analyses revealed common modulations by dual-task for verbal and non-verbal stimuli around 240 ms, likely corresponding to lexical selection. Modulations starting around 350 ms prior to vocal onset were only observed when verbal stimuli were involved. These later modulations, likely reflecting interference with phonological-phonetic encoding, were observed only when overlap between tasks was maximal and the same underlying neural circuits were engaged (cross-talk).