Serial control of phonology in speech production: a hierarchical model

Cross-Linguistic Trends in Speech Errors: An Analysis of Sub-Lexical Errors in Cantonese

Though past research on the sound structure of speech errors has contributed greatly to our understanding of phonological encoding, most of this research comes from a small set of majority languages with similar linguistic structures. To increase the linguistic diversity of relevant evidence, a large collection of speech errors was investigated in Cantonese, an under-studied language with unique phonological structures. In particular, the Cantonese data were examined for nine psycholinguistic effects commonly used as a lens on word-form encoding. Detailed quantitative analysis found that Cantonese has eight of these effects, providing broader cross-linguistic support for models based on these patterns. Yet Cantonese also exhibited differences with well-known Indo-European languages by having a higher rate of errors involving whole syllables and sub-constituents inside the syllable rime. These differences can be accounted for by recognizing the primacy of the syllable and mora in encoding Cantonese words, following proposals that have been made for Mandarin Chinese and Japanese.

Delayed Auditory Feedback Elicits Specific Patterns of Serial Order Errors in a Paced Syllable Sequence Production Task

PURPOSE

Delayed auditory feedback (DAF) interferes with speech output. DAF causes distorted and disfluent productions and errors in the serial order of produced sounds. Although DAF has been studied extensively, the specific patterns of elicited speech errors are somewhat obscured by relatively small speech samples, differences across studies, and uncontrolled variables. The goal of this study was to characterize the types of serial order errors that increase under DAF in a systematic syllable sequence production task, which used a closed set of sounds and controlled for speech rate.

METHOD

Sixteen adult speakers repeatedly produced CVCVCV (C = consonant, V = vowel) sequences, paced to a "visual metronome," while hearing self-generated feedback with delays of 0-250 ms. Listeners transcribed recordings, and speech errors were classified based on the literature surrounding naturally occurring slips of the tongue. A series of mixed-effects models were used to assess the effects of delay for different error types, for error arrival time, and for speaking rate.

RESULTS

DAF had a significant effect on the overall error rate for delays of 100 ms or greater. Statistical models revealed significant effects (relative to zero delay) for vowel and syllable repetitions, vowel exchanges, vowel omissions, onset disfluencies, and distortions. Serial order errors were especially dominated by vowel and syllable repetitions. Errors occurred earlier on average within a trial for longer feedback delays. Although longer delays caused slower speech, this effect was mediated by the run number (time in the experiment) and small compared with those in previous studies.

CONCLUSIONS

DAF drives a specific pattern of serial order errors. The dominant pattern of vowel and syllable repetition errors suggests possible mechanisms whereby DAF drives changes to the activity in speech planning representations, yielding errors. These mechanisms are outlined with reference to the GODIVA (Gradient Order Directions Into Velocities of Articulators) model of speech planning and production.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.19601785.

Neurocognitive signatures of phonemic sequencing in expert backward speakers

Despite its prolific growth, neurolinguistic research on phonemic sequencing has largely neglected the study of individuals with highly developed skills in this domain. To bridge this gap, we report multidimensional signatures of two experts in backward speech, that is, the capacity to produce utterances by reversing the order of phonemes while retaining their identity. Our approach included behavioral assessments of backward and forward speech alongside neuroimaging measures of voxel-based morphometry, diffusion tensor imaging, and resting-state functional connectivity. Relative to controls, both backward speakers exhibited behavioral advantages for reversing words and sentences of varying complexity, irrespective of working memory skills. These patterns were accompanied by increased grey matter volume, higher mean diffusivity, and enhanced functional connectivity along dorsal and ventral stream regions mediating phonological and other linguistic operations, with complementary support of areas subserving associative-visual and domain-general processes. Still, the specific loci of these neural patterns differed between both subjects, suggesting individual variability in the correlates of expert backward speech. Taken together, our results offer new vistas on the domain of phonemic sequencing, while illuminating neuroplastic patterns underlying extraordinary language abilities.

Investigating Perceptual Biases, Data Reliability, and Data Discovery in a Methodology for Collecting Speech Errors From Audio Recordings

This work describes a methodology of collecting speech errors from audio recordings and investigates how some of its assumptions affect data quality and composition. Speech errors of all types (sound, lexical, syntactic, etc.) were collected by eight data collectors from audio recordings of unscripted English speech. Analysis of these errors showed that: (i) different listeners find different errors in the same audio recordings, but (ii) the frequencies of error patterns are similar across listeners; (iii) errors collected "online" using on the spot observational techniques are more likely to be affected by perceptual biases than "offline" errors collected from audio recordings; and (iv) datasets built from audio recordings can be explored and extended in a number of ways that traditional corpus studies cannot be.

Altered transposition asymmetry in serial ordering in early Parkinson's disease

INTRODUCTION

The ability to arrange thoughts and actions in an appropriate serial order is impaired in Parkinson's disease (PD). However, it is unclear how serial order is represented and manipulated and how the representation or manipulation is altered in the early stages of PD. We aimed to analyze the pattern of performance errors in serial ordering versus serial recall in nondemented PD patients with mild clinical symptoms and healthy adults to identify the underlying principles of serial ordering.

METHODS

PD patients (N = 57) and healthy controls (N = 40) completed the adaptive digit ordering and digit span forward tests. We focused on items recalled in incorrect positions (transposition) and analyzed the tendency to recall transposed items too early (anticipation) versus too late (postponement). We also analyzed the tendency to recall the item displaced by the error (fill-in) versus the item following the error in the target output order (infill) after anticipation errors.

RESULTS

PD patients not only made more transposition errors but also showed distinct error patterns. The patients made more anticipations but not postponements, and more fill-ins but not in fills than healthy controls in the ordering test (transposition asymmetry). Individual patients' percentage of anticipations was negatively correlated with their daily exposure to D2/3 receptor agonists. Patients' error pattern in the forward test was normal.

CONCLUSION

The increase in anticipations in PD suggests an increase in the forward-specific variability in the representation of serial order. Their increase in fill-ins suggests a deficit in the chaining mechanism involved in the manipulation of serial order.

Towards the Quantification of Peggy Babcock: Speech Errors and Their Position within the Word

Sequences of similar (i.e., partially identical) words can be hard to say, as indicated by error frequencies, longer reaction and execution times. This study investigates the role of the location of this partial identity and the accompanying differences, i.e. whether errors are more frequent with mismatches in word onsets (top cop), codas (top tock) or both (pop tot). Number of syllables (tippy ticky) and empty positions (top ta) were also varied. Since the gradient nature of errors can be difficult to determine acoustically, articulatory data were investigated. Articulator movements were recorded using electromagnetic articulography, for up to 9 speakers of American English repeatedly producing 2-word sequences to an accelerating metronome. Most word pairs showed more intrusions and greater variability in coda than in onset position, in contrast to the predominance of onset position errors in corpora from perceptual observation.

Phonological regularity, perceptual biases, and the role of phonotactics in speech error analysis

Speech errors involving manipulations of sounds tend to be phonologically regular in the sense that they obey the phonotactic rules of well-formed words. We review the empirical evidence for phonological regularity in prior research, including both categorical assessments of words and regularity at the granular level involving specific segments and contexts. Since the reporting of regularity is affected by human perceptual biases, we also document this regularity in a new data set of 2,228 sublexical errors that was collected using methods that are demonstrably less prone to bias. These facts validate the claim that sound errors are overwhelmingly regular, but the new evidence suggests speech errors admit more phonologically ill-formed words than previously thought. Detailed facts of the phonological structure of errors, including this revised standard, are then related to model assumptions in contemporary theories of phonological encoding. This article is categorized under: Linguistics > Linguistic Theory Linguistics > Computational Models of Language Psychology > Language.

Phonemes: Lexical access and beyond

Phonemes play a central role in traditional theories as units of speech perception and access codes to lexical representations. Phonemes have two essential properties: they are 'segment-sized' (the size of a consonant or vowel) and abstract (a single phoneme may be have different acoustic realisations). Nevertheless, there is a long history of challenging the phoneme hypothesis, with some theorists arguing for differently sized phonological units (e.g. features or syllables) and others rejecting abstract codes in favour of representations that encode detailed acoustic properties of the stimulus. The phoneme hypothesis is the minority view today. We defend the phoneme hypothesis in two complementary ways. First, we show that rejection of phonemes is based on a flawed interpretation of empirical findings. For example, it is commonly argued that the failure to find acoustic invariances for phonemes rules out phonemes. However, the lack of invariance is only a problem on the assumption that speech perception is a bottom-up process. If learned sublexical codes are modified by top-down constraints (which they are), then this argument loses all force. Second, we provide strong positive evidence for phonemes on the basis of linguistic data. Almost all findings that are taken (incorrectly) as evidence against phonemes are based on psycholinguistic studies of single words. However, phonemes were first introduced in linguistics, and the best evidence for phonemes comes from linguistic analyses of complex word forms and sentences. In short, the rejection of phonemes is based on a false analysis and a too-narrow consideration of the relevant data.

Irrelevant Sound Disrupts Speech Production: Exploring the Relationship between Short-Term Memory and Experimentally Induced Slips of the Tongue

To explore the relationship between short-term memory and speech production, we developed a speech error induction technique. The technique, which was adapted from a Japanese word game, exposed participants to an auditory distractor word immediately before the utterance of a target word. In Experiment 1, the distractor words that were phonologically similar to the target word led to a greater number of errors in speaking the target than did the dissimilar distractor words. Furthermore, the speech error scores were significantly correlated with memory span scores. In Experiment 2, memory span scores were again correlated with the rate of the speech errors that were induced from the task-irrelevant speech sounds. Experiment 3 showed a strong irrelevant-sound effect in the serial recall of nonwords. The magnitude of the irrelevant-sound effects was not affected by phonological similarity between the to-be-remembered nonwords and the irrelevant-sound materials. Analysis of recall errors in Experiment 3 also suggested that there were no essential differences in recall error patterns between the dissimilar and similar irrelevant-sound conditions. Weproposed two different underlying mechanisms in immediate memory, one operating via the phonological short-term memory store and the other via the processes underpinning speech production.

Selective Interference with Verbal Short-Term Memory for Serial Order Information: A New Paradigm and Tests of a Timing-Signal Hypothesis

Many recent computational models of verbal short-term memory postulate a separation between processes supporting memory for the identity of items and processes supporting memory for their serial order. Furthermore, some of these models assume that memory for serial order is supported by a timing signal. We report an attempt to find evidence for such a timing signal by comparing an “item probe” task, requiring memory for items, with a “list probe” task, requiring memory for serial order. Four experiments investigated effects of irrelevant speech, articulatory suppression, temporal grouping, and paced finger tapping on these two tasks. In Experiments 1 and 2, irrelevant speech and articulatory suppression had a greater detrimental effect on the list probe task than on the item probe task. Reaction time data indicated that the list probe task, but not the item probe task, induced serial rehearsal of items. Phonological similarity effects confirmed that both probe tasks induced phonological recoding of visual inputs. Experiment 3 showed that temporal grouping of items during list presentation improved performance on the list probe task more than on the item probe task. In Experiment 4, paced tapping had a greater detrimental effect on the list probe task than on the item probe task. However, there was no differential effect of whether tapping was to a simple or a complex rhythm. Overall, the data illustrate the utility of the item probe/list probe paradigm and provide support for models that assume memory for serial order and memory for items involve separate processes. Results are generally consistent with the timing-signal hypothesis but suggest further factors that need to be explored to distinguish it from other accounts.

Kinematic Analysis of Speech Sound Sequencing Errors Induced by Delayed Auditory Feedback

PURPOSE

Delayed auditory feedback (DAF) causes speakers to become disfluent and make phonological errors. Methods for assessing the kinematics of speech errors are lacking, with most DAF studies relying on auditory perceptual analyses, which may be problematic, as errors judged to be categorical may actually represent blends of sounds or articulatory errors.

METHOD

Eight typical speakers produced nonsense syllable sequences under normal and DAF (200 ms). Lip and tongue kinematics were captured with electromagnetic articulography. Time-locked acoustic recordings were transcribed, and the kinematics of utterances with and without perceived errors were analyzed with existing and novel quantitative methods.

RESULTS

New multivariate measures showed that for 5 participants, kinematic variability for productions perceived to be error free was significantly increased under delay; these results were validated by using the spatiotemporal index measure. Analysis of error trials revealed both typical productions of a nontarget syllable and productions with articulatory kinematics that incorporated aspects of both the target and the perceived utterance.

CONCLUSIONS

This study is among the first to characterize articulatory changes under DAF and provides evidence for different classes of speech errors, which may not be perceptually salient. New methods were developed that may aid visualization and analysis of large kinematic data sets.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.5103067.

The Frame Constraint on Experimentally Elicited Speech Errors in Japanese

The so-called syllable position effect in speech errors has been interpreted as reflecting constraints posed by the frame structure of a given language, which is separately operating from linguistic content during speech production. The effect refers to the phenomenon that when a speech error occurs, replaced and replacing sounds tend to be in the same position within a syllable or word. Most of the evidence for the effect comes from analyses of naturally occurring speech errors in Indo-European languages, and there are few studies examining the effect in experimentally elicited speech errors and in other languages. This study examined whether experimentally elicited sound errors in Japanese exhibits the syllable position effect. In Japanese, the sub-syllabic unit known as "mora" is considered to be a basic sound unit in production. Results showed that the syllable position effect occurred in mora errors, suggesting that the frame constrains the ordering of sounds during speech production.

Domain-Generality of Timing-Based Serial Order Processes in Short-Term Memory: New Insights from Musical and Verbal Domains

Several models in the verbal domain of short-term memory (STM) consider a dissociation between item and order processing. This view is supported by data demonstrating that different types of time-based interference have a greater effect on memory for the order of to-be-remembered items than on memory for the items themselves. The present study investigated the domain-generality of the item versus serial order dissociation by comparing the differential effects of time-based interfering tasks, such as rhythmic interference and articulatory suppression, on item and order processing in verbal and musical STM domains. In Experiment 1, participants had to maintain sequences of verbal or musical information in STM, followed by a probe sequence, this under different conditions of interference (no-interference, rhythmic interference, articulatory suppression). They were required to decide whether all items of the probe list matched those of the memory list (item condition) or whether the order of the items in the probe sequence matched the order in the memory list (order condition). In Experiment 2, participants performed a serial order probe recognition task for verbal and musical sequences ensuring sequential maintenance processes, under no-interference or rhythmic interference conditions. For Experiment 1, serial order recognition was not significantly more impacted by interfering tasks than was item recognition, this for both verbal and musical domains. For Experiment 2, we observed selective interference of the rhythmic interference condition on both musical and verbal order STM tasks. Overall, the results suggest a similar and selective sensitivity to time-based interference for serial order STM in verbal and musical domains, but only when the STM tasks ensure sequential maintenance processes.

[Investigating phonological planning processes in speech production through a speech-error induction technique]

The present study investigated principles of phonological planning, a common serial ordering mechanism for speech production and phonological short-term memory. Nakayama and Saito (2014) have investigated the principles by using a speech-error induction technique, in which participants were exposed to an auditory distracIor word immediately before an utterance of a target word. They demonstrated within-word adjacent mora exchanges and serial position effects on error rates. These findings support, respectively, the temporal distance and the edge principles at a within-word level. As this previous study induced errors using word distractors created by exchanging adjacent morae in the target words, it is possible that the speech errors are expressions of lexical intrusions reflecting interactive activation of phonological and lexical/semantic representations. To eliminate this possibility, the present study used nonword distractors that had no lexical or semantic representations. This approach successfully replicated the error patterns identified in the abovementioned study, further confirming that the temporal distance and edge principles are organizing precepts in phonological planning.

Serial order in word form retrieval: New insights from the auditory picture-word interference task

One important theoretical question about word production concerns whether the phonemes of a word are retrieved in parallel or in sequential order. To address this question, Meyer and Schriefers (Journal of Experimental Psychology: Learning, Memory, and Cognition 17:1146-1160, 1991) used an auditory picture-word interference task and manipulated the position of the phonemes shared between a distractor word and a target picture. They found that begin-related distractors (e.g., boat-bone) facilitated naming times when they were presented within 150 ms before or after the picture, whereas end-related distractors (e.g., cone-bone) were effective only if presented within 150 ms after the picture. This suggested that the word's end phonemes were activated later than the beginning ones. However, it remained unclear whether these effects genuinely reflected facilitation at the level of phonological retrieval. In this study, we examined later distractor presentation onsets, so that the distractors had little opportunity to influence earlier, lexical selection processes. At the latest onset tested, end-related-but not begin-related-distractors significantly facilitated naming. We concluded that late-presented distractors do indeed influence phonological encoding, and that their asymmetric effects support a sequential model of phoneme retrieval.

The effect of speaking rate on serial-order sound-level errors in normal healthy controls and persons with aphasia

BACKGROUND

Although many speech errors can be generated at either a linguistic or motoric level of production, phonetically well-formed sound-level serial-order errors are generally assumed to result from disruption of phonologic encoding (PE) processes. An influential model of PE (Dell, 1986; Dell, Burger & Svec, 1997) predicts that speaking rate should affect the relative proportion of these serial-order sound errors (anticipations, perseverations, exchanges). These predictions have been extended to, and have special relevance for persons with aphasia (PWA) because of the increased frequency with which speech errors occur and because their localization within the functional linguistic architecture may help in diagnosis and treatment. Supporting evidence regarding the effect of speaking rate on phonological encoding has been provided by studies using young normal language (NL) speakers and computer simulations. Limited data exist for older NL users and no group data exist for PWA.

AIMS

This study tested the phonologic encoding properties of Dell's model of speech production (Dell, 1986; Dell,et al., 1997), which predicts that increasing speaking rate affects the relative proportion of serial-order sound errors (i.e., anticipations, perseverations, and exchanges).

METHODS & PROCEDURES

The effects of speech rate on the error ratios of anticipation/exchange (AE), anticipation/perseveration (AP) and vocal reaction time (VRT) were examined in 16 normal healthy controls (NHC) and 16 PWA without concomitant motor speech disorders. The participants were recorded performing a phonologically challenging (tongue twister) speech production task at their typical and two faster speaking rates.

OUTCOMES & RESULTS

A significant effect of increased rate was obtained for the AP but not the AE ratio. Significant effects of group and rate were obtained for VRT.

CONCLUSION

Although the significant effect of rate for the AP ratio provided evidence that changes in speaking rate did affect PE, the results failed to support the model derived predictions regarding the direction of change for error type proportions. The current findings argued for an alternative concept of the role of activation and decay in influencing types of serial-order sound errors. Rather than a slow activation decay rate (Dell, 1986), the results of the current study were more compatible with an alternative explanation of rapid activation decay or slow build-up of residual activation.

Context and meter enhance long-range planning in music performance

Neural responses demonstrate evidence of resonance, or oscillation, during the production of periodic auditory events. Music contains periodic auditory events that give rise to a sense of beat, which in turn generates a sense of meter on the basis of multiple periodicities. Metrical hierarchies may aid memory for music by facilitating similarity-based associations among sequence events at different periodic distances that unfold in longer contexts. A fundamental question is how metrical associations arising from a musical context influence memory during music performance. Longer contexts may facilitate metrical associations at higher hierarchical levels more than shorter contexts, a prediction of the range model, a formal model of planning processes in music performance (Palmer and Pfordresher, 2003; Pfordresher et al., 2007). Serial ordering errors, in which intended sequence events are produced in incorrect sequence positions, were measured as skilled pianists performed musical pieces that contained excerpts embedded in long or short musical contexts. Pitch errors arose from metrically similar positions and further sequential distances more often when the excerpt was embedded in long contexts compared to short contexts. Musicians' keystroke intensities and error rates also revealed influences of metrical hierarchies, which differed for performances in long and short contexts. The range model accounted for contextual effects and provided better fits to empirical findings when metrical associations between sequence events were included. Longer sequence contexts may facilitate planning during sequence production by increasing conceptual similarity between hierarchically associated events. These findings are consistent with the notion that neural oscillations at multiple periodicities may strengthen metrical associations across sequence events during planning.

Encoding order and developmental dyslexia: a family of skills predicting different orthographic components

We investigated order encoding in developmental dyslexia using a task that presented nonalphanumeric visual characters either simultaneously or sequentially--to tap spatial and temporal order encoding, respectively--and asked participants to reproduce their order. Dyslexic participants performed poorly in the sequential condition, but normally in the simultaneous condition, except for positions most susceptible to interference. These results are novel in demonstrating a selective difficulty with temporal order encoding in a dyslexic group. We also tested the associations between our order reconstruction tasks and: (a) lexical learning and phonological tasks; and (b) different reading and spelling tasks. Correlations were extensive when the whole group of participants was considered together. When dyslexics and controls were considered separately, different patterns of association emerged between orthographic tasks on the one side and tasks tapping order encoding, phonological processing, and written learning on the other. These results indicate that different skills support different aspects of orthographic processing and are impaired to different degrees in individuals with dyslexia. Therefore, developmental dyslexia is not caused by a single impairment, but by a family of deficits loosely related to difficulties with order. Understanding the contribution of these different deficits will be crucial to deepen our understanding of this disorder.

Making and monitoring errors based on altered auditory feedback

Previous research has demonstrated that altered auditory feedback (AAF) disrupts music performance and causes disruptions in both action planning and the perception of feedback events. It has been proposed that this disruption occurs because of interference within a shared representation for perception and action (Pfordresher, 2006). Studies reported here address this claim from the standpoint of error monitoring. In Experiment 1 participants performed short melodies on a keyboard while hearing no auditory feedback, normal auditory feedback, or alterations to feedback pitch on some subset of events. Participants overestimated error frequency when AAF was present but not for normal feedback. Experiment 2 introduced a concurrent load task to determine whether error monitoring requires executive resources. Although the concurrent task enhanced the effect of AAF, it did not alter participants' tendency to overestimate errors when AAF was present. A third correlational study addressed whether effects of AAF are reduced for a subset of the population who may lack the kind of perception/action associations that lead to AAF disruption: poor-pitch singers. Effects of manipulations similar to those presented in Experiments 1 and 2 were reduced for these individuals. We propose that these results are consistent with the notion that AAF interference is based on associations between perception and action within a forward internal model of auditory-motor relationships.

Within-word serial order control: Adjacent mora exchange and serial position effects in repeated single-word production

An essential function of language processing is serial order control. Computational models of serial ordering and empirical data suggest that plan representations for ordered output of sound are governed by principles related to similarity. Among these principles, the temporal distance and edge principles at a within-word level have not been empirically demonstrated separately from other principles. Specifically, the temporal distance principle assumes that phonemes that are in the same word and thus temporally close are represented similarly. This principle would manifest as phoneme movement errors within the same word. However, such errors are rarely observed in English, likely reflecting stronger effects of syllabic constraints (i.e., phonemes in different positions within the syllable are distinctly represented). The edge principle assumes that the edges of a sequence are represented distinctly from other elements/positions. This principle has been repeatedly observed as a serial position effect in the context of phonological short-term memory. However, it has not been demonstrated in single-word production. This study provides direct evidence for the two abovementioned principles by using a speech-error induction technique to show the exchange of adjacent morae and serial position effects in Japanese four-mora words. Participants repeatedly produced a target word or nonword, immediately after hearing an aurally presented distractor word. The phonologically similar distractor words, which were created by exchanging adjacent morae in the target, induced adjacent-mora-exchange errors, demonstrating the within-word temporal distance principle. There was also a serial position effect in error rates, such that errors were mostly induced at the middle positions within a word. The results provide empirical evidence for the temporal distance and edge principles in within-word serial order control.

The Relationship between Language Production and Verbal Short-Term Memory: The Role of Stress Grouping

This study investigates the influence of stress grouping on verbal short-term memory (STM). English speakers show a preference to combine syllables into trochaic groups, both lexically and in continuous speech. In two serial recall experiments, auditory lists of nonsense syllables were presented with either trochaic (STRONG–weak) or iambic (weak–STRONG) stress patterns, or in monotone. The acoustic correlates that carry stress were also manipulated in order to examine the relationship between input and output processes during recall. In Experiment 1, stressed and unstressed syllables differed in intensity and pitch but were matched for spoken duration. Significantly more syllables were recalled in the trochaic stress pattern condition than in the iambic and monotone conditions, which did not differ. In Experiment 2, spoken duration and pitch were manipulated but intensity was held constant. No effects of stress grouping were observed, suggesting that intensity is a critical acoustic factor for trochaic grouping. Acoustic analyses demonstrated that speech output was not identical to the auditory input, but that participants generated correct stress patterns by manipulating acoustic correlates in the same way in both experiments. These data challenge the idea of a language-independent STM store and support the notion of separable phonological input and output processes.

Phonemes and Production

This comment offers observations that support Hickok's claim that phoneme sized representations are involved more in speech production than speech perception, but notes that languages may vary with regard to the importance of the phoneme.

"Phonological" dysphasia: a cross-modal phonological impairment affecting repetition, production, and comprehension

In this paper we describe an aphasic patient, MS, who is impaired across a wide range of auditory input processing and spoken word production tasks. MS's performance on all these tasks shows phonological features: (1) his performance is poorest on auditory tasks with a strong phonological component, such as phoneme discrimination, auditory lexical decision, and word-picture matching featuring phono-logically related distractors; and (2) in spoken word production tasks, his errors are mainly phonemic and formal paraphasias. MS's single word repetition is particularly poor and exhibits some of the features of deep dysphasia, including lexicality effects (MS is unable to repeat nonwords) and image-ability effects. However, unlike in deep dysphasia, there are no semantic errors. We show that MS's condition, although apparently heterogeneous when viewed from a functional architecture perspective, can be described quite elegantly within an interactive-activation framework by proposing a single abnormality-a pathologically fast rate of decay within phonological representations.

Speed, accuracy, and serial order in sequence production

The production of complex sequences like music or speech requires the rapid and temporally precise production of events (e.g., notes and chords), often at fast rates. Memory retrieval in these circumstances may rely on the simultaneous activation of both the current event and the surrounding context (Lashley, 1951). We describe an extension to a model of incremental retrieval in sequence production (Palmer & Pfordresher, 2003) that incorporates this logic to predict overall error rates and speed-accuracy trade-offs, as well as types of serial ordering errors. The model-assumes that retrieval of the current event is influenced by activations of surrounding events. Activations of surrounding events increase over time, such that both the accessibility of distant events and overall accuracy increases at slower production rates. The model's predictions were tested in an experiment in which pianists performed unfamiliar music at 8 different tempi. Model fits to speed-accuracy data and to serial ordering errors support model predictions. Parameter fits to individual data further suggest that working memory contributes to the retrieval of serial order and overall accuracy is influenced in addition by motor dexterity and domain-specific skill.

Exploring the relationship between word processing and verbal short-term memory: evidence from associations and dissociations

A theory of the cognitive organisation of lexical processing, verbal short-term memory, and verbal learning is presented along with a summary of data that bear on this issue. We conceive of verbal STM as the outcome of processing that invokes both a specialised short-term memory and the lexical system. On this model, performance of verbal STM tasks depends on the integrity of lexical knowledge, access to that knowledge, and processes that encode serial order information.

Investigating the retention and time course of phonotactic constraint learning from production experience

Adults can rapidly learn artificial phonotactic constraints such as /f/ occurs only at the beginning of syllables by producing syllables that contain those constraints. This implicit learning is then reflected in their speech errors. However, second-order constraints in which the placement of a phoneme depends on another characteristic of the syllable (e.g., if the vowel is /æ/, /f/ occurs at the beginning of syllables and /s/ occurs at the end of syllables, but if the vowel is /I/, the reverse is true) require a longer learning period. Two experiments investigated the transience of second-order learning and whether consolidation plays a role in learning phonological dependencies, with speech errors used as a measure of learning. Experiment 1 tested the durability of learning and found that learning was still present in speech errors a week later. Experiment 2 looked at whether more time in the form of a consolidation period or more experience in the form of more trials was necessary for learning to be revealed in speech errors. Both consolidation and more trials led to learning; however, consolidation provided a more substantial benefit.

Bridging planning and execution: Temporal planning of syllables

This study compares the time to initiate words with varying syllable structures (V, VC, CV, CVC, CCV, CCVC). In order to test the hypothesis that different syllable structures require different amounts of time to prepare their temporal controls, or plans, two delayed naming experiments were carried out. In the first of these the initiation time was determined from acoustic recordings. The results confirmed the hypothesis but also showed an interaction with the initial segment (i.e., vowel-initial words were initiated later than words beginning with consonants, but this difference was much smaller for words starting stops compared to /l/ or /s/). Adding a coda did not affect the initiation time. In order to rule out effects of segment-specific articulatory to acoustic interval differences, a second experiment was performed in which speech movements of the tongue, the jaw and the lips were recorded by means of electromagnetic articulography. Results from initiation time, based on articulatory measurements, showed a significant syllable structure effect with VC words being initiated significantly later than CV(C) words. Only minor effects of the initial segment were found. These results can be partly explained by the amount of accumulated experience a speaker has in coordinating the relevant gesture combinations and triggering them appropriately in time.

Magnetic brain activity phase-locked to the envelope, the syllable onsets, and the fundamental frequency of a perceived speech signal

During speech perception, acoustic correlates of syllable structure and pitch periodicity are directly reflected in electrophysiological brain activity. Magnetoencephalography (MEG) recordings were made while 10 participants listened to natural or formant-synthesized speech at moderately fast or ultrafast rate. Cross-correlation analysis was applied to show brain activity time-locked to the speech envelope, to an acoustic marker of syllable onsets, and to pitch periodicity. The envelope yielded a right-lateralized M100-like response, syllable onsets gave rise to M50/M100-like fields with an additional anterior M50 component, and pitch (ca. 100 Hz) elicited a neural resonance bound to a central auditory source at a latency of 30 ms. The strength of these MEG components showed differential effects of syllable rate and natural versus synthetic speech. Presumingly, such phase-locking mechanisms serve as neuronal triggers for the extraction of information-bearing elements.

Serial Recall of Rhythms and Verbal Sequences: Impacts of Concurrent Tasks and Irrelevant Sound

Rhythmic grouping enhances verbal serial recall, yet very little is known about memory for rhythmic patterns. The aim of this study was to compare the cognitive processes supporting memory for rhythmic and verbal sequences using a range of concurrent tasks and irrelevant sounds. In Experiment 1, both concurrent articulation and paced finger tapping during presentation and during a retention interval impaired rhythm recall, while letter recall was only impaired by concurrent articulation. In Experiments 2 and 3, irrelevant sound consisted of irrelevant speech or tones, changing-state or steady-state sound, and syncopated or paced sound during presentation and during a retention interval. Irrelevant speech was more damaging to rhythm and letter recall than was irrelevant tone sound, but there was no effect of changing state on rhythm recall, while letter recall accuracy was disrupted by changing-state sound. Pacing of sound did not consistently affect either rhythm or letter recall. There are similarities in the way speech and rhythms are processed that appear to extend beyond reliance on temporal coding mechanisms involved in serial-order recall.

Cascading influences on the production of speech: evidence from articulation

Recent investigations have supported the suggestion that phonological speech errors may reflect the simultaneous activation of more than one phonemic representation. This presents a challenge for speech error evidence which is based on the assumption of well-formedness, because we may continue to perceive well-formed errors, even when they are not produced. To address this issue, we present two tongue-twister experiments in which the articulation of onset consonants is quantified and compared to baseline measures from cases where there is no phonemic competition. We report three measure of articulatory variability: changes in tongue-to-palate contact using electropalatography (EPG, Experiment 1), changes in midsagittal spline of the tongue using ultrasound (Experiment 2), and acoustic changes manifested as voice-onset time (VOT). These three sources provide converging evidence that articulatory variability increases when competing onsets differ by one phonological feature, but the increase is attenuated when onsets differ by two features. This finding provides clear evidence, based solely on production, that the articulation of phonemes is influenced by cascading activation from the speech plan.

Neural representations and mechanisms for the performance of simple speech sequences

Speakers plan the phonological content of their utterances before their release as speech motor acts. Using a finite alphabet of learned phonemes and a relatively small number of syllable structures, speakers are able to rapidly plan and produce arbitrary syllable sequences that fall within the rules of their language. The class of computational models of sequence planning and performance termed competitive queuing models have followed K. S. Lashley [The problem of serial order in behavior. In L. A. Jeffress (Ed.), Cerebral mechanisms in behavior (pp. 112-136). New York: Wiley, 1951] in assuming that inherently parallel neural representations underlie serial action, and this idea is increasingly supported by experimental evidence. In this article, we developed a neural model that extends the existing DIVA model of speech production in two complementary ways. The new model includes paired structure and content subsystems [cf. MacNeilage, P. F. The frame/content theory of evolution of speech production. Behavioral and Brain Sciences, 21, 499-511, 1998 ] that provide parallel representations of a forthcoming speech plan as well as mechanisms for interfacing these phonological planning representations with learned sensorimotor programs to enable stepping through multisyllabic speech plans. On the basis of previous reports, the model's components are hypothesized to be localized to specific cortical and subcortical structures, including the left inferior frontal sulcus, the medial premotor cortex, the basal ganglia, and the thalamus. The new model, called gradient order DIVA, thus fills a void in current speech research by providing formal mechanistic hypotheses about both phonological and phonetic processes that are grounded by neuroanatomy and physiology. This framework also generates predictions that can be tested in future neuroimaging and clinical case studies.

SYLLABARIUM: an online application for deriving complete statistics for Basque and Spanish orthographic syllables

The present article introduces SYLLABARIUM, a new Web tool addressing the needs of linguists, psycholinguists, and cognitive scientists who work with Spanish and/or Basque and are interested in retrieving information about several syllable-related parameters. This new online syllabic database allows the user to generate complete lists of Spanish and Basque syllables with information about the syllable frequency. Among other measures, for a given orthographic syllable, SYLLABARIUM provides its number of occurrences (i.e., the type frequency), the summed lexical frequency of the words that contain this syllable (i.e., the token frequency), and the positional distribution of type and token frequencies. The cross-language feature of SYLLABARIUM is of special interest to researchers aiming to explore the influence of the syllable in bilingualism. The Web tool is available at www.bcbl.eu/syllabarium.

How long does it take to describe what one sees? The first step using picture description tasks

The study explored the dependences between quantifiable features of a picture and the time it takes to describe it. Six native English speakers and six bilinguals watched pictures presented on the monitor and described them "as quickly and accurately as possible". The bilingual participants performed the test twice, in English and in their native language. The pictures could contain one to six objects. There were four series of trials that differed in the number of characteristics of the objects the participants were instructed to describe. Reaction time showed a modest, close to linear scaling with the number of objects. Both reaction time and speech time were significantly longer for the bilingual participants performing in English as compared to their performance in the native language and to the English speaking participants. The difference in reaction time did not depend on the number of objects. Speech time showed a close to linear scaling with the number of objects within each of the four series. The linear regression coefficient in this relationship increased linearly with the number of characteristics of the objects across all series. The results are discussed in relation to speed-accuracy trade-off and different strategies of picture description.

Twisting tongues and memories: Explorations of the relationship between language production and verbal working memory

Many accounts of working memory posit specialized storage mechanisms for the maintenance of serial order. We explore an alternative, that maintenance is achieved through temporary activation in the language production architecture. Four experiments examined the extent to which the phonological similarity effect can be explained as a sublexical speech error. Phonologically similar nonword stimuli were ordered to create tongue twister or control materials used in four tasks: reading aloud, immediate spoken recall, immediate typed recall, and serial recognition. Dependent measures from working memory (recall accuracy) and language production (speech errors) fields were used. Even though lists were identical except for item order, robust effects of tongue twisters were observed. Speech error analyses showed that errors were better described as phoneme rather than item ordering errors. The distribution of speech errors was comparable across all experiments and exhibited syllable-position effects, suggesting an important role for production processes. Implications for working memory and language production are discussed.

The role of natural class features in the acquisition of phonotactic regularities

Previous research has shown that phonotactic regularities can be acquired through recent production or auditory experience (e.g., Dell et al., Journal of Experimental Psychology: Learning, Memory, and Cognition, 26(6), 1355-1367, 2000; Onishi et al., Cognition, 83(1), B13-B23, 2002). However, little is known about the role of phonological natural classes in this learning process. This study addressed this question by investigating the acquisition of a contingency relationship between onsets and medial glides by Mandarin speakers. The experiments involved the manipulation of three types of phonotactic regularities. In the Laryngeal version, onsets that preceded the same glide shared a voicing feature. In the Place version, onsets that preceded same glide shared a place feature. In the Neither version, onsets associated with the same glide shared neither a voicing feature nor a place feature. Results showed the Place version and the Laryngeal version were more easily acquired than the Neither version in terms of the amount of exposure needed to acquire the experimentally manipulated phonotactic schema and the sustainability of the acquired schema. The results suggest that the statistical learning mechanism that guides our processing of speech input prefers phonological regularities that follow certain natural class features. This preference may account for the way natural languages are structured phonologically.

Semantic memory is key to binding phonology: converging evidence from immediate serial recall in semantic dementia and healthy participants

Patients with semantic dementia (SD) make numerous phoneme migration errors when recalling lists of words they no longer fully understand, suggesting that word meaning makes a critical contribution to phoneme binding in verbal short-term memory. Healthy individuals make errors that appear similar when recalling lists of nonwords, which also lack semantic support. Although previous studies have assumed that the errors in these two groups stem from the same underlying cause, they have never been directly compared. We tackled this issue by examining immediate serial recall for SD patients and controls on "pure" word lists and "mixed" lists that contained a mixture of words and nonwords. SD patients were equally poor at pure and mixed lists and made numerous phoneme migration errors in both conditions. In contrast, controls recalled pure lists better than mixed lists and only produced phoneme migrations for mixed lists. We also examined the claim that semantic activation is critical for words in the primacy portion of the list. In fact, the effect of mixed lists was greatest for later serial positions in the control group and in the SD group recall was poorest towards the ends of lists. These results suggest that mixing nonwords with words in healthy participants closely mimics the impact of semantic degradation in SD on word list recall. The study provides converging evidence for the idea that lexical/semantic knowledge is an important source of constraint on phonological coherence, ensuring that phonemes in familiar words are bound to each other and emerge together in recall.

Syllable timing and pausing: evidence from Cantonese

We examined the relationship between the acoustic duration of syllables and the silent pauses that follow them in Cantonese. The results showed that at major syntactic junctures, acoustic plus silent pause durations were quite similar for a number of different syllable types whose acoustic durations differed substantially. In addition, it appeared that CV: syllables, which had the longest acoustic duration of all syllable types that were examined, were also the least likely to have silent pauses after them. These results suggest that cross-language differences between the probability that silent pauses are used at major syntactic junctures might potentially be explained by the accuracy at which timing slots can be assigned for syllables, rather than more complex explanations that have been proposed.

Linking speech errors and phonological grammars: Insights from Harmonic Grammar networks

Phonological grammars characterize distinctions between relatively well-formed (unmarked) and relatively ill-formed (marked) phonological structures. We review evidence that markedness influences speech error probabilities. Specifically, although errors result in both unmarked as well as marked structures, there is a markedness asymmetry: errors are more likely to produce unmarked outcomes. We show that stochastic disruption to the computational mechanisms realizing a Harmonic Grammar (HG) can account for the broad empirical patterns of speech errors. We demonstrate that our proposal can account for the general markedness asymmetry. We also develop methods for linking particular HG proposals to speech error distributions, and illustrate these methods using a simple HG and a set of initial consonant errors in English.

Verbal working memory and language production: Common approaches to the serial ordering of verbal information

Verbal working memory (WM) tasks typically involve the language production architecture for recall; however, language production processes have had a minimal role in theorizing about WM. A framework for understanding verbal WM results is presented here. In this framework, domain-specific mechanisms for serial ordering in verbal WM are provided by the language production architecture, in which positional, lexical, and phonological similarity constraints are highly similar to those identified in the WM literature. These behavioral similarities are paralleled in computational modeling of serial ordering in both fields. The role of long-term learning in serial ordering performance is emphasized, in contrast to some models of verbal WM. Classic WM findings are discussed in terms of the language production architecture. The integration of principles from both fields illuminates the maintenance and ordering mechanisms for verbal information.

Translational research in aphasia: from neuroscience to neurorehabilitation

PURPOSE

In this article, the authors encapsulate discussions of the Language Work Group that took place as part of the Workshop in Plasticity/NeuroRehabilitation Research at the University of Florida in April 2005.

METHOD

In this narrative review, they define neuroplasticity and review studies that demonstrate neural changes associated with aphasia recovery and treatment. The authors then summarize basic science evidence from animals, human cognition, and computational neuroscience that is relevant to aphasia treatment research. They then turn to the aphasia treatment literature in which evidence exists to support several of the neuroscience principles.

CONCLUSION

Despite the extant aphasia treatment literature, many questions remain regarding how neuroscience principles can be manipulated to maximize aphasia recovery and treatment. They propose a framework, incorporating some of these principles, that may serve as a potential roadmap for future investigations of aphasia treatment and recovery. In addition to translational investigations from basic to clinical science, the authors propose several areas in which translation can occur from clinical to basic science to contribute to the fundamental knowledge base of neurorehabilitation. This article is intended to reinvigorate interest in delineating the factors influencing successful recovery from aphasia through basic, translational, and clinical research.

The role of a coda consonant as error trigger in repetition tasks

Speech errors are known to exhibit an intrusion bias in that segments are added rather than deleted; also, a shared final consonant can cause an interaction of the initial consonants. A principled connection between these two phenomena has been drawn in a gestural account of errors: Articulatory measures revealed a preponderance of errors in which both the target and intruding gesture are co-produced, instead of one replacing the other. This gestural intrusion bias has been interpreted as an errorful coupling of gestures in a dynamically stable coordination mode (1:1, in-phase), triggered by the presence of a shared coda consonant. Capturing tongue motion with ultrasound, the current paper investigates whether shared gestural composition other than a coda can trigger gestural co-production errors. Subjects repeated two-word phrases with alternating initial stop or fricative consonants in a coda condition (e.g., top cop), a nocoda condition (e.g., taa kaa) and a three-word phrase condition (e.g., taa kaa taa). The no-coda condition showed a lower error rate than the coda condition. The three-word phrase condition elicited an intermediate error rate for the stop consonants, but a high error rate for the fricative alternations. While all conditions exhibited both substitution and co-production errors, a gestural intrusion bias emerged mainly for the coda condition. The findings suggest that the proportion of different error types (substitutions, co-production errors) differs as a function of stimulus type: not all alternating stimulus patterns that trigger errors result in an intrusion bias.

Perceptual bias in speech error data collection: insights from Spanish speech errors

This paper studies the reliability and validity of naturalistic speech errors as a tool for language production research. Possible biases when collecting naturalistic speech errors are identified and specific predictions derived. These patterns are then contrasted with published reports from Germanic languages (English, German and Dutch) and one Romance language (Spanish). Unlike findings in the Germanic languages, Spanish speech errors show many patterns which run contrary to those expected from bias: (1) more phonological errors occur between words than within word; (2) word-initial consonants are less likely to participate in errors than word-medial consonants, (3) errors are equally likely in stressed and in unstressed syllables, (4) perseverations are more frequent than anticipations, and (5) there is no trace of a lexical bias. We present a new corpus of Spanish speech errors collected by many theoretically naïve observers (whereas the only corpus available so far was collected by two highly trained theoretically informed observers), give a general overview of it, and use it to replicate previous reports. In spite of the different susceptibility of these methods to bias, results were remarkably similar in both corpora and again contrary to predictions from bias. As a result, collecting speech errors "in the wild" seems to be free of bias to a reasonable extent even when using a multiple-collector method. The observed contrasting patterns between Spanish and Germanic languages arise as true cross-linguistic differences.