Serial control of phonology in speech production: a hierarchical model

Speech error elicitation and co-occurrence restrictions in two Ethiopian Semitic languages

This article reports the results of speech error elicitation experiments investigating the role of two consonant co-occurrence restrictions in the productive grammar of speakers of two Ethiopian Semitic languages, Amharic and Chaha. Higher error rates were found with consonant combinations that violated co-occurrence constraints than with those that had only a high degree of shared phonological similarity or low frequency of co-occurrence. Sequences that violated two constraints had the highest error rates. The results indicate that violations of consonant co-occurrence restrictions significantly increase error rates in the productions of native speakers, thereby supporting the psychological reality of the constraints.

Speech errors reflect newly learned phonotactic constraints

Speech errors reveal the speaker's implicit knowledge of phonotactic constraints, both languagewide constraints (e.g., /K/ cannot be a syllable onset when one is speaking English) and experimentally induced constraints (e.g., /k/ cannot be an onset during the experiment). Four experiments investigated the acquisition of novel 2nd-order constraints, in which the allowable position of a consonant depends on some other property of the syllable (e.g., /k/ can only be an onset if the vowel is /I/). Participants recited strings of syllables that exhibited the novel constraints throughout a 4-day experiment. Their errors reflected the newly learned constraints but not until the 2nd day of training. This contrasts with previous research showing that errors become sensitive to 1st-order constraints almost immediately. A model that learns to assign phonemes to syllable positions is presented. It attributes the relative slowness of the acquisition of 2nd-order constraints to the self-interfering property of these constraints.

Effects of hearing the past, present, or future during music performance

Three experiments were performed to explore the effects of mismatches between actions (key-presses) and the contents of auditory feedback (pitch events) during music performance. Pianists performed melodies from memory during altered auditory feedback that was synchronized with key-presses but matched the pitch of other sequence events. Feedback direction was manipulated by presenting pitches that matched events intended for the past (delays; Experiments 1 and 3) or the future (prelays; Experiments 2 and 3). Feedback distance was manipulated by varying the absolute separation between the current event and the location of the feedback pitch. All alterations disrupted the accuracy of performance (pitch errors) more so than timing. Serial-ordering errors indicated confusions among proximal and metrically similar events, consistent with the predictions of an incremental planning model (Palmer & Pfordresher, 2003). Patterns of serial-ordering errors suggested that performers compensate for the disruptive effects of altered feedback by changing event activations during planning.

An oscillator model of the timing of turn-taking

When humans talk without conventionalized arrangements, they engage in conversation--that is, a continuous and largely nonsimultaneous exchange in which speakers take turns. Turn-taking is ubiquitous in conversation and is the normal case against which alternatives, such as interruptions, are treated as violations that warrant repair. Furthermore, turn-taking involves highly coordinated timing, including a cyclic rise and fall in the probability of initiating speech during brief silences, and involves the notable rarity, especially in two-party conversations, of two speakers' breaking a silence at once. These phenomena, reported by conversation analysts, have been neglected by cognitive psychologists, and to date there has been no adequate cognitive explanation. Here, we propose that, during conversation, endogenous oscillators in the brains of the speaker and the listeners become mutually entrained, on the basis of the speaker's rate of syllable production. This entrained cyclic pattern governs the potential for initiating speech at any given instant for the speaker and also for the listeners (as potential next speakers). Furthermore, the readiness functions of the listeners are counterphased with that of the speaker, minimizing the likelihood of simultaneous starts by a listener and the previous speaker. This mutual entrainment continues for a brief period when the speech stream ceases, accounting for the cyclic property of silences. This model not only captures the timing phenomena observed inthe literature on conversation analysis, but also converges with findings from the literatures on phoneme timing, syllable organization, and interpersonal coordination.

Learning artificial phonotactic constraints: time course, durability, and relationship to natural constraints

G. S. Dell, K. D. Reed, D. R. Adams, and A. S. Meyer (2000) proposed a "breadth-of-constraint" continuum on phoneme errors, using artificial experiment-wide constraints to investigate a putative middle ground between local and language-wide constraints. The authors report 5 experiments that test the idea of the continuum and the location of the experiment-wide constraints within it. Experiments 1 and 2 replicated the findings of Dell et al. on the experiment-wide constraints but showed only chance adherence to the local positional constraints. Experiment 3 showed that the latter constraints are uniquely affected by the form of practice used. Experiments 4 and 5 investigated the time course and robustness of the experimental constraints by reversing them during testing. This caused no difficulty when occurring between blocks (Experiment 4) but caused short-lived disruption when occurring within block (Experiment 5). The authors propose that the results do not support the idea of a continuum, but that the experiment-wide constraints reflect a local biasing of language-wide constraints, probably related to the need for rapid learning.

A structural account of phonological paraphasias

The aim of this study is to develop a partial theory of phonological paraphasias which has some cross-syndrome and cross-linguistic validity. It is based on the distinction between content and structural units and emphasizes the role of the latter. The notion of structure holds the key to an understanding of the differences among the following three types of data: slips of the tongue, slips of the pen (defined as errors committed by healthy, competent adults), and paraphasias. A comparison of these three data types reveals that slips of the pen and paraphasias display striking similarities whereas slips of the tongue stand apart. This pattern emerges very clearly in an analysis of nine empirical effects all of which are found to be of a structural nature. On the basis of these results, it is argued that both the written output of normals and the oral output of aphasics are generated under a reduced structural representation (i.e., weak activation of structural nodes). However, the reasons for the diminished sensitivity to structure are not the same in the two modalities. While the impoverished structural representation is a likely consequence of the relatively slow production rate in writing, it may stem from an impaired transmission of activation among structural nodes in aphasia. By contrast, the normal speaking process occurs under the sway of a full-fledged structural representation. Hence, slips of the tongue are highly sensitive to structural effects.

Processing of extrafoveal objects during multiple-object naming

In 3 experiments, the authors investigated the extent to which objects that are about to be named are processed prior to fixation. Participants named pairs or triplets of objects. One of the objects, initially seen extrafoveally (the interloper), was replaced by a different object (the target) during the saccade toward it. The interloper-target pairs were identical or unrelated objects or visually and conceptually unrelated objects with homophonous names (e.g., animal- baseball bat). The mean latencies and gaze durations for the targets were shorter in the identity and homophone conditions than in the unrelated condition. This was true when participants viewed a fixation mark until the interloper appeared and when they fixated on another object and prepared to name it while viewing the interloper. These results imply that objects that are about to be named may undergo far-reaching processing, including access to their names, prior to fixation.

Transposition asymmetry in immediate serial recall

When participants confuse the position of items in immediate serial recall, they tend to recall transposed items too early rather than too late. This asymmetry of transposition errors was observed in four experiments. It increased as a function of list length, but was independent of report order, output position, cueing condition, and recall mode. The transposition asymmetry is consistent with error patterns in free recall and in regular speech production where transpositions are usually forward-looking. The asymmetry of transposition errors is discussed in terms of models of serial memory.

Serial order reconstruction in Down syndrome: evidence for a selective deficit in verbal short-term memory

BACKGROUND

Individuals with Down syndrome consistently perform less well than appropriately matched comparison groups on tests of verbal short-term memory, despite performing relatively well on non-verbal short-term memory tasks. However, it is not clear whether these findings constitute evidence for a selective deficit in verbal short-term memory, or whether they instead reflect the influence of non-central factors such as speech difficulties or poor number knowledge.

METHODS

Twenty-six individuals with Down syndrome and 32 typically developing children were tested on a digit reconstruction task in which participants were presented with auditory digit sequences and responded by pressing the corresponding digits on a touch-screen in the correct serial order. Background measures were performance on a closely matched visuo-spatial reconstruction task, reaction time on a simple digit identification task, receptive vocabulary age and non-verbal ability (Raven's matrices). Participants were also tested on a conventional digit recall task.

RESULTS

All four background measures accounted for significant individual variation in digit reconstruction performance, but there remained a significant effect of group that reflected relatively poor performance of individuals with Down syndrome. Hierarchical regression showed that group membership accounted for unique variation in both digit reconstruction and recall performance, even after all group differences on background measures had been accounted for.

CONCLUSIONS

The results provide strong evidence that Down syndrome is associated with a selective deficit in verbal short-term memory, and a deficit in verbal serial order memory in particular. Implications for the language difficulties associated with Down syndrome are discussed.

Contrasting effects of phonological priming in aphasic word production

Two fluent aphasics, IG and GL, performed a phonological priming task in which they repeated an auditory prime then named a target picture. The two patients both had selective deficits in word production: they were at or near ceiling on lexical comprehension tasks, but were significantly impaired in picture naming. IG's naming errors included both semantic and phonemic paraphasias, as well as failures to respond, whereas GL's errors were mainly phonemic and formal paraphasias. The two patients responded very differently to phonological priming: IG's naming was facilitated (both accuracy and speed) only by begin-related primes (e.g. ferry-feather), whereas GL benefited significantly only from end-related primes (e.g. brother-feather), showing no more than a facilitatory trend with begin-related primes. We interpret these results within a two-stage model of word production, in which begin-related and end-related primes are said to operate at different stages. We then discuss implications for models of normal and aphasic word production in general and particularly with respect to sequential aspects of the phonological encoding process.

Language influences on verbal short-term memory performance in Down syndrome: item and order recognition

Down syndrome is associated with severe deficits in language and verbal shortterm memory, but the causal relationship between these deficits is unclear. The current study therefore investigated the influence of language abilities on verbal short-term memory performance in Down syndrome. Twenty-one individuals with Down syndrome and 29 younger typically developing children were tested on memory for words and nonwords using 2 immediate recognition tasks: an order memory task that was a relatively pure measure of verbal short-term memory and an item memory task that was more sensitive to language ability. Despite having superior vocabulary knowledge to the typically developing children, individuals with Down syndrome were impaired on both order and item tasks. This impairment was particularly marked on the item task, where individuals with Down syndrome showed an atypically large lexicality effect. These results are interpreted in terms of an underlying verbal short-term memory deficit in Down syndrome that is compounded by poor phonological discrimination abilities.

Examining the relationship between word learning, nonword repetition, and immediate serial recall in adults

Two experiments examined whether the association between word-learning, nonword repetition, and immediate serial recall observed in children also exists in normal adults. The experiments also introduce a novel paradigm for studying word-learning. Experiment 1 studied the performance of 52 adults in nonword repetition, immediate serial recall, and word-learning tasks, examining the correlation between these measures. The results indicate that the developmental relationships between all three abilities also exist in adults. Experiment 2 investigated the robustness of these results using different stimuli and a variant of the word-learning task, and it also examined performance in a visuospatial span task, to test an alternative account of the results of Experiment 1; the results from 58 adults provide further evidence that the developmental association between word-learning, nonword repetition, and immediate serial recall extends into adulthood. The theoretical implications of these findings are discussed in terms of alternative models of the relationship between these abilities.

Auditory serial position effects in story retelling for non-brain-injured participants and persons with aphasia

Using story retelling as an index of language ability, it is difficult to disambiguate comprehension and memory deficits. Collecting data on the serial position effect (SPE), however, illuminates the memory component. This study examined the SPE of the percentage of information units (%IU) produced in the connected speech samples of adults with aphasia and age-matched, non-brain-injured (NBI) participants. The NBI participants produced significantly more direct and alternate IUs than participants with aphasia. Significant age and gender differences were found in subsamples of the NBI controls, with younger and female participants generating significantly more direct IUs than male and older NBI participants. Alternate IU productions did not generate an SPE from any group. There was a significant linear increase from the initial (primacy) to the final (recency) portion of the recalled alternate IUs for both the NBI group and the group of participants with aphasia. Results provide evidence that individuals with aphasia recall discourse length information using similar memory functions as the nonimpaired population, though at a reduced level of efficiency or quantity. A quadratic model is suggested for the recall of information directly recalled from discourse-length language material.

A Computational Model of Prefrontal Control in Free Recall: Strategic Memory Use in the California Verbal Learning Task

Several decades of research into the function of the frontal lobes in brain-damaged patients, and more recently in intact individuals using function brain imaging, has delineated the complex executive functions of the frontal cortex. And yet, the mechanisms by which the brain achieves these functions remain poorly understood. Here, we present a computational model of the role of the prefrontal cortex (PFC) in controlled memory use that may help to shed light on the mechanisms underlying one aspect of frontal control: the development and deployment of recall strategies. The model accounts for interactions between the PFC and medial temporal lobe in strategic memory use. The PFC self-organizes its own mnemonic codes using internally derived performance measures. These mnemonic codes serve as retrieval cues by biasing retrieval in the medial temporal lobe memory system. We present data from three simulation experiments that demonstrate strategic encoding and retrieval in the free recall of categorized lists of words. Experiment 1 compares the performance of the model with two control networks to evaluate the contribution of various components of the model. Experiment 2 compares the performance of normal and frontally lesioned models to data from several studies using frontally intact and frontally lesioned individuals, as well as normal, healthy individuals under conditions of divided attention. Experiment 3 compares the model's performance on the recall of blocked and unblocked categorized lists of words to data from Stuss et al. (1994) for individuals with control and frontal lobe lesions. Overall, our model captures a number of aspects of human performance on free recall tasks: an increase in total words recalled and in semantic clustering scores across trials, superiority on blocked lists of related items compared to unblocked lists of related items, and similar patterns of performance across trials in the normal and frontally lesioned models, with poorer overall performance of the lesioned models on all measures. The model also has a number of shortcomings, in light of which we suggest extensions to the model that would enable more sophisticated forms of strategic control.

Incremental planning in sequence production

People produce long sequences such as speech and music with incremental planning: mental preparation of a subset of sequence events. The authors model in music performance the sequence events that can be retrieved and prepared during production. Events are encoded in terms of their serial order and timing relative to other events in a planning increment, a contextually determined distribution of event activations. Planning is facilitated by events' metrical similarity and serial/temporal proximity and by developmental changes in short-term memory. The model's predictions of larger planning increments as production rate decreases and as producers' age-experience increases are confirmed in serial-ordering errors produced by adults and children. Incremental planning is considered as a general retrieval constraint in serially ordered behaviors.

Preliminary results of a functional MRI study of brain activation patterns in stuttering and nonstuttering speakers during a lexical access task

An fMRI study examining lexical access and lexical generation in nine non-stuttering and seven stuttering speakers is presented. Lexical access was examined during a word description task that was presented auditorily while subjects "silently" thought of the target words. Participants alternated between four 30-s rest blocks and four 30-s "active" blocks. Activation patterns were assessed utilizing a standard subtraction paradigm, where the activation during the rest blocks was subtracted from the activation during the active blocks. High levels of variability characterized activation patterns within both speaker groups. Group comparisons using random effects statistical analyses did not identify significant differences between the groups when corrected for multiple comparisons. Analyses were subsequently conducted by comparing the trends in the group activation patterns between the speaker groups using fixed (corrected) and random effects (uncorrected) analyses. Non-stuttering control speakers activated primarily left hemisphere cortical speech and language areas while the stuttering speakers appeared to produce more bilateral activation. Discussion of these results focuses on the specific within- and between-hemispheric activation patterns and possible interpretations of these patterns.

EDUCATIONAL OBJECTIVES

The reader will learn about: (1) issues related to interpreting brain activation findings in stuttering speakers; (2) the role and neurological substrates of lexical access during speech production in non-stuttering and stuttering speakers; (3) the basics of functional MRI; and (4) the brain activation areas involved during a silent lexical retrieval task in non-stuttering and stuttering speakers.

Phonological neighborhood effects in aphasic speech errors: spontaneous and structured contexts

The current study investigates the influence of phonological neighborhoods on the accuracy of speech production in aphasia by examining errors produced in both spontaneous and structured speech tasks. Characteristics of the phonological neighborhoods of spontaneously produced aphasic errors are compared to the neighborhood characteristics of correctly produced targets in a picture description task. Accuracy of picture naming is also examined with reference to the phonological neighborhood characteristics of the stimuli. Results show that frequency of occurrence and neighborhood density play a facilitative role in speech production, replicating findings from recent studies with normal subjects. It is argued that the results are most parsimoniously explained within an interactive activation framework of lexical access.

The influence of phonological context on the sound errors of a speaker with Wernicke's aphasia

A corpus of phonological errors produced in narrative speech by a Wernicke's aphasic speaker (R.W.B.) was tested for context effects using two new methods for establishing chance baselines. A reliable anticipatory effect was found using the second method, which estimated chance from the distance between phoneme repeats in the speech sample containing the errors. Relative to this baseline, error-source distances were shorter than expected for anticipations, but not perseverations. R.W.B.'s anticipation/perseveration ratio measured intermediate between a nonaphasic error corpus and that of a more severe aphasic speaker (both reported in Schwartz et al., 1994), supporting the view that the anticipatory bias correlates to severity. Finally, R.W.B's anticipations favored word-initial segments, although errors and sources did not consistently share word or syllable position.