Limited interaction in speech production: Chronometric, speech error, and neuropsychological evidence

Iterative alignment discovery of speech-associated neural activity

Objective. Brain-computer interfaces (BCIs) have the potential to preserve or restore speech in patients with neurological disorders that weaken the muscles involved in speech production. However, successful training of low-latency speech synthesis and recognition models requires alignment of neural activity with intended phonetic or acoustic output with high temporal precision. This is particularly challenging in patients who cannot produce audible speech, as ground truth with which to pinpoint neural activity synchronized with speech is not available.Approach. In this study, we present a new iterative algorithm for neural voice activity detection (nVAD) called iterative alignment discovery dynamic time warping (IAD-DTW) that integrates DTW into the loss function of a deep neural network (DNN). The algorithm is designed to discover the alignment between a patient's electrocorticographic (ECoG) neural responses and their attempts to speak during collection of data for training BCI decoders for speech synthesis and recognition.Main results. To demonstrate the effectiveness of the algorithm, we tested its accuracy in predicting the onset and duration of acoustic signals produced by able-bodied patients with intact speech undergoing short-term diagnostic ECoG recordings for epilepsy surgery. We simulated a lack of ground truth by randomly perturbing the temporal correspondence between neural activity and an initial single estimate for all speech onsets and durations. We examined the model's ability to overcome these perturbations to estimate ground truth. IAD-DTW showed no notable degradation (<1% absolute decrease in accuracy) in performance in these simulations, even in the case of maximal misalignments between speech and silence.Significance. IAD-DTW is computationally inexpensive and can be easily integrated into existing DNN-based nVAD approaches, as it pertains only to the final loss computation. This approach makes it possible to train speech BCI algorithms using ECoG data from patients who are unable to produce audible speech, including those with Locked-In Syndrome.

Focusing on the locus of the breakdown for treatment of anomia: a pilot study

The primary goal of this study was to evaluate the treatment effects of semantic feature analysis (SFA) and phonological components analysis (PCA) on word retrieval processing in persons with aphasia (PWAs). After identifying the locus of the breakdown in lexical retrieval processing, 15 monolingual native Persian speakers with aphasia were divided into two groups. After three naming trials, participants with dominant semantic deficits received SFA, and participants with primary phonological deficits were provided with PCA three times a week for eight weeks. Both approaches improved participants' naming and performance on language tests, including spontaneous speech, repetition, comprehension, and semantic processing. However, the correct naming of treated and untreated items was higher in mild-to-moderate participants, with mostly circumlocution and semantic paraphasias in the SFA group. The same holds for mild-to-moderate participants with mostly phonemic paraphasia who received PCA therapy. Moreover, the results showed that participants' baseline naming performance and semantic abilities could be associated with the treatment outcomes. Although limited by a lack of a control group, this study provided evidence supporting the possible benefits of focusing on the locus of the breakdown for treating anomia through SFA and PCA approaches, specifically in participants with mild to moderate aphasia. However, for those with severe aphasia, the treatment choice may not be as straightforward because several variables are likely to contribute to this population's word-finding difficulties. Replication with larger, well-stratified samples, use of a within-subjects alternating treatment design and consideration of treatments' long-term effects are required to better ascertain the effects of focusing on the locus of breakdown for treatment of anomia.

How to cut the pie is no piece of cake: Toward a process-oriented approach to assessment and diagnosis of speech sound disorders

BACKGROUND

'Speech sound disorder' is an umbrella term that encompasses dysarthria, articulation disorders, childhood apraxia of speech and phonological disorders. However, differential diagnosis between these disorders is a persistent challenge in speech pathology, as many diagnostic procedures use symptom clusters instead of identifying an origin of breakdown in the speech and language system.

AIMS

This article reviews typical and disordered speech through the lens of two well-developed models of production-one focused on phonological encoding and one focused on speech motor planning. We illustrate potential breakdown locations within these models that may relate to childhood apraxia of speech and phonological disorders.

MAIN CONTRIBUTION

This paper presents an overview of an approach to conceptualisation of speech sound disorders that is grounded in current models of speech production and emphasises consideration of underlying processes. The paper also sketches a research agenda for the development of valid, reliable and clinically feasible assessment protocols for children with speech sound disorders.

CONCLUSION

The process-oriented approach outlined here is in the early stages of development but holds promise for developing a more detailed and comprehensive understanding of, and assessment protocols for speech sound disorders that go beyond broad diagnostic labels based on error analysis. Directions for future research are discussed.

WHAT THIS PAPER ADDS

What is already known on the subject Speech sound disorders (SSD) are heterogeneous, and there is agreement that some children have a phonological impairment (phonological disorders, PD) whereas others have an impairment of speech motor planning (childhood apraxia of speech, CAS). There is also recognition that speech production involves multiple processes, and several approaches to the assessment and diagnosis of SSD have been proposed. What this paper adds to existing knowledge This paper provides a more detailed conceptualisation of potential impairments in children with SSD that is grounded in current models of speech production and encourages greater consideration of underlying processes. The paper illustrates this approach and provides guidance for further development. One consequence of this perspective is the notion that broad diagnostic category labels (PD, CAS) may each comprise different subtypes or profiles depending on the processes that are affected. What are the potential or actual clinical implications of this work? Although the approach is in the early stages of development and no comprehensive validated set of tasks and measures is available to assess all processes, clinicians may find the conceptualisation of different underlying processes and the notion of potential subtypes within PD and CAS informative when evaluating SSD. In addition, this perspective discourages either/or thinking (PD or CAS) and instead encourages consideration of the possibility that children may have different combinations of impairments at different processing stages.

Graph structure analysis of speech production among second language learners of Spanish and Chinese

Language experience shapes the gradual maturation of speech production in both native (L1) and second (L2) languages. Structural aspects like the connectedness of spontaneous narratives reveal this maturation progress in L1 acquisition and, as it does not rely on semantics, it could also reveal structural pattern changes during L2 acquisition. The current study tested whether L2 lexical retrieval associated with vocabulary knowledge could impact the global connectedness of narratives during the initial stages of L2 acquisition. Specifically, the study evaluated the relationship between graph structure (long-range recurrence or connectedness) and L2 learners’ oral production in the L2 and L1. Seventy-nine college-aged students who were native speakers of English and had received classroom instruction in either L2-Spanish or L2-Chinese participated in this study. Three tasks were used: semantic fluency, phonemic fluency and picture description. Measures were operationalized as the number of words per minute in the case of the semantic and phonemic fluency tasks. Graph analysis was carried out for the picture description task using the computational tool SpeechGraphs to calculate connectedness. Results revealed significant positive correlations between connectedness in the picture description task and measures of speech production (number of correct responses per minute) in the phonemic and semantic fluency tasks. These correlations were only significant for the participants’ L2- Spanish and Chinese. Results indicate that producing low connectedness narratives in L2 may be a marker of the initial stages of L2 oral development. These findings are consistent with the pattern reported in the early stages of L1 literacy. Future studies should further explore the interactions between graph structure and second language production proficiency, including more advanced stages of L2 learning and considering the role of cognitive abilities in this process.

Good-Enough Production: Selecting Easier Words Instead of More Accurate Ones

Dominant theories of language production suggest that word choice-lexical selection-is driven by alignment with the intended message: To talk about a young feline, we choose the most aligned word, kitten. Another factor that could shape lexical selection is word accessibility, or how easy it is to produce a given word (e.g., cat is more accessible than kitten). To test whether producers are also influenced by word accessibility, we designed an artificial lexicon containing high- and low-frequency words whose meanings correspond to compass directions. Participants in a communication game (total N = 181 adults) earned points by producing compass directions, which often required an implicit decision between a high- and low-frequency word. A trade-off was observed across four experiments; specifically, high-frequency words were produced even when less aligned with messages. These results suggest that implicit decisions between words are impacted by accessibility. Of all the times that people have produced cat, sometimes they likely meant kitten.

Individualized response to semantic versus phonological aphasia therapies in stroke

Attempts to personalize aphasia treatment to the extent where it is possible to reliably predict individual response to a particular treatment have yielded inconclusive results. The current study aimed to (i) compare the effects of phonologically versus semantically focussed naming treatment and (ii) examine biographical and neuropsychological baseline factors predictive of response to each treatment. One hundred and four individuals with chronic post-stroke aphasia underwent 3 weeks of phonologically focussed treatment and 3 weeks of semantically focussed treatment in an unblinded cross-over design. A linear mixed-effects model was used to compare the effects of treatment type on proportional change in correct naming across groups. Correlational analysis and stepwise regression models were used to examine biographical and neuropsychological predictors of response to phonological and semantic treatment across all participants. Last, chi-square tests were used to explore the association between treatment response and phonological and semantic deficit profiles. Semantically focussed treatment was found to be more effective at the group-level, independently of treatment order (P = 0.041). Overall, milder speech and language impairment predicted good response to semantic treatment (r range: 0.256-0.373) across neuropsychological tasks. The Western Aphasia Battery-Revised Spontaneous Speech score emerged as the strongest predictor of semantic treatment response (R 2 = 0.188). Severity of stroke symptoms emerged as the strongest predictor of phonological treatment response (R 2 = 0.103). Participants who showed a good response to semantic treatment were more likely to present with fluent speech compared to poor responders (P = 0.005), whereas participants who showed a good response to phonological treatment were more likely to present with apraxia of speech (P = 0.020). These results suggest that semantic treatment may be more beneficial to the improvement of naming performance in aphasia than phonological treatment, at the group-level. In terms of personalized predictors, participants with relatively mild impairments and fluent speech responded better to semantic treatment, while phonological treatment benefitted participants with more severe impairments and apraxia of speech.

To Lump or to Split? Possible Subtypes of Apraxia of Speech

BACKGROUND

The speculation that apraxia of speech (AOS) is not a unitary diagnosis, but consists of different subtypes instead, has been around for decades. However, attempts to empirically substantiate such a notion remain few and far between.

AIMS

The primary objective of this article is to consider the different bases for identifying subtypes of AOS, review existing evidence regarding subtypes under each classification basis, and provide discussion and implications for future research.

MAIN CONTRIBUTION

AOS subtypes have been proposed on the basis of clinical symptomatology, theoretical constructs, and an analogy to limb apraxia. Different possible subtypes of AOS are reviewed, along with their empirical support and limitations. Empirical evidence, particularly in the context of a progressive disease, supports the idea that AOS diagnosis may capture different underlying impairments of speech motor planning. Future research to advance our understanding of AOS should carefully consider the basis for subtype classification, and include large sample sizes to differentiate individual variability from possible subtypes.

CONCLUSIONS

Several proposed AOS subtypes have found some support in the literature. Further research is needed to determine the validity, coherence and utility of possible AOS subtypes for theoretical and clinical purposes.

Investigating the effects of phonological neighbors on word retrieval and phonetic variation in word naming and picture naming paradigms

Phonological neighbors have been shown to affect word processing. Prior work has shown that when a word with an initial voiceless stop has a contrasting initial voiced stop neighbor, Voice Onset Times (VOTs) are longer. Higher phonological neighborhood density (PND) has also been shown to facilitate word retrieval latency, and be associated with longer VOTs. However, these effects have rarely been investigated with picture naming, which is thought to be a more semantically driven task. The current study examined the effects of phonological neighbors on word retrieval times and phonetic variation, and how these effects differed in word naming and picture naming paradigms. Results showed that PND was positively correlated with longer VOT in both paradigms. Furthermore, the effect of initial stop neighbors on VOTs was only significant in word naming. These results highlight the influence of phonological neighbors on word production in different paradigms, support interactive models of word production, and suggest that hyper-articulation in speech does not solely depend on communicative context.

Speech Production From a Developmental Perspective

Purpose Current approaches to speech production aim to explain adult behavior and so make assumptions that, when taken to their logical conclusion, fail to adequately account for development. This failure is problematic if adult behavior can be understood to emerge from the developmental process. This problem motivates the proposal of a developmentally sensitive theory of speech production. The working hypothesis, which structures the theory, is that feedforward representations and processes mature earlier than central feedback control processes in speech production. Method Theoretical assumptions that underpin the 2 major approaches to adult speech production are reviewed. Strengths and weaknesses are evaluated with respect to developmental patterns. A developmental approach is then pursued. The strengths of existing theories are borrowed, and the ideas are resynthesized under the working hypothesis. The speech production process is then reimagined in developmental stages, with each stage building on the previous one. Conclusion The resulting theory proposes that speech production relies on conceptually linked representations that are information-reduced holistic perceptual and motoric forms, constituting the phonological aspect of a system that is acquired with the lexicon. These forms are referred to as exemplars and schemas, respectively. When a particular exemplar and schema are activated with the selection of a particular lexical concept, their forms are used to define unique trajectories through an endogenous perceptual-motor space that guides implementation. This space is not linguistic, reflecting its origin in the prespeech period. Central feedback control over production emerges with failures in communication and the development of a self-concept.

Intervention for children with word-finding difficulties: a parallel group randomised control trial

PURPOSE

The study investigated the outcome of a word-web intervention for children diagnosed with word-finding difficulties (WFDs).

METHOD

Twenty children age 6-8 years with WFDs confirmed by a discrepancy between comprehension and production on the Test of Word Finding-2, were randomly assigned to intervention (n = 11) and waiting control (n = 9) groups. The intervention group had six sessions of intervention which used word-webs and targeted children's meta-cognitive awareness and word-retrieval.

RESULT

On the treated experimental set (n = 25 items) the intervention group gained on average four times as many items as the waiting control group (d = 2.30). There were also gains on personally chosen items for the intervention group. There was little change on untreated items for either group.

CONCLUSION

The study is the first randomised control trial to demonstrate an effect of word-finding therapy with children with language difficulties in mainstream school. The improvement in word-finding for treated items was obtained following a clinically realistic intervention in terms of approach, intensity and duration.

A Systematic Review of Semantic Feature Analysis Therapy Studies for Aphasia

PURPOSE

The purpose of this study was to review treatment studies of semantic feature analysis (SFA) for persons with aphasia. The review documents how SFA is used, appraises the quality of the included studies, and evaluates the efficacy of SFA.

METHOD

The following electronic databases were systematically searched (last search February 2017): Academic Search Complete, CINAHL Plus, E-journals, Health Policy Reference Centre, MEDLINE, PsycARTICLES, PsycINFO, and SocINDEX. The quality of the included studies was rated. Clinical efficacy was determined by calculating effect sizes (Cohen's d) or percent of nonoverlapping data when d could not be calculated.

RESULTS

Twenty-one studies were reviewed reporting on 55 persons with aphasia. SFA was used in 6 different types of studies: confrontation naming of nouns, confrontation naming of verbs, connected speech/discourse, group, multilingual, and studies where SFA was compared with other approaches. The quality of included studies was high (Single Case Experimental Design Scale average [range] = 9.55 [8.0-11]). Naming of trained items improved for 45 participants (81.82%). Effect sizes indicated that there was a small treatment effect.

CONCLUSIONS

SFA leads to positive outcomes despite the variability of treatment procedures, dosage, duration, and variations to the traditional SFA protocol. Further research is warranted to examine the efficacy of SFA and generalization effects in larger controlled studies.

Variation in the speech signal as a window into the cognitive architecture of language production

The pronunciation of words is highly variable. This variation provides crucial information about the cognitive architecture of the language production system. This review summarizes key empirical findings about variation phenomena, integrating corpus, acoustic, articulatory, and chronometric data from phonetic and psycholinguistic studies. It examines how these data constrain our current understanding of word production processes and highlights major challenges and open issues that should be addressed in future research.

Interactions between Lexical Access and Articulation

This study investigates the interaction of lexical access and articulation in spoken word production, examining two dimensions along which theories vary. First, does articulatory variation reflect a fixed plan, or do lexical access-articulatory interactions continue after response initiation? Second, to what extent are interactive mechanisms hard-wired properties of the production system, as opposed to flexible? In two picture-naming experiments, we used semantic neighbor manipulations to induce lexical and conceptual co-activation. Our results provide evidence for multiple sources of interaction, both before and after response initiation. While interactive effects can vary across participants, we do not find strong evidence of variation of effects within individuals, suggesting that these interactions are relatively fixed features of each individual's production system.

Inducing speech errors in dysarthria using tongue twisters

Although tongue twisters have been widely use to study speech production in healthy speakers, few studies have employed this methodology for individuals with speech impairment. The present study compared tongue twister errors produced by adults with dysarthria and age-matched healthy controls. Eight speakers (four female, four male; mean age = 54.5 years) with spastic (mixed-spastic) dysarthria of varying aetiology (cerebral palsy, multiple sclerosis, multiple system atrophy) and eight controls (four female, four male; mean age = 56.9 years) were audio-recorded producing tongue twisters. One word in each tongue twister was marked for prominence. Speakers with dysarthria produced significantly more errors and spoke slower than healthy controls. The effect of prominence was significant for both groups-words spoken with prosodic prominence were significantly less error prone compared with words without prominence. While both groups produced most errors on words in the third position (of four-word utterances), speakers with dysarthria also produced high rates of errors on the first and fourth words. This preliminary investigation demonstrated the promise of applying the tongue twister paradigm to speakers with dysarthria and contributes to the evidence base for the implementation of prosodic strategies in speech intervention.

A case series comparison of semantically focused vs. phonologically focused cued naming treatment in aphasia

There is a lack of clarity in the field regarding how to best predict which naming treatment will be most beneficial for a particular individual with aphasia. The purpose of this study was to elucidate whether or not semantic or phonological therapy differentially impacts on outcomes for people with a range of different aphasic profiles when given both therapies. A single-participant design, with multiple repeated baselines for naming, replicated across four participants, was used. Participants were provided with a counterbalanced order of Semantic Feature Analysis (SFA) and Phonological Components Analysis (PCA) treatment. Findings demonstrated differential effects across participants. This seemed to be influenced by factors such as severity of anomia, order of treatment presentation, and capacity limits. Clinical implications of these findings highlight the importance of expanding our picture of a participant's behaviours to consider what other important factors can inform intervention decisions.

Negative induced mood influences word production: An event-related potentials study with a covert picture naming task

The present event-related potentials (ERPs) study investigated the effects of mood on phonological encoding processes involved in word generation. For this purpose, negative, positive and neutral affective states were induced in participants during three different recording sessions using short film clips. After the mood induction procedure, participants performed a covert picture naming task in which they searched letters. The negative compared to the neutral mood condition elicited more negative amplitudes in a component peaking around 290ms. Furthermore, results from source localization analyses suggested that this activity was potentially generated in the left prefrontal cortex. In contrast, no differences were found in the comparison between positive and neutral moods. Overall, current data suggest that processes involved in the retrieval of phonological information during speech generation are impaired when participants are in a negative mood. The mechanisms underlying these effects were discussed in relation to linguistic and attentional processes, as well as in terms of the use of heuristics.

Phonetic basis of phonemic paraphasias in aphasia: Evidence for cascading activation

Phonemic paraphasias are a common presenting symptom in aphasia and are thought to reflect a deficit in which selecting an incorrect phonemic segment results in the clear-cut substitution of one phonemic segment for another. The current study re-examines the basis of these paraphasias. Seven left hemisphere-damaged aphasics with a range of left hemisphere lesions and clinical diagnoses including Broca's, Conduction, and Wernicke's aphasia, were asked to produce syllable-initial voiced and voiceless fricative consonants, [z] and [s], in CV syllables followed by one of five vowels [i e a o u] in isolation and in a carrier phrase. Acoustic analyses were conducted focusing on two acoustic parameters signaling voicing in fricative consonants: duration and amplitude properties of the fricative noise. Results show that for all participants, regardless of clinical diagnosis or lesion site, phonemic paraphasias leave an acoustic trace of the original target in the error production. These findings challenge the view that phonemic paraphasias arise from a mis-selection of phonemic units followed by its correct implementation, as traditionally proposed. Rather, they appear to derive from a common mechanism with speech errors reflecting the co-activation of a target and competitor resulting in speech output that has some phonetic properties of both segments.

Phonological Encoding in Mandarin Chinese: Evidence from Tongue Twisters

Models of connected speech production in Mandarin Chinese must specify how lexical tone, speech segments, and phrase-level prosody are integrated in speech production. This study used tongue twisters to test predictions of the two different models of word form encoding. Tongue twisters were constructed from 5 sets of characters that rotated pairs of initial segments or pairs of tones, or both, across format (ABAB, ABBA), and across position of the characters in four-character tongue twister strings. Fifty two native Mandarin Chinese speakers read aloud 120 tongue twisters, repeating each one six times in a row. They made a total of 3503 (2.34%) segment errors and 1372 (.92%) tone errors. Segment errors occurred on the onsets of the first and third characters in the ABBA but not ABAB segment-alternating tongue twisters, and on the onsets of the second and fourth characters of the tone-alternating tongue twisters. Tone errors were highest on the third and fourth characters in the tone-alternating tongue twisters. The pattern of tone errors is consistent with the claim that tone is associated to a metrical frame prior to segment encoding, while the format by position interaction found for the segment-alternating tongue twisters suggest articulatory gestures oscillate in segment production as proposed by gestural phonology.

Integrating SLAM with existing evidence: Comment on Walker and Hickok (2015)

Walker and Hickok (Psychonomic Bulletin & Review doi:10.3758/s13423-015-0903-7, 2015) used simulations to compare a novel proposal, the semantic-lexical-auditory-motor model (SLAM), to an existing account of speech production, the two-step interactive account (TSIA; Foygel & Dell, Journal of Memory and Language, 43:182-216, doi:10.1006/jmla.2000.2716, 2000). This commentary critically examines their assessment of SLAM. The cases in which SLAM outperforms TSIA largely reflect SLAM's ability to (poorly) approximate an existing theory of speech production incorporating two stages of phonological processing (the lexical + postlexical account). The fact that SLAM and TSIA can exhibit equivalent fits to the overall response distribution of a set of aphasic patients is unsurprising, since previous work has shown that overall response distributions do not reliably discriminate theoretical alternatives. Finally, SLAM inherits issues associated with TSIA's assumption of strong feedback between levels of representation. This suggests that SLAM does not represent an advance over existing theories of speech production.

On the resolution of phonological constraints in spoken production: Acoustic and response time evidence

This study examines the production of words the pronunciation of which depends on the phonological context. Participants produced adjective-noun phrases starting with the French determiner un. The pronunciation of this determiner requires a liaison consonant before vowels. Naming latencies and determiner acoustic durations were shorter when the adjective and the noun both started with vowels or both with consonants, than when they had different onsets. These results suggest that the liaison process is not governed by the application of a local contextual phonological rule; they rather favor the hypothesis that pronunciation variants with and without the liaison consonant are stored in memory.

Phonological Neighborhood Competition Affects Spoken Word Production Irrespective of Sentential Context

Two experiments examined the influence of phonologically similar neighbors on articulation of words' initial stop consonants in order to investigate the conditions under which lexically-conditioned phonetic variation arises. In Experiment 1, participants produced words in isolation. Results showed that the voice-onset time (VOT) of a target's initial voiceless stop was predicted by its overall neighborhood density, but not by its having a voicing minimal pair. In Experiment 2, participants read aloud the same targets after semantically predictive sentence contexts and after neutral sentence contexts. Results showed that, although VOTs were shorter in words produced after predictive contexts, the neighborhood density effect on VOT production persisted irrespective of context. These findings suggest that global competition from a word's neighborhood affects spoken word production independently of contextual modulation and support models in which activation cascades automatically and obligatorily among all of a selected target word's phonological neighbors during acoustic-phonetic encoding.

Cascading activation from lexical processing to letter-level processing in written word production

Descriptions of language production have identified processes involved in producing language and the presence and type of interaction among those processes. In the case of spoken language production, consensus has emerged that there is interaction among lexical selection processes and phoneme-level processing. This issue has received less attention in written language production. In this paper, we present a novel analysis of the writing-to-dictation performance of an individual with acquired dysgraphia revealing cascading activation from lexical processing to letter-level processing. The individual produced frequent lexical-semantic errors (e.g., chipmunk → SQUIRREL) as well as letter errors (e.g., inhibit → INBHITI) and had a profile consistent with impairment affecting both lexical processing and letter-level processing. The presence of cascading activation is suggested by lower letter accuracy on words that are more weakly activated during lexical selection than on those that are more strongly activated. We operationalize weakly activated lexemes as those lexemes that are produced as lexical-semantic errors (e.g., lethal in deadly → LETAHL) compared to strongly activated lexemes where the intended target word (e.g., lethal) is the lexeme selected for production.

The segment as the minimal planning unit in speech production: evidence based on absolute response latencies

A minimal amount of information about a word must be phonologically and phonetically encoded before a person can begin to utter that word. Most researchers assume that the minimum is the complete word or possibly the initial syllable. However, there is some evidence that the initial segment is sufficient based on longer durations when the initial segment is primed. In two experiments in which the initial segment of a monosyllabic word is primed or not primed, we present additional evidence based on very short absolute response times determined on the basis of acoustic and articulatory onset relative to presentation of the complete target. We argue that the previous failures to find very short absolute response times when the initial segment is primed are due in part to the exclusive use of acoustic onset as a measure of response latency, the exclusion of responses with very short acoustic latencies, the manner of articulation of the initial segment (i.e., plosive vs. nonplosive), and individual differences. Theoretical implications of the segment as the minimal planning unit are considered.

Effect of sound similarity and word position on lexical selection

Spoken word production research has shown that phonological information influences lexical selection. It remains unclear, however, whether this phonological information is specified for its phonological environment (e.g., word position) or its phonetic (allophonic) realization. To examine this, two definition naming experiments were performed during which subjects produced lexical targets (e.g., "balcony") in response to the targets' definitions ("deck higher than a building's first floor") after naming a series of phonologically related or unrelated primes. Subjects produced target responses significantly more often when the primes were phonologically related to the target, regardless of whether the phonologically related primes matched the target's word position or did not. For example, subjects were equally primed to produce the target "balcony" after the prime "ballast" or "unbalanced" relative to unrelated primes. Moreover, equal priming occurred irrespective of phonological environment or phonetic realization. The results support models of spoken word production which include context-independent phonological representations.

Speech planning happens before speech execution: online reaction time methods in the study of apraxia of speech

PURPOSE

The purpose of this article is to present an argument for the use of online reaction time (RT) methods to the study of apraxia of speech (AOS) and to review the existing small literature in this area and the contributions it has made to our fundamental understanding of speech planning (deficits) in AOS.

METHOD

Following a brief description of limitations of offline perceptual methods, we provide a narrative review of various types of RT paradigms from the (speech) motor programming and psycholinguistic literatures and their (thus far limited) application with AOS.

CONCLUSION

On the basis of the review of the literature, we conclude that with careful consideration of potential challenges and caveats, RT approaches hold great promise to advance our understanding of AOS, in particular with respect to the speech planning processes that generate the speech signal before initiation. A deeper understanding of the nature and time course of speech planning and its disruptions in AOS may enhance diagnosis and treatment for AOS.

RESULTS

Only a handful of published studies on apraxia of speech have used reaction time methods. However, these studies have provided deeper insight into speech planning impairments in AOS based on a variety of experimental paradigms.

Patterns of impairments in AOS and mechanisms of interaction between phonological and phonetic encoding

PURPOSE

One reason why the diagnosis of apraxia of speech (AOS) and its underlying impairment are often debated may lie in the fact that most patients do not display pure patterns of AOS. Mixed patterns are clearly acknowledged at other levels of impairment (e.g., lexical-semantic and lexical-phonological), and they have contributed to debate about the degree of interaction between encoding levels; by contrast, mixed impairments and mechanisms of interaction are less acknowledged at the levels of phonological and phonetic processes. Here, the author aims at bringing together empirical evidence in favor of an interaction between phonological and phonetic encoding and of the predominance of mixed patterns of impairment over pure phonetic impairment.

METHOD

The author reviews empirical results from acoustic and psycholinguistic studies, both with healthy speakers and speakers with brain damage, favoring independent phonological and phonetic encoding and separable impairments as well as recent research pointing to an interaction between phonological and phonetic encoding processes and overlapping patterns of impairments.

CONCLUSIONS

Acknowledging interaction between phonological and phonetic processing has clear consequences on the definition of patterns of impairment. In particular, phonetic errors have not necessarily a phonetic origin, and most patterns of impairment are bound to display both phonological and phonetic features.

On the use of different methodologies in cognitive neuropsychology: drink deep and from several sources

Cognitive neuropsychology has championed the use of single-case research design. Recently, however, case series designs that employ multiple single cases have been increasingly utilized to address theoretical issues using data from neuropsychological populations. In this paper, we examine these methodologies, focusing on a number of points in particular. First we discuss the use of dissociations and associations, often thought of as a defining feature of cognitive neuropsychology, and argue that they are better viewed as part of a spectrum of methods that aim to explain and predict behaviour. We also raise issues regarding case series design in particular, arguing that selection of an appropriate sample, including controlling degree of homogeneity, is critical and constrains the theoretical claims that can be made on the basis of the data. We discuss the possible interpretation of “outliers” in a case series, suggesting that while they may reflect “noise” caused by variability in performance due to factors that are not of relevance to the theoretical claims, they may also reflect the presence of patterns that are critical to test, refine, and potentially falsify our theories. The role of case series in treatment research is also raised, in light of the fact that, despite their status as gold standard, randomized controlled trials cannot provide answers to many crucial theoretical and clinical questions. Finally, we stress the importance of converging evidence: We propose that it is conclusions informed by multiple sources of evidence that are likely to best inform theory and stand the test of time.

Why are names of people associated with so many phonological retrieval failures?

Two experiments are reported that revisit the issue of why people's names are more difficult to recall than common names such as the names of objects. In Experiment 1, retrieval of the names of a set of object pictures was compared with recall of a set of names of famous faces. The object and face sets were matched for preexperimental familiarity. The results showed significantly more tip-of-the tongue (TOT) states and significantly poorer name recall for faces than for objects. Although the overall numbers of incorrect answers for the two sets of items did not differ, the incorrect answers in the face condition were mostly "don't know" responses, whereas incorrect answers for objects were mostly alternative names. In Experiment 2, written definitions were used instead of pictures, and target items were selected so as to keep the number of alternatives to a minimum. Under these circumstances, there were no differences in either the number of items correctly named or the number of TOTs for common and people's names. These findings are consistent with the views of Brédart (Memory, 1, 351-366, 1993), who argued that there are fewer documented TOTs for common names because a semantically related alternative often comes to mind when a participant is experiencing, or is about to experience, a retrieval failure.

Interaction and representational integration: evidence from speech errors

We examine the mechanisms that support interaction between lexical, phonological and phonetic processes during language production. Studies of the phonetics of speech errors have provided evidence that partially activated lexical and phonological representations influence phonetic processing. We examine how these interactive effects are modulated by lexical frequency. Previous research has demonstrated that during lexical access, the processing of high frequency words is facilitated; in contrast, during phonetic encoding, the properties of low frequency words are enhanced. These contrasting effects provide the opportunity to distinguish two theoretical perspectives on how interaction between processing levels can be increased. A theory in which cascading activation is used to increase interaction predicts that the facilitation of high frequency words will enhance their influence on the phonetic properties of speech errors. Alternatively, if interaction is increased by integrating levels of representation, the phonetics of speech errors will reflect the retrieval of enhanced phonetic properties for low frequency words. Utilizing a novel statistical analysis method, we show that in experimentally induced speech errors low lexical frequency targets and outcomes exhibit enhanced phonetic processing. We sketch an interactive model of lexical, phonological and phonetic processing that accounts for the conflicting effects of lexical frequency on lexical access and phonetic processing.

Phonological Facilitation from Pictures in a Word Association Task: Evidence for Routine Cascaded Processing in Spoken Word Production

While most authors now agree that the language production system is in principle cascaded, the strength with which cascaded lemma-to-phoneme activation typically occurs is debated. Picture naming has been shown to be facilitated by phonologically related distractor pictures, but no such facilitation from pictures has been shown for word reading. Picture–picture paradigms have recently been suggested to represent an attentionally facilitated and unusually strong case of cascaded phonological facilitation, not typical of a more general weakly cascaded production system. We used a novel procedure based on picture–word interference paradigms, where participants made speeded verbal free association responses to presented words, with irrelevant picture distractors that were phonologically related to their predicted high-associate responses. Phonological facilitation effects from related picture names were observed on free associate verbal production latencies. These findings represent a far more general demonstration of routine cascaded language production and suggest that the strength and extent of cascaded activation is more substantial than that suggested by traditional picture–word paradigms.

Phonological neighborhood effects in spoken word production: an fMRI study

The current study examined the neural systems underlying lexically conditioned phonetic variation in spoken word production. Participants were asked to read aloud singly presented words, which either had a voiced minimal pair (MP) neighbor (e.g., cape) or lacked a minimal pair (NMP) neighbor (e.g., cake). The voiced neighbor never appeared in the stimulus set. Behavioral results showed longer voice-onset time for MP target words, replicating earlier behavioral results [Baese-Berk, M., & Goldrick, M. Mechanisms of interaction in speech production. Language and Cognitive Processes, 24, 527-554, 2009]. fMRI results revealed reduced activation for MP words compared to NMP words in a network including left posterior superior temporal gyrus, the supramarginal gyrus, inferior frontal gyrus, and precentral gyrus. These findings support cascade models of spoken word production and show that neural activation at the lexical level modulates activation in those brain regions involved in lexical selection, phonological planning, and, ultimately, motor plans for production. The facilitatory effects for words with MP neighbors suggest that competition effects reflect the overlap inherent in the phonological representation of the target word and its MP neighbor.

Mrs. Malaprop's Neighborhood: Using Word Errors to Reveal Neighborhood Structure

Many theories of language production and perception assume that in the normal course of processing a word, additional non-target words (lexical neighbors) become active. The properties of these neighbors can provide insight into the structure of representations and processing mechanisms in the language processing system. To infer the properties of neighbors, we examined the non-semantic errors produced in both spoken and written word production by four individuals who suffered neurological injury. Using converging evidence from multiple language tasks, we first demonstrate that the errors originate in disruption to the processes involved in the retrieval of word form representations from long-term memory. The targets and errors produced were then examined for their similarity along a number of dimensions. A novel statistical simulation procedure was developed to determine the significance of the observed similarities between targets and errors relative to multiple chance baselines. The results reveal that in addition to position-specific form overlap (the only consistent claim of traditional definitions of neighborhood structure) the dimensions of lexical frequency, grammatical category, target length and initial segment independently contribute to the activation of non-target words in both spoken and written production. Additional analyses confirm the relevance of these dimensions for word production showing that, in both written and spoken modalities, the retrieval of a target word is facilitated by increasing neighborhood density, as defined by the results of the target-error analyses.

The relation between content and structure in language production: an analysis of speech errors in semantic dementia

In order to explore the impact of a degraded semantic system on the structure of language production, we analysed transcripts from autobiographical memory interviews to identify naturally-occurring speech errors by eight patients with semantic dementia (SD) and eight age-matched normal speakers. Relative to controls, patients were significantly more likely to (a) substitute and omit open class words, (b) substitute (but not omit) closed class words, (c) substitute incorrect complex morphological forms and (d) produce semantically and/or syntactically anomalous sentences. Phonological errors were scarce in both groups. The study confirms previous evidence of SD patients' problems with open class content words which are replaced by higher frequency, less specific terms. It presents the first evidence that SD patients have problems with closed class items and make syntactic as well as semantic speech errors, although these grammatical abnormalities are mostly subtle rather than gross. The results can be explained by the semantic deficit which disrupts the representation of a pre-verbal message, lexical retrieval and the early stages of grammatical encoding.

Mechanisms of interaction in speech production

Many theories predict the presence of interactive effects involving information represented by distinct cognitive processes in speech production. There is considerably less agreement regarding the precise cognitive mechanisms that underlie these interactive effects. For example, are they driven by purely production-internal mechanisms (e.g., Dell, 1986) or do they reflect the influence of perceptual monitoring mechanisms on production processes (e.g., Roelofs, 2004)? Acoustic analyses reveal the phonetic realization of words is influenced by their word-specific properties-supporting the presence of interaction between lexical-level and phonetic information in speech production. A second experiment examines what mechanisms are responsible for this interactive effect. The results suggest the effect occurs on-line and is not purely driven by listener modeling. These findings are consistent with the presence of an interactive mechanism that is online and internal to the production system.

Are phonological influences on lexical (mis)selection the result of a monitoring bias?

A monitoring bias account is often used to explain speech error patterns that seem to be the result of an interactive language production system, like phonological influences on lexical selection errors. A biased monitor is suggested to detect and covertly correct certain errors more often than others. For instance, this account predicts that errors that are phonologically similar to intended words are harder to detect than those that are phonologically dissimilar. To test this, we tried to elicit phonological errors under the same conditions as those that show other kinds of lexical selection errors. In five experiments, we presented participants with high cloze probability sentence fragments followed by a picture that was semantically related, a homophone of a semantically related word, or phonologically related to the (implicit) last word of the sentence. All experiments elicited semantic completions or homophones of semantic completions, but none elicited phonological completions. This finding is hard to reconcile with a monitoring bias account and is better explained with an interactive production system. Additionally, this finding constrains the amount of bottom-up information flow in interactive models.

Saying the right word at the right time: Syntagmatic and paradigmatic interference in sentence production

Retrieving a word in a sentence requires speakers to overcome syntagmatic, as well as paradigmatic interference. When accessing cat in "The cat chased the string," not only are similar competitors such as dog and cap activated, but also other words in the planned sentence, such as chase and string. We hypothesize that both types of interference impact the same stage of lexical access, and review connectionist models of production that use an error-driven learning algorithm to overcome that interference. This learning algorithm creates a mechanism that limits syntagmatic interference, the syntactic "traffic cop," a configuration of excitatory and inhibitory connections from syntactic-sequential states to lexical units. We relate the models to word and sentence production data, from both normal and aphasic speakers.

A word-order constraint on phonological activation

Word-order rules impose major constraints on linguistic behavior. For example, adjectives appear before nouns in English, and after nouns in French. This means that constraints on word order must be language-specific properties upheld on-line by the language system. Despite the importance of these rules, little is known about how they operate. We report an influence of word order on the activation of phonological representations. Participants were presented with colored objects and asked to name either the colors or the objects; the phonological similarity between the object and color names was manipulated. French speakers showed a phonological congruency effect in color naming, but not in object naming. English participants yielded the opposite pattern: a phonological effect in object naming, but not in color naming. Differences in the typical order of nouns and adjectives in French and English provide a plausible account for this cross-linguistic contrast. More generally, these results provide direct evidence for the operation of word-order constraints during language production.

Lexical and post-lexical phonological representations in spoken production

Theories of spoken word production generally assume a distinction between at least two types of phonological processes and representations: lexical phonological processes that recover relatively arbitrary aspects of word forms from long-term memory and post-lexical phonological processes that specify the predictable aspects of phonological representations. In this work we examine the spoken production of two brain-damaged individuals. We use their differential patterns of accuracy across the tasks of spoken naming and repetition to establish that they suffer from distinct deficits originating fairly selectively within lexical or post-lexical processes. Independent and detailed analyses of their spoken productions reveal contrasting patterns that provide clear support for a distinction between two types of phonological representations: those that lack syllabic and featural information and are sensitive to lexical factors such as lexical frequency and neighborhood density, and those that include syllabic and featural information and are sensitive to detailed properties of phonological structure such as phoneme frequency and syllabic constituency.

Architectures, representations and processes of language production

We present an overview of recent research conducted in the field of language production based on papers presented at the first edition of the International Workshop on Language Production (Marseille, France, September 2004). This article comprises two main parts. In the first part, consisting of three sections, we review the articles that are included in this Special Issue. These three sections deal with three different topics of general interest for models of language production: (A) the general organisational principles of the language production system, (B) several aspects of the lexical selection process and (C) the representations and processes used during syntactic encoding. In the second part, we discuss future directions for research in the field of language production, given the considerable developments that have occurred in recent years.