Twisting tongues to test for conflict-monitoring in speech production

The influence of task-irrelevant color perception on flanker task performance: Insights from behavioral and ERP data

Perception of color as a task-relevant stimulus can affect cognition and behavior in the flanker task; however, it remains unclear whether it has the same impact when it is a task-irrelevant stimulus dimension. To this end, we applied four-letter flanker tasks with or without colored (red/blue) to 23 healthy young adults, while recording the event-related potentials (ERPs) and behavioral performance. The flanker task included four kinds of color types: non-color letter (NC), all color letter (AC), flanker color letter (FC), and target color letter (TC), each flanker task included congruent and incongruent conditions. The behavioral data demonstrated the classic conflict effect across all color types of flanker tasks in both reaction times (RTs) and accuracy, the significant interaction and main effect of color type factors were only observed in accuracy. The ERP results showed significant interaction between conflict factor (congruent, incongruent) and color type (NC, AC, FC, and TC), and the color type factor enhanced the fronto-central P2 (180-200 ms), descended the fronto-centro-parietal N2b (260-320 ms), and increased the fronto-central P3b (360-520 ms). The fronto-central P2 and the fronto-central P3b were larger for TC than NC, AC, and FC in the congruent condition, while the fronto-central P3b was smaller for NC than AC, FC, and TC in the incongruent condition. Furthermore, the fronto-centro-parietal N2b was decreased successively in NC, AC, FC, and TC in both congruent and incongruent conditions. Overall, our findings suggested that the task-irrelevant stimuli dimension of color can capture some attentional resources and is affected by the location of color (target/flanker) and the type of task trial (congruent/incongruent) in the flanker task.

Characterizing multi-word speech production using event-related potentials

Event-related potentials (ERPs) derived from electroencephalography (EEG) have proven useful for understanding linguistic processes during language perception and production. Words are commonly produced in sequences, yet most ERP studies have used single-word experimental designs. Single-word designs reduce potential ERP overlap in word sequence production. However, word sequence production engages brain mechanisms in different ways than single word production. In particular, speech monitoring and planning mechanisms are more engaged than for single words since several words must be produced in a short period of time. This study evaluates the feasibility of recording ERP components in the context of word sequence production, and whether separate components could be isolated for each word. Scalp EEG data were acquired, while participants recited word sequences from memory at a regular pace, using a tongue-twister paradigm. The results revealed fronto-central error-related negativity, previously associated with speech monitoring, which could be distinguished for each word. Its peak amplitude was sensitive to Cycle and Phonological Similarity. However, an effect of sequential production was also observable on baseline measures, indicating baseline shifts throughout the word sequence due to concurrent sustained medial-frontal EEG activity. We also report a late left anterior negativity (LLAN), associated with verbal response planning and execution, onsetting around 100 ms before the first word in each cycle and sustained throughout the rest of the cycle. This work underlines the importance of considering the contribution of transient and sustained EEG activity on ERPs, and provides evidence that ERPs can be used to study sequential word production.

Parsing the Neural Mechanisms of Short-Term and Long-Term Associations in the Flanker Tasks: An ERP Analysis

The neural mechanisms of cognitive conflicts within various flanker tasks are still unclear, which may be mixed with different effects of short-term associations and long-term associations. We applied a perceptual (color) flanker task and a symbolic (arrow) flanker task to 25 healthy young adults, while the event-related potentials (ERP) and behavioral performance were recorded. The former contains stimulus-stimulus conflict (SSC) of short-term memory (STM) associations, and the latter contains stimulus-response conflict (SRC) of long-term memory (LTM) associations. Both flanker tasks included congruent and incongruent conditions. The reaction time demonstrated the stimulus-response conflict effect in the arrow flanker task without the stimulus-stimulus conflict effect in the color flanker task. The ERP results showed SSC enhanced the frontocentral N2b without behavioral effects. SRC increased the frontocentral P2 but decreased the centroparietal P3b with prolonged reaction time. In the comparison between both tasks, the color flanker task elicited both the centroparietal N2b/N300 and the frontocentral N400, and the arrow flanker task increased the occipital N1. Our findings provide new evidence that different neural mechanisms underlie conflict effects based on different types of memory associations.

Towards a New Model of Verbal Monitoring

As all human activities, verbal communication is fraught with errors. It is estimated that humans produce around 16,000 words per day, but the word that is selected for production is not always correct and neither is the articulation always flawless. However, to facilitate communication, it is important to limit the number of errors. This is accomplished via the verbal monitoring mechanism. A body of research over the last century has uncovered a number of properties of the mechanisms at work during verbal monitoring. Over a dozen routes for verbal monitoring have been postulated. However, to date a complete account of verbal monitoring does not exist. In the current paper we first outline the properties of verbal monitoring that have been empirically demonstrated. This is followed by a discussion of current verbal monitoring models: the perceptual loop theory, conflict monitoring, the hierarchical state feedback control model, and the forward model theory. Each of these models is evaluated given empirical findings and theoretical considerations. We then outline lacunae of current theories, which we address with a proposal for a new model of verbal monitoring for production and perception, based on conflict monitoring models. Additionally, this novel model suggests a mechanism of how a detected error leads to a correction. The error resolution mechanism proposed in our new model is then tested in a computational model. Finally, we outline the advances and predictions of the model.

Pre-output Language Monitoring in Sign Production

A domain-general monitoring mechanism is proposed to be involved in overt speech monitoring. This mechanism is reflected in a medial frontal component, the error negativity (Ne), present in both errors and correct trials (Ne-like wave) but larger in errors than correct trials. In overt speech production, this negativity starts to rise before speech onset and is therefore associated with inner speech monitoring. Here, we investigate whether the same monitoring mechanism is involved in sign language production. Twenty deaf signers (American Sign Language [ASL] dominant) and 16 hearing signers (English dominant) participated in a picture-word interference paradigm in ASL. As in previous studies, ASL naming latencies were measured using the keyboard release time. EEG results revealed a medial frontal negativity peaking within 15 msec after keyboard release in the deaf signers. This negativity was larger in errors than correct trials, as previously observed in spoken language production. No clear negativity was present in the hearing signers. In addition, the slope of the Ne was correlated with ASL proficiency (measured by the ASL Sentence Repetition Task) across signers. Our results indicate that a similar medial frontal mechanism is engaged in preoutput language monitoring in sign and spoken language production. These results suggest that the monitoring mechanism reflected by the Ne/Ne-like wave is independent of output modality (i.e., spoken or signed) and likely monitors prearticulatory representations of language. Differences between groups may be linked to several factors including differences in language proficiency or more variable lexical access to motor programming latencies for hearing than deaf signers.

Electrophysiological Correlates of Monitoring in Typing with and without Visual Feedback

New theories of monitoring in language production, regardless of their mechanistic differences, all posit monitoring mechanisms that share general computational principles with action monitoring. This perspective, if accurate, would predict that many electrophysiological signatures of performance monitoring should be recoverable from language production tasks. In this study, we examined both error-related and feedback-related EEG indices of performance monitoring in the context of a typing-to-dictation task. To disentangle the contribution of the external from internal monitoring processes, we created a condition where participants immediately saw the word they typed (the immediate-feedback condition) versus one in which displaying the word was delayed until the end of the trial (the delayed-feedback condition). The removal of immediate visual feedback prompted a stronger reliance on internal monitoring processes, which resulted in lower correction rates and a clear error-related negativity. Compatible with domain-general monitoring views, an error positivity was only recovered under conditions where errors were detected or had a high likelihood of being detected. Examination of the feedback-related indices (feedback-related negativity and frontocentral positivity) revealed a two-stage process of integration of internal and external information. The recovery of a full range of well-established EEG indices of action monitoring in a language production task strongly endorses domain-general views of monitoring. Such indices, in turn, are helpful in understanding how information from different monitoring channels are combined.

Monitoring of language selection errors in switching: Not all about conflict

Although bilingual speakers are very good at selectively using one language rather than another, sometimes language selection errors occur. To investigate how bilinguals monitor their speech errors and control their languages in use, we recorded event-related potentials (ERPs) in unbalanced Dutch-English bilingual speakers in a cued language-switching task. We tested the conflict-based monitoring model of Nozari and colleagues by investigating the error-related negativity (ERN) and comparing the effects of the two switching directions (i.e., to the first language, L1 vs. to the second language, L2). Results show that the speakers made more language selection errors when switching from their L2 to the L1 than vice versa. In the EEG, we observed a robust ERN effect following language selection errors compared to correct responses, reflecting monitoring of speech errors. Most interestingly, the ERN effect was enlarged when the speakers were switching to their L2 (less conflict) compared to switching to the L1 (more conflict). Our findings do not support the conflict-based monitoring model. We discuss an alternative account in terms of error prediction and reinforcement learning.

Monitoring and Control in Language Production

Language research has provided insight into how speakers translate a thought into a sequence of sounds that ultimately becomes words, phrases, and sentences. Despite the complex stages involved in this process, relatively little is known about how we avoid and handle production and comprehension errors that would otherwise impede communication. We review current research on the mechanisms underlying monitoring and control of the language system, especially production, with particular emphasis on whether such monitoring is issued by domain-general or domain-specific procedures.

The timing of spontaneous detection and repair of naming errors in aphasia

This study examined the timing of spontaneous self-monitoring in the naming responses of people with aphasia. Twelve people with aphasia completed a 615-item naming test twice, in separate sessions. Naming attempts were scored for accuracy and error type, and verbalizations indicating detection were coded as negation (e.g., "no, not that") or repair attempts (i.e., a changed naming attempt). Focusing on phonological and semantic errors, we measured the timing of the errors and of the utterances that provided evidence of detection. The effects of error type and detection response type on error-to-detection latencies were analyzed using mixed-effects regression modeling. We first asked whether phonological errors and semantic errors differed in the timing of the detection process or repair planning. Results suggested that the two error types primarily differed with respect to repair planning. Specifically, repair attempts for phonological errors were initiated more quickly than repair attempts for semantic errors. We next asked whether this difference between the error types could be attributed to the tendency for phonological errors to have a high degree of phonological similarity with the subsequent repair attempts, thereby speeding the programming of the repairs. Results showed that greater phonological similarity between the error and the repair was associated with faster repair times for both error types, providing evidence of error-to-repair priming in spontaneous self-monitoring. When controlling for phonological overlap, significant effects of error type and repair accuracy on repair times were also found. These effects indicated that correct repairs of phonological errors were initiated particularly quickly, whereas repairs of semantic errors were initiated relatively slowly, regardless of their accuracy. We discuss the implications of these findings for theoretical accounts of self-monitoring and the role of speech error repair in learning.

A common neural hub resolves syntactic and non-syntactic conflict through cooperation with task-specific networks

Regions within the left inferior frontal gyrus (LIFG) have simultaneously been implicated in syntactic processing and cognitive control. Accounts attempting to unify LIFG's function hypothesize that, during comprehension, cognitive control resolves conflict between incompatible representations of sentence meaning. Some studies demonstrate co-localized activity within LIFG for syntactic and non-syntactic conflict resolution, suggesting domain-generality, but others show non-overlapping activity, suggesting domain-specific cognitive control and/or regions that respond uniquely to syntax. We propose however that examining exclusive activation sites for certain contrasts creates a false dichotomy: both domain-general and domain-specific neural machinery must coordinate to facilitate conflict resolution across domains. Here, subjects completed four diverse tasks involving conflict -one syntactic, three non-syntactic- while undergoing fMRI. Though LIFG consistently activated within individuals during conflict processing, functional connectivity analyses revealed task-specific coordination with distinct brain networks. Thus, LIFG may function as a conflict-resolution "hub" that cooperates with specialized neural systems according to information content.

Neurodynamics of executive control processes in bilinguals: evidence from ERP and source reconstruction analyses

The present study was designed to examine the impact of bilingualism on the neuronal activity in different executive control processes namely conflict monitoring, control implementation (i.e., interference suppression and conflict resolution) and overcoming of inhibition. Twenty-two highly proficient but non-balanced successive French-German bilingual adults and 22 monolingual adults performed a combined Stroop/Negative priming task while event-related potential (ERP) were recorded online. The data revealed that the ERP effects were reduced in bilinguals in comparison to monolinguals but only in the Stroop task and limited to the N400 and the sustained fronto-central negative-going potential time windows. This result suggests that bilingualism may impact the process of control implementation rather than the process of conflict monitoring (N200). Critically, our study revealed a differential time course of the involvement of the anterior cingulate cortex (ACC) and the prefrontal cortex (PFC) in conflict processing. While the ACC showed major activation in the early time windows (N200 and N400) but not in the latest time window (late sustained negative-going potential), the PFC became unilaterally active in the left hemisphere in the N400 and the late sustained negative-going potential time windows. Taken together, the present electroencephalography data lend support to a cascading neurophysiological model of executive control processes, in which ACC and PFC may play a determining role.

Early and Late Electrophysiological Effects of Distractor Frequency in Picture Naming: Reconciling Input and Output Accounts

The "distractor-frequency effect" refers to the finding that high-frequency (HF) distractor words slow picture naming less than low-frequency distractors in the picture-word interference paradigm. Rival input and output accounts of this effect have been proposed. The former attributes the effect to attentional selection mechanisms operating during distractor recognition, whereas the latter attributes it to monitoring/decision mechanisms operating on distractor and target responses in an articulatory buffer. Using high-density (128-channel) EEG, we tested hypotheses from these rival accounts. In addition to conducting stimulus- and response-locked whole-brain corrected analyses, we investigated the correct-related negativity, an ERP observed on correct trials at fronto-central electrodes proposed to reflect the involvement of domain general monitoring. The whole-brain ERP analysis revealed a significant effect of distractor frequency at inferior right frontal and temporal sites between 100 and 300-msec post-stimulus onset, during which lexical access is thought to occur. Response-locked, region of interest (ROI) analyses of fronto-central electrodes revealed a correct-related negativity starting 121 msec before and peaking 125 msec after vocal onset on the grand averages. Slope analysis of this component revealed a significant difference between HF and low-frequency distractor words, with the former associated with a steeper slope on the time window spanning from 100 msec before to 100 msec after vocal onset. The finding of ERP effects in time windows and components corresponding to both lexical processing and monitoring suggests the distractor frequency effect is most likely associated with more than one physiological mechanism.