Word onset phonetic properties and motor artifacts in speech production EEG recordings

Asynchronous behavioral and neurophysiological changes in word production in the adult lifespan

Behavioral and brain-related changes in word production have been claimed to predominantly occur after 70 years of age. Most studies investigating age-related changes in adulthood only compared young to older adults, failing to determine whether neural processes underlying word production change at an earlier age than observed in behavior. This study aims to fill this gap by investigating whether changes in neurophysiological processes underlying word production are aligned with behavioral changes. Behavior and the electrophysiological event-related potential patterns of word production were assessed during a picture naming task in 95 participants across five adult lifespan age groups (ranging from 16 to 80 years old). While behavioral performance decreased starting from 70 years of age, significant neurophysiological changes were present at the age of 40 years old, in a time window (between 150 and 220 ms) likely associated with lexical-semantic processes underlying referential word production. These results show that neurophysiological modifications precede the behavioral changes in language production; they can be interpreted in line with the suggestion that the lexical-semantic reorganization in mid-adulthood influences the maintenance of language skills longer than for other cognitive functions.

Interpersonal eye-tracking reveals the dynamics of interacting minds

The human eye is a rich source of information about where, when, and how we attend. Our gaze paths indicate where and what captures our attention, while changes in pupil size can signal surprise, revealing our expectations. Similarly, the pattern of our blinks suggests levels of alertness and when our attention shifts between external engagement and internal thought. During interactions with others, these cues reveal how we coordinate and share our mental states. To leverage these insights effectively, we need accurate, timely methods to observe these cues as they naturally unfold. Advances in eye-tracking technology now enable real-time observation of these cues, shedding light on mutual cognitive processes that foster shared understanding, collaborative thought, and social connection. This brief review highlights these advances and the new opportunities they present for future research.

The temporal dynamics of the Stroop effect from childhood to young and older adulthood

The processes involved in the Stroop task/effect are thought to involve conflict detection and resolution stages. Little is known about the evolution of these two components over the lifespan. It is well admitted that children and older adults tend to show longer response latencies than young adults. The present study aims at clarifying the rational of such changes from childhood to adulthood and in aging by comparing the impacted cognitive processes across age groups. More precisely, the aim was to clarify if all processes take more time to be executed, hence implying that longer latencies rely mainly on processing speed or if an additional process lengthens the resolution of the conflict in children and/or older adults. To this aim we recorded brain electrical activity using EEG in school-age children, young and older adults while they performed a classic verbal Stroop task. The signal was decomposed in microstate brain networks, and age groups and conditions were compared. Behavioral results evolved following an inverted U-shaped curve. In children, different brain states from the ones observed in adults were highlighted, both in the conflict detection and resolution time-windows. Longer latencies in the incongruent condition were mainly attributed to an overly increased duration of the microstates involved in the conflict resolution time window. In aging, the same microstate maps were reported for both young and older adult groups. The differences in performances between groups could be explained by a disproportionally long conflict detection phase, even compressing the latest stage of response articulation. These results tend to favor a specific immaturity of the brain networks involved coupled with a slowing of the processes in children, while cognitive decline could be mostly explained by a general slowing.

Word Production Changes through Adolescence: A Behavioral and ERP Investigation of Referential and Inferential Naming

Changes in word production occur across the lifespan, with adolescence representing a knot point between children's and adults' performance and underlying brain processes. Previous studies on referential word production using picture naming tasks have shown a completely adult-like pattern in 17-year-old adolescents and an intermediate pattern between children and adults in adolescents aged 14-16 years old, suggesting a possible involvement of visuo-conceptual processes in the transition from childhood to adulthood. Given the visual nature of the picture naming task, it is unclear whether changes in visuo-conceptual processes are specifically related to the referential word production or if overall changes in conceptual to lexical processes drive maturation. To answer this question, we turned to an inferential word production task, i.e., naming from auditory definitions, involving different conceptual to lexical processes relative to referential naming. Behavior and electroencephalographic Event-Related Potentials (ERP) in a (visual) referential word production task and an (auditory) inferential word production task were recorded and compared in three groups of adolescents (respectively, aged 10 to 13, 14 to 16, and 17 to 18). Only the youngest group displayed longer production latencies and lower accuracy than the two older groups of adolescents who performed similarly on both tasks. Crucially, ERP waveform analysis and topographic pattern analysis revealed significant intergroup differences on both tasks. Changes across ages are not merely linked to the visual-conceptual processes of a picture naming task but are rather related to lexical-semantic processes involved in word production.

Opportunities, pitfalls and trade-offs in designing protocols for measuring the neural correlates of speech

Decoding speech and speech-related processes directly from the human brain has intensified in studies over recent years as such a decoder has the potential to positively impact people with limited communication capacity due to disease or injury. Additionally, it can present entirely new forms of human-computer interaction and human-machine communication in general and facilitate better neuroscientific understanding of speech processes. Here, we synthesize the literature on neural speech decoding pertaining to how speech decoding experiments have been conducted, coalescing around a necessity for thoughtful experimental design aimed at specific research goals, and robust procedures for evaluating speech decoding paradigms. We examine the use of different modalities for presenting stimuli to participants, methods for construction of paradigms including timings and speech rhythms, and possible linguistic considerations. In addition, novel methods for eliciting naturalistic speech and validating imagined speech task performance in experimental settings are presented based on recent research. We also describe the multitude of terms used to instruct participants on how to produce imagined speech during experiments and propose methods for investigating the effect of these terms on imagined speech decoding. We demonstrate that the range of experimental procedures used in neural speech decoding studies can have unintended consequences which can impact upon the efficacy of the knowledge obtained. The review delineates the strengths and weaknesses of present approaches and poses methodological advances which we anticipate will enhance experimental design, and progress toward the optimal design of movement independent direct speech brain-computer interfaces.

Spontaneous quantitative processing in Chinese singular and plural picture naming: An event-related potentials analysis

Chinese nouns lack inflection and cannot reflect the quantitative relationship between singular and plural numbers. However, neural processes of picture naming are different from those of words. We assume that Chinese single and plural picture naming is different, and they may involve quantitative processing. Therefore, Experiment 1 was designed by picking picture naming as the task and Chinese as the target language and compared the accuracy, reaction time, and event-related potentials (ERPs) between single and plural picture naming, where two types of pictures were mixed. Although the T-test showed no significant differences in behavioral data, there were differences in ERPs. ERP differences involved two effects: P1 of 160-180 ms and P2 of 220-260 ms in the parietal-occipital lobe. These differences are suggested to reflect the neural differences in quantitative processing. Therefore, Chinese singular and plural picture naming consists of word production and implicit quantitative processing simultaneously. To explore the relationship between the two processings, we added a semantic factor (inanimate vs. animate items) to the quantity factor of Experiment 1 and carried out Experiment 2, with the observation indexes unchanged. There were no significant differences in behavioral data among the four conditions. After variance analysis, ERPs results indicated an interaction between semantic and quantitative factors in the central area at 180-280 ms. In summary, we suggest that Chinese singular and plural picture naming includes two simultaneous neural processing tasks: word production and quantitative processing, which interact in the central area at 180-280 ms.

Does learning to read affect naming skills? Insights from ERPs during letter and picture naming tasks

Numerous studies report that poor readers display low performance in naming tasks. However, very few studies have investigated the development of naming skills along with the development of reading fluency and its variability in typically developing children. In this study, we used electro-encephalographic (EEG) recordings acquired during letter and picture naming tasks to investigate how naming skills develop and, possibly, interact with age and reading level variations. Ninety-three children aged 7-12 years named letters and pictures under an EEG recording, and their reading performance was assessed. ERP results on amplitudes show that age and reading level have similar effects on the entire letter naming time-course. By contrast, age and reading level have different effects on the picture naming time-course, with a specific effect of reading level on the N1 time-interval, associated with visuo-conceptual processing and an effect of both age and reading on later time-windows. On the microstate analysis, age remains the only predictor of the variance in global electric field at scalp for both letter and picture naming indicating that reading skill is not related to a modulation of the mental processes underlying naming.

Behavioral and Brain Responses Highlight the Role of Usage in the Preparation of Multiword Utterances for Production

Usage-based theories assume that all aspects of language processing are shaped by the distributional properties of the language. The frequency not only of words but also of larger chunks plays a major role in language processing. These theories predict that the frequency of phrases influences the time needed to prepare these phrases for production and their acoustic duration. By contrast, dominant psycholinguistic models of utterance production predict no such effects. In these models, the system keeps track of the frequency of individual words but not of co-occurrences. This study investigates the extent to which the frequency of phrases impacts naming latencies and acoustic duration with a balanced design, where the same words are recombined to build high- and low-frequency phrases. The brain signal of participants is recorded so as to obtain information on the electrophysiological bases and functional locus of frequency effects. Forty-seven participants named pictures using high- and low-frequency adjective-noun phrases. Naming latencies were shorter for high-frequency than low-frequency phrases. There was no evidence that phrase frequency impacted acoustic duration. The electrophysiological signal differed between high- and low-frequency phrases in time windows that do not overlap with conceptualization or articulation processes. These findings suggest that phrase frequency influences the preparation of phrases for production, irrespective of the lexical properties of the constituents, and that this effect originates at least partly when speakers access and encode linguistic representations. Moreover, this study provides information on how the brain signal recorded during the preparation of utterances changes with the frequency of word combinations.

Dynamics of Word Production in the Transition from Adolescence to Adulthood

Changes in word production occur across the lifespan. Previous studies have shown electrophysiological, temporal, and functional differences between children and adults accompanying behavioral changes in picture-naming tasks (Laganaro, Tzieropoulos, Fraunfelder, & Zesiger, 2015). Thus, a shift toward adult-like processes in referential word production occurs somewhere between the ages of 13 and 20. Our aim was to investigate when and how children develop adult-like behavior and brain activation in word production. Toward this aim, performance and event-related potentials (ERP) in a referential word production task were recorded and compared for two groups of adolescents (aged 14 to 16 and 17 to 18), children (aged 10 to 13), and young adults (aged 20 to 30). Both groups of adolescents displayed adult-like production latencies, which were longer only for children, while accuracy was lower in the younger adolescents and in children, compared to adults. ERP waveform analysis and topographic pattern analysis revealed significant intergroup differences in key time-windows on stimulus-locked ERPs, both early (150-220 ms)-associated with pre-linguistic processes-and late (280-330 ms)-associated with lexical processes. The results indicate that brain activation underlying referential word production is completely adult-like in 17-year-old adolescents, whereas an intermediate pattern is still observed in adolescents aged 14 to 16 years old, although their production speed, but not their accuracy, is already adult-like.

Brain signatures predict communicative function of speech production in interaction

People normally know what they want to communicate before they start speaking. However, brain indicators of communication are typically observed only after speech act onset, and it is unclear when any anticipatory brain activity prior to speaking might first emerge, along with the communicative intentions it possibly reflects. Here, we investigated brain activity prior to the production of different speech act types, request and naming actions performed by uttering single words embedded into language games with a partner, similar to natural communication. Starting ca. 600 msec before speech onset, an event-related potential maximal at fronto-central electrodes, which resembled the Readiness Potential, was larger when preparing requests compared to naming actions. Analysis of the cortical sources of this anticipatory brain potential suggests a relatively stronger involvement of fronto-central motor regions for requests, which may reflect the speaker's expectation of the partner actions typically following requests, e.g., the handing over of a requested object. Our results indicate that different neuronal circuits underlying the processing of different speech act types activate already before speaking. Results are discussed in light of previous work addressing the neural basis of speech act understanding and predictive brain indexes of language comprehension.

Microstate ERP Analyses to Pinpoint the Articulatory Onset in Speech Production

The use of electroencephalography (EEG) to study overt speech production has increased substantially in the past 15 years and the alignment of evoked potential (ERPs) on the response onset has become an extremely useful method to target “latest” stages of speech production. Yet, response-locked ERPs raise a methodological issue: on which event should the point of alignment be placed? Response-locked ERPs are usually aligned to the vocal (acoustic) onset, although it is well known that articulatory movements may start up to a hundred milliseconds prior to the acoustic onset and that this “articulatory onset to acoustic onset interval” (AAI) depends on the phoneme properties. Given the previously reported difficulties to measure the AAI, the purpose of this study was to determine if the AAI could be reliably detected with EEG-microstates. High-density EEG was recorded during delayed speech production of monosyllabic pseudowords with four different onset consonants. Whereas the acoustic response onsets varied depending on the onset consonant, the response-locked spatiotemporal EEG analysis revealed a clear asynchrony of the same sequence of microstates across onset consonants. A specific microstate, the latest observed in the ERPs locked to the vocal onset, presented longer duration for phonemes with longer acoustic response onsets. Converging evidences seemed to confirm that this microstate may be related to the articulatory onset of motor execution: its scalp topography corresponded to those previously associated with muscle activity and source localization highlighted the involvement of motor areas. Finally, the analyses on the duration of such microstate in single trials further fit with the AAI intervals for specific phonemes reported in previous studies. These results thus suggest that a particular ERP-microstate is a reliable index of articulation onset and of the AAI.

When a second language hits a native language. What ERPs (do and do not) tell us about language retrieval difficulty in bilingual language production

The accumulating evidence suggests that prior usage of a second language (L2) leads to processing costs on the subsequent production of a native language (L1). However, it is unclear what mechanism underlies this effect. It has been proposed that the L1 cost reflects inhibition of L1 representation acting during L1 production; however, previous studies exploring this issue were inconclusive. It is also unsettled whether the mechanism operates on the whole-language level or is restricted to translation equivalents in the two languages. We report a study that allowed us to address both issues behaviorally with the use of ERPs while focusing on the consequences of using L2 on the production of L1. In our experiment, native speakers of Polish (L1) and learners of English (L2) named a set of pictures in L1 following a set of pictures in either L1 or L2. Half of the pictures were repeated from the preceding block and half were new; this enabled dissociation of the effects on the level of the whole language from those specific to individual lexical items. Our results are consistent with the notion that language after-effects operate at a whole-language level. Behaviorally, we observed a clear processing cost on the whole-language level and a small facilitation on the item-specific level. The whole-language effect was accompanied by an enhanced, fronto-centrally distributed negativity in the 250-350 ms time-window which we identified as the N300 (in contrast to previous research, which probably misidentified the effect as the N2), a component that presumably reflects retrieval difficulty of relevant language representations during picture naming. As such, unlike previous studies that reported N2 for naming pictures in L1 after L2 use, we propose that the reported ERPs (N300) indicate that prior usage of L2 hampers lexical access to names in L1. Based on the literature, the after-effects could be caused by L1 inhibition and/or L2 interference, but the ERPs so far have not been informative about the causal mechanism.

The Effect of Lexical Cohort Size Is Independent of Semantic Context Effects in a Picture-Word Interference Task: A Combined ERP and sLORETA Study

Lexical cohort size is known to play an important role in the magnitude of semantic interference during picture naming in continuous and blocking naming tasks. Nevertheless, whether and how lexical cohort size influences semantic context effects in a picture-word interference (PWI) task remains unclear. To address this issue, participants were required to name pictures, which were paired with both semantically related and unrelated distractors, from both large and small lexical cohorts while electroencephalogram (EEG) signals were recorded. Behavior results showed a semantic interference effect but no interaction between semantic relatedness and lexical cohort size in naming latencies. ERPs and correlation analyses revealed that semantic interference effects occurred at the lexical level in the time windows of 200-400 and 400-600 ms, and lexical cohort size effects occurred at the conceptual level in the time window of 100-200 ms and at the lexical level in the time windows of 200-400 ms. Critically, no interaction between two variables was found, reflecting that lexical cohort size is independent of semantic interference for categorical relations in the PWI. sLORETA results found stronger brain activations for large lexical cohorts at the left superior temporal gyrus and inferior frontal gyrus in the time interval of 250-300 ms, which may relate to lexical selection and self-monitoring. Our findings provide evidence for the swinging lexical network rather than the response exclusion hypothesis in spoken production.

Neurolinguistics Research Advancing Development of a Direct-Speech Brain-Computer Interface

A direct-speech brain-computer interface (DS-BCI) acquires neural signals corresponding to imagined speech, then processes and decodes these signals to produce a linguistic output in the form of phonemes, words, or sentences. Recent research has shown the potential of neurolinguistics to enhance decoding approaches to imagined speech with the inclusion of semantics and phonology in experimental procedures. As neurolinguistics research findings are beginning to be incorporated within the scope of DS-BCI research, it is our view that a thorough understanding of imagined speech, and its relationship with overt speech, must be considered an integral feature of research in this field. With a focus on imagined speech, we provide a review of the most important neurolinguistics research informing the field of DS-BCI and suggest how this research may be utilized to improve current experimental protocols and decoding techniques. Our review of the literature supports a cross-disciplinary approach to DS-BCI research, in which neurolinguistics concepts and methods are utilized to aid development of a naturalistic mode of communication.

Variation in the speech signal as a window into the cognitive architecture of language production

The pronunciation of words is highly variable. This variation provides crucial information about the cognitive architecture of the language production system. This review summarizes key empirical findings about variation phenomena, integrating corpus, acoustic, articulatory, and chronometric data from phonetic and psycholinguistic studies. It examines how these data constrain our current understanding of word production processes and highlights major challenges and open issues that should be addressed in future research.

Priming production: Neural evidence for enhanced automatic semantic activity preceding language production in schizophrenia

Introduction

Lexico-semantic disturbances are considered central to schizophrenia. Clinically, their clearest manifestation is in language production. However, most studies probing their underlying mechanisms have used comprehension or categorization tasks. Here, we probed automatic semantic activity prior to language production in schizophrenia using event-related potentials (ERPs).

Methods

19 people with schizophrenia and 16 demographically-matched healthy controls named target pictures that were very quickly preceded by masked prime words. To probe automatic semantic activity prior to production, we measured the N400 ERP component evoked by these targets. To determine the origin of any automatic semantic abnormalities, we manipulated the type of relationship between prime and target such that they overlapped in (a) their semantic features (semantically related, e.g. "cake" preceding a < picture of a pie >, (b) their initial phonemes (phonemically related, e.g. "stomach" preceding a < picture of a starfish >), or (c) both their semantic features and their orthographic/phonological word form (identity related, e.g. "socks" preceding a < picture of socks >). For each of these three types of relationship, the same targets were paired with unrelated prime words (counterbalanced across lists). We contrasted ERPs and naming times to each type of related target with its corresponding unrelated target.

Results

People with schizophrenia showed abnormal N400 modulation prior to naming identity related (versus unrelated) targets: whereas healthy control participants produced a smaller amplitude N400 to identity related than unrelated targets, patients showed the opposite pattern, producing a larger N400 to identity related than unrelated targets. This abnormality was specific to the identity related targets. Just like healthy control participants, people with schizophrenia produced a smaller N400 to semantically related than to unrelated targets, and showed no difference in the N400 evoked by phonemically related and unrelated targets. There were no differences between the two groups in the pattern of naming times across conditions.

Conclusion

People with schizophrenia can show abnormal neural activity associated with automatic semantic processing prior to language production. The specificity of this abnormality to the identity related targets suggests that that, rather than arising from abnormalities of either semantic features or lexical form alone, it may stem from disruptions of mappings (connections) between the meaning of words and their form.