Across-session consistency of context-driven language processing: A magnetoencephalography study

The Concise Language Paradigm (CLaP), a framework for studying the intersection of comprehension and production: electrophysiological properties

Studies investigating language commonly isolate one modality or process, focusing on comprehension or production. Here, we present a framework for a paradigm that combines both: the Concise Language Paradigm (CLaP), tapping into comprehension and production within one trial. The trial structure is identical across conditions, presenting a sentence followed by a picture to be named. We tested 21 healthy speakers with EEG to examine three time periods during a trial (sentence, pre-picture interval, picture onset), yielding contrasts of sentence comprehension, contextually and visually guided word retrieval, object recognition, and naming. In the CLaP, sentences are presented auditorily (constrained, unconstrained, reversed), and pictures appear as normal (constrained, unconstrained, bare) or scrambled objects. Imaging results revealed different evoked responses after sentence onset for normal and time-reversed speech. Further, we replicated the context effect of alpha-beta power decreases before picture onset for constrained relative to unconstrained sentences, and could clarify that this effect arises from power decreases following constrained sentences. Brain responses locked to picture-onset differed as a function of sentence context and picture type (normal vs. scrambled), and naming times were fastest for pictures in constrained sentences, followed by scrambled picture naming, and equally fast for bare and unconstrained picture naming. Finally, we also discuss the potential of the CLaP to be adapted to different focuses, using different versions of the linguistic content and tasks, in combination with electrophysiology or other imaging methods. These first results of the CLaP indicate that this paradigm offers a promising framework to investigate the language system.

Combining EEG and 3D-eye-tracking to study the prediction of upcoming speech in naturalistic virtual environments: A proof of principle

EEG and eye-tracking provide complementary information when investigating language comprehension. Evidence that speech processing may be facilitated by speech prediction comes from the observation that a listener's eye gaze moves towards a referent before it is mentioned if the remainder of the spoken sentence is predictable. However, changes to the trajectory of anticipatory fixations could result from a change in prediction or an attention shift. Conversely, N400 amplitudes and concurrent spectral power provide information about the ease of word processing the moment the word is perceived. In a proof-of-principle investigation, we combined EEG and eye-tracking to study linguistic prediction in naturalistic, virtual environments. We observed increased processing, reflected in theta band power, either during verb processing - when the verb was predictive of the noun - or during noun processing - when the verb was not predictive of the noun. Alpha power was higher in response to the predictive verb and unpredictable nouns. We replicated typical effects of noun congruence but not predictability on the N400 in response to the noun. Thus, the rich visual context that accompanied speech in virtual reality influenced language processing compared to previous reports, where the visual context may have facilitated processing of unpredictable nouns. Finally, anticipatory fixations were predictive of spectral power during noun processing and the length of time fixating the target could be predicted by spectral power at verb onset, conditional on the object having been fixated. Overall, we show that combining EEG and eye-tracking provides a promising new method to answer novel research questions about the prediction of upcoming linguistic input, for example, regarding the role of extralinguistic cues in prediction during language comprehension.

A reconceptualization of sentence production in post-stroke agrammatic aphasia: the synergistic processing bottleneck model

The language production deficit in post-stroke agrammatic aphasia (PSA-G) tends to result from lesions to the left inferior frontal gyrus (LIFG) and is characterized by a triad of symptoms: fragmented sentences, errors in functional morphology, and a dearth of verbs. Despite decades of research, the mechanisms underlying production patterns in PSA-G have been difficult to characterize. Two major impediments to progress may have been the view that it is a purely morphosyntactic disorder and the (sometimes overzealous) application of linguistic theory without interceding psycholinguistic evidence. In this paper, empirical evidence is examined to present an integrated portrait of language production in PSA-G and to evaluate the assumption of a syntax-specific syndrome. In light of extant evidence, it is proposed that agrammatic language production results from a combination of morphosyntactic, phonomotor, and processing capacity limitations that cause a cumulative processing bottleneck at the point of articulatory planning. This proposed Synergistic Processing Bottleneck model of PSA-G presents a testable framework for future research. The paper ends with recommendations for future research on PSA-G.

Parallel or sequential? Decoding conceptual and phonological/phonetic information from MEG signals during language production

Speaking requires the temporally coordinated planning of core linguistic information, from conceptual meaning to articulation. Recent neurophysiological results suggested that these operations involve a cascade of neural events with subsequent onset times, whilst competing evidence suggests early parallel neural activation. To test these hypotheses, we examined the sources of neuromagnetic activity recorded from 34 participants overtly naming 134 images from 4 object categories (animals, tools, foods and clothes). Within each category, word length and phonological neighbourhood density were co-varied to target phonological/phonetic processes. Multivariate pattern analyses (MVPA) searchlights in source space decoded object categories in occipitotemporal and middle temporal cortex, and phonological/phonetic variables in left inferior frontal (BA 44) and motor cortex early on. The findings suggest early activation of multiple variables due to intercorrelated properties and interactivity of processing, thus raising important questions about the representational properties of target words during the preparatory time enabling overt speaking.

Activating words without language: beta and theta oscillations reflect lexical access and control processes during verbal and non-verbal object recognition tasks

The intention to name an object modulates neural responses during object recognition tasks. However, the nature of this modulation is still unclear. We established whether a core operation in language, i.e. lexical access, can be observed even when the task does not require language (size-judgment task), and whether response selection in verbal versus non-verbal semantic tasks relies on similar neuronal processes. We measured and compared neuronal oscillatory activities and behavioral responses to the same set of pictures of meaningful objects, while the type of task participants had to perform (picture-naming versus size-judgment) and the type of stimuli to measure lexical access (cognate versus non-cognate) were manipulated. Despite activation of words was facilitated when the task required explicit word-retrieval (picture-naming task), lexical access occurred even without the intention to name the object (non-verbal size-judgment task). Activation of words and response selection were accompanied by beta (25-35 Hz) desynchronization and theta (3-7 Hz) synchronization, respectively. These effects were observed in both picture-naming and size-judgment tasks, suggesting that words became activated via similar mechanisms, irrespective of whether the task involves language explicitly. This finding has important implications to understand the link between core linguistic operations and performance in verbal and non-verbal semantic tasks.

Between alpha and gamma oscillations: Neural signatures of linguistic predictions and listener's attention to speaker's communication intention

When listeners hear a message produced by their interlocutor, they can predict upcoming words thanks to the sentential context and their attention can be focused on the speaker's communication intention. In two electroencephalographical (EEG) studies, we investigated the oscillatory correlates of prediction in spoken-language comprehension and how they are modulated by the listener's attention. Sentential contexts which were strongly predictive of a particular word were ended by a possessive adjective either matching the gender of the predicted word or not. Alpha, beta and gamma oscillations were studied as they were considered to play a crucial role in the predictive process. While evidence of word prediction was related to alpha fluctuations when listeners focused their attention on sentence meaning, changes in high-gamma oscillations were triggered by word prediction when listeners focused their attention on the speaker's communication intention. Independently of the endogenous attention to a level of linguistic information, the oscillatory correlates of word predictions in language comprehension were sensitive to the prosodic emphasis produced by the speaker at a late stage. These findings thus bear major implications for understanding the neural mechanisms that support predictive processing in spoken-language comprehension.

Functional identification of language-responsive channels in individual participants in MEG investigations

Making meaningful inferences about the functional architecture of the language system requires the ability to refer to the same neural units across individuals and studies. Traditional brain imaging approaches align and average brains together in a common space. However, lateral frontal and temporal cortex, where the language system resides, is characterized by high structural and functional inter-individual variability. This variability reduces the sensitivity and functional resolution of group-averaging analyses. This problem is compounded by the fact that language areas often lay in close proximity to regions of other large-scale networks with different functional profiles. A solution inspired by other fields of cognitive neuroscience (e.g., vision) is to identify language areas functionally in each individual brain using a 'localizer' task (e.g., a language comprehension task). This approach has proven productive in fMRI, yielding a number of discoveries about the language system, and has been successfully extended to intracranial recording investigations. Here, we apply this approach to MEG. Across two experiments (one in Dutch speakers, n=19; one in English speakers, n=23), we examined neural responses to the processing of sentences and a control condition (nonword sequences). We demonstrated that the neural response to language is spatially consistent at the individual level. The language-responsive sensors of interest were, as expected, less responsive to the nonwords condition. Clear inter-individual differences were present in the topography of the neural response to language, leading to greater sensitivity when the data were analyzed at the individual level compared to the group level. Thus, as in fMRI, functional localization yields benefits in MEG and thus opens the door to probing fine-grained distinctions in space and time in future MEG investigations of language processing.

Test-retest reliability of electroencephalographic and magnetoencephalographic measures elicited during language tasks: A literature review

Electroencephalographic (EEG) and magnetoencephalographic (MEG) recordings during language processing can provide relevant insights on neuroplasticity in clinical populations (including patients with aphasia). To use EEG and MEG in a longitudinal way, the outcome measures should be consistent across time in healthy individuals. Therefore, the current study provides a review on the test-retest reliability of EEG and MEG measures elicited during language paradigms in healthy adults. PubMed, Web of Science and Embase were searched for relevant articles based on specific eligibility criteria. In total, 11 articles were included in this literature review. The test-retest reliability of the P1, N1 and P2 is systematically considered to be satisfactory, whereas findings are more variable for event-related potentials/fields occurring later in time. The within subject consistency of EEG and MEG measures during language processing can be influenced by multiple variables such as the stimulus presentation mode, the offline reference choice and the required amount of cognitive resources during the task. To conclude, most of the available results are favourable regarding the longitudinal use of EEG and MEG measures elicited during language paradigms in healthy young individuals. In view to the use of these techniques in patients with aphasia, future research should focus on whether the same findings apply to different age groups.

Functional neuroanatomy of lexical access in contextually and visually guided spoken word production

Lexical access is commonly studied using bare picture naming, which is visually guided, but in real-life conversation, lexical access is more commonly contextually guided. In this fMRI study, we examined the underlying functional neuroanatomy of contextually and visually guided lexical access, and its consistency across sessions. We employed a context-driven picture naming task with fifteen healthy speakers reading incomplete sentences (word-by-word) and subsequently naming the picture depicting the final word. Sentences provided either a constrained or unconstrained lead-in setting for the picture to be named, thereby approximating lexical access in natural language use. The picture name could be planned either through sentence context (constrained) or picture appearance (unconstrained). This procedure was repeated in an equivalent second session two to four weeks later with the same sample to test for test-retest consistency. Picture naming times showed a strong context effect, confirming that constrained sentences speed up production of the final word depicted as an image. fMRI results showed that the areas common to contextually and visually guided lexical access were left fusiform and left inferior frontal gyrus (both consistently active across-sessions), and middle temporal gyrus. However, non-overlapping patterns were also found, notably in the left temporal and parietal cortices, suggesting a different neural circuit for contextually versus visually guided lexical access.

Inefficient speech-motor control affects predictive speech comprehension: atypical electrophysiological correlates in stuttering

Listeners predict upcoming information during language comprehension. However, how this ability is implemented is still largely unknown. Here, we tested the hypothesis proposing that language production mechanisms have a role in prediction. We studied 2 electroencephalographic correlates of predictability during speech comprehension-pre-target alpha-beta (8-30 Hz) power decrease and the post-target N400 event-related potential effect-in a population with impaired speech-motor control, i.e. adults who stutter (AWS), compared to typically fluent adults (TFA). Participants listened to sentences that could either constrain towards a target word or not, modulating its predictability. As a complementary task, participants also performed context-driven word production. Compared to TFA, AWS not only displayed atypical neural responses in production, but, critically, they showed a different pattern also in comprehension. Specifically, while TFA showed the expected pre-target power decrease, AWS showed a power increase in frontal regions, associated with speech-motor control. In addition, the post-target N400 effect was reduced for AWS with respect to TFA. Finally, we found that production and comprehension power changes were positively correlated in TFA, but not in AWS. Overall, the results support the idea that processes and neural structures prominently devoted to speech planning also support prediction during speech comprehension.

Time course of right-hemisphere recruitment during word production following left-hemisphere damage: A single case of young stroke

Our understanding of post-stroke language function is largely based on older age groups, who show increasing age-related brain pathology and neural reorganisation. To illustrate language outcomes in the young-adult brain, we present the case of J., a 23-year-old woman with chronic aphasia from a left-hemisphere stroke affecting the temporal lobe. Diffusion MRI-based tractography indicated that J.'s language-relevant white-matter structures were severely damaged. Employing magnetoencephalography (MEG), we explored J.'s conceptual preparation and word planning abilities using context-driven and bare picture-naming tasks. These revealed naming deficits, manifesting as word-finding difficulties and semantic paraphasias about half of the time. Naming was however facilitated by semantically constraining lead-in sentences. Altogether, this pattern indicates disrupted lexical-semantic and phonological retrieval abilities. MEG revealed that J.'s conceptual and naming-related neural responses were supported by the right hemisphere, compared to the typical left-lateralised brain response of a matched control. Differential recruitment of right-hemisphere structures (330-440 ms post-picture onset) was found concurrently during successful naming (right mid-to-posterior temporal lobe) and word-finding attempts (right inferior frontal gyrus). Disconnection of the temporal lobes via corpus callosum was not critical for recruitment of the right hemisphere in visually guided naming, possibly due to neural activity right lateralising from the outset. Although J.'s right hemisphere responded in a timely manner during word planning, its lexical and phonological retrieval abilities remained modest.

The Time Course of Language Production as Revealed by Pattern Classification of MEG Sensor Data

Language production involves a complex set of computations, from conceptualization to articulation, which are thought to engage cascading neural events in the language network. However, recent neuromagnetic evidence suggests simultaneous meaning-to-speech mapping in picture naming tasks, as indexed by early parallel activation of frontotemporal regions to lexical semantic, phonological, and articulatory information. Here we investigate the time course of word production, asking to what extent such "earliness" is a distinctive property of the associated spatiotemporal dynamics. Using MEG, we recorded the neural signals of 34 human subjects (26 males) overtly naming 134 images from four semantic object categories (animals, foods, tools, clothes). Within each category, we covaried word length, as quantified by the number of syllables contained in a word, and phonological neighborhood density to target lexical and post-lexical phonological/phonetic processes. Multivariate pattern analyses searchlights in sensor space distinguished the stimulus-locked spatiotemporal responses to object categories early on, from 150 to 250 ms after picture onset, whereas word length was decoded in left frontotemporal sensors at 250-350 ms, followed by the latency of phonological neighborhood density (350-450 ms). Our results suggest a progression of neural activity from posterior to anterior language regions for the semantic and phonological/phonetic computations preparing overt speech, thus supporting serial cascading models of word production.SIGNIFICANCE STATEMENT Current psycholinguistic models make divergent predictions on how a preverbal message is mapped onto articulatory output during the language planning. Serial models predict a cascading sequence of hierarchically organized neural computations from conceptualization to articulation. In contrast, parallel models posit early simultaneous activation of multiple conceptual, phonological, and articulatory information in the language system. Here we asked whether such earliness is a distinctive property of the neural dynamics of word production. The combination of the millisecond precision of MEG with multivariate pattern analyses revealed subsequent onset times for the neural events supporting semantic and phonological/phonetic operations, progressing from posterior occipitotemporal to frontal sensor areas. The findings bring new insights for refining current theories of language production.

Are alpha and beta oscillations spatially dissociated over the cortex in context-driven spoken-word production?

Decreases in oscillatory alpha‐ and beta‐band power have been consistently found in spoken‐word production. These have been linked to both motor preparation and conceptual‐lexical retrieval processes. However, the observed power decreases have a broad frequency range that spans two “classic” (sensorimotor) bands: alpha and beta. It remains unclear whether alpha‐ and beta‐band power decreases contribute independently when a spoken word is planned. Using a re‐analysis of existing magnetoencephalography data, we probed whether the effects in alpha and beta bands are spatially distinct. Participants read a sentence that was either constraining or non‐constraining toward the final word, which was presented as a picture. In separate blocks participants had to name the picture or score its predictability via button press. Irregular‐resampling auto‐spectral analysis (IRASA) was used to isolate the oscillatory activity in the alpha and beta bands from the background 1‐over‐f spectrum. The sources of alpha‐ and beta‐band oscillations were localized based on the participants’ individualized peak frequencies. For both tasks, alpha‐ and beta‐power decreases overlapped in left posterior temporal and inferior parietal cortex, regions that have previously been associated with conceptual and lexical processes. The spatial distributions of the alpha and beta power effects were spatially similar in these regions to the extent we could assess it. By contrast, for left frontal regions, the spatial distributions differed between alpha and beta effects. Our results suggest that for conceptual‐lexical retrieval, alpha and beta oscillations do not dissociate spatially and, thus, are distinct from the classical sensorimotor alpha and beta oscillations.

It remains unclear whether the consistently found alpha‐ and beta‐band power decreases in spoken‐word production support a single operation or contribute independently. Using novel methodology, we probed whether the alpha and beta bands are distinct from an anatomical perspective. We found anatomical overlap in the left posterior temporal and inferior parietal cortex, whereas for the left frontal region, the spatial overlap was limited. Our results suggest that for conceptual‐lexical retrieval, alpha and beta oscillations do not dissociate and, thus, are distinct from the classical sensorimotor alpha and beta.

Electrophysiological Signatures of Conceptual and Lexical Retrieval from Semantic Memory

Retrieval from semantic memory of conceptual and lexical information is essential for producing speech. It is unclear whether there are differences in the neural mechanisms of conceptual and lexical retrieval when spreading activation through semantic memory is initiated by verbal or nonverbal settings. The same twenty participants took part in two EEG experiments. The first experiment examined conceptual and lexical retrieval following nonverbal settings, whereas the second experiment was a replication of previous studies examining conceptual and lexical retrieval following verbal settings. Target pictures were presented after constraining and nonconstraining contexts. In the nonverbal settings, contexts were provided as two priming pictures (e.g., constraining: nest, feather; nonconstraining: anchor, lipstick; target picture: BIRD). In the verbal settings, contexts were provided as sentences (e.g., constraining: "The farmer milked a..."; nonconstraining: "The child drew a..."; target picture: COW). Target pictures were named faster following constraining contexts in both experiments, indicating that conceptual preparation starts before target picture onset in constraining conditions. In the verbal experiment, we replicated the alpha-beta power decreases in constraining relative to nonconstraining conditions before target picture onset. No such power decreases were found in the nonverbal experiment. Power decreases in constraining relative to nonconstraining conditions were significantly different between experiments. Our findings suggest that participants engage in conceptual preparation following verbal and nonverbal settings, albeit differently. The retrieval of a target word, initiated by verbal settings, is associated with alpha-beta power decreases. By contrast, broad conceptual preparation alone, prompted by nonverbal settings, does not seem enough to elicit alpha-beta power decreases. These findings have implications for theories of oscillations and semantic memory.

Picture naming yields highly consistent cortical activation patterns: Test-retest reliability of magnetoencephalography recordings

Reliable paradigms and imaging measures of individual-level brain activity are paramount when reaching from group-level research studies to clinical assessment of individual patients. Magnetoencephalography (MEG) provides a direct, non-invasive measure of cortical processing with high spatiotemporal accuracy, and is thus well suited for assessment of functional brain damage in patients with language difficulties. This MEG study aimed to identify, in a delayed picture naming paradigm, source-localized evoked activity and modulations of cortical oscillations that show high test-retest reliability across measurement days in healthy individuals, demonstrating their applicability in clinical settings. For patients with a language disorder picture naming can be a challenging task. Therefore, we also determined whether a semantic judgment task ('Is this item living?') with a spoken response ("yes"/"no") would suffice to induce comparably consistent activity within brain regions related to language production. The MEG data was collected from 19 healthy participants on two separate days. In picture naming, evoked activity was consistent across measurement days (intraclass correlation coefficient (ICC)>0.4) in the left frontal (400-800 ms after image onset), sensorimotor (200-800 ms), parietal (200-600 ms), temporal (200-800 ms), occipital (400-800 ms) and cingulate (600-800 ms) regions, as well as the right temporal (600-800 ms) region. In the semantic judgment task, consistent evoked activity was spatially more limited, occurring in the left temporal (200-800 ms), sensorimotor (400-800 ms), occipital (400-600 ms) and subparietal (600-800 ms) regions, and the right supramarginal cortex (600-800 ms). The delayed naming task showed typical beta oscillatory suppression in premotor and sensorimotor regions (800-1200 ms) but other consistent modulations of oscillatory activity were mostly observed in posterior cortical regions that have not typically been associated with language processing. The high test-retest consistency of MEG evoked activity in the picture naming task testifies to its applicability in clinical evaluations of language function, as well as in longitudinal MEG studies of language production in clinical and healthy populations.

Across-session consistency of context-driven language processing: A magnetoencephalography study

Changes in brain organization following damage are commonly observed, but they remain poorly understood. These changes are often studied with imaging techniques that overlook the temporal granularity at which language processes occur. By contrast, electrophysiological measures provide excellent temporal resolution. To test the suitability of magnetoencephalography (MEG) to track language‐related neuroplasticity, the present study aimed at establishing the spectro‐temporo‐spatial across‐session consistency of context‐driven picture naming in healthy individuals, using MEG in two test–retest sessions. Spectro‐temporo‐spatial test–retest consistency in a healthy population is a prerequisite for studying neuronal changes in clinical populations over time. For this purpose, 15 healthy speakers were tested with MEG while performing a context‐driven picture‐naming task at two time points. Participants read a sentence missing the final word and named a picture completing the sentence. Sentences were constrained or unconstrained toward the picture, such that participants could either retrieve the picture name through sentence context (constrained sentences), or could only name it after the picture appeared (unconstrained sentences). The context effect (constrained versus unconstrained) in picture‐naming times had a strong effect size and high across‐session consistency. The context MEG results revealed alpha–beta power decreases (10–20 Hz) in the left temporal and inferior parietal lobule that were consistent across both sessions. As robust spectro‐temporo‐spatial findings in a healthy population are required for working toward longitudinal patient studies, we conclude that using context‐driven language production and MEG is a suitable way to examine language‐related neuroplasticity after brain damage.

Transient perturbation of the left temporal cortex evokes plasticity-related reconfiguration of the lexical network

While much progress has been made in how brain organization supports language function, the language network's ability to adapt to immediate disturbances by means of reorganization remains unclear. The aim of this study was to examine acute reorganizational changes in brain activity related to conceptual and lexical retrieval in unimpaired language production following transient disruption of the left middle temporal gyrus (MTG). In a randomized single‐blind within‐subject experiment, we recorded the electroencephalogram from 16 healthy participants during a context‐driven picture‐naming task. Prior to the task, the left MTG was perturbed with real continuous theta‐burst stimulation (cTBS) or sham stimulation. During the task, participants read lead‐in sentences creating a constraining (e.g., “The farmer milks the”) or nonconstraining context (e.g., “The farmer buys the”). The last word was shown as a picture that participants had to name (e.g., “cow”). Replicating behavioral studies, participants were overall faster in naming pictures following a constraining relative to a nonconstraining context, but this effect did not differ between real and sham cTBS. In contrast, real cTBS increased overall error rates compared to sham cTBS. In line with previous studies, we observed a decrease in alpha‐beta (8–24 Hz) oscillatory power for constraining relative to nonconstraining contexts over left temporal–parietal cortex after participants received sham cTBS. However, following real cTBS, this decrease extended toward left prefrontal regions associated with both domain‐general and domain‐specific control mechanisms. Our findings provide evidence that immediately after perturbing the left MTG, the lexical‐semantic network is able to quickly reconfigure, also recruiting domain‐general regions.