Integration or predictability? A further specification of the functional role of gamma oscillations in language comprehension

Neural correlates of listening to nonnative-accented speech in multi-talker background noise

We examined the neural correlates underlying the semantic processing of native- and nonnative-accented sentences, presented in quiet or embedded in multi-talker noise. Implementing a semantic violation paradigm, 36 English monolingual young adults listened to American-accented (native) and Chinese-accented (nonnative) English sentences with or without semantic anomalies, presented in quiet or embedded in multi-talker noise, while EEG was recorded. After hearing each sentence, participants verbally repeated the sentence, which was coded and scored as an offline comprehension accuracy measure. In line with earlier behavioral studies, the negative impact of background noise on sentence repetition accuracy was higher for nonnative-accented than for native-accented sentences. At the neural level, the N400 effect for semantic anomaly was larger for native-accented than for nonnative-accented sentences, and was also larger for sentences presented in quiet than in noise, indicating impaired lexical-semantic access when listening to nonnative-accented speech or sentences embedded in noise. No semantic N400 effect was observed for nonnative-accented sentences presented in noise. Furthermore, the frequency of neural oscillations in the alpha frequency band (an index of online cognitive listening effort) was higher when listening to sentences in noise versus in quiet, but no difference was observed across the accent conditions. Semantic anomalies presented in background noise also elicited higher theta activity, whereas processing nonnative-accented anomalies was associated with decreased theta activity. Taken together, we found that listening to nonnative accents or background noise is associated with processing challenges during online semantic access, leading to decreased comprehension accuracy. However, the underlying cognitive mechanism (e.g., associated listening efforts) might manifest differently across accented speech processing and speech in noise processing.

Error-based Implicit Learning in Language: The Effect of Sentence Context and Constraint in a Repetition Paradigm

Prediction errors drive implicit learning in language, but the specific mechanisms underlying these effects remain debated. This issue was addressed in an EEG study manipulating the context of a repeated unpredictable word (repetition of the complete sentence or repetition of the word in a new sentence context) and sentence constraint. For the manipulation of sentence constraint, unexpected words were presented either in high-constraint (eliciting a precise prediction) or low-constraint sentences (not eliciting any specific prediction). Repetition-induced reduction of N400 amplitudes and of power in the alpha/beta frequency band was larger for words repeated with their sentence context as compared with words repeated in a new low-constraint context, suggesting that implicit learning happens not only at the level of individual items but additionally improves sentence-based predictions. These processing benefits for repeated sentences did not differ between constraint conditions, suggesting that sentence-based prediction update might be proportional to the amount of unpredicted semantic information, rather than to the precision of the prediction that was violated. In addition, the consequences of high-constraint prediction violations, as reflected in a frontal positivity and increased theta band power, were reduced with repetition. Overall, our findings suggest a powerful and specific adaptation mechanism that allows the language system to quickly adapt its predictions when unexpected semantic information is processed, irrespective of sentence constraint, and to reduce potential costs of strong predictions that were violated.

Neural consequences of binaural beat stimulation on auditory sentence comprehension: an EEG study

A growing literature has shown that binaural beat (BB)-generated by dichotic presentation of slightly mismatched pure tones-improves cognition. We recently found that BB stimulation of either beta (18 Hz) or gamma (40 Hz) frequencies enhanced auditory sentence comprehension. Here, we used electroencephalography (EEG) to characterize neural oscillations pertaining to the enhanced linguistic operations following BB stimulation. Sixty healthy young adults were randomly assigned to one of three listening groups: 18-Hz BB, 40-Hz BB, or pure-tone baseline, all embedded in music. After listening to the sound for 10 min (stimulation phase), participants underwent an auditory sentence comprehension task involving spoken sentences that contained either an object or subject relative clause (task phase). During the stimulation phase, 18-Hz BB yielded increased EEG power in a beta frequency range, while 40-Hz BB did not. During the task phase, only the 18-Hz BB resulted in significantly higher accuracy and faster response times compared with the baseline, especially on syntactically more complex object-relative sentences. The behavioral improvement by 18-Hz BB was accompanied by attenuated beta power difference between object- and subject-relative sentences. Altogether, our findings demonstrate beta oscillations as a neural correlate of improved syntactic operation following BB stimulation.

Conditionals in context: Brain signatures of prediction in discourse processing

Comprehenders are known to generate expectations about upcoming linguistic input at the sentence and discourse level. However, most previous studies on prediction focused mainly on word-induced brain activity rather than examining neural activity preceding a critical stimulus in discourse processing, where prediction actually takes place. In this EEG study, participants were presented with multiple sentences resembling a discourse including conditional sentences with either only if or if, which are characterized by different semantics, triggering stronger or weaker predictions about the possible continuation of the presented discourses, respectively. Results revealed that discourses including only if, as compared to discourses with bare if, triggered an increased predictive neural activity before the expected critical word, resembling the readiness potential. Moreover, word-induced P300 brain responses were found to be enhanced by unpredictable discourse continuations and reduced in predictable discourse continuations. Intriguingly, brain responses preceding and following the critical word were found to be correlated, which yields evidence for predictive activity modulating word-induced processing on the discourse level. These findings shed light on the predictive nature of neural processes at the discourse level, critically advancing our understanding of the functional interconnection between discourse understanding and prediction processes in brain and mind.

Development of Gamma Oscillation during Sentence Processing in Early Adolescence: Insights into the Maturation of Semantic Processing

Children's ability to retrieve word meanings and incorporate them into sentences, along with the neural structures that support these skills, continues to evolve throughout adolescence. Theta (4-8 Hz) activity that corresponds to word retrieval in children decreases in power and becomes more localized with age. This bottom-up word retrieval is often paired with changes in gamma (31-70 Hz), which are thought to reflect semantic unification in adults. Here, we studied gamma engagement during sentence processing using EEG time-frequency in children (ages 8-15) to unravel the developmental trajectory of the gamma network during sentence processing. Children heavily rely on semantic integration for sentence comprehension, but as they mature, semantic and syntactic processing units become distinct and localized. We observed a similar developmental shift in gamma oscillation around age 11, with younger groups (8-9 and 10-11) exhibiting broadly distributed gamma activity with higher amplitudes, while older groups (12-13 and 14-15) exhibited smaller and more localized gamma activity, especially over the left central and posterior regions. We interpret these findings as support for the argument that younger children rely more heavily on semantic processes for sentence comprehension than older children. And like adults, semantic processing in children is associated with gamma activity.

Beta and gamma binaural beats enhance auditory sentence comprehension

Binaural beats-an auditory illusion produced when two pure tones of slightly different frequencies are dichotically presented-have been shown to modulate various cognitive and psychological states. Here, we investigated the effects of binaural beat stimulation on auditory sentence processing that required interpretation of syntactic relations (Experiment 1) or an evaluation of syntactic well formedness (Experiment 2) with a large cohort of healthy young adults (N = 200). In both experiments, participants performed a language task after listening to one of four sounds (i.e., between-subject design): theta (7 Hz), beta (18 Hz), and gamma (40 Hz) binaural beats embedded in music, or the music only (baseline). In Experiment 1, 100 participants indicated the gender of a noun linked to a transitive action verb in spoken sentences containing either a subject or object-relative center-embedded clause. We found that both beta and gamma binaural beats yielded better performance, compared to the baseline, especially for syntactically more complex object-relative sentences. To determine if the binaural beat effect can be generalized to another type of syntactic analysis, we conducted Experiment 2 in which another 100 participants indicated whether or not there was a grammatical error in spoken sentences. However, none of the binaural beats yielded better performance for this task indicating that the benefit of beta and gamma binaural beats may be specific to the interpretation of syntactic relations. Together, we demonstrate, for the first time, the positive impact of binaural beats on auditory language comprehension. Both theoretical and practical implications are discussed.

Speech comprehension across time, space, frequency, and age: MEG-MVPA classification of intertrial phase coherence

Language is a key part of human cognition, essential for our well-being at all stages of our lives. Whereas many neurocognitive abilities decline with age, for language the picture is much less clear, and how exactly speech comprehension changes with ageing is still unknown. To investigate this, we employed magnetoencephalography (MEG) and recorded neuromagnetic brain responses to auditory linguistic stimuli in healthy participants of younger and older age using a passive task-free paradigm and a range of different linguistic stimulus contrasts, which enabled us to assess neural processing of spoken language at multiple levels (lexical, semantic, morphosyntactic). Using machine learning-based classification algorithms to scrutinise intertrial phase coherence of MEG responses in cortical source space, we found that patterns of oscillatory neural activity diverged between younger and older participants across several frequency bands (alpha, beta, gamma) for all tested linguistic information types. The results suggest multiple age-related changes in the brain's neurolinguistic circuits, which may be due to both healthy ageing in general and compensatory processes in particular.

Early ERP indices of gender-biased processing elicited by generic masculine role nouns and the feminine-masculine pair form

In most gender-marked languages, the masculine form is used to refer to male people specifically as well as to people of any gender generically. This dual functionality was shown in behavioral studies to lead to male-biased mental representations. Here, using EEG, we targeted the neurophysiological basis of this bias by investigating whether and how the generic masculine influences the early perceptual and cognitive processing of anaphoric references to men and women. We found that ERP amplitudes in the P200 range were larger for references to women than to men after generic masculine role nouns, while amplitudes in the P300 range were larger for references to men than to women after the feminine-masculine pair form. These findings suggest that the generic masculine primes the perceptual system towards processing men and that neither this form nor the feminine-masculine pair form elicits gender-balanced computations during early processing in the human brain.

Development is in the details: Event-related theta oscillations reveal children and adults verify multiplication facts differently

When verifying the correctness of single-digit multiplication problems, children and adults show a robust ERP correctness effect thought to reflect similar cognitive processes across groups. Recent studies suggest that this effect is instead a modulation of the negative-going N400 component in children, reflecting access to semantic memory, and the positive-going P300 component in adults, reflecting stimulus categorization. However, the relative difference in ERP amplitude is the same for both components, more positive for correct than incorrect solutions, presenting a challenge to ascertaining the appropriate interpretation. Time-frequency analysis (TFA) of the N400/P300 window provides an objective approach to dissociating these effects. TFA measured from solution onset during single-digit multiplication verification revealed significant modulations of event-related as theta power (3-6 Hz) in both groups. Correct trials elicit less power in children (9-12 years) and more power in adults relative to incorrect trials. These findings are consistent with modulations of the N400 and P300, respectively, where opposite effects were predicted for spectral power. The ERP results further support a reinterpretation of the multiplication correctness effect. In contrast, TFA of the N400 effect elicited to a word-picture verification task revealed the same event-related theta effect in both groups, with increased power for mismatched than matched pictures. Together, these findings provide evidence for a developmental shift in cognitive processing specific to the multiplication task. Models of arithmetic should account for this overlooked difference in cognitive processing between children and adults.

Age and vocabulary knowledge differentially influence the N400 and theta responses during semantic retrieval

Using electroencephalography (EEG) to study the neural oscillations supporting language development is increasingly common; however, a clear understanding of the relationship between neural oscillations and traditional Event Related Potentials (ERPs) is needed to disentangle how maturation of language-related neural networks supports semantic processing throughout grade school. Theta and the N400 are both thought to index semantic retrieval but, in adults, are only weakly correlated with one another indicating they may measure somewhat unique aspects of retrieval. Here, we studied the relationship between the N400 amplitude and theta power during semantic retrieval with key indicators of language abilities including age, vocabulary, reading comprehension and phonological memory in 226 children ages 8-15 years. The N400 and theta responses were positively correlated over posterior areas, but negatively correlated over frontal areas. When controlling for the N400 amplitude, the amplitude of the theta response was predicted by age, but not by language measures. On the other hand, when controlling theta amplitude, the amplitude of the N400 was predicted by both vocabulary knowledge and age. These findings indicate that while there is a clear relationship between the N400 and theta responses, they may each index unique aspects of development related to semantic retrieval.

Predictability and decomposability separately contribute to compositional processing of idiomatic language

When reading, comprehenders construct a message-level representation and integrate new information as it becomes available. Such compositional processing may differ for idioms, where the meanings of the individual words do not always relate to the figurative meaning. Here, we examined how predictability and idiom decomposability contribute to compositional processing. Participants' EEG was recorded while they read sentences containing idioms that varied in decomposability and phrase-final word cloze probability, or their literal match (break the ice/slip on the ice) with little context prior to the phrase, along with adjective insertion conditions (break the freezing ice/slip on the freezing ice). Cloze probability modulated N400 amplitudes to critical words for both idiomatic and literal phrases, whereas P600 amplitudes only elicited by idiomatic phrases were also modulated. Phrases with adjective insertions reduced acceptability judgments, particularly for idioms, and led to N400 amplitude differences compared to critical words, but only for idioms. N400 differences were also found between idiomatic and literal contexts at the point of adjective insertion. Additionally, both cloze probability and decomposability modulated gamma band activity, with greater gamma activity for more predictable and less decomposable idioms, but at different times and with different scalp topographies, suggesting dissociable components of processing. These results support a hybrid model of processing in which multiple linguistic factors determine the type of processing engaged by the brain to comprehend non-literal language. When prior context is minimal, compositional processing may still be engaged when reading idioms.

Task-Modulated Oscillation Differences in Auditory and Spoken Chinese-English Bilingual Processing: An Electroencephalography Study

Neurophysiological research on the bilingual activity of interpretation or interpreting has been very fruitful in understanding the bilingual brain and has gained increasing popularity recently. Issues like word interpreting and the directionality of interpreting have been attended to by many researchers, mainly with localizing techniques. Brain structures such as the dorsolateral prefrontal cortex have been repeatedly identified during interpreting. However, little is known about the oscillation and synchronization features of interpreting, especially sentence-level overt interpreting. In this study we implemented a Chinese-English sentence-level overt interpreting experiment with electroencephalography on 43 Chinese-English bilinguals and compared the oscillation and synchronization features of interpreting with those of listening, speaking and shadowing. We found significant time-frequency power differences in the delta-theta (1–7 Hz) and gamma band (above 30 Hz) between motor and silent tasks. Further theta-gamma coupling analysis revealed different synchronization networks in between speaking, shadowing and interpreting, indicating an idea-formulation dependent mechanism. Moreover, interpreting incurred robust right frontotemporal gamma coactivation network compared with speaking and shadowing, which we think may reflect the language conversion process inherent in interpreting.

EEG theta and N400 responses to congruent versus incongruent brand logos

Neuroimaging and behavioral studies have shown that brands convey meaning to consumers. To investigate the immediate reactions of the brain to brand logos, followed either by congruent or incongruent pictorial brand-related cues, can deepen understanding of the semantic processing of brands, and perhaps how consolidated the logo is in consumers’ minds. Participants were exposed to different brand-related image sets, that were either congruent (a match between brand-related images and brand logo) or incongruent (a mismatch between brand-related images and brand logo) while having their brain signals recorded. Event-related potential and EEG time–frequency domain features were extracted from the signals of the target image (brand logo). The results showed significantly larger N400 peak and relative theta power increase for incongruent compared to congruent logos, which could be attributed to an error-monitoring process. Thus, we argue that brands are encoded deeply in consumers’ minds, and cognitive processing of mismatched (vs matched) brand logos is more difficult, leading to greater error monitoring. The results were mostly consistent with previous studies investigating semantic incongruences in the linguistic field. Therefore, the error-monitoring process could be extended beyond linguistic forms, for example to images and brands.

How the healthy ageing brain supports semantic binding during language comprehension

Semantic binding refers to constructing complex meaning based on elementary building blocks. Using electroencephalography (EEG), we investigated the age-related changes in modulations of oscillatory brain activity supporting lexical retrieval and semantic binding. Young and older adult participants were visually presented two-word phrases, which for the first word revealed a lexical retrieval signature (e.g., swift vs. swrfeq) and for the second word revealed a semantic binding signature (e.g., horse in a semantic binding "swift horse" vs. no binding "swrfeq horse" context). The oscillatory brain activity associated with lexical retrieval as well as semantic binding significantly differed between healthy older and young adults. Specifically for lexical retrieval, we found that different age groups exhibited opposite patterns of theta and alpha modulation, which as a combined picture suggest that lexical retrieval is associated with different and delayed signatures in older compared with young adults. For semantic binding, in young adults, we found a signature in the low-beta range centred around the target word onset (i.e., a smaller low-beta increase for binding relative to no binding), whereas in healthy older adults, we found an opposite binding signature about ~500 ms later in the low- and high-beta range (i.e., a smaller low- and high-beta decrease for binding relative to no binding). The novel finding of a different and delayed oscillatory signature for semantic binding in healthy older adults reflects that the integration of word meaning into the semantic context takes longer and relies on different mechanisms in healthy older compared with young adults.

Semantic priming and neurobiology in schizophrenia: A theoretical review

In this theoretical review we bridge the cognitive and neurobiological sciences to shed light on the neurocognitive foundations of the semantic priming effect in schizophrenia. We review and theoretically evaluate the neurotransmitter systems (dopaminergic, GABAergic and glutamatergic) and neurobiological underpinnings of behavioural and electrophysiological (N400) semantic priming in the pathology, and the main hypotheses on their geneses: a disinhibition of the semantic spread of activation, a disorganised semantic storage or noisy lexical-semantic associations, a psychomotor artefact, an artefact of relatedness proportions, or an inability to mobilise contextual information. We further assess the literature on the endophenotype of Formal Thought Disorder from multiple standpoints, ranging from neurophysiology to cognition: considerations are weaved on neuronal (PV basket cell, SST, VIP) and receptor deficits (DRD1, NMDA), neurotransmitter imbalances (dopamine), cortical and dopaminergic lateralisation, inter alia. In conclusion, we put forth novel postulates on the underlying causes of controlled hypopriming, automatic hyperpriming, N400 reversals (larger amplitudes for close associations), indirect versus direct hyperpriming, and the endophenotype of lexical-semantic disturbances in schizophrenia.

Neurophysiological basis of the N400 deflection, from Mismatch Negativity to Semantic Prediction Potentials and late positive components

The first theoretical model on the neurophysiological basis of the N400: the deflection reflects layer I dendritic plateaus on a preparatory state of synaptic integration that precedes layer V somatic burst firing for conscious identification of the higher-order features of the stimulus (a late positive shift). Plateaus ensue from apical disinhibition by vasoactive intestinal polypeptide-positive interneurons (VIPs) through suppression of Martinotti cells, opening the gates for glutamatergic feedback to trigger dendritic regenerative potentials. Cholinergic transients contribute to these dynamics directly, holding a central role in the N400 deflection. The stereotypical timing of the (frontal) glutamatergic feedback and the accompanying cholinergic transients account for the enigmatic "invariability" of the peak latency in the face of a gamut of different stimuli and paradigms. The theoretical postulations presented here may bring about unprecedented level of detail for the N400 deflection to be used in the study of schizophrenia, Alzheimer's disease and other higher-order pathologies. The substrates of a late positive component, the Mismatch Negativity and the Semantic Prediction Potentials are also surveyed.

EEG theta responses induced by emoji semantic violations

This study investigated emoji semantic processing by measuring changes in event-related electroencephalogram (EEG) power. The last segment of experimental sentences was designed as either words or emojis consistent or inconsistent with the sentential context. The results showed that incongruent emojis led to a conspicuous increase of theta power (4–7 Hz), while incongruent words induced a decrease. Furthermore, the theta power increase was observed at midfrontal, occipital and bilateral temporal lobes with emojis. This suggests a higher working memory load for monitoring errors, difficulty of form recognition and concept retrieval in emoji semantic processing. It implies different neuro-cognitive processes involved in the semantic processing of emojis and words.

When components collide: Spatiotemporal overlap of the N400 and P600 in language comprehension

The problem of spatiotemporal overlap between event-related potential (ERP) components is generally acknowledged in language research. However, its implications for the interpretation of experimental results are often overlooked. In a previous experiment on the functional interpretation of the N400 and P600, it was argued that a P600 effect to implausible words was largely obscured - in one of two implausible conditions - by an overlapping N400 effect of semantic association. In the present ERP study, we show that the P600 effect of implausibility is uncovered when the critical condition is tested against a proper baseline condition which elicits a similar N400 amplitude, while it is obscured when tested against a baseline condition producing an N400 effect. Our findings reveal that component overlap can result in the apparent absence or presence of an effect in the surface signal and should therefore be carefully considered when interpreting ERP patterns. Importantly, we show that, by factoring in the effects of spatiotemporal overlap between the N400 and P600 on the surface signal, which we reveal using rERP analysis, apparent inconsistencies in previous findings are easily reconciled, enabling us to draw unambiguous conclusions about the functional interpretation of the N400 and P600 components. Overall, our results provide compelling evidence that the N400 reflects lexical retrieval processes, while the P600 indexes compositional integration of word meaning into the unfolding utterance interpretation.

Language Dysfunction in Schizophrenia: Assessing Neural Tracking to Characterize the Underlying Disorder(s)?

Deficits in language production and comprehension are characteristic of schizophrenia. To date, it remains unclear whether these deficits arise from dysfunctional linguistic knowledge, or dysfunctional predictions derived from the linguistic context. Alternatively, the deficits could be a result of dysfunctional neural tracking of auditory information resulting in decreased auditory information fidelity and even distorted information. Here, we discuss possible ways for clinical neuroscientists to employ neural tracking methodology to independently characterize deficiencies on the auditory-sensory and abstract linguistic levels. This might lead to a mechanistic understanding of the deficits underlying language related disorder(s) in schizophrenia. We propose to combine naturalistic stimulation, measures of speech-brain synchronization, and computational modeling of abstract linguistic knowledge and predictions. These independent but likely interacting assessments may be exploited for an objective and differential diagnosis of schizophrenia, as well as a better understanding of the disorder on the functional level-illustrating the potential of neural tracking methodology as translational tool in a range of psychotic populations.

The temporal and spectral characteristics of expectations and prediction errors in pain and thermoception

In the context of a generative model, such as predictive coding, pain and heat perception can be construed as the integration of expectation and input with their difference denoted as a prediction error. In a previous neuroimaging study (Geuter et al., 2017) we observed an important role of the insula in such a model but could not establish its temporal aspects. Here, we employed electroencephalography to investigate neural representations of predictions and prediction errors in heat and pain processing. Our data show that alpha-to-beta activity was associated with stimulus intensity expectation, followed by a negative modulation of gamma band activity by absolute prediction errors. This is in contrast to prediction errors in visual and auditory perception, which are associated with increased gamma band activity, but is in agreement with observations in working memory and word matching, which show gamma band activity for correct, rather than violated, predictions.

Neural oscillations reveal differences in the process of word learning among school-aged children from lower socioeconomic status backgrounds

Building a robust vocabulary in grade school is essential for academic success. Children from lower socioeconomic status (SES) households on average perform below their higher SES peers on word learning tasks, negatively impacting their vocabulary; however, significant variability exists within this group. Many children from low SES homes perform as well as, or better than, their higher SES peers on measures of word learning. The current study addresses what processes underlie this variability, by comparing the neural oscillations of 44 better versus worse word learners (ages 8-15 years) from lower SES households as they infer the meaning of unknown words. Better word learners demonstrated increases in theta and beta power as a word was learned, whereas worse word learners exhibited decreases in alpha power. These group differences in neural oscillatory engagement during word learning indicate there may be different strategies employed based on differences in children's skills. Notably, children with greater vocabulary knowledge are more likely to exhibit larger beta increases; a strategy which is associated with better word learning. This sheds new light on the mechanisms that support word learning in children from low SES households.

Development of Neural Response to Novel Sounds in Fragile X Syndrome: Potential Biomarkers

Auditory processing abnormalities in fragile X syndrome (FXS) may contribute to difficulties with language development, pattern identification, and contextual updating. Participants with FXS (N = 41) and controls (N = 27) underwent auditory event-related potentials during presentation of an oddball paradigm. Data was adequate for analysis for 33 participants with FXS and 27 controls (age 4-51 y, 13 females [FXS]; 4-54 y, 11 females [control]). Participants with FXS showed larger N1 and P2 amplitudes, abnormal lack of modulation of P1 and P2 amplitudes and P2 latency in response to oddball stimuli ) relative to controls: Females with FXS were more similar to controls. Participants with FXS showed a marginal speeding of the P2 latency, suggesting potentiation to oddball stimuli rather than habituation. Participants with FXS showed a heightened N1 habituation effect compared to controls. Gamma power was significantly higher for participants with FXS. Groups did not differ on mismatch negativity. Both controls and participants with FXS showed similar developmental trajectories in P1 and N1 amplitude, P2 latency, and gamma power, but not for P2 amplitude. One month retest analyses performed in 14 participants suggest strong test-retest reliability for most measures. Individuals with FXS show previously demonstrated increased response amplitude and high frequency neural activity. Despite an overall normal developmental trajectory for most measures, individuals with FXS show age-independent but gender-dependent decreases in complex processing of novel stimuli. Many markers show strong retest reliability even in children and thus are potential biomarkers for clinical trials in FXS.

The Influence of Form- and Meaning-Based Predictions on Cortical Speech Processing Under Challenging Listening Conditions: A MEG Study

Under adverse listening conditions, prior linguistic knowledge about the form (i.e., phonology) and meaning (i.e., semantics) help us to predict what an interlocutor is about to say. Previous research has shown that accurate predictions of incoming speech increase speech intelligibility, and that semantic predictions enhance the perceptual clarity of degraded speech even when exact phonological predictions are possible. In addition, working memory (WM) is thought to have specific influence over anticipatory mechanisms by actively maintaining and updating the relevance of predicted vs. unpredicted speech inputs. However, the relative impact on speech processing of deviations from expectations related to form and meaning is incompletely understood. Here, we use MEG to investigate the cortical temporal processing of deviations from the expected form and meaning of final words during sentence processing. Our overall aim was to observe how deviations from the expected form and meaning modulate cortical speech processing under adverse listening conditions and investigate the degree to which this is associated with WM capacity. Results indicated that different types of deviations are processed differently in the auditory N400 and Mismatch Negativity (MMN) components. In particular, MMN was sensitive to the type of deviation (form or meaning) whereas the N400 was sensitive to the magnitude of the deviation rather than its type. WM capacity was associated with the ability to process phonological incoming information and semantic integration.

A Temporal Sampling Basis for Visual Processing in Developmental Dyslexia

Knowledge of oscillatory entrainment and its fundamental role in cognitive and behavioral processing has increasingly been applied to research in the field of reading and developmental dyslexia. Growing evidence indicates that oscillatory entrainment to theta frequency spoken language in the auditory domain, along with cross-frequency theta-gamma coupling, support phonological processing (i.e., cognitive encoding of linguistic knowledge gathered from speech) which is required for reading. This theory is called the temporal sampling framework (TSF) and can extend to developmental dyslexia, such that inadequate temporal sampling of speech-sounds in people with dyslexia results in poor theta oscillatory entrainment in the auditory domain, and thus a phonological processing deficit which hinders reading ability. We suggest that inadequate theta oscillations in the visual domain might account for the many magno-dorsal processing, oculomotor control and visual deficits seen in developmental dyslexia. We propose two possible models of a magno-dorsal visual correlate to the auditory TSF: (1) A direct correlate that involves "bottom-up" magnocellular oscillatory entrainment of the visual domain that occurs when magnocellular populations phase lock to theta frequency fixations during reading and (2) an inverse correlate whereby attending to text triggers "top-down" low gamma signals from higher-order visual processing areas, thereby organizing magnocellular populations to synchronize to a theta frequency to drive the temporal control of oculomotor movements and capturing of letter images at a higher frequency.

Frequency-based Dissociation of Symbolic and Nonsymbolic Numerical Processing during Numerical Comparison

Recent evidence suggests that during numerical calculation, symbolic and nonsymbolic processing are functionally distinct operations. Nevertheless, both roughly recruit the same brain areas (spatially overlapping networks in the parietal cortex) and happen at the same time (roughly 250 msec poststimulus onset). We tested the hypothesis that symbolic and nonsymbolic processing are segregated by means of functionally relevant networks in different frequency ranges: high gamma (above 50 Hz) for symbolic processing and lower beta (12–17 Hz) for nonsymbolic processing. EEG signals were quantified as participants compared either symbolic numbers or nonsymbolic quantities. Larger EEG gamma-band power was observed for more difficult symbolic comparisons (ratio of 0.8 between the two numbers) than for easier comparisons (ratio of 0.2) over frontocentral regions. Similarly, beta-band power was larger for more difficult nonsymbolic comparisons than for easier ones over parietal areas. These results confirm the existence of a functional dissociation in EEG oscillatory dynamics during numerical processing that is compatible with the notion of distinct linguistic processing of symbolic numbers and approximation of nonsymbolic numerical information.

Studying brain activity during word-by-word interactions using wireless EEG

We introduce here the word-by-word paradigm, a dynamic setting, in which two people take turns in producing a single sentence. This task requires a high degree of coordination between the partners and the simplicity of the task allows us to study with sufficient experimental control behavioral and neural processes that underlie this controlled interaction. For this study, 13 pairs of individuals engaged in a scripted word-by-word interaction, while we recorded the neural activity of both participants simultaneously using wireless EEG. To study expectation building, different semantic contexts were primed for each participant. Semantically unexpected continuations were introduced in 25% of all sentences. In line with the hypothesis, we observed amplitude differences for the P200-N400-P600 ERPs for unexpected compared to expected words. Moreover, we could successfully assess speech and reaction times. Our results show that it is possible to measure ERPs and RTs to semantically unexpected words in a dyadic interactive scenario.

Cortical Tracking of Surprisal during Continuous Speech Comprehension

Speech comprehension requires rapid online processing of a continuous acoustic signal to extract structure and meaning. Previous studies on sentence comprehension have found neural correlates of the predictability of a word given its context, as well as of the precision of such a prediction. However, they have focused on single sentences and on particular words in those sentences. Moreover, they compared neural responses to words with low and high predictability, as well as with low and high precision. However, in speech comprehension, a listener hears many successive words whose predictability and precision vary over a large range. Here, we show that cortical activity in different frequency bands tracks word surprisal in continuous natural speech and that this tracking is modulated by precision. We obtain these results through quantifying surprisal and precision from naturalistic speech using a deep neural network and through relating these speech features to EEG responses of human volunteers acquired during auditory story comprehension. We find significant cortical tracking of surprisal at low frequencies, including the delta band as well as in the higher frequency beta and gamma bands, and observe that the tracking is modulated by the precision. Our results pave the way to further investigate the neurobiology of natural speech comprehension.

The Relation between Alpha/Beta Oscillations and the Encoding of Sentence induced Contextual Information

Pre-stimulus alpha (8-12 Hz) and beta (16-20 Hz) oscillations have been frequently linked to the prediction of upcoming sensory input. Do these frequency bands serve as a neural marker of linguistic prediction as well? We hypothesized that if pre-stimulus alpha and beta oscillations index language predictions, their power should monotonically relate to the degree of predictability of incoming words based on past context. We expected that the more predictable the last word of a sentence, the stronger the alpha and beta power modulation. To test this, we measured neural responses with magnetoencephalography of healthy individuals during exposure to a set of linguistically matched sentences featuring three levels of sentence context constraint (high, medium and low constraint). We observed fluctuations in alpha and beta power before last word onset, and modulations in M400 amplitude after last word onset. The M400 amplitude was monotonically related to the degree of context constraint, with a high constraining context resulting in the strongest amplitude decrease. In contrast, pre-stimulus alpha and beta power decreased more strongly for intermediate constraints, followed by high and low constraints. Therefore, unlike the M400, pre-stimulus alpha and beta dynamics were not indexing the degree of word predictability from sentence context.

THE POWER OF NEURAL OSCILLATIONS TO INFORM SENTENCE COMPREHENSION: A LINGUISTIC PERSPECTIVE

The field of psycholinguistics is currently experiencing an explosion of interest in the analysis of neural oscillations - rhythmic brain activity synchronized at different temporal and spatial levels. Given that language comprehension relies on a myriad of processes, which are carried out in parallel in distributed brain networks, there is hope that this methodology might bring the field closer to understanding some of the more basic (spatially and temporally distributed, yet at the same time often overlapping) neural computations that support language function. In this review we discuss existing proposals linking oscillatory dynamics in different frequency bands to basic neural computations, and review relevant theories suggesting associations between band-specific oscillations and higher-level cognitive processes. More or less consistent patterns of oscillatory activity related to certain types of linguistic processing can already be derived from the evidence that has accumulated over the past few decades. The centerpiece of the current review is a synthesis of such patterns grouped by linguistic phenomenon. We restrict our review to evidence linking measures of oscillatory power to the comprehension of sentences, as well as linguistically (and/or pragmatically) more complex structures. For each grouping, we provide a brief summary and a table of associated oscillatory signatures that a psycholinguist might expect to find when employing a particular linguistic task. Summarizing across different paradigms, we conclude that a handful of basic neural oscillatory mechanisms are likely recruited in different ways and at different times for carrying out a variety of linguistic computations.

MVPA Analysis of Intertrial Phase Coherence of Neuromagnetic Responses to Words Reliably Classifies Multiple Levels of Language Processing in the Brain

Neural processing of language is still among the most poorly understood functions of the human brain, whereas a need to objectively assess the neurocognitive status of the language function in a participant-friendly and noninvasive fashion arises in various situations. Here, we propose a solution for this based on a short task-free recording of MEG responses to a set of spoken linguistic contrasts. We used spoken stimuli that diverged lexically (words/pseudowords), semantically (action-related/abstract), or morphosyntactically (grammatically correct/ungrammatical). Based on beamformer source reconstruction we investigated intertrial phase coherence (ITPC) in five canonical bands (α, β, and low, medium, and high γ) using multivariate pattern analysis (MVPA). Using this approach, we could successfully classify brain responses to meaningful words from meaningless pseudowords, correct from incorrect syntax, as well as semantic differences. The best classification results indicated distributed patterns of activity dominated by core temporofrontal language circuits and complemented by other areas. They varied between the different neurolinguistic properties across frequency bands, with lexical processes classified predominantly by broad γ, semantic distinctions by α and β, and syntax by low γ feature patterns. Crucially, all types of processing commenced in a near-parallel fashion from ∼100 ms after the auditory information allowed for disambiguating the spoken input. This shows that individual neurolinguistic processes take place simultaneously and involve overlapping yet distinct neuronal networks that operate at different frequency bands. This brings further hope that brain imaging can be used to assess neurolinguistic processes objectively and noninvasively in a range of populations.

Speech-specific audiovisual integration modulates induced theta-band oscillations

Speech perception is influenced by vision through a process of audiovisual integration. This is demonstrated by the McGurk illusion where visual speech (for example /ga/) dubbed with incongruent auditory speech (such as /ba/) leads to a modified auditory percept (/da/). Recent studies have indicated that perception of the incongruent speech stimuli used in McGurk paradigms involves mechanisms of both general and audiovisual speech specific mismatch processing and that general mismatch processing modulates induced theta-band (4–8 Hz) oscillations. Here, we investigated whether the theta modulation merely reflects mismatch processing or, alternatively, audiovisual integration of speech. We used electroencephalographic recordings from two previously published studies using audiovisual sine-wave speech (SWS), a spectrally degraded speech signal sounding nonsensical to naïve perceivers but perceived as speech by informed subjects. Earlier studies have shown that informed, but not naïve subjects integrate SWS phonetically with visual speech. In an N1/P2 event-related potential paradigm, we found a significant difference in theta-band activity between informed and naïve perceivers of audiovisual speech, suggesting that audiovisual integration modulates induced theta-band oscillations. In a McGurk mismatch negativity paradigm (MMN) where infrequent McGurk stimuli were embedded in a sequence of frequent audio-visually congruent stimuli we found no difference between congruent and McGurk stimuli. The infrequent stimuli in this paradigm are violating both the general prediction of stimulus content, and that of audiovisual congruence. Hence, we found no support for the hypothesis that audiovisual mismatch modulates induced theta-band oscillations. We also did not find any effects of audiovisual integration in the MMN paradigm, possibly due to the experimental design.

Oscillatory dynamics of cortical functional connections in semantic prediction

An event related potential, known as the N400, has been particularly useful in investigating language processing as it serves as a neural index for semantic prediction. There are numerous studies on the functional segregation of N400 neural sources; however, the oscillatory dynamics of functional connections among the relevant sources has remained elusive. In this study we acquired magnetoencephalography data during a classic N400 paradigm, where the semantic predictability of a fixed target noun was manipulated in simple German sentences. We conducted inter-regional functional connectivity (FC) and time-frequency analysis on known regions of the semantic network, encompassing bilateral temporal, and prefrontal cortices. Increased FC was found in less predicted (LP) nouns compared with highly predicted (HP) nouns in three connections: (a) right inferior frontal gyrus (IFG) and right middle temporal gyrus (MTG) from 0 to 300 ms mainly within the alpha band, (b) left lateral orbitofrontal (LOF) and right IFG around 400 ms within the beta band, and (c) left superior temporal gyrus (STG) and left LOF from 300 to 700 ms in the beta and low gamma bands. Furthermore, gamma spectral power (31-70 Hz) was stronger in HP nouns than in LP nouns in left anterior temporal cortices in earlier time windows (0-200 ms). Our findings support recent theories in language comprehension, suggesting fronto-temporal top-down connections are mainly mediated through beta oscillations while gamma band frequencies are involved in matching between prediction and input.

Lingering expectations: A pseudo-repetition effect for words previously expected but not presented

Prediction can help support rapid language processing. However, it is unclear whether prediction has downstream consequences, beyond processing in the moment. In particular, when a prediction is disconfirmed, does it linger, or is it suppressed? This study manipulated whether words were actually seen or were only expected, and probed their fate in memory by presenting the words (again) a few sentences later. If disconfirmed predictions linger, subsequent processing of the previously expected (but never presented) word should be similar to actual word repetition. At initial presentation, electrophysiological signatures of prediction disconfirmation demonstrated that participants had formed expectations. Further downstream, relative to unseen words, repeated words elicited a strong N400 decrease, an enhanced late positive complex (LPC), and late alpha band power decreases. Critically, like repeated words, words previously expected but not presented also attenuated the N400. This "pseudo-repetition effect" suggests that disconfirmed predictions can linger at some stages of processing, and demonstrates that prediction has downstream consequences beyond rapid on-line processing.

Developmental differences in the neural oscillations underlying auditory sentence processing in children and adults

Although very young children seem to process ongoing language quickly and effortlessly, neuroimaging and behavioral studies reveal that children continue to mature in their language skills through adolescence. During this prolonged development, children likely engage the same basic cognitive processes and neural mechanisms to perform language tasks as adults, but in somewhat different ways. In this study we used time frequency analysis of EEG to identify developmental differences in the engagement of neural oscillations between children (ages 10-12) and adults while listening to naturally-paced sentences. Adults displayed consistent beta changes throughout the sentence compared to children, thought to be related to efficient syntactic integration, and children displayed more broadly distributed theta changes than adults, thought to be related to more effortful semantic integration. Few differences in alpha, related to verbal working memory, existed between groups. These findings shed new light on developmental changes in the neuronal processes underlying language comprehension.

Addressing the Language Binding Problem With Dynamic Functional Connectivity During Meaningful Spoken Language Comprehension

During speech, how does the brain integrate information processed on different timescales and in separate brain areas so we can understand what is said? This is the language binding problem. Dynamic functional connectivity (brief periods of synchronization in the phase of EEG oscillations) may provide some answers. Here we investigate time and frequency characteristics of oscillatory power and phase synchrony (dynamic functional connectivity) during speech comprehension. Twenty adults listened to meaningful English sentences and non-sensical “Jabberwocky” sentences in which pseudo-words replaced all content words, while EEG was recorded. Results showed greater oscillatory power and global connectivity strength (mean phase lag index) in the gamma frequency range (30–80 Hz) for English compared to Jabberwocky. Increased power and connectivity relative to baseline was also seen in the theta frequency range (4–7 Hz), but was similar for English and Jabberwocky. High-frequency gamma oscillations may reflect a mechanism by which the brain transfers and integrates linguistic information so we can extract meaning and understand what is said. Slower frequency theta oscillations may support domain-general processing of the rhythmic features of speech. Our findings suggest that constructing a meaningful representation of speech involves dynamic interactions among distributed brain regions that communicate through frequency-specific functional networks.

Differences in Neurocognitive Mechanisms Underlying the Processing of Center-Embedded and Non–embedded Musical Structures

In music, chords are organized into hierarchical structures based on recursive or embedded syntax. How the brain extracts recursive grammar is a central question in musical cognition and other cognitive neuroscience, but the precise mechanism remains unclear. By analyzing event related potentials (ERPs) and neural oscillatory activity, the present study investigated neurocognitive mechanisms underlying the processing of center-embedded structure in music by examining the differences in center-embedded and non-embedded structure processing and evaluating how these differences are affected by musical proficiency. Based on Western musical proficiency, the subjects were divided into two groups, non-experts and experts. The results revealed that for non-experts, the processing of center-embedded structure elicited greater early right-anterior negativity (ERAN) and N5 components as well as, reduced alpha and gamma activities than did the non-embedded structure. For experts, no significant difference in the ERP response was observed between the processing of non-embedded and center-embedded structures; however, the processing of center-embedded structure elicited increased beta activity compared to non-embedded structure. These findings indicate that listeners different in proficiency would rely on different cognitive neural mechanisms in music processing with the syntactic complexity increases.

Gamma Oscillatory Activity Related to Language Prediction

Using magnetoencephalography, the current study examined gamma activity associated with language prediction. Participants read high- and low-constraining sentences in which the final word of the sentence was either expected or unexpected. Although no consistent gamma power difference induced by the sentence-final words was found between the expected and unexpected conditions, the correlation of gamma power during the prediction and activation intervals of the sentence-final words was larger when the presented words matched with the prediction compared with when the prediction was violated or when no prediction was available. This suggests that gamma magnitude relates to the match between predicted and perceived words. Moreover, the expected words induced activity with a slower gamma frequency compared with that induced by unexpected words. Overall, the current study establishes that prediction is related to gamma power correlations and a slowing of the gamma frequency.

The Role of Gamma Oscillations During Integration of Metaphoric Gestures and Abstract Speech

Metaphoric (MP) co-speech gestures are commonly used during daily communication. They communicate about abstract information by referring to gestures that are clearly concrete (e.g., raising a hand for “the level of the football game is high”). To understand MP co-speech gestures, a multisensory integration at semantic level is necessary between abstract speech and concrete gestures. While semantic gesture-speech integration has been extensively investigated using functional magnetic resonance imaging, evidence from electroencephalography (EEG) is rare. In the current study, we set out an EEG experiment, investigating the processing of MP vs. iconic (IC) co-speech gestures in different contexts, to reveal the oscillatory signature of MP gesture integration. German participants (n = 20) viewed video clips with an actor performing both types of gestures, accompanied by either comprehensible German or incomprehensible Russian (R) speech, or speaking German sentences without any gestures. Time-frequency analysis of the EEG data showed that, when gestures were accompanied by comprehensible German speech, MP gestures elicited decreased gamma band power (50–70 Hz) between 500 and 700 ms in the parietal electrodes when compared to IC gestures, and the source of this effect was localized to the right middle temporal gyrus. This difference is likely to reflect integration processes, as it was reduced in the R language and no-gesture conditions. Our findings provide the first empirical evidence suggesting the functional relationship between gamma band oscillations and higher-level semantic processes in a multisensory setting.

Oscillatory Brain Responses Reflect Anticipation during Comprehension of Speech Acts in Spoken Dialog

Everyday conversation requires listeners to quickly recognize verbal actions, so-called speech acts, from the underspecified linguistic code and prepare a relevant response within the tight time constraints of turn-taking. The goal of this study was to determine the time-course of speech act recognition by investigating oscillatory EEG activity during comprehension of spoken dialog. Participants listened to short, spoken dialogs with target utterances that delivered three distinct speech acts (Answers, Declinations, Pre-offers). The targets were identical across conditions at lexico-syntactic and phonetic/prosodic levels but differed in the pragmatic interpretation of the speech act performed. Speech act comprehension was associated with reduced power in the alpha/beta bands just prior to Declination speech acts, relative to Answers and Pre-offers. In addition, we observed reduced power in the theta band during the beginning of Declinations, relative to Answers. Based on the role of alpha and beta desynchronization in anticipatory processes, the results are taken to indicate that anticipation plays a role in speech act recognition. Anticipation of speech acts could be critical for efficient turn-taking, allowing interactants to quickly recognize speech acts and respond within the tight time frame characteristic of conversation. The results show that anticipatory processes can be triggered by the characteristics of the interaction, including the speech act type.

Hearing and seeing meaning in noise: Alpha, beta, and gamma oscillations predict gestural enhancement of degraded speech comprehension

During face‐to‐face communication, listeners integrate speech with gestures. The semantic information conveyed by iconic gestures (e.g., a drinking gesture) can aid speech comprehension in adverse listening conditions. In this magnetoencephalography (MEG) study, we investigated the spatiotemporal neural oscillatory activity associated with gestural enhancement of degraded speech comprehension. Participants watched videos of an actress uttering clear or degraded speech, accompanied by a gesture or not and completed a cued‐recall task after watching every video. When gestures semantically disambiguated degraded speech comprehension, an alpha and beta power suppression and a gamma power increase revealed engagement and active processing in the hand‐area of the motor cortex, the extended language network (LIFG/pSTS/STG/MTG), medial temporal lobe, and occipital regions. These observed low‐ and high‐frequency oscillatory modulations in these areas support general unification, integration and lexical access processes during online language comprehension, and simulation of and increased visual attention to manual gestures over time. All individual oscillatory power modulations associated with gestural enhancement of degraded speech comprehension predicted a listener's correct disambiguation of the degraded verb after watching the videos. Our results thus go beyond the previously proposed role of oscillatory dynamics in unimodal degraded speech comprehension and provide first evidence for the role of low‐ and high‐frequency oscillations in predicting the integration of auditory and visual information at a semantic level.

Predictability's aftermath: Downstream consequences of word predictability as revealed by repetition effects

Stimulus processing in language and beyond is shaped by context, with predictability having a particularly well-attested influence on the rapid processes that unfold during the presentation of a word. But does predictability also have downstream consequences for the quality of the constructed representations? On the one hand, the ease of processing predictable words might free up time or cognitive resources, allowing for relatively thorough processing of the input. On the other hand, predictability might allow the system to run in a top-down "verification mode", at the expense of thorough stimulus processing. This electroencephalogram (EEG) study manipulated word predictability, which reduced N400 amplitude and inter-trial phase clustering (ITPC), and then probed the fate of the (un)predictable words in memory by presenting them again. More thorough processing of predictable words should increase repetition effects, whereas less thorough processing should decrease them. Repetition was reflected in N400 decreases, late positive complex (LPC) enhancements, and late alpha/beta band power decreases. Critically, prior predictability tended to reduce the repetition effect on the N400, suggesting less priming, and eliminated the repetition effect on the LPC, suggesting a lack of episodic recollection. These findings converge on a top-down verification account, on which the brain processes more predictable input less thoroughly. More generally, the results demonstrate that predictability has multifaceted downstream consequences beyond processing in the moment.

The neural oscillations of speech processing and language comprehension: state of the art and emerging mechanisms

Neural oscillations subserve a broad range of functions in speech processing and language comprehension. On the one hand, speech contains-somewhat-repetitive trains of air pressure bursts that occur at three dominant amplitude modulation frequencies, physically marking the linguistically meaningful progressions of phonemes, syllables and intonational phrase boundaries. To these acoustic events, neural oscillations of isomorphous operating frequencies are thought to synchronise, presumably resulting in an implicit temporal alignment of periods of neural excitability to linguistically meaningful spectral information on the three low-level linguistic description levels. On the other hand, speech is a carrier signal that codes for high-level linguistic meaning, such as syntactic structure and semantic information-which cannot be read from stimulus acoustics, but must be acquired during language acquisition and decoded for language comprehension. Neural oscillations subserve the processing of both syntactic structure and semantic information. Here, I synthesise a mapping from each linguistic processing domain to a unique set of subserving oscillatory mechanisms-the mapping is plausible given the role ascribed to different oscillatory mechanisms in different subfunctions of cortical information processing and faithful to the underlying electrophysiology. In sum, the present article provides an accessible and extensive review of the functional mechanisms that neural oscillations subserve in speech processing and language comprehension.

Language Prediction Is Reflected by Coupling between Frontal Gamma and Posterior Alpha Oscillations

Readers and listeners actively predict upcoming words during language processing. These predictions might serve to support the unification of incoming words into sentence context and thus rely on interactions between areas in the language network. In the current magnetoencephalography study, participants read sentences that varied in contextual constraints so that the predictability of the sentence-final words was either high or low. Before the sentence-final words, we observed stronger alpha power suppression for the highly compared with low constraining sentences in the left inferior frontal cortex, left posterior temporal region, and visual word form area. Importantly, the temporal and visual word form area alpha power correlated negatively with left frontal gamma power for the highly constraining sentences. We suggest that the correlation between alpha power decrease in temporal language areas and left prefrontal gamma power reflects the initiation of an anticipatory unification process in the language network.

Neural Oscillations and a Nascent Corticohippocampal Theory of Reference

The ability to use words to refer to the world is vital to the communicative power of human language. In particular, the anaphoric use of words to refer to previously mentioned concepts (antecedents) allows dialogue to be coherent and meaningful. Psycholinguistic theory posits that anaphor comprehension involves reactivating a memory representation of the antecedent. Whereas this implies the involvement of recognition memory or the mnemonic subroutines by which people distinguish old from new, the neural processes for reference resolution are largely unknown. Here, we report time–frequency analysis of four EEG experiments to reveal the increased coupling of functional neural systems associated with referentially coherent expressions compared with referentially problematic expressions. Despite varying in modality, language, and type of referential expression, all experiments showed larger gamma-band power for referentially coherent expressions compared with referentially problematic expressions. Beamformer analysis in high-density Experiment 4 localized the gamma-band increase to posterior parietal cortex around 400–600 msec after anaphor onset and to frontotemporal cortex around 500–1000 msec. We argue that the observed gamma-band power increases reflect successful referential binding and resolution, which links incoming information to antecedents through an interaction between the brain's recognition memory networks and frontotemporal language network. We integrate these findings with previous results from patient and neuroimaging studies, and we outline a nascent corticohippocampal theory of reference.

The N400 Effect during Speaker-Switch-Towards a Conversational Approach of Measuring Neural Correlates of Language

Language occurs naturally in conversations. However, the study of the neural underpinnings of language has mainly taken place in single individuals using controlled language material. The interactive elements of a conversation (e.g., turn-taking) are often not part of neurolinguistic setups. The prime reason is the difficulty to combine open unrestricted conversations with the requirements of neuroimaging. It is necessary to find a trade-off between the naturalness of a conversation and the restrictions imposed by neuroscientific methods to allow for ecologically more valid studies. Here, we make an attempt to study the effects of a conversational element, namely turn-taking, on linguistic neural correlates, specifically the N400 effect. We focus on the physiological aspect of turn-taking, the speaker-switch, and its effect on the detectability of the N400 effect. The N400 event-related potential reflects expectation violations in a semantic context; the N400 effect describes the difference of the N400 amplitude between semantically expected and unexpected items. Sentences with semantically congruent and incongruent final words were presented in two turn-taking modes: (1) reading aloud first part of the sentence and listening to speaker-switch for the final word, and (2) listening to first part of the sentence and speaker-switch for the final word. A significant N400 effect was found for both turn-taking modes, which was not influenced by the mode itself. However, the mode significantly affected the P200, which was increased for the reading aloud mode compared to the listening mode. Our results show that an N400 effect can be detected during a speaker-switch. Speech articulation (reading aloud) before the analyzed sentence fragment did also not impede the N400 effect detection for the final word. The speaker-switch, however, seems to influence earlier components of the electroencephalogram, related to processing of salient stimuli. We conclude that the N400 can effectively be used to study neural correlates of language in conversational approaches including speaker-switches.

Prediction Signatures in the Brain: Semantic Pre-Activation during Language Comprehension

There is broad agreement that context-based predictions facilitate lexical-semantic processing. A robust index of semantic prediction during language comprehension is an evoked response, known as the N400, whose amplitude is modulated as a function of semantic context. However, the underlying neural mechanisms that utilize relations of the prior context and the embedded word within it are largely unknown. We measured magnetoencephalography (MEG) data while participants were listening to simple German sentences in which the verbs were either highly predictive for the occurrence of a particular noun (i.e., provided context) or not. The identical set of nouns was presented in both conditions. Hence, differences for the evoked responses of the nouns can only be due to differences in the earlier context. We observed a reduction of the N400 response for highly predicted nouns. Interestingly, the opposite pattern was observed for the preceding verbs: highly predictive (that is more informative) verbs yielded stronger neural magnitude compared to less predictive verbs. A negative correlation between the N400 effect of the verb and that of the noun was found in a distributed brain network, indicating an integral relation between the predictive power of the verb and the processing of the subsequent noun. This network consisted of left hemispheric superior and middle temporal areas and a subcortical area; the parahippocampus. Enhanced activity for highly predictive relative to less predictive verbs, likely reflects establishing semantic features associated with the expected nouns, that is a pre-activation of the expected nouns.