What do we mean by prediction in language comprehension?

Statistical learning and Gestalt-like principles predict melodic expectations

Expectation, or prediction, has become a major theme in cognitive science. Music offers a powerful system for studying how expectations are formed and deployed in the processing of richly structured sequences that unfold rapidly in time. We ask to what extent expectations about an upcoming note in a melody are driven by two distinct factors: Gestalt-like principles grounded in the auditory system (e.g.a preference for subsequent notes to move in small intervals), and statistical learning of melodic structure. We use multinomial regression modeling to evaluate the predictions of computationally implemented models of melodic expectation against behavioral data from a musical cloze task, in which participants hear a novel melodic opening and are asked to sing the note they expect to come next. We demonstrate that both Gestalt-like principles and statistical learning contribute to listeners' online expectations. In conjunction with results in the domain of language, our results point to a larger-than-previously-assumed role for statistical learning in predictive processing across cognitive domains, even in cases that seem potentially governed by a smaller set of theoretically motivated rules. However, we also find that both of the models tested here leave much variance in the human data unexplained, pointing to a need for models of melodic expectation that incorporate underlying hierarchical and/or harmonic structure. We propose that our combined behavioral (melodic cloze) and modeling (multinomial regression) approach provides a powerful method for further testing and development of models of melodic expectation.

Grammatical class modulates the (left) inferior frontal gyrus within 100 milliseconds when syntactic context is predictive

The current study set out to examine the spatiotemporal dynamics of predictive processing during syntactic processing. To do so, we conducted an MEG experiment in which we contrasted MRI-constrained sources elicited by nouns and verbs when they were preceded by a predictive syntactic context (i.e., possessive pronouns for nouns, and personal pronouns for verbs) versus a non-predictive syntactic context (visually matched symbols). The results showed rapid (from ~80 ms onwards) noun-verb differences in the left and (to a lesser extent) right inferior frontal gyri (IFG), but only when those nouns and verbs were preceded by the syntactically predictive context (i.e. their corresponding pronoun). Furthermore, the contrast between possessive and personal pronouns that preceded the rapid noun-verb modulations in the (L)IFG also produced differences in source activation in various regions of the prefrontal cortex (the superior frontal and orbitofrontal cortex). We suggest the data show that syntactic unification manifests very early on during processing in the LIFG. The speed of such syntactic unification operations is hypothesized to be driven by predictive top-down activations stemming from a domain-general network in the prefrontal cortex.

Language-driven anticipatory eye movements in virtual reality

Predictive language processing is often studied by measuring eye movements as participants look at objects on a computer screen while they listen to spoken sentences. This variant of the visual-world paradigm has revealed that information encountered by a listener at a spoken verb can give rise to anticipatory eye movements to a target object, which is taken to indicate that people predict upcoming words. The ecological validity of such findings remains questionable, however, because these computer experiments used two-dimensional stimuli that were mere abstractions of real-world objects. Here we present a visual-world paradigm study in a three-dimensional (3-D) immersive virtual reality environment. Despite significant changes in the stimulus materials and the different mode of stimulus presentation, language-mediated anticipatory eye movements were still observed. These findings thus indicate that people do predict upcoming words during language comprehension in a more naturalistic setting where natural depth cues are preserved. Moreover, the results confirm the feasibility of using eyetracking in rich and multimodal 3-D virtual environments.

Toward a Neurobiologically Plausible Model of Language-Related, Negative Event-Related Potentials

Language-related event-related potential (ERP) components such as the N400 have traditionally been associated with linguistic or cognitive functional interpretations. By contrast, it has been considerably more difficult to relate these components to neurobiologically grounded accounts of language. Here, we propose a theoretical framework based on a predictive coding architecture, within which negative language-related ERP components such as the N400 can be accounted for in a neurobiologically plausible manner. Specifically, we posit that the amplitude of negative language-related ERP components reflects precision-weighted prediction error signals, i.e., prediction errors weighted by the relevance of the information source leading to the error. From this perspective, precision has a direct link to cue validity in a particular language and, thereby, to relevance of individual linguistic features for internal model updating. We view components such as the N400 and LAN as members of a family with similar functional characteristics and suggest that latency and topography differences between these components reflect the locus of prediction errors and model updating within a hierarchically organized cortical predictive coding architecture. This account has the potential to unify findings from the full range of the N400 literature, including word-level, sentence-, and discourse-level results as well as cross-linguistic differences.

Developmental Timescale of Rapid Adaptation to Conflicting Cues in Real-Time Sentence Processing

Children and adults use established global knowledge to generate real-time linguistic predictions, but less is known about how listeners generate predictions in circumstances that semantically conflict with long-standing event knowledge. We explore these issues in adults and 5- to 10-year-old children using an eye-tracked sentence comprehension task that tests real-time activation of unexpected events that had been previously encountered in brief stories. Adults generated predictions for these previously unexpected events based on these discourse cues alone, whereas children overall did not override their established global knowledge to generate expectations for semantically conflicting material; however, they do show an increased ability to integrate discourse cues to generate appropriate predictions for sentential endings. These results indicate that the ability to rapidly integrate and deploy semantically conflicting knowledge has a long developmental trajectory, with adult-like patterns not emerging until later in childhood.

Specific lexico-semantic predictions are associated with unique spatial and temporal patterns of neural activity

We used Magnetoencephalography (MEG) in combination with Representational Similarity Analysis to probe neural activity associated with distinct, item-specific lexico-semantic predictions during language comprehension. MEG activity was measured as participants read highly constraining sentences in which the final words could be predicted. Before the onset of the predicted words, both the spatial and temporal patterns of brain activity were more similar when the same words were predicted than when different words were predicted. The temporal patterns localized to the left inferior and medial temporal lobe. These findings provide evidence that unique spatial and temporal patterns of neural activity are associated with item-specific lexico-semantic predictions. We suggest that the unique spatial patterns reflected the prediction of spatially distributed semantic features associated with the predicted word, and that the left inferior/medial temporal lobe played a role in temporally 'binding' these features, giving rise to unique lexico-semantic predictions.

I see what you meant to say: Anticipating speech errors during online sentence processing

Everyday speech is rife with errors and disfluencies, yet processing what we hear usually feels effortless. How does the language comprehension system accomplish such an impressive feat? The current experiment tests the hypothesis that listeners draw on relevant contextual and linguistic cues to anticipate speech errors and mentally correct them, even before receiving an explicit correction from the speaker. In the current visual-world eye-tracking experiment, we monitored participants' eye movements to objects in a display while they listened to utterances containing reparandum-repair speech errors (e.g., . . . his cat, uh I mean his dog . . .). The contextual plausibility of the misspoken word and the certainty with which the speaker uttered this word were systematically manipulated. Results showed that listeners immediately exploited these cues to generate top-down expectations regarding the speaker's communicative intention. Crucially, listeners used these expectations to constrain the bottom-up speech input and mentally correct perceived speech errors, even before the speaker initiated the correction. The results provide powerful evidence regarding the joint process of correcting speech errors that involves both the speaker and the listener. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Integration and Prediction in Language Processing: A Synthesis of Old and New

Current theories of language processing emphasize prediction as a mechanism to facilitate comprehension, which contrasts with the state of the field a few decades ago, when prediction was rarely mentioned. We argue that the field of psycholinguistics would benefit from revisiting these earlier theories of comprehension which attempted to explain integration and the processes underlying the formation of rich representations of linguistic input, and that emphasized informational newness over redundancy. We suggest further that integration and anticipation may be complementary mechanisms that operate on elaborated, coherent discourse representations, supporting enhanced comprehension and memory. In addition, the traditional emphasis on language as a tool for communication implies that much linguistic content will be nonredundant; moreover, the purpose of anticipation is probably not to permit the prediction of exact lexical or syntactic forms, but instead to induce a state of preparedness that allows the comprehender to be receptive to new information, thus facilitating its processing.

Early L2 Spoken Word Recognition Combines Input-Based and Knowledge-Based Processing

This study examines the perceptual trade-off between knowledge of a language's statistical regularities and reliance on the acoustic signal during L2 spoken word recognition. We test how early learners track and make use of segmental and suprasegmental cues and their relative frequencies during non-native word recognition. English learners of Mandarin were taught an artificial tonal language in which a tone's informativeness for word identification varied according to neighborhood density. The stimuli mimicked Mandarin's uneven distribution of syllable+tone combinations by varying syllable frequency and the probability of particular tones co-occurring with a particular syllable. Use of statistical regularities was measured by four-alternative forced-choice judgments and by eye fixations to target and competitor symbols. Half of the participants were trained on one speaker, that is, low speaker variability while the other half were trained on four speakers. After four days of learning, the results confirmed that tones are processed according to their informativeness. Eye movements to the newly learned symbols demonstrated that L2 learners use tonal probabilities at an early stage of word recognition, regardless of speaker variability. The amount of variability in the signal, however, influenced the time course of recovery from incorrect anticipatory looks: participants exposed to low speaker variability recovered from incorrect probability-based predictions of tone more rapidly than participants exposed to greater variability. These results motivate two conclusions: early L2 learners track the distribution of segmental and suprasegmental co-occurrences and make predictions accordingly during spoken word recognition; and when the acoustic input is more variable because of multi-speaker input, listeners rely more on their knowledge of tone-syllable co-occurrence frequency distributions and less on the incoming acoustic signal.

Predictive Pre-updating and Working Memory Capacity: Evidence from Event-related Potentials

It was recently proposed that lexical prediction in sentence context encompasses two qualitatively distinct prediction mechanisms: “pre-activation,” namely, activating representations stored in long-term memory, and “pre-updating,” namely, updating the sentence's representation, built online in working memory (WM), to include the predicted content [Lau, E. F., Holcomb, P. J., & Kuperberg, G. R. Dissociating N400 effects of prediction from association in single-word contexts. Journal of Cognitive Neuroscience, 25, 484–502, 2013]. The current study sought to find evidence for pre-updating and test the influence of individual differences in WM capacity on the tendency to engage in this process. Participants read strongly and weakly constraining sentences. ERPs were measured on the predictable noun as well as on the preceding verb, where the prediction is generated. Increased P600 amplitude was observed at the verb in the strongly constraining sentences, reflecting integration of the predicted upcoming argument, thus providing evidence for pre-updating. This effect was greater for participants with higher WM capacity, indicating that the tendency to engage in pre-updating is highly affected by WM capacity. The opposite effect was observed at the noun, that is, for participants with higher WM span, a greater decrease in P600 amplitude in the strongly constraining sentences was observed, indicating that the integration of a pre-updated word was easier. We discuss these results in light of previous literature and propose a plausible architecture to account for the interplay between pre-activation and pre-updating, mediating the influence of factors such as WM capacity.

Lingering expectations: A pseudo-repetition effect for words previously expected but not presented

Prediction can help support rapid language processing. However, it is unclear whether prediction has downstream consequences, beyond processing in the moment. In particular, when a prediction is disconfirmed, does it linger, or is it suppressed? This study manipulated whether words were actually seen or were only expected, and probed their fate in memory by presenting the words (again) a few sentences later. If disconfirmed predictions linger, subsequent processing of the previously expected (but never presented) word should be similar to actual word repetition. At initial presentation, electrophysiological signatures of prediction disconfirmation demonstrated that participants had formed expectations. Further downstream, relative to unseen words, repeated words elicited a strong N400 decrease, an enhanced late positive complex (LPC), and late alpha band power decreases. Critically, like repeated words, words previously expected but not presented also attenuated the N400. This "pseudo-repetition effect" suggests that disconfirmed predictions can linger at some stages of processing, and demonstrates that prediction has downstream consequences beyond rapid on-line processing.

Balancing Prediction and Sensory Input in Speech Comprehension: The Spatiotemporal Dynamics of Word Recognition in Context

Spoken word recognition in context is remarkably fast and accurate, with recognition times of ∼200 ms, typically well before the end of the word. The neurocomputational mechanisms underlying these contextual effects are still poorly understood. This study combines source-localized electroencephalographic and magnetoencephalographic (EMEG) measures of real-time brain activity with multivariate representational similarity analysis to determine directly the timing and computational content of the processes evoked as spoken words are heard in context, and to evaluate the respective roles of bottom-up and predictive processing mechanisms in the integration of sensory and contextual constraints. Male and female human participants heard simple (modifier-noun) English phrases that varied in the degree of semantic constraint that the modifier (W1) exerted on the noun (W2), as in pairs, such as "yellow banana." We used gating tasks to generate estimates of the probabilistic predictions generated by these constraints as well as measures of their interaction with the bottom-up perceptual input for W2. Representation similarity analysis models of these measures were tested against electroencephalographic and magnetoencephalographic brain data across a bilateral fronto-temporo-parietal language network. Consistent with probabilistic predictive processing accounts, we found early activation of semantic constraints in frontal cortex (LBA45) as W1 was heard. The effects of these constraints (at 100 ms after W2 onset in left middle temporal gyrus and at 140 ms in left Heschl's gyrus) were only detectable, however, after the initial phonemes of W2 had been heard. Within an overall predictive processing framework, bottom-up sensory inputs are still required to achieve early and robust spoken word recognition in context.SIGNIFICANCE STATEMENT Human listeners recognize spoken words in natural speech contexts with remarkable speed and accuracy, often identifying a word well before all of it has been heard. In this study, we investigate the brain systems that support this important capacity, using neuroimaging techniques that can track real-time brain activity during speech comprehension. This makes it possible to locate the brain areas that generate predictions about upcoming words and to show how these expectations are integrated with the evidence provided by the speech being heard. We use the timing and localization of these effects to provide the most specific account to date of how the brain achieves an optimal balance between prediction and sensory input in the interpretation of spoken language.

Shared neural and cognitive mechanisms in action and language: The multiscale information transfer framework

This review compares how humans process action and language sequences produced by other humans. On the one hand, we identify commonalities between action and language processing in terms of cognitive mechanisms (e.g., perceptual segmentation, predictive processing, integration across multiple temporal scales), neural resources (e.g., the left inferior frontal cortex), and processing algorithms (e.g., comprehension based on changes in signal entropy). On the other hand, drawing on sign language with its particularly strong motor component, we also highlight what differentiates (both oral and signed) linguistic communication from nonlinguistic action sequences. We propose the multiscale information transfer framework (MSIT) as a way of integrating these insights and highlight directions into which future empirical research inspired by the MSIT framework might fruitfully evolve. This article is categorized under: Psychology > Language Linguistics > Language in Mind and Brain Psychology > Motor Skill and Performance Psychology > Prediction.

Effects of speech rate, preview time of visual context, and participant instructions reveal strong limits on prediction in language processing

There is a consensus among language researchers that people can predict upcoming language. But do people always predict when comprehending language? Notions that "brains … are essentially prediction machines" certainly suggest so. In three eye-tracking experiments we tested this view. Participants listened to simple Dutch sentences ('Look at the displayed bicycle') while viewing four objects (a target, e.g. a bicycle, and three unrelated distractors). We used the identical visual stimuli and the same spoken sentences but varied speech rates, preview time, and participant instructions. Target nouns were preceded by definite gender-marked determiners, which allowed participants to predict the target object because only the targets but not the distractors agreed in gender with the determiner. In Experiment 1, participants had four seconds preview and sentences were presented either in a slow or a normal speech rate. Participants predicted the targets as soon as they heard the determiner in both conditions. Experiment 2 was identical except that participants were given only a one second preview. Participants predicted the targets only in the slow speech condition. Experiment 3 was identical to Experiment 2 except that participants were explicitly told to predict. This led only to a small prediction effect in the normal speech condition. Thus, a normal speech rate only afforded prediction if participants had an extensive preview. Even the explicit instruction to predict the target resulted in only a small anticipation effect with a normal speech rate and a short preview. These findings are problematic for theoretical proposals that assume that prediction pervades cognition.

How bilinguals perceive speech depends on which language they think they're hearing

Bilinguals understand when the communication context calls for speaking a particular language and can switch from speaking one language to speaking the other based on such conceptual knowledge. There is disagreement regarding whether conceptually-based language selection is also possible in the listening modality. For example, can bilingual listeners perceptually adjust to changes in pronunciation across languages based on their conceptual understanding of which language they're currently hearing? We asked French- and Spanish-English bilinguals to identify nonsense monosyllables as beginning with /b/ or /p/, speech categories that French and Spanish speakers pronounce differently than English speakers. We conceptually cued each bilingual group to one of their two languages or the other by explicitly instructing them that the speech items were word onsets in that language, uttered by a native speaker thereof. Both groups adjusted their /b-p/ identification boundary as a function of this conceptual cue to the language context. These results support a bilingual model permitting conceptually-based language selection on both the speaking and listening end of a communicative exchange.

Unfolding meaning in context: The dynamics of conceptual similarity

How are relationships between concepts affected by the interplay between short-term contextual constraints and long-term conceptual knowledge? Across two studies we investigate the consequence of changes in visual context for the dynamics of conceptual processing. Participants' eye movements were tracked as they viewed a visual depiction of e.g. a canary in a birdcage (Experiment 1), or a canary and three unrelated objects, each in its own quadrant (Experiment 2). In both studies participants heard either a semantically and contextually similar "robin" (a bird; similar size), an equally semantically similar but not contextually similar "stork" (a bird; bigger than a canary, incompatible with the birdcage), or unrelated "tent". The changing patterns of fixations across time indicated first, that the visual context strongly influenced the eye movements such that, in the context of a birdcage, early on (by word offset) hearing "robin" engendered more looks to the canary than hearing "stork" or "tent" (which engendered the same number of looks), unlike in the context of unrelated objects (in which case "robin" and "stork" engendered equivalent looks to the canary, and more than did "tent"). Second, within the 500 ms post-word-offset eye movements in both experiments converged onto a common pattern (more looks to the canary after "robin" than after "stork", and for both more than after "tent"). We interpret these findings as indicative of the dynamics of activation within semantic memory accessed via pictures and via words, and reflecting the complex interaction between systems representing context-independent and context-dependent conceptual knowledge driven by predictive processing.

Vocabulary size and Native Speaker self-identification influence flexibility in linguistic prediction among adult bilinguals

When language users predict upcoming speech, they generate pluralistic expectations, weighted by likelihood (Kuperberg & Jaeger, 2016). Many variables influence the prediction of highly-likely sentential outcomes, but less is known regarding variables affecting the prediction of less-likely outcomes. Here we explore how English vocabulary size and self-identification as a Native Speaker (NS) of English modulate adult bi-/multilinguals' pre-activation of less-likely sentential outcomes in two visual-world experiments. Participants heard transitive sentences containing an agent, action and theme (The pirate chases the ship) while viewing four referents varying in expectancy by relation to the agent and action. In experiment 1 (N=70), spoken themes referred to highly-expected items (e.g., ship). Results indicate lower-skill (smaller vocabulary size) and less confident (not identifying as NS) bi-/multilinguals activate less-likely action-related referents more than their higher-skill/confidence peers. In experiment 2 (N=65), themes were one of two less-likely items (The pirate chases the bone/cat). Results approaching significance indicate an opposite but similar size effect: higher-skill/confidence listeners activate less-likely action-related (e.g., bone) referents slightly more than lower-skill/confidence listeners. Results across experiments suggest higher-skill/confidence participants more flexibly modulate their linguistic predictions per the demands of the task, with similar but not identical patterns emerging when bi-/multilinguals are grouped by self-ascribed NS-status versus vocabulary size.

Multimodal neuroimaging evidence for looser lexico-semantic networks in schizophrenia:Evidence from masked indirect semantic priming

It has been hypothesized that schizophrenia is characterized by overly broad automatic activity within lexico-semantic networks. We used two complementary neuroimaging techniques, Magnetoencephalography (MEG) and functional Magnetic Resonance Imaging (fMRI), in combination with a highly automatic indirect semantic priming paradigm, to spatiotemporally localize this abnormality in the brain. Eighteen people with schizophrenia and 20 demographically-matched control participants viewed target words ("bell") preceded by directly related ("church"), indirectly related ("priest"), or unrelated ("hammer") prime words in MEG and fMRI sessions. To minimize top-down processing, the prime was masked, the target appeared only 140 ms after prime onset, and participants simply monitored for words within a particular semantic category that appeared in filler trials. Both techniques revealed a significantly larger automatic indirect priming effect in people with schizophrenia than in control participants. MEG temporally localized this enhanced effect to the N400 time window (300-500 ms) - the critical stage of accessing meaning from words. fMRI spatially localized the effect to the left temporal fusiform cortex, which plays a role in mapping of orthographic word-form on to meaning. There was no evidence of an enhanced automatic direct semantic priming effect in the schizophrenia group. These findings provide converging neural evidence for abnormally broad highly automatic lexico-semantic activity in schizophrenia. We argue that, rather than arising from an unconstrained spread of automatic activation across semantic memory, this broader automatic lexico-semantic activity stems from looser mappings between the form and meaning of words.

Dissociating predictability, plausibility and possibility of sentence continuations in reading: evidence from late-positivity ERPs

Late positive event-related potential (ERP) components occurring after the N400, traditionally linked to reanalysis due to syntactic incongruence, are increasingly considered to also reflect reanalysis and repair due to semantic difficulty. Semantic problems can have different origins, such as a mismatch of specific predictions based on the context, low plausibility, or even semantic impossibility of a word in the given context. DeLong, Quante & Kutas (2014) provided the first direct evidence for topographically different late positivities for prediction mismatch (left frontal late positivity for plausible but unexpected words) and plausibility violation (posterior-parietal late positivity for implausible, incongruent words). The aim of the current study is twofold: (1) to replicate this dissociation of ERP effects for plausibility violations and prediction mismatch in a different language, and (2) to test an additional contrast within implausible words, comparing impossible and possible sentence continuations. Our results replicate DeLong, Quante & Kutas (2014) with different materials in a different language, showing graded effects for predictability and plausibility at the level of the N400, a dissociation of plausible and implausible, anomalous continuations in posterior late positivities and an effect of prediction mismatch on late positivities at left-frontal sites. In addition, we found some evidence for a dissociation, at these left-frontal sites, between implausible words that were fully incompatible with the preceding discourse and those for which an interpretation is possible.

Lexical prediction in the aging brain: The effects of predictiveness and congruency on the N400 ERP component

Although the N400 ERP component has been extensively studied in younger adults, the underlying mechanisms are still unclear. In older adults, N400 ERP studies have shown less efficient use of context compared to younger adults. Here, we asked whether the mechanisms underlying the N400 effect are the same in terms of predictiveness and congruency in younger and older adults. We used a simple picture-word matching task in which we crossed predictiveness and congruency. Our results indicate a three-way interaction between predictiveness, congruency, and age, in that, younger adults showed an N400 effect only in strongly constrained conditions; whereas, older adults showed an effect in both strongly- and weakly constrained conditions. This interaction was not modulated by language experience or cognitive decline. Our results support either two separate mechanisms (lexical access and integration) that run in parallel and are modulated by age or a common prediction error mechanism that changes with age.

Backward-Looking Sentence Processing in Typically Disfluent versus Stuttered Speech: ERP Evidence

The aim was to determine how backward-looking sentence processing is affected by typically-disfluent versus stuttered speech. Two listener groups heard Garden Path (GP) and control sentences. GP sentences contained no disfluency, a silent pause, or a filled pause before the disambiguating verb. For one group, the sentence preambles additionally contained stuttering-like disfluencies. Comprehension accuracy, event-related potentials (ERPs) time-locked to disambiguating verbs, and perceptual speaker ratings, were compared between groups. The With Stuttering group perceived the speaker as less competent but had better comprehension accuracy for GP sentences. ERPs to disambiguating verbs in GP sentences included a P600 component, indexing backward-looking sentence processing, but only for the No Stuttering group. Other ERP components, elicited to GP sentences with silent/filled pauses, did not differ between groups. Results suggest that listeners abandon prior expectations when processing sentences containing stuttering-like disfluencies, possibly because they lack a speaker model defined by the presence of stuttering.

Eye'll Help You Out! How the Gaze Cue Reduces the Cognitive Load Required for Reference Processing

Referential gaze has been shown to benefit language processing in situated communication in terms of shifting visual attention and leading to shorter reaction times on subsequent tasks. The present study simultaneously assessed both visual attention and, importantly, the immediate cognitive load induced at different stages of sentence processing. We aimed to examine the dynamics of combining visual and linguistic information in creating anticipation for a specific object and the effect this has on language processing. We report evidence from three visual‐world eye‐tracking experiments, showing that referential gaze leads to a shift in visual attention toward the cued object, which consequently lowers the effort required for processing the linguistic reference. Importantly, perceiving and following the gaze cue did not prove costly in terms of cognitive effort, unless the cued object did not fit the verb selectional preferences.

Language Separation in Bidialectal Speakers: Evidence From Eye Tracking

The aim of this study was to find out how people process the dialectal variation encountered in the daily linguistic input. We conducted an eye tracking study (Visual Word Paradigm) that targeted the online processing of grammatical gender markers. Three different groups of Norwegian speakers took part in the experiment: one group of students from the capital Oslo, and two groups of dialect speakers of the Sogn dialect of Western Norway. One Sogn group was defined as "stable dialect speakers," and one as "unstable dialect speakers," based on a background questionnaire. The students participated in two eye tracking experiments each, one conducted in the their own dialect, and one in the other dialect (i.e., Sogn dialect for the Oslo students, and Oslo dialect for the Sogn students). The gender systems in the two dialects differ: the Sogn dialect makes an obligatory three-gender split (Masculine, Feminine, and Neuter) whereas the Oslo dialect only obligatorily makes a two gender distinction. The research question was whether speakers could use gender markers to predict the upcoming target noun in both local and non-local dialect mode, and furthermore, if they correctly could adjust their expectations based on dialect mode. The results showed that the Sogn speakers could predict upcoming linguistic material both in the local and Oslo dialect, but only the stable group were able to adjust their predictions based on the dialect mode. The unstable group applied a more general Oslo-compatible parsing to both the local and the non-local dialect. The Oslo speakers on the other hand were able to use gender markers as predictors only in their own dialect. We argue that the stable Sogn group should be treated as a bilingual group, as they show native-like skills in both varieties, while the unstable Sogn group can be seen as accommodated monolinguals, in that they treat the two varieties as sharing an underspecified grammar. The Oslo group on the other hand lacks sufficient competence in the other dialect to make use of grammatical markers to make predictions.

Gamma Oscillatory Activity Related to Language Prediction

Using magnetoencephalography, the current study examined gamma activity associated with language prediction. Participants read high- and low-constraining sentences in which the final word of the sentence was either expected or unexpected. Although no consistent gamma power difference induced by the sentence-final words was found between the expected and unexpected conditions, the correlation of gamma power during the prediction and activation intervals of the sentence-final words was larger when the presented words matched with the prediction compared with when the prediction was violated or when no prediction was available. This suggests that gamma magnitude relates to the match between predicted and perceived words. Moreover, the expected words induced activity with a slower gamma frequency compared with that induced by unexpected words. Overall, the current study establishes that prediction is related to gamma power correlations and a slowing of the gamma frequency.

Theta oscillations mediate pre-activation of highly expected word initial phonemes

Prediction has been proposed to be a fundamental neurocognitive mechanism. However, its role in language comprehension is currently under debate. In this magnetoencephalography study we aimed to find evidence of word-form phonological pre-activation and to characterize the oscillatory mechanisms supporting this. Participants were presented firstly with a picture of an object, and then, after a delay (fixed or variable), they heard the corresponding word. Target words could contain a phoneme substitution, and participants’ task was to detect mispronunciations. Word-initial phonemes were either fricatives or plosives, generating two experimental conditions (expect-fricative and expect-plosive). In the pre-word interval, significant differences (α = 0.05) emerged between conditions both for fixed and variable delays. Source reconstruction of this effect showed a brain-wide network involving several frequency bands, including bilateral superior temporal areas commonly associated with phonological processing, in a theta range. These results show that phonological representations supported by the theta band may be active before word onset, even under temporal uncertainty. However, in the evoked response just prior to the word, differences between conditions were apparent under variable- but not fixed-delays. This suggests that additional top-down mechanisms sensitive to phonological form may be recruited when there is uncertainty in the signal.

ERP indicators of L2 proficiency in word-to-text integration processes

Studies of bilingual proficiency have largely focused on word and sentence processing, whereas the text level has received relatively little attention. We examined on-line second language (L2) text comprehension in relation to L2 proficiency with ERPs recorded on critical words separated across a sentence boundary from their co-referential antecedents. The integration processes on the critical words were designed to reflect different levels of text representation: word-form, word-meaning, and situational level (Kintsch, 1998). Across proficiency level, bilinguals showed biphasic N400/late positive component (LPC) effects related to word meaning integration (N400) and mental model updating (LPC) processes. More proficient bilinguals, compared with less proficient bilinguals, showed reduced amplitudes in both N400 and LPC when the integration depended on semantic and conceptual meanings. When the integration was based on word repetitions and inferences, both groups showed reduced N400 negativity while elevated LPC positivity. These effects reflect how memory mechanisms (processes and resources) support the tight coupling among word meaning, readers' memory of the text meaning and the referentially-specified meaning of the text. They further demonstrate the importance of L2 semantic and conceptual processing in modulating the L2 proficiency effect on L2 text integration processes. These results align with the assumption that word meaning processes are causal components in variations of comprehension ability for both monolinguals and bilinguals.

Lexical Predictability During Natural Reading: Effects of Surprisal and Entropy Reduction

What are the effects of word-by-word predictability on sentence processing times during the natural reading of a text? Although information complexity metrics such as surprisal and entropy reduction have been useful in addressing this question, these metrics tend to be estimated using computational language models, which require some degree of commitment to a particular theory of language processing. Taking a different approach, this study implemented a large-scale cumulative cloze task to collect word-by-word predictability data for 40 passages and compute surprisal and entropy reduction values in a theory-neutral manner. A separate group of participants read the same texts while their eye movements were recorded. Results showed that increases in surprisal and entropy reduction were both associated with increases in reading times. Furthermore, these effects did not depend on the global difficulty of the text. The findings suggest that surprisal and entropy reduction independently contribute to variation in reading times, as these metrics seem to capture different aspects of lexical predictability.

Electrophysiological evidence for preserved primacy of lexical prediction in aging

Young adults show consistent neural benefits of predictable contexts when processing upcoming words, but these benefits are less clear-cut in older adults. Here we disentangle the neural correlates of prediction accuracy and contextual support during word processing, in order to test current theories that suggest that neural mechanisms underlying predictive processing are specifically impaired in older adults. During a sentence comprehension task, older and younger readers were asked to predict passage-final words and report the accuracy of these predictions. Age-related reductions were observed for N250 and N400 effects of prediction accuracy, as well as for N400 effects of contextual support independent of prediction accuracy. Furthermore, temporal primacy of predictive processing (i.e., earlier facilitation for successful predictions) was preserved across the lifespan, suggesting that predictive mechanisms are unlikely to be uniquely impaired in older adults. In addition, older adults showed prediction effects on frontal post-N400 positivities (PNPs) that were similar in amplitude to PNPs in young adults. Previous research has shown correlations between verbal fluency and lexical prediction in older adult readers, suggesting that the production system may be linked to capacity for lexical prediction, especially in aging. The current study suggests that verbal fluency modulates PNP effects of contextual support, but not prediction accuracy. Taken together, our findings suggest that aging does not result in specific declines in lexical prediction.

Musical rhythm and reading development: does beat processing matter?

There is mounting evidence for links between musical rhythm processing and reading-related cognitive skills, such as phonological awareness. This may be because music and speech are rhythmic: both involve processing complex sound sequences with systematic patterns of timing, accent, and grouping. Yet, there is a salient difference between musical and speech rhythm: musical rhythm is often beat-based (based on an underlying grid of equal time intervals), while speech rhythm is not. Thus, the role of beat-based processing in the reading-rhythm relationship is not clear. Is there is a distinct relation between beat-based processing mechanisms and reading-related language skills, or is the rhythm-reading link entirely due to shared mechanisms for processing nonbeat-based aspects of temporal structure? We discuss recent evidence for a distinct link between beat-based processing and early reading abilities in young children, and suggest experimental designs that would allow one to further methodically investigate this relationship. We propose that beat-based processing taps into a listener's ability to use rich contextual regularities to form predictions, a skill important for reading development.

Neural encoding and production of functional morphemes in the posterior temporal lobe

Morphemes are the smallest meaning-carrying units in human language, and are among the most basic building blocks through which humans express specific ideas and concepts. By using time-resolved cortical stimulations, neural recordings, and focal lesion evaluations, we show that inhibition of a small cortical area within the left dominant posterior–superior temporal lobe selectively impairs the ability to produce appropriate functional morphemes but does not distinctly affect semantic and lexical retrieval, comprehension, or articulation. Additionally, neural recordings within this area reveal the localized encoding of morphological properties and their planned production prior to speech onset. Finally, small lesions localized to the gray matter in this area result in a selective functional morpheme-production deficit. Collectively, these findings reveal a detailed division of linguistic labor within the posterior–superior temporal lobe and suggest that functional morpheme processing constitutes an operationally discrete step in the series of computations essential to language production.

Functional morphemes allow us to express details about objects, events, and their relationships. Here, authors show that inhibiting a small cortical area within left posterior superior temporal lobe selectively impairs the ability to produce functional morphemes but does not impair other linguistic abilities.

1/f neural noise and electrophysiological indices of contextual prediction in aging

Prediction of upcoming words during reading has been suggested to enhance the efficiency of discourse processing. Emerging models have postulated that predictive mechanisms require synchronous firing of neural networks, but to date, this relationship has been investigated primarily through oscillatory activity in narrow frequency bands. A recently-developed measure proposed to reflect broadband neural activity - and thereby synchronous neuronal firing - is 1/f neural noise extracted from EEG spectral power. Previous research has indicated that this measure of 1/f neural noise changes across the lifespan, and these neural changes predict age-related behavioral impairments in visual working memory. Using a cross-sectional sample of young and older adults, we examined age-related changes in 1/f neural noise and whether this measure predicted ERP correlates of successful lexical prediction during discourse comprehension. 1/f neural noise across two different language tasks revealed high within-subject correlations, indicating that this measure can provide a reliable index of individualized patterns of neural activation. In addition to age, 1/f noise was a significant predictor of N400 effects of successful lexical prediction; however, noise did not mediate age-related declines in other ERP effects. We discuss broader implications of these findings for theories of predictive processing, as well as potential applications of 1/f noise across research populations.

The Temporal Prediction of Stress in Speech and Its Relation to Musical Beat Perception

While rhythmic expectancies are thought to be at the base of beat perception in music, the extent to which stress patterns in speech are similarly represented and predicted during on-line language comprehension is debated. The temporal prediction of stress may be advantageous to speech processing, as stress patterns aid segmentation and mark new information in utterances. However, while linguistic stress patterns may be organized into hierarchical metrical structures similarly to musical meter, they do not typically present the same degree of periodicity. We review the theoretical background for the idea that stress patterns are predicted and address the following questions: First, what is the evidence that listeners can predict the temporal location of stress based on preceding rhythm? If they can, is it thanks to neural entrainment mechanisms similar to those utilized for musical beat perception? And lastly, what linguistic factors other than rhythm may account for the prediction of stress in natural speech? We conclude that while expectancies based on the periodic presentation of stresses are at play in some of the current literature, other processes are likely to affect the prediction of stress in more naturalistic, less isochronous speech. Specifically, aspects of prosody other than amplitude changes (e.g., intonation) as well as lexical, syntactic and information structural constraints on the realization of stress may all contribute to the probabilistic expectation of stress in speech.

Understanding environmental sounds in sentence context

There is debate about how individuals use context to successfully predict and recognize words. One view argues that context supports neural predictions that make use of the speech motor system, whereas other views argue for a sensory or conceptual level of prediction. While environmental sounds can convey clear referential meaning, they are not linguistic signals, and are thus neither produced with the vocal tract nor typically encountered in sentence context. We compared the effect of spoken sentence context on recognition and comprehension of spoken words versus nonspeech, environmental sounds. In Experiment 1, sentence context decreased the amount of signal needed for recognition of spoken words and environmental sounds in similar fashion. In Experiment 2, listeners judged sentence meaning in both high and low contextually constraining sentence frames, when the final word was present or replaced with a matching environmental sound. Results showed that sentence constraint affected decision time similarly for speech and nonspeech, such that high constraint sentences (i.e., frame plus completion) were processed faster than low constraint sentences for speech and nonspeech. Linguistic context facilitates the recognition and understanding of nonspeech sounds in much the same way as for spoken words. This argues against a simple form of a speech-motor explanation of predictive coding in spoken language understanding, and suggests support for conceptual-level predictions.

Prediction is Production: The missing link between language production and comprehension

Language comprehension often involves the generation of predictions. It has been hypothesized that such prediction-for-comprehension entails actual language production. Recent studies provided evidence that the production system is recruited during language comprehension, but the link between production and prediction during comprehension remains hypothetical. Here, we tested this hypothesis by comparing prediction during sentence comprehension (primary task) in participants having the production system either available or not (non-verbal versus verbal secondary task). In the primary task, sentences containing an expected or unexpected target noun-phrase were presented during electroencephalography recording. Prediction, measured as the magnitude of the N400 effect elicited by the article (expected versus unexpected), was hindered only when the production system was taxed during sentence context reading. The present study provides the first direct evidence that the availability of the speech production system is necessary for generating lexical prediction during sentence comprehension. Furthermore, these important results provide an explanation for the recruitment of language production during comprehension.

When Proactivity Fails: An Electrophysiological Study of Establishing Reference in Schizophrenia

BACKGROUND

Schizophrenia is characterized by abnormalities in referential communication, which may be linked to more general deficits in proactive cognitive control. We used event-related potentials to probe the timing and nature of the neural mechanisms engaged as people with schizophrenia linked pronouns to their preceding referents during word-by-word sentence comprehension.

METHODS

We measured event-related potentials to pronouns in two-clause sentences in 16 people with schizophrenia and 20 demographically matched control participants. Our design crossed the number of potential referents (1-referent, 2-referent) with whether the pronoun matched the gender of its preceding referent(s) (matching, mismatching). This gave rise to four conditions: 1) 1-referent matching ("Edward took courses in accounting but he . . ."); 2) 2-referent matching ("Edward and Phillip took courses but he . . . "); 3) 1-referent mismatching ("Edward took courses in accounting but she . . ."); and 4) 2-referent mismatching ("Edward and Phillip took courses but she . . .").

RESULTS

Consistent with previous findings, healthy control participants produced a larger left anteriorly distributed negativity between 400 and 600 ms to 2-referent matching than to 1-referent matching pronouns (the "Nref effect"). In contrast, people with schizophrenia produced a larger centroposterior positivity effect between 600 and 800 ms. Both patient and control groups produced a larger positivity between 400 and 800 ms to mismatching than to matching pronouns.

CONCLUSIONS

These findings suggest that proactive mechanisms of referential processing, reflected by the Nref effect, are impaired in schizophrenia, while reactive mechanisms, reflected by the positivity effects, are relatively spared. Indeed, patients may compensate for proactive deficits by retroactively engaging with context to influence the processing of inputs at a later stage of analysis.

Planning versus comprehension in turn-taking: Fast responders show reduced anticipatory processing of the question

Rapid response latencies in conversation suggest that responders start planning before the ongoing turn is finished. Indeed, an earlier EEG study suggests that listeners start planning their responses to questions as soon as they can (Bögels et al., 2015a). The present study aimed to (1) replicate this early planning effect and (2) investigate whether such early response planning incurs a cost on participants' concurrent comprehension of the ongoing turn. During the experiment participants answered questions from a confederate partner. To address aim (1), the questions were designed such that response planning could start either early or late in the turn. Our results largely replicate Bögels et al. (2015a), showing a large positive ERP effect and an oscillatory alpha/beta reduction right after participants could have first started planning their verbal response, again suggesting an early start of response planning. To address aim (2), the confederate's questions also contained either an expected word or an unexpected one to elicit a differential N400 effect, either before or after the start of response planning. We hypothesized an attenuated N400 effect after response planning had started. In contrast, the N400 effects before and after planning did not differ. There was, however, a positive correlation between participants' response time and their N400 effect size after planning had started; quick responders showed a smaller N400 effect, suggesting reduced attention to comprehension and possibly reduced anticipatory processing. We conclude that early response planning can indeed impact comprehension processing.

Communicative predictions can overrule linguistic priors

Predictions allow for efficient human communication. To be efficient, listeners’ predictions need to be adapted to the communicative context. Here we show that during speech processing this adaptation is a highly flexible and selective process that is able to fine-tune itself to individual language styles of specific interlocutors. In a newly developed paradigm, speakers differed in the probabilities by which they used particular sentence structures. Probe trials were applied to infer participants’ syntactic expectations for a given speaker and to track changes of these expectations over time. The results show that listeners fine-tune their linguistic expectations according to the individual language style of a speaker. Strikingly, nine months after the initial experiment these highly specific expectations could be rapidly reactivated when confronted with the particular language style of a speaker but not merely on the basis of an association with speaker identity per se. These findings highlight that communicative interaction fine-tunes and consolidates interlocutor specific communicative predictions which can overrule strong linguistic priors.