Predictability's aftermath: Downstream consequences of word predictability as revealed by repetition effects

Error-based Implicit Learning in Language: The Effect of Sentence Context and Constraint in a Repetition Paradigm

Prediction errors drive implicit learning in language, but the specific mechanisms underlying these effects remain debated. This issue was addressed in an EEG study manipulating the context of a repeated unpredictable word (repetition of the complete sentence or repetition of the word in a new sentence context) and sentence constraint. For the manipulation of sentence constraint, unexpected words were presented either in high-constraint (eliciting a precise prediction) or low-constraint sentences (not eliciting any specific prediction). Repetition-induced reduction of N400 amplitudes and of power in the alpha/beta frequency band was larger for words repeated with their sentence context as compared with words repeated in a new low-constraint context, suggesting that implicit learning happens not only at the level of individual items but additionally improves sentence-based predictions. These processing benefits for repeated sentences did not differ between constraint conditions, suggesting that sentence-based prediction update might be proportional to the amount of unpredicted semantic information, rather than to the precision of the prediction that was violated. In addition, the consequences of high-constraint prediction violations, as reflected in a frontal positivity and increased theta band power, were reduced with repetition. Overall, our findings suggest a powerful and specific adaptation mechanism that allows the language system to quickly adapt its predictions when unexpected semantic information is processed, irrespective of sentence constraint, and to reduce potential costs of strong predictions that were violated.

Delayed onset facilitates subsequent retrieval of words during language comprehension

Prior research has shown that during language comprehension, memory representations associated with premodified words (e.g., the injured and dangerous bear) are retrieved faster from memory than those associated with unmodified words (e.g., the bear). Current explanations attribute this effect to the semantic richness of modified words. However, it is not clear whether the presence of modifying words are in fact necessary for a retrieval benefit. Premodifiers necessarily delay the onset of the target word (i.e., bear), and temporal delays may heighten attention to upcoming stimuli, and/or strengthen encoding by producing free time during encoding, facilitating subsequent retrieval. We therefore examined whether a simple delay in the onset of the target can produce a retrieval benefit. Our results show that delayed onset facilitates the subsequent retrieval of target words in the absence of any modifying information. These results lend support to models of language comprehension according to which delays may enhance attention to upcoming words, and also to models of working memory based on which free time replenishes encoding resources, strengthening the memory trace of encoded information and facilitating its retrieval at a subsequent point. Our results also contribute to current memory-based theories of sentence comprehension by showing that retrieval from memory may be affected by nonlinguistic factors such as delay-induced attention enhancement, or free time during encoding.

Information entropy facilitates (not impedes) lexical processing during language comprehension

It is well known that contextual predictability facilitates word identification, but it is less clear whether the uncertainty associated with the current context (i.e., its lexical entropy) influences sentence processing. On the one hand, high entropy contexts may lead to interference due to greater number of lexical competitors. On the other hand, predicting multiple lexical competitors may facilitate processing through the preactivation of shared semantic features. In this study, we examined whether entropy measured at the trial level (i.e., for each participant, for each item) corresponds to facilitatory or inhibitory effects. Trial-level entropy captures each individual's knowledge about specific contexts and is therefore a more valid and sensitive measure of entropy (relative to the commonly employed item-level entropy). Participants (N = 112) completed two experimental sessions (with counterbalanced orders) that were separated by a 3- to 14-day interval. In one session, they produced up to 10 completions for sentence fragments (N = 647). In another session, they read the same sentences including a target word (whose entropy value was calculated based on the produced completions) while reading times were measured. We observed a facilitatory (not inhibitory) effect of trial-level entropy on lexical processing over and above item-level measures of lexical predictability (including cloze probability, surprisal, and semantic constraint). Extra analyses revealed that greater semantic overlap between the target and the produced responses facilitated target processing. Thus, the results lend support to theories of lexical prediction maintaining that prediction involves broad activation of semantic features rather than activation of full lexical forms.

It takes a village: A multi-brain approach to studying multigenerational family communication

Grandparents play a critical role in child rearing across the globe. Yet, there is a shortage of neurobiological research examining the relationship between grandparents and their grandchildren. We employ multi-brain neurocomputational models to simulate how changes in neurophysiological processes in both development and healthy aging affect multigenerational inter-brain coupling - a neural marker that has been linked to a range of socio-emotional and cognitive outcomes. The simulations suggest that grandparent-child interactions may be paired with higher inter-brain coupling than parent-child interactions, raising the possibility that the former may be more advantageous under certain conditions. Critically, this enhancement of inter-brain coupling for grandparent-child interactions is more pronounced in tri-generational interactions that also include a parent, which may speak to findings that grandparent involvement in childrearing is most beneficial if the parent is also an active household member. Together, these findings underscore that a better understanding of the neurobiological basis of cross-generational interactions is vital, and that such knowledge can be helpful in guiding interventions that consider the whole family. We advocate for a community neuroscience approach in developmental social neuroscience to capture the diversity of child-caregiver relationships in real-world settings.

Looking for immediate and downstream evidence of lexical prediction in eye movements during reading

Previous investigations of whether readers make predictions about the full identity of upcoming words have focused on the extent to which there are processing consequences when readers encounter linguistic input that is incompatible with their expectations. To date, eye-movement studies have revealed inconsistent evidence of the processing costs that would be expected to accompany lexical prediction. This study investigated whether readers' lexical predictions were observable during or downstream from their initial point of activation. Three experiments assessed readers' eye movements to predictable and unpredictable words, and then to subsequent downstream words, which probed the lingering activation of previously expected words. The results showed novel evidence of processing costs for unexpected input but only when supported by a plausible linguistic environment, suggesting that readers could strategically modulate their predictive processing. However, there was limited evidence that their lexical predictions affected downstream processing. The implications of these findings for understanding the role of prediction in language processing are discussed.

The Impact of Linguistic Prediction Violations on Downstream Recognition Memory and Sentence Recall

Predicting upcoming words during language comprehension not only affects processing in the moment but also has consequences for memory, although the source of these memory effects (e.g., whether driven by lingering pre-activations, re-analysis following prediction violations, or other mechanisms) remains underspecified. Here, we investigated downstream impacts of prediction on memory in two experiments. First, we recorded EEG as participants read strongly and weakly constraining sentences with expected, unexpected but plausible, or semantically anomalous endings ("He made a holster for his gun / father / train") and were tested on their recognition memory for the sentence endings. Participants showed similar rates of false alarms for predicted but never presented sentence endings whether the prediction violation was plausible or anomalous, suggesting that these arise from pre-activation of the expected words during reading. During sentence reading, especially in strongly constraining sentences, plausible prediction violations elicited an anterior positivity; anomalous endings instead elicited a posterior positivity, whose amplitude was predictive of later memory for those anomalous words. ERP patterns at the time of recognition differentiated plausible and anomalous sentence endings: Words that had been plausible prediction violations elicited enhanced late positive complex amplitudes, suggesting greater episodic recollection, whereas anomalous sentence endings elicited greater N1 amplitudes, suggesting attentional tagging. In a follow-up behavioral study, a separate group of participants read the same sentence stimuli and were tested for sentence-level recall. We found that recall of full sentences was impaired when sentences ended with a prediction violation. Taken together, the results suggest that prediction violations draw attention and affect encoding of the violating word, in a manner that depends on plausibility, and that this, in turn, may impair future memory of the gist of the sentence.

Combining EEG and 3D-eye-tracking to study the prediction of upcoming speech in naturalistic virtual environments: A proof of principle

EEG and eye-tracking provide complementary information when investigating language comprehension. Evidence that speech processing may be facilitated by speech prediction comes from the observation that a listener's eye gaze moves towards a referent before it is mentioned if the remainder of the spoken sentence is predictable. However, changes to the trajectory of anticipatory fixations could result from a change in prediction or an attention shift. Conversely, N400 amplitudes and concurrent spectral power provide information about the ease of word processing the moment the word is perceived. In a proof-of-principle investigation, we combined EEG and eye-tracking to study linguistic prediction in naturalistic, virtual environments. We observed increased processing, reflected in theta band power, either during verb processing - when the verb was predictive of the noun - or during noun processing - when the verb was not predictive of the noun. Alpha power was higher in response to the predictive verb and unpredictable nouns. We replicated typical effects of noun congruence but not predictability on the N400 in response to the noun. Thus, the rich visual context that accompanied speech in virtual reality influenced language processing compared to previous reports, where the visual context may have facilitated processing of unpredictable nouns. Finally, anticipatory fixations were predictive of spectral power during noun processing and the length of time fixating the target could be predicted by spectral power at verb onset, conditional on the object having been fixated. Overall, we show that combining EEG and eye-tracking provides a promising new method to answer novel research questions about the prediction of upcoming linguistic input, for example, regarding the role of extralinguistic cues in prediction during language comprehension.

Prediction during language comprehension: what is next?

Prediction is often regarded as an integral aspect of incremental language comprehension, but little is known about the cognitive architectures and mechanisms that support it. We review studies showing that listeners and readers use all manner of contextual information to generate multifaceted predictions about upcoming input. The nature of these predictions may vary between individuals owing to differences in language experience, among other factors. We then turn to unresolved questions which may guide the search for the underlying mechanisms. (i) Is prediction essential to language processing or an optional strategy? (ii) Are predictions generated from within the language system or by domain-general processes? (iii) What is the relationship between prediction and memory? (iv) Does prediction in comprehension require simulation via the production system? We discuss promising directions for making progress in answering these questions and for developing a mechanistic understanding of prediction in language.

Read carefully, because this is important! How value-driven strategies impact sentence memory

Little is understood about how people strategically process and remember important but complex information, such as sentences. In the current study, we asked whether people can effectively prioritize memory for sentences as a function of their relative importance (operationalized as a reward point value) and whether they do so, in part, by changing their sentence processing strategies when value information is available in advance. We adapted the value-directed remembering paradigm (Castel, Psychol Learn Motiv 48:225-270, 2007) for sentences that varied in constraint and predictability. Each sentence was associated with a high or low value for subsequent free recall (whole sentence) and recognition (sentence-final words) tests. Value information appeared after or before each sentence as a between-subject manipulation. Regardless of condition, we observed that high-value sentences were recalled more often than low-value sentences, showing that people can strategically prioritize their encoding of sentences. However, memory patterns differed depending on when value information was available. Recall for high-value sentences that ended unexpectedly (and therefore violated one's predictions) was reduced in the Before compared to the After condition. Before condition participants also showed a greater tendency to false alarm to lures (words that were the predicted - but not obtained - ending) from strongly constraining sentences. These observations suggest that when people try to prioritize sentence-level information that they know is valuable, the reading strategies they employ may paradoxically lead to worse memory.

Between alpha and gamma oscillations: Neural signatures of linguistic predictions and listener's attention to speaker's communication intention

When listeners hear a message produced by their interlocutor, they can predict upcoming words thanks to the sentential context and their attention can be focused on the speaker's communication intention. In two electroencephalographical (EEG) studies, we investigated the oscillatory correlates of prediction in spoken-language comprehension and how they are modulated by the listener's attention. Sentential contexts which were strongly predictive of a particular word were ended by a possessive adjective either matching the gender of the predicted word or not. Alpha, beta and gamma oscillations were studied as they were considered to play a crucial role in the predictive process. While evidence of word prediction was related to alpha fluctuations when listeners focused their attention on sentence meaning, changes in high-gamma oscillations were triggered by word prediction when listeners focused their attention on the speaker's communication intention. Independently of the endogenous attention to a level of linguistic information, the oscillatory correlates of word predictions in language comprehension were sensitive to the prosodic emphasis produced by the speaker at a late stage. These findings thus bear major implications for understanding the neural mechanisms that support predictive processing in spoken-language comprehension.

Readers scrutinize lexical familiarity only in the absence of expectations: Evidence from lexicality effects on event-related potentials

Readers generate predictions about the meaning of upcoming words while reading constraining sentences. These predictions feed down to predictions about orthographic form. For example, orthographic neighbors of predicted words yield reduced N400 amplitudes compared to non-neighbors regardless of lexical status (Laszlo & Federmeier, 2009). We investigated whether readers are sensitive to lexicality in low constraint sentences when they must scrutinize the perceptual input more closely for word recognition. In a replication and extension of Laszlo and Federmeier (2009), we observed similar patterns as the original study in high constraint sentences, but found a lexicality effect in low constraint sentences that was not present when the sentence was highly constraining. This suggests that, in the absence of strong expectations, readers adopt a different reading strategy to scrutinize the structure of words more in depth to make sense of what they have read compared to when they encounter a supportive sentence context.

Event-related potentials show that parafoveal vision is insufficient for semantic integration

Readers extract information from a word from parafoveal vision prior to looking at it. It has been argued that parafoveal perception allows readers to initiate linguistic processes, but it is unclear which stages of word processing are engaged: the process of extracting letter information to recognize words, or the process of extracting meaning to comprehend them. This study used the event-related brain potential (ERP) technique to investigate how word recognition (indexed by the N400 effect for unexpected or anomalous compared to expected words) and semantic integration (indexed by the Late-positive component; LPC effect for anomalous compared to expected words) are or are not elicited when the word is perceived only in parafoveal vision. Participants read a target word following a sentence that made it expected, unexpected, or anomalous, and read the sentences presented three words at a time in the Rapid Serial Visual Presentation (RSVP) with flankers paradigm so that words were perceived in parafoveal and foveal vision. We orthogonally manipulated whether the target word was masked in parafoveal and/or foveal vision to dissociate the processing associated with perception of the target word from either location. We found that the N400 effect was generated from parafoveally perceived words, and was reduced for foveally perceived words if they were previously perceived parafoveally. In contrast, the LPC effect was only elicited if the word was perceived foveally, suggesting that readers must attend to a word directly in foveal vision in order to attempt to integrate its meaning into the sentence context.

Parafoveal preview benefit in a conflicting sentential context: Evidence from ERPs

In natural reading, the reader's processing of a word starts when the word is located in parafoveal vision. Relative to a situation with an invalid preview, fixations are significantly shorter after a fully valid, identical preview. Although research on the identity preview benefit has been ongoing for more than 40 years, the mechanism of this preview benefit, the level of lexical processing it occurs, and its relationship to the sentential context remain unclear. This study employed EEG brain component analysis technology to address these questions in Chinese sentence reading. We manipulated the sentential context to make the target word plausible or not plausible with the sentence and manipulated the target word present or not present in preview. EEG results showed that the identity preview benefit can affect not only the early preview positivity, reflecting the early orthographic processing of words, but also the N400 and LPC components, reflecting the late and in-depth semantic processing of words. Conflicting sentential context, in which the target word is implausible and cannot be integrated into the sentence, can interfere temporarily with these processes. These findings suggest that in the process of sentence reading, an identical preview word can promote the subsequent reading process at multiple levels, and its role is modulated by contextual information.

Benefits and costs of predictive processing: How sentential constraint and word expectedness affect memory formation

This study investigated how the strength of schema support provided by strongly (SC) and weakly constraining (WC) sentences affects the encoding of expected and unexpected words, and how this is reflected in event-related potentials (ERPs). In a surprise recognition memory test, words studied on the previous day were presented together with new words and lures that were expected but not presented in the study phase. ERPs recorded in the study phase were compared for subsequently remembered and forgotten words. Better memory performance for expected over unexpected words was electrophysiologically supported by a parietal subsequent memory effect (SME) reflecting enhanced item-specific encoding of contextually expected words. SC sentences not only facilitated the semantic integration of sentence-ending words, as reflected in reduced N400 amplitudes, but also enabled the rapid successful encoding of these words into memory, which is evidenced by an SC > WC pattern in memory performance and correlations between pre- and post-stimulus SMEs for SC sentences. In contrast, words processed in WC sentence contexts necessitated sustained elaborative encoding processes as reflected in a late frontal slow wave SME. Expected but not presented words were associated with high rates of false positive memory decisions, indicating that these words remained in a state of high accessibility in memory even one day after the study phase. These mnemonic costs of predictive processing were more pronounced for expected words from SC sentences than from WC sentences and could reflect the lingering of strong semantic predictions which were associated with the pre-updating of sentence representations.

Age-related Changes in the Structure and Dynamics of the Semantic Network

Normal aging has variable effects on language comprehension, perhaps because comprehension mechanisms vary in their dependence on network structure versus network dynamics. To test claims that processing dynamics are more affected by age than structure, we used EEG to measure and compare the impact of neighborhood size, a core measure of the structure of the lexico-semantic network, and repetition, a simple measure of processing dynamics, on single word processing. Older adults showed robust effects of neighborhood size on the N400, comparable to those elicited by young adults, but reduced effects of repetition. Furthermore, older adults with greater verbal fluency, print exposure, and reading comprehension showed greater repetition effects, suggesting some older adults can maintain processing dynamics that are similar to those of young adults. Thus, the organizational structure of the semantic network seems stable across normal aging, but (some) older adults may struggle to adjust activation states within that network.

Connecting and considering: Electrophysiology provides insights into comprehension

The ability to rapidly and systematically access knowledge stored in long-term memory in response to incoming sensory information-that is, to derive meaning from the world-lies at the core of human cognition. Research using methods that can precisely track brain activity over time has begun to reveal the multiple cognitive and neural mechanisms that make this possible. In this article, I delineate how a process of connecting affords an effortless, continuous infusion of meaning into human perception. In a relatively invariant time window, uncovered through studies using the N400 component of the event-related potential, incoming sensory information naturally induces a graded landscape of activation across long-term semantic memory, creating what might be called "proto-concepts". Connecting can be (but is not always) followed by a process of further considering those activations, wherein a set of more attentionally demanding "active comprehension" mechanisms mediate the selection, augmentation, and transformation of the initial semantic representations. The result is a limited set of more stable bindings that can be arranged in time or space, revised as needed, and brought to awareness. With this research, we are coming closer to understanding how the human brain is able to fluidly link sensation to experience, to appreciate language sequences and event structures, and, sometimes, to even predict what might be coming up next.

The N400 ERP component reflects an error-based implicit learning signal during language comprehension

The functional significance of the N400 evoked-response component is still actively debated. An increasing amount of theoretical and computational modelling work is built on the interpretation of the N400 as a prediction error. In neural network modelling work, it was proposed that the N400 component can be interpreted as the change in a probabilistic representation of meaning that drives the continuous adaptation of an internal model of the statistics of the environment. These results imply that increased N400 amplitudes should correspond to greater adaptation, which can be measured via implicit memory. To investigate this model derived hypothesis, the current study manipulated expectancy in a sentence reading task to influence N400 amplitudes and subsequently presented the previously expected vs. unexpected words in a perceptual identification task to measure implicit memory. As predicted, reaction times in the perceptual identification task were significantly faster for previously unexpected words that induced larger N400 amplitudes in the previous sentence reading task. Additionally, it could be demonstrated that this adaptation seems to specifically depend on the process underlying N400 amplitudes, as participants with larger N400 differences during sentence reading also exhibited a larger implicit memory benefit in the perceptual identification task. These findings support the interpretation of the N400 as an implicit learning signal driving adaptation in language processing.

Intelligibility and recall of sentences spoken by adult and child talkers wearing face masks

With the Covid-19 pandemic, face masks have become part of our daily lives. While face masks are effective in slowing down the spread of the virus, they also make face-to-face communication more challenging. The present study sought to examine the impact of face masks on listeners' intelligibility and recall of sentences produced by one German native adult and one child talker. In the intelligibility task, German native adult listeners watched video clips of either an adult or a child talker producing sentences with and without a face mask. In a cued-recall experiment, another group of German native listeners watched the same video clips and then completed a cued-recall task. The results showed that face masks significantly affected listeners' intelligibility and recall performance, and this effect was equally true for both talkers. The findings here contribute to the fast growing and urgent research regarding the impact of face masks on communication.

Dividing attention influences contextual facilitation and revision during language comprehension

Although we often seem to successfully comprehend language in the face of distraction, few studies have examined the role of sustained attention in critical components of sentence processing, such as integrating information over a sentence and revising predictions when unexpected information is encountered. The current study investigated the impact of attention on sentence processing using a novel dual-task paradigm. Participants read weakly and strongly constraining sentences with expected or unexpected endings while also tracking the motion of dots in the background, and their EEG was recorded. Under full attention, the amplitude of the N400 component of the ERP, a measure of semantic access, was reduced (facilitated) in a graded fashion by contextual strength and fit. This context-based facilitation was attenuated when attention was divided, suggesting that sustained attention is important for building up message-level representations. In contrast, the post-N400 frontal positivity that has been observed to prediction violations and associated with revision processes was unaffected by dividing attention. However, under divided attention, participants also elicited posteriorly-distributed effects to these violations. Thus, predictive processes seem to be engaged even when attention is divided, but additional resources may then be required to process unexpected information.

Representational Pattern Similarity of Electrical Brain Activity Reveals Rapid and Specific Prediction during Language Comprehension

Predicting upcoming events is a critical function of the brain, and language provides a fertile testing ground for studying prediction, as comprehenders use context to predict features of upcoming words. Many aspects of the mechanisms of prediction remain elusive, partly due to a lack of methodological tools to probe prediction formation in the moment. To elucidate what features are neurally preactivated and when, we used representational similarity analysis on previously collected sentence reading data. We compared EEG activity patterns elicited by expected and unexpected sentence final words to patterns from the preceding words of the sentence, in both strongly and weakly constraining sentences. Pattern similarity with the final word was increased in an early time window following the presentation of the pre-final word, and this increase was modulated by both expectancy and constraint. This was not seen at earlier words, suggesting that predictions were precisely timed. Additionally, pre-final word activity-the predicted representation-had negative similarity with later final word activity, but only for strongly expected words. These findings shed light on the mechanisms of prediction in the brain: rapid preactivation occurs following certain cues, but the predicted features may receive reduced processing upon confirmation.

The costs (and benefits) of effortful listening on context processing: A simultaneous electrophysiology, pupillometry, and behavioral study

There is an apparent disparity between the fields of cognitive audiology and cognitive electrophysiology as to how linguistic context is used when listening to perceptually challenging speech. To gain a clearer picture of how listening effort impacts context use, we conducted a pre-registered study to simultaneously examine electrophysiological, pupillometric, and behavioral responses when listening to sentences varying in contextual constraint and acoustic challenge in the same sample. Participants (N = 44) listened to sentences that were highly constraining and completed with expected or unexpected sentence-final words ("The prisoners were planning their escape/party") or were low-constraint sentences with unexpected sentence-final words ("All day she thought about the party"). Sentences were presented either in quiet or with +3 dB SNR background noise. Pupillometry and EEG were simultaneously recorded and subsequent sentence recognition and word recall were measured. While the N400 expectancy effect was diminished by noise, suggesting impaired real-time context use, we simultaneously observed a beneficial effect of constraint on subsequent recognition memory for degraded speech. Importantly, analyses of trial-to-trial coupling between pupil dilation and N400 amplitude showed that when participants' showed increased listening effort (i.e., greater pupil dilation), there was a subsequent recovery of the N400 effect, but at the same time, higher effort was related to poorer subsequent sentence recognition and word recall. Collectively, these findings suggest divergent effects of acoustic challenge and listening effort on context use: while noise impairs the rapid use of context to facilitate lexical semantic processing in general, this negative effect is attenuated when listeners show increased effort in response to noise. However, this effort-induced reliance on context for online word processing comes at the cost of poorer subsequent memory.

The fate of the unexpected: Consequences of misprediction assessed using ERP repetition effects

Amid increasing interest in the role of prediction in language comprehension, there remains a gap in our understanding of what happens when predictions are disconfirmed. Are unexpected words harder to process and encode because of interference from the original prediction? Or, because of their relevance for learning, do expectation violations strengthen the representations of unexpected words? In two experiments, we used event-related potentials to probe the downstream consequences of prediction violations. Critical words were unexpected but plausible completions of either strongly constraining sentences, wherein they constituted a prediction violation, or weakly constraining sentences that did not afford a clear prediction. Three sentences later the critical word was repeated at the end of a different, weakly constraining sentence. In Experiment 1, repeated words elicited a reduced N400 and an enhanced late positive complex (LPC) compared to words seen for the first time. Critically, there was no effect of initial sentence constraint on the size of the repetition effect in either time window. Thus, prediction violations did not accrue either costs or benefits for later processing. Experiment 2 used the same critical items and added strongly constraining filler sentences with expected endings to further promote prediction. Again, there was no effect of initial sentence constraint on either the N400 or the LPC to repeated critical words. When taken with prior findings, the results suggest that prediction is both powerful and flexible: It can facilitate processing of predictable information by reducing encoding effort without causing processing difficulties for unexpected inputs.

The impact of face masks on the recall of spoken sentences

The effect of face covering masks on listeners' recall of spoken sentences was investigated. Thirty-two German native listeners watched video recordings of a native speaker producing German sentences with and without a face mask, and then completed a cued-recall task. Listeners recalled significantly fewer words when the sentences had been spoken with a face mask. This might suggest that face masks increase processing demands, which in turn leaves fewer resources for encoding speech in memory. The result is also informative for policy-makers during the COVID-19 pandemic, regarding the impact of face masks on oral communication.

Examining the Role of General Cognitive Skills in Language Processing: A Window into Complex Cognition

Whenever we use language to communicate, sounds, signs, and/or letters are combined into words that, in turn, form sentences, which together tell a story. Both language production and language comprehension rely on representations at different levels of granularity that need to be continuously and rapidly activated, selected, and combined. The representations themselves are specific to language, but many processes that regulate their use, such as inhibition of competitors or updating of working memory with new information, are so-called domain-general abilities that apply across different kinds of tasks. Here, we provide an overview of the behavioral and neurophysiological evidence in favor of domain-general abilities underpinning language skills and describe which particular aspects of production and comprehension draw upon such cognitive resources. We discuss how this line of research not only reveals important similarities between production and comprehension but also helps to establish links between language and other cognitive domains. Finally, we argue that studying how domain-general abilities are used in language will lead to important insights into the highly dynamic and efficient communication between brain networks that is necessary to successfully go from sounds to stories.

To catch a Snitch: Brain potentials reveal variability in the functional organization of (fictional) world knowledge during reading

We harnessed the temporal sensitivity of event-related brain potentials (ERPs) alongside individual differences in Harry Potter (HP) knowledge to investigate the extent to which the availability and timing of information relevant for real-time written word processing are influenced by variation in domain knowledge. We manipulated meaningful (category, event) relationships between sentence fragments about HP stories and their sentence final words. During word-by-word reading, N400 amplitudes to (a) linguistically supported and (b) unsupported but meaningfully related, but not to (c) unsupported, unrelated sentence endings varied with HP domain knowledge. Single-trial analyses revealed that only the N400s to linguistically supported (but not to either type of unsupported) sentence-final words varied as a function of whether individuals knew (or could remember) the correct (supported) ending for each HP "fact." We conclude that the quick availability of information relevant for word understanding in sentences is a function of individuals' knowledge of both specific facts and the domain to which the facts belong. During written sentence processing, as domain knowledge increases, it is clearly evident that individuals can make use of the relevant knowledge systematically organized around themes, events, and categories in that domain, to the extent they have it.

Predictability Changes What We Remember in Familiar Temporal Contexts

The human brain constantly anticipates the future based on memories of the past. Encountering a familiar situation reactivates memory of previous encounters, which can trigger a prediction of what comes next to facilitate responsiveness. However, a prediction error can lead to pruning of the offending memory, a process that weakens its representation in the brain and leads to forgetting. Our goal in this study was to evaluate whether memories are spared from such pruning in situations that allow for accurate predictions at the categorical level, despite prediction errors at the item level. Participants viewed a sequence of objects, some of which reappeared multiple times ("cues"), followed always by novel items. Half of the cues were followed by new items from different (unpredictable) categories, while others were followed by new items from a single (predictable) category. Pattern classification of fMRI data was used to identify category-specific predictions after each cue. Pruning was observed only in unpredictable contexts, while encoding of new items was less robust in predictable contexts. These findings demonstrate that how associative memories are updated is influenced by the reliability of abstract-level predictions in familiar contexts.

THE POWER OF NEURAL OSCILLATIONS TO INFORM SENTENCE COMPREHENSION: A LINGUISTIC PERSPECTIVE

The field of psycholinguistics is currently experiencing an explosion of interest in the analysis of neural oscillations - rhythmic brain activity synchronized at different temporal and spatial levels. Given that language comprehension relies on a myriad of processes, which are carried out in parallel in distributed brain networks, there is hope that this methodology might bring the field closer to understanding some of the more basic (spatially and temporally distributed, yet at the same time often overlapping) neural computations that support language function. In this review we discuss existing proposals linking oscillatory dynamics in different frequency bands to basic neural computations, and review relevant theories suggesting associations between band-specific oscillations and higher-level cognitive processes. More or less consistent patterns of oscillatory activity related to certain types of linguistic processing can already be derived from the evidence that has accumulated over the past few decades. The centerpiece of the current review is a synthesis of such patterns grouped by linguistic phenomenon. We restrict our review to evidence linking measures of oscillatory power to the comprehension of sentences, as well as linguistically (and/or pragmatically) more complex structures. For each grouping, we provide a brief summary and a table of associated oscillatory signatures that a psycholinguist might expect to find when employing a particular linguistic task. Summarizing across different paradigms, we conclude that a handful of basic neural oscillatory mechanisms are likely recruited in different ways and at different times for carrying out a variety of linguistic computations.

Downstream Behavioral and Electrophysiological Consequences of Word Prediction on Recognition Memory

When people process language, they can use context to predict upcoming information, influencing processing and comprehension as seen in both behavioral and neural measures. Although numerous studies have shown immediate facilitative effects of confirmed predictions, the downstream consequences of prediction have been less explored. In the current study, we examined those consequences by probing participants' recognition memory for words after they read sets of sentences. Participants read strongly and weakly constraining sentences with expected or unexpected endings ("I added my name to the list/basket"), and later were tested on their memory for the sentence endings while EEG was recorded. Critically, the memory test contained words that were predictable ("list") but were never read (participants saw "basket"). Behaviorally, participants showed successful discrimination between old and new items, but false alarmed to the expected-item lures more often than to new items, showing that predicted words or concepts can linger, even when predictions are disconfirmed. Although false alarm rates did not differ by constraint, event-related potentials (ERPs) differed between false alarms to strongly and weakly predictable words. Additionally, previously unexpected (compared to previously expected) endings that appeared on the memory test elicited larger N1 and LPC amplitudes, suggesting greater attention and episodic recollection. In contrast, highly predictable sentence endings that had been read elicited reduced LPC amplitudes during the memory test. Thus, prediction can facilitate processing in the moment, but can also lead to false memory and reduced recollection for predictable information.

Lingering expectations: A pseudo-repetition effect for words previously expected but not presented

Prediction can help support rapid language processing. However, it is unclear whether prediction has downstream consequences, beyond processing in the moment. In particular, when a prediction is disconfirmed, does it linger, or is it suppressed? This study manipulated whether words were actually seen or were only expected, and probed their fate in memory by presenting the words (again) a few sentences later. If disconfirmed predictions linger, subsequent processing of the previously expected (but never presented) word should be similar to actual word repetition. At initial presentation, electrophysiological signatures of prediction disconfirmation demonstrated that participants had formed expectations. Further downstream, relative to unseen words, repeated words elicited a strong N400 decrease, an enhanced late positive complex (LPC), and late alpha band power decreases. Critically, like repeated words, words previously expected but not presented also attenuated the N400. This "pseudo-repetition effect" suggests that disconfirmed predictions can linger at some stages of processing, and demonstrates that prediction has downstream consequences beyond rapid on-line processing.