The N400 ERP component reflects an error-based implicit learning signal during language comprehension

How predictability and individual alpha frequency shape memory: Insights from an event-related potential investigation

Prediction and memory are strongly intertwined, with predictions relying on memory retrieval, whilst also influencing memory encoding. However, it is unclear how predictability influences explicit memory performance, and how individual neural factors may modulate this relationship. The current study sought to investigate the effect of predictability on memory processing with an analysis of the N400 event-related potential in a context extending beyond language. Participants (N = 48, females = 33) completed a study-test paradigm where they first viewed predictable and unpredictable four-item 'ABCD' sequences of outdoor scene images, whilst their brain activity was recorded using electroencephalography. Subsequently, their memory for the images was tested, and N400 patterns during learning were compared with memory outcomes. Behavioural results revealed better memory for images in predictable sequences in contrast to unpredictable sequences. Memory was also strongest for predictable images in the 'B' position, suggesting that when processing longer sequences, the brain may prioritise the data deemed most informative. Strikingly, greater N400 amplitudes during learning were associated with enhanced memory at test for individuals with low versus high individual alpha frequencies. In light of the relationship between the N400 and stimulus predictability, this finding may imply that predictive processing differs between individuals to influence the extent of memory encoding. Finally, exploratory analyses provided evidence for a later positivity that was predictive of subsequent memory performance. Ultimately, the results highlight the complex and interconnected relationship between predictive processing and memory, whilst shedding light on the accumulation of predictions across longer sequences.

The unique contribution of uncertainty reduction during naturalistic language comprehension

Language comprehension is an incremental process with prediction. Delineating various mental states during such a process is critical to understanding the relationship between human cognition and the properties of language. Entropy reduction, which indicates the dynamic decrease of uncertainty as language input unfolds, has been recognized as effective in predicting neural responses during comprehension. According to the entropy reduction hypothesis (Hale, 2006), entropy reduction is related to the processing difficulty of a word, the effect of which may overlap with other well-documented information-theoretical metrics such as surprisal or next-word entropy. However, the processing difficulty was often confused with the information conveyed by a word, especially lacking neural differentiation. We propose that entropy reduction represents the cognitive neural process of information gain that can be dissociated from processing difficulty. This study characterized various information-theoretical metrics using GPT-2 and identified the unique effects of entropy reduction in predicting fMRI time series acquired during language comprehension. In addition to the effects of surprisal and entropy, entropy reduction was associated with activations in the left inferior frontal gyrus, bilateral ventromedial prefrontal cortex, insula, thalamus, basal ganglia, and middle cingulate cortex. The reduction of uncertainty, rather than its fluctuation, proved to be an effective factor in modeling neural responses. The neural substrates underlying the reduction in uncertainty might imply the brain's desire for information regardless of processing difficulty.

Delayed predictive inference integration with and revision by low-competitive inference alternatives in Chinese narrative text reading

When readers encounter information conflicting with the predictive inferences made earlier, they may update the outdated ones with new ones, a process known as predictive inference revision. The current study examined the revision of disconfirmed predictive inferences by the primarily weakly activated, thus low-competitive inference alternatives during Chinese narrative text reading among Chinese native speakers. We conducted an event-related brain potential (ERP) experiment to study the predictive inference revision with increasingly supportive information for the low-competitive predictive inference alternatives. It serves as the very first attempts to study the predictive inference revision mechanisms by combining a larger range of ERP components, including frontal-Post-N400-Positivity (f-PNP) as an index of revision to examine the influences of the alternative inferences at later stages of reading comprehension. Our results showed that readers could detect inconsistent information (P300), disconfirm the incorrect predictive inferences before successfully integrating the low-competitive alternative predictive inferences with their current situation model (N400), engaging themselves in a second-pass reanalysis process incurring processing costs (P600), and revising the disconfirmed predictive inferences (f-PNP) at a later stage of reading comprehension. Results of this study are supportive of relevant theories in assuming that predictive inference revision does not happen immediately upon encountering conflicting information but happens slowly and incrementally. Our results also unfold the post-revision mechanisms by suggesting the remaining activation and lingering influences of the disconfirmed inferences in the forthcoming reading process.

Prior Context and Individual Alpha Frequency Influence Predictive Processing during Language Comprehension

The extent to which the brain predicts upcoming information during language processing remains controversial. To shed light on this debate, the present study reanalyzed Nieuwland and colleagues' (2018) [Nieuwland, M. S., Politzer-Ahles, S., Heyselaar, E., Segaert, K., Darley, E., Kazanina, N., et al. Large-scale replication study reveals a limit on probabilistic prediction in language comprehension. eLife, 7, e33468, 2018] replication of DeLong and colleagues (2015) [DeLong, K. A., Urbach, T. P., & Kutas, M. Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nature Neuroscience, 8, 1117-1121, 2005]. Participants (n = 356) viewed sentences containing articles and nouns of varying predictability, while their EEG was recorded. We measured ERPs preceding the critical words (namely, the semantic prediction potential), in conjunction with postword N400 patterns and individual neural metrics. ERP activity was compared with two measures of word predictability: cloze probability and lexical surprisal. In contrast to prior literature, semantic prediction potential amplitudes did not increase as cloze probability increased, suggesting that the component may not reflect prediction during natural language processing. Initial N400 results at the article provided evidence against phonological prediction in language, in line with Nieuwland and colleagues' findings. Strikingly, however, when the surprisal of the prior words in the sentence was included in the analysis, increases in article surprisal were associated with increased N400 amplitudes, consistent with prediction accounts. This relationship between surprisal and N400 amplitude was not observed when the surprisal of the two prior words was low, suggesting that expectation violations at the article may be overlooked under highly predictable conditions. Individual alpha frequency also modulated the relationship between article surprisal and the N400, emphasizing the importance of individual neural factors for prediction. The present study extends upon existing neurocognitive models of language and prediction more generally, by illuminating the flexible and subject-specific nature of predictive processing.

An Integrated theory of false insights and beliefs under psychedelics

Psychedelics are recognised for their potential to re-orient beliefs. We propose a model of how psychedelics can, in some cases, lead to false insights and thus false beliefs. We first review experimental work on laboratory-based false insights and false memories. We then connect this to insights and belief formation under psychedelics using the active inference framework. We propose that subjective and brain-based alterations caused by psychedelics increases the quantity and subjective intensity of insights and thence beliefs, including false ones. We offer directions for future research in minimising the risk of false and potentially harmful beliefs arising from psychedelics. Ultimately, knowing how psychedelics may facilitate false insights and beliefs is crucial if we are to optimally leverage their therapeutic potential.

Are the P600 and P3 ERP components linked to the task-evoked pupillary response as a correlate of norepinephrine activity?

During language comprehension, anomalies and ambiguities in the input typically elicit the P600 event-related potential component. Although traditionally interpreted as a specific signal of combinatorial operations in sentence processing, the component has alternatively been proposed to be a variant of the oddball-sensitive, domain-general P3 component. In particular, both components might reflect phasic norepinephrine release from the locus coeruleus (LC/NE) to motivationally significant stimuli. In this preregistered study, we tested this hypothesis by relating both components to the task-evoked pupillary response, a putative biomarker of LC/NE activity. 36 participants completed a sentence comprehension task (containing 25% morphosyntactic violations) and a non-linguistic oddball task (containing 20% oddballs), while the EEG and pupil size were co-registered. Our results showed that the task-evoked pupillary response and the ERP amplitudes of both components were similarly affected by both experimental tasks. In the oddball task, there was also a temporally specific relationship between the P3 and the pupillary response beyond the shared oddball effect, thereby further linking the P3 to NE. Because this link was less reliable in the linguistic context, we did not find conclusive evidence for or against a relationship between the P600 and the pupillary response. Still, our findings further stimulate the debate on whether language-related ERPs are indeed specific to linguistic processes or shared across cognitive domains. However, further research is required to verify a potential link between the two ERP positivities and the LC/NE system as the common neural generator.

Perceptual Expectations Are Reflected by Early Alpha Power Reduction

The predictability of a stimulus can be characterized by its transitional probability. Perceptual expectations derived from the transitional probability of the stimulus were found to modulate the early alpha oscillations in the sensory regions of the brain when neural responses to expected versus unexpected stimuli were compared. The objective of our study was to find out the extent to which this low-frequency oscillation reflects stimulus predictability. We aimed to detect the alpha-power difference with smaller differences in transitional probabilities by comparing expected stimuli with neutral ones. We studied the effect of expectation on perception by applying an unsupervised visual statistical learning paradigm with expected and neutral stimuli embedded in an image sequence while recording EEG. Time-frequency analysis showed that expected stimuli elicit lower alpha power in the window of 8-12 Hz and 0-400 msec after stimulus presentation, appearing in the centroparietal region. Comparing previous findings of expectancy-based alpha-band modulation with our results suggests that early alpha oscillation shows an inverse relationship with stimulus predictability. Although current data are insufficient to determine the origin of the alpha power reduction, this could be a potential sign of expectation suppression in cortical oscillatory activity.

Error-based Implicit Learning in Language: The Effect of Sentence Context and Constraint in a Repetition Paradigm

Prediction errors drive implicit learning in language, but the specific mechanisms underlying these effects remain debated. This issue was addressed in an EEG study manipulating the context of a repeated unpredictable word (repetition of the complete sentence or repetition of the word in a new sentence context) and sentence constraint. For the manipulation of sentence constraint, unexpected words were presented either in high-constraint (eliciting a precise prediction) or low-constraint sentences (not eliciting any specific prediction). Repetition-induced reduction of N400 amplitudes and of power in the alpha/beta frequency band was larger for words repeated with their sentence context as compared with words repeated in a new low-constraint context, suggesting that implicit learning happens not only at the level of individual items but additionally improves sentence-based predictions. These processing benefits for repeated sentences did not differ between constraint conditions, suggesting that sentence-based prediction update might be proportional to the amount of unpredicted semantic information, rather than to the precision of the prediction that was violated. In addition, the consequences of high-constraint prediction violations, as reflected in a frontal positivity and increased theta band power, were reduced with repetition. Overall, our findings suggest a powerful and specific adaptation mechanism that allows the language system to quickly adapt its predictions when unexpected semantic information is processed, irrespective of sentence constraint, and to reduce potential costs of strong predictions that were violated.

Strong Prediction: Language Model Surprisal Explains Multiple N400 Effects

Theoretical accounts of the N400 are divided as to whether the amplitude of the N400 response to a stimulus reflects the extent to which the stimulus was predicted, the extent to which the stimulus is semantically similar to its preceding context, or both. We use state-of-the-art machine learning tools to investigate which of these three accounts is best supported by the evidence. GPT-3, a neural language model trained to compute the conditional probability of any word based on the words that precede it, was used to operationalize contextual predictability. In particular, we used an information-theoretic construct known as surprisal (the negative logarithm of the conditional probability). Contextual semantic similarity was operationalized by using two high-quality co-occurrence-derived vector-based meaning representations for words: GloVe and fastText. The cosine between the vector representation of the sentence frame and final word was used to derive contextual cosine similarity estimates. A series of regression models were constructed, where these variables, along with cloze probability and plausibility ratings, were used to predict single trial N400 amplitudes recorded from healthy adults as they read sentences whose final word varied in its predictability, plausibility, and semantic relationship to the likeliest sentence completion. Statistical model comparison indicated GPT-3 surprisal provided the best account of N400 amplitude and suggested that apparently disparate N400 effects of expectancy, plausibility, and contextual semantic similarity can be reduced to variation in the predictability of words. The results are argued to support predictive coding in the human language network.

Revealing brain's cognitive process deeply: a study of the consistent EEG patterns of audio-visual perceptual holistic

Introduction

To investigate the brain's cognitive process and perceptual holistic, we have developed a novel method that focuses on the informational attributes of stimuli.

Methods

We recorded EEG signals during visual and auditory perceptual cognition experiments and conducted ERP analyses to observe specific positive and negative components occurring after 400ms during both visual and auditory perceptual processes. These ERP components represent the brain's perceptual holistic processing activities, which we have named Information-Related Potentials (IRPs). We combined IRPs with machine learning methods to decode cognitive processes in the brain.

Results

Our experimental results indicate that IRPs can better characterize information processing, particularly perceptual holism. Additionally, we conducted a brain network analysis and found that visual and auditory perceptual holistic processing share consistent neural pathways.

Discussion

Our efforts not only demonstrate the specificity, significance, and reliability of IRPs but also reveal their great potential for future brain mechanism research and BCI applications.

Trial-by-trial fluctuations of pre-stimulus alpha power predict language ERPs

Anticipatory mechanisms are known to play a key role in language, but they have been mostly investigated with violation paradigms, which only consider what happens after predictions have been (dis)confirmed. Relatively few studies focused on the pre-stimulus interval and found that stronger expectations are associated with lower pre-stimulus alpha power. However, alpha power also fluctuates spontaneously, in the absence of experimental manipulations; and in the attention and perception domains, spontaneously low pre-stimulus power is associated with better behavioral performance and with event-related potential (ERPs) with shorter latencies and higher amplitudes. Importantly, little is known about the role of alpha fluctuations in other domains, as it is in language. To this aim, we investigated whether spontaneous fluctuations in pre-stimulus alpha power modulate language-related ERPs in a semantic congruence task. Electrophysiology data were analyzed using Generalized Additive Mixed Models to model nonlinear interactions between pre-stimulus alpha power and EEG amplitude, at the single-trial level. We found that the N400 and the late posterior positivity/P600 were larger in the case of lower pre-stimulus alpha power. Still, while the N400 was observable regardless of the level of pre-stimulus power, a late posterior positivity/P600 effect was only observable for low pre-stimulus alpha power. We discuss these findings in light of the different, albeit connected, functional interpretations of pre-stimulus alpha and the ERPs according to both a nonpredictive interpretation focused on attentional mechanisms and under a predictive processing framework.

Category Mistakes Electrified

Occurrences of sentences that are traditionally considered category mistakes, such as 'The red number is divisible by three', tend to elicit a sense of oddness in assessors. In attempting to explain this oddness, existing accounts in the philosophical literature commonly claim that occurrences of such sentences are associated with a defect or phenomenology unique to the class of category mistakes. It might be thought that recent work in experimental psycholinguistics-in particular, the recording of event-related brain potentials (patterns of voltage variation in the brain)-holds the potential to shed new light on this debate. I review the relevant experimental results, before arguing that they present advocates of accounts of category mistakes with a dilemma: either the uniqueness claims should be rejected, or the experimental technique in question cannot be used to test existing accounts of category mistakes in the manner that philosophers might hope.

Understanding the Effects of Constraint and Predictability in ERP

Intuitively, strongly constraining contexts should lead to stronger probabilistic representations of sentences in memory. Encountering unexpected words could therefore be expected to trigger costlier shifts in these representations than expected words. However, psycholinguistic measures commonly used to study probabilistic processing, such as the N400 event-related potential (ERP) component, are sensitive to word predictability but not to contextual constraint. Some research suggests that constraint-related processing cost may be measurable via an ERP positivity following the N400, known as the anterior post-N400 positivity (PNP). The PNP is argued to reflect update of a sentence representation and to be distinct from the posterior P600, which reflects conflict detection and reanalysis. However, constraint-related PNP findings are inconsistent. We sought to conceptually replicate Federmeier et al. (2007) and Kuperberg et al. (2020), who observed that the PNP, but not the N400 or the P600, was affected by constraint at unexpected but plausible words. Using a pre-registered design and statistical approach maximising power, we demonstrated a dissociated effect of predictability and constraint: strong evidence for predictability but not constraint in the N400 window, and strong evidence for constraint but not predictability in the later window. However, the constraint effect was consistent with a P600 and not a PNP, suggesting increased conflict between a strong representation and unexpected input rather than greater update of the representation. We conclude that either a simple strong/weak constraint design is not always sufficient to elicit the PNP, or that previous PNP constraint findings could be an artifact of smaller sample size.

Inefficient speech-motor control affects predictive speech comprehension: atypical electrophysiological correlates in stuttering

Listeners predict upcoming information during language comprehension. However, how this ability is implemented is still largely unknown. Here, we tested the hypothesis proposing that language production mechanisms have a role in prediction. We studied 2 electroencephalographic correlates of predictability during speech comprehension-pre-target alpha-beta (8-30 Hz) power decrease and the post-target N400 event-related potential effect-in a population with impaired speech-motor control, i.e. adults who stutter (AWS), compared to typically fluent adults (TFA). Participants listened to sentences that could either constrain towards a target word or not, modulating its predictability. As a complementary task, participants also performed context-driven word production. Compared to TFA, AWS not only displayed atypical neural responses in production, but, critically, they showed a different pattern also in comprehension. Specifically, while TFA showed the expected pre-target power decrease, AWS showed a power increase in frontal regions, associated with speech-motor control. In addition, the post-target N400 effect was reduced for AWS with respect to TFA. Finally, we found that production and comprehension power changes were positively correlated in TFA, but not in AWS. Overall, the results support the idea that processes and neural structures prominently devoted to speech planning also support prediction during speech comprehension.