Predictive coding in visual search as revealed by cross-frequency EEG phase synchronization

Mission impossible? Spatial context relearning following a target relocation event depends on cue predictiveness

Visual search for a target is faster when the spatial layout of distractors is repeatedly encountered, illustrating that statistical learning of contextual invariances facilitates attentional guidance (contextual cueing; Chun & Jiang, 1998, Cognitive Psychology, 36, 28-71). While contextual learning is usually relatively efficient, relocating the target to an unexpected location (within an otherwise unchanged search layout) typically abolishes contextual cueing and the benefits deriving from invariant contexts recover only slowly with extensive training (Zellin et al., 2014, Psychonomic Bulletin & Review, 21(4), 1073-1079). However, a recent study by Peterson et al. (2022, Attention, Perception, & Psychophysics, 84(2), 474-489) in fact reported rather strong adaptation of spatial contextual memories following target position changes, thus contrasting with prior work. Peterson et al. argued that previous studies may have been underpowered to detect a reliable recovery of contextual cueing after the change. However, their experiments also used a specific display design that frequently presented the targets at the same locations, which might reduce the predictability of the contextual cues thereby facilitating its flexible relearning (irrespective of statistical power). The current study was a (high-powered) replication of Peterson et al., taking into account both statistical power and target overlap in context-memory adaptation. We found reliable contextual cueing for the initial target location irrespective of whether the targets shared their location across multiple displays, or not. However, contextual adaptation following a target relocation event occurred only when target locations were shared. This suggests that cue predictability modulates contextual adaptation, over and above a possible (yet negligible) influence of statistical power.

Two Distinct Neural Mechanisms Underlying Acupuncture Analgesia

Acupuncture analgesia is a traditional treatment with a long history, although it lacks scientific evidence. It is reportedly associated with the central nervous system, including various brain regions, from the cortices to the brain stem. However, it remains unclear whether the distributed regions behave as a single unit or consist of multiple sub-units playing different roles. Magnetoencephalography is a neuroimaging technique that can measure the oscillatory frequency of neural signals and brain regions. The frequency band of neural signals allows further understanding of the characteristics of the acupuncture-related neural systems. This study measured resting-state brain activity using magnetoencephalography in 21 individuals with chronic pain before and after acupuncture treatment. The subjective level of pain was assessed using a visual analog scale, and brain activity was compared to identify the brain regions and the frequencies associated with acupuncture analgesia. Here, we categorized the changes in resting-state brain activity into two groups: low-frequency oscillatory activity (<3 Hz) in the left middle occipital and right superior partial lobule and high-frequency oscillatory activity (81–120 Hz) on both sides of the prefrontal, primary sensory, and right fusiform gyri. These findings suggest that acupuncture analgesia influences two or more sub-units of the neural systems, which helps us understand the neural mechanisms underlying acupuncture analgesia.

Mismatch of Visual-Vestibular Information in Virtual Reality: Is Motion Sickness Part of the Brains Attempt to Reduce the Prediction Error?

Visually induced motion sickness (VIMS) is a relevant limiting factor in the use of virtual reality (VR) devices. Understanding the origin of this problem might help to develop strategies to circumvent this limitation. Previous studies have attributed VIMS to a mismatch between visual, and vestibular information, causing ambiguity of the position of the body in relation to its surrounding. Studies using EEG have shown a shift of the power spectrum to lower frequencies while VIMS is experienced. However, little is known about the relationship between the intensity of the VIMS and the changes in these power spectra. Moreover, the effect of different varieties of VIMS on the causal relationship between brain areas is largely unknown. Here, we used EEG to study 14 healthy subjects in a VR environment who were exposed to increasing levels of mismatch between vestibular and visual information. The frequency power and the bivariate transfer entropy as a measure for the information transfer were calculated. We found a direct association between increasing mismatch levels and subjective VIMS. With increasing VIMS, the proportion of slow EEG waves (especially 1–10 Hz) increases, especially in temporo-occipital regions. Furthermore, we found a general decrease in the information flow in most brain areas but especially in brain areas involved in the processing of vestibular signals and the detection of self-motion. We hypothesize that the general shift of frequency power and the decrease in information flow while experiencing high intensity VIMS represent a brain state of a reduced ability to receive, transmit and process information. We further hypothesize that the mechanism of reduced information flow is a general reaction of the brain to an unresolvable mismatch of information. This reaction aims on transforming a currently unstable model with a high prediction error into a stable model in an environment of minimal contradictory information.

The Menstrual Cycle Alters Resting-State Cortical Activity: A Magnetoencephalography Study

Resting-state neural oscillations are used as biomarkers for functional diseases such as dementia, epilepsy, and stroke. However, accurate interpretation of clinical outcomes requires the identification and minimisation of potential confounding factors. While several studies have indicated that the menstrual cycle also alters brain activity, most of these studies were based on visual inspection rather than objective quantitative measures. In the present study, we aimed to clarify the effect of the menstrual cycle on spontaneous neural oscillations based on quantitative magnetoencephalography (MEG) parameters. Resting-state MEG activity was recorded from 25 healthy women with normal menstrual cycles. For each woman, resting-state brain activity was acquired twice using MEG: once during their menstrual period (MP) and once outside of this period (OP). Our results indicated that the median frequency and peak alpha frequency of the power spectrum were low, whereas Shannon spectral entropy was high, during the MP. Theta intensity within the right temporal cortex and right limbic system was significantly lower during the MP than during the OP. High gamma intensity in the left parietal cortex was also significantly lower during the MP than during the OP. Similar differences were also observed in the parietal and occipital regions between the proliferative (the late part of the follicular phase) and secretory phases (luteal phase). Our findings suggest that the menstrual cycle should be considered to ensure accurate interpretation of functional neuroimaging in clinical practice.

EEG cross-frequency phase synchronization as an index of memory matching in visual search

Visual perception is influenced by our expectancies about incoming sensory information. It is assumed that mental templates of expected sensory input are created and compared to actual input, which can be matching or not. When such mental templates are held in working memory, cross-frequency phase synchronization (CFS) between theta and gamma band activity has been proposed to serve matching processes between prediction and sensation. We investigated how this is affected by the number of activated templates that could be matched by comparing conditions where participants had to keep either one or multiple templates in mind for successful visual search. We found a transient CFS between EEG theta and gamma activity in an early time window around 150 ms after search display presentation, in right hemispheric parietal cortex. Our results suggest that for single template conditions, stronger transient theta-gamma CFS at posterior sites contralateral to target presentation can be observed than for multiple templates. This can be interpreted as evidence to the idea of sequential attentional templates. But mainly, it is understood in line with previous theoretical accounts strongly arguing for transient synchronization between posterior theta and gamma phase as a neural correlate of matching incoming sensory information with contents from working memory and as evidence for limitations in memory matching during multiple template search.

Adaptive Filtering for Improved EEG-Based Mental Workload Assessment of Ambulant Users

Recently, due to the emergence of mobile electroencephalography (EEG) devices, assessment of mental workload in highly ecological settings has gained popularity. In such settings, however, motion and other common artifacts have been shown to severely hamper signal quality and to degrade mental workload assessment performance. Here, we show that classical EEG enhancement algorithms, conventionally developed to remove ocular and muscle artifacts, are not optimal in settings where participant movement (e.g., walking or running) is expected. As such, an adaptive filter is proposed that relies on an accelerometer-based referential signal. We show that when combined with classical algorithms, accurate mental workload assessment is achieved. To test the proposed algorithm, data from 48 participants was collected as they performed the Revised Multi-Attribute Task Battery-II (MATB-II) under a low and a high workload setting, either while walking/jogging on a treadmill, or using a stationary exercise bicycle. Accuracy as high as 95% could be achieved with a random forest based mental workload classifier with ambulant users. Moreover, an increase in gamma activity was found in the parietal cortex, suggesting a connection between sensorimotor integration, attention, and workload in ambulant users.

Delta phase reset predicts conflict-related changes in P3 amplitude and behavior

When multiple competing responses are activated, we respond more slowly than if only one response is activated (response conflict). Conflict-induced slowing is reduced for consecutive high-conflict stimuli, an effect known as conflict adaptation. Verguts and Notebaert's (2009) adaptation by binding theory suggests this is due to Hebbian learning of cognitive control, potentiated by the response of the locus coeruleus norepinephrine (NE) system. Phasic activity of the NE system can potentially be measured non-invasively in humans by recording the P3 component of the event-related potential (ERP), and the P3 is sensitive to conflict adaptation. Bouret and Sara's (2005) network reset theory suggests that phasic NE might functionally reset ongoing large-scale network activity, generating synchronous neural population activity like the P3. To examine the possibility that network reset contributes to conflict effects in the P3, we recorded high-density EEG data while subjects performed a flanker task. As expected, conflict and conflict adaptation modulated P3 amplitudes. Brain-behavior correlation analyses indicated that activity during the rise of the P3 was related to RT and predicted RT differences due to conflict. More importantly, phase of delta oscillations not only predicted reaction time differences between low-conflict and high-conflict conditions, but delta phase reset also predicted the amplitude of the P3. Delta oscillations exhibited dominant peaks both pre and post-stimulus, and delta at stimulus onset predicted the post-stimulus ERP, in particular the N2 and P3. This result bridges human EEG with basic mechanisms suggested by computational neural models and invasive patient recordings, namely that salient cognitive events might reset ongoing oscillations leading to the generation of the phase-locked evoked potential. We conclude that partial phase reset is a cortical mechanism involved in monitoring the environment for unexpected events, and this response contributes to conflict effects in the ERP. These results are in line with theories that phasic NE release might reset ongoing cortical activity, leading to the generation of ERP components like the P3.

Predictions through evidence accumulation over time

It has been proposed that the brain specializes in predicting future states of the environment. These predictions are probabilistic, and must be continuously updated on the basis of their mismatch with actual evidence. Although electrophysiological data disclose neural activity patterns in relation to predictive processes, little is known about how this activity supports prediction build-up through evidence accumulation. Here we addressed this gap. Participants were required to make moment-by-moment predictions about stimuli presented in sequences in which gathering evidence from previous items as they were presented was either possible or not. Two event-related potentials (ERP), a frontocentral P2 and a central P3, were sensitive to information accumulation throughout the sequence. Time-frequency (TF) analyses revealed that prediction build-up process also modulated centrally distributed theta activity, and that alpha power was suppressed in anticipation to fully predictable stimuli. Results are in agreement with the notion of predictions as probability distributions and highlight the ability of observers to extract those probabilities in a changing environment and to adjust their predictions consequently.

Segregation and Integration of Cortical Information Processing Underlying Cross-Modal Perception

Visual cues from the speaker’s face influence the perception of speech. An example of this influence is demonstrated by the McGurk-effect where illusory (cross-modal) sounds are perceived following presentation of incongruent audio–visual (AV) stimuli. Previous studies report the engagement of specific cortical modules that are spatially distributed during cross-modal perception. However, the limits of the underlying representational space and the cortical network mechanisms remain unclear. In this combined psychophysical and electroencephalography (EEG) study, the participants reported their perception while listening to a set of synchronous and asynchronous incongruent AV stimuli. We identified the neural representation of subjective cross-modal perception at different organizational levels — at specific locations in sensor space and at the level of the large-scale brain network estimated from between-sensor interactions. We identified an enhanced positivity in the event-related potential peak around 300 ms following stimulus onset associated with cross-modal perception. At the spectral level, cross-modal perception involved an overall decrease in power at the frontal and temporal regions at multiple frequency bands and at all AV lags, along with an increased power at the occipital scalp region for synchronous AV stimuli. At the level of large-scale neuronal networks, enhanced functional connectivity at the gamma band involving frontal regions serves as a marker of AV integration. Thus, we report in one single study that segregation of information processing at individual brain locations and integration of information over candidate brain networks underlie multisensory speech perception.