The origin of the occipital lambda wave in man

Saccade size predicts onset time of object processing during visual search of an open world virtual environment

OBJECTIVE

To date the vast majority of research in the visual neurosciences have been forced to adopt a highly constrained perspective of the vision system in which stimuli are processed in an open-loop reactive fashion (i.e., abrupt stimulus presentation followed by an evoked neural response). While such constraints enable high construct validity for neuroscientific investigation, the primary outcomes have been a reductionistic approach to isolate the component processes of visual perception. In electrophysiology, of the many neural processes studied under this rubric, the most well-known is, arguably, the P300 evoked response. There is, however, relatively little known about the real-world corollary of this component in free-viewing paradigms where visual stimuli are connected to neural function in a closed-loop. While growing evidence suggests that neural activity analogous to the P300 does occur in such paradigms, it is an open question when this response occurs and what behavioral or environmental factors could be used to isolate this component.

APPROACH

The current work uses convolutional networks to decode neural signals during a free-viewing visual search task in a closed-loop paradigm within an open-world virtual environment. From the decoded activity we construct fixation-locked response profiles that enable estimations of the variable latency of any P300 analogue around the moment of fixation. We then use these estimates to investigate which factors best reduce variable latency and, thus, predict the onset time of the response. We consider measurable, search-related factors encompassing top-down (i.e., goal driven) and bottom-up (i.e., stimulus driven) processes, such as fixation duration and salience. We also consider saccade size as an intermediate factor reflecting the integration of these two systems.

MAIN RESULTS

The results show that of these factors only saccade size reliably determines the onset time of P300 analogous activity for this task. Specifically, we find that for large saccades the variability in response onset is small enough to enable analysis using traditional ensemble averaging methods.

SIGNIFICANCE

The results show that P300 analogous activity does occur during closed-loop, free-viewing visual search while highlighting distinct differences between the open-loop version of this response and its real-world analogue. The results also further establish saccades, and saccade size, as a key factor in real-world visual processing.

(Micro)saccade-related potentials during face recognition: A study combining EEG, eye-tracking, and deconvolution modeling

Under natural viewing conditions, complex stimuli such as human faces are typically looked at several times in succession, implying that their recognition may unfold across multiple eye fixations. Although electrophysiological (EEG) experiments on face recognition typically prohibit eye movements, participants still execute frequent (micro)saccades on the face, each of which generates its own visuocortical response. This finding raises the question of whether the fixation-related potentials (FRPs) evoked by these tiny gaze shifts also contain psychologically valuable information about face processing. Here, we investigated this question by corecording EEG and eye movements in an experiment with emotional faces (happy, angry, neutral). Deconvolution modeling was used to separate the stimulus ERPs to face onset from the FRPs generated by subsequent microsaccades-induced refixations on the face. As expected, stimulus ERPs exhibited typical emotion effects, with a larger early posterior negativity (EPN) for happy/angry compared with neutral faces. Eye tracking confirmed that participants made small saccades in 98% of the trials, which were often aimed at the left eye of the stimulus face. However, while each saccade produced a strong response over visual areas, this response was unaffected by the face's emotional expression, both for the first and for subsequent (micro)saccades. This finding suggests that the face's affective content is rapidly evaluated after stimulus onset, leading to only a short-lived sensory enhancement by arousing stimuli that does not repeat itself during immediate refixations. Methodologically, our work demonstrates how eye tracking and deconvolution modeling can be used to extract several brain responses from each EEG trial, providing insights into neural processing at different latencies after stimulus onset.

Gaze onsets during naturalistic infant-caregiver interaction associate with 'sender' but not 'receiver' neural responses, and do not lead to changes in inter-brain synchrony

Temporal coordination during infant-caregiver social interaction is thought to be crucial for supporting early language acquisition and cognitive development. Despite a growing prevalence of theories suggesting that increased inter-brain synchrony associates with many key aspects of social interactions such as mutual gaze, little is known about how this arises during development. Here, we investigated the role of mutual gaze onsets as a potential driver of inter-brain synchrony. We extracted dual EEG activity around naturally occurring gaze onsets during infant-caregiver social interactions in N = 55 dyads (mean age 12 months). We differentiated between two types of gaze onset, depending on each partners' role. 'Sender' gaze onsets were defined at a time when either the adult or the infant made a gaze shift towards their partner at a time when their partner was either already looking at them (mutual) or not looking at them (non-mutual). 'Receiver' gaze onsets were defined at a time when their partner made a gaze shift towards them at a time when either the adult or the infant was already looking at their partner (mutual) or not (non-mutual). Contrary to our hypothesis we found that, during a naturalistic interaction, both mutual and non-mutual gaze onsets were associated with changes in the sender, but not the receiver's brain activity and were not associated with increases in inter-brain synchrony above baseline. Further, we found that mutual, compared to non-mutual gaze onsets were not associated with increased inter brain synchrony. Overall, our results suggest that the effects of mutual gaze are strongest at the intra-brain level, in the 'sender' but not the 'receiver' of the mutual gaze.

The effects of cognitive distraction on behavioural, oculomotor and electrophysiological metrics during a driving hazard perception task

Previous research has demonstrated that the distraction caused by holding a mobile telephone conversation is not limited to the period of the actual conversation (Haigney, 1995; Redelmeier & Tibshirani, 1997; Savage et al., 2013). In a prior study we identified potential eye movement and EEG markers of cognitive distraction during driving hazard perception. However the extent to which these markers are affected by the demands of the hazard perception task are unclear. Therefore in the current study we assessed the effects of secondary cognitive task demand on eye movement and EEG metrics separately for periods prior to, during and after the hazard was visible. We found that when no hazard was present (prior and post hazard windows), distraction resulted in changes to various elements of saccadic eye movements. However, when the target was present, distraction did not affect eye movements. We have previously found evidence that distraction resulted in an overall decrease in theta band output at occipital sites of the brain. This was interpreted as evidence that distraction results in a reduction in visual processing. The current study confirmed this by examining the effects of distraction on the lambda response component of subjects eye fixation related potentials (EFRPs). Furthermore, we demonstrated that although detections of hazards were not affected by distraction, both eye movement and EEG metrics prior to the onset of the hazard were sensitive to changes in cognitive workload. This suggests that changes to specific aspects of the saccadic eye movement system could act as unobtrusive markers of distraction even prior to a breakdown in driving performance.

The Impact of Task Demands on Fixation-Related Brain Potentials during Guided Search

Recording synchronous data from EEG and eye-tracking provides a unique methodological approach for measuring the sensory and cognitive processes of overt visual search. Using this approach we obtained fixation related potentials (FRPs) during a guided visual search task specifically focusing on the lambda and P3 components. An outstanding question is whether the lambda and P3 FRP components are influenced by concurrent task demands. We addressed this question by obtaining simultaneous eye-movement and electroencephalographic (EEG) measures during a guided visual search task while parametrically modulating working memory load using an auditory N-back task. Participants performed the guided search task alone, while ignoring binaurally presented digits, or while using the auditory information in a 0, 1, or 2-back task. The results showed increased reaction time and decreased accuracy in both the visual search and N-back tasks as a function of auditory load. Moreover, high auditory task demands increased the P3 but not the lambda latency while the amplitude of both lambda and P3 was reduced during high auditory task demands. The results show that both early and late stages of visual processing indexed by FRPs are significantly affected by concurrent task demands imposed by auditory working memory.

Superposition model predicts EEG occipital activity during free viewing of natural scenes

Visual event-related potentials (ERPs) produced by a stimulus are thought to reflect either an increase of synchronized activity or a phase realignment of ongoing oscillatory activity, with both mechanisms sharing the assumption that ERPs are independent of the current state of the brain at the time of stimulation. In natural viewing, however, visual inputs occur one after another at specific subject-paced intervals through unconstrained eye movements. We conjecture that during natural viewing, ERPs generated after each fixation are better explained by a superposition of ongoing oscillatory activity related to the processing of previous fixations, with new activity elicited by the visual input at the current fixation. We examined the electroencephalography (EEG) signals that occur in humans at the onset of each visual fixation, both while subjects freely viewed natural scenes and while they viewed a black or gray background. We found that the fixation ERPs show visual components that are absent when subjects move their eyes on a homogeneous gray or black screen. Single-trial EEG signals that comprise the ERP are predicted more accurately by a model of superposition than by either phase resetting or the addition of evoked responses and stimulus-independent noise. The superposition of ongoing oscillatory activity and the visually evoked response results in a modification of the ongoing oscillation phase. The results presented suggest that the observed EEG signals reflect changes occurring in a common neuronal substrate rather than a simple summation at the scalp of signals from independent sources.

Pattern-induced negative occipital potentials (PINOP)

SUMMARY

: We describe 24 subjects (16 female, 8 male; age range, 3 to 36 years [mean, 15.7]) who exhibited a hitherto inadequately described EEG response to visual scanning of geometric patterns. Like lambda waves (the normal physiologic response to visual scanning of pictures), the responses to pattern scanning were occipitally distributed and disappeared on eye closure. In contrast to lambda waves, they were surface negative, briefer in duration, and sharper in contour. To designate them, we have coined the term pattern-induced negative occipital potentials (PINOP). The prevalence of epilepsy was not significantly different among subjects with PINOP than among age- and sex-matched control subjects who did not have PINOP. None of the patients with PINOP exhibited paroxysmal epileptiform responses to intermittent photic stimulation or pattern activation. We conclude that PINOP represent an unusual benign physiologic phenomenon. The restricted distribution over the posterior head region and absence of associated, more widely distributed epileptiform responses during photic stimulation and pattern testing are clues to the diagnosis. We hypothesize that a differential area of activation in the occipital lobe during pattern viewing versus picture viewing and orientation of the activated areas to the scalp electrodes may account for the differences in the morphology of the wave forms observed during conventional EEG recording.

A primer on motion visual evoked potentials

Motion visual evoked potentials (motion VEPs) have been used since the late 1960s to investigate the properties of human visual motion processing, and continue to be a popular tool with a possible future in clinical diagnosis. This review first provides a synopsis of the characteristics of motion VEPs and then summarizes important methodological aspects. A subsequent overview illustrates how motion VEPs have been applied to study basic functions of human motion processing and shows perspectives for their use as a diagnostic tool.

Comparison between the lambda response of eye-fixation-related potentials and the P100 component of pattern-reversal visual evoked potentials

The purpose of this study was to compare the lambda response of eye-fixation-related potentials (EFRPs) with the P100 component of pattern-reversal visual-evoked potentials. EFRPs were obtained by averaging EEGs time-locked to the offset of the saccade. The dipole of the lambda response and that of the P100 component were estimated by the dipole-tracing method (Musha & Homma, 1990). The locations of their dipoles at the occipital sites were very close to each other when the difference waveform, which was calculated by subtracting the EFRP to the patternless stimulus from the EFRP to the patterned stimulus, was used for the lambda response. This finding implies that the lambda response and P100 have a common neural generator in the visual cortex. However, the peak latency of the lambda response was shorter than that of P100. The saccades in the EFRP trial were considered to be the cause of the difference.

Lambda response by orientation of striped patterns

A lambda response is an averaged occipital EEG potential associated with the offsets of saccadic eye movements. In the present experiment, two participants were asked to make horizontal saccades across horizontal or vertical white-black stripes. Analysis of orientations of striped patterns showed horizontal saccades across vertical stripes produced larger amplitudes of the lambda response than did horizontal saccades across horizontal stripes. Therefore, when the lambda response is used as the index of mental workload, it is necessary to take notice of the orientation of stimulus pattern.

Integrated effect of stimulation at fixation points on EFRP (eye-fixation related brain potentials)

The purpose of this study was to investigate the integrated effect of stimulation at the fixation points just before and just after saccadic eye-movement (saccade) on eye-fixation related brain potentials (EFRP: P75 and N105). Checkerboard patterns were used as stimuli. In Experiment 1, changes in check sizes between two fixation points enhanced the amplitude of P75, while changes in the phases of patterns between the two points did not affect EFRP. This result showed that EFRP was affected by two fixation points, and that changes in the retinal image between the two points did not necessarily affect EFRP. In Experiment 2, the relationship between EFRP and check size was investigated in detail. A second order relationship between logarithm of check size and the latency of P75, and a linear relationship between logarithm of check size and the amplitude of N105 were found. The effect of check size on the amplitude of P75 which might explain the increased amplitude of P75 observed in Experiment 1 did not appear. These results suggest that EFRP might reflect relative higher processing than peripheral stimulation at one fixation point.

Event-related desynchronization in the alpha band and the processing of semantic information

The hypothesis was tested whether event-related power shifts in the upper alpha band are specifically related to semantic memory processes. In Expt. 1 subjects had to judge whether pairs of sequentially presented words (W1-W2) were semantically congruent. In the following experiments subjects were presented the W1 words of Expt. 1 and were asked to perform a free association task in Expt. 2 and a cued recall task in Expt. 3. It is assumed that semantic memory demands dominate in Expt. 1, whereas working memory demands dominate in Expt. 3 and that Expt. 2 takes an intermediate position with respect to both types of task demands. A significant task-related power change that responds selectively to semantic processing demands was found for the upper alpha band and over the left side of the scalp. The lower alpha band, on the other hand, most likely reflects unspecific processing demands such as attention. A more general interpretation of these findings is that different cognitive processes such as semantic memory, perceptual encoding and attentional processes are reflected by band power changes in different and rather narrow frequency bands over localized regions in the brain.

Saccade onset and offset lambda waves: relation to pattern movement visually evoked potentials

The lambda (lambda) wave is an occipital EEG potential which occurs when saccadic eye movements are made against an illuminated contrast background. There is some disagreement concerning the presence of sub-components to the lambda-wave, and its relationship to visually evoked potentials. In the present study, lambda-waves were recorded with saccades of different durations (30-110 ms) and compared to VEPs associated with pattern movements of similar durations and velocity. It was found that the lambda-wave consisted of a saccade onset component with positive sub-components at 59 and 100 ms after saccade onset, and a saccade offset component with a positive potential at 74 ms after saccade offset. With small saccades of 30 ms duration or less, these components superimposed to form a single lambda-wave. In the case of pattern movement VEPs, a movement onset component of latency 110 ms following movement onset, and a movement offset component at 89 ms after movement offset, were identified. The similar behaviour of the lambda-wave and VEP under these conditions supports the view that the lambda-wave is a visually evoked potential resulting from movement of the visual field across the retina during a saccadic eye movement.

Evoked potentials during REM sleep reflect dreaming

Polygraphic recordings were collected for 11 normal subjects during sleep and wakefulness in order to investigate characteristics of the rapid eye movement (REM) associated potentials. EEGs were averaged using 5 different triggering points: (1) saccade onset under the normal ambient illumination, (2) saccade onset in the total darkness, (3) onset of REMs during REM sleep, (4) flash during REM sleep, and (5) flash during stage 2 sleep. In the central area, positive potentials appeared with waking saccades under the normal ambient illumination (P240L) and REMs (P185R). The latency of P185R associated with REMs was significantly shorter than that of P240L associated with waking saccades. These findings suggest that P185R is evoked by PGO waves occurring just before the REM. A small positive potential appeared in the occipital area with waking saccade under the normal ambient illumination (P260L) and REMs in the total darkness (P250R). Conspicuous absence of these waves for waking saccades in the total darkness suggests that P250R accompanied with REMs reflects activities involved with the cognitive processes occurring when a subject scans a dream image during REM sleep.