Endogenous attention selection during binocular rivalry at early stages of visual processing

Collective plasticity of binocular interactions in the adult visual system

Binocular visual plasticity can be initiated via either bottom-up or top-down mechanisms, but it is unknown if these two forms of adult plasticity can be independently combined. In seven participants with normal binocular vision, sensory eye dominance was assessed using a binocular rivalry task, before and after a period of monocular deprivation and with and without selective attention directed towards one eye. On each trial, participants reported the dominant monocular target and the inter-ocular contrast difference between the stimuli was systematically altered to obtain estimates of ocular dominance. We found that both monocular light- and pattern-deprivation shifted dominance in favour of the deprived eye. However, this shift was completely counteracted if the non-deprived eye's stimulus was selectively attended. These results reveal that shifts in ocular dominance, driven by bottom-up and top-down selection, appear to act independently to regulate the relative contrast gain between the two eyes.

The effect of prepulse amplitude and timing on the perception of an electrotactile pulse

The perceived intensity of an intense stimulus as well as the startle reflex it elicits can both be reduced when preceded by a weak stimulus (prepulse). Both phenomena are used to characterise the processes of sensory gating in clinical and non-clinical populations. The latter phenomenon, startle prepulse inhibition (PPI), is conceptualised as a measure of pre-attentive sensorimotor gating due to its observation at short latencies. In contrast, the former, prepulse inhibition of perceived stimulus intensity (PPIPSI), is believed to involve higher-order cognitive processes (e.g., attention), which require longer latencies. Although conceptually distinct, PPIPSI is often studied using parameters that elicit maximal PPI, likely limiting what we can learn about sensory gating's influence on conscious perception. Here, we tested an array of stimulus onset asynchronies (SOAs; 0-602 ms) and prepulse intensities (0-3× perceptual threshold) to determine the time course and sensitivity to the intensity of electrotactile PPIPSI. Participants were required to compare an 'unpleasant but not painful' electric pulse to their left wrist that was presented alone with the same stimulus preceded by an electric prepulse, and report which pulse stimulus felt more intense. Using a 2× perceptual threshold prepulse, PPIPSI emerged as significant at SOAs from 162 to 602 ms. We conclude that evidence of electrotactile PPIPSI at SOAs of 162 ms or longer is consistent with gating of perception requiring higher-level processes, not measured by startle PPI. The possible role of attentional processes, stimuli intensity, modality-specific differences, and methods of investigating PPIPSI further are discussed.

N1-P2 event-related potentials and perceived intensity are associated: The effects of a weak pre-stimulus and attentional load on processing of a subsequent intense stimulus

A weak stimulus presented immediately before a more intense one reduces both the N1-P2 cortical response and the perceived intensity of the intense stimulus. The former effect is referred to as cortical prepulse inhibition (PPI), the latter as prepulse inhibition of perceived stimulus intensity (PPIPSI). Both phenomena are used to study sensory gating in clinical and non-clinical populations, however little is known about their relationship. Here, we investigated 1) the possibility that cortical PPI and PPIPSI are associated, and 2) how they are affected by attentional load. Participants were tasked with comparing the intensity of an electric pulse presented alone versus one preceded 200 ms by a weaker electric prepulse (Experiment 1), or an acoustic pulse presented alone with one preceded 170 ms by a weaker acoustic prepulse (Experiment 2). A counting task (easy vs. hard) manipulating attentional load was included in Experiment 2. In both experiments, we observed a relationship between N1-P2 amplitude and perceived intensity, where greater cortical PPI was associated with a higher probability of perceiving the 'pulse with prepulse' as less intense. Moreover, higher attentional load decreased observations of PPIPSI but had no effect on N1-P2 amplitude. Based on the findings we propose that PPIPSI partially relies on the allocation of attentional resources towards monitoring cortical channels that process stimulus intensity characteristics such as the N1-P2 complex.

Attention cueing in rivalry: insights from pupillometry

We used pupillometry to evaluate the effects of attention cueing on perceptual bi-stability, as reported by adult human observers. Perceptual alternations and pupil diameter were measured during two forms of rivalry, generated by presenting a white and a black disk to the two eyes (binocular rivalry) or splitting the disks between eyes (interocular grouping rivalry). In line with previous studies, we found that subtle pupil size modulations (about 0.05 mm) tracked alternations between exclusive dominance phases of the black or white disk. These pupil responses were larger for perceptually stronger stimuli: presented to the dominant eye or with physically higher luminance contrast. However, cueing of endogenous attention to one of the rivaling percepts did not affect pupil modulations during exclusive dominance phases. This was observed despite the reliable effects of endogenous attention on perceptual dominance, which shifted in favor of the cued percept by about 10%. The results were comparable for binocular and interocular grouping rivalry. Cueing only had a marginal modulatory effect on pupil size during mixed percepts in binocular rivalry. This may suggest that, rather than acting by modulating perceptual strength, endogenous attention primarily acts during periods of unresolved competition, which is compatible with attention being automatically directed to the rivaling stimuli during periods of exclusive dominance and thereby sustaining perceptual alternations.Significance StatementBinocular rivalry depends on attention. When it is diverted away from the stimuli, perceptual alternations slow down; when it is preferentially directed to one stimulus, perception lingers more on it, consistent with attention enhancing the effective strength of the rivaling stimuli. Here we introduce pupillometry as a means to indirectly track changes in effective stimulus strength. We find that pupil size accurately tracks perceived luminance during two forms of rivalry: binocular rivalry and interocular grouping rivalry. Both show robust effects of attention cueing on perceptual dominance, but pupil modulations during exclusive dominance are unaffected by cueing. This suggests that endogenous attention does not affect perceptual strength during exclusive dominance, though it might do so during transition phases.

Attentional eye selection modulates sensory eye dominance

Brief periods of monocular deprivation significantly modify binocular visual processing. For example, patching one eye for a few hours alters the inter-ocular balance, with the previously patched eye becoming dominant once the patch is removed. However, the contribution of higher-level visual processing to this phenomenon is still unclear. Here, we compared changes in sensory eye dominance produced by three types of monocular manipulations in adult participants with normal binocular vision. One eye was covered for 150 min using either an opaque patch, a diffusing lens, or a prism that inverted the image. All three manipulations altered dominance duration and predominance during binocular rivalry (BR) in favour of the treated eye and the time courses of the changes were similar. These results indicate that modifications of luminance or contrast are not strictly necessary to drive shifts in eye dominance, as both were unaltered in the prism condition. Next, we found that shifts in eye dominance were dependent on attentional demands during the monocular treatment period, providing support for the role of attentional eye selection in modulating eye dominance. Finally, we found relatively rapid build-up of the ocular dominance shift after the onset of monocular treatment. Taken together, our results suggest that modifications to monocular input alter inter-ocular balance via selective attentional mechanisms that bias output towards the deprived eye. Eye-based attention may play an important role in conditions where normal input to one eye is disrupted, such as childhood amblyopia.

Altered phase and nonphase EEG activity expose impaired maintenance of a spatial-object attentional focus in multiple sclerosis patients

Some of the anatomical and functional basis of cognitive impairment in multiple sclerosis (MS) currently remains unknown. In particular, there is scarce knowledge about modulations in induced EEG (nonphase activity) for diverse frequency bands related to attentional deficits in this pathology. The present study analyzes phase and nonphase alpha and gamma modulations in 26 remitting-relapsing multiple sclerosis patients during their participation in the attention network test compared with twenty-six healthy controls (HCs) matched in sociodemographic variables. Behavioral results showed that the MS group exhibited general slowing, suggesting impairment in alerting and orienting networks, as has been previously described in other studies. Time–frequency analysis of EEG revealed that the gamma band was related to the spatial translation of the attentional focus, and the alpha band seemed to be related to the expectancy mechanisms and cognitive processing of the target. Moreover, phase and nonphase modulations differed in their psychophysiological roles and were affected differently in the MS and HC groups. In summary, nonphase modulations can unveil hidden cognitive mechanisms for phase analysis and complete our knowledge of the neural basis of cognitive impairment in multiple sclerosis pathology.

The time course of different surround suppression mechanisms

What we see depends on the spatial context in which it appears. Previous work has linked the suppression of perceived contrast by surrounding stimuli to reduced neural responses in early visual cortex. This surround suppression depends on at least two separable neural mechanisms, "low-level" and "higher level," which can be differentiated by their response characteristics. We used electroencephalography to demonstrate for the first time that human occipital neural responses show evidence of these two suppression mechanisms. Eighteen adults (10 women, 8 men) each participated in three experimental sessions, in which they viewed visual stimuli through a mirror stereoscope. The first session was used to identify the C1 component, while the second and third comprised the main experiment. Event-related potentials were measured in response to center gratings either with no surround or with surrounding gratings oriented parallel or orthogonal, and presented in either the same eye (monoptic) or the opposite eye (dichoptic). We found that the earliest component of an event-related potential (C1; ∼60 ms) was suppressed by surrounding stimuli, but that suppression did not depend on surround configuration. This suggests a suppression mechanism that is not tuned for relative orientation acting on the earliest cortical response to the target. A later response component (N1; ∼160 ms) showed stronger suppression for parallel and monoptic surrounds, consistent with our earlier psychophysical results and a second form of suppression that is binocular and orientation tuned. We conclude that these two forms of surround suppression have distinct response time courses in the human visual system, which can be differentiated using electrophysiology.

Bistable perception: neural bases and usefulness in psychological research

Bistable images have the possibility of being perceived in two different ways. Due to their physical characteristics, these visual stimuli allow two different perceptions, associated with top-down and bottom-up modulating processes. Based on an extensive literature review, the present article aims to gather the conceptual models and the foundations of perceptual bistability. This theoretical article compiles not only notions that are intertwined with the understanding of this perceptual phenomenon, but also the diverse classification and uses of bistable images in psychological research, along with a detailed explanation of the neural correlates that are involved in perceptual reversibility. We conclude that the use of bistable images as a paradigmatic resource in psychological research might be extensive. In addition, due to their characteristics, visual bistable stimuli have the potential to be implemented as a resource in experimental tasks that seek to understand diverse concerns linked essentially to attention, sensory, perceptual and memory processes.

Olfaction Modulates Early Neural Responses to Matching Visual Objects

Sensory information is initially registered within anatomically and functionally segregated brain networks but is also integrated across modalities in higher cortical areas. Although considerable research has focused on uncovering the neural correlates of multisensory integration for the modalities of vision, audition, and touch, much less attention has been devoted to understanding interactions between vision and olfaction in humans. In this study, we asked how odors affect neural activity evoked by images of familiar visual objects associated with characteristic smells. We employed scalp-recorded EEG to measure visual ERPs evoked by briefly presented pictures of familiar objects, such as an orange, mint leaves, or a rose. During presentation of each visual stimulus, participants inhaled either a matching odor, a nonmatching odor, or plain air. The N1 component of the visual ERP was significantly enhanced for matching odors in women, but not in men. This is consistent with evidence that women are superior in detecting, discriminating, and identifying odors and that they have a higher gray matter concentration in olfactory areas of the OFC. We conclude that early visual processing is influenced by olfactory cues because of associations between odors and the objects that emit them, and that these associations are stronger in women than in men.

Emotional cues during simultaneous face and voice processing: electrophysiological insights

Both facial expression and tone of voice represent key signals of emotional communication but their brain processing correlates remain unclear. Accordingly, we constructed a novel implicit emotion recognition task consisting of simultaneously presented human faces and voices with neutral, happy, and angry valence, within the context of recognizing monkey faces and voices task. To investigate the temporal unfolding of the processing of affective information from human face-voice pairings, we recorded event-related potentials (ERPs) to these audiovisual test stimuli in 18 normal healthy subjects; N100, P200, N250, P300 components were observed at electrodes in the frontal-central region, while P100, N170, P270 were observed at electrodes in the parietal-occipital region. Results indicated a significant audiovisual stimulus effect on the amplitudes and latencies of components in frontal-central (P200, P300, and N250) but not the parietal occipital region (P100, N170 and P270). Specifically, P200 and P300 amplitudes were more positive for emotional relative to neutral audiovisual stimuli, irrespective of valence, whereas N250 amplitude was more negative for neutral relative to emotional stimuli. No differentiation was observed between angry and happy conditions. The results suggest that the general effect of emotion on audiovisual processing can emerge as early as 200 msec (P200 peak latency) post stimulus onset, in spite of implicit affective processing task demands, and that such effect is mainly distributed in the frontal-central region.

Perceptual load, voluntary attention, and aging: an event-related potential study

The locus of attentional selection is known to vary with perceptual load (Lavie et al., 2004). Under voluntary attention, perceptual load modulates selective visual processing at an early cortical stage, as reflected in the posterior P1 and N1 components of the event-related potentials (ERPs). Adult aging also affects both behavioral and ERP signs of attentional selection. However, it is not known whether perceptual load modulates this relationship. Accordingly, in the present study ERPs were recorded in a voluntary attention task. Young and old participants were asked to discriminate the direction of a target line embedded within a display of four lines that appeared in the left or right visual field. Participants responded faster and more accurately to valid relative to invalid trials and to low-load relative to high-load condition. Older participants responded more slowly and with lower accuracy than young participants in all conditions. The amplitudes of the posterior contralateral P1 and N1 components in valid trials were larger than that in invalid trials in all conditions. N1 amplitude was larger under the high load condition than that in the low load condition. Moreover, in the high perceptual load condition, the old group had a larger N1 than the young group at contralateral sites. The findings suggest that under voluntary attention, perceptual load and aging modulates attentional selection at an early but not the earliest stage, during the N1 (120-200ms) time range. Increased N1 amplitude in older adults may reflect increased demands on target discrimination in high perceptual load.

Understanding attentional modulation of binocular rivalry: a framework based on biased competition

Starting from early scientific explorations of binocular rivalry, researchers have wondered about the degree to which an observer can exert voluntary attentional control over rivalry dynamics. The answer to this question would not only reveal the extent to which we may determine our own conscious visual experience, but also advance our understanding of the neural mechanisms underlying binocular rivalry. Classic studies, intriguingly, reached contradictory conclusions, ranging from an absence of attentional control, as advocated by Breese, to nearly complete control of rivalry dynamics, as reported by Helmholtz. Recent investigations have revisited this question, but the results have continued to echo the conflicting findings of earlier studies, seemingly precluding a comprehensive understanding of attentional effects on rivalry. Here, we review both classic and modern studies, and propose a unifying framework derived from the biased competition theory of attention. The key assumption of this theory is that the nature of stimulus conflict determines the limits of attentional modulation. For example, a condition in which unresolved stimulus conflict transpires through many levels of visual processing should be very susceptible to attentional control. When applied to binocular rivalry, this framework predicts strong attentional modulations under conditions of unresolved stimulus conflict (e.g., initial selection) and conditions where conflict is resolved at higher levels of visual processing (e.g., stimulus rivalry). Additionally, the efficacy of attentional control over rivalry can be increased by utilization of demanding, behaviorally relevant tasks, and likely through perceptual training paradigms. We show that this framework can help facilitate the understanding and synthesis of a diverse set of results on attentional control over rivalry, and we propose several directions for future research on this interesting topic.

On the role of attention in binocular rivalry: electrophysiological evidence

During binocular rivalry visual consciousness fluctuates between two dissimilar monocular images. We investigated the role of attention in this phenomenon by comparing event-related potentials (ERPs) when binocular-rivalry stimuli were attended with when they were unattended. Stimuli were dichoptic, orthogonal gratings that yielded binocular rivalry and dioptic, identically oriented gratings that yielded binocular fusion. Events were all possible orthogonal changes in orientation of one or both gratings. We had two attention conditions: In the attend-to-grating condition, participants had to report changes in perceived orientation, focussing their attention on the gratings. In the attend-to-fixation condition participants had to report changes in a central fixation target, taking attention away from the gratings. We found, surprisingly, that attending to rival gratings yielded a smaller ERP component (the N1, from 160–210 ms) than attending to the fixation target. To explain this paradoxical effect of attention, we propose that rivalry occurs in the attend-to-fixation condition (we found an ERP signature of rivalry in the form of a sustained negativity from 210–300 ms) but that the mechanism processing the stimulus changes is more adapted in the attend-to-grating condition than in the attend-to-fixation condition. This is consistent with the theory that adaptation gives rise to changes of visual consciousness during binocular rivalry.

Stress potentiates early and attenuates late stages of visual processing

Stress can fundamentally alter neural responses to incoming information. Recent research suggests that stress and anxiety shift the balance of attention away from a task-directed mode, governed by prefrontal cortex, to a sensory-vigilance mode, governed by the amygdala and other threat-sensitive regions. A key untested prediction of this framework is that stress exerts dissociable effects on different stages of information processing. This study exploited the temporal resolution afforded by event-related potentials to disentangle the impact of stress on vigilance, indexed by early perceptual activity, from its impact on task-directed cognition, indexed by later postperceptual activity in humans. Results indicated that threat of shock amplified stress, measured using retrospective ratings and concurrent facial electromyography. Stress also double-dissociated early sensory-specific processing from later task-directed processing of emotionally neutral stimuli: stress amplified N1 (184-236 ms) and attenuated P3 (316-488 ms) activity. This demonstrates that stress can have strikingly different consequences at different processing stages. Consistent with recent suggestions, stress amplified earlier extrastriate activity in a manner consistent with vigilance for threat (N1), but disrupted later activity associated with the evaluation of task-relevant information (P3). These results provide a novel basis for understanding how stress can modulate information processing in everyday life and stress-sensitive disorders.

Compatibility between stimulated eye, target location and response location

Responses to stimuli are faster when the stimulus location spatially corresponds to the required response (standard Simon effect). Recently, a similar effect has been observed with monocular stimuli. Responses were faster when the response location and the stimulated eye corresponded (monocular Simon effect). It has been suggested that distinct mechanisms may underlie these two Simon effects. Here, we attempted to study these two mechanisms simultaneously. For mean reaction time, a finding of perfect additivity was obtained. These behavioral data coupled with surface electrophysiological measures support the view that two different mechanisms contribute independently to the monocular and standard Simon effect.