Voluntary and Involuntary Attention in Bistable Visual Perception: A MEG Study

In this study, voluntary and involuntary visual attention focused on different interpretations of a bistable image, were investigated using magnetoencephalography (MEG). A Necker cube with sinusoidally modulated pixels' intensity in the front and rear faces with frequencies 6.67 Hz (60/9) and 8.57 Hz (60/7), respectively, was presented to 12 healthy volunteers, who interpreted the cube as either left- or right-oriented. The tags of these frequencies and their second harmonics were identified in the average Fourier spectra of the MEG data recorded from the visual cortex. In the first part of the experiment, the subjects were asked to voluntarily control their attention by interpreting the cube orientation as either being on the left or right. Accordingly, we observed the dominance of the corresponding spectral component, and voluntary attention performance was measured. In the second part of the experiment, the subjects were asked to focus their gaze on a red marker at the center of the cube image without putting forth effort in its interpretation. The alternation of the dominant spectral energies at the second harmonics of the stimulation frequencies was treated as changes in the cube orientation. Based on the results of the first experimental stage and using a wavelet analysis, we developed a method which allowed us to identify the currently perceived cube orientation. Finally, we characterized involuntary attention using the distribution of dominance times when focusing attention on one of the cube orientations, which was related to voluntary attention performance and brain noise. In particular, we confirmed our hypothesis that higher attention performance is associated with stronger brain noise.

Ensemble modeling of auditory streaming reveals potential sources of bistability across the perceptual hierarchy

Perceptual bistability-the spontaneous, irregular fluctuation of perception between two interpretations of a stimulus-occurs when observing a large variety of ambiguous stimulus configurations. This phenomenon has the potential to serve as a tool for, among other things, understanding how function varies across individuals due to the large individual differences that manifest during perceptual bistability. Yet it remains difficult to interpret the functional processes at work, without knowing where bistability arises during perception. In this study we explore the hypothesis that bistability originates from multiple sources distributed across the perceptual hierarchy. We develop a hierarchical model of auditory processing comprised of three distinct levels: a Peripheral, tonotopic analysis, a Central analysis computing features found more centrally in the auditory system, and an Object analysis, where sounds are segmented into different streams. We model bistable perception within this system by applying adaptation, inhibition and noise into one or all of the three levels of the hierarchy. We evaluate a large ensemble of variations of this hierarchical model, where each model has a different configuration of adaptation, inhibition and noise. This approach avoids the assumption that a single configuration must be invoked to explain the data. Each model is evaluated based on its ability to replicate two hallmarks of bistability during auditory streaming: the selectivity of bistability to specific stimulus configurations, and the characteristic log-normal pattern of perceptual switches. Consistent with a distributed origin, a broad range of model parameters across this hierarchy lead to a plausible form of perceptual bistability.

Does direction of walking impact binocular rivalry between competing patterns of optic flow?

When dissimilar monocular images are viewed simultaneously by the two eyes, stable binocular vision gives way to unstable vision characterized by alternations in dominance between the two images in a phenomenon called binocular rivalry. These alternations in perception reveal the existence of inhibitory interactions between neural representations associated with conflicting visual inputs. Binocular rivalry has been studied since the days of Wheatstone, but one recent strategy is to investigate its susceptibility to influences caused by one's own motor activity. This paper focused on the activity of walking, which produces an expected, characteristic direction of optic flow dependent upon the direction of one's walking. In a set of experiments, we employed virtual reality technology to present dichoptic stimuli to observers who walked forward, backward, or were sitting. Optic flow was presented to a given eye, and was sometimes congruent with the direction of walking, sometimes incongruent, and sometimes random, except when the participant was sitting. Our results indicate that, while walking had a reliable influence on rivalry dynamics, the predominance of congruent or incongruent motion did not.

Does visual attention drive the dynamics of bistable perception?

How does attention interact with incoming sensory information to determine what we perceive? One domain in which this question has received serious consideration is that of bistable perception: a captivating class of phenomena that involves fluctuating visual experience in the face of physically unchanging sensory input. Here, some investigations have yielded support for the idea that attention alone determines what is seen, while others have implicated entirely attention-independent processes in driving alternations during bistable perception. We review the body of literature addressing this divide and conclude that in fact both sides are correct-depending on the form of bistable perception being considered. Converging evidence suggests that visual attention is required for alternations in the type of bistable perception called binocular rivalry, while alternations during other types of bistable perception appear to continue without requiring attention. We discuss some implications of this differential effect of attention for our understanding of the mechanisms underlying bistable perception, and examine how these mechanisms operate during our everyday visual experiences.

The Role of Voluntary and Involuntary Attention in Selecting Perceptual Dominance during Binocular Rivalry

When incompatible images are presented to corresponding regions of each eye, perception alternates between the two monocular views (binocular rivalry). In this study, we have investigated how involuntary (exogenous) and voluntary (endogenous) attention can influence the perceptual dominance of one rival image or the other during contour rivalry. Subjects viewed two orthogonal grating stimuli that were presented to both eyes. Involuntary attention was directed to one of the grating stimuli with a brief change in orientation. After a short period, the cued grating was removed from the image in one eye and the uncued grating was removed from the image in the other eye, generating binocular rivalry. Subjects usually reported dominance of the cued grating during the rivalry period. We found that the influence of the cue declined with the interval between its onset and the onset of binocular rivalry in a manner consistent with the effect of involuntary attention. Finally, we demonstrated that voluntary attention to a grating stimulus could also influence the ongoing changes in perceptual dominance that accompany longer periods of binocular rivalry. Voluntary attention did not increase the mean dominance period of the attended grating, but rather decreased the mean dominance period of the non-attended grating. This pattern is analogous to increasing the perceived contrast of the attended grating. These results suggest that the competition during binocular rivalry might be an example of a more general attentional mechanism within the visual system.

Psychophysical "blinding" methods reveal a functional hierarchy of unconscious visual processing

Numerous non-invasive experimental "blinding" methods exist for suppressing the phenomenal awareness of visual stimuli. Not all of these suppressive methods occur at, and thus index, the same level of unconscious visual processing. This suggests that a functional hierarchy of unconscious visual processing can in principle be established. The empirical results of extant studies that have used a number of different methods and additional reasonable theoretical considerations suggest the following tentative hierarchy. At the highest levels in this hierarchy is unconscious processing indexed by object-substitution masking. The functional levels indexed by crowding, the attentional blink (and other attentional blinding methods), backward pattern masking, metacontrast masking, continuous flash suppression, sandwich masking, and single-flash interocular suppression, fall at progressively lower levels, while unconscious processing at the lowest levels is indexed by eye-based binocular-rivalry suppression. Although unconscious processing levels indexed by additional blinding methods is yet to be determined, a tentative placement at lower levels in the hierarchy is also given for unconscious processing indexed by Troxler fading and adaptation-induced blindness, and at higher levels in the hierarchy indexed by attentional blinding effects in addition to the level indexed by the attentional blink. The full mapping of levels in the functional hierarchy onto cortical activation sites and levels is yet to be determined. The existence of such a hierarchy bears importantly on the search for, and the distinctions between, neural correlates of conscious and unconscious vision.

Age-related deficits in attentional control of perceptual rivalry

Some aspects of attentional processing are known to decline with normal aging. To understand how age affects the attentional control of perceptual stability, we investigated age-related changes in voluntarily controlled perceptual rivalry. Durations of the dominant percept, produced by an ambiguous Rubin vase-faces figure, were measured in conditions that required passive viewing and attentional control: holding and switching the dominant percept. During passive viewing, mean dominance duration in the older group was significantly longer (63%) than the dominance duration found in the young group. This age-related deficit could be due to a decline in the apparent strength of the alternating percepts as a result of higher contrast gain of visual cortical activity and a reduction in the amount of attentional resources allocated to the ambiguous stimulus in older people compared to young adults. In comparison to passive viewing, holding the dominant percept did not significantly alter the dominance durations in the older group, while the dominance durations in the young group were increased (∼100%). The dominance durations for both age groups in switch conditions were reduced compared to their passive viewing durations (∼40%). The inability of older people to voluntarily prolong the duration of the dominant percept suggests that they may have abnormal attentional mechanisms, which are inefficient at enhancing the effective strength of the dominant percept. Results suggest that older adults have difficulty holding attended visual objects in focus, a problem that could affect their ability to carry out everyday tasks.

A Model for Perceptual Averaging and Stochastic Bistable Behavior and the Role of Voluntary Control

We combine population coding, winner-take-all competition, and differentiated inhibitory feedback to model the process by which information from different, continuously variable signals is integrated for perceptual awareness. We focus on “slant rivalry,” where binocular disparity is in conflict with monocular perspective in specifying surface slant. Using a robust single parameter set, our model successfully replicates three key experimental results: (1) transition from signal averaging to bistability with increasing signal conflict, (2) change in perceptual reversal rates as a function of signal conflict, and (3) a shift in the distribution of percept durations through voluntary control exertion. Voluntary control is implemented through the use of a single top-down bias input. The transition from signal averaging to bistability arises as a natural consequence of combining population coding and wide receptive fields, common to higher cortical areas. The model architecture does not contain any assumption that would limit it to this particular example of stimulus rivalry. An emergent physiological interpretation is that differentiated inhibitory feedback may play an important role for increasing percept stability without reducing sensitivity to large stimulus changes, which for bistable conditions leads to increased alternation rate as a function of signal conflict.

Chapter 8 Beyond a relay nucleus: neuroimaging views on the human LGN

The lateral geniculate nucleus (LGN) is the thalamic station in the retinocortical projection and has traditionally been viewed as the gateway for sensory information to enter the cortex. Here, we review recent studies of the human LGN that have investigated the retinotopic organization, physiologic response properties, and modulation of neural activity by selective attention and by visual awareness in a binocular rivalry paradigm. In the retinotopy studies, we found that the contralateral visual field was represented with the lower field in the medial-superior portion and the upper field in the lateral-inferior portion of each LGN. The fovea was represented in posterior and superior portions, with increasing eccentricities represented more anteriorly. Functional MRI responses increased monotonically with stimulus contrast in the LGN and in visual cortical areas. In the LGN, the dynamic response range of the contrast function was larger and contrast gain was lower than in the cortex. In our attention studies, we found that directed attention to a spatial location modulated neural activity in the LGN in several ways: it enhanced neural responses to attended stimuli, attenuated responses to ignored stimuli, and increased baseline activity in the absence of visual stimulation. Furthermore, we showed in a binocular rivalry paradigm that neural activity in the LGN correlated strongly with the subjects' reported percepts. The overall view that emerges from these studies is that the human LGN plays a role in perception and cognition far beyond that of a relay nucleus and, rather, needs to be considered as an early gatekeeper in the control of visual attention and awareness.

Neural correlates of binocular rivalry in the human lateral geniculate nucleus

When dissimilar images are presented to the two eyes, they compete for perceptual dominance so that only one image is visible at a time while the other one is suppressed. Neural correlates of such binocular rivalry have been found at multiple stages of visual processing, including striate and extrastriate visual cortex. However, little is known about the role of subcortical processing during binocular rivalry. Here we used fMRI to measure neural activity in the human LGN while subjects viewed contrast-modulated gratings presented dichoptically. Neural activity in the LGN correlated strongly with the subjects' reported percepts, such that activity increased when a high-contrast grating was perceived and decreased when a low-contrast grating was perceived. Our results provide evidence for a functional role of the LGN in binocular rivalry and suggest that the LGN, traditionally viewed as the gateway to the visual cortex, may be an early gatekeeper of visual awareness.

Independent binocular integration for form and colour

Although different features of an object are processed in anatomically distinct regions of the cerebral cortex, they often appear bound together in perception. Here, using binocular rivalry, we reveal that the awareness of form can occur independently from the awareness of colour. First, we report that, if both eyes briefly view a grating stimulus prior to the presentation of the same grating in one eye and an orthogonal grating in the other, subjects tend to report perceptual dominance of the non-primed grating. The primer was most effective when it was similar in orientation, spatial frequency and spatial phase to one of the rival images. Next, we showed that the process underlying the binocular integration of chromatic information was selectively influenced by the colour of a previously presented stimulus. We then combined these paradigms by using a primer that had the same colour as one rival stimulus, but the same form as the other stimulus. In this situation, we found that rival stimuli differing in form and colour can sometimes achieve states of dominance in which the chromatic information from one eye's image combines with the form of the other eye's image temporarily creating a binocular impression that corresponds with neither monocular component. Finally, we demonstrated that during continuous viewing of rival stimuli differing in form and colour, chromatic integration could occur independently of form rivalry. Paradoxically, however, we found that changes to the form of the stimulus had more of an influence on chromatic integration than on form rivalry. Together these phenomena show that the neural processes involved in integrating information from the two eyes can operate selectively on different stimulus features.

The depth and selectivity of suppression in binocular rivalry

Binocular rivalry occurs when the two eyes are presented with incompatible stimuli and the perceived image alternates between the two stimuli. The aim of this study was to find out whether the periodic perceptual loss of a monocular stimulus during binocular rivalry is mirrored by a comparable loss of contrast sensitivity. We presented brief test stimuli to one eye while its conditioning stimulus was dominant or suppressed. The test stimuli were varied widely across four stimulus domains--namely, the relative stimulation of medium- and long-wavelength-sensitive cones, duration, spatial frequency, and grating orientation. The result in each case was the same. Suppression depended slightly or not at all on the type of test stimulus, and contrast sensitivity during suppression was around 64% of that during dominance. The effect of suppression on sensitivity is therefore very weak, relative to its effect on the perceived image. Furthermore, suppression was largely independent of the similarity between the conditioning and the test stimuli, indicating that our results are better explained by eye suppression than by stimulus suppression. A model is presented to account for the small, monocular sensitivity loss during suppression: It assumes that test detection precedes conditioning stimulus perception in the visual pathway.

Monocular lustre from flicker

A spot that flickers at 16 Hz between two luminance levels (on a grey surround) has an appearance of metallic lustre, which we call 'monocular lustre'. Binocular and monocular lustre were measured in comparable conditions by a rating procedure, and both were reported only when the light and dark values of the flickering (or binocularly fused) spot straddled the surround luminance, so that the spot was alternately brighter and darker than the surround. We attribute lustre to competition between ON and OFF visual pathways.

Configuration saliency revealed in short duration binocular rivalry

Supra-threshold spatial integration was studied by testing the saliency of multi-Gabor element configurations in short duration binocular rivalry (dichoptic masking) conditions. Dichoptic presentations allow for a competition between spatially overlapping supra-threshold stimuli that involve non-overlapping monocular receptive fields in the first stage of visual filtering. Different spatial configurations of Gabor patches (sigma = lambda = 0.12 degree) were presented to one eye (target) together with a bandpass noise presented to the other eye (mask). After a short rivalry period (120 ms) in which a dominance of one eye was established, a probe (a randomly positioned small rectangle of reduced contrast in the target) was presented for additional detection period (80 ms). Probe detection performance was measured (two-alternative-forced choice paradigm (2AFC) by finding the mask contrast leading to 79% correct response. Results show that configuration saliency is consistently expressed as dominance in short-duration binocular rivalry, with similar results obtained for longer durations (200 ms and continuous presentations). We find that textures of high-contrast randomly oriented patches are more dominant than uniform textures where the effect decreases and eventually reverses with decreasing of contrast. For supra-threshold contours, however, we find that smooth collinear contours are more dominant than 'jagged' ones, regardless of phase and contrast. These findings suggest principles underlying early lateral integration mechanisms based on contrast dependent inhibitory and excitatory connections. This mechanism could be based on iso-orientation surround (2D) inhibition and collinear (1D) facilitation, with inhibition being more effective at high contrasts.

Single units and conscious vision

Figures that can be seen in more than one way are invaluable tools for the study of the neural basis of visual awareness, because such stimuli permit the dissociation of the neural responses that underlie what we perceive at any given time from those forming the sensory representation of a visual pattern. To study the former type of responses, monkeys were subjected to binocular rivalry, and the response of neurons in a number of different visual areas was studied while the animals reported their alternating percepts by pulling levers. Perception-related modulations of neural activity were found to occur to different extents in different cortical visual areas. The cells that were affected by suppression were almost exclusively binocular, and their proportion was found to increase in the higher processing stages of the visual system. The strongest correlations between neural activity and perception were observed in the visual areas of the temporal lobe. A strikingly large number of neurons in the early visual areas remained active during the perceptual suppression of the stimulus, a finding suggesting that conscious visual perception might be mediated by only a subset of the cells exhibiting stimulus selective responses. These physiological findings, together with a number of recent psychophysical studies, offer a new explanation of the phenomenon of binocular rivalry. Indeed, rivalry has long been considered to be closely linked with binocular fusion and stereopsis, and the sequences of dominance and suppression have been viewed as the result of competition between the two monocular channels. The physiological data presented here are incompatible with this interpretation. Rather than reflecting interocular competition, the rivalry is most probably between the two different central neural representations generated by the dichoptically presented stimuli. The mechanisms of rivalry are probably the same as, or very similar to, those underlying multistable perception in general, and further physiological studies might reveal much about the neural mechanisms of our perceptual organization.

A hierarchical model of binocular rivalry

Binocular rivalry is the alternating percept that can result when the two eyes see different scenes. Recent psychophysical evidence supports the notion that some aspects of binocular rivalry bear functional similarities to other bistable percepts. We build a model based on the hypothesis (Logothetis & Schall, 1989; Leopold & Logothetis, 1996; Logothetis, Leopold & Sheinberg, 1996) that alternation can be generated by competition between top-down cortical explanations for the inputs, rather than by direct competition between the inputs. Recent neurophysiological evidence shows that some binocular neurons are modulated with the changing percept; others are not, even if they are selective between the stimuli presented to the eyes. We extend our model to a hierarchy to address these effects.

No binocular rivalry in the LGN of alert macaque monkeys

Orthogonal drifting gratings were presented binocularly to alert macaque monkeys in an attempt to find neural correlates of binocular rivalry. Gratings were centered over lateral geniculate nucleus (LGN) receptive fields and the corresponding points for the opposite eye. The only task of the monkey was to fixate. We found no difference between the responses of LGN neurons under rivalrous and nonrivalrous conditions, as determined by examining the ratios of their respective power spectra. There was, however, a curious "temporal afterimage" effect in which cell responses continued to be modulated at the drift frequency of the grating for several seconds after the grating disappeared.

Interocular suppression in the primary visual cortex: a possible neural basis of binocular rivalry

In an attempt to demonstrate a physiological basis for the alternating suppression of perception when the two eyes view very different contours (binocular rivalry), we studied the responses of neurons in the lateral geniculate nucleus (LGN) and area 17 of cats for drifting gratings of different orientation, spatial frequency and contrast in the two eyes. Almost half of the LGN neurons studied exhibited modest inhibitory interocular interaction, but independent of interocular differences in orientation. Monocularly driven units in layer 4 of area 17 behaved similarly. However, for the majority of binocular cortical cells, the response to a grating of optimal orientation in one eye was suppressed by a grating of very different orientation shown to the other eye, over a wide range of spatial frequency and independent of relative spatial phase. This interocular suppression exhibits a remarkable non-linearity: a grating of non-preferred orientation in one eye causes significant interocular suppression only if the neuron is already responding to an appropriate stimulus in the other eye [Sengpiel and Blakemore (1994) Nature, 368, 847-850]. We propose that the switches in perceptual dominance during binocular rivalry depend on interocular interactions at the level of binocular neurons of the primary visual cortex, which might involve intracortical inhibition between adjacent ocular dominance columns. The spontaneous alternations in perceptual suppression that occur during prolonged viewing of rivalrous patterns remain to be explained, although significant variation in the strength of neuronal suppression in such conditions was occasionally seen.

Binocular rivalry disrupts stereopsis

Does the shift from binocular rivalry to fusion or stereopsis take time? We measured stereoacuity after rivalry suppression of one half-image of a stereoacuity line target. After the observer signalled that the single stereo half-image had been suppressed, the other half-image was presented for a variable duration. Stereoacuity thresholds were elevated for 150-200 ms. A control experiment demonstrated that the threshold elevation was due to rivalry suppression per se, rather than masking effects associated with the rivalry-inducing target. Monocular Vernier thresholds, measured as the smallest identifiable abrupt shift in the upper line of an aligned Vernier target that had previously been suppressed by rivalry, were elevated for a much longer duration. This result shows that an appropriately matched stereo pair can break rivalry suppression more easily than can monocular changes in position. With the aid of a similar paradigm, we also measured the duration needed to detect a disparate feature in a random-dot stereogram after rivalry suppression of one half-image of the stereogram. Observers could correctly identify the location of the disparate feature (upper or lower visual field) when the other half-image was presented for a duration ranging from 150-650 ms. In the absence of the matching half-image, the first half-image was suppressed by the rival target for a far longer duration (a few seconds). These findings show that although stereopsis and fusion terminate rivalry, both are initially disrupted for a few hundred milliseconds by rivalry suppression.

Visually guided attention is neutralized when informative cues are visible but unperceived

The ability to voluntarily shift the focus of visual attention away from the focus of gaze was investigated in a novel paradigm designed to elaborate the stages of processing underlying this ability. A basic experimental method used to investigate guided visual attention involves measuring response times to targets presented at positions of which the observer has been informed by an orienting cue. Binocular rivalry was utilized to dissociate presentation of the orienting cue from visual awareness of that cue. The findings indicated that when an informative cue was presented to an eye during the dominance phase, thus reaching visual awareness, manual response times were significantly affected by cue validity. In contrast, when the same cue was presented to an eye during suppression, and thus was not seen by observers, response times were not influenced by cue validity. We conclude that to guide attention, neural signals registering informative visual cues must be processed at stages lying beyond the site of rivalry suppression. Implications for investigating the neural basis of visual attention are discussed.