Binocular rivalry is not chaotic

Quantum formalism to describe binocular rivalry

On the basis of the general character and operation of the process of perception, a formalism is sought to mathematically describe the subjective or abstract/mental process of perception. It is shown that the formalism of orthodox quantum theory of measurement, where the observer plays a key role, is a broader mathematical foundation which can be adopted to describe the dynamics of the subjective experience. The mathematical formalism describes the psychophysical dynamics of the subjective or cognitive experience as communicated to us by the subject. Subsequently, the formalism is used to describe simple perception processes and, in particular, to describe the probability distribution of dominance duration obtained from the testimony of subjects experiencing binocular rivalry. Using this theory and parameters based on known values of neuronal oscillation frequencies and firing rates, the calculated probability distribution of dominance duration of rival states in binocular rivalry under various conditions is found to be in good agreement with available experimental data. This theory naturally explains an observed marked increase in dominance duration in binocular rivalry upon periodic interruption of stimulus and yields testable predictions for the distribution of perceptual alteration in time.

Intermittent ambiguous stimuli: implicit memory causes periodic perceptual alternations

When viewing a stimulus that has multiple plausible real-world interpretations, perception alternates between these interpretations every few seconds. Alternations can be halted by intermittently removing the stimulus from view. The same interpretation dominates over many successive presentations, and perception stabilizes. Here we study perception during long sessions of such intermittent presentation. We demonstrate that, rather than causing truly stable perception, intermittent presentation gives rise to a perceptual alternation cycle with its own characteristics and dependencies, different from those during continuous presentation. Alternations during intermittent viewing typically occur once every few minutes--much less frequently than the seconds-scale alternations during continuous viewing. Strikingly, alternations during intermittent viewing occur at fairly regular intervals, making for a surprisingly periodic alternation cycle. The duration of this cycle becomes longer as the blank duration between presentations is increased, reaching dozens of minutes in some cases. We interpret our findings in terms of a mathematical model that describes a neural network with competition between alternative interpretations. Network sensitivities depend on prior dominance, thus providing a memory for past perception. Slow changes in sensitivity produce both perceptual stabilization and the regular but infrequent alternations, meaning that the same memory traces are responsible for both. This model provides a good description of psychophysical findings, and offers several indications regarding their neural basis.

Size matters: a study of binocular rivalry dynamics

W.J.M. Levelt systematized the influence of stimulus strength on binocular rivalry dynamics in several formal propositions. His counterintuitive 2nd proposition states that mean dominance duration of one eye's stimulus depends not on the strength of that stimulus but, instead, on the strength of the stimulus viewed by the other eye. Some studies have reported results consistent with this proposition but others have found violations of the proposition. This paper examines the dynamics of binocular rivalry by changing the size of rival stimuli and the tracking instructions during rivalry tracking periods in which the contrasts of the two rival stimuli are varied independently. Levelt's 2nd proposition was validated when those stimuli were large, but it was violated when the rival stimuli were small, suggesting that the dynamics of binocular rivalry are spatiotemporal in nature. A simple energy model with coupling among neighboring areas of rivalry can account for these findings. Other dynamics depending on the size of rival stimuli are discussed.

Balance between noise and adaptation in competition models of perceptual bistability

Perceptual bistability occurs when a physical stimulus gives rise to two distinct interpretations that alternate irregularly. Noise and adaptation processes are two possible mechanisms for switching in neuronal competition models that describe the alternating behaviors. Either of these processes, if strong enough, could alone cause the alternations in dominance. We examined their relative role in producing alternations by studying models where by smoothly varying the parameters, one can change the rhythmogenesis mechanism from being adaptation-driven to noise-driven. In consideration of the experimental constraints on the statistics of the alternations (mean and shape of the dominance duration distribution and correlations between successive durations) we ask whether we can rule out one of the mechanisms. We conclude that in order to comply with the observed mean of the dominance durations and their coefficient of variation, the models must operate within a balance between the noise and adaptation strength-both mechanisms are involved in producing alternations, in such a way that the system operates near the boundary between being adaptation-driven and noise-driven.

Long-term speeding in perceptual switches mediated by attention-dependent plasticity in cortical visual processing

Binocular rivalry has been extensively studied to understand the mechanisms that control switches in visual awareness and much has been revealed about the contributions of stimulus and cognitive factors. Because visual processes are fundamentally adaptive, however, it is also important to understand how experience alters the dynamics of perceptual switches. When observers viewed binocular rivalry repeatedly over many days, the rate of perceptual switches increased as much as 3-fold. This long-term rivalry speeding exhibited a pattern of image-feature specificity that ruled out primary contributions from strategic and nonsensory factors and implicated neural plasticity occurring in both low- and high-level visual processes in the ventral stream. Furthermore, the speeding occurred only when the rivaling patterns were voluntarily attended, suggesting that the underlying neural plasticity selectively engages when stimuli are behaviorally relevant. Long-term rivalry speeding may thus reflect broader mechanisms that facilitate quick assessments of signals that contain multiple behaviorally relevant interpretations.

Binocular rivalry and head-worn displays

OBJECTIVE

We provide a review and analysis of much of the published literature on binocular rivalry that is relevant to the design and use of head-worn displays (HWDs).

BACKGROUND

This review draws heavily from both the basic vision literature and applied HWD literature in order to help provide insight for minimizing the effects of binocular rivalry when HWDs are worn.

METHOD

Included in this review are articles and books found cited in other works as well as articles and books obtained from an Internet search.

RESULTS

Issues discussed and summarized are (a) characteristics of binocular rivalry, (b) stimulus factors affecting rivalry, (c) cognitive variables affecting rivalry, and (d) tasks affected by rivalry.

CONCLUSION

This paper offers a set of recommendations for minimizing the effects of binocular rivalry when HWDs are used as well as recommendations for future research.

APPLICATION

Considerations of the basic vision literature on binocular rivalry will provide insight for future design solutions for HWDs.

Mountains and valleys: binocular rivalry and the flow of experience

Binocular rivalry provides a useful situation for studying the relation between the temporal flow of conscious experience and the temporal dynamics of neural activity. After proposing a phenomenological framework for understanding temporal aspects of consciousness, we review experimental research on multistable perception and binocular rivalry, singling out various methodological, theoretical, and empirical aspects of this research relevant to studying the flow of experience. We then review an experimental study from our group explicitly concerned with relating the temporal dynamics of rivalrous experience to the temporal dynamics of cortical activity. Drawing attention to the importance of dealing with ongoing activity and its inherent changing nature at both phenomenological and neurodynamical levels, we argue that the notions of recurrence and variability are pertinent to understanding rivalry in particular and the flow of experience in general.

Noise-induced alternations in an attractor network model of perceptual bistability

When a stimulus supports two distinct interpretations, perception alternates in an irregular manner between them. What causes the bistable perceptual switches remains an open question. Most existing models assume that switches arise from a slow fatiguing process, such as adaptation or synaptic depression. We develop a new, attractor-based framework in which alternations are induced by noise and are absent without it. Our model goes beyond previous energy-based conceptualizations of perceptual bistability by constructing a neurally plausible attractor model that is implemented in both firing rate mean-field and spiking cell-based networks. The model accounts for known properties of bistable perceptual phenomena, most notably the increase in alternation rate with stimulation strength observed in binocular rivalry. Furthermore, it makes a novel prediction about the effect of changing stimulus strength on the activity levels of the dominant and suppressed neural populations, a prediction that could be tested with functional MRI or electrophysiological recordings. The neural architecture derived from the energy-based model readily generalizes to several competing populations, providing a natural extension for multistability phenomena.

A Model for Perceptual Averaging and Stochastic Bistable Behavior and the Role of Voluntary Control

We combine population coding, winner-take-all competition, and differentiated inhibitory feedback to model the process by which information from different, continuously variable signals is integrated for perceptual awareness. We focus on “slant rivalry,” where binocular disparity is in conflict with monocular perspective in specifying surface slant. Using a robust single parameter set, our model successfully replicates three key experimental results: (1) transition from signal averaging to bistability with increasing signal conflict, (2) change in perceptual reversal rates as a function of signal conflict, and (3) a shift in the distribution of percept durations through voluntary control exertion. Voluntary control is implemented through the use of a single top-down bias input. The transition from signal averaging to bistability arises as a natural consequence of combining population coding and wide receptive fields, common to higher cortical areas. The model architecture does not contain any assumption that would limit it to this particular example of stimulus rivalry. An emergent physiological interpretation is that differentiated inhibitory feedback may play an important role for increasing percept stability without reducing sensitivity to large stimulus changes, which for bistable conditions leads to increased alternation rate as a function of signal conflict.

Temporal Dynamics of Auditory and Visual Bistability Reveal Common Principles of Perceptual Organization

When dealing with natural scenes, sensory systems have to process an often messy and ambiguous flow of information. A stable perceptual organization nevertheless has to be achieved in order to guide behavior. The neural mechanisms involved can be highlighted by intrinsically ambiguous situations. In such cases, bistable perception occurs: distinct interpretations of the unchanging stimulus alternate spontaneously in the mind of the observer. Bistable stimuli have been used extensively for more than two centuries to study visual perception. Here we demonstrate that bistable perception also occurs in the auditory modality. We compared the temporal dynamics of percept alternations observed during auditory streaming with those observed for visual plaids and the susceptibilities of both modalities to volitional control. Strong similarities indicate that auditory and visual alternations share common principles of perceptual bistability. The absence of correlation across modalities for subject-specific biases, however, suggests that these common principles are implemented at least partly independently across sensory modalities. We propose that visual and auditory perceptual organization could rely on distributed but functionally similar neural competition mechanisms aimed at resolving sensory ambiguities.

Transient synchrony of distant brain areas and perceptual switching in ambiguous figures

We studied the relationship between perceptual switching in the Necker cube and long-distance transient phase synchronization in EEG. Transient periods of response related synchrony between parietal and frontal areas were observed. They start 800-600, ms prior to the switch response and occur in pairs. Four types of pairs could be distinguished, two of which are accompanied by transient alpha band activity in the occipital area. The results indicate that perceptual switching processes involve parietal and frontal areas; these are the ones that are normally associated with various cognitive processes. Sensory information in the visual areas is involved in some, but not in all, of switching processes. The intrinsic variability, as well as the participating areas, points to the role of strategic cognitive processes in perceptual switching.

Inertia and memory in ambiguous visual perception

Perceptual multistability during ambiguous visual perception is an important clue to neural dynamics. We examined perceptual switching during ambiguous depth perception using a Necker cube stimulus, and also during binocular rivalry. Analysis of perceptual switching time series using variance-sample size analysis, spectral analysis and time series shuffling shows that switching times behave as a 1/f noise and possess very long range correlations. The long memory feature contrasts sharply with the traditional satiation models of multistability, where the memory is not incorporated, as well as with recently published models of multistability and neural processing, where memory is excluded. On the other hand, the long memory feature favors the concept of "dynamic core" or coalition of neurons, where neurons form transient coalitions. Perceptual switching then corresponds to replacement of one coalition of neurons by another. The inertia and memory measures the stability of a coalition: a strong and stable coalition has to be won over by another similarly strong and stable coalition, resulting in long switching times. The complicated transient dynamics of competing coalitions of neurons may be addressable using a combination of functional imaging, measurement of frequency-tagged magnetoencephalography and frequency-tagged encephalography, simultaneous recordings of groups of neurons in many areas of the brain, and concepts from statistical mechanics and nonlinear dynamics theory.

Individual differences in perceptual switching rates; the role of occipital alpha and frontal theta band activity

Prolonged presentation of visually ambiguous figures leads to perceptual switching. Individual switching rates show great variability. The present study compares individuals with high versus low switching rates by investigating human scalp electroencephalogram and blink rates. Eight subjects viewed the Necker cube continuously and responded to perceptual switching by pressing a button. Frequent switchers showed characteristic occipital alpha and frontal theta band activity prior to a switch, whereas infrequent switchers did not. The alpha activity was specific to switching, the theta activity was generic to perceptual processing conditions. A negative correlation was observed between perceptual switching and blink rates. These results suggest that the ability to concentrate attentional effort on the task is responsible for the differences in perceptual switching rates.

Stochastic resonance in binocular rivalry

When a different image is presented to each eye, visual awareness spontaneously alternates between the two images--a phenomenon called binocular rivalry. Because binocular rivalry is characterized by two marginally stable perceptual states and spontaneous, apparently stochastic, switching between them, it has been speculated that switches in perceptual awareness reflect a double-well-potential type computational architecture coupled with noise. To characterize this noise-mediated mechanism, we investigated whether stimulus input, neural adaptation, and inhibitory modulations (thought to underlie perceptual switches) interacted with noise in such a way that the system produced stochastic resonance. By subjecting binocular rivalry to weak periodic contrast modulations spanning a range of frequencies, we demonstrated quantitative evidence of stochastic resonance in binocular rivalry. Our behavioral results combined with computational simulations provided insights into the nature of the internal noise (its magnitude, locus, and calibration) that is relevant to perceptual switching, as well as provided novel dynamic constraints on computational models designed to capture the neural mechanisms underlying perceptual switching.

Voluntary control and the dynamics of perceptual bi-stability

Voluntary control and conscious perception seem to be related: when we are confronted with ambiguous images we are in some cases and to some extent able to voluntarily select a percept. However, to date voluntary control has not been used in neurophysiological studies on the correlates of conscious perception, presumably because the dynamic of perceptual reversals was not suitable. We exposed the visual system to four ambiguous stimuli that instigate bi-stable perception: slant rivalry, orthogonal grating rivalry, house-face rivalry, and Necker cube rivalry. In the preceding companion paper [van Ee, R. (2005). Dynamics of perceptual bi-stability for stereoscopic slant rivalry and a comparison with grating, house-face, and Necker cube rivalry. Vision Research] we focussed on the temporal dynamics of the perceptual reversals. Here we examined the role of voluntary control in the dynamics of perceptual reversals. We asked subjects to attempt to hold percepts and to speed-up the perceptual reversals. The investigations across the four stimuli revealed qualitative similarities concerning the influence of voluntary control on the temporal dynamics of perceptual reversals. We also found differences. In comparison to the other rivalry stimuli, slant rivalry exhibits: (1) relatively long percept durations; (2) a relatively clear role of voluntary control in modifying the percept durations. We advocate that these aspects, alongside with its metrical (quantitative) aspects, potentially make slant rivalry an interesting tool in studying the neural underpinnings of visual awareness.

Dynamics of perceptual bi-stability for stereoscopic slant rivalry and a comparison with grating, house-face, and Necker cube rivalry

A way to study conscious perception is to expose the visual system to an ambiguous stimulus that instigates bi-stable perception. This provides the opportunity to study neural underpinnings related to the percepts rather than to the stimulus. We have recently developed a slant-rivalry paradigm that has beneficial metrical (quantitative) aspects and that exhibits temporal aspects of perceptual reversals that seemed to be under considerable voluntary control of the observer. Here we examined a range of different aspects of the temporal dynamics of the perceptual reversals of slant rivalry and we compared these with the dynamics of orthogonal grating rivalry, house-face rivalry, and Necker cube rivalry. We found that slant rivalry exhibits a qualitatively similar pattern of dynamics. The drift of the perceptual reversal rate, both across successive experimental repetitions, and across successive 35-s portions of data were similar. The sequential dependence of the durations of perceptual phases, too, revealed very similar patterns. The main quantitative difference, which could make slant rivalry a useful stimulus for future neurophysiological studies, is that the percept durations are relatively long compared to the other rivalry stimuli. In the paper that accompanies this paper [van Ee, R., van Dam, L. C. J., Brouwer, G. J. (2005). Voluntary control and the dynamics of perceptual bi-stability. Vision Research,] we focused on the role of voluntary control in the dynamics of perceptual reversals.

The Necker cube—an ambiguous figure disambiguated in early visual processing

How can our percept spontaneously change while the observed object stays unchanged? This happens with ambiguous figures, like the Necker cube. Explanations favor either bottom-up factors in early visual processing, or top-down factors near awareness. The EEG has a high temporal resolution, so event related potentials (ERPs) may help to throw light on these alternative explanations. However, the precise point in time of neural correlates of perceptual reversal is difficult to estimate. We developed a paradigm that overcomes this problem and found an early (120 ms) occipital ERP signal correlated with endogenous perceptual reversal. Parallels of ambiguous-figure-reversal to binocular-rivalry-reversals are explored.

Both monocular and binocular signals contribute to motion rivalry

There is an ongoing debate on whether binocular rivalry involves competition among monocular cells or binocular cells. We investigated this issue psychophysically with two specially designed test stimuli. One test stimulus contained monocular motion signals but greatly reduced binocular motion signals, while the other contained binocular motion signals but no monocular motion signals. For comparison, we also employed a normal rivalrous control containing both monocular and binocular motion signals, and a non-rivalrous flicker-noise control with neither monocular nor binocular motion signals. We found that binocular rivalry for the two test stimuli was significantly reduced compared with the normal rivalrous control, but not completely eliminated compared with the non-rivalrous control. Therefore, both monocular and binocular motion signals appear to contribute to motion rivalry, suggesting that motion rivalry must involve competition among both monocular and binocular cells.

Lateral neural model of binocular rivalry

This article introduces a two-dimensionally extended, neuron-based model for binocular rivalry. The basic block of the model is a certain type of astable multivibrator comprising excitatory and inhibitory neurons. Many of these blocks are laterally coupled on a medium range to provide a two-dimensional layer. Our model, like others, needs noise to reproduce typical stochastic oscillations. Due to its spatial extension, the noise has to be laterally correlated. When the contrast ratio of the pictures varies, their share of the perception time changes in a way that is known from comparable experimental data (Levelt, 1965; Mueller & Blake, 1989). This is a result of the lateral coupling and not a property of the single model block. The presentation of simple and suitable inhomogeneous stimuli leads to an easily describable perception of periodically moving pictures like propagating fronts or breathing spots. This suggests new experiments. Under certain conditions, a bifurcation from static to moving perceptions is predicted and may be checked and employed by future experiments. Recent "paradox" (Logothetis, 1999) observations of two different neuron classes in cortical areas MT (Logothetis & Schall, 1989) and V4 (Leopold & Logothetis, 1996), one that behaves alike under rivaling and nonrivaling conditions and another that drastically changes its behavior, are interpreted as being related to separate inhibitor neurons.

Background synaptic activity as a switch between dynamical states in a network

A bright red light may trigger a sudden motor action in a driver crossing an intersection: stepping at once on the brakes. The same red light, however, may be entirely inconsequential if it appears, say, inside a movie theater. Clearly, context determines whether a particular stimulus will trigger a motor response, but what is the neural correlate of this? How does the nervous system enable or disable whole networks so that they are responsive or not to a given sensory signal? Using theoretical models and computer simulations, I show that networks of neurons have a built-in capacity to switch between two types of dynamic state: one in which activity is low and approximately equal for all units, and another in which different activity distributions are possible and may even change dynamically. This property allows whole circuits to be turned on or off by weak, unstructured inputs. These results are illustrated using networks of integrate-and-fire neurons with diverse architectures. In agreement with the analytic calculations, a uniform background input may determine whether a random network has one or two stable firing levels; it may give rise to randomly alternating firing episodes in a circuit with reciprocal inhibition; and it may regulate the capacity of a center-surround circuit to produce either self-sustained activity or traveling waves. Thus, the functional properties of a network may be drastically modified by a simple, weak signal. This mechanism works as long as the network is able to exhibit stable firing states, or attractors.

A common oscillator for perceptual rivalries?

Perceptual rivalry is an oscillation of conscious experience that takes place despite univarying. if ambiguous, sensory input. Much current interest is focused on the controversy over the neural site of binocular rivalry, a variety of perceptual rivalry for which a number of different cortical regions have been implicated. Debate continues over the relative role of higher levels of processing compared with primary visual cortex and the suggestion that different forms of rivalry involve different cortical areas. Here we show that the temporal pattern of disappearance and reappearance in motion-induced blindness (MIB) (Bonneh et al, 2001 Nature 411 798-801) is highly correlated with the pattern of oscillation reported during binocular rivalry in the same individual. This correlation holds over a wide range of inter-individual variation. Temporal similarity in the two phenomena was strikingly confirmed by the effects of the hallucinogen LSD, which produced the same, extraordinary, pattern of increased rhythmicity in both kinds of perceptual oscillation. Furthermore. MIB demonstrates the two properties previously considered characteristic of binocular rivalry. Namely the distribution of dominance periods can be approximated by a gamma distribution and, in line with Levelt's second proposition of binocular rivalry, predominance of one perceptual phase can be increased through a reduction in the predominance time of the opposing phase. We conclude that (i) MIB is a form of perceptual rivalry, and (ii) there may be a common oscillator responsible for timing aspects of all forms of perceptual rivalry.

The dynamics of bi-stable alternation in ambiguous motion displays: a fresh look at plaids

Prolonged observations of moving plaids lead to bi-stable alternations between coherency and transparency. However, most studies of plaids used brief presentations and a 2AFC between the two interpretations, thus overlooking the dynamical aspect of plaid perception. In other domains, most notably binocular rivalry, it was shown that the dynamics of the bi-stable alternations reveal important insights about the underlying mechanisms. Here we develop methods to study the dynamics of plaid perception. Observers continually indicated their percept (coherency or transparency) during presentations that lasted 1-5 min. Two measures of the relative strength of the coherency percept were derived from those data: C/[C+T], the relative time spent seeing coherency, and RTtransp, the response time to report transparency. Those measures are independent of each other yet tightly correlated, and both show systematic relations to manipulations of plaid parameters. Furthermore, the two measures are sensitive to manipulations in wide parametric regimes, including ranges where brief-presentation methods suffer from "ceiling" and "floor" effects. We conclude that studying the dynamics of bi-stability in plaids can provide new and unsuspected findings about motion integration and segmentation.

Evidence for perceptual "trapping" and adaptation in multistable binocular rivalry

When a different pattern is presented to each eye, the perceived image spontaneously alternates between the two patterns (binocular rivalry); the dynamics of these bistable alternations are known to be stochastic. Examining multistable binocular rivalry (involving four dominant percepts), we demonstrated path dependence and on-line adaptation, which were equivalent whether perceived patterns were formed by single-eye dominance or by mixed-eye dominance. The spontaneous perceptual transitions tended to get trapped within a pair of related global patterns (e.g., opponent shapes and symmetric patterns), and during such trapping, the probability of returning to the repeatedly experienced patterns gradually decreased (postselection pattern adaptation). These results suggest that the structure of global shape coding and its adaptation play a critical role in directing spontaneous alternations of visual awareness in perceptual multistability.

A spiking neuron model for binocular rivalry

We present a biologically plausible model of binocular rivalry consisting of a network of Hodgkin-Huxley type neurons. Our model accounts for the experimentally and psychophysically observed phenomena: (1) it reproduces the distribution of dominance durations seen in both humans and primates, (2) it exhibits a lack of correlation between lengths of successive dominance durations, (3) variation of stimulus strength to one eye influences only the mean dominance duration of the contralateral eye, not the mean dominance duration of the ipsilateral eye, (4) increasing both stimuli strengths in parallel decreases the mean dominance durations. We have also derived a reduced population rate model from our spiking model from which explicit expressions for the dependence of the dominance durations on input strengths are analytically calculated. We also use this reduced model to derive an expression for the distribution of dominance durations seen within an individual.

Visual competition

Binocular rivalry--the alternations in perception that occur when different images are presented to the two eyes--has been the subject of intensive investigation for more than 160 years. The psychophysical properties of binocular rivalry have been well described, but newer imaging and electrophysiological techniques have not resolved the issue of where in the brain rivalry occurs. The most recent evidence supports a view of rivalry as a series of processes, each of which is implemented by neural mechanisms at different levels of the visual hierarchy. Although unanswered questions remain, this view of rivalry might allow us to resolve some of the controversies and apparent contradictions that have emerged from its study.

Dynamics of perceptual oscillations in form vision

Certain periodic dot patterns (Marroquin patterns) generate a percept of dynamically oscillating circles, and analogous effects were explored by op artists in the 1960s. Here we show psychophysically that circles are perceived in these patterns only around specific points that are quantitatively predicted by a neural model of configural units hypothesized to reside in cortical area V4. Circles superimposed on the pattern mask perception of illusory circles. A neural model of lateral inhibitory interactions among V4 configural units showing spike-frequency adaptation quantitatively accounts for the human data. The model is consistent with ideas on the neural basis of attention in V4, and it suggests that attention may be biased via neuromodulation of slow hyperpolarizing potentials in cortical neurons.

Multistable phenomena: changing views in perception

Traditional explanations of multistable visual phenomena (e.g. ambiguous figures, perceptual rivalry) suggest that the basis for spontaneous reversals in perception lies in antagonistic connectivity within the visual system. In this review, we suggest an alternative, albeit speculative, explanation for visual multistability - that spontaneous alternations reflect responses to active, programmed events initiated by brain areas that integrate sensory and non-sensory information to coordinate a diversity of behaviors. Much evidence suggests that perceptual reversals are themselves more closely related to the expression of a behavior than to passive sensory responses: (1) they are initiated spontaneously, often voluntarily, and are influenced by subjective variables such as attention and mood; (2) the alternation process is greatly facilitated with practice and compromised by lesions in non-visual cortical areas; (3) the alternation process has temporal dynamics similar to those of spontaneously initiated behaviors; (4) functional imaging reveals that brain areas associated with a variety of cognitive behaviors are specifically activated when vision becomes unstable. In this scheme, reorganizations of activity throughout the visual cortex, concurrent with perceptual reversals, are initiated by higher, largely non-sensory brain centers. Such direct intervention in the processing of the sensory input by brain structures associated with planning and motor programming might serve an important role in perceptual organization, particularly in aspects related to selective attention.

Single units and conscious vision

Figures that can be seen in more than one way are invaluable tools for the study of the neural basis of visual awareness, because such stimuli permit the dissociation of the neural responses that underlie what we perceive at any given time from those forming the sensory representation of a visual pattern. To study the former type of responses, monkeys were subjected to binocular rivalry, and the response of neurons in a number of different visual areas was studied while the animals reported their alternating percepts by pulling levers. Perception-related modulations of neural activity were found to occur to different extents in different cortical visual areas. The cells that were affected by suppression were almost exclusively binocular, and their proportion was found to increase in the higher processing stages of the visual system. The strongest correlations between neural activity and perception were observed in the visual areas of the temporal lobe. A strikingly large number of neurons in the early visual areas remained active during the perceptual suppression of the stimulus, a finding suggesting that conscious visual perception might be mediated by only a subset of the cells exhibiting stimulus selective responses. These physiological findings, together with a number of recent psychophysical studies, offer a new explanation of the phenomenon of binocular rivalry. Indeed, rivalry has long been considered to be closely linked with binocular fusion and stereopsis, and the sequences of dominance and suppression have been viewed as the result of competition between the two monocular channels. The physiological data presented here are incompatible with this interpretation. Rather than reflecting interocular competition, the rivalry is most probably between the two different central neural representations generated by the dichoptically presented stimuli. The mechanisms of rivalry are probably the same as, or very similar to, those underlying multistable perception in general, and further physiological studies might reveal much about the neural mechanisms of our perceptual organization.

A hierarchical model of binocular rivalry

Binocular rivalry is the alternating percept that can result when the two eyes see different scenes. Recent psychophysical evidence supports the notion that some aspects of binocular rivalry bear functional similarities to other bistable percepts. We build a model based on the hypothesis (Logothetis & Schall, 1989; Leopold & Logothetis, 1996; Logothetis, Leopold & Sheinberg, 1996) that alternation can be generated by competition between top-down cortical explanations for the inputs, rather than by direct competition between the inputs. Recent neurophysiological evidence shows that some binocular neurons are modulated with the changing percept; others are not, even if they are selective between the stimuli presented to the eyes. We extend our model to a hierarchy to address these effects.