A monocular contribution to stimulus rivalry

Binocularly-driven competing neural responses and the perceptual resolution of color

Competing rivalrous neural representations can be resolved at several levels of the visual system. Sustained percepts during interocular-switch rivalry (ISR), in which rivalrous left- and right-eye stimuli swap between eyes several times a second, often are attributed to competing binocularly driven neural representations of each rivalrous stimulus. An alternative view posits monocular neural competition together with a switch in eye dominance at the moment of each stimulus swap between eyes. Here, a range of experimental conditions was tested that would change the colors seen if mediated by eye dominance but not if by competition between binocularly driven responses. Observers viewed multiple chromatically rivalrous discs in various temporal and spatial patterns, and reported when all discs in view appeared the same color. Unlike typical ISR paradigms that swap the complete stimulus in each eye, some of the rivalrous discs were swapped at a different time, or faster frequency, than other discs. Monocular dominance of one eye at a time implies that all discs will rarely be seen as identical in color when some discs swap at a different frequency than others. On the other hand, competing binocularly driven neural responses are not affected by asynchronous swap timing among the individual discs. Results for every observer are in accord with competing responses at the level of binocularly driven, chromatically tuned neurons. Although an account based on eye dominance can be constructed using many small retinotopic zones that have independent timing for the moment of switching the dominant eye, competing binocularly driven responses are a more parsimonious explanation.

Interocular Grouping in Perceptual Rivalry Localized with fMRI

Bistable perception refers to a broad class of dynamically alternating visual illusions that result from ambiguous images. These illusions provide a powerful method to study the mechanisms that determine how visual input is integrated over space and time. Binocular rivalry occurs when subjects view different images in each eye, and a similar experience called stimulus rivalry occurs even when the left and right images are exchanged at a fast rate. Many previous studies have identified with fMRI a network of cortical regions that are recruited during binocular rivalry, relative to non-rivalrous control conditions (termed replay) that use physically changing stimuli to mimic rivalry. However, we show here for the first time that additional cortical areas are activated when subjects experience rivalry with interocular grouping. When interocular grouping occurs, activation levels broadly increase, with a slight shift towards right hemisphere lateralization. Moreover, direct comparison of binocular rivalry with and without grouping highlights strong focused activity in the intraparietal sulcus and lateral occipital areas, such as right-sided retinotopic visual areas LO1 and IP2, as well as activity in left-sided visual areas LO1, and IP0-IP2. The equivalent analyses for comparable stimulus (eye-swap) rivalry showed very similar results; the main difference is greater recruitment of the right superior parietal cortex for binocular rivalry, as previously reported. Thus, we found minimal interaction between the novel networks isolated here for interocular grouping, and those previously attributed to stimulus and binocular rivalry. We conclude that spatial integration (i.e,. image grouping/segmentation) is a key function of lateral occipital/intraparietal cortex that acts similarly on competing binocular stimulus representations, regardless of fast monocular changes.

A functional theory of bistable perception based on dynamical circular inference

When we face ambiguous images, the brain cannot commit to a single percept; instead, it switches between mutually exclusive interpretations every few seconds, a phenomenon known as bistable perception. While neuromechanistic models, e.g., adapting neural populations with lateral inhibition, may account for the dynamics of bistability, a larger question remains unresolved: how this phenomenon informs us on generic perceptual processes in less artificial contexts. Here, we propose that bistable perception is due to our prior beliefs being reverberated in the cortical hierarchy and corrupting the sensory evidence, a phenomenon known as “circular inference”. Such circularity could occur in a hierarchical brain where sensory responses trigger activity in higher-level areas but are also modulated by feedback projections from these same areas. We show that in the face of ambiguous sensory stimuli, circular inference can change the dynamics of the perceptual system and turn what should be an integrator of inputs into a bistable attractor switching between two highly trusted interpretations. The model captures various aspects of bistability, including Levelt’s laws and the stabilizing effects of intermittent presentation of the stimulus. Since it is related to the generic perceptual inference and belief updating mechanisms, this approach can be used to predict the tendency of individuals to form aberrant beliefs from their bistable perception behavior. Overall, we suggest that feedforward/feedback information loops in hierarchical neural networks, a phenomenon that could lead to psychotic symptoms when overly strong, could also underlie perception in nonclinical populations.

In cases of high ambiguity, our perceptual system cannot commit to a single percept and switches between different interpretations, giving rise to bistable perception. In this paper we outline a computational model of bistability based on the notion of circular inference, i.e. a form of suboptimal hierarchical inference in which priors and / or sensory inputs are reverberated and over-counted. We suggest that descending loops (i.e. reverberated priors) transform our perceptual system from a simple accumulator of sensory inputs into a bistable attractor, that switches between two highly-trusted interpretations. Using analytical methods we derive the necessary conditions for bistable perception to occur. We show that our dynamical circular inference model is able to capture many features of bistability, such as Levelt’s laws and the stabilizing effects of intermittent presentation of the stimulus. Finally we make novel predictions about the behavior of psychotic patients.

Conflict defined by global gestalt can modulate binocular rivalry suppression

Binocular rivalry suppression is thought to necessarily require local interocular conflict: the presence of incompatible image elements, such as orthogonal contours, in retinally corresponding regions of two monocular displays. Whether suppression can also be driven by conflict at the level of spatially nonlocal surface or object representations is unclear. Here, we kept local contour conflict constant while varying global conflict, defined by the gestalt formed by the two monocular displays. Specifically, each eye was presented with a grid of image elements (crosses or plusses), placed such that the two eyes’ individual grid elements did not directly overlap but the grids as a whole did. In a “shared motion” condition, all elements moved in unison, inviting a gestalt made up of all elements across both eyes; in a “different motions” condition, the elements’ trajectories differed between eyes, inviting a gestalt of two overlapping surfaces, each associated with one eye. Perceptual disappearances of image elements occurred more readily in the different motions condition, an observation that could not be explained by any between-condition differences in local contour conflict. In a second experiment, we furthermore established that, whereas perceptual disappearances in the shared motion condition tended to involve a single element at a time, in the different motions condition, multiple elements belonging to the same gestalt often disappeared together. These findings indicate that, even though binocular rivalry may critically rely on inhibition due to locally incompatible image elements, this inhibition also depends on the global gestalt to which these elements contribute.

Perceptual rivalry across animal species

This review in memoriam of Jack Pettigrew provides an overview of past and current research into the phenomenon of multistable perception across multiple animal species. Multistable perception is characterized by two or more perceptual interpretations spontaneously alternating, or rivaling, when animals are exposed to stimuli with inherent sensory ambiguity. There is a wide array of ambiguous stimuli across sensory modalities, ranging from the configural changes observed in simple line drawings, such as the famous Necker cube, to the alternating perception of entire visual scenes that can be instigated by interocular conflict. The latter phenomenon, called binocular rivalry, in particular caught the attention of the late Jack Pettigrew, who combined his interest in the neuronal basis of perception with a unique comparative biological approach that considered ambiguous sensation as a fundamental problem of sensory systems that has shaped the brain throughout evolution. Here, we examine the research findings on visual perceptual alternation and suppression in a wide variety of species including insects, fish, reptiles, and primates. We highlight several interesting commonalities across species and behavioral indicators of perceptual alternation. In addition, we show how the comparative approach provides new avenues for understanding how the brain suppresses opposing sensory signals and generates alternations in perceptual dominance.

Idiosyncratic preferences in transparent motion and binocular rivalry are dissociable

Previous studies revealed that there are idiosyncratic preferences to perceive certain motion directions in front during motion transparency depth rivalry (Mamassian & Wallace, 2010; Schütz, 2014). Meanwhile, other studies reported idiosyncratic preferences in binocular rivalry during the onset stage (Carter & Cavanagh, 2007; Stanley, Carter, & Forte, 2011). Here we investigated the relationship of idiosyncratic preferences in transparent motion and binocular rivalry. We presented two dot clouds that were moving in opposite directions. In the transparent motion condition, both dot clouds were presented to both eyes and participants had to report the dot cloud they perceived in front. In the binocular rivalry condition, the dot clouds were presented to different eyes and participants had to report the dominant dot cloud. There were strong idiosyncratic directional preferences in transparent motion and rather weak directional preferences in binocular rivalry. In general, binocular rivalry was dominated by biases in contrast polarity, whereas transparent motion was dominated by biases in motion direction. A circular correlation analysis showed no correlation between directional preferences in transparent motion and binocular rivalry. These findings show that idiosyncratic preferences in a visual feature can be dissociated at different stages of processing.

Methods to assess binocular rivalry with periodic stimuli

Binocular rivalry occurs when the two eyes are presented with incompatible stimuli and perception alternates between these two stimuli. This phenomenon has been investigated in two types of experiments: (1) Traditional experiments where the stimulus is fixed, (2) eye-swap experiments in which the stimulus periodically swaps between eyes many times per second (Logothetis et al. in Nature 380(6575):621-624, 1996). In spite of the rapid swapping between eyes, perception can be stable for many seconds with specific stimulus parameter configurations. Wilson introduced a two-stage, hierarchical model to explain both types of experiments (Wilson in Proc. Natl. Acad. Sci. 100(24):14499-14503, 2003). Wilson's model and other rivalry models have been only studied with bifurcation analysis for fixed inputs and different types of dynamical behavior that can occur with periodically forcing inputs have not been investigated. Here we report (1) a more complete description of the complex dynamics in the unforced Wilson model, (2) a bifurcation analysis with periodic forcing. Previously, bifurcation analysis of the Wilson model with fixed inputs has revealed three main types of dynamical behaviors: Winner-takes-all (WTA), Rivalry oscillations (RIV), Simultaneous activity (SIM). Our results have revealed richer dynamics including mixed-mode oscillations (MMOs) and a period-doubling cascade, which corresponds to low-amplitude WTA (LAWTA) oscillations. On the other hand, studying rivalry models with numerical continuation shows that periodic forcing with high frequency (e.g. 18 Hz, known as flicker) modulates the three main types of behaviors that occur with fixed inputs with forcing frequency (WTA-Mod, RIV-Mod, SIM-Mod). However, dynamical behavior will be different with low frequency periodic forcing (around 1.5 Hz, so-called swap). In addition to WTA-Mod and SIM-Mod, cycle skipping, multi-cycle skipping and chaotic dynamics are found. This research provides a framework for either assessing binocular rivalry models to check consistency with empirical results, or for better understanding neural dynamics and mechanisms necessary to implement a minimal binocular rivalry model.

Cholinergic Modulation of Binocular Vision

The endogenous neurotransmitter acetylcholine (ACh) is known to affect the excitatory/inhibitory (E/I) balance of primate visual cortex, enhancing feedforward thalamocortical gain while suppressing corticocortical synapses. Recent advances in the study of the human visual system suggest that ACh is a likely component underlying interocular interactions. However, our understanding of its precise role in binocular processes is currently lacking. Here we use binocular rivalry as a probe of interocular dynamics to determine ACh's effects, via the acetylcholinesterase inhibitor (AChEI) donepezil, on the binocular visual system. A total of 23 subjects (13 male) completed two crossover experimental sessions where binocular rivalry measurements were obtained before and after taking either donepezil (5 mg) or a placebo (lactose) pill. We report that enhanced cholinergic potentiation attenuates perceptual suppression during binocular rivalry, reducing the overall rate of interocular competition while enhancing the visibility of superimposition mixed percepts. Considering recent evidence that perceptual suppression during binocular rivalry is causally modulated by the inhibitory neurotransmitter GABA, our results suggest that cholinergic activity counteracts the effect of GABA with regards to interocular dynamics and may modulate the inhibitory drive within the visual cortex.SIGNIFICANCE STATEMENT Our research demonstrates that the cholinergic system is implicated in modulating binocular interactions in the human visual cortex. Potentiating the transmission of acetylcholine (ACh) via the cholinergic drug donepezil reduces the extent to which the eyes compete for perceptual dominance when presented two separate, incongruent images.

A hierarchical model of perceptual multistability involving interocular grouping

Ambiguous visual images can generate dynamic and stochastic switches in perceptual interpretation known as perceptual rivalry. Such dynamics have primarily been studied in the context of rivalry between two percepts, but there is growing interest in the neural mechanisms that drive rivalry between more than two percepts. In recent experiments, we showed that split images presented to each eye lead to subjects perceiving four stochastically alternating percepts (Jacot-Guillarmod et al. Vision research, 133, 37-46, 2017): two single eye images and two interocularly grouped images. Here we propose a hierarchical neural network model that exhibits dynamics consistent with our experimental observations. The model consists of two levels, with the first representing monocular activity, and the second representing activity in higher visual areas. The model produces stochastically switching solutions, whose dependence on task parameters is consistent with four generalized Levelt Propositions, and with experiments. Moreover, dynamics restricted to invariant subspaces of the model demonstrate simpler forms of bistable rivalry. Thus, our hierarchical model generalizes past, validated models of binocular rivalry. This neuromechanistic model also allows us to probe the roles of interactions between populations at the network level. Generalized Levelt's Propositions hold as long as feedback from the higher to lower visual areas is weak, and the adaptation and mutual inhibition at the higher level is not too strong. Our results suggest constraints on the architecture of the visual system and show that complex visual stimuli can be used in perceptual rivalry experiments to develop more detailed mechanistic models of perceptual processing.

Does feature integration affect resolution of multiple simultaneous forms of ambiguity?

Ambiguity resolution, perceptual grouping, and feature integration all occur seamlessly and subconsciously. When multiple regions of an image share ambiguous features, perceptual grouping can yield an integrated object percept rather than one of multiple objects, each with its individual features. Here, perceptual resolution and grouping of chromatically rivalrous Necker cubes were investigated in three experiments to determine the principles that underlie these coherent percepts. The first experiment showed perceptual grouping beyond independent resolution of each cube's color and orientation, but the second experiment did not show grouping greater than expected from separate color- and orientation-grouping processes. The third experiment found no reliable difference in grouping when two features (color and orientation) were part of the same object versus when they were distributed across separate objects. These findings fail to support a role for feature conjunctions in grouping objects with multiple ambiguous features.

Grouping ambiguous neural representations: neither identical chromaticity (the stimulus) nor color (the percept) is necessary

Multiple regions, each with the same ambiguous chromatic neural representation, are resolved to have the identical perceived color more often than chance [Proc. Natl. Acad. Sci. USA93, 15508 (1996)PNASA60027-842410.1073/pnas.93.26.15508; J. Opt. Soc. Am. A35, B85 (2018)JOAOD60740-323210.1364/JOSAA.35.000B85]. This reveals that the regions are grouped, but it is unclear whether they are grouped because each one has the identical competing representations of the same stimuli (that is, the same chromaticities) or, alternatively, identical competing representations of the same colors one sees. The current study uses chromatic induction, as in Nat. Neurosci.6, 801 (2003)NANEFN1097-625610.1038/nn1099, to disentangle whether grouping depends on identical (though ambiguous) stimulus chromaticities or on perceived colors, by (1) inducing one chromaticity to appear in two different colors or (2) inducing two different chromaticities to appear in the same color. All stimuli were equiluminant gratings with chromatic inducing and test fields. Three observers were tested, first completing color matches to measure induced color-appearance shifts and second completing grouping measurements using interocular-switch rivalry, a method with rivalrous dichoptic images swapped between the eyes at 3.75 Hz [J. Vis.17, 9 (2017)1534-736210.1167/17.5.9]. Each of two separate areas, one above and one below fixation, had dichoptic rivalry. The two sets of regions had either identical or different chromaticities that could appear either as the same color or not. Observers reported their percepts when both areas above and below fixation were grouped by color or by chromaticity (or neither in an additional experimental condition). All conditions showed significant groupings for every observer, including when neither color nor chromaticity was identical in a "group." Moreover, there was never a significant effect of chromaticity versus color for any observer. This is the result expected if neither color nor chromaticity must match between two regions in order for them to be grouped and suggests that, instead, some other feature drives grouping.

Eye swapping temporally modulates potency of continuous flash suppression

Continuous flash suppression (CFS) refers to a technique to render a monocular stimulus invisible by presenting a dynamic series of high-contrast patterns (such as Mondrian patterns) to the other eye. Despite its popularity as a tool to suppress stimulus from awareness, the suppression mechanisms underlying CFS remain not well understood. To further elucidate the suppression mechanisms, this study investigated the effects of eye swapping on CFS suppression by manipulating the eye of presentation of the suppressor and the target. Results showed that eye swapping of the suppressor and the target significantly reduced the strength of CFS suppression when swapping frequency was higher (3.5 Hz). However, strong suppression persisted at lower swapping frequency (1.2 Hz). Investigation of the time course of suppression revealed that suppression was weaker just after eye swapping but that it quickly regained strength over the monocular presentation period of the suppressor. However, this buildup seemed to not be fast enough to closely follow eye swapping at higher frequency. These findings can be better understood by the contribution of monocular processes to CFS suppression. They imply that interocular suppression caused by competition between monocular processes can mediate phenomenal suppression over multiple eye swaps when swapping frequency is low. The significance of the findings is discussed in relation to binocular rivalry and binocular switch suppression.

Eye swapping temporally modulates potency of continuous flash suppression

Continuous flash suppression (CFS) refers to a technique to render a monocular stimulus invisible by presenting a dynamic series of high-contrast patterns (such as Mondrian patterns) to the other eye. Despite its popularity as a tool to suppress stimulus from awareness, the suppression mechanisms underlying CFS remain not well understood. To further elucidate the suppression mechanisms, this study investigated the effects of eye swapping on CFS suppression by manipulating the eye of presentation of the suppressor and the target. Results showed that eye swapping of the suppressor and the target significantly reduced the strength of CFS suppression when swapping frequency was higher (3.5 Hz). However, strong suppression persisted at lower swapping frequency (1.2 Hz). Investigation of the time course of suppression revealed that suppression was weaker just after eye swapping but that it quickly regained strength over the monocular presentation period of the suppressor. However, this buildup seemed to not be fast enough to closely follow eye swapping at higher frequency. These findings can be better understood by the contribution of monocular processes to CFS suppression. They imply that interocular suppression caused by competition between monocular processes can mediate phenomenal suppression over multiple eye swaps when swapping frequency is low. The significance of the findings is discussed in relation to binocular rivalry and binocular switch suppression.

Temporary monocular occlusion facilitates binocular fusion during rivalry

A few hours of monocular patching temporarily enhances the deprived eye's contribution to binocular vision, constituting a form of adult brain plasticity. Although the mechanism for this plasticity is currently unknown, several imaging studies present evidence that monocular deprivation achieves its effects by changing excitatory-inhibitory balance in the visual cortex. Much of the past work on adult monocular patching utilized binocular rivalry to quantify the patching-induced shift in perceptual eye dominance, extracting periods of exclusive visibility (in which one eye's signal is suppressed from perception) to assess each eye's contribution to binocular vision while overlooking the occurrence of mixed visibility (in which information from both eyes is combined). In this paper, we discuss two experiments to investigate the effects of short-term monocular occlusion on the relative predominance of mixed and exclusive percepts during binocular rivalry. In addition to the known perceptual eye-dominance shift, we hypothesized patching would also increase the perception of mixtures during rivalry due to deprivation-induced changes in excitatory-inhibitory balance. Our data point to two previously unknown effects of monocular deprivation: (a) a significant increase in the overall fraction and median duration of mixed visibility during rivalry that is detectable up to at least an hour after removing the patch and (b) the overall fraction of superimposition; rather than piecemeal, mixed percepts are specifically enhanced after monocular deprivation. In addition to strengthening the contribution of the deprived eye, our results show that temporary monocular patching enhances the visibility of fused binocular percepts, likely the result of attenuated interocular inhibition.

Perceptual resolution of ambiguous neural representations for form and chromaticity

A coherent percept of our visual world is important for functioning. Ambiguities, however, are implicit in visual neural representations and must be resolved for stable perception of objects and scenes. Grouping processes can link multiple neurally ambiguous fragments across the visual field. Experiments here determined how multiple visual features of each fragment contribute to perceptual resolution of ambiguity by grouping. Chromatic interocular-switch rivalry, a technique for presenting competing dichoptic images, was used to induce ambiguous neural representations for equiluminant chromatic discs and gratings. Two dichoptic stimuli were presented simultaneously to measure the amount of time they both appeared the same in at least one feature domain. The two stimuli were grouped when they appeared to share ambiguous features such as color, orientation, and spatial frequency more often than chance. Experiments here tested whether unshared and unambiguous features impeded grouping of the ambiguous components. Overall, the results show that grouping can be driven by neural ambiguity that is common for fragments across the visual field, even when the fragments also have other unshared, unambiguous features.

Temporal dynamics of binocular integration in primary visual cortex

Whenever we open our eyes, our brain quickly integrates the two eyes' perspectives into a combined view. This process of binocular integration happens so rapidly that even incompatible stimuli are briefly fused before one eye's view is suppressed in favor of the other (binocular rivalry). The neuronal basis for this brief period of fusion during incompatible binocular stimulation is unclear. Neuroanatomically, the eyes provide two largely separate streams of information that are integrated into a binocular response by the primary visual cortex (V1). However, the temporal dynamics underlying the formation of this binocular response are largely unknown. To address this question, we examined the temporal profile of binocular responses in V1 of fixating monkeys. We found that V1 processes binocular stimuli in a dynamic sequence that comprises at least two distinct temporal phases. An initial transient phase is characterized by enhanced spiking responses for both compatible and incompatible binocular stimuli compared to monocular stimulation. This transient is followed by a sustained response that differed markedly between congruent and incongruent binocular stimulation. Specifically, incompatible binocular stimulation resulted in overall response reduction relative to monocular stimulation (binocular suppression). In contrast, responses to compatible stimuli were either suppressed or enhanced (binocular facilitation) depending on the neurons' ocularity (selectivity for one eye over the other) and laminar location. These results suggest that binocular integration in V1 occurs in at least two sequential steps that comprise initial additive combination of the two eyes' signals followed by widespread differentiation between binocular concordance and discordance.

Revisiting individual differences in the time course of binocular rivalry

Simultaneously showing an observer two incompatible displays, one to each eye, causes binocular rivalry, during which the observer regularly switches between perceiving one eye's display and perceiving the other. Observers differ in the rate of this perceptual cycle, and these individual differences have been reported to correlate with differences in the perceptual switch rate for other bistable perception phenomena. Identifying which psychological or neural factors explain this variability can help clarify the mechanisms underlying binocular rivalry and of bistable perception generally. Motivated by the prominent theory that perceptual switches during binocular rivalry are brought about by neural adaptation, we investigated whether perceptual switch rates are correlated with the strength of neural adaptation, indexed by visual aftereffects. We found no compelling evidence for such correlations. Moreover, we did not corroborate previous findings that switch rates are correlated between binocular rivalry and other forms of bistable perception. This latter nonreplication prompted us to perform a meta-analysis of existing research into correlations among forms of bistable perception, which revealed that evidence for such correlations is much weaker than is generally believed. By showing no common factor linking individual differences in binocular rivalry and in our other paradigms, these results fit well with other work that has shown such common factors to be rare among visual phenomena generally.

Stimulus rivalry and binocular rivalry share a common neural substrate

When two incompatible images are shown separately to each eye, a perceptual process known as binocular rivalry occurs by which the two images compete for awareness. The site of competition for binocular rivalry has been a topic of debate, and recent theories are that it may occur either at low levels of the visual system where the inputs from the two eyes are combined or at high levels of the visual system where the two images are processed. One of the major pieces of evidence for a high-level image account of rivalry is a phenomenon known as stimulus rivalry, in which two competing stimuli are swapped between the eyes at 3 Hz. However, there is little available neurophysiological evidence for a neural substrate for this high-level competition. Here, we used frequency tagging of two competing stimuli in binocular rivalry and stimulus rivalry in humans to evaluate whether the steady-state visually evoked potentials (SSVEPs) show similar signatures of neural competition for both conditions. We found that flickering the stimuli generates spectral power at the tagged frequencies in both types of rivalry in the early visual cortex. We then quantified dynamic signatures of competition by tracking amplitude changes in the frequency tags, which showed that both types of rivalry colocalized in occipital regions of the cortex. Thus, contrary to our hypothesis that stimulus rivalry was being mediated by high-level competition between the images, we find that neural competition measured by the SSVEP instead suggests that the sites of competition for stimulus rivalry and binocular rivalry may similarly include the occipital pole and middle temporal gyrus (hMT+/V5) of the visual system, consistent with a low-level, binocular interpretation.

Perceptual resolution of color for multiple chromatically ambiguous objects

In a classic study, Kovács et al. [Proc. Natl. Acad. Sci. USA93, 15508 (1996)PNASA60027-842410.1073/pnas.93.26.15508] used an array of many disks presented dichoptically with half of the disks in one eye "red" and the other half "green;" disk chromaticities in the fellow eye were reversed, resulting in binocular color rivalry for every disk, thus creating color ambiguity. Surprisingly, the binocularly fused percept sometimes was all disks of the same color (red or green), which showed that perceptual resolution of the many ambiguous neural representations did not rely completely on monocular dominance or on independent resolution for each disk. The present study replicates and expands on the original with the aim to isolate binocularly driven neural mechanisms of perceptual resolution without contamination from monocular dominance. Observers viewed a color-rivalrous array with 16 disks presented either steadily to each eye, as in Kovács et al., or with chromatic interocular-switch rivalry (CISR), which swaps the two images between the eyes every 133 ms. The total proportion of viewing time when the 16 disks were perceived to be all red or all green was measured. For three observers, the disks all appeared the same color more often with CISR than with steady rivalrous presentation, suggesting that monocular dominance interferes with grouped perceptual resolution of ambiguous stimuli in the Kovács paradigm. This conclusion was supported by an additional condition using CISR, but with every disk the same color in one eye at each instant (e.g., all "red" disks in one eye and all "green" in the other). This condition was never significantly different from the original CISR condition, as expected if CISR reveals only binocularly mediated perceptual resolution of the disks' color, irrespective of monocular neural representations. In conclusion, chromatically tuned binocularly driven neurons account for perceptual resolution of CISR.

Attention model of binocular rivalry

When the corresponding retinal locations in the two eyes are presented with incompatible images, a stable percept gives way to perceptual alternations in which the two images compete for perceptual dominance. As perceptual experience evolves dynamically under constant external inputs, binocular rivalry has been used for studying intrinsic cortical computations and for understanding how the brain regulates competing inputs. Converging behavioral and EEG results have shown that binocular rivalry and attention are intertwined: binocular rivalry ceases when attention is diverted away from the rivalry stimuli. In addition, the competing image in one eye suppresses the target in the other eye through a pattern of gain changes similar to those induced by attention. These results require a revision of the current computational theories of binocular rivalry, in which the role of attention is ignored. Here, we provide a computational model of binocular rivalry. In the model, competition between two images in rivalry is driven by both attentional modulation and mutual inhibition, which have distinct selectivity (feature vs. eye of origin) and dynamics (relatively slow vs. relatively fast). The proposed model explains a wide range of phenomena reported in rivalry, including the three hallmarks: (i) binocular rivalry requires attention; (ii) various perceptual states emerge when the two images are swapped between the eyes multiple times per second; (iii) the dominance duration as a function of input strength follows Levelt's propositions. With a bifurcation analysis, we identified the parameter space in which the model's behavior was consistent with experimental results.

Chromatic interocular-switch rivalry

Interocular-switch rivalry (also known as stimulus rivalry) is a kind of binocular rivalry in which two rivalrous images are swapped between the eyes several times a second. The result is stable periods of one image and then the other, with stable intervals that span many eye swaps (Logothetis, Leopold, & Sheinberg, 1996). Previous work used this close kin of binocular rivalry with rivalrous forms. Experiments here test whether chromatic interocular-switch rivalry, in which the swapped stimuli differ in only chromaticity, results in slow alternation between two colors. Swapping equiluminant rivalrous chromaticities at 3.75 Hz resulted in slow perceptual color alternation, with one or the other color often continuously visible for two seconds or longer (during which there were 15+ eye swaps). A well-known theory for sustained percepts from interocular-switch rivalry with form is inhibitory competition between binocular neurons driven by monocular neurons with matched orientation tuning in each eye; such binocular neurons would produce a stable response when a given orientation is swapped between the eyes. A similar model can account for the percepts here from chromatic interocular-switch rivalry and is underpinned by the neurophysiological finding that color-preferring binocular neurons are driven by monocular neurons from each eye with well-matched chromatic selectivity (Peirce, Solomon, Forte, & Lennie, 2008). In contrast to chromatic interocular-switch rivalry, luminance interocular-switch rivalry with swapped stimuli that differ in only luminance did not result in slowly alternating percepts of different brightnesses.

Social Interactions Receive Priority to Conscious Perception

Humans are social animals, constantly engaged with other people. The importance of social thought and action is hard to overstate. However, is social information so important that it actually determines which stimuli are promoted to conscious experience and which stimuli are suppressed as invisible? To address this question, we used a binocular rivalry paradigm, in which the two eyes receive different action stimuli. In two experiments we measured the conscious percept of rival actions and found that actions engaged in social interactions are granted preferential access to visual awareness over non-interactive actions. Lastly, an attentional task that presumably engaged the mentalizing system enhanced the priority assigned to social interactions in reaching conscious perception. We also found a positive correlation between human identification of interactive activity and the promotion of socially-relevant information to visual awareness. The present findings suggest that the visual system amplifies socially-relevant sensory information and actively promotes it to consciousness, thereby facilitating inferences about social interactions.

Training of binocular rivalry suppression suggests stimulus-specific plasticity in monocular and binocular visual areas

The plasticity of the human brain, as shown in perceptual learning, is generally reflected by improved task performance after training. Here, we show that perceptual suppression can be increased through training. In the first experiment, binocular rivalry suppression of a specific orientation was trained, leading to a relative reduction in sensitivity to the trained orientation. In a second experiment, two orthogonal orientations were suppressed in alternating training blocks, in the left and right eye, respectively. This double-training procedure lead to reduced sensitivity for the orientation that was suppression-trained in each specific eye, implying that training of feature suppression is specific for the eye in which the oriented grating was presented during training. Results of a control experiment indicate that the obtained effects are indeed due to suppression during training, instead of being merely due to the repetitive presentation of the oriented gratings. Visual plasticity is essential for a person's visual development. The finding that plasticity can result in increased perceptual suppression reported here may prove to be significant in understanding human visual development. It emphasizes that for stable vision, not only the enhancement of relevant signals is crucial, but also the reliable and stable suppression of (task) irrelevant signals.

Individual differences in the temporal dynamics of binocular rivalry and stimulus rivalry

Binocular rivalry and stimulus rivalry are two forms of perceptual instability that arise when the visual system is confronted with conflicting stimulus information. In the case of binocular rivalry, dissimilar monocular stimuli are presented to the two eyes for an extended period of time, whereas for stimulus rivalry the dissimilar monocular stimuli are exchanged rapidly and repetitively between the eyes during extended viewing. With both forms of rivalry, one experiences extended durations of exclusive perceptual dominance that fluctuate between the two stimuli. Whether these two forms of rivalry arise within different stages of visual processing has remained debatable. Using an individual-differences approach, we found that both stimulus rivalry and binocular rivalry exhibited same-shaped distributions of dominance durations among a sample of 30 observers and, moreover, that the dominance durations measured during binocular and stimulus rivalry were significantly correlated among our sample of observers. Furthermore, we found a significant, positive correlation between alternation rate in binocular rivalry and the incidence of stimulus rivalry. These results suggest that the two forms of rivalry may be tapping common neural mechanisms, or at least different mechanisms with comparable time constants. It remains to be learned just why the incidences of binocular rivalry and stimulus rivalry vary so greatly among people.

Serial correlations in Continuous Flash Suppression

Research on visual rivalry has demonstrated that consecutive dominance durations are serially dependent, implying that the underlying competition mechanism is not driven by some random process but includes a memory component. Here we asked whether serial dependence is also observed in continuous flash suppression (CFS). We addressed this question by analyzing a large dataset of time series of suppression durations obtained in a series of so-called “breaking CFS” experiments in which the duration of the period is measured until a suppressed target breaks through the CFS mask. Across experimental manipulations, stimuli, and observers, we found that (i) the distribution of breakthrough rates was fit less well by a gamma distribution than in conventional visual rivalry paradigms, (ii) the suppression duration on a previous trial influenced the suppression duration on a later trial up to as long as a lag of eight trials, and (iii) the mechanism underlying these serial correlations was predominantly monocular. We conclude that the underlying competition mechanism of CFS also includes a memory component that is primarily, but not necessarily exclusively, monocular in nature. We suggest that the temporal dependency structure of suppression durations in CFS is akin to those observed in binocular rivalry, which might imply that both phenomena tap into similar rather than distinct mechanisms.

3D-MAD: A Full Reference Stereoscopic Image Quality Estimator Based on Binocular Lightness and Contrast Perception

Algorithms for a stereoscopic image quality assessment (IQA) aim to estimate the qualities of 3D images in a manner that agrees with human judgments. The modern stereoscopic IQA algorithms often apply 2D IQA algorithms on stereoscopic views, disparity maps, and/or cyclopean images, to yield an overall quality estimate based on the properties of the human visual system. This paper presents an extension of our previous 2D most apparent distortion (MAD) algorithm to a 3D version (3D-MAD) to evaluate 3D image quality. The 3D-MAD operates via two main stages, which estimate perceived quality degradation due to 1) distortion of the monocular views and 2) distortion of the cyclopean view. In the first stage, the conventional MAD algorithm is applied on the two monocular views, and then the combined binocular quality is estimated via a weighted sum of the two estimates, where the weights are determined based on a block-based contrast measure. In the second stage, intermediate maps corresponding to the lightness distance and the pixel-based contrast are generated based on a multipathway contrast gain-control model. Then, the cyclopean view quality is estimated by measuring the statistical-difference-based features obtained from the reference stereopair and the distorted stereopair, respectively. Finally, the estimates obtained from the two stages are combined to yield an overall quality score of the stereoscopic image. Tests on various 3D image quality databases demonstrate that our algorithm significantly improves upon many other state-of-the-art 2D/3D IQA algorithms.

Attention modulation of stimulus rivalry under swapping paradigm

Stimulus rivalry refers to the sustained periods of perceptual dominance that occur when different visual stimuli are swapped at a regular rate between eyes. This phenomenon is thought to involve mainly eye-independent mechanisms. Although several studies have reported that attention can increase image predominance in conventional binocular rivalry, it is unknown whether attention can specifically modulate stimulus rivalry. We addressed this question and manipulated the spatial characteristic of the stimuli to assess whether such an attention modulation could depend on visual processing hierarchy. The results showed that selective attention of stimulus rivalry significantly increased the predominance of the attended stimulus, regardless of the stimulus' spatial characteristics. No effect was observed on the swapping percept. The findings are discussed in the context of recent models attempting to characterize stimulus rivalry between eye-dependent and eye-independent levels.

Redundancy Gain in Binocular Rivalry

A behavioural advantage is found across a wide range of stimuli when two targets are presented in opposite hemifields compared with those targets being presented together in one hemifield, or one target being presented alone. This advantage for responses to multiple targets versus a single target is often termed redundancy gain. Here we report on the findings of two experiments investigating redundancy gain in binocular rivalry. Experiment 1 presented a rival pair in one hemifield with an additional image presented to both eyes in the opposite hemifield. There was a weak effect of this stable image on the perceived dominance of the images within the rival pair. Experiment 2 presented a second rival pair in either the same or opposite hemifield and showed that instances of joint predominance were greater when the two pairs were presented in opposite hemifields than within the same hemifield. Therefore, the findings suggest that redundancy gain may be extended to stimuli presented under binocular rivalry conditions.