An integrated framework of spatiotemporal dynamics of binocular rivalry

A human cortical adaptive mutual inhibition circuit underlying competition for perceptual decision and repetition suppression reversal

A model based on inhibitory coupling has been proposed to explain perceptual oscillations. This 'adapting reciprocal inhibition' model postulates that it is the strength of inhibitory coupling that determines the fate of competition between percepts. Here, we used an fMRI-based adaptation technique to reveal the influence of neighboring neuronal populations, such as reciprocal inhibition, in motion-selective hMT+/V5. If reciprocal inhibition exists in this region, the following predictions should hold: 1. stimulus-driven response would not simply decrease, as predicted by simple repetition-suppression of neuronal populations, but instead, increase due to the activity from adjacent populations; 2. perceptual decision involving competing representations, should reflect decreased reciprocal inhibition by adaptation; 3. neural activity for the competing percept should also later on increase upon adaptation. Our results confirm these three predictions, showing that a model of perceptual decision based on adapting reciprocal inhibition holds true. Finally, they also show that the net effect of the well-known repetition suppression phenomenon can be reversed by this mechanism.

Adaptation to transients disrupts spatial coherence in binocular rivalry

When one eye is presented with an image that is distinct from the image presented to the other eye, the eyes start to rival and suppress each other's image. Binocular rivalry leads to perceptual alternations between the images of each eye, during which only one of the images is perceived at a time. However, when the eyes exert weak and shallow suppression, participants tend to perceive both images intermixed more often. A recent study proposed that the precedence of mixed percepts positively correlates with the degree of adaptation to conflict between the eyes. However, this study neglected the role of visual transients, which covaried with the degree of conflict in the stimulus design. Here we report that not the conflict between the eyes but prolonged and repeated observations of strong visual transients cause participants to report more mixed percepts. We conclude that visual transients, such as sudden changes in contrast, draw attention, strengthen both eyes' image representations, and facilitate the adaptation to interocular suppression, which consequentially disrupts the spatial coherence in binocular rivalry. This finding is relevant to virtual- and augmented reality for which it is crucial to design stereoscopic environments in which binocular rivalry is limited.

Symmetry of generalized rivalry network models determines patterns of interocular grouping in four-location binocular rivalry

Previously, symmetry of network models has been proposed to account for interocular grouping during binocular rivalry. Here, we construct and analyze generalized rivalry network models with different types of symmetry (based on different kinds of excitatory coupling) to derive predictions of possible perceptual states in 12 experiments with four retinal locations. Percepts in binocular rivalry involving more than three locations have not been empirically investigated due to the difficulty in reporting simultaneous percepts at multiple locations. Here, we develop a novel reporting procedure in which the stimulus disappears when the subject is cued to report the simultaneously perceived colors in all four retinal locations. This procedure ensures that simultaneous rather than sequential percepts are reported. The procedure was applied in 12 experiments with six binocular rivalry stimulus configurations, all consisting of dichoptic displays of red and green squares at four locations. We call configurations with an even or odd number of red squares even or odd configurations, respectively. In experiments using even stimulus configurations, we found that even percepts were more frequently observed than odd percepts, whereas in experiments using odd stimulus configurations even and odd percepts were observed with equal probability. The generalized rivalry network models in which couplings depend on stimulus features and spatial configurations was in better agreement with the empirical results. We conclude that the excitatory coupling strength in the horizontal and vertical configurations are different and the coupling strengths between the same color and between different colors are different.NEW & NOTEWORTHY Wilson network models of interocular groupings during binocular rivalry are constructed by considering features that indicate equal coupling strengths. Network symmetries, based on equal couplings, predict percepts. For a four-location rivalry experiment with red or green squares at each location, we analyze different possible Wilson networks. In our experiments we develop a novel reporting procedure and show that networks in which stimulus features and spatial configurations are distinguished best agree with experiments.

Evidence for neural rhythms embedded within binocular rivalry

Evidence for perceptual periodicity emerges from studies showing periodic fluctuations in visual perception and decision making that are accompanied by neural oscillations in brain activity. We have uncovered signs of periodicity in the time course of binocular rivalry, a widely studied form of multistable perception. This was done by analyzing time series data contained in an unusually large dataset of rivalry state durations associated with states of exclusive monocular dominance and states of mixed perception during transitions between exclusive dominance. Identifiable within the varying durations of dynamic mixed perception are rhythmic clusters of durations whose incidence falls within the frequency band associated with oscillations in neural activity accompanying periodicity in perceptual judgments. Endogenous neural oscillations appear to be especially impactful when perception is unusually confounding.

Multistable Perception and the Role of the Frontoparietal Cortex in Perceptual Inference

A given pattern of optical stimulation can arise from countless possible real-world sources, creating a dilemma for vision: What in the world actually gives rise to the current pattern? This dilemma was pointed out centuries ago by the astronomer and mathematician Ibn Al-Haytham and was forcefully restated 150 years ago when von Helmholtz characterized perception as unconscious inference. To buttress his contention, von Helmholtz cited multistable perception: recurring changes in perception despite unchanging sensory input. Recent neuroscientific studies have exploited multistable perception to identify brain areas uniquely activated in association with these perceptual changes, but the specific roles of those activations remain controversial. This article provides an overview of theoretical models of multistable perception, a review of recent neuroimaging and brain stimulation studies focused on mechanisms associated with these perceptual changes, and a synthesis of available evidence within the context of current notions about Bayesian inference that find their historical roots in von Helmholtz's work.

Scale-freeness of dominant and piecemeal perceptions during binocular rivalry

When two eyes are simultaneously stimulated by two inconsistent images, the observer's perception switches between the two images every few seconds such that only one image is perceived at a time. This phenomenon is named binocular rivalry (BR). However, sometimes the perceived image is a piecemeal mixed of two stimuli known as piecemeal perceptions. In this study, a BR task was designed in which orthogonal gratings are presented to the two eyes. The subjects were trained to report 3 states: dominant perceptions (two state matching to perceived grating orientation) and the piecemeal perceptions (third state). We explored the scale-freeness of the BR percept durations considering the two dominant monocular states as well as the piecemeal transition state using detrended fluctuation analysis. Our results reproduced the previous finding of memory in the perceptual switches between the monocular perception states. Moreover, we showed that such memory also exists in the transitory periods of dichoptic piecemeal perceptions. These results support our hypothesis that the pool of unstable piecemeal perceptions could be regarded as separate multiple low-depth basin in the perceptual state landscape. Likewise, the transitions from these piecemeal state basins and stable monocular state basins are faced with resistance. Therefore there is inertia and memory (i.e. positive serial correlation) for the piecemeal dichoptic perception states as well as the monocular states.

Regulating the Access to Awareness: Brain Activity Related to Probe-related and Spontaneous Reversals in Binocular Rivalry

Research on the neural correlates of consciousness (NCC) has implicated an assortment of brain regions, ERP components, and network properties associated with visual awareness. Recently, the P3b ERP component has emerged as a leading NCC candidate. However, typical P3b paradigms depend on the detection of some stimulus change, making it difficult to separate brain processes elicited by the stimulus itself from those associated with updates or changes in visual awareness. Here we used binocular rivalry to ask whether the P3b is associated with changes in awareness even in the absence of changes in the object of awareness. We recorded ERPs during a probe-mediated binocular rivalry paradigm in which brief probes were presented over the image in either the suppressed or dominant eye to determine whether the elicited P3b activity is probe or reversal related. We found that the timing of P3b (but not its amplitude) was closely related to the timing of the report of a perceptual change rather than to the onset of the probe. This is consistent with the proposal that P3b indexes updates in conscious awareness, rather than being related to stimulus processing per se. Conversely, the probe-related P1 amplitude (but not its latency) was associated with reversal latency, suggesting that the degree to which the probe is processed increases the likelihood of a fast perceptual reversal. Finally, the response-locked P3b amplitude (but not its latency) was associated with the duration of an intermediate stage between reversals in which parts of both percepts coexist (piecemeal period). Together, the data suggest that the P3b reflects an update in consciousness and that the intensity of that process (as indexed by P3b amplitude) predicts how immediate that update is.

Binocular rivalry from invisible patterns

Binocular rivalry arises when incompatible images are presented to the two eyes. If the two eyes' conflicting features are invisible, leading to identical perceptual interpretations, does rivalry competition still occur? Here we investigated whether binocular rivalry can be induced from conflicting but invisible spatial patterns. A chromatic grating counterphase flickering at 30 Hz appeared uniform, but produced significant tilt aftereffect and orientation-selective adaptation. The invisible pattern also generated significant BOLD activities in the early visual cortex, with minimal response in the parietal and frontal cortical areas. Compared with perceptually matched uniform stimuli, a monocularly presented invisible chromatic grating enhanced the rivalry competition with a low-contrast visible grating presented to the other eye. Furthermore, switching from a uniform field to a perceptually matched invisible chromatic grating produced interocular suppression at approximately 200 ms after onset of the invisible grating. Experiments using briefly presented monocular probes revealed evidence for sustained rivalry competition between two invisible gratings during continuous dichoptic presentations. These findings indicate that even without visible interocular conflict, and with minimal engagement of frontoparietal cortex and consciousness related top-down feedback, perceptually identical patterns with invisible conflict features produce rivalry competition in the early visual cortex.

Multistable Perception in Older Adults: Constructing a Whole from Fragments

Visual perception is constructive in nature; that is, a coherent whole is generated from ambiguous fragments that are encountered in dynamic visual scenes. Creating this coherent whole from fragmented sensory inputs requires one to detect, identify, distinguish and organize sensory input. The organization of fragments into a coherent whole is facilitated by the continuous interactions between lower level sensory inputs and higher order processes. However, age-related declines are found in both neural structures and cognitive processes (e.g., attention and inhibition). The impact of these declines on the constructive nature of visual processing was the focus of this study. Here we asked younger adults, young-old (65–79 years), and old-old adults (80+ years) to view a multistable figure (i.e., Necker cube) under four conditions (free, priming, volition, and adaptation) and report, via a button press, when percepts spontaneously changed. The oldest-olds, unlike young-olds and younger adults, were influenced by priming, had less visual stability during volition and showed less ability to adapt to multistable stimuli. These results suggest that the ability to construct a coherent whole from fragments declines with age. More specifically, vision is constructed differently in the old-olds, which might influence environmental interpretations and navigational abilities in this age group.

The 'laws' of binocular rivalry: 50 years of Levelt's propositions

It has been fifty years since Levelt's monograph On Binocular Rivalry (1965) was published, but its four propositions that describe the relation between stimulus strength and the phenomenology of binocular rivalry remain a benchmark for theorists and experimentalists even today. In this review, we will revisit the original conception of the four propositions and the scientific landscape in which this happened. We will also provide a brief update concerning distributions of dominance durations, another aspect of Levelt's monograph that has maintained a prominent presence in the field. In a critical evaluation of Levelt's propositions against current knowledge of binocular rivalry we will then demonstrate that the original propositions are not completely compatible with what is known today, but that they can, in a straightforward way, be modified to encapsulate the progress that has been made over the past fifty years. The resulting modified, propositions are shown to apply to a broad range of bistable perceptual phenomena, not just binocular rivalry, and they allow important inferences about the underlying neural systems. We argue that these inferences reflect canonical neural properties that play a role in visual perception in general, and we discuss ways in which future research can build on the work reviewed here to attain a better understanding of these properties.

Novel quantitative assessment of metamorphopsia in maculopathy

PURPOSE

Patients with macular disease often report experiencing metamorphopsia (visual distortion). Although typically measured with Amsler charts, more quantitative assessments of perceived distortion are desirable to effectively monitor the presence, progression, and remediation of visual impairment.

METHODS

Participants with binocular (n = 33) and monocular (n = 50) maculopathy across seven disease groups, and control participants (n = 10) with no identifiable retinal disease completed a modified Amsler grid assessment (presented on a computer screen with eye tracking to ensure fixation compliance) and two novel assessments to measure metamorphopsia in the central 5° of visual field. A total of 81% (67/83) of participants completed a hyperacuity task where they aligned eight dots in the shape of a square, and 64% (32/50) of participants with monocular distortion completed a spatial alignment task using dichoptic stimuli. Ten controls completed all tasks.

RESULTS

Horizontal and vertical distortion magnitudes were calculated for each of the three assessments. Distortion magnitudes were significantly higher in patients than controls in all assessments. There was no significant difference in magnitude of distortion across different macular diseases. There were no significant correlations between overall magnitude of distortion among any of the three measures and no significant correlations in localized measures of distortion.

CONCLUSIONS

Three alternative quantifications of monocular spatial distortion in the central visual field generated uncorrelated estimates of visual distortion. It is therefore unlikely that metamorphopsia is caused solely by retinal displacement, but instead involves additional top-down information, knowledge about the scene, and perhaps, cortical reorganization.

Surface area of early visual cortex predicts individual speed of traveling waves during binocular rivalry

Binocular rivalry ensues when different images are presented to the 2 eyes with conscious perception alternating between the possible interpretations. For large rivalry displays, perceptual transitions are initiated at one location and spread to other parts of the visual field, a phenomenon termed "traveling wave." Previous studies investigated the underlying neural mechanisms of the traveling wave and surmised that primary visual cortex might play an important role. We used magnetic resonance imaging and behavioral measures in humans to explore how interindividual differences in observers' subjective experience of the wave are related to anatomical characteristics of cortical regions. We measured wave speed in participants and confirmed the long-term stability of the individual values. Retinotopic mapping was employed to delineate borders of visual areas V1-V3 in order to determine surface area and cortical thickness in those regions. Only the surface areas of V1 and V2, but not V3 showed a correlation with wave speed. For individuals with larger V1/V2 area, the traveling wave needed longer to spread across the same distance in visual space. Our results highlight the role of early visual areas in mediating binocular rivalry and suggest possible mechanisms for the correlation between surface area and the traveling waves.

Prioritized Detection of Personally Familiar Faces

We investigated whether personally familiar faces are preferentially processed in conditions of reduced attentional resources and in the absence of conscious awareness. In the first experiment, we used Rapid Serial Visual Presentation (RSVP) to test the susceptibility of familiar faces and faces of strangers to the attentional blink. In the second experiment, we used continuous flash interocular suppression to render stimuli invisible and measured face detection time for personally familiar faces as compared to faces of strangers. In both experiments we found an advantage for detection of personally familiar faces as compared to faces of strangers. Our data suggest that the identity of faces is processed with reduced attentional resources and even in the absence of awareness. Our results show that this facilitated processing of familiar faces cannot be attributed to detection of low-level visual features and that a learned unique configuration of facial features can influence preconscious perceptual processing.

Establishing Communication between Neuronal Populations through Competitive Entrainment

The role of gamma frequency oscillation in neuronal interaction, and the relationship between oscillation and information transfer between neurons, has been the focus of much recent research. While the biological mechanisms responsible for gamma oscillation and the properties of resulting networks are well studied, the dynamics of changing phase coherence between oscillating neuronal populations are not well understood. To this end we develop a computational model of competitive selection between multiple stimuli, where the selection and transfer of population-encoded information arises from competition between converging stimuli to entrain a target population of neurons. Oscillation is generated by Pyramidal-Interneuronal Network Gamma through the action of recurrent synaptic connections between a locally connected network of excitatory and inhibitory neurons. Competition between stimuli is driven by differences in coherence of oscillation, while transmission of a single selected stimulus is enabled between generating and receiving neurons via Communication-through-Coherence. We explore the effect of varying synaptic parameters on the competitive transmission of stimuli over different neuron models, and identify a continuous region within the parameter space of the recurrent synaptic loop where inhibition-induced oscillation results in entrainment of target neurons. Within this optimal region we find that competition between stimuli of equal coherence results in model output that alternates between representation of the stimuli, in a manner strongly resembling well-known biological phenomena resulting from competitive stimulus selection such as binocular rivalry.