Stochastic variations in sensory awareness are driven by noisy neuronal adaptation: evidence from serial correlations in perceptual bistability

Perceptual Resolution of Ambiguity: Can Tuned, Divisive Normalization Account for both Interocular Similarity Grouping and Difference Enhancement

Our visual system usually provides a unique and functional representation of the external world. At times, however, the visual system has more than one compelling interpretation of the same retinal stimulus; in this case, neural populations compete for perceptual dominance to resolve ambiguity. Spatial and temporal context can guide perceptual experience. Recent evidence shows that ambiguous retinal stimuli are sometimes resolved by enhancing either similarity or differences among multiple percepts. Divisive normalization is a canonical neural computation that enables context-dependent sensory processing by attenuating a neuron's response by other neurons. Experiments here show that divisive normalization can account for perceptual representations of either similarity enhancement (so-called grouping) or difference enhancement, offering a unified framework for opposite perceptual outcomes.

Crossmodal interference on counting performance: Evidence for shared attentional resources

During the act of counting, our perceptual system may rely on information coming from different sensory channels. However, when the information coming from different sources is discordant, such as in the case of a de-synchronization between visual stimuli to be counted and irrelevant auditory stimuli, the performance in a sequential counting task might deteriorate. Such deterioration may originate from two different mechanisms, both linked to exogenous attention attracted by auditory stimuli. Indeed, exogenous auditory triggers may infiltrate our internal "counter", interfering with the counting process, resulting in an overcount; alternatively, the exogenous auditory triggers may disrupt the internal "counter" by deviating participants' attention from the visual stimuli, resulting in an undercount. We tested these hypotheses by asking participants to count visual discs sequentially appearing on the screen while listening to task-irrelevant sounds, in systematically varied conditions: visual stimuli could be synchronized or de-synchronized with sounds; they could feature regular or irregular pacing; and their speed presentation could be fast (approx. 3/sec), moderate (approx. 2/sec), or slow (approx. 1.5/sec). Our results support the second hypothesis since participants tend to undercount visual stimuli in all harder conditions (de-synchronized, irregular, fast sequences). We discuss these results in detail, adding novel elements to the study of crossmodal interference.

New insights into binocular rivalry from the reconstruction of evolving percepts using model network dynamics

When the two eyes are presented with highly distinct stimuli, the resulting visual percept generally switches every few seconds between the two monocular images in an irregular fashion, giving rise to a phenomenon known as binocular rivalry. While a host of theoretical studies have explored potential mechanisms for binocular rivalry in the context of evoked model dynamics in response to simple stimuli, here we investigate binocular rivalry directly through complex stimulus reconstructions based on the activity of a two-layer neuronal network model with competing downstream pools driven by disparate monocular stimuli composed of image pixels. To estimate the dynamic percept, we derive a linear input-output mapping rooted in the non-linear network dynamics and iteratively apply compressive sensing techniques for signal recovery. Utilizing a dominance metric, we are able to identify when percept alternations occur and use data collected during each dominance period to generate a sequence of percept reconstructions. We show that despite the approximate nature of the input-output mapping and the significant reduction in neurons downstream relative to stimulus pixels, the dominant monocular image is well-encoded in the network dynamics and improvements are garnered when realistic spatial receptive field structure is incorporated into the feedforward connectivity. Our model demonstrates gamma-distributed dominance durations and well obeys Levelt's four laws for how dominance durations change with stimulus strength, agreeing with key recurring experimental observations often used to benchmark rivalry models. In light of evidence that individuals with autism exhibit relatively slow percept switching in binocular rivalry, we corroborate the ubiquitous hypothesis that autism manifests from reduced inhibition in the brain by systematically probing our model alternation rate across choices of inhibition strength. We exhibit sufficient conditions for producing binocular rivalry in the context of natural scene stimuli, opening a clearer window into the dynamic brain computations that vary with the generated percept and a potential path toward further understanding neurological disorders.

Hierarchical processing underpins competition in tactile perceptual bistability

Ambiguous sensory information can lead to spontaneous alternations between perceptual states, recently shown to extend to tactile perception. The authors recently proposed a simplified form of tactile rivalry which evokes two competing percepts for a fixed difference in input amplitudes across antiphase, pulsatile stimulation of the left and right fingers. This study addresses the need for a tactile rivalry model that captures the dynamics of perceptual alternations and that incorporates the structure of the somatosensory system. The model features hierarchical processing with two stages. The first and the second stages of model could be located at the secondary somatosensory cortex (area S2), or in higher areas driven by S2. The model captures dynamical features specific to the tactile rivalry percepts and produces general characteristics of perceptual rivalry: input strength dependence of dominance times (Levelt's proposition II), short-tailed skewness of dominance time distributions and the ratio of distribution moments. The presented modelling work leads to experimentally testable predictions. The same hierarchical model could generalise to account for percept formation, competition and alternations for bistable stimuli that involve pulsatile inputs from the visual and auditory domains.

Vestibular and active self-motion signals drive visual perception in binocular rivalry

Multisensory integration helps the brain build reliable models of the world and resolve ambiguities. Visual interactions with sound and touch are well established but vestibular influences on vision are less well studied. Here, we test the vestibular influence on vision using horizontally opposed motions presented one to each eye so that visual perception is unstable and alternates irregularly. Passive, whole-body rotations in the yaw plane stabilized visual alternations, with perceived direction oscillating congruently with rotation (leftward motion during leftward rotation, and vice versa). This demonstrates a purely vestibular signal can resolve ambiguous visual motion and determine visual perception. Active self-rotation following the same sinusoidal profile also entrained vision to the rotation cycle – more strongly and with a lesser time lag, likely because of efference copy and predictive internal models. Both experiments show that visual ambiguity provides an effective paradigm to reveal how vestibular and motor inputs can shape visual perception.

•

Binocular rivalry between left/right motions is stabilized by congruent head movement

•

Left/right head rotations entrain rivalry dynamics so matching direction is perceived

•

Active and passive rotations both drive rivalry dominance to match rotation direction

•

Resolving ambiguous vision occurs in a broader vestibular and action-based context

Binocular rivalry reveals an out-of-equilibrium neural dynamics suited for decision-making

In ambiguous or conflicting sensory situations, perception is often ‘multistable’ in that it perpetually changes at irregular intervals, shifting abruptly between distinct alternatives. The interval statistics of these alternations exhibits quasi-universal characteristics, suggesting a general mechanism. Using binocular rivalry, we show that many aspects of this perceptual dynamics are reproduced by a hierarchical model operating out of equilibrium. The constitutive elements of this model idealize the metastability of cortical networks. Independent elements accumulate visual evidence at one level, while groups of coupled elements compete for dominance at another level. As soon as one group dominates perception, feedback inhibition suppresses supporting evidence. Previously unreported features in the serial dependencies of perceptual alternations compellingly corroborate this mechanism. Moreover, the proposed out-of-equilibrium dynamics satisfies normative constraints of continuous decision-making. Thus, multistable perception may reflect decision-making in a volatile world: integrating evidence over space and time, choosing categorically between hypotheses, while concurrently evaluating alternatives.

Perceptual rivalry with vibrotactile stimuli

In perceptual rivalry, ambiguous sensory information leads to dynamic changes in the perceptual interpretation of fixed stimuli. This phenomenon occurs when participants receive sensory stimuli that support two or more distinct interpretations; this results in spontaneous alternations between possible perceptual interpretations. Perceptual rivalry has been widely studied across different sensory modalities including vision, audition, and to a limited extent, in the tactile domain. Common features of perceptual rivalry across various ambiguous visual and auditory paradigms characterize the randomness of switching times and their dependence on input strength manipulations (Levelt's propositions). It is still unclear whether the general characteristics of perceptual rivalry are preserved with tactile stimuli. This study aims to introduce a simple tactile stimulus capable of generating perceptual rivalry and explores whether general features of perceptual rivalry from other modalities extend to the tactile domain. Our results confirm that Levelt's proposition II extends to tactile bistability, and that the stochastic characteristics of irregular perceptual alternations agree with non-tactile modalities. An analysis of correlations between subsequent perceptual phases reveals a significant positive correlation at lag 1 (as found in visual bistability), and a negative correlation for lag 2 (in contrast with visual bistability).

Ensemble modeling of auditory streaming reveals potential sources of bistability across the perceptual hierarchy

Perceptual bistability-the spontaneous, irregular fluctuation of perception between two interpretations of a stimulus-occurs when observing a large variety of ambiguous stimulus configurations. This phenomenon has the potential to serve as a tool for, among other things, understanding how function varies across individuals due to the large individual differences that manifest during perceptual bistability. Yet it remains difficult to interpret the functional processes at work, without knowing where bistability arises during perception. In this study we explore the hypothesis that bistability originates from multiple sources distributed across the perceptual hierarchy. We develop a hierarchical model of auditory processing comprised of three distinct levels: a Peripheral, tonotopic analysis, a Central analysis computing features found more centrally in the auditory system, and an Object analysis, where sounds are segmented into different streams. We model bistable perception within this system by applying adaptation, inhibition and noise into one or all of the three levels of the hierarchy. We evaluate a large ensemble of variations of this hierarchical model, where each model has a different configuration of adaptation, inhibition and noise. This approach avoids the assumption that a single configuration must be invoked to explain the data. Each model is evaluated based on its ability to replicate two hallmarks of bistability during auditory streaming: the selectivity of bistability to specific stimulus configurations, and the characteristic log-normal pattern of perceptual switches. Consistent with a distributed origin, a broad range of model parameters across this hierarchy lead to a plausible form of perceptual bistability.

Switch rates for orthogonally oriented kinetic-depth displays are correlated across observers

When continuously viewing multistable displays, which are compatible with several comparably likely interpretations, perception perpetually switches between available alternatives. Prior studies typically report the lack of consistent individual switch rates across different displays. However, this comparison is based on an assumption that neural representations of physically identical displays are consistent across observers. Yet, given how different individuals are already at the level of the retina, it is likely that the difference in other relevant factors might mask the correlation. To address this issue, we compared switch rates in two kinetic-depth displays (KDE) that rotated around orthogonal axes (45° counterclockwise vs. 45° clockwise relative to the vertical). This ensured that dynamics of multistable perception was based on highly similar, but different and independent neural representations. We also included a Necker cube (NC) display as a control. We report that switch rates were correlated between two kinetic-depth effect displays, but not between either of the KDE and NC displays. This demonstrates that the usual lack of correlation may not be evidence for the lack of a shared pacesetter mechanism of multistable perception, but reflect other factors, such as differently modulated inputs to competing representations. In addition, we asked participants to speed-up or slow-down perceptual alternations and found that only the former ability was correlated across different displays. This indicates that these two types of volitional control may differ in their use of attentional resources.

Age-dependency in binocular rivalry is reflected by exclusive percepts, not mixed percepts

Some aspects of decision-making are known to decline with normal aging. One of the known perceptual decision-making processes which is vastly studied is binocular rivalry. It is well-established that the older the person, the slower the perceptual dynamics. However, the underlying neurobiological cause is unknown. So, to understand how age affects visual decision-making, we investigated age-related changes in perception during binocular rivalry. In binocular rivalry, the image presented to one eye competes for perceptual dominance with the image presented to the other eye. Perception during binocular rivalry consists of alternations between exclusive percepts. However, frequently, mixed percepts with combinations of the two monocular images occur. The mixed percepts reflect a transition from the percept of one eye to the other but frequently the transitions do not complete the full cycle and the previous exclusive percept becomes dominant again. The transitional idiosyncrasy of mixed percepts has not been studied systematically in different age groups. Previously, we have found evidence for adaptation and noise, and not inhibition, as underlying neural factors that are related to age-dependent perceptual decisions. Based on those conclusions, we predict that mixed percepts/inhibitory interactions should not change with aging. Therefore, in an old and a young age group, we studied binocular rivalry dynamics considering both exclusive and mixed percepts by using two paradigms: percept-choice and percept-switch. We found a decrease in perceptual alternation Probability for older adults, although the rate of mixed percepts did not differ significantly compared to younger adults. Interestingly, the mixed percepts play a very similar transitional idiosyncrasy in our different age groups. Further analyses suggest that differences in synaptic depression, gain modulation at the input level, and/or slower execution of motor commands are not the determining factors to explain these findings. We then argue that changes in perceptual decisions at an older age are the result of changes in neural adaptation and noise.

Symmetry of generalized rivalry network models determines patterns of interocular grouping in four-location binocular rivalry

Previously, symmetry of network models has been proposed to account for interocular grouping during binocular rivalry. Here, we construct and analyze generalized rivalry network models with different types of symmetry (based on different kinds of excitatory coupling) to derive predictions of possible perceptual states in 12 experiments with four retinal locations. Percepts in binocular rivalry involving more than three locations have not been empirically investigated due to the difficulty in reporting simultaneous percepts at multiple locations. Here, we develop a novel reporting procedure in which the stimulus disappears when the subject is cued to report the simultaneously perceived colors in all four retinal locations. This procedure ensures that simultaneous rather than sequential percepts are reported. The procedure was applied in 12 experiments with six binocular rivalry stimulus configurations, all consisting of dichoptic displays of red and green squares at four locations. We call configurations with an even or odd number of red squares even or odd configurations, respectively. In experiments using even stimulus configurations, we found that even percepts were more frequently observed than odd percepts, whereas in experiments using odd stimulus configurations even and odd percepts were observed with equal probability. The generalized rivalry network models in which couplings depend on stimulus features and spatial configurations was in better agreement with the empirical results. We conclude that the excitatory coupling strength in the horizontal and vertical configurations are different and the coupling strengths between the same color and between different colors are different.NEW & NOTEWORTHY Wilson network models of interocular groupings during binocular rivalry are constructed by considering features that indicate equal coupling strengths. Network symmetries, based on equal couplings, predict percepts. For a four-location rivalry experiment with red or green squares at each location, we analyze different possible Wilson networks. In our experiments we develop a novel reporting procedure and show that networks in which stimulus features and spatial configurations are distinguished best agree with experiments.

Dynamic properties of internal noise probed by modulating binocular rivalry

Neural systems are inherently noisy, and this noise can affect our perception from moment to moment. This is particularly apparent in binocular rivalry, where perception of competing stimuli shown to the left and right eyes alternates over time. We modulated rivalling stimuli using dynamic sequences of external noise of various rates and amplitudes. We repeated each external noise sequence twice, and assessed the consistency of percepts across repetitions. External noise modulations of sufficiently high contrast increased consistency scores above baseline, and were most effective at 1/8Hz. A computational model of rivalry in which internal noise has a 1/f (pink) temporal amplitude spectrum, and a standard deviation of 16% contrast, provided the best account of our data. Our novel technique provides detailed estimates of the dynamic properties of internal noise during binocular rivalry, and by extension the stochastic processes that drive our perception and other types of spontaneous brain activity.

Although our perception of the world appears constant, sensory representations are variable because of the ‘noisy’ nature of biological neurons. Here we used a binocular rivalry paradigm, in which conflicting images are shown to the two eyes, to probe the properties of this internal variability. Using a novel paradigm in which the contrasts of rivalling stimuli are modulated by two independent external noise streams, we infer the amplitude and character of this internal noise. The temporal amplitude spectrum of the noise has a 1/f spectrum, similar to that of natural visual input, and consistent with the idea that the visual system evolved to match its environment.

Children's perception of visual and auditory ambiguity and its link to executive functions and creativity

The phenomenon of perceptual bistability provides insights into aspects of perceptual processing not normally accessible to everyday experience. However, most experiments have been conducted in adults, and it is not clear to what extent key aspects of perceptual switching change through development. The current research examined the ability of 6-, 8-, and 10-year-old children (N = 66) to switch between competing percepts of ambiguous visual and auditory stimuli and links between switching rate, executive functions, and creativity. The numbers of switches participants reported in two visual tasks (ambiguous figure and ambiguous structure from motion) and two auditory tasks (verbal transformation and auditory streaming) were measured in three 60-s blocks. In addition, inhibitory control was measured with a Stroop task, set shifting was measured with a verbal fluency task, and creativity was measured with a divergent thinking task. The numbers of perceptual switches increased in all four tasks from 6 to 10 years of age but differed across tasks in that they were higher in the verbal transformation and ambigous structure-from-motion tasks than in the ambigous figure and auditory streaming tasks for all age groups. Although perceptual switching rates differed across tasks, there were predictive relationships between switching rates in some tasks. However, little evidence for the influence of central processes on perceptual switching was found. Overall, the results support the notion that perceptual switching is largely modality and task specific and that this property is already evident when perceptual switching emerges.

Individual differences in continuous flash suppression: Potency and linkages to binocular rivalry dynamics

Binocular rivalry (BR) and continuous flash suppression (CFS) are compelling psychophysical phenomena involving interocular suppression. Using an individual differences approach we assessed whether interocular suppression induced by CFS is predictable in potency from characteristics of BR that are plausibly governed by interocular inhibition. We found large individual differences in BR dynamics and, in addition, in the strength of CFS as gauged by the incidence and durations of breakthroughs in CFS during an extended viewing periods. CFS's potency waned with repeated trials, but stable individual differences persisted despite these mean shifts. We also discovered large individual differences in the strength of the post-CFS shift in BR dominance produced by interocular suppression. While CFS breakthroughs were significantly negatively correlated with shifts in BR dominance after CFS, there were no significant associations between individual differences in alternation rate during pre-CFS binocular rivalry and either breakthroughs during CFS or post-CFS dominance shifts. Bayesian hypothesis tests and highest posterior density intervals confirmed the weak association between these two forms of interocular suppression. Thus, our findings suggest that the substantial individual differences in BR dynamics and CFS effectiveness are modestly related but not entirely mediated by one common neural substrate.

Perceptual reversals in binocular rivalry: Improved detection from OKN

When binocular rivalry is induced by opponent motion displays, perceptual reversals are often associated with changed oculomotor behavior (Frässle, Sommer, Jansen, Naber, & Einhäuser, 2014; Fujiwara et al., 2017). Specifically, the direction of smooth pursuit phases in optokinetic nystagmus typically corresponds to the direction of motion that dominates perceptual appearance at any given time. Here we report an improved analysis that continuously estimates perceived motion in terms of "cumulative smooth pursuit." In essence, smooth pursuit segments are identified, interpolated where necessary, and joined probabilistically into a continuous record of cumulative smooth pursuit (i.e., probability of eye position disregarding blinks, saccades, signal losses, and artefacts). The analysis is fully automated and robust in healthy, developmental, and patient populations. To validate reliability, we compare volitional reports of perceptual reversals in rivalry displays, and of physical reversals in nonrivalrous control displays. Cumulative smooth pursuit detects physical reversals and estimates eye velocity more accurately than existing methods do (Frässle et al., 2014). It also appears to distinguish dominant and transitional perceptual states, detecting changes with a precision of ±100 ms. We conclude that cumulative smooth pursuit significantly improves the monitoring of binocular rivalry by means of recording optokinetic nystagmus.

Changes in low-level neural properties underlie age-dependent visual decision making

Aging typically slows down cognitive processes, specifically those related to perceptual decisions. However, the neurobiological mechanisms underlying these age-associated changes are still elusive. To address this, we studied the effect of aging on both perceptual and binocular rivalry in various presentation conditions. Two age groups of participants reported their spontaneous percept switches during continuous presentation and percept choices during intermittent presentation. We find no significant age effect on the mean and cumulative frequencies of percept switch durations under continuous presentation. However, the data show a significant age effect on coefficient of variation, ratio of standard deviation to mean of percept durations. Our results also reveal that the alternation rate for percept choices significantly declines at an older age under intermittent presentation. The latter effect is even more pronounced at shorter inter-stimulus durations. These results together with the predictions of existing neural models for bistable perception imply that age-dependency of visual perceptual decisions is caused by shifts in neural adaptation and noise, not by a change in inhibition strength. Thus, variation in the low-level neural properties, adaptation and noise, cause age-dependent properties in visual perceptual decisions.

Long-Range Temporal Correlations in Alpha Oscillations Stabilize Perception of Ambiguous Visual Stimuli

Ongoing brain dynamics have been proposed as a type of “neuronal noise” that can trigger perceptual switches when viewing an ambiguous, bistable stimulus. However, no prior study has directly quantified how such neuronal noise relates to the rate of percept reversals. Specifically, it has remained unknown whether individual differences in complexity of resting-state oscillations—as reflected in long-range temporal correlations (LRTC)—are associated with perceptual stability. We hypothesized that participants with stronger resting-state LRTC in the alpha band experience more stable percepts, and thereby fewer perceptual switches. Furthermore, we expected that participants who report less discontinuous thoughts during rest, experience less switches. To test this, we recorded electroencephalography (EEG) in 65 healthy volunteers during 5 min Eyes-Closed Rest (ECR), after which they filled in the Amsterdam Resting-State Questionnaire (ARSQ). This was followed by three conditions where participants attended an ambiguous structure-from-motion stimulus—Neutral (passively observe the stimulus), Hold (the percept for as long as possible), and Switch (as often as possible). LRTC of resting-state alpha oscillations predicted the number of switches only in the Hold condition, with stronger LRTC associated with less switches. Contrary to our expectations, there was no association between resting-state Discontinuity of Mind and percept stability. Participants were capable of controlling switching according to task goals, and this was accompanied by increased alpha power during Hold and decreased power during Switch. Fewer switches were associated with stronger task-related alpha LRTC in all conditions. Together, our data suggest that bistable visual perception is to some extent under voluntary control and influenced by LRTC of alpha oscillations.

Similar but separate systems underlie perceptual bistability in vision and audition

The dynamics of perceptual bistability, the phenomenon in which perception switches between different interpretations of an unchanging stimulus, are characterised by very similar properties across a wide range of qualitatively different paradigms. This suggests that perceptual switching may be triggered by some common source. However, it is also possible that perceptual switching may arise from a distributed system, whose components vary according to the specifics of the perceptual experiences involved. Here we used a visual and an auditory task to determine whether individuals show cross-modal commonalities in perceptual switching. We found that individual perceptual switching rates were significantly correlated across modalities. We then asked whether perceptual switching arises from some central (modality-) task-independent process or from a more distributed task-specific system. We found that a log-normal distribution best explained the distribution of perceptual phases in both modalities, suggestive of a combined set of independent processes causing perceptual switching. Modality- and/or task-dependent differences in these distributions, and lack of correlation with the modality-independent central factors tested (ego-resiliency, creativity, and executive function), also point towards perceptual switching arising from a distributed system of similar but independent processes.

The Independent and Shared Mechanisms of Intrinsic Brain Dynamics: Insights From Bistable Perception

In bistable perception, constant input leads to alternating perception. The dynamics of the changing perception reflects the intrinsic dynamic properties of the “unconscious inferential” process in the brain. Under the same condition, individuals differ in how fast they experience the perceptual alternation. In this study, testing many forms of bistable perception in a large number of observers, we investigated the key question of whether there is a general and common mechanism or multiple and independent mechanisms that control the dynamics of the inferential brain. Bistable phenomena tested include binocular rivalry, vase-face, Necker cube, moving plaid, motion induced blindness, biological motion, spinning dancer, rotating cylinder, Lissajous-figure, rolling wheel, and translating diamond. Switching dynamics for each bistable percept was measured in 100 observers. Results show that the switching rates of subsets of bistable percept are highly correlated. The clustering of dynamic properties of some bistable phenomena but not an overall general control of switching dynamics implies that the brain’s inferential processes are both shared and independent – faster in constructing 3D structure from motion does not mean faster in integrating components into an objects.

The effect of stimulus strength on binocular rivalry rate in healthy individuals: Implications for genetic, clinical and individual differences studies

Binocular rivalry (BR) occurs when conflicting images concurrently presented to corresponding retinal locations of each eye stochastically alternate in perception. Anomalies of BR rate have been examined in a range of clinical psychiatric conditions. In particular, slow BR rate has been proposed as an endophenotype for bipolar disorder (BD) to improve power in large-scale genome-wide association studies. Examining the validity of BR rate as a BD endophenotype however requires large-scale datasets (n=1000s to 10,000s), a standardized testing protocol, and optimization of stimulus parameters to maximize separation between BD and healthy groups. Such requirements are indeed relevant to all clinical psychiatric BR studies. Here we address the issue of stimulus optimization by examining the effect of stimulus parameter variation on BR rate and mixed-percept duration (MPD) in healthy individuals. We aimed to identify the stimulus parameters that induced the fastest BR rates with the least MPD. Employing a repeated-measures within-subjects design, 40 healthy adults completed four BR tasks using orthogonally drifting grating stimuli that varied in drift speed and aperture size. Pairwise comparisons were performed to determine modulation of BR rate and MPD by these stimulus parameters, and individual variation of such modulation was also assessed. From amongst the stimulus parameters examined, we found that 8cycles/s drift speed in a 1.5° aperture induced the fastest BR rate without increasing MPD, but that BR rate with this stimulus configuration was not substantially different to BR rate with stimulus parameters we have used in previous studies (i.e., 4cycles/s drift speed in a 1.5° aperture). In addition to contributing to stimulus optimization issues, the findings have implications for Levelt's Proposition IV of binocular rivalry dynamics and individual differences in such dynamics.

Scale-freeness of dominant and piecemeal perceptions during binocular rivalry

When two eyes are simultaneously stimulated by two inconsistent images, the observer's perception switches between the two images every few seconds such that only one image is perceived at a time. This phenomenon is named binocular rivalry (BR). However, sometimes the perceived image is a piecemeal mixed of two stimuli known as piecemeal perceptions. In this study, a BR task was designed in which orthogonal gratings are presented to the two eyes. The subjects were trained to report 3 states: dominant perceptions (two state matching to perceived grating orientation) and the piecemeal perceptions (third state). We explored the scale-freeness of the BR percept durations considering the two dominant monocular states as well as the piecemeal transition state using detrended fluctuation analysis. Our results reproduced the previous finding of memory in the perceptual switches between the monocular perception states. Moreover, we showed that such memory also exists in the transitory periods of dichoptic piecemeal perceptions. These results support our hypothesis that the pool of unstable piecemeal perceptions could be regarded as separate multiple low-depth basin in the perceptual state landscape. Likewise, the transitions from these piecemeal state basins and stable monocular state basins are faced with resistance. Therefore there is inertia and memory (i.e. positive serial correlation) for the piecemeal dichoptic perception states as well as the monocular states.

Extending Levelt's Propositions to perceptual multistability involving interocular grouping

Levelt's Propositions are central to understanding a wide range of multistable perceptual phenomena, but it is unclear whether they extend to perceptual multistability involving interocular grouping. We presented split-grating stimuli with complementary halves of the same color (either red or green) to human subjects. The subjects reported four percepts in alternation: the two stimuli presented to each eye (half red and half green), as well as the two single color (all red or all green), interocularly grouped percepts. Increasing color saturation lead to increased reports of the single color percept in most subjects, indicating increased predominance of grouped percepts (Levelt's Proposition I). This increase in predominance was due to a decrease in the average dominance duration of single-eye percepts, with grouped percept dominance largely unaffected. This agrees with a generalization of Levelt's Proposition II, as the average dominance duration of the stronger (in this case single-eye) percept was primarily affected by changes in stimulus strength. Moreover, in agreement with Levelt's Proposition III the alternation rate between percepts increased as the difference in the strength of the percepts decreased.

Filling-in rivalry: Perceptual alternations in the absence of retinal image conflict

During perceptual rivalry, an observer's perceptual experience alternates over time despite constant sensory stimulation. Perceptual alternations are thought to be driven by conflicting or ambiguous retinal image features at a particular spatial location and modulated by global context from surrounding locations. However, rivalry can also occur between two illusory stimuli-such as two filled-in stimuli within the retinal blind spot. In this "filling-in rivalry," what observers perceive in the blind spot changes in the absence of local stimulation. It remains unclear if filling-in rivalry shares common mechanisms with other types of rivalry. We measured the dynamics of rivalry between filled-in percepts in the blind spot, finding a high degree of exclusivity (perceptual dominance of one filled-in percept, rather than a perception of transparency), alternation rates that were highly consistent for individual observers, and dynamics that closely resembled other forms of perceptual rivalry. The results suggest that mechanisms common to a wide range of rivalry situations need not rely on conflicting retinal image signals.

Collective Activity of Many Bistable Assemblies Reproduces Characteristic Dynamics of Multistable Perception

The timing of perceptual decisions depends on both deterministic and stochastic factors, as the gradual accumulation of sensory evidence (deterministic) is contaminated by sensory and/or internal noise (stochastic). When human observers view multistable visual displays, successive episodes of stochastic accumulation culminate in repeated reversals of visual appearance. Treating reversal timing as a "first-passage time" problem, we ask how the observed timing densities constrain the underlying stochastic accumulation. Importantly, mean reversal times (i.e., deterministic factors) differ enormously between displays/observers/stimulation levels, whereas the variance and skewness of reversal times (i.e., stochastic factors) keep characteristic proportions of the mean. What sort of stochastic process could reproduce this highly consistent "scaling property?" Here we show that the collective activity of a finite population of bistable units (i.e., a generalized Ehrenfest process) quantitatively reproduces all aspects of the scaling property of multistable phenomena, in contrast to other processes under consideration (Poisson, Wiener, or Ornstein-Uhlenbeck process). The postulated units express the spontaneous dynamics of attractor assemblies transitioning between distinct activity states. Plausible candidates are cortical columns, or clusters of columns, as they are preferentially connected and spontaneously explore a restricted repertoire of activity states. Our findings suggests that perceptual representations are granular, probabilistic, and operate far from equilibrium, thereby offering a suitable substrate for statistical inference.

SIGNIFICANCE STATEMENT

Spontaneous reversals of high-level perception, so-called multistable perception, conform to highly consistent and characteristic statistics, constraining plausible neural representations. We show that the observed perceptual dynamics would be reproduced quantitatively by a finite population of distinct neural assemblies, each with locally bistable activity, operating far from the collective equilibrium (generalized Ehrenfest process). Such a representation would be consistent with the intrinsic stochastic dynamics of neocortical activity, which is dominated by preferentially connected assemblies, such as cortical columns or clusters of columns. We predict that local neuron assemblies will express bistable dynamics, with spontaneous active-inactive transitions, whenever they contribute to high-level perception.

Individual differences in the temporal dynamics of binocular rivalry and stimulus rivalry

Binocular rivalry and stimulus rivalry are two forms of perceptual instability that arise when the visual system is confronted with conflicting stimulus information. In the case of binocular rivalry, dissimilar monocular stimuli are presented to the two eyes for an extended period of time, whereas for stimulus rivalry the dissimilar monocular stimuli are exchanged rapidly and repetitively between the eyes during extended viewing. With both forms of rivalry, one experiences extended durations of exclusive perceptual dominance that fluctuate between the two stimuli. Whether these two forms of rivalry arise within different stages of visual processing has remained debatable. Using an individual-differences approach, we found that both stimulus rivalry and binocular rivalry exhibited same-shaped distributions of dominance durations among a sample of 30 observers and, moreover, that the dominance durations measured during binocular and stimulus rivalry were significantly correlated among our sample of observers. Furthermore, we found a significant, positive correlation between alternation rate in binocular rivalry and the incidence of stimulus rivalry. These results suggest that the two forms of rivalry may be tapping common neural mechanisms, or at least different mechanisms with comparable time constants. It remains to be learned just why the incidences of binocular rivalry and stimulus rivalry vary so greatly among people.

Serial correlations in Continuous Flash Suppression

Research on visual rivalry has demonstrated that consecutive dominance durations are serially dependent, implying that the underlying competition mechanism is not driven by some random process but includes a memory component. Here we asked whether serial dependence is also observed in continuous flash suppression (CFS). We addressed this question by analyzing a large dataset of time series of suppression durations obtained in a series of so-called “breaking CFS” experiments in which the duration of the period is measured until a suppressed target breaks through the CFS mask. Across experimental manipulations, stimuli, and observers, we found that (i) the distribution of breakthrough rates was fit less well by a gamma distribution than in conventional visual rivalry paradigms, (ii) the suppression duration on a previous trial influenced the suppression duration on a later trial up to as long as a lag of eight trials, and (iii) the mechanism underlying these serial correlations was predominantly monocular. We conclude that the underlying competition mechanism of CFS also includes a memory component that is primarily, but not necessarily exclusively, monocular in nature. We suggest that the temporal dependency structure of suppression durations in CFS is akin to those observed in binocular rivalry, which might imply that both phenomena tap into similar rather than distinct mechanisms.

Auditory Streaming as an Online Classification Process with Evidence Accumulation

When human subjects hear a sequence of two alternating pure tones, they often perceive it in one of two ways: as one integrated sequence (a single "stream" consisting of the two tones), or as two segregated sequences, one sequence of low tones perceived separately from another sequence of high tones (two "streams"). Perception of this stimulus is thus bistable. Moreover, subjects report on-going switching between the two percepts: unless the frequency separation is large, initial perception tends to be of integration, followed by toggling between integration and segregation phases. The process of stream formation is loosely named “auditory streaming”. Auditory streaming is believed to be a manifestation of human ability to analyze an auditory scene, i.e. to attribute portions of the incoming sound sequence to distinct sound generating entities. Previous studies suggested that the durations of the successive integration and segregation phases are statistically independent. This independence plays an important role in current models of bistability. Contrary to this, we show here, by analyzing a large set of data, that subsequent phase durations are positively correlated. To account together for bistability and positive correlation between subsequent durations, we suggest that streaming is a consequence of an evidence accumulation process. Evidence for segregation is accumulated during the integration phase and vice versa; a switch to the opposite percept occurs stochastically based on this evidence. During a long phase, a large amount of evidence for the opposite percept is accumulated, resulting in a long subsequent phase. In contrast, a short phase is followed by another short phase. We implement these concepts using a probabilistic model that shows both bistability and correlations similar to those observed experimentally.

Negligible fronto-parietal BOLD activity accompanying unreportable switches in bistable perception

The human brain's executive systems play a vital role in deciding and selecting among actions. Selection among alternatives also occurs in the perceptual domain, for instance when perception switches between interpretations during perceptual bistability. Whether executive systems also underlie this functionality remains debated, with known fronto-parietal concomitants of perceptual switches being variously interpreted as reflecting the switches' cause, or as reflecting their consequences. We developed a paradigm where the two eyes receive different inputs and perception demonstrably switches between these inputs, yet where switches themselves are so inconspicuous as to become unreportable, minimizing their executive consequences. Fronto-parietal fMRI BOLD responses that accompany perceptual switches were similarly minimized in this paradigm, indicating that these reflect the switches' consequences rather than their cause. We conclude that perceptual switches do not always rely on executive brain areas, and that processes responsible for selection among alternatives may operate outside of the brain's executive systems.

Onset rivalry: factors that succeed and fail to bias selection

This project examined whether previous visual history can bias perceptual dominance during onset rivalry. A predictive sequence of non-rivalrous stimuli preceded dichoptically presented rivalrous displays. One of the dichoptic images was the implied next step of the preceding sequence while the other was not. Observers reported their initial dominant percept. Across five experiments, we found that motion sequences biased perceptual selection such that a rivalrous stimulus that continued a motion sequence tended to dominate one that did not. However, signals generated by complex pattern of motion information or verbal-semantic information had no influence on selection. These results are consistent with the view that onset rivalry is an early phase of rivalry that is likely insensitive to modulation by factors originating beyond the visual system.

The 'laws' of binocular rivalry: 50 years of Levelt's propositions

It has been fifty years since Levelt's monograph On Binocular Rivalry (1965) was published, but its four propositions that describe the relation between stimulus strength and the phenomenology of binocular rivalry remain a benchmark for theorists and experimentalists even today. In this review, we will revisit the original conception of the four propositions and the scientific landscape in which this happened. We will also provide a brief update concerning distributions of dominance durations, another aspect of Levelt's monograph that has maintained a prominent presence in the field. In a critical evaluation of Levelt's propositions against current knowledge of binocular rivalry we will then demonstrate that the original propositions are not completely compatible with what is known today, but that they can, in a straightforward way, be modified to encapsulate the progress that has been made over the past fifty years. The resulting modified, propositions are shown to apply to a broad range of bistable perceptual phenomena, not just binocular rivalry, and they allow important inferences about the underlying neural systems. We argue that these inferences reflect canonical neural properties that play a role in visual perception in general, and we discuss ways in which future research can build on the work reviewed here to attain a better understanding of these properties.

Competition with and without priority control: linking rivalry to attention through winner-take-all networks with memory

Competition is ubiquitous in perception. For example, items in the visual field compete for processing resources, and attention controls their priority (biased competition). The inevitable ambiguity in the interpretation of sensory signals yields another form of competition: distinct perceptual interpretations compete for access to awareness. Rivalry, where two equally likely percepts compete for dominance, explicates the latter form of competition. Building upon the similarity between attention and rivalry, we propose to model rivalry by a generic competitive circuit that is widely used in the attention literature-a winner-take-all (WTA) network. Specifically, we show that a network of two coupled WTA circuits replicates three common hallmarks of rivalry: the distribution of dominance durations, their dependence on input strength ("Levelt's propositions"), and the effects of stimulus removal (blanking). This model introduces a form of memory by forming discrete states and explains experimental data better than competitive models of rivalry without memory. This result supports the crucial role of memory in rivalry specifically and in competitive processes in general. Our approach unifies the seemingly distinct phenomena of rivalry, memory, and attention in a single model with competition as the common underlying principle.

Top-down influences on ambiguous perception: the role of stable and transient states of the observer

The world as it appears to the viewer is the result of a complex process of inference performed by the brain. The validity of this apparently counter-intuitive assertion becomes evident whenever we face noisy, feeble or ambiguous visual stimulation: in these conditions, the state of the observer may play a decisive role in determining what is currently perceived. On this background, ambiguous perception and its amenability to top-down influences can be employed as an empirical paradigm to explore the principles of perception. Here we offer an overview of both classical and recent contributions on how stable and transient states of the observer can impact ambiguous perception. As to the influence of the stable states of the observer, we show that what is currently perceived can be influenced (1) by cognitive and affective aspects, such as meaning, prior knowledge, motivation, and emotional content and (2) by individual differences, such as gender, handedness, genetic inheritance, clinical conditions, and personality traits and by (3) learning and conditioning. As to the impact of transient states of the observer, we outline the effects of (4) attention and (5) voluntary control, which have attracted much empirical work along the history of ambiguous perception. In the huge literature on the topic we trace a difference between the observer's ability to control dominance (i.e., the maintenance of a specific percept in visual awareness) and reversal rate (i.e., the switching between two alternative percepts). Other transient states of the observer that have more recently drawn researchers' attention regard (6) the effects of imagery and visual working memory. (7) Furthermore, we describe the transient effects of prior history of perceptual dominance. (8) Finally, we address the currently available computational models of ambiguous perception and how they can take into account the crucial share played by the state of the observer in perceiving ambiguous displays.

Temporal dynamics of different cases of bi-stable figure-ground perception

Segmentation of a visual scene in "figure" and "ground" is essential for perception of the three-dimensional layout of a scene. In cases of bi-stable perception, two distinct figure-ground interpretations alternate over time. We were interested in the temporal dynamics of these alternations, in particular when the same image is presented repeatedly, with short blank periods in-between. Surprisingly, we found that the intermittent presentation of Rubin's classical "face-or-vase" figure, which is frequently taken as a standard case of bi-stable figure-ground perception, often evoked perceptual switches during the short presentations and stabilization was not prominent. Interestingly, bi-stable perception of Kanizsa's anomalous transparency figure did strongly stabilize across blanks. We also found stabilization for the Necker cube, which we used for comparison. The degree of stabilization (and the lack of it) varied across stimuli and across individuals. Our results indicate, against common expectation, that the stabilization phenomenon cannot be generally evoked by intermittent presentation. We argue that top-down feedback factors such as familiarity, semantics, expectation, and perceptual bias contribute to the complex processes underlying the temporal dynamics of bi-stable figure-ground perception.

Revisiting the Lissajous figure as a tool to study bistable perception

During bistable vision perception spontaneously "switches" between two mutually exclusive percepts despite constant sensory input. The endogenous nature of these perceptual transitions has motivated extensive research aimed at the underlying mechanisms, since spontaneous perceptual transitions of bistable stimuli should in principle allow for a dissociation of processes related to sensory stimulation from those related to conscious perception. However, transitions from one conscious percept to another are often not instantaneous, and participants usually report a considerable amount of mixed or unclear percepts. This feature of bistable vision makes it difficult to isolate transition-related visual processes. Here, we revisited an ambiguous depth-from-motion stimulus which was first introduced to experimental psychology more than 80 years ago. This rotating Lissajous figure might prove useful in complementing other bistable stimuli, since its perceptual transitions only occur at critical stimulus configurations and are virtually instantaneous, thus facilitating the construction of a perceptually equivalent replay condition. We found that three parameters of the Lissajous figure - complexity, line width, and rotational speed - differentially modulated its perceptual dominance durations and transition probabilities, thus providing experimenters with a versatile tool to study the perceptual dynamics of bistable vision.

Subjective visual perception: from local processing to emergent phenomena of brain activity

The combination of electrophysiological recordings with ambiguous visual stimulation made possible the detection of neurons that represent the content of subjective visual perception and perceptual suppression in multiple cortical and subcortical brain regions. These neuronal populations, commonly referred to as the neural correlates of consciousness, are more likely to be found in the temporal and prefrontal cortices as well as the pulvinar, indicating that the content of perceptual awareness is represented with higher fidelity in higher-order association areas of the cortical and thalamic hierarchy, reflecting the outcome of competitive interactions between conflicting sensory information resolved in earlier stages. However, despite the significant insights into conscious perception gained through monitoring the activities of single neurons and small, local populations, the immense functional complexity of the brain arising from correlations in the activity of its constituent parts suggests that local, microscopic activity could only partially reveal the mechanisms involved in perceptual awareness. Rather, the dynamics of functional connectivity patterns on a mesoscopic and macroscopic level could be critical for conscious perception. Understanding these emergent spatio-temporal patterns could be informative not only for the stability of subjective perception but also for spontaneous perceptual transitions suggested to depend either on the dynamics of antagonistic ensembles or on global intrinsic activity fluctuations that may act upon explicit neural representations of sensory stimuli and induce perceptual reorganization. Here, we review the most recent results from local activity recordings and discuss the potential role of effective, correlated interactions during perceptual awareness.

Structure-from-motion: dissociating perception, neural persistence, and sensory memory of illusory depth and illusory rotation

In the structure-from-motion paradigm, physical motion on a screen produces the vivid illusion of an object rotating in depth. Here, we show how to dissociate illusory depth and illusory rotation in a structure-from-motion stimulus using a rotationally asymmetric shape and reversals of physical motion. Reversals of physical motion create a conflict between the original illusory states and the new physical motion: Either illusory depth remains constant and illusory rotation reverses, or illusory rotation stays the same and illusory depth reverses. When physical motion reverses after the interruption in presentation, we find that illusory rotation tends to remain constant for long blank durations (T (blank) ≥ 0.5 s), but illusory depth is stabilized if interruptions are short (T (blank) ≤ 0.1 s). The stability of illusory depth over brief interruptions is consistent with the effect of neural persistence. When this is curtailed using a mask, stability of ambiguous vision (for either illusory depth or illusory rotation) is disrupted. We also examined the selectivity of the neural persistence of illusory depth. We found that it relies on a static representation of an interpolated illusory object, since changes to low-level display properties had little detrimental effect. We discuss our findings with respect to other types of history dependence in multistable displays (sensory stabilization memory, neural fatigue, etc.). Our results suggest that when brief interruptions are used during the presentation of multistable displays, switches in perception are likely to rely on the same neural mechanisms as spontaneous switches, rather than switches due to the initial percept choice at the stimulus onset.

Short term synaptic depression improves information transfer in perceptual multistability

Competitive neural networks are often used to model the dynamics of perceptual bistability. Switching between percepts can occur through fluctuations and/or a slow adaptive process. Here, we analyze switching statistics in competitive networks with short term synaptic depression and noise. We start by analyzing a ring model that yields spatially structured solutions and complement this with a study of a space-free network whose populations are coupled with mutual inhibition. Dominance times arising from depression driven switching can be approximated using a separation of timescales in the ring and space-free model. For purely noise-driven switching, we derive approximate energy functions to justify how dominance times are exponentially related to input strength. We also show that a combination of depression and noise generates realistic distributions of dominance times. Unimodal functions of dominance times are more easily told apart by sampling, so switches induced by synaptic depression induced provide more information about stimuli than noise-driven switching. Finally, we analyze a competitive network model of perceptual tristability, showing depression generates a history-dependence in dominance switching.

Multi-stable perception balances stability and sensitivity

We report that multi-stable perception operates in a consistent, dynamical regime, balancing the conflicting goals of stability and sensitivity. When a multi-stable visual display is viewed continuously, its phenomenal appearance reverses spontaneously at irregular intervals. We characterized the perceptual dynamics of individual observers in terms of four statistical measures: the distribution of dominance times (mean and variance) and the novel, subtle dependence on prior history (correlation and time-constant). The dynamics of multi-stable perception is known to reflect several stabilizing and destabilizing factors. Phenomenologically, its main aspects are captured by a simplistic computational model with competition, adaptation, and noise. We identified small parameter volumes (~3% of the possible volume) in which the model reproduced both dominance distribution and history-dependence of each observer. For 21 of 24 data sets, the identified volumes clustered tightly (~15% of the possible volume), revealing a consistent "operating regime" of multi-stable perception. The "operating regime" turned out to be marginally stable or, equivalently, near the brink of an oscillatory instability. The chance probability of the observed clustering was <0.02. To understand the functional significance of this empirical "operating regime," we compared it to the theoretical "sweet spot" of the model. We computed this "sweet spot" as the intersection of the parameter volumes in which the model produced stable perceptual outcomes and in which it was sensitive to input modulations. Remarkably, the empirical "operating regime" proved to be largely coextensive with the theoretical "sweet spot." This demonstrated that perceptual dynamics was not merely consistent but also functionally optimized (in that it balances stability with sensitivity). Our results imply that multi-stable perception is not a laboratory curiosity, but reflects a functional optimization of perceptual dynamics for visual inference.

Modelling the emergence and dynamics of perceptual organisation in auditory streaming

Many sound sources can only be recognised from the pattern of sounds they emit, and not from the individual sound events that make up their emission sequences. Auditory scene analysis addresses the difficult task of interpreting the sound world in terms of an unknown number of discrete sound sources (causes) with possibly overlapping signals, and therefore of associating each event with the appropriate source. There are potentially many different ways in which incoming events can be assigned to different causes, which means that the auditory system has to choose between them. This problem has been studied for many years using the auditory streaming paradigm, and recently it has become apparent that instead of making one fixed perceptual decision, given sufficient time, auditory perception switches back and forth between the alternatives—a phenomenon known as perceptual bi- or multi-stability. We propose a new model of auditory scene analysis at the core of which is a process that seeks to discover predictable patterns in the ongoing sound sequence. Representations of predictable fragments are created on the fly, and are maintained, strengthened or weakened on the basis of their predictive success, and conflict with other representations. Auditory perceptual organisation emerges spontaneously from the nature of the competition between these representations. We present detailed comparisons between the model simulations and data from an auditory streaming experiment, and show that the model accounts for many important findings, including: the emergence of, and switching between, alternative organisations; the influence of stimulus parameters on perceptual dominance, switching rate and perceptual phase durations; and the build-up of auditory streaming. The principal contribution of the model is to show that a two-stage process of pattern discovery and competition between incompatible patterns can account for both the contents (perceptual organisations) and the dynamics of human perception in auditory streaming.

The sound waves produced by objects in the environment mix together before reaching the ears. Before we can make sense of an auditory scene, our brains must solve the puzzle of how to disassemble the sound waveform into groupings that correspond to the original source signals. How is this feat accomplished? We propose that the auditory system continually scans the structure of incoming signals in search of clues to indicate which pieces belong together. For instance, sound events may belong together if they have similar features, or form part of a clear temporal pattern. However this process is complicated by lack of knowledge of future events and the many possible ways in which even a simple sound sequence can be decomposed. The biological solution is multistability: one possible interpretation of a sound is perceived initially, which then gives way to another interpretation, and so on. We propose a model of auditory multistability, in which fragmental descriptions of the signal compete and cooperate to explain the sound scene. We demonstrate, using simplified experimental stimuli, that the model can account for both the contents (perceptual organisations) and the dynamics of human perception in auditory streaming.

A common neurodynamical mechanism could mediate externally induced and intrinsically generated transitions in visual awareness

The neural correlates of conscious visual perception are commonly studied in paradigms of perceptual multistability that allow multiple perceptual interpretations during unchanged sensory stimulation. What is the source of this multistability in the content of perception? From a theoretical perspective, a fine balance between deterministic and stochastic forces has been suggested to underlie the spontaneous, intrinsically driven perceptual transitions observed during multistable perception. Deterministic forces are represented by adaptation of feature-selective neuronal populations encoding the competing percepts while stochastic forces are modeled as noise-driven processes. Here, we used a unified neuronal competition model to study the dynamics of adaptation and noise processes in binocular flash suppression (BFS), a form of externally induced perceptual suppression, and compare it with the dynamics of intrinsically driven alternations in binocular rivalry (BR). For the first time, we use electrophysiological, biologically relevant data to constrain a model of perceptual rivalry. Specifically, we show that the mean population discharge pattern of a perceptually modulated neuronal population detected in electrophysiological recordings in the lateral prefrontal cortex (LPFC) during BFS, constrains the dynamical range of externally induced perceptual transitions to a region around the bifurcation separating a noise-driven attractor regime from an adaptation-driven oscillatory regime. Most interestingly, the dynamical range of intrinsically driven perceptual transitions during BR is located in the noise-driven attractor regime, where it overlaps with BFS. Our results suggest that the neurodynamical mechanisms of externally induced and spontaneously generated perceptual alternations overlap in a narrow, noise-driven region just before a bifurcation where the system becomes adaptation-driven.

Orientation-specificity of adaptation: isotropic adaptation is purely monocular

Numerous studies have found that prolonged exposure to grating stimuli reduces sensitivity to subsequently presented gratings, most evidently when the orientations of the adapting and test patterns are similar. The rate of sensitivity loss varies with angular difference indicating both the presence and bandwidths of psychophysical ‘orientation channels’. Here we study the orientation dependency of contrast adaptation measured both monoptically and dichoptically. Earlier psychophysical reports show that orientation bandwidths are broader at lower spatial frequencies, and we confirm this with a simple von Mises model using 0.25 vs. 2 c.p.d. gratings. When a single isotropic (orientation invariant) parameter is added to this model, however, we find no evidence for any difference in bandwidth with spatial frequency. Consistent with cross-orientation masking effects, we find isotropic adaptation to be strongly low spatial frequency-biased. Surprisingly, unlike masking, we find that the effects of interocular adaptation are purely orientation-tuned, with no evidence of isotropic threshold elevation. This dissociation points to isotropic (or ‘cross-orientation’) adaptation being an earlier and more magnocellular-like process than that which supports orientation-tuned adaptation and suggests that isotropic masking and adaptation are likely mediated by separate mechanisms.

A century of Gestalt psychology in visual perception: II. Conceptual and theoretical foundations

Our first review article (Wagemans et al., 2012) on the occasion of the centennial anniversary of Gestalt psychology focused on perceptual grouping and figure-ground organization. It concluded that further progress requires a reconsideration of the conceptual and theoretical foundations of the Gestalt approach, which is provided here. In particular, we review contemporary formulations of holism within an information-processing framework, allowing for operational definitions (e.g., integral dimensions, emergent features, configural superiority, global precedence, primacy of holistic/configural properties) and a refined understanding of its psychological implications (e.g., at the level of attention, perception, and decision). We also review 4 lines of theoretical progress regarding the law of Prägnanz-the brain's tendency of being attracted towards states corresponding to the simplest possible organization, given the available stimulation. The first considers the brain as a complex adaptive system and explains how self-organization solves the conundrum of trading between robustness and flexibility of perceptual states. The second specifies the economy principle in terms of optimization of neural resources, showing that elementary sensors working independently to minimize uncertainty can respond optimally at the system level. The third considers how Gestalt percepts (e.g., groups, objects) are optimal given the available stimulation, with optimality specified in Bayesian terms. Fourth, structural information theory explains how a Gestaltist visual system that focuses on internal coding efficiency yields external veridicality as a side effect. To answer the fundamental question of why things look as they do, a further synthesis of these complementary perspectives is required.

Binocular rivalry produced by temporal frequency differences

When the eyes view images that are sufficiently different to prevent binocular fusion, binocular rivalry occurs and the images are seen sequentially in a stochastic alternation. Here we examine whether temporal frequency differences will trigger binocular rivalry by presenting two dynamic random-pixel arrays that are spatially matched but which modulate temporally at two different rates. We found that binocular rivalry between the two temporal frequencies did indeed occur, provided the frequencies were sufficiently different. Differences greater than two octaves (i.e., a factor of four) produced robust rivalry with clear-cut alternations similar to those experienced with spatial rivalry and with similar alternation rates. This finding indicates that temporal information can produce binocular rivalry in the absence of spatial conflict and is discussed in terms of rivalry requiring conflict between temporal channels.

Multistability in auditory stream segregation: a predictive coding view

Auditory stream segregation involves linking temporally separate acoustic events into one or more coherent sequences. For any non-trivial sequence of sounds, many alternative descriptions can be formed, only one or very few of which emerge in awareness at any time. Evidence from studies showing bi-/multistability in auditory streaming suggest that some, perhaps many of the alternative descriptions are represented in the brain in parallel and that they continuously vie for conscious perception. Here, based on a predictive coding view, we consider the nature of these sound representations and how they compete with each other. Predictive processing helps to maintain perceptual stability by signalling the continuation of previously established patterns as well as the emergence of new sound sources. It also provides a measure of how well each of the competing representations describes the current acoustic scene. This account of auditory stream segregation has been tested on perceptual data obtained in the auditory streaming paradigm.

The role of attention in ambiguous reversals of structure-from-motion

Multiple dots moving independently back and forth on a flat screen induce a compelling illusion of a sphere rotating in depth (structure-from-motion). If all dots simultaneously reverse their direction of motion, two perceptual outcomes are possible: either the illusory rotation reverses as well (and the illusory depth of each dot is maintained), or the illusory rotation is maintained (but the illusory depth of each dot reverses). We investigated the role of attention in these ambiguous reversals. Greater availability of attention--as manipulated with a concurrent task or inferred from eye movement statistics--shifted the balance in favor of reversing illusory rotation (rather than depth). On the other hand, volitional control over illusory reversals was limited and did not depend on tracking individual dots during the direction reversal. Finally, display properties strongly influenced ambiguous reversals. Any asymmetries between 'front' and 'back' surfaces--created either on purpose by coloring or accidentally by random dot placement--also shifted the balance in favor of reversing illusory rotation (rather than depth). We conclude that the outcome of ambiguous reversals depends on attention, specifically on attention to the illusory sphere and its surface irregularities, but not on attentive tracking of individual surface dots.

Willpower and conscious percept: volitional switching in binocular rivalry

When dissimilar images are presented to the left and right eyes, awareness switches spontaneously between the two images, such that one of the images is suppressed from awareness while the other is perceptually dominant. For over 170 years, it has been accepted that even though the periods of dominance are subject to attentional processes, we have no inherent control over perceptual switching. Here, we revisit this issue in response to evidence that top-down attention can target perceptually suppressed ‘vision for action’ representations in the dorsal stream. We investigated volitional control over rivalry between apparent motion (AM), drifting (DM) and stationary (ST) grating pairs. Observers demonstrated a remarkable ability to generate intentional switches in the AM and D conditions, but not in the ST condition. Corresponding switches in the pursuit direction of optokinetic nystagmus verified this finding objectively. We showed it is unlikely that intentional perceptual switches were triggered by saccadic eye movements, because their frequency was reduced substantially in the volitional condition and did not change around the time of perceptual switches. Hence, we propose that synergy between dorsal and ventral stream representations provides the missing link in establishing volitional control over rivalrous conscious percepts.