Endogenous influences on perceptual bistability depend on exogenous stimulus characteristics

Visual motion perception as online hierarchical inference

Identifying the structure of motion relations in the environment is critical for navigation, tracking, prediction, and pursuit. Yet, little is known about the mental and neural computations that allow the visual system to infer this structure online from a volatile stream of visual information. We propose online hierarchical Bayesian inference as a principled solution for how the brain might solve this complex perceptual task. We derive an online Expectation-Maximization algorithm that explains human percepts qualitatively and quantitatively for a diverse set of stimuli, covering classical psychophysics experiments, ambiguous motion scenes, and illusory motion displays. We thereby identify normative explanations for the origin of human motion structure perception and make testable predictions for future psychophysics experiments. The proposed online hierarchical inference model furthermore affords a neural network implementation which shares properties with motion-sensitive cortical areas and motivates targeted experiments to reveal the neural representations of latent structure.

Subjective control of polystable illusory apparent motion: Is control possible when the stimulus affords countless motion possibilities?

We investigate whether a new polystable illusion, illusory apparent motion (IAM), is susceptible to subjective perceptual control as has been shown in other polystable stimuli (e.g., the Necker cube, apparent motion quartets). Previous research has demonstrated that, although IAM shares some properties in common with other polystable stimuli, it also has some unique ones that make it unclear whether it should have similar susceptibility to subjective control. For example, IAM can be perceived in a countless number of directions and motion patterns (e.g., up–down, left–left, contracting–expanding, shear, diagonal). To explore perceptual control of IAM, in experiment 1 (n = 99) we used a motion persistence paradigm where participants are primed with different motion patterns and are instructed to control (change or hold) the initial motion pattern and indicate when the motion pattern changes. Building on experiment 1, experiment 2 (n = 76) brings the method more in line with previous subjective control research, testing whether participants can control their perception of IAM in a context without priming and while dynamically reporting their percepts throughout the trial. Findings from the two experiments demonstrate that participants were able to control their perception of IAM across paradigms. We explore the implications of these findings, strategies reported, and open questions for future research.

Visuospatial Attention Allocation as an Indicator of Cognitive Deficit in Traumatic Brain Injury: A Systematic Review and Meta-Analysis

Traumatic Brain Injury (TBI) is defined by changes in brain function resulting from external forces acting on the brain and is typically characterized by a host of physiological and functional changes such as cognitive deficits including attention problems. In the present study, we focused on the effect of TBI on the ability to allocate attention in vision (i.e., the use of endogenous and exogenous visual cues) by systematically reviewing previous literature on the topic. We conducted quantitative synthesis of 16 selected studies of visual attention following TBI, calculating 80 effect size estimates. The combined effect size was large (g = 0.79, p < 0.0001) with medium heterogeneity (I² = 68.39%). Subgroup analyses revealed an increase in deficit with moderate-to-severe and severe TBI as compared to mild TBI [F_{(2, 76)} = 24.14, p < 0.0001]. Task type was another key source of variability and subgroup analyses indicated that higher order attention processes were severely affected by TBI [F_{(2, 77)} = 5.66, p = 0.0051). Meta-regression analyses revealed significant improvement in visual attention deficit with time [p(mild) = 0.031, p(moderate-to-severe) = 0.002, p(severe) < 0.0001]. Taken together, these results demonstrate that visual attention is affected by TBI and that regular assessment of visual attention, using a systematic attention allocation task, may provide a useful clinical measure of cognitive impairment and change after TBI.

Individual differences point to two separate processes involved in the resolution of binocular rivalry

Although binocular rivalry is different from other perceptually bistable phenomena in requiring interocular conflict, it also shares numerous features with those phenomena. This raises the question of whether, and to what extent, the neural bases of binocular rivalry and other bistable phenomena overlap. Here we examine this question using an individual-differences approach. In a first experiment, observers reported perception during four binocular rivalry tasks that differed in the features and retinal locations of the stimuli used. Perceptual dominance durations were highly correlated when compared between stimuli that differed in location only. Correlations were substantially weaker, however, when comparing stimuli comprised of different features. Thus, individual differences in binocular-rivalry perception partly reflect a feature-specific factor that is not shared among all variants of binocular rivalry. Our second experiment again included several binocular rivalry variants, but also a different form of bistability: moving plaid rivalry. Correlations in dominance durations between binocular rivalry variants that differed in feature content were again modest. Moreover, and surprisingly, correlations between binocular rivalry and moving plaid rivalry were of similar magnitude. This indicates a second, more general, factor underlying individual differences in binocular rivalry perception: one that is shared across binocular rivalry and moving plaid rivalry. We propose that the first, feature-specific factor corresponds to feature-tuned mechanisms involved in the treatment of interocular conflict, whereas the second, general factor corresponds to mechanisms involved in representing surfaces. These latter mechanisms would operate at a binocular level and be central to both binocular rivalry and other forms of bistability.

Switch rates for orthogonally oriented kinetic-depth displays are correlated across observers

When continuously viewing multistable displays, which are compatible with several comparably likely interpretations, perception perpetually switches between available alternatives. Prior studies typically report the lack of consistent individual switch rates across different displays. However, this comparison is based on an assumption that neural representations of physically identical displays are consistent across observers. Yet, given how different individuals are already at the level of the retina, it is likely that the difference in other relevant factors might mask the correlation. To address this issue, we compared switch rates in two kinetic-depth displays (KDE) that rotated around orthogonal axes (45° counterclockwise vs. 45° clockwise relative to the vertical). This ensured that dynamics of multistable perception was based on highly similar, but different and independent neural representations. We also included a Necker cube (NC) display as a control. We report that switch rates were correlated between two kinetic-depth effect displays, but not between either of the KDE and NC displays. This demonstrates that the usual lack of correlation may not be evidence for the lack of a shared pacesetter mechanism of multistable perception, but reflect other factors, such as differently modulated inputs to competing representations. In addition, we asked participants to speed-up or slow-down perceptual alternations and found that only the former ability was correlated across different displays. This indicates that these two types of volitional control may differ in their use of attentional resources.

Directional Bias for Vertical Integration of Motion Trajectories

Abstract. Here we report a new ambiguous continuous motion display, in which two objects appear at the diagonally opposite corners of an imaginary square, move along the diagonal axis toward each other, and after meeting in the center, shift their trajectories to the other two diagonal corners. This display can be seen as two objects’ colliding and bouncing off each other, with two competing interpretations of trajectory configuration requiring either vertical or horizontal integration of trajectory segments. Despite the fact that both percepts are equally plausible, the current study revealed a perceptual preference toward a vertical integration interpretation. We compared this bias with the similar vertical bias in a bistable apparent motion quartet, which suggests that the directional anisotropy found here is quite a new, and distinct phenomenon in both its perceptual characteristics and underlying mechanism.

Bistable perception: neural bases and usefulness in psychological research

Bistable images have the possibility of being perceived in two different ways. Due to their physical characteristics, these visual stimuli allow two different perceptions, associated with top-down and bottom-up modulating processes. Based on an extensive literature review, the present article aims to gather the conceptual models and the foundations of perceptual bistability. This theoretical article compiles not only notions that are intertwined with the understanding of this perceptual phenomenon, but also the diverse classification and uses of bistable images in psychological research, along with a detailed explanation of the neural correlates that are involved in perceptual reversibility. We conclude that the use of bistable images as a paradigmatic resource in psychological research might be extensive. In addition, due to their characteristics, visual bistable stimuli have the potential to be implemented as a resource in experimental tasks that seek to understand diverse concerns linked essentially to attention, sensory, perceptual and memory processes.

The influence of action-effect anticipation on bistable perception: differences between onset rivalry and ambiguous motion

Perception is strongly shaped by the actions we perform. According to the theory of event coding, and forward models of motor control, goal-directed action preparation activates representations of desired effects. These expectations about the precise stimulus identity of one's action-outcomes (i.e. identity predictions) are thought to selectively influence perceptual processing of action-contingent effects. However, the existing evidence for such identity-prediction effects is scarce and mixed. Here, we developed a new paradigm to capture such effects and examined whether action-outcome predictions can bias the perception of binocular onset rivalry (Experiments 1a and 1b) and bistable motion (Experiment 2). Participants performed learning tasks in which they were exposed to action-outcome associations. On test trials, actions were followed by bistable stimuli that could be perceived as being either congruent or incongruent with the aforementioned associations (i.e. rivalrous oriented gratings in Experiments 1a and 1b and spheres with ambiguous rotation directions in Experiment 2). Across three experiments, we show that, whilst exposure to action-effect associations can bias the apparent motion direction of ambiguous spheres, it fails to influence perceptual selection of grating orientations in binocular onset rivalry. This pattern of results extends previous work on ambiguous motion by demonstrating that action-induced modulations do not generalize to all types of bistable percepts.

Perceptual coupling induces co-rotation and speeds up alternations in adjacent bi-stable structure-from-motion objects

When two bi-stable structure-from-motion (SFM) spheres are presented simultaneously, they tend to rotate in the same direction. This effect reflects a common state bias that is present for various multistable displays. However, it was also reported that when two spheres are positioned so that they touch each other, they tend to counterrotate instead. The latter effect is interpreted as a frictional interaction, indicating the influence of the embedded physics on our visual perception. Here, we examined the interplay between these two biases in two experiments using a wide range of conditions. Those included two SFM shapes, two types of disambiguation cues, the presence or absence of the disambiguation cues, different layout options, and two samples of observers from two different universities (in sum 26 participants). Contrary to the prior report, we observed a robust common state bias for all conditions, including those that were optimized for frictional and "gear meshing" interactions. We found that stronger coupling of perceptual states is accompanied by more frequent synchronous perceptual reversals of the two objects. However, we found that the simultaneity of the individual switches does not predict the duration of the following dominance phase. Finally, we report that stronger perceptual coupling speeds up perceptual alternations.

Intracranial Recordings of Occipital Cortex Responses to Illusory Visual Events

Ambiguous visual stimuli elicit different perceptual interpretations over time, creating the illusion that a constant stimulus is changing. We investigate whether such spontaneous changes in visual perception involve occipital brain regions specialized for processing visual information, despite the absence of concomitant changes in stimulation. Spontaneous perceptual changes observed while viewing a binocular rivalry stimulus or an ambiguous structure-from-motion stimulus were compared with stimulus-induced perceptual changes that occurred in response to an actual stimulus change. Intracranial recordings from human occipital cortex revealed that spontaneous and stimulus-induced perceptual changes were both associated with an early transient increase in high-frequency power that was more spatially confined than a later transient decrease in low-frequency power. We suggest that the observed high-frequency and low-frequency modulations relate to initiation and maintenance of a percept, respectively. Our results are compatible with the idea that spontaneous changes in perception originate from competitive interactions within visual neural networks.

SIGNIFICANCE STATEMENT

Ambiguous visual stimuli elicit different perceptual interpretations over time, creating the illusion that a constant stimulus is changing. The literature on the neural correlates of conscious visual perception remains inconclusive regarding the extent to which such spontaneous changes in perception involve sensory brain regions. In an attempt to bridge the gap between existing animal and human studies, we recorded from intracranial electrodes placed on the human occipital lobe. We compared two different kinds of ambiguous stimuli, binocular rivalry and the phenomenon of ambiguous structure-from-motion, enabling generalization of our findings across different stimuli. Our results indicate that spontaneous and stimulus-induced changes in perception (i.e., "illusory" and "real" changes in the stimulus, respectively) may involve sensory regions to a similar extent.

Feature-based attention resolves depth ambiguity

Perceiving the world around us requires that we resolve ambiguity. This process is often studied in the lab using ambiguous figures whose structures can be interpreted in multiple ways. One class of figures contains ambiguity in its depth relations, such that either of two surfaces could be seen as being the "front" of an object. Previous research suggests that selectively attending to a given location on such objects can bias the perception of that region as the front. This study asks whether selectively attending to a distributed feature can also bias that region toward the front. Participants viewed a structure-from-motion display of a rotating cylinder that could be perceived as rotating clockwise or counterclockwise (as imagined viewing from the top), depending on whether a set of red or green moving dots were seen as being in the front. A secondary task encouraged observers to globally attend to either red or green. Results from both Experiment 1 and 2 showed that the dots on the cylinder that shared the attended feature, and its corresponding surface, were more likely to be seen as being in the front, as measured by participants' clockwise versus counterclockwise percept reports. Feature-based attention, like location-based attention, is capable of biasing competition among potential interpretations of figures with ambiguous structure in depth.

Perceptual Stability of the Lissajous Figure Is Modulated by the Speed of Illusory Rotation

Lissajous figures represent ambiguous structure-from-motion stimuli rotating in depth and have proven to be a versatile tool to explore the cognitive and neural mechanisms underlying bistable perception. They are generated by the intersection of two sinusoids with perpendicular axes and increasing phase-shift whose frequency determines the speed of illusory 3D rotation. Recently, we found that Lissajous figures of higher shifting frequencies elicited longer perceptual phase durations and tentatively proposed a “representational momentum” account. In this study, our aim was twofold. First, we aimed to gather more behavioral evidence related to the perceptual dynamics of the Lissajous figure by simultaneously varying its shifting frequency and size. Using a conventional analysis, we investigated the effects of our experimental manipulations on transition probability (i.e., the probability that the current percept will change at the next critical stimulus configuration). Second, we sought to test the impact of our experimental factors on the occurrence of transitions in bistable perception by means of a Bayesian approach that can be used to directly quantify the impact of contextual cues on perceptual stability. We thereby estimated the implicit prediction of perceptual stability and how it is modulated by experimental manipulations.

Lesions to right posterior parietal cortex impair visual depth perception from disparity but not motion cues

The posterior parietal cortex (PPC) is understood to be active when observers perceive three-dimensional (3D) structure. However, it is not clear how central this activity is in the construction of 3D spatial representations. Here, we examine whether PPC is essential for two aspects of visual depth perception by testing patients with lesions affecting this region. First, we measured subjects' ability to discriminate depth structure in various 3D surfaces and objects using binocular disparity. Patients with lesions to right PPC (N = 3) exhibited marked perceptual deficits on these tasks, whereas those with left hemisphere lesions (N = 2) were able to reliably discriminate depth as accurately as control subjects. Second, we presented an ambiguous 3D stimulus defined by structure from motion to determine whether PPC lesions influence the rate of bistable perceptual alternations. Patients' percept durations for the 3D stimulus were generally within a normal range, although the two patients with bilateral PPC lesions showed the fastest perceptual alternation rates in our sample. Intermittent stimulus presentation reduced the reversal rate similarly across subjects. Together, the results suggest that PPC plays a causal role in both inferring and maintaining the perception of 3D structure with stereopsis supported primarily by the right hemisphere, but do not lend support to the view that PPC is a critical contributor to bistable perceptual alternations.This article is part of the themed issue 'Vision in our three-dimensional world'.

Serial correlations in Continuous Flash Suppression

Research on visual rivalry has demonstrated that consecutive dominance durations are serially dependent, implying that the underlying competition mechanism is not driven by some random process but includes a memory component. Here we asked whether serial dependence is also observed in continuous flash suppression (CFS). We addressed this question by analyzing a large dataset of time series of suppression durations obtained in a series of so-called “breaking CFS” experiments in which the duration of the period is measured until a suppressed target breaks through the CFS mask. Across experimental manipulations, stimuli, and observers, we found that (i) the distribution of breakthrough rates was fit less well by a gamma distribution than in conventional visual rivalry paradigms, (ii) the suppression duration on a previous trial influenced the suppression duration on a later trial up to as long as a lag of eight trials, and (iii) the mechanism underlying these serial correlations was predominantly monocular. We conclude that the underlying competition mechanism of CFS also includes a memory component that is primarily, but not necessarily exclusively, monocular in nature. We suggest that the temporal dependency structure of suppression durations in CFS is akin to those observed in binocular rivalry, which might imply that both phenomena tap into similar rather than distinct mechanisms.

The 'laws' of binocular rivalry: 50 years of Levelt's propositions

It has been fifty years since Levelt's monograph On Binocular Rivalry (1965) was published, but its four propositions that describe the relation between stimulus strength and the phenomenology of binocular rivalry remain a benchmark for theorists and experimentalists even today. In this review, we will revisit the original conception of the four propositions and the scientific landscape in which this happened. We will also provide a brief update concerning distributions of dominance durations, another aspect of Levelt's monograph that has maintained a prominent presence in the field. In a critical evaluation of Levelt's propositions against current knowledge of binocular rivalry we will then demonstrate that the original propositions are not completely compatible with what is known today, but that they can, in a straightforward way, be modified to encapsulate the progress that has been made over the past fifty years. The resulting modified, propositions are shown to apply to a broad range of bistable perceptual phenomena, not just binocular rivalry, and they allow important inferences about the underlying neural systems. We argue that these inferences reflect canonical neural properties that play a role in visual perception in general, and we discuss ways in which future research can build on the work reviewed here to attain a better understanding of these properties.

Top-down influences on ambiguous perception: the role of stable and transient states of the observer

The world as it appears to the viewer is the result of a complex process of inference performed by the brain. The validity of this apparently counter-intuitive assertion becomes evident whenever we face noisy, feeble or ambiguous visual stimulation: in these conditions, the state of the observer may play a decisive role in determining what is currently perceived. On this background, ambiguous perception and its amenability to top-down influences can be employed as an empirical paradigm to explore the principles of perception. Here we offer an overview of both classical and recent contributions on how stable and transient states of the observer can impact ambiguous perception. As to the influence of the stable states of the observer, we show that what is currently perceived can be influenced (1) by cognitive and affective aspects, such as meaning, prior knowledge, motivation, and emotional content and (2) by individual differences, such as gender, handedness, genetic inheritance, clinical conditions, and personality traits and by (3) learning and conditioning. As to the impact of transient states of the observer, we outline the effects of (4) attention and (5) voluntary control, which have attracted much empirical work along the history of ambiguous perception. In the huge literature on the topic we trace a difference between the observer's ability to control dominance (i.e., the maintenance of a specific percept in visual awareness) and reversal rate (i.e., the switching between two alternative percepts). Other transient states of the observer that have more recently drawn researchers' attention regard (6) the effects of imagery and visual working memory. (7) Furthermore, we describe the transient effects of prior history of perceptual dominance. (8) Finally, we address the currently available computational models of ambiguous perception and how they can take into account the crucial share played by the state of the observer in perceiving ambiguous displays.

Revisiting the Lissajous figure as a tool to study bistable perception

During bistable vision perception spontaneously "switches" between two mutually exclusive percepts despite constant sensory input. The endogenous nature of these perceptual transitions has motivated extensive research aimed at the underlying mechanisms, since spontaneous perceptual transitions of bistable stimuli should in principle allow for a dissociation of processes related to sensory stimulation from those related to conscious perception. However, transitions from one conscious percept to another are often not instantaneous, and participants usually report a considerable amount of mixed or unclear percepts. This feature of bistable vision makes it difficult to isolate transition-related visual processes. Here, we revisited an ambiguous depth-from-motion stimulus which was first introduced to experimental psychology more than 80 years ago. This rotating Lissajous figure might prove useful in complementing other bistable stimuli, since its perceptual transitions only occur at critical stimulus configurations and are virtually instantaneous, thus facilitating the construction of a perceptually equivalent replay condition. We found that three parameters of the Lissajous figure - complexity, line width, and rotational speed - differentially modulated its perceptual dominance durations and transition probabilities, thus providing experimenters with a versatile tool to study the perceptual dynamics of bistable vision.

Perceptual memory drives learning of retinotopic biases for bistable stimuli

The visual system exploits past experience at multiple timescales to resolve perceptual ambiguity in the retinal image. For example, perception of a bistable stimulus can be biased toward one interpretation over another when preceded by a brief presentation of a disambiguated version of the stimulus (positive priming) or through intermittent presentations of the ambiguous stimulus (stabilization). Similarly, prior presentations of unambiguous stimuli can be used to explicitly “train” a long-lasting association between a percept and a retinal location (perceptual association). These phenonema have typically been regarded as independent processes, with short-term biases attributed to perceptual memory and longer-term biases described as associative learning. Here we tested for interactions between these two forms of experience-dependent perceptual bias and demonstrate that short-term processes strongly influence long-term outcomes. We first demonstrate that the establishment of long-term perceptual contingencies does not require explicit training by unambiguous stimuli, but can arise spontaneously during the periodic presentation of brief, ambiguous stimuli. Using rotating Necker cube stimuli, we observed enduring, retinotopically specific perceptual biases that were expressed from the outset and remained stable for up to 40 min, consistent with the known phenomenon of perceptual stabilization. Further, bias was undiminished after a break period of 5 min, but was readily reset by interposed periods of continuous, as opposed to periodic, ambiguous presentation. Taken together, the results demonstrate that perceptual biases can arise naturally and may principally reflect the brain's tendency to favor recent perceptual interpretation at a given retinal location. Further, they suggest that an association between retinal location and perceptual state, rather than a physical stimulus, is sufficient to generate long-term biases in perceptual organization.

Structure-from-motion: dissociating perception, neural persistence, and sensory memory of illusory depth and illusory rotation

In the structure-from-motion paradigm, physical motion on a screen produces the vivid illusion of an object rotating in depth. Here, we show how to dissociate illusory depth and illusory rotation in a structure-from-motion stimulus using a rotationally asymmetric shape and reversals of physical motion. Reversals of physical motion create a conflict between the original illusory states and the new physical motion: Either illusory depth remains constant and illusory rotation reverses, or illusory rotation stays the same and illusory depth reverses. When physical motion reverses after the interruption in presentation, we find that illusory rotation tends to remain constant for long blank durations (T (blank) ≥ 0.5 s), but illusory depth is stabilized if interruptions are short (T (blank) ≤ 0.1 s). The stability of illusory depth over brief interruptions is consistent with the effect of neural persistence. When this is curtailed using a mask, stability of ambiguous vision (for either illusory depth or illusory rotation) is disrupted. We also examined the selectivity of the neural persistence of illusory depth. We found that it relies on a static representation of an interpolated illusory object, since changes to low-level display properties had little detrimental effect. We discuss our findings with respect to other types of history dependence in multistable displays (sensory stabilization memory, neural fatigue, etc.). Our results suggest that when brief interruptions are used during the presentation of multistable displays, switches in perception are likely to rely on the same neural mechanisms as spontaneous switches, rather than switches due to the initial percept choice at the stimulus onset.

The role of attention in ambiguous reversals of structure-from-motion

Multiple dots moving independently back and forth on a flat screen induce a compelling illusion of a sphere rotating in depth (structure-from-motion). If all dots simultaneously reverse their direction of motion, two perceptual outcomes are possible: either the illusory rotation reverses as well (and the illusory depth of each dot is maintained), or the illusory rotation is maintained (but the illusory depth of each dot reverses). We investigated the role of attention in these ambiguous reversals. Greater availability of attention--as manipulated with a concurrent task or inferred from eye movement statistics--shifted the balance in favor of reversing illusory rotation (rather than depth). On the other hand, volitional control over illusory reversals was limited and did not depend on tracking individual dots during the direction reversal. Finally, display properties strongly influenced ambiguous reversals. Any asymmetries between 'front' and 'back' surfaces--created either on purpose by coloring or accidentally by random dot placement--also shifted the balance in favor of reversing illusory rotation (rather than depth). We conclude that the outcome of ambiguous reversals depends on attention, specifically on attention to the illusory sphere and its surface irregularities, but not on attentive tracking of individual surface dots.

On the functional relevance of frontal cortex for passive and voluntarily controlled bistable vision

In bistable vision, one constant ambiguous stimulus leads to 2 alternating conscious percepts. This perceptual switching occurs spontaneously but can also be influenced through voluntary control. Neuroimaging studies have reported that frontal regions are activated during spontaneous perceptual switches, leading some researchers to suggest that frontal regions causally induce perceptual switches. But the opposite also seems possible: frontal activations may themselves be caused by spontaneous switches. Classically implicated in attentional processes, these same regions are also candidates for the origins of voluntary control over bistable vision. Here too, it remains unknown whether frontal cortex is actually functionally relevant. It is even possible that spontaneous perceptual switches and voluntarily induced switches are mediated by the same top-down mechanisms. To directly address these issues, we here induced "virtual lesions," with transcranial magnetic stimulation, in frontal, parietal, and 2 lower level visual cortices using an established ambiguous structure-from-motion stimulus. We found that dorsolateral prefrontal cortex was causally relevant for voluntary control over perceptual switches. In contrast, we failed to find any evidence for an active role of frontal cortex in passive bistable vision. Thus, it seems the same pathway used for willed top-down modulation of bistable vision is not used during passive bistable viewing.

Online action-to-perception transfer: only percept-dependent action affects perception

Perception self-evidently affects action, but under which conditions does action in turn influence perception? To answer this question we ask observers to view an ambiguous stimulus that is alternatingly perceived as rotating clockwise or counterclockwise. When observers report the perceived direction by rotating a manipulandum, opposing directions between report and percept ('incongruent') destabilize the percept, whereas equal directions ('congruent') stabilize it. In contrast, when observers report their percept by key presses while performing a predefined movement, we find no effect of congruency. Consequently, our findings suggest that only percept-dependent action directly influences perceptual experience.

Human middle temporal cortex, perceptual bias, and perceptual memory for ambiguous three-dimensional motion

When faced with inconclusive or conflicting visual input human observers experience one of multiple possible perceptions. One factor that determines perception of such an ambiguous stimulus is how the same stimulus was perceived on previous occasions, a phenomenon called perceptual memory. We examined perceptual memory of an ambiguous motion stimulus while applying transcranial magnetic stimulation (TMS) to the motion-sensitive areas of the middle temporal cortex (hMT+). TMS increased the predominance of whichever perceptual interpretation was most commonly reported by a given observer at baseline, with reduced perception of the less favored interpretation. This increased incidence of the preferred percept indicates impaired long-term buildup of perceptual memory traces that normally act against individual percept biases. We observed no effect on short-term memory traces acting from one presentation to the next. Our results indicate that hMT+ is important for the long-term buildup of perceptual memory for ambiguous motion stimuli.

Stochastic variations in sensory awareness are driven by noisy neuronal adaptation: evidence from serial correlations in perceptual bistability

When the sensory system is subjected to ambiguous input, perception alternates between interpretations in a seemingly random fashion. Although neuronal noise obviously plays a role, the neural mechanism for the generation of randomness at the slow time scale of the percept durations (multiple seconds) is unresolved. Here significant nonzero serial correlations are reported in series of visual percept durations (to the author's knowledge for the first time accounting for duration impurities caused by reaction time, drift, and incomplete percepts). Serial correlations for perceptual rivalry using structure-from-motion ambiguity were smaller than for binocular rivalry using orthogonal gratings. A spectrum of computational models is considered, and it is concluded that noise in adaptation of percept-related neurons causes the serial correlations. This work bridges, in a physiologically plausible way, widely appreciated deterministic modeling and randomness in experimental observations of visual rivalry.

Multisensory congruency as a mechanism for attentional control over perceptual selection

The neural mechanisms underlying attentional selection of competing neural signals for awareness remains an unresolved issue. We studied attentional selection, using perceptually ambiguous stimuli in a novel multisensory paradigm that combined competing auditory and competing visual stimuli. We demonstrate that the ability to select, and attentively hold, one of the competing alternatives in either sensory modality is greatly enhanced when there is a matching cross-modal stimulus. Intriguingly, this multimodal enhancement of attentional selection seems to require a conscious act of attention, as passively experiencing the multisensory stimuli did not enhance control over the stimulus. We also demonstrate that congruent auditory or tactile information, and combined auditory-tactile information, aids attentional control over competing visual stimuli and visa versa. Our data suggest a functional role for recently found neurons that combine voluntarily initiated attentional functions across sensory modalities. We argue that these units provide a mechanism for structuring multisensory inputs that are then used to selectively modulate early (unimodal) cortical processing, boosting the gain of task-relevant features for willful control over perceptual awareness.

Intermittent ambiguous stimuli: implicit memory causes periodic perceptual alternations

When viewing a stimulus that has multiple plausible real-world interpretations, perception alternates between these interpretations every few seconds. Alternations can be halted by intermittently removing the stimulus from view. The same interpretation dominates over many successive presentations, and perception stabilizes. Here we study perception during long sessions of such intermittent presentation. We demonstrate that, rather than causing truly stable perception, intermittent presentation gives rise to a perceptual alternation cycle with its own characteristics and dependencies, different from those during continuous presentation. Alternations during intermittent viewing typically occur once every few minutes--much less frequently than the seconds-scale alternations during continuous viewing. Strikingly, alternations during intermittent viewing occur at fairly regular intervals, making for a surprisingly periodic alternation cycle. The duration of this cycle becomes longer as the blank duration between presentations is increased, reaching dozens of minutes in some cases. We interpret our findings in terms of a mathematical model that describes a neural network with competition between alternative interpretations. Network sensitivities depend on prior dominance, thus providing a memory for past perception. Slow changes in sensitivity produce both perceptual stabilization and the regular but infrequent alternations, meaning that the same memory traces are responsible for both. This model provides a good description of psychophysical findings, and offers several indications regarding their neural basis.

Rapid perceptual switching of a reversible biological figure

Certain visual stimuli can give rise to contradictory perceptions. In this paper we examine the temporal dynamics of perceptual reversals experienced with biological motion, comparing these dynamics to those observed with other ambiguous structure from motion (SFM) stimuli. In our first experiment, naïve observers monitored perceptual alternations with an ambiguous rotating walker, a figure that randomly alternates between walking in clockwise (CW) and counter-clockwise (CCW) directions. While the number of reported reversals varied between observers, the observed dynamics (distribution of dominance durations, CW/CCW proportions) were comparable to those experienced with an ambiguous kinetic depth cylinder. In a second experiment, we compared reversal profiles with rotating and standard point-light walkers (i.e. non-rotating). Over multiple test repetitions, three out of four observers experienced consistently shorter mean percept durations with the rotating walker, suggesting that the added rotational component may speed up reversal rates with biomotion. For both stimuli, the drift in alternation rate across trial and across repetition was minimal. In our final experiment, we investigated whether reversals with the rotating walker and a non-biological object with similar global dimensions (rotating cuboid) occur at random phases of the rotation cycle. We found evidence that some observers experience peaks in the distribution of response locations that are relatively stable across sessions. Using control data, we discuss the role of eye movements in the development of these reversal patterns, and the related role of exogenous stimulus characteristics. In summary, we have demonstrated that the temporal dynamics of reversal with biological motion are similar to other forms of ambiguous SFM. We conclude that perceptual switching with biological motion is a robust bistable phenomenon.

Widespread fMRI activity differences between perceptual states in visual rivalry are correlated with differences in observer biases

When observing bistable stimuli, the percept can change in the absence of changes in the stimulus itself. When intermittently presenting a bistable stimulus, the number of perceptual alternations can increase or decrease, depending on the duration of the period that the stimulus is removed from screen between stimulus presentations (off-period). Longer off-periods lead to stabilization of the percept, while short off-periods produce perceptual alternations. Here we compare fMRI brain activation across percept repetitions and alternations when observing an intermittently presented ambiguously rotating structure from motion sphere. In the first experimental session, subjects were requested to voluntarily control the percept into either a repeating or an alternating perceptual regime at a single off-period. In a consecutive session, subjects observed the sphere uninstructed, and reported alternations and repetitions. The behavioral data showed that there were marked individual biases for observing the sphere as either repeating or alternating. The fMRI data showed activation differences between alternating and repeating perceptual regimes in an extensive network that included parietal cortex, dorsal premotor area, dorsolateral prefrontal cortex, supplementary motor area, insula, and cerebellum. However, these activation differences could all be explained by intersubject differences in the bias for one of the two perceptual regimes. The stronger the bias was for a particular perceptual regime, the less activation and vice versa. We conclude that widespread activation differences between perceptual regimes can be accounted for by differences in the perceptual bias for one of the two regimes.

General validity of Levelt's propositions reveals common computational mechanisms for visual rivalry

The mechanisms underlying conscious visual perception are often studied with either binocular rivalry or perceptual rivalry stimuli. Despite existing research into both types of rivalry, it remains unclear to what extent their underlying mechanisms involve common computational rules. Computational models of binocular rivalry mechanisms are generally tested against Levelt's four propositions, describing the psychophysical relation between stimulus strength and alternation dynamics in binocular rivalry. Here we use a bistable rotating structure-from-motion sphere, a generally studied form of perceptual rivalry, to demonstrate that Levelt's propositions also apply to the alternation dynamics of perceptual rivalry. Importantly, these findings suggest that bistability in structure-from-motion results from active cross-inhibition between neural populations with computational principles similar to those present in binocular rivalry. Thus, although the neural input to the computational mechanism of rivalry may stem from different cortical neurons and different cognitive levels the computational principles just prior to the production of visual awareness appear to be common to the two types of rivalry.

Perceptual switch rates with ambiguous structure-from-motion figures in bipolar disorder

Slowing of the rate at which a rivalrous percept switches from one configuration to another has been suggested as a potential trait marker for bipolar disorder. We measured perceptual alternations for a bistable, rotating, structure-from-motion cylinder in bipolar and control participants. In a control task, binocular depth rendered the direction of cylinder rotation unambiguous to monitor participants' performance and attention during the experimental task. A particular direction of rotation was perceptually stable, on average, for 33.5 s in participants without psychiatric diagnosis. Euthymic, bipolar participants showed a slightly slower rate of switching between the two percepts (percept duration 42.3 s). Under a parametric analysis of the best-fitting model for individual participants, this difference was statistically significant. However, the variability within groups was high, so this difference in average switch rates was not big enough to serve as a trait marker for bipolar disorder. We also found that low-level visual capacities, such as stereo threshold, influence perceptual switch rates. We suggest that there is no single brain location responsible for perceptual switching in all different ambiguous figures and that perceptual switching is generated by the actions of local cortical circuitry.

Bi-stable depth ordering of superimposed moving gratings

Ambiguous stimuli with two distinct interpretations give rise to perceptual alternations between them. During prolonged viewing of transparently moving gratings, observers report periods of perceiving one grating in front of the other, alternating with periods of the reverse depth ordering. We measured the percepts' dominance times to study the effect of depth cues (wavelength, duty cycle, and speed) on the perceived depth ordering. The grating with shorter wavelength, lower duty cycle, or higher speed was perceived as being behind the other for a fraction of time larger than one half. The fraction of time spent perceiving each grating as behind changed gradually as a function of the parameters. The fraction of dominance depended on the ratio between the gratings' wavelengths, not on their absolute sizes. The wavelength ratio had a stronger effect on perceived depth than that of duty cycle or speed and could override stereoscopic disparity cues. Similar results were obtained with superimposed moving surfaces of random dots. The findings are interpreted in terms of their relation to statistical properties of natural surfaces and provide evidence that the fraction of dominance of each percept represents the likelihood that it corresponds to the true interpretation of the underlying scene.

Early interactions between neuronal adaptation and voluntary control determine perceptual choices in bistable vision

At the onset of bistable stimuli, the brain needs to choose which of the competing perceptual interpretations will first reach awareness. Stimulus manipulations and cognitive control both influence this choice process, but the underlying mechanisms and interactions remain poorly understood. Using intermittent presentation of bistable visual stimuli, we demonstrate that short interruptions cause perceptual reversals upon the next presentation, whereas longer interstimulus intervals stabilize the percept. Top-down voluntary control biases this process but does not override the timing dependencies. Extending a recently introduced low-level neural model, we demonstrate that percept-choice dynamics in bistable vision can be fully understood with interactions in early neural processing stages. Our model includes adaptive neural processing preceding a rivalry resolution stage with cross-inhibition, adaptation, and an interaction of the adaptation levels with a neural baseline. Most importantly, our findings suggest that top-down attentional control over bistable stimuli interacts with low-level mechanisms at early levels of sensory processing before perceptual conflicts are resolved and perceptual choices about bistable stimuli are made.

Visual cortex allows prediction of perceptual states during ambiguous structure-from-motion

We investigated the role of retinotopic visual cortex and motion-sensitive areas in representing the content of visual awareness during ambiguous structure-from-motion (SFM), using functional magnetic resonance imaging (fMRI) and multivariate statistics (support vector machines). Our results indicate that prediction of perceptual states can be very accurate for data taken from dorsal visual areas V3A, V4D, V7, and MT+ and for parietal areas responsive to SFM, but to a lesser extent for other visual areas. Generalization of prediction was possible, because prediction accuracy was significantly better than chance for both an unambiguous stimulus and a different experimental design. Detailed analysis of eye movements revealed that strategic and even encouraged beneficial eye movements were not the cause of the prediction accuracy based on cortical activation. We conclude that during perceptual rivalry, neural correlates of visual awareness can be found in retinotopic visual cortex, MT+, and parietal cortex. We argue that the organization of specific motion-sensitive neurons creates detectable biases in the preferred direction selectivity of voxels, allowing prediction of perceptual states. During perceptual rivalry, retinotopic visual cortex, in particular higher-tier dorsal areas like V3A and V7, actively represents the content the visual awareness.

Inter-ocular transfer of stimulus cueing in dominance selection at the onset of binocular rivalry

Recent work investigated the influence of exogenous attention on initial percept dominance at the onset of binocular rivalry. It was reported that cueing attention to one of two binocularly presented transparent stimuli immediately prior to rivalrous viewing provided the cued stimulus with a competitive advantage in subsequent binocular rivalry. This effect was independent of the eye containing the cued stimulus during the rivalry phase. In this recent work, the attention cue was always presented to both eyes. This leaves unclear the extent to which cueing affects binocular and/or monocular stimulus representations. To disambiguate this issue, we compared the cueing strength when the cue was presented ipsi-, contra- or bi-laterally with respect to the eye containing the cued stimulus during subsequent binocular rivalry. Besides replicating previous findings, we found that stimulus cueing readily transfers across eyes, suggesting that binocular mechanisms mediate exogenous attention effects on dominance selection at the onset of binocular rivalry.

Attentional control over either of the two competing percepts of ambiguous stimuli revealed by a two-parameter analysis: Means do not make the difference

We studied distributions of perceptual rivalry reversals, as defined by the two fitted parameters of the Gamma distribution. We did so for a variety of bi-stable stimuli and voluntary control exertion tasks. Subjects' distributions differed from one another for a particular stimulus and control task in a systematic way that reflects a constraint on the describing parameters. We found a variety of two-parameter effects, the most important one being that distributions of subjects differ from one another in the same systematic way across different stimuli and control tasks (i.e., a fast switcher remains fast across all conditions in a parameter-specified way). The cardinal component of subject-dependent variation was not the conventionally used mean reversal rate, but a component that was oriented-for all stimuli and tasks-roughly perpendicular to the mean rate. For the Necker cube, we performed additional experiments employing specific variations in control exertion, suggesting that subjects have to a considerable extent independent control over the reversal rate of either of the two competing percepts.