Where is the ghost in the shell?

The neurobiology of conscious experience is one of the fundamental mysteries in science. New evidence suggests that transcranial magnetic stimulation of the parietal cortex does not modulate bistable perception. What does this mean for the neural correlates of consciousness, and how should we search for them?

Bistable perception, precision and neuromodulation

Bistable perception follows from observing a static, ambiguous, (visual) stimulus with two possible interpretations. Here, we present an active (Bayesian) inference account of bistable perception and posit that perceptual transitions between different interpretations (i.e. inferences) of the same stimulus ensue from specific eye movements that shift the focus to a different visual feature. Formally, these inferences are a consequence of precision control that determines how confident beliefs are and change the frequency with which one can perceive-and alternate between-two distinct percepts. We hypothesized that there are multiple, but distinct, ways in which precision modulation can interact to give rise to a similar frequency of bistable perception. We validated this using numerical simulations of the Necker cube paradigm and demonstrate the multiple routes that underwrite the frequency of perceptual alternation. Our results provide an (enactive) computational account of the intricate precision balance underwriting bistable perception. Importantly, these precision parameters can be considered the computational homologs of particular neurotransmitters-i.e. acetylcholine, noradrenaline, dopamine-that have been previously implicated in controlling bistable perception, providing a computational link between the neurochemistry and perception.

Tug-of-Peace: Visual Rivalry and Atypical Visual Motion Processing in MECP2 Duplication Syndrome of Autism

Extracting common patterns of neural circuit computations in the autism spectrum and confirming them as a cause of specific core traits of autism is the first step toward identifying cell-level and circuit-level targets for effective clinical intervention. Studies in humans with autism have identified functional links and common anatomic substrates between core restricted behavioral repertoire, cognitive rigidity, and overstability of visual percepts during visual rivalry. To study these processes with single-cell precision and comprehensive neuronal population coverage, we developed the visual bistable perception paradigm for mice based on ambiguous moving plaid patterns consisting of two transparent gratings drifting at an angle of 120°. This results in spontaneous reversals of the perception between local component motion (plaid perceived as two separate moving grating components) and integrated global pattern motion (plaid perceived as a fused moving texture). This robust paradigm does not depend on the explicit report of the mouse, since the direction of the optokinetic nystagmus (OKN) is used to infer the dominant percept. Using this paradigm, we found that the rate of perceptual reversals between global and local motion interpretations is reduced in the methyl-CpG-binding protein 2 duplication syndrome (MECP2-ds) mouse model of autism. Moreover, the stability of local motion percepts is greatly increased in MECP2-ds mice at the expense of global motion percepts. Thus, our model reproduces a subclass of the core features in human autism (reduced rate of visual rivalry and atypical perception of visual motion). This further offers a well-controlled approach for dissecting neuronal circuits underlying these core features.

An Accumulating Neural Signal Underlying Binocular Rivalry Dynamics

During binocular rivalry, conflicting images are presented one to each eye and perception alternates stochastically between them. Despite stable percepts between alternations, modeling suggests that neural signals representing the two images change gradually, and that the duration of stable percepts are determined by the time required for these signals to reach a threshold that triggers an alternation. However, direct physiological evidence for such signals has been lacking. Here, we identify a neural signal in the human visual cortex that shows these predicted properties. We measured steady-state visual evoked potentials (SSVEPs) in 84 human participants (62 females, 22 males) who were presented with orthogonal gratings, one to each eye, flickering at different frequencies. Participants indicated their percept while EEG data were collected. The time courses of the SSVEP amplitudes at the two frequencies were then compared across different percept durations, within participants. For all durations, the amplitude of signals corresponding to the suppressed stimulus increased and the amplitude corresponding to the dominant stimulus decreased throughout the percept. Critically, longer percepts were characterized by more gradual increases in the suppressed signal and more gradual decreases of the dominant signal. Changes in signals were similar and rapid at the end of all percepts, presumably reflecting perceptual transitions. These features of the SSVEP time courses are well predicted by a model in which perceptual transitions are produced by the accumulation of noisy signals. Identification of this signal underlying binocular rivalry should allow strong tests of neural models of rivalry, bistable perception, and neural suppression.SIGNIFICANCE STATEMENT During binocular rivalry, two conflicting images are presented to the two eyes and perception alternates between them, with switches occurring at seemingly random times. Rivalry is an important and longstanding model system in neuroscience, used for understanding neural suppression, intrinsic neural dynamics, and even the neural correlates of consciousness. All models of rivalry propose that it depends on gradually changing neural activity that on reaching some threshold triggers the perceptual switches. This manuscript reports the first physiological measurement of neural signals with that set of properties in human participants. The signals, measured with EEG in human observers, closely match the predictions of recent models of rivalry, and should pave the way for much future work.

Altered Perception of the Bistable Motion Quartet in Albinism

Purpose

Perception of the motion quartet (MQ) alternates between horizontal and vertical motion, with a bias toward vertical motion. This vertical bias has been explained by the dominance of intrahemispheric processing. In albinism, each hemisphere receives input from both visual hemifields owing to enhanced crossing of the optic nerves at the optic chiasm. This might affect the perception of the ambiguous MQ and particularly the vertical bias.

Methods

The effect of optic nerve misrouting in persons with albinism and nystagmus (PWA, n = 14) on motion perception for MQ was compared with healthy controls (HC; n = 11) and with persons with nystagmus in the absence of optic nerve misrouting (PWN; n = 12). We varied the ratio of horizontal and vertical distances of MQ dots (aspect ratio [AR]) between 0.75 and 1.25 and compared the percentages of horizontal and vertical motion percepts as a function of AR between groups.

Results

For HC, the probability of vertical motion perception increased as a sigmoid function with increasing AR exhibiting the expected vertical percept bias (mean, 58%; median, 54%; vertical motion percepts). PWA showed a surprisingly strong horizontal bias independent of the AR with a mean of 11% (median, 10%) vertical motion percepts. The PWN was in between PWA and HC, with a mean of 34% (median, 47%) vertical perception. Nystagmus alone is unlikely to explain this pattern of results because PWA and PWN had comparable fixation stabilities.

Conclusions

The strong horizontal bias observed in PWA and PWN might partly result from the horizontal nystagmus. The even stronger horizontal bias in PWA indicates that the intrahemispherical corepresentation of both visual hemifields may play an additional role. The altered perception of the MQ in PWA opens opportunities to (i) understand the interplay of stability and plasticity in altered visual pathway conditions and (ii) identify visual pathway abnormalities with a perception-based test using the MQ.

Individual differences in emotional reactions to bistable perception

OBJECTIVE

To assess whether there are individual differences in emotional reactions to bistable images, and if so, to identify some of the psychological factors that predict them.

BACKGROUND

Bistable images - which have two competing perceptual interpretations - have long been used in the scientific study of consciousness. Here we applied a different lens and investigated emotional reactions to them. Method Participants were adult humans in a cross-sectional study. Participants were presented with three bistable images and rated their emotional reactions to experiencing bistability. They also completed measures of intolerance of uncertainty, cognitive empathy, affective empathy, and negative affect. Results There were marked individual differences in these reactions, ranging from feeling highly negative to highly positive. These individual differences in emotional response to bistability were linked to a number of psychological processes: intolerance of uncertainty, cognitive empathy, and negative affect, but not affective empathy. Conclusions These finding have important implications because: (a) these emotional reactions could distort scientific investigations that use these stimuli to study non-emotional perceptual and cognitive processes; and (b) they highlight that this approach offers a useful window into how individuals react to these stimuli that demonstrate that there is not always a single viable interpretation of the world around us.

Spontaneous Necker-cube reversals may not be that spontaneous

Introduction

During observation of the ambiguous Necker cube, our perception suddenly reverses between two about equally possible 3D interpretations. During passive observation, perceptual reversals seem to be sudden and spontaneous. A number of theoretical approaches postulate destabilization of neural representations as a pre-condition for reversals of ambiguous figures. In the current study, we focused on possible Electroencephalogram (EEG) correlates of perceptual destabilization, that may allow prediction of an upcoming perceptual reversal.

Methods

We presented ambiguous Necker cube stimuli in an onset-paradigm and investigated the neural processes underlying endogenous reversals as compared to perceptual stability across two consecutive stimulus presentations. In a separate experimental condition, disambiguated cube variants were alternated randomly, to exogenously induce perceptual reversals. We compared the EEG immediately before and during endogenous Necker cube reversals with corresponding time windows during exogenously induced perceptual reversals of disambiguated cube variants.

Results

For the ambiguous Necker cube stimuli, we found the earliest differences in the EEG between reversal trials and stability trials already 1 s before a reversal occurred, at bilateral parietal electrodes. The traces remained similar until approximately 1100 ms before a perceived reversal, became maximally different at around 890 ms (p = 7.59 × 10^-6, Cohen's d = 1.35) and remained different until shortly before offset of the stimulus preceding the reversal. No such patterns were found in the case of disambiguated cube variants.

Discussion

The identified EEG effects may reflect destabilized states of neural representations, related to destabilized perceptual states preceding a perceptual reversal. They further indicate that spontaneous Necker cube reversals are most probably not as spontaneous as generally thought. Rather, the destabilization may occur over a longer time scale, at least 1 s before a reversal event, despite the reversal event as such being perceived as spontaneous by the viewer.

Attractor-Like Dynamics Extracted from Human Electrocorticographic Recordings Underlie Computational Principles of Auditory Bistable Perception

In bistable perception, observers experience alternations between two interpretations of an unchanging stimulus. Neurophysiological studies of bistable perception typically partition neural measurements into stimulus-based epochs and assess neuronal differences between epochs based on subjects' perceptual reports. Computational studies replicate statistical properties of percept durations with modeling principles like competitive attractors or Bayesian inference. However, bridging neuro-behavioral findings with modeling theory requires the analysis of single-trial dynamic data. Here, we propose an algorithm for extracting nonstationary timeseries features from single-trial electrocorticography (ECoG) data. We applied the proposed algorithm to 5-min ECoG recordings from human primary auditory cortex obtained during perceptual alternations in an auditory triplet streaming task (six subjects: four male, two female). We report two ensembles of emergent neuronal features in all trial blocks. One ensemble consists of periodic functions that encode a stereotypical response to the stimulus. The other comprises more transient features and encodes dynamics associated with bistable perception at multiple time scales: minutes (within-trial alternations), seconds (duration of individual percepts), and milliseconds (switches between percepts). Within the second ensemble, we identified a slowly drifting rhythm that correlates with the perceptual states and several oscillators with phase shifts near perceptual switches. Projections of single-trial ECoG data onto these features establish low-dimensional attractor-like geometric structures invariant across subjects and stimulus types. These findings provide supporting neural evidence for computational models with oscillatory-driven attractor-based principles. The feature extraction techniques described here generalize across recording modality and are appropriate when hypothesized low-dimensional dynamics characterize an underlying neural system.SIGNIFICANCE STATEMENT Irrespective of the sensory modality, neurophysiological studies of multistable perception have typically investigated events time-locked to the perceptual switching rather than the time course of the perceptual states per se. Here, we propose an algorithm that extracts neuronal features of bistable auditory perception from largescale single-trial data while remaining agnostic to the subject's perceptual reports. The algorithm captures the dynamics of perception at multiple timescales, minutes (within-trial alternations), seconds (durations of individual percepts), and milliseconds (timing of switches), and distinguishes attributes of neural encoding of the stimulus from those encoding the perceptual states. Finally, our analysis identifies a set of latent variables that exhibit alternating dynamics along a low-dimensional manifold, similar to trajectories in attractor-based models for perceptual bistability.

Distinct dorsal and ventral streams for binocular rivalry dominance and suppression revealed by magnetoencephalography

Binocular rivalry is an example of bistable visual perception extensively examined in neuroimaging. Magnetoencephalography can track brain responses to phasic visual stimulations of predetermined frequency and phase to advance our understanding of perceptual dominance and suppression in binocular rivalry. We used left and right eye stimuli that flickered at two tagging frequencies to track their respective oscillatory cortical evoked responses. We computed time-resolved measures of coherence to track brain responses phase locked with stimulus frequencies and with respect to the participants' indications of alternations of visual rivalry they experienced. We compared the brain maps obtained to those from a non-rivalrous control replay condition that used physically changing stimuli to mimic rivalry. We found stronger coherence within a posterior cortical network of visual areas during rivalry dominance compared with rivalry suppression and replay control. This network extended beyond the primary visual cortex to several retinotopic visual areas. Moreover, network coherence with dominant percepts in primary visual cortex peaked at least 50 ms prior to the suppressed percept nadir, consistent with the escape theory of alternations. Individual alternation rates were correlated with the rate of change in dominant evoked peaks, but not for the slope of response to suppressed percepts. Effective connectivity measures revealed that dominant (respectively, suppressed) percepts were expressed in dorsal (respectively ventral) streams. We thus demonstrate that binocular rivalry dominance and suppression engage distinct mechanisms and brain networks. These findings advance neural models of rivalry and may relate to more general aspects of selection and suppression in natural vision.

Investigating racing thoughts via ocular temporal windows: deficits in the control of automatic perceptual processes

BACKGROUND

Racing thoughts have been found in several states of bipolar disorder (BD), but also in healthy populations with subclinical mood alterations. The evaluation of racing thoughts relies on subjective reports, and objective measures are sparse. The current study aims at finding an objective neuropsychological equivalent of racing thoughts in a mixed group of BD patients and healthy controls by using a bistable perception paradigm.

METHOD

Eighty-three included participants formed three groups based on participants' levels of racing thoughts reported via the Racing and Crowded Thoughts Questionnaire. Participants reported reversals in their perception during viewing of the bistable Necker cube either spontaneously, while asked to focus on one interpretation of the cube, or while asked to accelerate perceptual reversals. The dynamics of perceptual alternations were studied both at a conscious level (with manual temporal windows reflecting perceptual reversals) and at a more automatic level (with ocular temporal windows derived from ocular fixations).

RESULTS

The rate of windows was less modulated by attentional conditions in participants with racing thoughts, and most clearly so for ocular windows. The rate of ocular windows was especially high when participants with racing thoughts were asked to focus on one interpretation of the Necker cube and when they received these instructions for the first time.

CONCLUSIONS

Our results indicate that in subjects with racing thoughts automatic perceptual processes escape cognitive control mechanisms. Racing thoughts may involve not only conscious thought mechanisms but also more automatic processes.

Adaptation in the sensory cortex drives bistable switching during auditory stream segregation

Current theories of perception emphasize the role of neural adaptation, inhibitory competition, and noise as key components that lead to switches in perception. Supporting evidence comes from neurophysiological findings of specific neural signatures in modality-specific and supramodal brain areas that appear to be critical to switches in perception. We used functional magnetic resonance imaging to study brain activity around the time of switches in perception while participants listened to a bistable auditory stream segregation stimulus, which can be heard as one integrated stream of tones or two segregated streams of tones. The auditory thalamus showed more activity around the time of a switch from segregated to integrated compared to time periods of stable perception of integrated; in contrast, the rostral anterior cingulate cortex and the inferior parietal lobule showed more activity around the time of a switch from integrated to segregated compared to time periods of stable perception of segregated streams, consistent with prior findings of asymmetries in brain activity depending on the switch direction. In sound-responsive areas in the auditory cortex, neural activity increased in strength preceding switches in perception and declined in strength over time following switches in perception. Such dynamics in the auditory cortex are consistent with the role of adaptation proposed by computational models of visual and auditory bistable switching, whereby the strength of neural activity decreases following a switch in perception, which eventually destabilizes the current percept enough to lead to a switch to an alternative percept.

No common factor for illusory percepts, but a link between pareidolia and delusion tendency: A test of predictive coding theory

Predictive coding theory is an influential view of perception and cognition. It proposes that subjective experience of the sensory information results from a comparison between the sensory input and the top-down prediction about this input, the latter being critical for shaping the final perceptual outcome. The theory is able to explain a wide range of phenomena extending from sensory experiences such as visual illusions to complex pathological states such as hallucinations and psychosis. In the current study we aimed at testing the proposed connection between different phenomena explained by the predictive coding theory by measuring the manifestation of top-down predictions at progressing levels of complexity, starting from bistable visual illusions (alternating subjective experience of the same sensory input) and pareidolias (alternative meaningful interpretation of the sensory input) to self-reports of hallucinations and delusional ideations in everyday life. Examining the correlation structure of these measures in 82 adult healthy subjects revealed a positive association between pareidolia proneness and a tendency for delusional ideations, yet without any relationship to bistable illusions. These results show that only a subset of the phenomena that are explained by the predictive coding theory can be attributed to one common underlying factor. Our findings thus support the hierarchical view of predictive processing with independent top-down effects at the sensory and cognitive levels.

Reversible-figure perception: Why is voluntary control limited?

Observers can voluntarily avoid reversals of an ambiguous, reversible figure, extending the duration of an intended percept. This is usually attributed to high-level, top-down attentional processes. However, voluntary control is limited. Reversals occur despite attempts to avoid them. In two experiments, observers demonstrated significant, but limited, voluntary control over Necker cube perception. Cube size and cube completeness, variables associated with stimulus-driven processes involving neural adaptation, influenced the frequency of reversals regardless of observers' intentions. Results are consistent with the hybrid hypothesis that both top-down and bottom-up processes contribute to Necker-cube perception and support the hypothesis that the contribution of bottom-up processes is responsible for the limitation on voluntary control.

Conflict monitoring and attentional adjustment during binocular rivalry

To make sense of ambiguous and, at times, fragmentary sensory input, the brain must rely on a process of active interpretation. At any given moment, only one of several possible perceptual representations prevails in our conscious experience. Our hypothesis is that the competition between alternative representations induces a pattern of neural activation resembling cognitive conflict, eventually leading to fluctuations between different perceptual outcomes in the case of steep competition. To test this hypothesis, we probed changes in perceptual awareness between competing images using binocular rivalry. We drew our predictions from the conflict monitoring theory, which holds that cognitive control is invoked by the detection of conflict during information processing. Our results show that fronto-medial theta oscillations (5-7 Hz), an established electroencephalography (EEG) marker of conflict, increases right before perceptual alternations and decreases thereafter, suggesting that conflict monitoring occurs during perceptual competition. Furthermore, to investigate conflict resolution via attentional engagement, we looked for a neural marker of perceptual switches as by parieto-occipital alpha oscillations (8-12 Hz). The power of parieto-occipital alpha displayed an inverse pattern to that of fronto-medial theta, reflecting periods of high interocular inhibition during stable perception, and low inhibition around moments of perceptual change. Our findings aim to elucidate the relationship between conflict monitoring mechanisms and perceptual awareness.

Non-stimulated regions in early visual cortex encode the contents of conscious visual perception

Predictions shape our perception. The theory of predictive processing poses that our brains make sense of incoming sensory input by generating predictions, which are sent back from higher to lower levels of the processing hierarchy. These predictions are based on our internal model of the world and enable inferences about the hidden causes of the sensory input data. It has been proposed that conscious perception corresponds to the currently most probable internal model of the world. Accordingly, predictions influencing conscious perception should be fed back from higher to lower levels of the processing hierarchy. Here, we used functional magnetic resonance imaging and multivoxel pattern analysis to show that non‐stimulated regions of early visual areas contain information about the conscious perception of an ambiguous visual stimulus. These results indicate that early sensory cortices in the human brain receive predictive feedback signals that reflect the current contents of conscious perception.

Causal roles of prefrontal cortex during spontaneous perceptual switching are determined by brain state dynamics

The prefrontal cortex (PFC) is thought to orchestrate cognitive dynamics. However, in tests of bistable visual perception, no direct evidence supporting such presumable causal roles of the PFC has been reported except for a recent work. Here, using a novel brain-state-dependent neural stimulation system, we identified causal effects on percept dynamics in three PFC activities—right frontal eye fields, dorsolateral PFC (DLPFC), and inferior frontal cortex (IFC). The causality is behaviourally detectable only when we track brain state dynamics and modulate the PFC activity in brain-state-/state-history-dependent manners. The behavioural effects are underpinned by transient neural changes in the brain state dynamics, and such neural effects are quantitatively explainable by structural transformations of the hypothetical energy landscapes. Moreover, these findings indicate distinct functions of the three PFC areas: in particular, the DLPFC enhances the integration of two PFC-active brain states, whereas IFC promotes the functional segregation between them. This work resolves the controversy over the PFC roles in spontaneous perceptual switching and underlines brain state dynamics in fine investigations of brain-behaviour causality.

A cube that seems to shift its spatial arrangement as you keep looking; the elegant silhouette of a pirouetting dancer, which starts to spin in the opposite direction the more you stare at it; an illustration that shows two profiles – or is it a vase? These optical illusions are examples of bistable visual perception. Beyond their entertaining aspect, they provide a way for scientists to explore the dynamics of human consciousness, and the neural regions involved in this process.

Some studies show that bistable visual perception is associated with the activation of the prefrontal cortex, a brain area involved in complex cognitive processes. However, it is unclear whether this region is required for the illusions to emerge. Some research has showed that even if sections of the prefrontal cortex are temporally deactivated, participants can still experience the illusions.

Instead, Takamitsu Watanabe proposes that bistable visual perception is a process tied to dynamic brain states – that is, that distinct regions of the prefontal cortex are required for this fluctuating visual awareness, depending on the state of the whole brain. Such causal link cannot be observed if brain activity is not tracked closely.

To investigate this, the brain states of 65 participants were recorded as individuals were experiencing the optical illusions; the activity of their various brain regions could therefore be mapped, and then areas of the prefrontal cortex could precisely be inhibited at the right time using transcranial magnetic stimulation. This revealed that, indeed, prefrontal cortex regions were necessary for bistable visual perception, but not in a simple way. Instead, which ones were required and when depended on activity dynamics taking place in the whole brain. Overall, these results indicate that monitoring brain states is necessary to better understand – and ultimately, control – the neural pathways underlying perception and behaviour.

The Certainty of Ambiguity in Visual Neural Representations

Some images evoke bistable percepts: two different visual experiences seen in alternation while continuously viewing an unchanged stimulus. The Necker Cube and Rubin's Vase are classic examples, each of which gives alternating percepts of different shapes. Other bistable percepts are alternating colors or directions of motion. Although stimuli that result in salient bistability are rare and sometimes cleverly constructed to emphasize ambiguity, they have been influential for over 150 years, since the work of von Helmholtz, who considered them to be evidence for perceptual visual processes that interpret retinal stimuli. While bistability in natural viewing is uncommon, the main point of this review is that implicit ambiguity in visual neural representations is pervasive. Resolving ambiguity, therefore, is a fundamental and ubiquitous process of vision that routinely affects what we see, not an oddity arising from cleverly crafted images. This review focuses on the causes of widespread ambiguity, historical perspectives on it, and modern knowledge and theory about resolving it.

An active role of inferior frontal cortex in conscious experience

In the search for the neural correlates of consciousness, it has remained controversial whether prefrontal cortex determines what is consciously experienced or, alternatively, serves only complementary functions, such as introspection or action. Here, we provide converging evidence from computational modeling and two functional magnetic resonance imaging experiments that indicated a key role of inferior frontal cortex in detecting perceptual conflicts caused by ambiguous sensory information. Crucially, the detection of perceptual conflicts by prefrontal cortex turned out to be critical in the process of transforming ambiguous sensory information into unambiguous conscious experiences: in a third experiment, disruption of neural activity in inferior frontal cortex through transcranial magnetic stimulation slowed down the updating of conscious experience that occurs in response to perceptual conflicts. These findings show that inferior frontal cortex actively contributes to the resolution of perceptual ambiguities. Prefrontal cortex is thus causally involved in determining the contents of conscious experience.

The Role of Blinks, Microsaccades and their Retinal Consequences in Bistable Motion Perception

Eye-related movements such as blinks and microsaccades are modulated during bistable perceptual tasks. However, if they play an active role during internal perceptual switches is not known. We conducted two experiments involving an ambiguous plaid stimulus, wherein participants were asked to continuously report their percept, which could consist of either unidirectional coherent or bidirectional component movement. Our main results show that blinks and microsaccades did not facilitate perceptual switches. On the contrary, a reduction in eye movements preceded the perceptual switch. Blanks, on the other hand, thought to mimic the retinal consequences of a blink, consistently led to a switch. Through the timing of the blank-introduced perceptual change, we were able to estimate the delay between the internal switch and the response. This delay further allowed us to evaluate that the reduction in blink probability co-occurred with the internal perceptual switch. Additionally, our results indicate that distinct internal processes underlie the switch to coherent vs. component percept. Blanks exclusively facilitated a switch to the coherent percept, and only the switch to coherent percept was followed by an increase in blink rate. In a second study, we largely replicated the findings and included a microsaccade analysis. Microsaccades only showed a weak relation with perceptual switches, but their direction was correlated with the perceived motion direction. Nevertheless, our data suggests an interaction between microsaccades and blinks by showing that microsaccades were differently modulated around blinks compared with blanks. This study shows that a reduction in eye movements precedes internal perceptual switches indicating that the rate of blinks can set the stage for a reinterpretation of sensory input. While a perceptual switch based on changed sensory input usually leads to an increase in blink rate, such an increase was only present after the perceptual switch to coherent motion but absent after the switch to component percept. This provides evidence of different underlying mechanism or internal consequence of the two perceptual switches and suggests that blinks can uncover differences in internal percept-related processes that are not evident from the percept itself.

Dynamics of a Mutual Inhibition Circuit between Pyramidal Neurons Compared to Human Perceptual Competition

Neural competition plays an essential role in active selection processes of noisy and ambiguous input signals, and it is assumed to underlie emergent properties of brain functioning, such as perceptual organization and decision-making. Despite ample theoretical research on neural competition, experimental tools to allow neurophysiological investigation of competing neurons have not been available. We developed a "hybrid" system where real-life neurons and a computer-simulated neural circuit interacted. It enabled us to construct a mutual inhibition circuit between two real-life pyramidal neurons. We then asked what dynamics this minimal unit of neural competition exhibits and compared them with the known behavioral-level dynamics of neural competition. We found that the pair of neurons shows bistability when activated simultaneously by current injections. The addition of modeled synaptic noise and changes in the activation strength showed that the dynamics of the circuit are strikingly similar to the known properties of bistable visual perception: The distribution of dominance durations showed a right-skewed shape, and the changes of the activation strengths caused changes in dominance, dominance durations, and reversal rates as stated in the well-known empirical laws of bistable perception known as Levelt's propositions.SIGNIFICANCE STATEMENT Visual perception emerges as the result of neural systems actively organizing visual signals that involves selection processes of competing neurons. While the neural competition, realized by a "mutual inhibition" circuit has been examined in many theoretical studies, its properties have not been investigated in real neurons. We have developed a "hybrid" system where two real-life pyramidal neurons in a mouse brain slice interact through a computer-simulated mutual inhibition circuit. We found that simultaneous activation of the neurons leads to bistable activity. We investigated the effect of noise and the effect of changes in the activation strength on the dynamics. We observed that the pair of neurons exhibit dynamics strikingly similar to the known properties of bistable visual perception.

Temporal dynamics of the flash-induced bouncing effect

Two identical visual disks moving toward each other on a two‐dimensional (2D) display are more likely to be perceived as “streaming through” than “bouncing off” each other after their coincidence. However, either a brief auditory tone or visual flash presented at the coincident moment of the disks can strikingly increase the incidence of the bouncing percept. Despite the neural substrates underlying the sound‐induced bouncing effect have been widely investigated, little is known about the neural mechanisms underlying the flash‐induced bouncing effect. The present study used event‐related potential recordings to explore the temporal dynamics of the flash‐induced bouncing effect. The results showed that the amplitude of the postcoincidence parietooccipital P2 component (190–230 ms after coincidence) elicited by the visual motion was significantly smaller on bouncing relative to streaming trials only when the flash was presented but not when absent. In addition, the parietal P3 component (330–430 ms) was found to be larger on bouncing than streaming trials when the flash was presented, but the opposite was true when no flash was presented. These electrophysiological findings suggest that the flash‐induced bouncing effect may occur at both perceptual and postperceptual stages of processing.

Psychotic Experiences in Schizophrenia and Sensitivity to Sensory Evidence

Perceptual inference depends on an optimal integration of current sensory evidence with prior beliefs about the environment. Alterations of this process have been related to the emergence of positive symptoms in schizophrenia. However, it has remained unclear whether delusions and hallucinations arise from an increased or decreased weighting of prior beliefs relative to sensory evidence. To investigate the relation of this prior-to-likelihood ratio to positive symptoms in schizophrenia, we devised a novel experimental paradigm which gradually manipulates perceptually ambiguous visual stimuli by disambiguating stimulus information. As a proxy for likelihood precision, we assessed the sensitivity of individual participants to sensory evidence. As a surrogate for the precision of prior beliefs in perceptual stability, we measured phase duration in ambiguity. Relative to healthy controls, patients with schizophrenia showed a stronger increment in congruent perceptual states for increasing levels of disambiguating stimulus evidence. Sensitivity to sensory evidence correlated positively with the individual patients' severity of perceptual anomalies and hallucinations. Moreover, the severity of such experiences correlated negatively with phase duration. Our results indicate that perceptual anomalies and hallucinations are associated with a shift of perceptual inference toward sensory evidence and away from prior beliefs. This reduced prior-to-likelihood ratio in sensory processing may contribute to the phenomenon of aberrant salience, which has been suggested to give rise to the false inferences underlying psychotic experiences.

Dissociable Neural Information Dynamics of Perceptual Integration and Differentiation during Bistable Perception

At any given moment, we experience a perceptual scene as a single whole and yet we may distinguish a variety of objects within it. This phenomenon instantiates two properties of conscious perception: integration and differentiation. Integration is the property of experiencing a collection of objects as a unitary percept and differentiation is the property of experiencing these objects as distinct from each other. Here, we evaluated the neural information dynamics underlying integration and differentiation of perceptual contents during bistable perception. Participants listened to a sequence of tones (auditory bistable stimuli) experienced either as a single stream (perceptual integration) or as two parallel streams (perceptual differentiation) of sounds. We computed neurophysiological indices of information integration and information differentiation with electroencephalographic and intracranial recordings. When perceptual alternations were endogenously driven, the integrated percept was associated with an increase in neural information integration and a decrease in neural differentiation across frontoparietal regions, whereas the opposite pattern was observed for the differentiated percept. However, when perception was exogenously driven by a change in the sound stream (no bistability), neural oscillatory power distinguished between percepts but information measures did not. We demonstrate that perceptual integration and differentiation can be mapped to theoretically motivated neural information signatures, suggesting a direct relationship between phenomenology and neurophysiology.

Assessing Field Dependence-Independence Cognitive Abilities Through EEG-Based Bistable Perception Processing

Field Dependence–Independence (FDI) is a widely studied dimension of cognitive styles designed to measure an individual’s ability to identify embedded parts of an organized visual field as entities separate from that given field. The research aims to determine whether the brain activity features that are considered to be perceptual switching indicators could serve as robust features, differentiating Field-Dependent (FD) from Field-Independent (FI) participants. Previous research suggests that various features derived from event related potentials (ERP) and frequency features are associated with the perceptual reversal occurring during the observation of a bistable image. In this study, we combined these features in the context of a different experimental scheme using ambiguous and unambiguous stimuli during participants’ perceptual observations. We assessed the participants’ FD-I classification with the use of the Hidden Figures Test (HFT). Results show that the peak amplitude of the frontoparietal positivity, the late positive deflection in frontal and parietal areas, is higher for the FD group at specific locations of the left lobe, whereas it occurs later for the FD group at the central and occipital electrodes. Additionally, the FD group exhibits higher levels of gamma power before stimulus onset at channel TP10 and higher gamma power during reversal at the right centroparietal electrodes (T8, CP6, and TP10). The peak amplitude of the reversal positivity, the positive deflection during the reversal, is higher for the FD group at the rear right lobe (P4).

Neural Signatures of Auditory Perceptual Bistability Revealed by Large-Scale Human Intracranial Recordings

A key challenge in neuroscience is understanding how sensory stimuli give rise to perception, especially when the process is supported by neural activity from an extended network of brain areas. Perception is inherently subjective, so interrogating its neural signatures requires, ideally, a combination of three factors: (1) behavioral tasks that separate stimulus-driven activity from perception per se; (2) human subjects who self-report their percepts while performing those tasks; and (3) concurrent neural recordings acquired at high spatial and temporal resolution. In this study, we analyzed human electrocorticographic recordings obtained during an auditory task which supported mutually exclusive perceptual interpretations. Eight neurosurgical patients (5 male; 3 female) listened to sequences of repeated triplets where tones were separated in frequency by several semitones. Subjects reported spontaneous alternations between two auditory perceptual states, 1-stream and 2-stream, by pressing a button. We compared averaged auditory evoked potentials (AEPs) associated with 1-stream and 2-stream percepts and identified significant differences between them in primary and nonprimary auditory cortex, surrounding auditory-related temporoparietal cortex, and frontal areas. We developed classifiers to identify spatial maps of percept-related differences in the AEP, corroborating findings from statistical analysis. We used one-dimensional embedding spaces to perform the group-level analysis. Our data illustrate exemplar high temporal resolution AEP waveforms in auditory core region; explain inconsistencies in perceptual effects within auditory cortex, reported across noninvasive studies of streaming of triplets; show percept-related changes in frontoparietal areas previously highlighted by studies that focused on perceptual transitions; and demonstrate that auditory cortex encodes maintenance of percepts and switches between them.

SIGNIFICANCE STATEMENT The human brain has the remarkable ability to discern complex and ambiguous stimuli from the external world by parsing mixed inputs into interpretable segments. However, one's perception can deviate from objective reality. But how do perceptual discrepancies occur? What are their anatomical substrates? To address these questions, we performed intracranial recordings in neurosurgical patients as they reported their perception of sounds associated with two mutually exclusive interpretations. We identified signatures of subjective percepts as distinct from sound-driven brain activity in core and non-core auditory cortex and frontoparietal cortex. These findings were compared with previous studies of auditory bistable perception and suggested that perceptual transitions and maintenance of perceptual states were supported by common neural substrates.

Slower and Less Variable Binocular Rivalry Rates in Patients With Bipolar Disorder, OCD, Major Depression, and Schizophrenia

When two different images are presented to the two eyes dichoptically, observers usually experience a perceptual alternation between the two images. This phenomenon, known as binocular rivalry, has been used as a powerful tool to investigate mechanisms of visual awareness. It was also found that the rates of perceptual alternation are slower in patients with bipolar disorder than in healthy controls (Pettigrew and Miller, 1998; Miller et al., 2003). To investigate the broader clinical relevance of binocular rivalry in psychiatric disorders, we measured the perceptual alternation rates during rivalry in healthy controls (n = 39) and in patients with different types of psychiatric disorders, including bipolar disorder type I (BD, n = 28), obsessive-compulsive disorder (OCD, n = 22), major depression (MD, n = 50), schizophrenia (SCZ, n = 44), and first-degree relatives (FDRs) of SCZ patients (n = 32). Participants viewed competing red-green images on a computer monitor through red-green anaglyph glasses and pressed buttons to record their perceptual alternations. The distributions of the rivalry rates were well described by a lognormal function in all groups. Critically, the median rate of perceptual alternation was 0.27 Hz for BD patients, 0.26 Hz for the OCD patients, 0.25 Hz for the MD patients, and 0.23 Hz and 0.27 Hz for the SCZ patients and their FDRs, respectively. All of which were significantly slower than the rate of 0.41 Hz obtained for the healthy controls, suggesting there may be shared genotypes between these different disorders. While rivalry alternations were generally slower in different types of psychiatric disorders compared to healthy controls, adding variance of rivalry rates in the analysis helped to partially separate among the different patient groups. Our results suggest that the slowing of binocular rivalry is likely due to certain common factors among the patient groups, but more subtle differences between different patient groups could be revealed when additional properties of rivalry dynamics are considered.

Transcutaneous Vagus Nerve Stimulation (tVNS) and the Dynamics of Visual Bistable Perception

Transcutaneous vagus nerve stimulation (tVNS) is widely used for clinical applications, but its mechanism of action is poorly understood. One candidate pathway that might mediate the effects of tVNS is an increase in GABAergic neurotransmission. In this study, we investigated the effect of tVNS on visual bistable perception, which is highly coupled to GABA. Participants were 34 healthy young subjects. We used a static (Necker cube) and a dynamic (structure from motion) bistable perception task. Each subject underwent tVNS as well as sham (placebo) stimulation for ∼45 min. We analyze effects of tVNS on percept durations by means of Bayesian multilevel regression. We find no evidence for a modulation of bistable perception dynamics through tVNS in either task, but the analyses do not ultimately confirm the null hypothesis either. We discuss different possible implications of our finding and propose that GABAergic effects of tVNS should be further investigated using more direct measures of GABA concentration, and, more generally, that a better understanding of the mechanisms of action of vagus nerve stimulation is needed. Finally, we discuss limitations of our study design, data analysis, and conclusions.

Frequency of alpha oscillation predicts individual differences in perceptual stability during binocular rivalry

When ambiguous visual stimuli have multiple interpretations, human perception can alternate between them, producing perceptual multistability. There is a large variation between individuals in how long stable percepts endure, on average, between switches, but the underlying neural basis of this individual difference in perceptual dynamics remains obscure. Here, we show that in one widely studied multistable paradigm-binocular rivalry-perceptual stability in individuals is predicted by the frequency of their neural oscillations within the alpha range (7-13 Hz). Our results suggest revising models of rivalry to incorporate effects of neural oscillations on perceptual alternations, and raise the possibility that a common factor may influence dynamics in many neural processes.

Neuronal correlates of auditory streaming in the auditory cortex of behaving monkeys

This study tested the hypothesis that spiking activity in the primary auditory cortex of monkeys is related to auditory stream formation. Evidence for this hypothesis was previously obtained in animals that were passively exposed to stimuli and in which differences in the streaming percept were confounded with differences between the stimuli. In this study, monkeys performed an operant task on sequences that were composed of light flashes and tones. The tones alternated between a high and a low frequency and could be perceived either as one auditory stream or two auditory streams. The flashes promoted either a one-stream percept or a two-stream percept. Comparison of different types of sequences revealed that the neuronal responses to the alternating tones were more similar when the flashes promoted auditory stream integration, and were more dissimilar when the flashes promoted auditory stream segregation. Thus our findings show that the spiking activity in the monkey primary auditory cortex is related to auditory stream formation.

A Generic Mechanism for Perceptual Organization in the Parietal Cortex

Our visual system's ability to group visual elements into meaningful entities and to separate them from others is referred to as scene segmentation. Visual motion often provides a powerful cue for this process as parallax or coherence can inform the visual system about scene or object structure. Here we tested the hypothesis that scene segmentation by motion cues relies on a common neural substrate in the parietal cortex. We used fMRI and a set of three entirely distinct motion stimuli to examine scene segmentation in the human brain. The stimuli covered a wide range of high-level processes, including perceptual grouping, transparent motion, and depth perception. All stimuli were perceptually bistable such that percepts alternated every few seconds while the physical stimulation remained constant. The perceptual states were asymmetric, in that one reflected the default (nonsegmented) interpretation, and the other the non-default (segmented) interpretation. We confirmed behaviorally that upon stimulus presentation, the default percept was always perceived first, before perceptual alternations ensued. Imaging results showed that across all stimulus classes perceptual scene-segmentation was associated with an increase of activity in the posterior parietal cortex together with a decrease of neural signal in the early visual cortex. This pattern of activation is compatible with predictive coding models of visual perception, and suggests that parietal cortex hosts a generic mechanism for scene segmentation.SIGNIFICANCE STATEMENT Making sense of cluttered visual scenes is crucial for everyday perception. An important cue to scene segmentation is visual motion: slight movements of scene elements give away which elements belong to the foreground or background or to the same object. We used three distinct stimuli that engage visual scene segmentation mechanisms based on motion. They involved perceptual grouping, transparent motion, and depth perception. Brain activity associated with all three mechanisms converged in the same parietal region with concurrent deactivation of early visual areas. The results suggest that posterior parietal cortex is a hub involved in structuring visual scenes based on different motion cues, and that feedback modulates early cortical processing in accord with predictive coding theory.

Long-Range Temporal Correlations in Alpha Oscillations Stabilize Perception of Ambiguous Visual Stimuli

Ongoing brain dynamics have been proposed as a type of “neuronal noise” that can trigger perceptual switches when viewing an ambiguous, bistable stimulus. However, no prior study has directly quantified how such neuronal noise relates to the rate of percept reversals. Specifically, it has remained unknown whether individual differences in complexity of resting-state oscillations—as reflected in long-range temporal correlations (LRTC)—are associated with perceptual stability. We hypothesized that participants with stronger resting-state LRTC in the alpha band experience more stable percepts, and thereby fewer perceptual switches. Furthermore, we expected that participants who report less discontinuous thoughts during rest, experience less switches. To test this, we recorded electroencephalography (EEG) in 65 healthy volunteers during 5 min Eyes-Closed Rest (ECR), after which they filled in the Amsterdam Resting-State Questionnaire (ARSQ). This was followed by three conditions where participants attended an ambiguous structure-from-motion stimulus—Neutral (passively observe the stimulus), Hold (the percept for as long as possible), and Switch (as often as possible). LRTC of resting-state alpha oscillations predicted the number of switches only in the Hold condition, with stronger LRTC associated with less switches. Contrary to our expectations, there was no association between resting-state Discontinuity of Mind and percept stability. Participants were capable of controlling switching according to task goals, and this was accompanied by increased alpha power during Hold and decreased power during Switch. Fewer switches were associated with stronger task-related alpha LRTC in all conditions. Together, our data suggest that bistable visual perception is to some extent under voluntary control and influenced by LRTC of alpha oscillations.

The Independent and Shared Mechanisms of Intrinsic Brain Dynamics: Insights From Bistable Perception

In bistable perception, constant input leads to alternating perception. The dynamics of the changing perception reflects the intrinsic dynamic properties of the “unconscious inferential” process in the brain. Under the same condition, individuals differ in how fast they experience the perceptual alternation. In this study, testing many forms of bistable perception in a large number of observers, we investigated the key question of whether there is a general and common mechanism or multiple and independent mechanisms that control the dynamics of the inferential brain. Bistable phenomena tested include binocular rivalry, vase-face, Necker cube, moving plaid, motion induced blindness, biological motion, spinning dancer, rotating cylinder, Lissajous-figure, rolling wheel, and translating diamond. Switching dynamics for each bistable percept was measured in 100 observers. Results show that the switching rates of subsets of bistable percept are highly correlated. The clustering of dynamic properties of some bistable phenomena but not an overall general control of switching dynamics implies that the brain’s inferential processes are both shared and independent – faster in constructing 3D structure from motion does not mean faster in integrating components into an objects.

Can Rotational Grouping Be Determined by the Initial Conditions?

Objects rotating in depth with an ambiguous rotation direction frequently appear to rotate together. Corotation is especially strong when the objects are interpretable as having a shared axis. We manipulated the initial conditions of the experiment by having pairs of objects initially appear to be unambiguous, and then make either a sudden or gradual transition to ambiguous spin. We find that in neither case do coaxial counter-rotating objects persist in being perceived as counter-rotating. This implies that the perceptual constraint that favors coaxial corotation overrides the initial perceptual state of the objects.

Spectral fingerprints of large-scale cortical dynamics during ambiguous motion perception

Ambiguous stimuli have been widely used to study the neuronal correlates of consciousness. Recently, it has been suggested that conscious perception might arise from the dynamic interplay of functionally specialized but widely distributed cortical areas. While previous research mainly focused on phase coupling as a correlate of cortical communication, more recent findings indicated that additional coupling modes might coexist and possibly subserve distinct cortical functions. Here, we studied two coupling modes, namely phase and envelope coupling, which might differ in their origins, putative functions and dynamics. Therefore, we recorded 128-channel EEG while participants performed a bistable motion task and utilized state-of-the-art source-space connectivity analysis techniques to study the functional relevance of different coupling modes for cortical communication. Our results indicate that gamma-band phase coupling in extrastriate visual cortex might mediate the integration of visual tokens into a moving stimulus during ambiguous visual stimulation. Furthermore, our results suggest that long-range fronto-occipital gamma-band envelope coupling sustains the horizontal percept during ambiguous motion perception. Additionally, our results support the idea that local parieto-occipital alpha-band phase coupling controls the inter-hemispheric information transfer. These findings provide correlative evidence for the notion that synchronized oscillatory brain activity reflects the processing of sensory input as well as the information integration across several spatiotemporal scales. The results indicate that distinct coupling modes are involved in different cortical computations and that the rich spatiotemporal correlation structure of the brain might constitute the functional architecture for cortical processing and specific multi-site communication. Hum Brain Mapp 37:4099-4111, 2016. © 2016 Wiley Periodicals, Inc.

Category Selectivity of Human Visual Cortex in Perception of Rubin Face-Vase Illusion

When viewing the Rubin face-vase illusion, our conscious perception spontaneously alternates between the face and the vase; this illusion has been widely used to explore bistable perception. Previous functional magnetic resonance imaging (fMRI) studies have studied the neural mechanisms underlying bistable perception through univariate and multivariate pattern analyses; however, no studies have investigated the issue of category selectivity. Here, we used fMRI to investigate the neural mechanisms underlying the Rubin face-vase illusion by introducing univariate amplitude and multivariate pattern analyses. The results from the amplitude analysis suggested that the activity in the fusiform face area was likely related to the subjective face perception. Furthermore, the pattern analysis results showed that the early visual cortex (EVC) and the face-selective cortex could discriminate the activity patterns of the face and vase perceptions. However, further analysis of the activity patterns showed that only the face-selective cortex contains the face information. These findings indicated that although the EVC and face-selective cortex activities could discriminate the visual information, only the activity and activity pattern in the face-selective areas contained the category information of face perception in the Rubin face-vase illusion.

Attention model of binocular rivalry

When the corresponding retinal locations in the two eyes are presented with incompatible images, a stable percept gives way to perceptual alternations in which the two images compete for perceptual dominance. As perceptual experience evolves dynamically under constant external inputs, binocular rivalry has been used for studying intrinsic cortical computations and for understanding how the brain regulates competing inputs. Converging behavioral and EEG results have shown that binocular rivalry and attention are intertwined: binocular rivalry ceases when attention is diverted away from the rivalry stimuli. In addition, the competing image in one eye suppresses the target in the other eye through a pattern of gain changes similar to those induced by attention. These results require a revision of the current computational theories of binocular rivalry, in which the role of attention is ignored. Here, we provide a computational model of binocular rivalry. In the model, competition between two images in rivalry is driven by both attentional modulation and mutual inhibition, which have distinct selectivity (feature vs. eye of origin) and dynamics (relatively slow vs. relatively fast). The proposed model explains a wide range of phenomena reported in rivalry, including the three hallmarks: (i) binocular rivalry requires attention; (ii) various perceptual states emerge when the two images are swapped between the eyes multiple times per second; (iii) the dominance duration as a function of input strength follows Levelt's propositions. With a bifurcation analysis, we identified the parameter space in which the model's behavior was consistent with experimental results.

Changing What You See by Changing What You Know: The Role of Attention

Attending is a cognitive process that incorporates a person's knowledge, goals, and expectations. What we perceive when we attend to one thing is different from what we perceive when we attend to something else. Yet, it is often argued that attentional effects do not count as evidence that perception is influenced by cognition. I investigate two arguments often given to justify excluding attention. The first is arguing that attention is a post-perceptual process reflecting selection between fully constructed perceptual representations. The second is arguing that attention as a pre-perceptual process that simply changes the input to encapsulated perceptual systems. Both of these arguments are highly problematic. Although some attentional effects can indeed be construed as post-perceptual, others operate by changing perceptual content across the entire visual hierarchy. Although there is a natural analogy between spatial attention and a change of input, the analogy falls apart when we consider other forms of attention. After dispelling these arguments, I make a case for thinking of attention not as a confound, but as one of the mechanisms by which cognitive states affect perception by going through cases in which the same or similar visual inputs are perceived differently depending on the observer's cognitive state, and instances where cuing an observer using language affects what one sees. Lastly, I provide two compelling counter-examples to the critique that although cognitive influences on perception can be demonstrated in the laboratory, it is impossible to really experience them for oneself in a phenomenologically compelling way. Taken together, the current evidence strongly supports the thesis that what we know routinely influences what we see, that the same sensory input can be perceived differently depending on the current cognitive state of the viewer, and that phenomenologically salient demonstrations are possible if certain conditions are met.

Binocular rivalry in children on the autism spectrum

When different images are presented to the eyes, the brain is faced with ambiguity, causing perceptual bistability: visual perception continuously alternates between the monocular images, a phenomenon called binocular rivalry. Many models of rivalry suggest that its temporal dynamics depend on mutual inhibition among neurons representing competing images. These models predict that rivalry should be different in autism, which has been proposed to present an atypical ratio of excitation and inhibition [the E/I imbalance hypothesis; Rubenstein & Merzenich, 2003]. In line with this prediction, some recent studies have provided evidence for atypical binocular rivalry dynamics in autistic adults. In this study, we examined if these findings generalize to autistic children. We developed a child‐friendly binocular rivalry paradigm, which included two types of stimuli, low‐ and high‐complexity, and compared rivalry dynamics in groups of autistic and age‐ and intellectual ability‐matched typical children. Unexpectedly, the two groups of children presented the same number of perceptual transitions and the same mean phase durations (times perceiving one of the two stimuli). Yet autistic children reported mixed percepts for a shorter proportion of time (a difference which was in the opposite direction to previous adult studies), while elevated autistic symptomatology was associated with shorter mixed perception periods. Rivalry in the two groups was affected similarly by stimulus type, and consistent with previous findings. Our results suggest that rivalry dynamics are differentially affected in adults and developing autistic children and could be accounted for by hierarchical models of binocular rivalry, including both inhibition and top‐down influences. Autism Res2017. ©2017 The Authors Autism Research published by Wiley Periodicals, Inc. on behalf of International Society for Autism Research Autism Res 2017, 10: 1096–1106. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.

Learning What to See in a Changing World

Visual perception is strongly shaped by expectations, but it is poorly understood how such perceptual expectations are learned in our dynamic sensory environment. Here, we applied a Bayesian framework to investigate whether perceptual expectations are continuously updated from different aspects of ongoing experience. In two experiments, human observers performed an associative learning task in which rapidly changing expectations about the appearance of ambiguous stimuli were induced. We found that perception of ambiguous stimuli was biased by both learned associations and previous perceptual outcomes. Computational modeling revealed that perception was best explained by a model that continuously updated priors from associative learning and perceptual history and combined these priors with the current sensory information in a probabilistic manner. Our findings suggest that the construction of visual perception is a highly dynamic process that incorporates rapidly changing expectations from different sources in a manner consistent with Bayesian learning and inference.

Quantum-like model of unconscious-conscious dynamics

We present a quantum-like model of sensation–perception dynamics (originated in Helmholtz theory of unconscious inference) based on the theory of quantum apparatuses and instruments. We illustrate our approach with the model of bistable perception of a particular ambiguous figure, the Schröder stair. This is a concrete model for unconscious and conscious processing of information and their interaction. The starting point of our quantum-like journey was the observation that perception dynamics is essentially contextual which implies impossibility of (straightforward) embedding of experimental statistical data in the classical (Kolmogorov, 1933) framework of probability theory. This motivates application of nonclassical probabilistic schemes. And the quantum formalism provides a variety of the well-approved and mathematically elegant probabilistic schemes to handle results of measurements. The theory of quantum apparatuses and instruments is the most general quantum scheme describing measurements and it is natural to explore it to model the sensation–perception dynamics. In particular, this theory provides the scheme of indirect quantum measurements which we apply to model unconscious inference leading to transition from sensations to perceptions.

Imagine that: elevated sensory strength of mental imagery in individuals with Parkinson's disease and visual hallucinations

Visual hallucinations occur when our conscious experience does not accurately reflect external reality. However, these dissociations also regularly occur when we imagine the world around us in the absence of visual stimulation. We used two novel behavioural paradigms to objectively measure visual hallucinations and voluntary mental imagery in 19 individuals with Parkinson's disease (ten with visual hallucinations; nine without) and ten healthy, age-matched controls. We then used this behavioural overlap to interrogate the connectivity both within and between the major attentional control networks using resting-state functional magnetic resonance imaging. Patients with visual hallucinations had elevated mental imagery strength compared with patients without hallucinations and controls. Specifically, the sensory strength of imagery predicted the frequency of visual hallucinations. Together, hallucinations and mental imagery predicted multiple abnormalities in functional connectivity both within and between the attentional control networks, as measured with resting-state functional magnetic resonance imaging. However, the two phenomena were also dissociable at the neural level, with both mental imagery and visual misperceptions associated with specific abnormalities in attentional network connectivity. Our results provide the first evidence of both the shared and unique neural correlates of these two similar, yet distinct phenomena.

An alternating renewal process describes the buildup of perceptual segregation

For some ambiguous scenes perceptual conflict arises between integration and segregation. Initially, all stimulus features seem integrated. Then abruptly, perhaps after a few seconds, a segregated percept emerges. For example, segregation of acoustic features into streams may require several seconds. In behavioral experiments, when a subject's reports of stream segregation are averaged over repeated trials, one obtains a buildup function, a smooth time course for segregation probability. The buildup function has been said to reflect an underlying mechanism of evidence accumulation or adaptation. During long duration stimuli perception may alternate between integration and segregation. We present a statistical model based on an alternating renewal process (ARP) that generates buildup functions without an accumulative process. In our model, perception alternates during a trial between different groupings, as in perceptual bistability, with random and independent dominance durations sampled from different percept-specific probability distributions. Using this theory, we describe the short-term dynamics of buildup observed on short trials in terms of the long-term statistics of percept durations for the two alternating perceptual organizations. Our statistical-dynamics model describes well the buildup functions and alternations in simulations of pseudo-mechanistic neuronal network models with percept-selective populations competing through mutual inhibition. Even though the competition model can show history dependence through slow adaptation, our statistical switching model, that neglects history, predicts well the buildup function. We propose that accumulation is not a necessary feature to produce buildup. Generally, if alternations between two states exhibit independent durations with stationary statistics then the associated buildup function can be described by the statistical dynamics of an ARP.

Top-down modulation in human visual cortex predicts the stability of a perceptual illusion

Conscious perception sometimes fluctuates strongly, even when the sensory input is constant. For example, in motion-induced blindness (MIB), a salient visual target surrounded by a moving pattern suddenly disappears from perception, only to reappear after some variable time. Whereas such changes of perception result from fluctuations of neural activity, mounting evidence suggests that the perceptual changes, in turn, may also cause modulations of activity in several brain areas, including visual cortex. In this study, we asked whether these latter modulations might affect the subsequent dynamics of perception. We used magnetoencephalography (MEG) to measure modulations in cortical population activity during MIB. We observed a transient, retinotopically widespread modulation of beta (12-30 Hz)-frequency power over visual cortex that was closely linked to the time of subjects' behavioral report of the target disappearance. This beta modulation was a top-down signal, decoupled from both the physical stimulus properties and the motor response but contingent on the behavioral relevance of the perceptual change. Critically, the modulation amplitude predicted the duration of the subsequent target disappearance. We propose that the transformation of the perceptual change into a report triggers a top-down mechanism that stabilizes the newly selected perceptual interpretation.

Auditory event-related potentials associated with perceptual reversals of bistable pitch motion

Previous event-related potential (ERP) experiments have consistently identified two components associated with perceptual transitions of bistable visual stimuli, the "reversal negativity" (RN) and the "late positive complex" (LPC). The RN (~200 ms post-stimulus, bilateral occipital-parietal distribution) is thought to reflect transitions between neural representations that form the moment-to-moment contents of conscious perception, while the LPC (~400 ms, central-parietal) is considered an index of post-perceptual processing related to accessing and reporting one's percept. To explore the generality of these components across sensory modalities, the present experiment utilized a novel bistable auditory stimulus. Pairs of complex tones with ambiguous pitch relationships were presented sequentially while subjects reported whether they perceived the tone pairs as ascending or descending in pitch. ERPs elicited by the tones were compared according to whether perceived pitch motion changed direction or remained the same across successive trials. An auditory reversal negativity (aRN) component was evident at ~170 ms post-stimulus over bilateral fronto-central scalp locations. An auditory LPC component (aLPC) was evident at subsequent latencies (~350 ms, fronto-central distribution). These two components may be auditory analogs of the visual RN and LPC, suggesting functionally equivalent but anatomically distinct processes in auditory vs. visual bistable perception.

Probing the time course of head-motion cues integration during auditory scene analysis

The perceptual organization of auditory scenes is a hard but important problem to solve for human listeners. It is thus likely that cues from several modalities are pooled for auditory scene analysis, including sensory-motor cues related to the active exploration of the scene. We previously reported a strong effect of head motion on auditory streaming. Streaming refers to an experimental paradigm where listeners hear sequences of pure tones, and rate their perception of one or more subjective sources called streams. To disentangle the effects of head motion (changes in acoustic cues at the ear, subjective location cues, and motor cues), we used a robotic telepresence system, Telehead. We found that head motion induced perceptual reorganization even when the acoustic scene had not changed. Here we reanalyzed the same data to probe the time course of sensory-motor integration. We show that motor cues had a different time course compared to acoustic or subjective location cues: motor cues impacted perceptual organization earlier and for a shorter time than other cues, with successive positive and negative contributions to streaming. An additional experiment controlled for the effects of volitional anticipatory components, and found that arm or leg movements did not have any impact on scene analysis. These data provide a first investigation of the time course of the complex integration of sensory-motor cues in an auditory scene analysis task, and they suggest a loose temporal coupling between the different mechanisms involved.

Online tracking of the contents of conscious perception using real-time fMRI

Perception is an active process that interprets and structures the stimulus input based on assumptions about its possible causes. We use real-time functional magnetic resonance imaging (rtfMRI) to investigate a particularly powerful demonstration of dynamic object integration in which the same physical stimulus intermittently elicits categorically different conscious object percepts. In this study, we simulated an outline object that is moving behind a narrow slit. With such displays, the physically identical stimulus can elicit categorically different percepts that either correspond closely to the physical stimulus (vertically moving line segments) or represent a hypothesis about the underlying cause of the physical stimulus (a horizontally moving object that is partly occluded). In the latter case, the brain must construct an object from the input sequence. Combining rtfMRI with machine learning techniques we show that it is possible to determine online the momentary state of a subject's conscious percept from time resolved BOLD-activity. In addition, we found that feedback about the currently decoded percept increased the decoding rates compared to prior fMRI recordings of the same stimulus without feedback presentation. The analysis of the trained classifier revealed a brain network that discriminates contents of conscious perception with antagonistic interactions between early sensory areas that represent physical stimulus properties and higher-tier brain areas. During integrated object percepts, brain activity decreases in early sensory areas and increases in higher-tier areas. We conclude that it is possible to use BOLD responses to reliably track the contents of conscious visual perception with a relatively high temporal resolution. We suggest that our approach can also be used to investigate the neural basis of auditory object formation and discuss the results in the context of predictive coding theory.

Do audio-visual motion cues promote segregation of auditory streams?

An audio-visual experiment using moving sound sources was designed to investigate whether the analysis of auditory scenes is modulated by synchronous presentation of visual information. Listeners were presented with an alternating sequence of two pure tones delivered by two separate sound sources. In different conditions, the two sound sources were either stationary or moving on random trajectories around the listener. Both the sounds and the movement trajectories were derived from recordings in which two humans were moving with loudspeakers attached to their heads. Visualized movement trajectories modeled by a computer animation were presented together with the sounds. In the main experiment, behavioral reports on sound organization were collected from young healthy volunteers. The proportion and stability of the different sound organizations were compared between the conditions in which the visualized trajectories matched the movement of the sound sources and when the two were independent of each other. The results corroborate earlier findings that separation of sound sources in space promotes segregation. However, no additional effect of auditory movement per se on the perceptual organization of sounds was obtained. Surprisingly, the presentation of movement-congruent visual cues did not strengthen the effects of spatial separation on segregating auditory streams. Our findings are consistent with the view that bistability in the auditory modality can occur independently from other modalities.

Predictability effects in auditory scene analysis: a review

Many sound sources emit signals in a predictable manner. The idea that predictability can be exploited to support the segregation of one source's signal emissions from the overlapping signals of other sources has been expressed for a long time. Yet experimental evidence for a strong role of predictability within auditory scene analysis (ASA) has been scarce. Recently, there has been an upsurge in experimental and theoretical work on this topic resulting from fundamental changes in our perspective on how the brain extracts predictability from series of sensory events. Based on effortless predictive processing in the auditory system, it becomes more plausible that predictability would be available as a cue for sound source decomposition. In the present contribution, empirical evidence for such a role of predictability in ASA will be reviewed. It will be shown that predictability affects ASA both when it is present in the sound source of interest (perceptual foreground) and when it is present in other sound sources that the listener wishes to ignore (perceptual background). First evidence pointing toward age-related impairments in the latter capacity will be addressed. Moreover, it will be illustrated how effects of predictability can be shown by means of objective listening tests as well as by subjective report procedures, with the latter approach typically exploiting the multi-stable nature of auditory perception. Critical aspects of study design will be delineated to ensure that predictability effects can be unambiguously interpreted. Possible mechanisms for a functional role of predictability within ASA will be discussed, and an analogy with the old-plus-new heuristic for grouping simultaneous acoustic signals will be suggested.

Neural substrates of perceptual integration during bistable object perception

The way we perceive an object depends both on feedforward, bottom-up processing of its physical stimulus properties and on top-down factors such as attention, context, expectation, and task relevance. Here we compared neural activity elicited by varying perceptions of the same physical image--a bistable moving image in which perception spontaneously alternates between dissociated fragments and a single, unified object. A time-frequency analysis of EEG changes associated with the perceptual switch from object to fragment and vice versa revealed a greater decrease in alpha (8-12 Hz) accompanying the switch to object percept than to fragment percept. Recordings of event-related potentials elicited by irrelevant probes superimposed on the moving image revealed an enhanced positivity between 184 and 212 ms when the probes were contained within the boundaries of the perceived unitary object. The topography of the positivity (P2) in this latency range elicited by probes during object perception was distinct from the topography elicited by probes during fragment perception, suggesting that the neural processing of probes differed as a function of perceptual state. Two source localization algorithms estimated the neural generator of this object-related difference to lie in the lateral occipital cortex, a region long associated with object perception. These data suggest that perceived objects attract attention, incorporate visual elements occurring within their boundaries into unified object representations, and enhance the visual processing of elements occurring within their boundaries. Importantly, the perceived object in this case emerged as a function of the fluctuating perceptual state of the viewer.