Ultrahigh Field fMRI Reveals Different Roles of the Temporal and Frontoparietal Cortices in Subjective Awareness

A central question in consciousness theories is whether one is dealing with a dichotomous ("all-or-none") or a gradual phenomenon. In this 7T fMRI study, we investigated whether dichotomy or gradualness in fact depends on the brain region associated with perceptual awareness reports. Both male and female human subjects performed an emotion discrimination task (fear vs neutral bodies) presented under continuous flash suppression with trial-based perceptual awareness measures. Behaviorally, recognition sensitivity increased linearly with increased stimuli awareness and was at chance level during perceptual unawareness. Physiologically, threat stimuli triggered a slower heart rate than neutral ones during "almost clear" stimulus experience, indicating freezing behavior. Brain results showed that activity in the occipitotemporal, parietal, and frontal regions as well as in the amygdala increased with increased stimulus awareness while early visual areas showed the opposite pattern. The relationship between temporal area activity and perceptual awareness best fitted a gradual model while the activity in frontoparietal areas fitted a dichotomous model. Furthermore, our findings illustrate that specific experimental decisions, such as stimulus type or the approach used to evaluate awareness, play pivotal roles in consciousness studies and warrant careful consideration.

Mental flexibility assessment: A research protocol for patients with Parkinson's Disease and Anorexia Nervosa

Mental Flexibility oscillates between adaptive variability in behavior and the capacity to restore homeostasis, linked to mental health. It has recently been one of the most investigated abilities in mental and neurological diseases such as Anorexia nervosa and Parkinson's disease, studied for rigidity or cognitive inflexibility. Patients with anorexia nervosa have rigid cognitive processes about food and weight, which leads to restrictive eating and excessive exercise. People who struggle to adapt their cognitive processes and actions to change their diet and exercise habits may have a harder time recovering from the disorder. On the other hand, research suggests that Parkinson's disease patients may have cognitive flexibility impairments that impair their ability to perform daily tasks and adapt to new environments. Although of clinical interest, mental flexibility lacks theoretical liberalization and unified assessment. This study introduces "IntellEGO" a protocol for a new, multidimensional psychometric assessment of flexibility. This assessment evaluates a person's authentic ability to handle daily challenges using cognitive, emotional, and behavioral factors. Since traditional assessments often focus on one domain, we aim to examine flexibility from multiple angles, acknowledging the importance of viewing people as whole beings with mental and physical aspects. The study protocol includes two assessment phases separated by a rehabilitation period. T0, the acute phase upon admission, and T1, the post-rehabilitation phase lasting 15 days for Parkinson's patients and 4 weeks for eating disorder patients, will be assessed. Neuropsychological performance, self-report questionnaires, psychophysiological measures, and neuroendocrine measures will be collected from Anorexia Nervosa and Parkinson's Disease patients during each study phase. The objective of this procedure is to provide clinicians with a comprehensive framework for conducting meticulous assessments of mental flexibility. This framework considers emotional, cognitive, and behavioral factors, and is applicable to various patient populations.

Prefrontal GABA and glutamate-glutamine levels affect sustained attention

Attention levels fluctuate during the course of daily activities. However, factors underlying sustained attention are still unknown. We investigated mechanisms of sustained attention using psychological, neuroimaging, and neurochemical approaches. Participants were scanned with functional magnetic resonance imaging (fMRI) while performing gradual-onset, continuous performance tasks (gradCPTs). In gradCPTs, narrations or visual scenes gradually changed from one to the next. Participants pressed a button for frequent Go trials as quickly as possible and withheld responses to infrequent No-go trials. Performance was better for the visual gradCPT than for the auditory gradCPT, but the 2 were correlated. The dorsal attention network was activated during intermittent responses, regardless of sensory modality. Reaction-time variability of gradCPTs was correlated with signal changes (SCs) in the left fronto-parietal regions. We also used magnetic resonance spectroscopy (MRS) to measure levels of glutamate-glutamine (Glx) and γ-aminobutyric acid (GABA) in the left prefrontal cortex (PFC). Glx levels were associated with performance under undemanding situations, whereas GABA levels were related to performance under demanding situations. Combined fMRI-MRS results demonstrated that SCs of the left PFC were positively correlated with neurometabolite levels. These findings suggest that a neural balance between excitation and inhibition is involved in attentional fluctuations and brain dynamics.

Subjective control of polystable illusory apparent motion: Is control possible when the stimulus affords countless motion possibilities?

We investigate whether a new polystable illusion, illusory apparent motion (IAM), is susceptible to subjective perceptual control as has been shown in other polystable stimuli (e.g., the Necker cube, apparent motion quartets). Previous research has demonstrated that, although IAM shares some properties in common with other polystable stimuli, it also has some unique ones that make it unclear whether it should have similar susceptibility to subjective control. For example, IAM can be perceived in a countless number of directions and motion patterns (e.g., up–down, left–left, contracting–expanding, shear, diagonal). To explore perceptual control of IAM, in experiment 1 (n = 99) we used a motion persistence paradigm where participants are primed with different motion patterns and are instructed to control (change or hold) the initial motion pattern and indicate when the motion pattern changes. Building on experiment 1, experiment 2 (n = 76) brings the method more in line with previous subjective control research, testing whether participants can control their perception of IAM in a context without priming and while dynamically reporting their percepts throughout the trial. Findings from the two experiments demonstrate that participants were able to control their perception of IAM across paradigms. We explore the implications of these findings, strategies reported, and open questions for future research.

The Independent and Shared Mechanisms of Intrinsic Brain Dynamics: Insights From Bistable Perception

In bistable perception, constant input leads to alternating perception. The dynamics of the changing perception reflects the intrinsic dynamic properties of the “unconscious inferential” process in the brain. Under the same condition, individuals differ in how fast they experience the perceptual alternation. In this study, testing many forms of bistable perception in a large number of observers, we investigated the key question of whether there is a general and common mechanism or multiple and independent mechanisms that control the dynamics of the inferential brain. Bistable phenomena tested include binocular rivalry, vase-face, Necker cube, moving plaid, motion induced blindness, biological motion, spinning dancer, rotating cylinder, Lissajous-figure, rolling wheel, and translating diamond. Switching dynamics for each bistable percept was measured in 100 observers. Results show that the switching rates of subsets of bistable percept are highly correlated. The clustering of dynamic properties of some bistable phenomena but not an overall general control of switching dynamics implies that the brain’s inferential processes are both shared and independent – faster in constructing 3D structure from motion does not mean faster in integrating components into an objects.

Category Selectivity of Human Visual Cortex in Perception of Rubin Face-Vase Illusion

When viewing the Rubin face-vase illusion, our conscious perception spontaneously alternates between the face and the vase; this illusion has been widely used to explore bistable perception. Previous functional magnetic resonance imaging (fMRI) studies have studied the neural mechanisms underlying bistable perception through univariate and multivariate pattern analyses; however, no studies have investigated the issue of category selectivity. Here, we used fMRI to investigate the neural mechanisms underlying the Rubin face-vase illusion by introducing univariate amplitude and multivariate pattern analyses. The results from the amplitude analysis suggested that the activity in the fusiform face area was likely related to the subjective face perception. Furthermore, the pattern analysis results showed that the early visual cortex (EVC) and the face-selective cortex could discriminate the activity patterns of the face and vase perceptions. However, further analysis of the activity patterns showed that only the face-selective cortex contains the face information. These findings indicated that although the EVC and face-selective cortex activities could discriminate the visual information, only the activity and activity pattern in the face-selective areas contained the category information of face perception in the Rubin face-vase illusion.

Pre-coincidence brain activity predicts the perceptual outcome of streaming/bouncing motion display

When two identical visual discs move toward each other on a two-dimensional visual display, they can be perceived as either "streaming through" or "bouncing off" each other after their coincidence. Previous studies have observed a strong bias toward the streaming percept. Additionally, the incidence of the bouncing percept in this ambiguous display could be increased by various factors, such as a brief sound at the moment of coincidence and a momentary pause of the two discs. The streaming/bouncing bistable motion phenomenon has been studied intensively since its discovery. However, little is known regarding the neural basis underling the perceptual ambiguity in the classic version of the streaming/bouncing motion display. The present study investigated the neural basis of the perception disambiguating underling the processing of the streaming/bouncing bistable motion display using event-related potential (ERP) recordings. Surprisingly, the amplitude of frontal central P2 (220-260 ms) that was elicited by the moving discs ~200 ms before the coincidence of the two discs was observed to be predictive of subsequent streaming or bouncing percept. A larger P2 amplitude was observed for streaming percept than the bouncing percept. These findings suggest that the streaming/bouncing bistable perception may have been disambiguated unconsciously ~200 ms before the coincidence of the two discs.

A point process modeling approach for investigating the effect of online brain activity on perceptual switching

When watching an ambiguous figure that allows for multiple interpretations, our interpretation spontaneously switches between the possible options. Such spontaneous switching is called perceptual switching and it is modulated by top-down selective attention. In this study, we propose a point process modeling approach for investigating the effects of online brain activity on perceptual switching, where we define online activity as continuous brain activity including spontaneous background and induced activities. Specifically, we modeled perceptual switching during Necker cube perception using electroencephalography (EEG) data. Our method is based on the framework of point process model, which is a statistical model of a series of events. We regard perceptual switching phenomenon as a stochastic process and construct its model in a data-driven manner. We develop a model called the online activity regression model, which enables to determine whether online brain activity has excitatory or inhibitory effects on perceptual switching. By fitting online activity regression models to experimental data and applying the likelihood ratio testing with correction for multiple comparisons, we explore the brain regions and frequency bands with significant effects on perceptual switching. The results demonstrate that the modulation of online occipital alpha activity mediates the suppression of perceptual switching to the non-attended interpretation. Thus, our method provides a dynamic description of the attentional process by naturally accounting for the entire time course of brain activity, which is difficult to resolve by focusing only on the brain activity around the time of perceptual switching.

Auditory multistability and neurotransmitter concentrations in the human brain

Multistability in perception is a powerful tool for investigating sensory-perceptual transformations, because it produces dissociations between sensory inputs and subjective experience. Spontaneous switching between different perceptual objects occurs during prolonged listening to a sound sequence of tone triplets or repeated words (termed auditory streaming and verbal transformations, respectively). We used these examples of auditory multistability to examine to what extent neurochemical and cognitive factors influence the observed idiosyncratic patterns of switching between perceptual objects. The concentrations of glutamate-glutamine (Glx) and γ-aminobutyric acid (GABA) in brain regions were measured by magnetic resonance spectroscopy, while personality traits and executive functions were assessed using questionnaires and response inhibition tasks. Idiosyncratic patterns of perceptual switching in the two multistable stimulus configurations were identified using a multidimensional scaling (MDS) analysis. Intriguingly, although switching patterns within each individual differed between auditory streaming and verbal transformations, similar MDS dimensions were extracted separately from the two datasets. Individual switching patterns were significantly correlated with Glx and GABA concentrations in auditory cortex and inferior frontal cortex but not with the personality traits and executive functions. Our results suggest that auditory perceptual organization depends on the balance between neural excitation and inhibition in different brain regions.This article is part of the themed issue 'Auditory and visual scene analysis'.

Lesions to right posterior parietal cortex impair visual depth perception from disparity but not motion cues

The posterior parietal cortex (PPC) is understood to be active when observers perceive three-dimensional (3D) structure. However, it is not clear how central this activity is in the construction of 3D spatial representations. Here, we examine whether PPC is essential for two aspects of visual depth perception by testing patients with lesions affecting this region. First, we measured subjects' ability to discriminate depth structure in various 3D surfaces and objects using binocular disparity. Patients with lesions to right PPC (N = 3) exhibited marked perceptual deficits on these tasks, whereas those with left hemisphere lesions (N = 2) were able to reliably discriminate depth as accurately as control subjects. Second, we presented an ambiguous 3D stimulus defined by structure from motion to determine whether PPC lesions influence the rate of bistable perceptual alternations. Patients' percept durations for the 3D stimulus were generally within a normal range, although the two patients with bilateral PPC lesions showed the fastest perceptual alternation rates in our sample. Intermittent stimulus presentation reduced the reversal rate similarly across subjects. Together, the results suggest that PPC plays a causal role in both inferring and maintaining the perception of 3D structure with stereopsis supported primarily by the right hemisphere, but do not lend support to the view that PPC is a critical contributor to bistable perceptual alternations.This article is part of the themed issue 'Vision in our three-dimensional world'.

Auditory Multi-Stability: Idiosyncratic Perceptual Switching Patterns, Executive Functions and Personality Traits

Multi-stability refers to the phenomenon of perception stochastically switching between possible interpretations of an unchanging stimulus. Despite considerable variability, individuals show stable idiosyncratic patterns of switching between alternative perceptions in the auditory streaming paradigm. We explored correlates of the individual switching patterns with executive functions, personality traits, and creativity. The main dimensions on which individual switching patterns differed from each other were identified using multidimensional scaling. Individuals with high scores on the dimension explaining the largest portion of the inter-individual variance switched more often between the alternative perceptions than those with low scores. They also perceived the most unusual interpretation more often, and experienced all perceptual alternatives with a shorter delay from stimulus onset. The ego-resiliency personality trait, which reflects a tendency for adaptive flexibility and experience seeking, was significantly positively related to this dimension. Taking these results together we suggest that this dimension may reflect the individual's tendency for exploring the auditory environment. Executive functions were significantly related to some of the variables describing global properties of the switching patterns, such as the average number of switches. Thus individual patterns of perceptual switching in the auditory streaming paradigm are related to some personality traits and executive functions.

Bistable perception in normal aging: perceptual reversibility and its relation to cognition

The effects of age on the ability to resolve perceptual ambiguity are unknown, though it depends on frontoparietal attentional networks known to change with age. We presented the bistable Necker cube to 24 middle-aged and OAs (older adults; 56-78 years) and 20 YAs (younger adults; 18-24 years) under passive-viewing and volitional control conditions: Hold one cube percept and Switch between cube percepts. During passive viewing, OAs had longer dominance durations (time spent on each percept) than YAs. In the Hold condition, OAs were less able than YAs to increase dominance durations. In the Switch condition, OAs and YAs did not differ in performance. Dominance durations in either condition correlated with performance on tests of executive function mediated by the frontal lobes. Eye movements (fixation deviations) did not differ between groups. These results suggest that OAs' reduced ability to hold a percept may arise from reduced selective attention. The lack of correlation of performance between Hold and executive-function measures suggests at least a partial segregation of underlying mechanisms.

Perceptual, cognitive, and personality rigidity in Parkinson's disease

Parkinson's disease (PD) is associated with motor and non-motor rigidity symptoms (e.g., cognitive and personality). The question is raised as to whether rigidity in PD also extends to perception, and if so, whether perceptual, cognitive, and personality rigidities are correlated. Bistable stimuli were presented to 28 non-demented individuals with PD and 26 normal control adults (NC). Necker cube perception and binocular rivalry were examined during passive viewing, and the Necker cube was additionally used for two volitional-control conditions: Hold one percept in front, and Switch between the two percepts. Relative to passive viewing, PD were significantly less able than NC to reduce dominance durations in the Switch condition, indicating perceptual rigidity. Tests of cognitive flexibility and a personality questionnaire were administered to explore the association with perceptual rigidity. Cognitive flexibility was not correlated with perceptual rigidity for either group. Personality (novelty seeking) correlated with dominance durations on Necker passive viewing for PD but not NC. The results indicate the presence in mild-moderate PD of perceptual rigidity and suggest shared neural substrates with novelty seeking, but functional divergence from those supporting cognitive flexibility. The possibility is raised that perceptual rigidity may be a harbinger of cognitive inflexibility later in the disease course.

Multistable perception in children: Prefrontal delta oscillations in the developing brain

The prefrontal cortex (PFC) is considered to be the primary source of attentional control during elementary visual processing as exemplified in perceptual ambiguity. Assuming that multistable perception activates a fronto-parietal network, we contrast the results of mature and developing cognitive systems to deduce the developmental status of underlying structures from behavioral performances and functional EEG parameters. We analyzed the topographical distribution, amplitude characteristics and inter-trial variability of a reversal-related delta response that accompanies perceptual switches between the two alternative percepts of an ambiguous motion pattern. Fourteen ten-year old children and an adult control group indicated changes of perceived motion directions by a button-press. EEG was recorded from frontal, central, parietal, and occipital locations of both hemispheres. Behavioral data shows a considerably lower reversal rate within the children sample, suggesting that the related mechanisms are not yet operating on an adult level. In contrast to findings in adults, the involved delta component emerges as part of an unspecific posterior activation, suggesting that a cortical specialization process has not been accomplished yet. On frontal locations the ten-year old children fail to yield a stable component. The synchronized fronto-parietal activity in adults may constitute the result of a specialization process that determined connection patterns and functionally tuned the involved areas. This implies a deficit in timing and temporal sequencing of neuronal activity in children, mainly attributable to a less functional differentiated PFC that has not been fully integrated yet into the cognitive ensemble.

Synchronous and opposite roles of the parietal and prefrontal cortices in bistable perception: a double-coil TMS-EEG study

Bistable perception occurs when a stimulus is ambiguous and has two distinct interpretations that spontaneously alternate in observers' consciousness. Studies using functional magnetic resonance imaging, electroencephalography (EEG), and transcranial magnetic stimulation (TMS) in healthy subjects and patient studies point towards a right fronto-parietal network regulating the balance between percept stabilization and the arising of alternative interpretations. However, the causal role of the interaction between parietal and prefrontal areas is not clearly understood. Using intermittent presentations of bistable images, we confirmed that maintaining or switching percepts had neural correlates identifiable on EEG. Single-pulse TMS applied over the right anterior intraparietal sulcus (IPS) 70 msec before image presentation interfered with evoked potentials and destabilized the percept. However, with paired-pulse TMS applied over right IPS and dorsolateral prefrontal cortex (DLPFC) 70 and 60 msec before image presentation, both perceptual and neurophysiological effects were canceled. Thus, TMS over IPS and DLPFC interacted with each other and influenced upcoming percepts. We suggest that when the visual world is ambiguous, IPS plays a stabilizing role, whereas DLPFC is important for triggering perceptual switches or for modulating parietal activity. The balance between maintaining and switching visual conscious percepts relies on the dynamic interaction between IPS and DLPFC.

Energy landscape and dynamics of brain activity during human bistable perception

Individual differences in the structure of parietal and prefrontal cortex predict the stability of bistable visual perception. However, the mechanisms linking such individual differences in brain structures to behaviour remain elusive. Here we demonstrate a systematic relationship between the dynamics of brain activity, cortical structure and behaviour underpinning bistable perception. Using fMRI in humans, we find that the activity dynamics during bistable perception are well described as fluctuating between three spatially distributed energy minimums: visual-area-dominant, frontal-area-dominant and intermediate states. Transitions between these energy minimums predicted behaviour, with participants whose brain activity tend to reflect the visual-area-dominant state exhibiting more stable perception and those whose activity transits to frontal-area-dominant states reporting more frequent perceptual switches. Critically, these brain activity dynamics are correlated with individual differences in grey matter volume of the corresponding brain areas. Thus, individual differences in the large-scale dynamics of brain activity link focal brain structure with bistable perception.

Subjective visual perception: from local processing to emergent phenomena of brain activity

The combination of electrophysiological recordings with ambiguous visual stimulation made possible the detection of neurons that represent the content of subjective visual perception and perceptual suppression in multiple cortical and subcortical brain regions. These neuronal populations, commonly referred to as the neural correlates of consciousness, are more likely to be found in the temporal and prefrontal cortices as well as the pulvinar, indicating that the content of perceptual awareness is represented with higher fidelity in higher-order association areas of the cortical and thalamic hierarchy, reflecting the outcome of competitive interactions between conflicting sensory information resolved in earlier stages. However, despite the significant insights into conscious perception gained through monitoring the activities of single neurons and small, local populations, the immense functional complexity of the brain arising from correlations in the activity of its constituent parts suggests that local, microscopic activity could only partially reveal the mechanisms involved in perceptual awareness. Rather, the dynamics of functional connectivity patterns on a mesoscopic and macroscopic level could be critical for conscious perception. Understanding these emergent spatio-temporal patterns could be informative not only for the stability of subjective perception but also for spontaneous perceptual transitions suggested to depend either on the dynamics of antagonistic ensembles or on global intrinsic activity fluctuations that may act upon explicit neural representations of sensory stimuli and induce perceptual reorganization. Here, we review the most recent results from local activity recordings and discuss the potential role of effective, correlated interactions during perceptual awareness.

Event-related potential responses to perceptual reversals are modulated by working memory load

While viewing ambiguous figures, such as the Necker cube, the available perceptual interpretations alternate with one another. The role of higher level mechanisms in such reversals remains unclear. We tested whether perceptual reversals of discontinuously presented Necker cube pairs depend on working memory resources by manipulating cognitive load while recording event-related potentials (ERPs). The ERPs showed early enhancements of negativity, which were obtained in response to the first cube approximately 500 ms before perceived reversals. We found that working memory load influenced reversal-related brain responses in response to the second cube over occipital areas at the 150-300 ms post-stimulus and over central areas at P3 time window (300-500 ms), suggesting that it modulates intermediate visual processes. Interestingly, reversal rates remained unchanged by the working memory load. We propose that perceptual reversals in discontinuous presentation of ambiguous stimuli are governed by an early (well preceding pending reversals) mechanism, while the effects of load on the reversal related ERPs may reflect general top-down influences on visual processing, possibly mediated by the prefrontal cortex.

Dichoptic Viewing Methods for Binocular Rivalry Research: Prospects for Large-Scale Clinical and Genetic Studies

Binocular rivalry (BR) is an intriguing phenomenon that occurs when two different images are presented, one to each eye, resulting in alternation orrivalrybetween the percepts. The phenomenon has been studied for nearly 200 years, with renewed and intensive investigation over recent decades. Therateof perceptual switching has long been known to vary widely between individuals but to be relatively stable within individuals. A recent twin study demonstrated that individual variation in BR rate is under substantial genetic control, a finding that also represented the first report, using a large study, of genetic contribution for any post-retinal visual processing phenomenon. The twin study had been prompted by earlier work showing BR rate was slow in the heritable psychiatric condition, bipolar disorder (BD). Together, these studies suggested that slow BR may represent an endophenotype for BD, and heralded the advent of modern clinical and genetic studies of rivalry. This new focus has coincided with rapid advances in 3D display technology, but despite such progress, specific development of technology for rivalry research has been lacking. This review therefore compares different display methods for BR research across several factors, including viewing parameters, image quality, equipment cost, compatibility with other investigative methods, subject group, and sample size, with a focus on requirements specific to large-scale clinical and genetic studies. It is intended to be a resource for investigators new to BR research, such as clinicians and geneticists, and to stimulate the development of 3D display technology for advancing interdisciplinary studies of rivalry.

Opposing roles of sensory and parietal cortices in awareness in a bistable motion illusion

Motion-induced blindness (MIB) is a bistable visual phenomenon in which stationary disks surrounded by a moving pattern intermittently disappear from the viewer's awareness. We explored the cortical network that subserves the MIB phenomenon by targeting its constituent parts with disruptive transcranial magnetic stimulation (TMS), in the form of continuous theta burst stimulation (cTBS). Previous neuroimaging and TMS studies have implicated the right posterior parietal cortex (rPPC) in perceptual transitions such as binocular rivalry, while the visual area V5/MT has been suggested to play a key role in MIB. In this study, we found that cTBS applied to the rPPC lengthened the duration of disappearance in MIB, while cTBS applied to V5/MT shortened the duration of disappearance and decreased the frequency of disappearance in MIB. These results demonstrate a causal role for both the rPPC and V5/MT in MIB, and suggest that the rPPC is involved in shifting resources between competing functional areas, while V5/MT processing initiates and maintains MIB.

Brain mechanisms for simple perception and bistable perception

When faced with ambiguous sensory inputs, subjective perception alternates between the different interpretations in a stochastic manner. Such multistable perception phenomena have intrigued scientists and laymen alike for over a century. Despite rigorous investigations, the underlying mechanisms of multistable perception remain elusive. Recent studies using multivariate pattern analysis revealed that activity patterns in posterior visual areas correlate with fluctuating percepts. However, increasing evidence suggests that vision--and perception at large--is an active inferential process involving hierarchical brain systems. We applied searchlight multivariate pattern analysis to functional magnetic resonance imaging signals across the human brain to decode perceptual content during bistable perception and simple unambiguous perception. Although perceptually reflective activity patterns during simple perception localized predominantly to posterior visual regions, bistable perception involved additionally many higher-order frontoparietal and temporal regions. Moreover, compared with simple perception, both top-down and bottom-up influences were dramatically enhanced during bistable perception. We further studied the intermittent presentation of ambiguous images--a condition that is known to elicit perceptual memory. Compared with continuous presentation, intermittent presentation recruited even more higher-order regions and was accompanied by further strengthened top-down influences but relatively weakened bottom-up influences. Taken together, these results strongly support an active top-down inferential process in perception.

A common neurodynamical mechanism could mediate externally induced and intrinsically generated transitions in visual awareness

The neural correlates of conscious visual perception are commonly studied in paradigms of perceptual multistability that allow multiple perceptual interpretations during unchanged sensory stimulation. What is the source of this multistability in the content of perception? From a theoretical perspective, a fine balance between deterministic and stochastic forces has been suggested to underlie the spontaneous, intrinsically driven perceptual transitions observed during multistable perception. Deterministic forces are represented by adaptation of feature-selective neuronal populations encoding the competing percepts while stochastic forces are modeled as noise-driven processes. Here, we used a unified neuronal competition model to study the dynamics of adaptation and noise processes in binocular flash suppression (BFS), a form of externally induced perceptual suppression, and compare it with the dynamics of intrinsically driven alternations in binocular rivalry (BR). For the first time, we use electrophysiological, biologically relevant data to constrain a model of perceptual rivalry. Specifically, we show that the mean population discharge pattern of a perceptually modulated neuronal population detected in electrophysiological recordings in the lateral prefrontal cortex (LPFC) during BFS, constrains the dynamical range of externally induced perceptual transitions to a region around the bifurcation separating a noise-driven attractor regime from an adaptation-driven oscillatory regime. Most interestingly, the dynamical range of intrinsically driven perceptual transitions during BR is located in the noise-driven attractor regime, where it overlaps with BFS. Our results suggest that the neurodynamical mechanisms of externally induced and spontaneously generated perceptual alternations overlap in a narrow, noise-driven region just before a bifurcation where the system becomes adaptation-driven.

Global mapping of the whole-brain network underlining binocular rivalry

We investigated how the structure of the brain network relates to the stability of perceptual alternation in binocular rivalry. Historically, binocular rivalry has provided important new insights to our understandings in neuroscience. Although various relationships between the local regions of the human brain structure and perceptual switching phenomena have been shown in previous researches, the global organization of the human brain structural network relating to this phenomenon has not yet been addressed. To approach this issue, we reconstructed fiber-tract bundles using diffusion tensor imaging and then evaluated the correlations between the speeds of perceptual alternation and fractional anisotropy (FA) values in each fiber-tract bundle integrating among 84 brain regions. The resulting comparison revealed that the distribution of the global organization of the structural brain network showed positive or negative correlations between the speeds of perceptual alternation and the FA values. First, the connections between the subcortical regions stably were negatively correlated. Second, the connections between the cortical regions mainly showed positive correlations. Third, almost all other cortical connections that showed negative correlations were located in one central cluster of the subcortical connections. This contrast between the contribution of the cortical regions to destabilization and the contribution of the subcortical regions to stabilization of perceptual alternation provides important information as to how the global architecture of the brain structural network supports the phenomenon of binocular rivalry.

Variability of perceptual multistability: from brain state to individual trait

Few phenomena are as suitable as perceptual multistability to demonstrate that the brain constructively interprets sensory input. Several studies have outlined the neural circuitry involved in generating perceptual inference but only more recently has the individual variability of this inferential process been appreciated. Studies of the interaction of evoked and ongoing neural activity show that inference itself is not merely a stimulus-triggered process but is related to the context of the current brain state into which the processing of external stimulation is embedded. As brain states fluctuate, so does perception of a given sensory input. In multistability, perceptual fluctuation rates are consistent for a given individual but vary considerably between individuals. There has been some evidence for a genetic basis for these individual differences and recent morphometric studies of parietal lobe regions have identified neuroanatomical substrates for individual variability in spontaneous switching behaviour. Moreover, disrupting the function of these latter regions by transcranial magnetic stimulation yields systematic interference effects on switching behaviour, further arguing for a causal role of these regions in perceptual inference. Together, these studies have advanced our understanding of the biological mechanisms by which the brain constructs the contents of consciousness from sensory input.

Neural processes for intentional control of perceptual switching: a magnetoencephalography study

This article reports an interesting link between the psychophysical property of intentional control of perceptual switching and the underlying neural activities. First, we revealed that the timing of perceptual switching for a dynamical dot quartet can be controlled by the observers' intention, without eye movement. However, there is a clear limitation to this control, such that each animation frame of the stimulus must be presented for a sufficiently long time length; in other words, the frequency of the stimulus alternation must be sufficiently slow for the control. The typical stimulus onset asynchrony for a 50% level of success was about 275 ms for an average of 10 observers. On the basis of psychophysical property, we designed three experiments for investigating the neural process with a magnetoencephalography. They revealed that: (1) a peak component occurring about 300 ms after a reversal was stronger when the direction of perceived motion was switched intentionally than when it was not switched, and (2) neural components about 30-40 ms and 240-250 ms after the reversal of the stimulus animation were stronger when perception was altered intentionally than when it was switched unintentionally. The 300 ms component is consistent with a previous study about passive perceptual switching (Struber and Herrmann [ 2002]: Cogn Brain Res 14:370-382), but the intentional effect was seemed to be a different component from the well-known P300 component.

On the functional relevance of frontal cortex for passive and voluntarily controlled bistable vision

In bistable vision, one constant ambiguous stimulus leads to 2 alternating conscious percepts. This perceptual switching occurs spontaneously but can also be influenced through voluntary control. Neuroimaging studies have reported that frontal regions are activated during spontaneous perceptual switches, leading some researchers to suggest that frontal regions causally induce perceptual switches. But the opposite also seems possible: frontal activations may themselves be caused by spontaneous switches. Classically implicated in attentional processes, these same regions are also candidates for the origins of voluntary control over bistable vision. Here too, it remains unknown whether frontal cortex is actually functionally relevant. It is even possible that spontaneous perceptual switches and voluntarily induced switches are mediated by the same top-down mechanisms. To directly address these issues, we here induced "virtual lesions," with transcranial magnetic stimulation, in frontal, parietal, and 2 lower level visual cortices using an established ambiguous structure-from-motion stimulus. We found that dorsolateral prefrontal cortex was causally relevant for voluntary control over perceptual switches. In contrast, we failed to find any evidence for an active role of frontal cortex in passive bistable vision. Thus, it seems the same pathway used for willed top-down modulation of bistable vision is not used during passive bistable viewing.

Right parietal brain activity precedes perceptual alternation during binocular rivalry

We investigated perceptual reversals for intermittently presented stimuli during binocular rivalry and physical alternation while the ongoing EEG was recorded from 64 channels. EEG topographies immediately preceding stimulus-onset were analyzed and two topographies doubly dissociated perceptual reversals from non-reversals. The estimated intracranial generators associated with these topographies were stronger in right inferior parietal cortex and weaker bilaterally in the ventral stream before perceptual reversals. No such differences were found for physical alternation of the same stimuli. These results replicate and extend findings from a previous study with the Necker cube and suggest common neural mechanisms associated with perceptual reversals during binocular rivalry and ambiguous figure perception. For both types of multi-stable stimuli, the dorsal stream is more active preceding perceptual reversals. Activity in the ventral stream, however, differed for binocular rivalry compared to ambiguous figures. The results from the two studies suggest a causal role for the right inferior parietal cortex in generating perceptual reversals regardless of the type of multi-stable stimulus, while activity in the ventral stream appears to depend on the particular type of stimulus.

Neural correlates of motion-induced blindness in the human brain

Motion-induced blindness (MIB) is a visual phenomenon in which highly salient visual targets spontaneously disappear from visual awareness (and subsequently reappear) when superimposed on a moving background of distracters. Such fluctuations in awareness of the targets, although they remain physically present, provide an ideal paradigm to study the neural correlates of visual awareness. Existing behavioral data on MIB are consistent both with a role for structures early in visual processing and with involvement of high-level visual processes. To further investigate this issue, we used high field functional MRI to investigate signals in human low-level visual cortex and motion-sensitive area V5/MT while participants reported disappearance and reappearance of an MIB target. Surprisingly, perceptual invisibility of the target was coupled to an increase in activity in low-level visual cortex plus area V5/MT compared with when the target was visible. This increase was largest in retinotopic regions representing the target location. One possibility is that our findings result from an active process of completion of the field of distracters that acts locally in the visual cortex, coupled to a more global process that facilitates invisibility in general visual cortex. Our findings show that the earliest anatomical stages of human visual cortical processing are implicated in MIB, as with other forms of bistable perception.

The neural bases of multistable perception

Multistable perception is the spontaneous alternation between two or more perceptual states that occurs when sensory information is ambiguous. Multistable phenomena permit dissociation of neural activity related to conscious perception from that related to sensory stimulation, and therefore have been used extensively to study the neural correlates of consciousness. Here, we review recent work on the neural mechanisms underlying multistable perception and how such work has contributed to understanding the neural correlates of consciousness. Particular emphasis is put on the role of high-level brain mechanisms that are involved in actively selecting and interpreting sensory information, and their interactions with lower-level processes that are more directly concerned with the processing of sensory stimulus properties.

Temporal cortex participates in spontaneous perceptual reversal

The Necker cube is perceived as two distinct three-dimensional forms; participants experience alternation between two mutually exclusive perceptions. Perceptual dominance for one form tends to be maintained when the visual stimulus is intermittently removed. The effect is enhanced with the Necker lattice (an array of Necker cubes). Neural processes underlying perceptual reversal and stabilization are unknown. Functional MRI was used to investigate the brain regions involved. Regional activation differed between endogenous and stimulus-driven perceptual reversals, and between reversal and stabilization. Our results indicated that the right anterior portion of superior temporal sulcus is likely to be involved in perceptual stabilization (perceptual memory), whereas reversal is modulated by destabilizing influences from the right frontal lobe.

Visual perception of ambiguous figures: synchronization based neural models

We develop and study two neural network models of perceptual alternations. Both models have a star-like architecture of connections with a central element connected to a set of peripheral elements. A particular perception is simulated in terms of partial synchronization between the central element and some sub-group of peripheral elements. The first model is constructed from phase oscillators and the mechanism of perceptual alternations is based on chaotic intermittency under fixed parameter values. Similar to experimental evidence, the distribution of times between perceptual alternations is represented by the gamma distribution. The second model is built of spiking neurons of the Hodgkin-Huxley type. The mechanism of perceptual alternations is based on plasticity of inhibitory synapses which increases the inhibition from the central unit to the neural assembly representing the current percept. As a result another perception is formed. Simulations show that the second model is in good agreement with behavioural data on switching times between percepts of ambiguous figures and with experimental results on binocular rivalry of two and four percepts.

Neural generators of ERPs linked with Necker cube reversals

Multistable perception occurs when a single physical stimulus leads to two or more distinct percepts that spontaneously switch (reverse). Previous ERP studies have reported reversal negativities and late positive components associated with perceptual reversals. The goal of the current study was to localize the neural generators of the reversal ERP components in order to evaluate their correspondence with previous fMRI results and to better understand their functional significance. A Necker-type stimulus was presented for brief intervals while subjects indicated their perceptions. Local auto-regressive average source analyses and dipole modeling indicated that sources for the reversal negativity were located in inferior occipital-temporal cortex. Generators of the late positive component were estimated to reside in inferior temporal and superior parietal regions.

Early visual brain areas reflect the percept of an ambiguous scene

When a visual scene allows multiple interpretations, the percepts may spontaneously alternate despite the stable retinal image and the invariant sensory input transmitted to the brain. To study the brain basis of such multi-stable percepts, we superimposed rapidly changing dynamic noise as regional tags to the Rubin vase-face figure and followed the corresponding tag-related cortical signals with magnetoencephalography. The activity already in the earliest visual cortical areas, the primary visual cortex included, varied with the perceptual states reported by the observers. These percept-related modulations most likely reflect top-down influences that accentuate the neural representation of the perceived object in the early visual cortex and maintain the segregation of objects from the background.

Perceptual switch rates with ambiguous structure-from-motion figures in bipolar disorder

Slowing of the rate at which a rivalrous percept switches from one configuration to another has been suggested as a potential trait marker for bipolar disorder. We measured perceptual alternations for a bistable, rotating, structure-from-motion cylinder in bipolar and control participants. In a control task, binocular depth rendered the direction of cylinder rotation unambiguous to monitor participants' performance and attention during the experimental task. A particular direction of rotation was perceptually stable, on average, for 33.5 s in participants without psychiatric diagnosis. Euthymic, bipolar participants showed a slightly slower rate of switching between the two percepts (percept duration 42.3 s). Under a parametric analysis of the best-fitting model for individual participants, this difference was statistically significant. However, the variability within groups was high, so this difference in average switch rates was not big enough to serve as a trait marker for bipolar disorder. We also found that low-level visual capacities, such as stereo threshold, influence perceptual switch rates. We suggest that there is no single brain location responsible for perceptual switching in all different ambiguous figures and that perceptual switching is generated by the actions of local cortical circuitry.

The effects of pattern shape, subliminal stimulation, and voluntary control on multistable visual perception

Spontaneous figure reversal of ambiguous patterns was analyzed in humans. A) With Necker-"cube"-like, or "drum"-like figures, having square or round shaped "front" and "rear" surfaces, and either large or small "depth", the perceptual intervals corresponding to both interpretations of "drum" were longer than those of "cube"; the perceived "depth" of the figures was less relevant for reversal timing (inter-reversal intervals were only slightly longer for the "deeper" figures). Although the shape of "front" and "rear" surfaces is not a crucial geometrical feature for figure reversal, it did influence its timing. More, or longer information-processing steps should probably be needed for perceptual representations of curvilinear patterns in comparison with rectangular ones. The underlying neural mechanisms are probably located at a relatively peripheral level in the visual system. B) With a modified Necker "cube"-like figure, having the two internal vertices coincident, and the long axis of the figure aligned horizontally, the effect of voluntary control on perception-reversal timing overcomes opposite effects due to either fixation-attention to pattern's focal zones, or subliminal stimulation by the pattern's biased versions, suggesting one or the other perception's possibility, while it is enhanced by concordant imagery. Voluntary control should intervene downward at a high-level processing, and should probably affect both a decision-making and a perception-stabilizing mechanism in the process of the pattern's unconscious interpretation. Results A and B are confronted with other results on both perceptual and binocular rivalry of up-to-date literature, in the frame of discussions on low-level bottom-up automatic stimulus-driven processing vs high-level top-down covert attention-driven processing.

Early top-down influences on bistable perception revealed by event-related potentials

A longstanding debate exists in the literature concerning bottom-up vs. top-down influences on bistable perception. Recently, a technique has been developed to measure early changes in brain activity (via ERPs) related to perceptual reversals (Kornmeier & Bach, 2004). An ERP component, the reversal negativity (RN) has been identified, and is characterized as an increase in negative potential over the posterior scalp from 150 to 350 ms for perceptual reversals compared to perceptual stability. This finding, although interesting, has not helped resolve issues related to the bottom-up vs. top-down debate because top-down influences have not been directly manipulated. The current study focused on resolving some of these issues by measuring the RN while observers maintained one of three 'intentional approaches', (1) try to reverse perception as often as possible, (2) try to stabilize perception for as long as possible, and (3) maintain a passive approach. Enhancements in RN amplitude were found for the intention-to-reverse condition compared to the passive condition. This finding suggests an early influence (150 ms) of top-down control on perceptual reversals of bistable figures. Results are discussed in terms of competing attention shifting vs. fatigue-based theories of bistable perception.

Mountains and valleys: binocular rivalry and the flow of experience

Binocular rivalry provides a useful situation for studying the relation between the temporal flow of conscious experience and the temporal dynamics of neural activity. After proposing a phenomenological framework for understanding temporal aspects of consciousness, we review experimental research on multistable perception and binocular rivalry, singling out various methodological, theoretical, and empirical aspects of this research relevant to studying the flow of experience. We then review an experimental study from our group explicitly concerned with relating the temporal dynamics of rivalrous experience to the temporal dynamics of cortical activity. Drawing attention to the importance of dealing with ongoing activity and its inherent changing nature at both phenomenological and neurodynamical levels, we argue that the notions of recurrence and variability are pertinent to understanding rivalry in particular and the flow of experience in general.

The contribution of prefrontal cortex to global perception

Recent research suggests a role of top-down modulatory signals on perceptual processing, particularly for the integration of local elementary information to form a global holistic percept. In this study we investigated whether prefrontal cortex may be instrumental in this top-down modulation in humans. We measured detection thresholds for perceiving a circle defined by a closed chain of grating patches in 6 patients with prefrontal lesions, 4 control patients with temporal lesions and 17 healthy control subjects. Performance of patients with prefrontal lesions was worse than that of patients with temporal lesions and normal controls when the patterns were sparse, requiring integration across relatively extensive regions of space, but similar to the control groups for denser patterns. The results clearly implicate the prefrontal cortex in the process of integrating elementary features into a holistic global percept, when the elements do not form a "pop-out" display.

A neural basis for inference in perceptual ambiguity

When looking at ambiguous visual stimuli, the observer experiences frequent spontaneous transitions between two competing percepts while physical stimulation remains unchanged. Despite recent advances in understanding the neural processes underlying such perceptual rivalry, a key question has remained unresolved: Does perceptual rivalry result merely from local bistability of neural activity patterns in sensory stimulus representations, or do higher-order areas play a causal role by shifting inference and, thus, initiating perceptual changes? We used functional MRI to measure brain activity while human observers reported successive spontaneous changes in perceived direction for an ambiguous apparent motion stimulus. In a control condition, the individual sequences of spontaneous perceptual switches during bistability were replayed by using a disambiguated version of the stimulus. Greater activations during spontaneous compared with stimulus-driven switches were observed in inferior frontal cortex bilaterally. Subsequent chronometric analyses of event-related signal time courses showed that, relative to activations in motion-sensitive extrastriate visual cortex, right inferior frontal cortex activation occurred earlier during spontaneous than during stimulus-driven perceptual changes. The temporal precedence of right inferior frontal activations suggests that this region participates in initiating spontaneous switches in perception during constant physical stimulation. Our findings can thus be seen as a signature of when and where the brain "makes up its mind" about competing perceptual interpretations of a given sensory input pattern.