No binocular rivalry in the LGN of alert macaque monkeys

Stimulating both eyes with matching stimuli enhances V1 responses

Neurons in the primary visual cortex (V1) of primates play a key role in combining monocular inputs to form a binocular response. Although much has been gleaned from studying how V1 responds to discrepant (dichoptic) images, equally important is to understand how V1 responds to concordant (dioptic) images in the two eyes. Here, we investigated the extent to which concordant, balanced, zero-disparity binocular stimulation modifies V1 responses to varying stimulus contrast using intracranial multielectrode arrays. On average, binocular stimuli evoked stronger V1 activity than their monocular counterparts. This binocular facilitation scaled most proportionately with contrast during the initial transient. As V1 responses evolved, additional contrast-mediated dynamics emerged. Specifically, responses exhibited longer maintenance of facilitation for lower contrast and binocular suppression at high contrast. These results suggest that V1 processes concordant stimulation of both eyes in at least two sequential steps: initial response enhancement followed by contrast-dependent control of excitation.

Contextual Modulation of Feedforward Inputs to Primary Visual Cortex

Throughout the brain, parallel processing streams compose the building blocks of complex neural functions. One of the most salient models for studying the functional specialization of parallel visual streams in the primate brain is the lateral geniculate nucleus (LGN) of the dorsal thalamus, through which the parvocellular and magnocellular channels, On-center and Off-center channels, and ipsilateral and contralateral eye channels are maintained and provide the foundation for cortical processing. We examined three aspects of neural processing in these streams: (1) the relationship between extraclassical surround suppression, a widespread visual computation thought to represent a canonical neural computation, and the parallel channels of the LGN; (2) the magnitude of binocular interaction in the parallel streams; and (3) the magnitude of suppression elicited by perceptual competition (binocular rivalry) in each stream. Our results show that surround suppression is almost exclusive to Off channel cells; further, we found evidence for two different components of monocular surround suppression—an early-stage suppression exhibited by all magnocellular cells, and a late-stage suppression exhibited only by Off cells in both the parvocellular and magnocellular pathways. This finding indicates that stream-specific circuits contribute to surround suppression in the primate LGN and suggests a distinct role for suppression in the Off channel to the cortex. We also examined the responses of LGN neurons in alert macaque monkeys to determine whether neurons that supply the cortex with visual information are influenced by stimulation of both eyes. Our results demonstrate that LGN neurons are not influenced by stimulation of the non-dominant eye. This was the case when dichoptic stimuli were presented to classical receptive fields of neurons, extraclassical receptive fields of neurons, and when stimuli were appropriate to produce the perception of binocular rivalry.

Bi-Stable Perception: Self-Coordinating Brain Regions to Make-Up the Mind

Bi-stable perception is a strong instance of cognitive self-organization, providing a research model for how ‘the brain makes up its mind.’ The complexity of perceptual bistability prevents a simple attribution of functions to areas, because many cognitive processes, recruiting multiple brain regions, are simultaneously involved. The functional magnetic resonance imaging (fMRI) evidence suggests the activation of a large network of distant brain areas. Concurrently, electroencephalographic and magnetoencephalographic (MEEG) literature shows sub second oscillatory activity and phase synchrony on several frequency bands. Strongly represented are beta and gamma bands, often associated with neural/cognitive integration processes. The spatial extension and short duration of brain activities suggests the need for a fast, large-scale neural coordination mechanism. To address the range of temporo-spatial scales involved, we systematize the current knowledge from mathematical models, cognitive sciences and neuroscience at large, from single-cell- to system-level research, including evidence from human and non-human primates. Surprisingly, despite evidence spanning through different organization levels, models, and experimental approaches, the scarcity of integrative studies is evident. In a final section of the review we dwell on the reasons behind such scarcity and on the need of integration in order to achieve a real understanding of the complexities underlying bi-stable perception processes.

Binocular Suppression in the Macaque Lateral Geniculate Nucleus Reveals Early Competitive Interactions between the Eyes

The lateral geniculate nucleus (LGN) of the dorsal thalamus is the primary recipient of the two eyes’ outputs. Most LGN neurons are monocular in that they are activated by visual stimulation through only one (dominant) eye. However, there are both intrinsic connections and inputs from binocular structures to the LGN that could provide these neurons with signals originating from the other (non-dominant) eye. Indeed, previous work introducing luminance differences across the eyes or using a single-contrast stimulus showed binocular modulation for single unit activity in anesthetized macaques and multiunit activity in awake macaques. Here, we sought to determine the influence of contrast viewed by both the non-dominant and dominant eyes on LGN single-unit responses in awake macaques. To do this, we adjusted each eye’s signal strength by independently varying the contrast of stimuli presented to the two eyes. Specifically, we recorded LGN single unit spiking activity in two awake macaques while they viewed drifting gratings of varying contrast. We found that LGN neurons of all types [parvocellular (P), magnocellular (M), and koniocellular (K)] were significantly suppressed when stimuli were presented at low contrast to the dominant eye and at high contrast to the non-dominant eye. Further, the inputs of the two eyes showed antagonistic interaction, whereby the magnitude of binocular suppression diminished with high contrast in the dominant eye, or low contrast in the non-dominant eye. These results suggest that the LGN represents a site of precortical binocular processing involved in resolving discrepant contrast differences between the eyes.

Retinal ganglion cells and the magnocellular, parvocellular, and koniocellular subcortical visual pathways from the eye to the brain

In primates including humans, most retinal ganglion cells send signals to the lateral geniculate nucleus (LGN) of the thalamus. The anatomical and functional properties of the two major pathways through the LGN, the parvocellular (P) and magnocellular (M) pathways, are now well understood. Neurones in these pathways appear to convey a filtered version of the retinal image to primary visual cortex for further analysis. The properties of the P-pathway suggest it is important for high spatial acuity and red-green color vision, while those of the M-pathway suggest it is important for achromatic visual sensitivity and motion vision. Recent work has sharpened our understanding of how these properties are built in the retina, and described subtle but important nonlinearities that shape the signals that cortex receives. In addition to the P- and M-pathways, other retinal ganglion cells also project to the LGN. These ganglion cells are larger than those in the P- and M-pathways, have different retinal connectivity, and project to distinct regions of the LGN, together forming heterogenous koniocellular (K) pathways. Recent work has started to reveal the properties of these K-pathways, in the retina and in the LGN. The functional properties of K-pathways are more complex than those in the P- and M-pathways, and the K-pathways are likely to have a distinct contribution to vision. They provide a complementary pathway to the primary visual cortex, but can also send signals directly to extrastriate visual cortex. At the level of the LGN, many neurones in the K-pathways seem to integrate retinal with non-retinal inputs, and some may provide an early site of binocular convergence.

Functional Specialization in the Attention Network

Spatial attention is comprised of neural mechanisms that boost sensory processing at a behaviorally relevant location while filtering out competing information. The present review examines functional specialization in the network of brain regions that directs such preferential processing. This attention network includes both cortical (e.g., frontal and parietal cortices) and subcortical (e.g., the superior colliculus and the pulvinar nucleus of the thalamus) structures. Here, we piece together existing evidence that these various nodes of the attention network have dissociable functional roles by synthesizing results from electrophysiology and neuroimaging studies. We describe functional specialization across several dimensions (e.g., at different processing stages and within different behavioral contexts), while focusing on spatial attention as a dynamic process that unfolds over time. Functional contributions from each node of the attention network can change on a moment-to-moment timescale, providing the necessary cognitive flexibility for sampling from highly dynamic environments.

Binocular summation in marmoset lateral geniculate nucleus

In primates and carnivores, the main laminae of the dorsal lateral geniculate nucleus (LGN) receive monocular excitatory input in an eye-alternating fashion. There is also evidence that nondominant eye stimulation can reduce responses to dominant eye stimulation and that a subset of LGN cells in the koniocellular (K) layers receives convergent binocular excitatory input from both eyes. What is not known is how the two eye inputs summate in the K layers of LGN. Here, we aimed to answer this question by making extracellular array electrode recordings targeted to K layers in the marmoset (Callithrix jacchus) LGN, as visual stimuli (flashed 200 ms temporal square-wave pulses or drifting gratings) were presented to each eye independently or to both eyes simultaneously. We found that when the flashed stimulus was presented to both eyes, compared to the dominant eye, the peak firing rate of most cells (61%, 14/23) was reduced. The remainder showed response facilitation (17%) or partial summation (22%). A greater degree of facilitation was seen when the total number of spikes across the stimulus time window (200 ms) rather than peak firing rates was measured. A similar pattern of results was seen for contrast-varying gratings and for small numbers of parvocellular (n = 12) and magnocellular (n = 3) cells recorded. Our findings show that binocular summation in the marmoset LGN is weak and predominantly sublinear in nature.

Influence of continuous flash suppression mask frequency on stimulus visibility

The continuous flash suppression (CFS) paradigm is increasingly used in consciousness research, but its mechanisms are still not fully understood. To better understand its temporal properties, we presented the CFS masks at 9 frequencies, and examined their influence on stimuli visibility, while taking into account the inter-individual variability and the change of CFS suppression as the experiment progressed. The frequencies consisted of fundamental frequencies of 3, 4 and 5 Hz, and their 2nd and 3rd harmonics, which included the 10 Hz frequency typically used in most of the CFS studies. We found that the suppression of stimulus awareness was stronger under 4, 6 and 8 Hz than 10 Hz. After controlling for inter-individual variability with mixed-effects analysis, we found that the number of seen trials was lower for the 4 Hz-basis frequencies than the 5 Hz ones, and was lower for the 2nd than 3rd harmonic. We propose that this may be caused by an interaction between the CFS masks and the ongoing sampling of the attentional mechanism. Examining individual data, we also found a habituation effect that the participants saw significantly more stimuli as the experiment progressed. Our results suggest that these factors need to be taken care of in future CFS studies in order to achieve optimal visual awareness suppression and ensure the generalizability of results.

Binocular response modulation in the lateral geniculate nucleus

The dorsal lateral geniculate nucleus of the thalamus (LGN) receives the main outputs of both eyes and relays those signals to the visual cortex. Each retina projects to separate layers of the LGN so that each LGN neuron is innervated by a single eye. In line with this anatomical separation, visual responses of almost all of LGN neurons are driven by one eye only. Nonetheless, many LGN neurons are sensitive to what is shown to the other eye as their visual responses differ when both eyes are stimulated compared to when the driving eye is stimulated in isolation. This, predominantly suppressive, binocular modulation of LGN responses might suggest that the LGN is the first location in the primary visual pathway where the outputs from the two eyes interact. Indeed, the LGN features several anatomical structures that would allow for LGN neurons responding to one eye to modulate neurons that respond to the other eye. However, it is also possible that binocular response modulation in the LGN arises indirectly as the LGN also receives input from binocular visual structures. Here we review the extant literature on the effects of binocular stimulation on LGN spiking responses, highlighting findings from cats and primates, and evaluate the neural circuits that might mediate binocular response modulation in the LGN.

Different Signal Enhancement Pathways of Attention and Consciousness Underlie Perception in Humans

It is not yet known whether attention and consciousness operate through similar or largely different mechanisms. Visual processing mechanisms are routinely characterized by measuring contrast response functions (CRFs). In this report, behavioral CRFs were obtained in humans (both males and females) by measuring afterimage durations over the entire range of inducer stimulus contrasts to reveal visual mechanisms behind attention and consciousness. Deviations relative to the standard CRF, i.e., gain functions, describe the strength of signal enhancement, which were assessed for both changes due to attentional task and conscious perception. It was found that attention displayed a response-gain function, whereas consciousness displayed a contrast-gain function. Through model comparisons, which only included contrast-gain modulations, both contrast-gain and response-gain effects can be explained with a two-level normalization model, in which consciousness affects only the first level and attention affects only the second level. These results demonstrate that attention and consciousness can effectively show different gain functions because they operate through different signal enhancement mechanisms.SIGNIFICANCE STATEMENT The relationship between attention and consciousness is still debated. Mapping contrast response functions (CRFs) has allowed (neuro)scientists to gain important insights into the mechanistic underpinnings of visual processing. Here, the influence of both attention and consciousness on these functions were measured and they displayed a strong dissociation. First, attention lowered CRFs, whereas consciousness raised them. Second, attention manifests itself as a response-gain function, whereas consciousness manifests itself as a contrast-gain function. Extensive model comparisons show that these results are best explained in a two-level normalization model in which consciousness affects only the first level, whereas attention affects only the second level. These findings show dissociations between both the computational mechanisms behind attention and consciousness and the perceptual consequences that they induce.

To see or not to see--thalamo-cortical networks during blindsight and perceptual suppression

Even during moments when we fail to be fully aware of our environment, our brains never go silent. Instead, it appears that the brain can also operate in an alternate, unconscious mode. Delineating unconscious from conscious neural processes is a promising first step toward investigating how awareness emerges from brain activity. Here we focus on recent insights into the neuronal processes that contribute to visual function in the absence of a conscious visual percept. Drawing on insights from findings on the phenomenon of blindsight that results from injury to primary visual cortex and the results of experimentally induced perceptual suppression, we describe what kind of visual information the visual system analyzes unconsciously and we discuss the neuronal routing and responses that accompany this process. We conclude that unconscious processing of certain visual stimulus attributes, such as the presence of visual motion or the emotional expression of a face can occur in a geniculo-cortical circuit that runs independent from and in parallel to the predominant route through primary visual cortex. We speculate that in contrast, bidirectional neuronal interactions between cortex and the thalamic pulvinar nucleus that support large-scale neuronal integration and visual awareness are impeded during blindsight and perceptual suppression.

Temporal response properties of koniocellular (blue-on and blue-off) cells in marmoset lateral geniculate nucleus

Visual perception requires integrating signals arriving at different times from parallel visual streams. For example, signals carried on the phasic-magnocellular (MC) pathway reach the cerebral cortex pathways some tens of milliseconds before signals traveling on the tonic-parvocellular (PC) pathway. Visual latencies of cells in the koniocellular (KC) pathway have not been specifically studied in simian primates. Here we compared MC and PC cells to “blue-on” (BON) and “blue-off” (BOF) KC cells; these cells carry visual signals originating in short-wavelength-sensitive (S) cones. We made extracellular recordings in the lateral geniculate nucleus (LGN) of anesthetized marmosets. We found that BON visual latencies are 10–20 ms longer than those of PC or MC cells. A small number of recorded BOF cells ( n = 7) had latencies 10–20 ms longer than those of BON cells. Within all cell groups, latencies of foveal receptive fields (<10° eccentricity) were longer (by 3–8 ms) than latencies of peripheral receptive fields (>10°). Latencies of yellow-off inputs to BON cells lagged the blue-on inputs by up to 30 ms, but no differences in visual latency were seen on comparing marmosets expressing dichromatic (“red-green color-blind”) or trichromatic color vision phenotype. We conclude that S-cone signals leaving the LGN on KC pathways are delayed with respect to signals traveling on PC and MC pathways. Cortical circuits serving color vision must therefore integrate across delays in (red-green) chromatic signals carried by PC cells and (blue-yellow) signals carried by KC cells.

Thalamocortical rhythms during a vibrotactile detection task

To explore the role of oscillatory dynamics of the somatosensory thalamocortical network in perception and decision making, we recorded the simultaneous neuronal activity in the ventral posterolateral nucleus (VPL) of the somatosensory thalamus and primary somatosensory cortex (S1) in two macaque monkeys performing a vibrotactile detection task. Actively detecting a vibrotactile stimulus and reporting its perception elicited a sustained poststimulus beta power increase in VPL and an alpha power decrease in S1, in both stimulus-present and stimulus-absent trials. These oscillatory dynamics in the somatosensory thalamocortical network depended on the behavioral context: they were stronger for the active detection condition than for a passive stimulation condition. Furthermore, contrasting stimulus-present vs. stimulus-absent responses, we found that poststimulus theta power increased in both VPL and S1, and alpha/beta power decreased in S1, reflecting the monkey's perceptual decision but not the motor response per se. Additionally, higher prestimulus alpha power in S1 correlated with an increased probability of the monkey reporting a stimulus, regardless of the actual presence of a stimulus. Thus, we found task-related modulations in oscillatory activity, not only in the neocortex but also in the thalamus, depending on behavioral context. Furthermore, oscillatory modulations reflected the perceptual decision process and subsequent behavioral response. We conclude that these early sensory regions, in addition to their primary sensory functions, may be actively involved in perceptual decision making.

Binocular rivalry: frontal activity relates to introspection and action but not to perception

When two dissimilar stimuli are presented to the eyes, perception alternates between multiple interpretations, a phenomenon dubbed binocular rivalry. Numerous recent imaging studies have attempted to unveil neural substrates underlying multistable perception. However, these studies had a conceptual constraint: access to observers' perceptual state relied on their introspection and active report. Here, we investigated to what extent neural correlates of binocular rivalry in healthy humans are confounded by this subjective measure and by action. We used the optokinetic nystagmus and pupil size to objectively and continuously map perceptual alternations for binocular-rivalry stimuli. Combining these two measures with fMRI allowed us to assess the neural correlates of binocular rivalry time locked to the perceptual alternations in the absence of active report. When observers were asked to actively report their percept, our objective measures matched the report. In this active condition, objective measures and subjective reporting revealed that occipital, parietal, and frontal areas underlie the processing of binocular rivalry, replicating earlier findings. Furthermore, objective measures provided additional statistical power due to their continuous nature. Importantly, when observers passively experienced rivalry without reporting perceptual alternations, a different picture emerged: differential neural activity in frontal areas was absent, whereas activation in occipital and parietal regions persisted. Our results question the popular view of a driving role of frontal areas in the initiation of perceptual alternations during binocular rivalry. Instead, we conclude that frontal areas are associated with active report and introspection rather than with rivalry per se.

Subjective visual perception: from local processing to emergent phenomena of brain activity

The combination of electrophysiological recordings with ambiguous visual stimulation made possible the detection of neurons that represent the content of subjective visual perception and perceptual suppression in multiple cortical and subcortical brain regions. These neuronal populations, commonly referred to as the neural correlates of consciousness, are more likely to be found in the temporal and prefrontal cortices as well as the pulvinar, indicating that the content of perceptual awareness is represented with higher fidelity in higher-order association areas of the cortical and thalamic hierarchy, reflecting the outcome of competitive interactions between conflicting sensory information resolved in earlier stages. However, despite the significant insights into conscious perception gained through monitoring the activities of single neurons and small, local populations, the immense functional complexity of the brain arising from correlations in the activity of its constituent parts suggests that local, microscopic activity could only partially reveal the mechanisms involved in perceptual awareness. Rather, the dynamics of functional connectivity patterns on a mesoscopic and macroscopic level could be critical for conscious perception. Understanding these emergent spatio-temporal patterns could be informative not only for the stability of subjective perception but also for spontaneous perceptual transitions suggested to depend either on the dynamics of antagonistic ensembles or on global intrinsic activity fluctuations that may act upon explicit neural representations of sensory stimuli and induce perceptual reorganization. Here, we review the most recent results from local activity recordings and discuss the potential role of effective, correlated interactions during perceptual awareness.

Consciousness in humans and non-human animals: recent advances and future directions

This joint article reflects the authors' personal views regarding noteworthy advances in the neuroscience of consciousness in the last 10 years, and suggests what we feel may be promising future directions. It is based on a small conference at the Samoset Resort in Rockport, Maine, USA, in July of 2012, organized by the Mind Science Foundation of San Antonio, Texas. Here, we summarize recent advances in our understanding of subjectivity in humans and other animals, including empirical, applied, technical, and conceptual insights. These include the evidence for the importance of fronto-parietal connectivity and of “top-down” processes, both of which enable information to travel across distant cortical areas effectively, as well as numerous dissociations between consciousness and cognitive functions, such as attention, in humans. In addition, we describe the development of mental imagery paradigms, which made it possible to identify covert awareness in non-responsive subjects. Non-human animal consciousness research has also witnessed substantial advances on the specific role of cortical areas and higher order thalamus for consciousness, thanks to important technological enhancements. In addition, much progress has been made in the understanding of non-vertebrate cognition relevant to possible conscious states. Finally, major advances have been made in theories of consciousness, and also in their comparison with the available evidence. Along with reviewing these findings, each author suggests future avenues for research in their field of investigation.

Brain mechanisms for simple perception and bistable perception

When faced with ambiguous sensory inputs, subjective perception alternates between the different interpretations in a stochastic manner. Such multistable perception phenomena have intrigued scientists and laymen alike for over a century. Despite rigorous investigations, the underlying mechanisms of multistable perception remain elusive. Recent studies using multivariate pattern analysis revealed that activity patterns in posterior visual areas correlate with fluctuating percepts. However, increasing evidence suggests that vision--and perception at large--is an active inferential process involving hierarchical brain systems. We applied searchlight multivariate pattern analysis to functional magnetic resonance imaging signals across the human brain to decode perceptual content during bistable perception and simple unambiguous perception. Although perceptually reflective activity patterns during simple perception localized predominantly to posterior visual regions, bistable perception involved additionally many higher-order frontoparietal and temporal regions. Moreover, compared with simple perception, both top-down and bottom-up influences were dramatically enhanced during bistable perception. We further studied the intermittent presentation of ambiguous images--a condition that is known to elicit perceptual memory. Compared with continuous presentation, intermittent presentation recruited even more higher-order regions and was accompanied by further strengthened top-down influences but relatively weakened bottom-up influences. Taken together, these results strongly support an active top-down inferential process in perception.

Neural coding and perceptual detection in the primate somatosensory thalamus

The contribution of the sensory thalamus to perception and decision making is not well understood. We addressed this problem by recording single neurons in the ventral posterior lateral (VPL) nucleus of the somatosensory thalamus while trained monkeys judged the presence or absence of a vibrotactile stimulus of variable amplitude applied to the skin of a fingertip. We found that neurons in the VPL nucleus modulated their firing rate as a function of stimulus amplitude, and that such modulations accounted for the monkeys' overall psychophysical performance. These neural responses did not predict the animals' decision reports in individual trials, however. Moreover, the sensitivity to changes in stimulus amplitude was similar when the monkeys' performed the detection task and when they were not required to report stimulus detection. These results suggest that the primate somatosensory thalamus likely provides a reliable neural representation of the sensory input to the cerebral cortex, where sensory information is transformed and combined with other cognitive components associated with behavioral performance.

Ambiguous figures - what happens in the brain when perception changes but not the stimulus

During observation of ambiguous figures our perception reverses spontaneously although the visual information stays unchanged. Research on this phenomenon so far suffered from the difficulty to determine the instant of the endogenous reversals with sufficient temporal precision. A novel experimental paradigm with discontinuous stimulus presentation improved on previous temporal estimates of the reversal event by a factor of three. It revealed that disambiguation of ambiguous visual information takes roughly 50 ms or two loops of recurrent neural activity. Further, the decision about the perceptual outcome has taken place at least 340 ms before the observer is able to indicate the consciously perceived reversal manually. We provide a short review about physiological studies on multistable perception with a focus on electrophysiological data. We further present a new perspective on multistable perception that can easily integrate previous apparently contradicting explanatory approaches. Finally we propose possible extensions toward other research fields where ambiguous figure perception may be useful as an investigative tool.

Predictive Context Influences Perceptual Selection during Binocular Rivalry

Prediction may be a fundamental principle of sensory processing: it has been proposed that the brain continuously generates predictions about forthcoming sensory information. However, little is known about how prediction contributes to the selection of a conscious percept from among competing alternatives. Here, we used binocular rivalry to investigate the effects of prediction on perceptual selection. In binocular rivalry, incompatible images presented to the two eyes result in a perceptual alternation between the images, even though the visual stimuli remain constant. If predictive signals influence the competition between neural representations of rivalrous images, this influence should generate a bias in perceptual selection that depends on predictive context. To manipulate predictive context, we developed a novel binocular rivalry paradigm in which rivalrous test images were immediately preceded by a sequence of context images presented identically to the two eyes. One of the test images was consistent with the preceding image sequence (it was the expected next image in the series), and the other was inconsistent (non-predicted). We found that human observers were more likely to perceive the consistent image at the onset of rivalry, suggesting that predictive context biased selection in favor of the predicted percept. This prediction effect was distinct from the effects of adaptation to stimuli presented before the binocular rivalry test. In addition, perceptual reports were speeded for predicted percepts relative to non-predicted percepts. These results suggest that predictive signals related to visual stimulus history exist at neural sites that can bias conscious perception during binocular rivalry. Our paradigm provides a new way to study how prior information and incoming sensory information combine to generate visual percepts.

Cognitive and perceptual functions of the visual thalamus

The thalamus is classically viewed as passively relaying information to the cortex. However, there is growing evidence that the thalamus actively regulates information transmission to the cortex and between cortical areas using a variety of mechanisms, including the modulation of response magnitude, firing mode, and synchrony of neurons according to behavioral demands. We discuss how the visual thalamus contributes to attention, awareness, and visually guided actions, to present a general role for the thalamus in perception and cognition.

Distinct contributions of the magnocellular and parvocellular visual streams to perceptual selection

During binocular rivalry, conflicting images presented to the two eyes compete for perceptual dominance, but the neural basis of this competition is disputed. In interocular switch rivalry, rival images periodically exchanged between the two eyes generate one of two types of perceptual alternation: (1) a fast, regular alternation between the images that is time-locked to the stimulus switches and has been proposed to arise from competition at lower levels of the visual processing hierarchy or (2) a slow, irregular alternation spanning multiple stimulus switches that has been associated with higher levels of the visual system. The existence of these two types of perceptual alternation has been influential in establishing the view that rivalry may be resolved at multiple hierarchical levels of the visual system. We varied the spatial, temporal, and luminance properties of interocular switch rivalry gratings and found, instead, an association between fast, regular perceptual alternations and processing by the magnocellular stream and between slow, irregular alternations and processing by the parvocellular stream. The magnocellular and parvocellular streams are two early visual pathways that are specialized for the processing of motion and form, respectively. These results provide a new framework for understanding the neural substrates of binocular rivalry that emphasizes the importance of parallel visual processing streams, and not only hierarchical organization, in the perceptual resolution of ambiguities in the visual environment.

Unmixing binocular signals

Incompatible images presented to the two eyes lead to perceptual oscillations in which one image at a time is visible. Early models portrayed this binocular rivalry as involving reciprocal inhibition between monocular representations of images, occurring at an early visual stage prior to binocular mixing. However, psychophysical experiments found conditions where rivalry could also occur at a higher, more abstract level of representation. In those cases, the rivalry was between image representations dissociated from eye-of-origin information, rather than between monocular representations from the two eyes. Moreover, neurophysiological recordings found the strongest rivalry correlate in inferotemporal cortex, a high-level, predominantly binocular visual area involved in object recognition, rather than early visual structures. An unresolved issue is how can the separate identities of the two images be maintained after binocular mixing in order for rivalry to be possible at higher levels? Here we demonstrate that after the two images are mixed, they can be unmixed at any subsequent stage using a physiologically plausible non-linear signal-processing algorithm, non-negative matrix factorization, previously proposed for parsing object parts during object recognition. The possibility that unmixed left and right images can be regenerated at late stages within the visual system provides a mechanism for creating various binocular representations and interactions de novo in different cortical areas for different purposes, rather than inheriting then from early areas. This is a clear example how non-linear algorithms can lead to highly non-intuitive behavior in neural information processing.

Neural and BOLD responses across the brain

Functional Magnetic Resonance Imaging (fMRI) has quickly grown into one of the most important tools for studying brain function, especially in humans. Despite its prevalence, we still do not have a clear picture of what exactly the blood oxygenation level dependent (BOLD) signal represents or how it compares to the signals obtained with other methods (e.g., electrophysiology). We particularly refer to single neuron recordings and electroencephalography when we mention 'electrophysiological methods', given that these methods have been used for more than 50 years, and have formed the basis of much of our current understanding of brain function. Brain function involves the coordinated activity of many different areas and many different cell types that can participate in an enormous variety of processes (neural firing, inhibitory and excitatory synaptic activity, neuromodulation, oscillatory activity, etc.). Of these cells and processes, only a subset is sampled with electrophysiological techniques, and their contribution to the recorded signals is not exactly known. Functional imaging signals are driven by the metabolic needs of the active cells, and are most likely also biased toward certain cell types and certain neural processes, although we know even less about which processes actually drive the hemodynamic response. This article discusses the current status on the interpretation of the BOLD signal and how it relates to neural activity measured with electrophysiological techniques. WIREs Cogn Sci 2012, 3:75-86. doi: 10.1002/wcs.153 For further resources related to this article, please visit the WIREs website.

A dissociation of attention and awareness in phase-sensitive but not phase-insensitive visual channels

The elements most vivid in our conscious awareness are the ones to which we direct our attention. Scientific study confirms the impression of a close bond between selective attention and visual awareness, yet the nature of this association remains elusive. Using visual afterimages as an index, we investigate neural processing of stimuli as they enter awareness and as they become the object of attention. We find evidence of response enhancement accompanying both attention and awareness, both in the phase-sensitive neural channels characteristic of early processing stages and in the phase-insensitive channels typical of higher cortical areas. The effects of attention and awareness on phase-insensitive responses are positively correlated, but in the same experiments, we observe no correlation between the effects on phase-sensitive responses. This indicates independent signatures of attention and awareness in early visual areas yet a convergence of their effects at more advanced processing stages.

Opposing effects of attention and consciousness on afterimages

The brain's ability to handle sensory information is influenced by both selective attention and consciousness. There is no consensus on the exact relationship between these two processes and whether they are distinct. So far, no experiment has simultaneously manipulated both. We carried out a full factorial 2 x 2 study of the simultaneous influences of attention and consciousness (as assayed by visibility) on perception, correcting for possible concurrent changes in attention and consciousness. We investigated the duration of afterimages for all four combinations of high versus low attention and visible versus invisible. We show that selective attention and visual consciousness have opposite effects: paying attention to the grating decreases the duration of its afterimage, whereas consciously seeing the grating increases the afterimage duration. These findings provide clear evidence for distinctive influences of selective attention and consciousness on visual perception.

Gain control in the visual thalamus during perception and cognition

The thalamus has traditionally been thought to passively relay sensory information to the cortex. By showing that responses in visual thalamus are modulated by perceptual and cognitive tasks, recent fMRI and physiology studies have helped revise this view. The modulatory input to the visual thalamus derives from functionally distinct cortical and subcortical feedback pathways. These pathways enable the lateral geniculate nucleus and pulvinar to regulate the information transmitted to cortical areas according to cognitive requirements. Emerging evidence suggests that such regulation involves changing the degree of synchrony between neurons as well as changing the magnitude of thalamic activity. These findings support a role for the thalamus that extends as far as contributing to the control of visual attention and awareness.

Intracortical connections are not required for oscillatory activity in the visual cortex

Synchronized oscillatory discharge in the visual cortex has been proposed to underlie the linking of retinotopically disparate features into perceptually coherent objects. These proposals have largely relied on the premise that the oscillations arise from intracortical circuitry. However, strong oscillations within both the retina and the lateral geniculate nucleus (LGN) have been reported recently. To evaluate the possibility that cortical oscillations arise from peripheral pathways, we have developed two plausible models of single cell oscillatory discharge that specifically exclude intracortical networks. In the first model, cortical oscillatory discharge near 50 Hz in frequency arises from the integration of signals from strongly oscillatory cells within the LGN. The model also predicts the incidence of 50-Hz oscillatory cells within the cortex. Oscillatory discharge around 30 Hz is explained in a second model by the presence of intrinsically oscillatory cells within cortical layer 5. Both models generate spike trains whose power spectra and mean firing rates are in close agreement with experimental observations of simple and complex cells. Considered together, the two models can largely account for the nature and incidence of oscillatory discharge in the cat's visual cortex. The validity of these models is consistent with the possibility that oscillations are generated independently of intracortical interactions. Because these models rely on intrinsic stimulus-independent oscillators within the retina and cortex, the results further suggest that oscillatory activity within the cortex is not necessarily associated with the processing of high-order visual information.

Intracortical connections are not required for oscillatory activity in the visual cortex

arises from the integration of signals from strongly oscillatory cells within the LGN. The model also predicts the incidence of 50-Hz oscillatory cells within the cortex. Oscillatory discharge around 30 Hz is explained in a second model by the presence of intrinsically oscillatory cells within cortical layer 5. Both models generate spike trains whose power spectra and mean firing rates are in close agreement with experimental observations of simple and complex cells. Considered together, the two models can largely account for the nature and incidence of oscillatory discharge in the cat's visual cortex. The validity of these models is consistent with the possibility that oscillations are generated independently of intracortical interactions. Because these models rely on intrinsic stimulus-independent oscillators within the retina and cortex, the results further suggest that oscillatory activity within the cortex is not necessarily associated with the processing of high-order visual information.

Neural activity in the visual thalamus reflects perceptual suppression

To examine the role of the visual thalamus in perception, we recorded neural activity in the lateral geniculate nucleus (LGN) and pulvinar of 2 macaque monkeys during a visual illusion that induced the intermittent perceptual suppression of a bright luminance patch. Neural responses were sorted on the basis of the trial-to-trial visibility of the stimulus, as reported by the animals. We found that neurons in the dorsal and ventral pulvinar, but not the LGN, showed changes in spiking rate according to stimulus visibility. Passive viewing control sessions showed such modulation to be independent of the monkeys' active report. Perceptual suppression was also accompanied by a marked drop in low-frequency power (9-30 Hz) of the local field potential (LFP) throughout the visual thalamus, but this modulation was not observed during passive viewing. Our findings demonstrate that visual responses of pulvinar neurons reflect the perceptual awareness of a stimulus, while those of LGN neurons do not.

fMRI and its interpretations: an illustration on directional selectivity in area V5/MT

fMRI is a tool to study brain function noninvasively that can reliably identify sites of neural involvement for a given task. However, to what extent can fMRI signals be related to measures obtained in electrophysiology? Can the blood-oxygen-level-dependent signal be interpreted as spatially pooled spiking activity? Here we combine knowledge from neurovascular coupling, functional imaging and neurophysiology to discuss whether fMRI has succeeded in demonstrating one of the most established functional properties in the visual brain, namely directional selectivity in the motion-processing region V5/MT+. We also discuss differences of fMRI and electrophysiology in their sensitivity to distinct physiological processes. We conclude that fMRI constitutes a complement, not a poor-resolution substitute, to invasive techniques, and that it deserves interpretations that acknowledge its stand as a separate signal.

Predictive coding explains binocular rivalry: an epistemological review

Binocular rivalry occurs when the eyes are presented with different stimuli and subjective perception alternates between them. Though recent years have seen a number of models of this phenomenon, the mechanisms behind binocular rivalry are still debated and we still lack a principled understanding of why a cognitive system such as the brain should exhibit this striking kind of behaviour. Furthermore, psychophysical and neurophysiological (single cell and imaging) studies of rivalry are not unequivocal and have proven difficult to reconcile within one framework. This review takes an epistemological approach to rivalry that considers the brain as engaged in probabilistic unconscious perceptual inference about the causes of its sensory input. We describe a simple empirical Bayesian framework, implemented with predictive coding, which seems capable of explaining binocular rivalry and reconciling many findings. The core of the explanation is that selection of one stimulus, and subsequent alternation between stimuli in rivalry occur when: (i) there is no single model or hypothesis about the causes in the environment that enjoys both high likelihood and high prior probability and (ii) when one stimulus dominates, the bottom-up, driving signal for that stimulus is explained away while, crucially, the bottom-up signal for the suppressed stimulus is not, and remains as an unexplained but explainable prediction error signal. This induces instability in perceptual dynamics that can give rise to perceptual transitions or alternations during rivalry.

Temporal frequency and contrast tagging bias the type of competition in interocular switch rivalry

The nature of competition underlying perceptual alternations in binocular rivalry remains controversial. Interocular swapping of rivalrous stimuli can result in either slow irregular perceptual alternations that bridge multiple interocular switches or fast regular alternations that are time locked to the stimulus exchanges. We labeled either the inputs to the eyes or the individual rivalrous stimuli using temporal frequency and contrast tagging. Tagging of eye-of-origin signals enhanced the fast regular perceptual alternations associated with eye rivalry, while stimulus tagging shifted perception towards slow irregular alternations characteristic of stimulus rivalry. Thus, the type of competition in binocular rivalry can be biased based on additional cues in the visual inputs. The results are consistent with a model in which the brain combines information across multiple visual features to resolve ambiguities in visual inputs.

Local field potential reflects perceptual suppression in monkey visual cortex

Neurophysiological and functional imaging experiments remain in apparent disagreement on the role played by the earliest stages of the visual cortex in supporting a visual percept. Here, we report electrophysiological findings that shed light on this issue. We monitored neural activity in the visual cortex of monkeys as they reported their perception of a high-contrast visual stimulus that was induced to vanish completely from perception on a subset of trials. We found that the spiking of neurons in cortical areas V1 and V2 was uncorrelated with the perceptual visibility of the target, whereas that in area V4 showed significant perception-related changes. In contrast, power changes in the lower frequency bands (particularly 9-30 Hz) of the local field potential (LFP), collected on the same trials, showed consistent and sustained perceptual modulation in all three areas. In addition, for the gamma frequency range (30-50 Hz), the responses during perceptual suppression of the target were correlated significantly with the responses to its physical removal in all areas, although the modulation magnitude was considerably higher in area V4 than in V1 and V2. These results, taken together, suggest that low-frequency LFP power in early cortical processing is more closely related to the representation of stimulus visibility than is spiking or higher frequency LFP activity.

Neural bases of binocular rivalry

During binocular rivalry, conflicting monocular images compete for access to consciousness in a stochastic, dynamical fashion. Recent human neuroimaging and psychophysical studies suggest that rivalry entails competitive interactions at multiple neural sites, including sites that retain eye-selective information. Rivalry greatly suppresses activity in the ventral pathway and attenuates visual adaptation to form and motion; nonetheless, some information about the suppressed stimulus reaches higher brain areas. Although rivalry depends on low-level inhibitory interactions, high-level excitatory influences promoting perceptual grouping and selective attention can extend the local dominance of a stimulus over space and time. Inhibitory and excitatory circuits considered within a hybrid model might account for the paradoxical properties of binocular rivalry and provide insights into the neural bases of visual awareness itself.

Neuroimaging: Perception at the Brain's Core

Two new functional imaging studies have shown that activity in the lateral geniculate nucleus of the thalamus strongly reflects perceptual dominance during binocular rivalry, raising new questions about how subjective percepts arise in the brain.

Chapter 8 Beyond a relay nucleus: neuroimaging views on the human LGN

The lateral geniculate nucleus (LGN) is the thalamic station in the retinocortical projection and has traditionally been viewed as the gateway for sensory information to enter the cortex. Here, we review recent studies of the human LGN that have investigated the retinotopic organization, physiologic response properties, and modulation of neural activity by selective attention and by visual awareness in a binocular rivalry paradigm. In the retinotopy studies, we found that the contralateral visual field was represented with the lower field in the medial-superior portion and the upper field in the lateral-inferior portion of each LGN. The fovea was represented in posterior and superior portions, with increasing eccentricities represented more anteriorly. Functional MRI responses increased monotonically with stimulus contrast in the LGN and in visual cortical areas. In the LGN, the dynamic response range of the contrast function was larger and contrast gain was lower than in the cortex. In our attention studies, we found that directed attention to a spatial location modulated neural activity in the LGN in several ways: it enhanced neural responses to attended stimuli, attenuated responses to ignored stimuli, and increased baseline activity in the absence of visual stimulation. Furthermore, we showed in a binocular rivalry paradigm that neural activity in the LGN correlated strongly with the subjects' reported percepts. The overall view that emerges from these studies is that the human LGN plays a role in perception and cognition far beyond that of a relay nucleus and, rather, needs to be considered as an early gatekeeper in the control of visual attention and awareness.

Neural correlates of binocular rivalry in the human lateral geniculate nucleus

When dissimilar images are presented to the two eyes, they compete for perceptual dominance so that only one image is visible at a time while the other one is suppressed. Neural correlates of such binocular rivalry have been found at multiple stages of visual processing, including striate and extrastriate visual cortex. However, little is known about the role of subcortical processing during binocular rivalry. Here we used fMRI to measure neural activity in the human LGN while subjects viewed contrast-modulated gratings presented dichoptically. Neural activity in the LGN correlated strongly with the subjects' reported percepts, such that activity increased when a high-contrast grating was perceived and decreased when a low-contrast grating was perceived. Our results provide evidence for a functional role of the LGN in binocular rivalry and suggest that the LGN, traditionally viewed as the gateway to the visual cortex, may be an early gatekeeper of visual awareness.

Eye-specific effects of binocular rivalry in the human lateral geniculate nucleus

When dissimilar images are presented to the two eyes, they compete for perceptual dominance so that each image is visible in turn for a few seconds while the other is suppressed. Such binocular rivalry is associated with relative suppression of local, eye-based representations that can also be modulated by high-level influences such as perceptual grouping. However, it is currently unclear how early in visual processing the suppression of eye-based signals can occur. Here we use high-resolution functional magnetic resonance imaging (fMRI) in conjunction with a new binocular rivalry stimulus to show that signals recorded from the human lateral geniculate nucleus (LGN) exhibit eye-specific suppression during rivalry. Regions of the LGN that show strong eye-preference independently show strongly reduced activity during binocular rivalry when the stimulus presented in their preferred eye is perceptually suppressed. The human LGN is thus the earliest stage of visual processing that reflects eye-specific dominance and suppression.

The neurophysiological time pattern of illusionary visual perceptual transitions: a simultaneous EEG and fMRI study

Several divergent cortical mechanisms generating multistability in visual perception have been suggested. Here, we investigated the neurophysiologic time pattern of multistable perceptual changes by means of a simultaneous recording with electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). Volunteers responded to the subjective perception of a sudden change between stable patterns of illusionary motion (multistable transition) during a stroboscopic paradigm. We found a global deceleration of the EEG frequency prior to a transition and an occipital-accentuated acceleration after a transition, as obtained by low-resolution electromagnetic tomography analysis (LORETA) analysis. A decrease in BOLD response was found in the prefrontal cortex before, and an increase after the transitions was observed in the right anterior insula, the MT/V5 regions and the SMA. The thalamus and left superior temporal gyrus showed a pattern of decrease before and increase after transitions. No such temporal course was found in the control condition. The multimodal approach of data acquisition allows us to argue that the top-down control of illusionary visual perception depends on selective attention, and that a diminution of vigilance reduces selective attention. These are necessary conditions to allow for the occurrence of a perception discontinuity in absence of a physical change of the stimulus.

Both monocular and binocular signals contribute to motion rivalry

There is an ongoing debate on whether binocular rivalry involves competition among monocular cells or binocular cells. We investigated this issue psychophysically with two specially designed test stimuli. One test stimulus contained monocular motion signals but greatly reduced binocular motion signals, while the other contained binocular motion signals but no monocular motion signals. For comparison, we also employed a normal rivalrous control containing both monocular and binocular motion signals, and a non-rivalrous flicker-noise control with neither monocular nor binocular motion signals. We found that binocular rivalry for the two test stimuli was significantly reduced compared with the normal rivalrous control, but not completely eliminated compared with the non-rivalrous control. Therefore, both monocular and binocular motion signals appear to contribute to motion rivalry, suggesting that motion rivalry must involve competition among both monocular and binocular cells.

Non-dominant eye responses in the dorsal lateral geniculate nucleus of the cat: an intracellular study

While binocularity has been established as an important characteristic of cat visual cortical neurons, neurons in the dorsal lateral geniculate nucleus (LGNd) are commonly believed to be monocular. To test whether binocularity exists at the level of the LGNd, postsynaptic potentials (PSPs) of 101 cells were intracellularly recorded in eight normal and eight monocularly deprived cats while presenting stimuli to either the dominant or non-dominant eyes. The results showed that: (1) About 92% of neurons (45 out of 49) responded to a flashing spot presented to the non-dominant eye. In contrast to the dominant eye responses, the non-dominant eye PSPs usually exhibited the same polarization tendency (hyperpolarization or depolarization) to flashing spot stimuli of light increment or decrement, and most of them were inhibitory (hyperpolarization, 35 out of 45, 78%). (2) The response field (RF) of the non-dominant eye overlapped that of the dominant eye. (3) For most binocular cells, peak-to-peak amplitudes of non-dominant eye PSPs were about half the size (46%) of those of the dominant eye. The peak latencies and half-peak latencies of non-dominant eye PSPs were significantly longer than those of the dominant eye (mean differences were 5.4 ms and 5.6 ms respectively). (4) Most of the binocular cells responded well to contrast reversing gratings presented to the non-dominant eye, and the responses were clearly spatial-frequency tuned. No null phase could be found for non-dominant eye PSPs, no matter the neuron was classified as X or Y type according to dominant eye elicited responses. Some of the cells responded well to drifting gratings presented to the non-dominant eye. (5) We also recorded 52 cells in monocularly deprived cats, and found that 49 cells (94%) showed significant responses to flashing spots presented to the non-dominant eye, a similar percentage to that found in normal cats (92%).

CONCLUSION

as strongly monocular neurons, most of LGNd cells could also be driven by the non-dominant eye. The responses evoked by non-dominant eye stimulation differ greatly from those evoked by dominant eye stimulation, and remain intact even without visual experience. These observations suggest an important role of the perigeniculate nucleus in providing binocular inputs to LGNd cells.

Organization of the feedback pathway from striate cortex (V1) to the lateral geniculate nucleus (LGN) in the owl monkey (Aotus trivirgatus)

The function of the corticogeniculate feedback pathway from the striate cortex (V1) to the lateral geniculate nucleus (LGN) in primates is not well understood. Insight into possible function can be gained by studying the morphology and projection patterns of corticogeniculate axons in the LGN. The goal of this research was to examine how corticogeniculate axons innervate the functionally specific (e.g., parvocellular [P], magnocellular [M], and koniocellular [K]) and eye-specific layers of the LGN. Pressure injections of biotinylated dextran were made into owl monkey V1, and the resulting labeled axons were reconstructed through serial sections of the LGN. All of the corticogeniculate axons, regardless of termination pattern, were thin with boutons en passant or at the ends of small stalks, as described in cats. Axons were found in all layers of the LGN, and two main patterns of innervation were observed. In the first pattern, axons terminated in individual M or P LGN layers. In the second pattern of innervation, axons terminated in pairs of functionally matched layers. Examples of this type were seen within pairs of M, P, or K layers. In most cases, both classes of axons contain arbors focused within the P or M layers but also had collateral side branches in neighboring K layers. Unlike corticogeniculate axons seen in the cat, corticogeniculate axons in the owl monkey maintained topographic innervation in the LGN layers that was consistent with receptive field sizes represented in V1. The patterns of layer projections along with the retinotopic match of corticogeniculate axons within the LGN suggest that in primates V1 can modulate activity in the LGN through functionally specific projections in a more tightly tuned retinotopic fashion than previously believed.

MEG alpha activity decrease reflects destabilization of multistable percepts

Multistable stimuli offer the possibility to investigate visual awareness, since they evoke spontaneous alternations between different perceptual interpretations of the same stimulus and, therefore, allow to dissociate perceptual from stimulus-driven mechanisms. In the present study, we used an ambiguous motion paradigm and compared endogenous reversals of perceived motion direction which occur spontaneously during constant ambiguous stimulation with exogenous reversals that were induced externally by changes of stimulation. Contrasting the two conditions allowed to investigate processes that trigger endogenous reversals, since the related activity should be absent in the exogenous reversal condition. We employed ambiguous dot patterns which can easily be transformed to present two stable motion directions in order to induce exogenous pattern reversals. Whole-head MEG was recorded from 10 subjects. We analyzed event-related fields (ERFs) and oscillatory activity in the alpha and gamma ranges. The results showed P300-like slow waves in response to both endogenous and exogenous reversals reflecting the conscious recognition of pattern reversals. Analyses in the gamma-band did not reveal any significant modulations. The alpha activity showed different time courses for endogenous and exogenous reversals. While the exogenous alpha activity decreased in temporal relation to the pattern reversal, the endogenous alpha activity displayed a continuous decrease starting in the time interval preceding the reversal. This time course of the endogenous alpha activity is consistent with a bottom-up approach to figure reversals, since it reflects a process of destabilization of the actual percept until a switch of visual awareness occurs.