Neuronal correlates of subjective visual perception

Encoding of three-dimensional structure-from-motion by primate area MT neurons

We see the world as three-dimensional, but because the retinal image is flat, we must derive the third dimension, depth, from two-dimensional cues. Image movement provides one of the most potent cues for depth. For example, the shadow of a contorted wire appears flat when the wire is stationary, but rotating the wire causes motion in the shadow, which suddenly appears three-dimensional. The neural mechanism of this effect, known as 'structure-from-motion', has not been discovered. Here we study cortical area MT, a primate region that is involved in visual motion perception. Two rhesus monkeys were trained to fixate their gaze while viewing two-dimensional projections of transparent, revolving cylinders. These stimuli appear to be three-dimensional, but the surface order perceived (front as opposed to back) tends to reverse spontaneously. These reversals occur because the stimulus does not specify which surface is in front or at the back. Monkeys reported which surface order they perceived after viewing the stimulus. In many of the neurons tested, there was a reproducible change in activity that coincided with reversals of the perceived surface order, even though the stimulus remained identical. This suggests that area MT has a basic role in structure-from-motion perception.

Adult cortical dynamics

There are many influences on our perception of local features. What we see is not strictly a reflection of the physical characteristics of a scene but instead is highly dependent on the processes by which our brain attempts to interpret the scene. As a result, our percepts are shaped by the context within which local features are presented, by our previous visual experiences, operating over a wide range of time scales, and by our expectation of what is before us. The substrate for these influences is likely to be found in the lateral interactions operating within individual areas of the cerebral cortex and in the feedback from higher to lower order cortical areas. Even at early stages in the visual pathway, cells are far more flexible in their functional properties than previously thought. It had long been assumed that cells in primary visual cortex had fixed properties, passing along the product of a stereotyped operation to the next stage in the visual pathway. Any plasticity dependent on visual experience was thought to be restricted to a period early in the life of the animal, the critical period. Furthermore, the assembly of contours and surfaces into unified percepts was assumed to take place at high levels in the visual pathway, whereas the receptive fields of cells in primary visual cortex represented very small windows on the visual scene. These concepts of spatial integration and plasticity have been radically modified in the past few years. The emerging view is that even at the earliest stages in the cortical processing of visual information, cells are highly mutable in their functional properties and are capable of integrating information over a much larger part of visual space than originally believed.

Neural correlates of visual and motor decision processes

Recent research has clarified and revealed characteristics of perceptual and motor decision processes in the brain. A democracy of sensory neurons discriminate the properties of a stimulus, while competition contrasts the attributes of stimuli across the visual field to locate conspicuous stimuli. Salience and significance are weighed to select an object on which to focus attention and action. Experimentally combining neural and mental chronometry has determined the contribution of perceptual and motor processes to the duration and variability of behavioral reaction time. Whereas perceptual processing occupies a relatively constant amount of time for a given stimulus condition, the processes of mapping particular stimuli onto the appropriate behavior and preparing the motor response provide flexibility but introduce delay and variability in reaction time.

A model of neuronal responses in visual area MT

Electrophysiological studies indicate that neurons in the middle temporal (MT) area of the primate brain are selective for the velocity of visual stimuli. This paper describes a computational model of MT physiology, in which local image velocities are represented via the distribution of MT neuronal responses. The computation is performed in two stages, corresponding to neurons in cortical areas V1 and MT. Each stage computes a weighted linear sum of inputs, followed by rectification and divisive normalization. V1 receptive field weights are designed for orientation and direction selectivity. MT receptive field weights are designed for velocity (both speed and direction) selectivity. The paper includes computational simulations accounting for a wide range of physiological data, and describes experiments that could be used to further test and refine the model.

Metaphors of consciousness and attention in the brain

Scientific metaphors have long provided heuristic tools for approaching novel problems.Today, the neurobiology of consciousness and attention is a central concern, presenting formidable conceptual and empirical challenges. Many current ideas fit the broad theme of a theater metaphor; this idea can be worked out in detail, resulting in relevant, testable hypotheses.

Binocular rivalry and motion perception

In a series of experiments psychophysical techniques were used to study the relation between binocular rivalry and motion perception. An initial series of experiments confirmed that motion enhances the predominance of an eye during rivalry, although the direction of motion does not matter. The presence of an annulus of motion immediately surrounding one eye's rival target greatly enhances dominance of that target, but the influence of the annulus progressively decreases as the separation between disk and annulus increased. Opponent directions of motion in disk and annulus yield greater dominance than when dots in the disk and annulus moved in identical directions. In a second experiment that two eyes were adapted to orthogonal directions of motion, generating strong, distinctively different monocular motion aftereffects (MAEs). Even though the two eyes view physically identical random-motion displays following differential adaptation, binocular rivalry of the discrepant MAEs can occur. Finally, using a stimulus replacement technique to measure detectability of translational and rotational motion, it was found that both types of motion were readily detected during periods of dominance but went undetected during periods of suppression. Taken together, these results bear on the process responsible for rivalry and its neural locus relative to the analysis of different types of motion.

Synchronization of oscillatory responses in visual cortex correlates with perception in interocular rivalry

In subjects suffering from early onset strabismus, signals conveyed by the two eyes are not perceived simultaneously but in alternation. We exploited this phenomenon of interocular suppression to investigate the neuronal correlate of binocular rivalry in primary visual cortex of awake strabismic cats. Monocularly presented stimuli that were readily perceived by the animal evoked synchronized discharges with an oscillatory patterning in the gamma-frequency range. Upon dichoptic stimulation, neurons responding to the stimulus that continued to be perceived increased the synchronicity and the regularity of their oscillatory patterning while the reverse was true for neurons responding to the stimulus that was no longer perceived. These differential changes were not associated with modifications of discharge rate, suggesting that at early stages of visual processing the degree of synchronicity rather than the amplitude of responses determines which signals are perceived and control behavioral responses.

Variable place-cell coupling to a continuously viewed stimulus: evidence that the hippocampus acts as a perceptual system

A key feature of perception is that the interpretation of a single, continuously available stimulus can change from time to time. This aspect of perception is well illustrated by the use of ambiguous figures that can be seen in two different ways. When people view such a stimulus they almost universally describe what they are seeing as jumping between two states. If it is agreed that this perceptual phenomenon is causally linked to the activity of nerve cells, the state jumps would have to occur in conjunction with changes in neural activity somewhere in the nervous system. Our experiments suggest that hippocampal place cells are part of a perceptual system. We conducted variations of a 'cue-card rotation' experiment on rats in which the angular position of a prominent visual stimulus on the wall of cylinder is changed in the rat's presence. The three main results are that (i) place-cell firing fields remain stationary if the cue is rotated by 180 degrees, so the relation between the cue and the field is altered; (ii) firing fields rotate by 45 degrees when the cue is rotated by 45 degrees, so the relation between the field and the card is maintained; and (iii) if the cue is first rotated by 180 degrees and then rotated in a series of 45 degrees steps, the field winds up at a different angular position relative to the card when the card is back in its original position. Thus, place cells can fire in two different ways in response to a continuously viewed stimulus. We conclude that place cells reveal that the hippocampal mapping system also has properties expected of a perceptual system.

Neural networks for consciousness

The paper outlines a three-stage neural network model for (i) the emergence of consciousness at its lowest level of phenomenal experience, (ii) the development of actions on the emerged conscious activity so as to generate higher-order consciousness. In the model, the lower first stage involves modules transforming inputs into various codes. It is only at the second level that further modules are activated in a manner which brings about the emergence of phenomenal awareness. The evidence in support of the initial two-stage model is briefly summarised. The two-stage model is then developed by means of a detailed neural framework which allows analysis of the extended duration of activity in posterior working memory sites.The third stage is then described in terms of known neural structures in the frontal lobes, and the manner they might support the creation of higher consciousness is briefly presented.

Non-Invasive Analysis of Awareness

A program is outlined which indicates in what manner awareness may be probed by the recently developed non-invasive instruments (PET, fMRI, MEG and EEG). The nature of the neural systems needed for the creation of awareness is reviewed, leading to a set of characteristics required for the crucial experiments able to uncover the processes involved. The assessment of experiments possible to probe the emergence of perception is then surveyed in terms of these criteria, and those which appear to be most effective are delineated. Brief conclusions are then drawn as to the viability of the program.

A method for investigating binocular rivalry in real-time with the steady-state VEP

Under conditions in which the visual system cannot reconcile dissimilar images from the two eyes, perception typically alternates between the two half-images-a process known as binocular rivalry. We report a real-time, steady-state VEP method that is a sensitive detector of the continuous alternations in perceptual dominance across the eyes. This method works by labelling each half-image with a slightly different temporal frequency so that the record generated by each can be recovered from the EEG by spectrum analysis. In this way, one can track the "waxing" and "waning" of the VEP amplitudes for each eye simultaneously during spontaneous rivalry, permitting an analysis of the relative physiological dominance of each eye in real-time. Such alternations were clearly observed in the VEP amplitudes generated by each half-image during rivalry (the amplitudes for the two eyes correlated negatively). In contrast, VEP amplitudes for the two eyes varied either synchronously or randomly when the half-images were allowed to fuse. The instances of physiological dominance of each eye as evidenced by the VEP correlated well with the subjects' report of perceptual dominance. This purely electrophysiological method appears to be suitable for measuring rivalry in non-verbal human or animal subjects, as it does not require active participation from them.

Binocular spatial phase tuning characteristics of neurons in the macaque striate cortex

We employed microelectrode recording techniques to study the sensitivity of individual neurons in the striate cortex of anesthetized and paralyzed monkeys to relative interocular image disparities and to determine the effects of basic stimulus parameters on these cortical binocular interactions. The visual stimuli were drifting sine wave gratings. After the optimal stimulus orientation, spatial frequency, and direction of stimulus movement were found, the cells' disparity tuning characteristics were determined by measuring responses as a function of the relative interocular spatial phase of dichoptic grating pairs. No attempts were made to assess absolute position disparities or horizontal disparities relative to the horopter. The majority (approximately 70%) of simple cells were highly sensitive to interocular spatial phase disparities, particularly neurons with balanced ocular dominances. Simple cells typically demonstrated binocular facilitation at the optimal phase disparity and binocular suppression for disparities 180 degrees away. Fewer complex cells were phase selective (approximately 40%); however, the range of disparity selectivity in phase-sensitive complex cells was comparable with that for simple cells. Binocular interactions in non-phase-sensitive complex cells were evidenced by binocular response amplitudes that differed from responses to monocular stimulation. The degree of disparity tuning was independent of a cell's optimal orientation or the degree of direction tuning. However, disparity-sensitive cells tended to have narrow orientation tuning functions and the degree of disparity tuning was greatest for the optimal stimulus orientations. Rotating the stimulus for one eye 90 degrees from the optimal orientation usually eliminated binocular interactions. The effects of phase disparities on the binocular response amplitude were also greatest at the optimal spatial frequency. Thus a cell's sensitivity to absolute position disparities reflects its spatial tuning characteristics, with cells sensitive to high spatial frequencies being capable of signaling very small changes in image disparity. On the other hand, stimulus contrast had relatively little effect on a cell's disparity tuning, because response saturation occurred at the same contrast level for all relative interocular phase disparities. Thus, as with orientation tuning, a cell's optimal disparity and the degree of disparity selectivity were invariant with contrast. Overall, the results show that sensitivity to interocular spatial phase disparities is a common property of striate neurons. A cell's disparity tuning characteristics appear to largely reflect its monocular receptive field properties and the interocular balance between excitatory and inhibitory inputs. However, distinct functional classes of cortical neurons could not be discriminated on the basis of disparity sensitivity alone.

Some essential differences between consciousness and attention, perception, and working memory

When "divided attention" methods were discovered in the 1950s their implications for conscious experience were not widely appreciated. Yet when people process competing streams of sensory input they show both selective processes and clear contrasts between conscious and unconscious events. This paper suggests that the term "attention" may be best applied to the selection and maintenance of conscious contents and distinguished from consciousness itself. This is consistent with common usage. The operational criteria for selective attention, defined in this way, are entirely different from those used to assess consciousness. To illustrate the scientific usefulness of the distinction it is applied to Posner's (1994) brain model of visual attention. It seems that features that are often attributed to attention-like limited capacity-may more accurately be viewed as properties of consciousness.

The role of temporal cortical areas in perceptual organization

The visual areas of the temporal lobe of the primate are thought to be essential for the representation of visual objects. To examine the role of these areas in the visual awareness of a stimulus, we recorded the activity of single neurons in monkeys trained to report their percepts when viewing ambiguous stimuli. Visual ambiguity was induced by presenting incongruent images to the two eyes, a stimulation condition known to instigate binocular rivalry, during which one image is seen at a given time while the other is perceptually suppressed. Previous recordings in areas V1, V2, V4, and MT of monkeys experiencing binocular rivalry showed that only a small proportion of striate and early extrastriate neurons discharge exclusively when the driving stimulus is seen. In contrast, the activity of almost all neurons in the inferior temporal cortex and the visual areas of the cortex of superior temporal sulcus was found to be contingent upon the perceptual dominance of an effective visual stimulus. These areas thus appear to represent a stage of processing beyond the resolution of ambiguities--and thus beyond the processes of perceptual grouping and image segmentation--where neural activity reflects the brain's internal view of objects, rather than the effects of the retinal stimulus on cells encoding simple visual features or shape primitives.

Visual responses of neurons from areas V1 and MT in a monkey with late onset strabismus: a case study

One adult monkey (Macaca fascicularis) was investigated psychophysically and electrophysiologically after at least 5 years of late onset esotropic macrostrabismus (squint angle 52 deg). Behavioural tests revealed normal monocular visual and visuomotor functions. No indications of deep amblyopia or oculomotor asymmetry were found. The monkey used the left or right eye alternately at about equal frequencies. Single unit recordings from area VI disclosed a normal ocular dominance distribution. Most VI neurons from both hemispheres received binocular input. Thus, discordant visual information from corresponding retinal locations of the two eyes converged onto the cortical neurons. No evidence for anomalous retinal correspondence was found. Diplopia and confusion must therefore be avoided by suppression of vision through one eye to allow stable, unambiguous perception. Possible suppression was investigated by stimulating a neuron through the same eye when it was actively used for fixation in one set of trials, and when it was not used for fixation in another set of trials. Significant differences in these two stimulus conditions were found in 20/39 neurons from area VI and in 11/34 motion sensitive neurons recorded in the middle superior temporal area (MT). The normalized population activity in VI and MT was higher if cells were stimulated through the fixating eye. The data are discussed with respect to possible suppressive mechanisms helping to prevent double vision in strabismus and in binocular rivalry.

Can illusory motion disrupt tracking real motion?

When rotating stripes or other periodic stimuli cross the retina at a critical rate, a reversal in the direction of motion of the stimuli is often seen. This illusion of motion perception was used to explore the roles of retinal and perceived motion in the generation of optokinetic nystagmus. Here we show that optokinetic nystagmus is disrupted during the perception of this illusion. Thus, when perceived and actual motion are in conflict, subjects fail to track the veridical movement. This observation suggests that the perception of motion can directly influence optokinetic nystagmus, even in the presence of a moving retinal image. A conflict in the neural representation of motion in different brain areas may explain these findings.

When the brain changes its mind: interocular grouping during binocular rivalry

The prevalent view of binocular rivalry holds that it is a competition between the two eyes mediated by reciprocal inhibition among monocular neurons. This view is largely due to the nature of conventional rivalry-inducing stimuli, which are pairs of dissimilar images with coherent patterns within each eye's image. Is it the eye of origin or the coherency of patterns that determines perceptual alternations between coherent percepts in binocular rivalry? We break the coherency of conventional stimuli and replace them by complementary patchworks of intermingled rivalrous images. Can the brain unscramble the pieces of the patchwork arriving from different eyes to obtain coherent percepts? We find that pattern coherency in itself can drive perceptual alternations, and the patchworks are reassembled into coherent forms by most observers. This result is in agreement with recent neurophysiological and psychophysical evidence demonstrating that there is more to binocular rivalry than mere eye competition.

Visual awareness of objects correlates with activity of right occipital cortex

In the search for human neural correlates of visual awareness, cortical magnetic responses to coherent and meaningful objects were compared with responses to disorganized and meaningless non-objects when observers tried to detect the coherent objects. Three brief stimulus durations were included to vary the detection rate of the objects. Of the multiple brain regions activated, only the right lateral occipital cortex showed signals correlating with the proportion of correct object detections. The results suggest an important role for this area in visual awareness of objects.

Perceptual stability and the selective adaptation of perceived and unperceived motion directions

Adaptation was studied in a paradigm in which the adapting stimulus was a variably biased version of a bistable apparent motion stimulus, a motion quartet, and the post-adaptation test stimulus was a "neutral" motion quartet. Either horizontal or vertical motion was perceived, never both at the same time. When only one of these was perceived during the entire adaptation phase of a trial, and the perceived motion was highly stable, adaptation effects were greater for the perceived than the unperceived motion directions (i.e., adaptation was selective to the perceived motion). However, when the perceived motion during adaptation was relatively unstable (i.e., when the perceived motion was more likely to spontaneously change directions), similar levels of adaptation were obtained for perceived as well as unperceived, but possible motion directions. Thus, adaptation occurs prior to the determination of which of the competing motion directions will be perceived. The relationship between the stability of the adapting percept and the selectivity of adaptation is explained in terms of differences in the activation of mutually inhibitory horizontal and vertical motion detectors.

No binocular rivalry in the LGN of alert macaque monkeys

Orthogonal drifting gratings were presented binocularly to alert macaque monkeys in an attempt to find neural correlates of binocular rivalry. Gratings were centered over lateral geniculate nucleus (LGN) receptive fields and the corresponding points for the opposite eye. The only task of the monkey was to fixate. We found no difference between the responses of LGN neurons under rivalrous and nonrivalrous conditions, as determined by examining the ratios of their respective power spectra. There was, however, a curious "temporal afterimage" effect in which cell responses continued to be modulated at the drift frequency of the grating for several seconds after the grating disappeared.

What is rivalling during binocular rivalry?

When different images are presented to the two eyes, they compete for perceptual dominance, such that one image is visible while the other is suppressed. This binocular rivalry is thought to reflect competition between monocular neurons within the primary visual cortex. However, neurons whose activity correlates with perception during rivalry are found mainly in higher cortical areas, and respond to input from both eyes. Thus rivalry may involve competition between alternative perceptual interpretations at a higher level of analysis. To investigate this, we tested the effect of rapidly alternating the rival stimuli between the two eyes. Under these conditions, the perceptual alternations exhibit the same temporal dynamics as with static patterns, and a single phase of perceptual dominance can span multiple alternations of the stimuli. Thus neural representations of the two stimuli compete for visual awareness independently of the eye through which they reach the higher visual areas. This finding places binocular rivalry in the general category of multistable phenomena, such as ambiguous figures, and provides a new way to study the neural cause and resolution of perceptual ambiguities.

Towards the neuronal correlate of visual awareness

Several encouraging developments towards identifying the neuronal correlate of visual awareness have emerged recently. Increasingly sophisticated behavioral paradigms permit the study of visual awareness in humans as well as in non-human primates. In patients with anatomically restricted lesions in striate and extrastriate cortex, highly informative deficits of visual awareness are observed. Similar deficits can be obtained in normal observers with a novel class of psychophysical displays. Taken together, these results suggest that the contents of visual awareness reflect neuronal activity in certain extrastriate, but not in striate, visual cortical areas.

Components of visual acuity loss in strabismus

Strabismus, the misalignment of the visual axis of one eye relative to that of the other eye, reduces visual acuity in the affected eye. Several processes contributing to that loss are: amblyopia, which results in a chronic acuity loss whether or not the fellow eye is viewing; strabismic deviation, which shifts the image of an acuity target onto more peripheral, and therefore less acute, retina when the fellow eye fixates; interocular suppression and binocular masking, which reduce visibility in the strabismic eye due to neural influences from the other eye. We measured the losses due to these processes in nine small-angle strabismic subjects. Amblyopia reduced acuity by a median of 34% relative to its value in subjects with normal binocular vision, and strabismic deviation produced a loss of 44%. Suppression and masking together reduced acuity by 20%, and therefore had substantially less effect than the other factors.

Activity changes in early visual cortex reflect monkeys' percepts during binocular rivalry

When the two eyes view dissimilar images, we experience binocular rivalry, in which one eye's view dominates for several seconds and is then replaced by that of the other eye. What causes these perceptual changes in the absence of any change in the stimulus? We showed previously that some neurons in monkey cortical area MT show changes in activity during motion rivalry that reflect the perceived direction of motion. To determine whether perception-related modulation of activity occurs in other visual cortical areas, we recorded from individual neurons in V1, V2 and V4 while monkeys reported the perceived orientation of rival gratings of two orthogonal orientations. Many cells, particularly in V4, showed patterns of activity that correlated with the perceptual dominance and suppression of one stimulus. The majority were orientation-selective and could be driven equally well from either eye. It has been previously suggested that binocular rivalry involves reciprocal inhibition between monocular neurons within V1 (for example, see ref. 4), but our results do not support this view; rather, we propose that binocular rivalry arises through interactions between binocular neurons at several levels in the visual pathways, and that similar mechanisms may underlie other multistable perceptual states that occur when viewing ambiguous images.

A relationship between behavioral choice and the visual responses of neurons in macaque MT

We have previously documented the exquisite motion sensitivity of neurons in extrastriate area MT by studying the relationship between their responses and the direction and strength of visual motion signals delivered to their receptive fields. These results suggested that MT neurons might provide the signals supporting behavioral choice in visual discrimination tasks. To approach this question from another direction, we have now studied the relationship between the discharge of MT neurons and behavioral choice, independently of the effects of visual stimulation. We found that trial-to-trial variability in neuronal signals was correlated with the choices the monkey made. Therefore, when a directionally selective neuron in area MT fires more vigorously, the monkey is more likely to make a decision in favor of the preferred direction of the cell. The magnitude of the relationship was modest, on average, but was highly significant across a sample of 299 cells from four monkeys. The relationship was present for all stimuli (including those without a net motion signal), and for all but the weakest responses. The relationship was reduced or eliminated when the demands of the task were changed so that the directional signal carried by the cell was less informative. The relationship was evident within 50 ms of response onset, and persisted throughout the stimulus presentation. On average, neurons that were more sensitive to weak motion signals had a stronger relationship to behavior than those that were less sensitive. These observations are consistent with the idea that neuronal signals in MT are used by the monkey to determine the direction of stimulus motion. The modest relationship between behavioral choice and the discharge of any one neuron, and the prevalence of the relationship across the population, make it likely that signals from many neurons are pooled to form the data on which behavioral choices are based.

Visual perception and phenomenal consciousness

In the (re-)animated debate on consciousness we focus on three questions: Who has consciousness? What is its neuronal basis? What is its function? Regarding the first, we suggest that consciousness is exclusive to living organisms able to distinguish self from non-self. It may be restricted further to organisms who possess a repertoire of overt and covert behaviour which can be voluntarily modified and suppressed. This requires an intermediary neuronal net mediating between sensory input and behavioural output. What are the properties of this net which distinguish unalloyed information processing per se from conscious representation? To tackle this second question, we use the visual system and the functional losses that result from lesions at its different levels, and differentiate a reflexive, a phenomenal, and a consciously accessible stage of visual processing. We suggest that the latter two represent two distinct aspects of consciousness. Blindsight, a neurological example of visual processing in the absence of phenomenal vision, could help to elucidate the neuronal basis of phenomenality, and the special role of striate cortex. Like the patients, our monkeys with unilateral striate cortical removal show evidence not just of residual visual processing, but of the same absence of phenomenal vision, opening routes to further exploring the details of its neuronal implementation. The second aspect, conscious access to presently or previously processed information, is likely to require higher cortical structures, and may depend on the stage of phenomenal representations. In patients with blindsight, both aspects are lost, and it is conceivable that a loss of phenomenality generally causes a loss of conscious accessibility. One important function of phenomenal representations, our third question, would then be to allow conscious retrieval and manipulation of currently processed or formerly stored information, enabling organisms to consciously think and plan.

Blindsight in normal observers

Some patients with lesions in visual cortex lack conscious visual experience but, when tested, exhibit a significant ability, termed 'blindsight', to discriminate visual stimuli. Here we report two different visual displays that induce blindsight in normal observers. Using an objective measure, we show that conscious experience remains defective at presentation times much longer (1 s) than the onset of visual sensitivity (approximately 60 ms). To obtain this effect, we generate a contrast between visual textures and then conceal the contrast by superimposing 'complementary' textures. Complementarity can involve either opposite motion or binocular rivalry and orthogonal orientation. In both cases, observers locate the texture contrast reliably but do not, by either subjective or objective measures, consciously experience it. Taken together with present knowledge of the visual cortical site(s) at which opposite motion and rivalrous orientation interact, this observation bears upon the functional anatomy of conscious visual experience.

Consciousness and the natural method

'Consciousness' is a superordinate term for a heterogeneous array of mental state types. The types share the property of 'being experienced' or 'being experiences'--'of there being something that it is like for the subject to be in one of these states.' I propose that we can only build a theory of consciousness by deploying 'the natural method' of coordinating all relevant informational resources at once, especially phenomenology, cognitive science, neuroscience and evolutionary biology. I'll provide two examples of the natural method in action in mental domains where an adaptationist evolutionary account seems plausible: (i) visual awareness and (ii) conscious event memory. Then I will discuss a case, (iii), dreaming, where I think no adaptationist evolutionary account exists. Beyond whatever interest the particular cases have, the examination will show why I think that a theory of mind, and the role conscious mentation plays in it, will need to be built domain-by-domain with no a priori expectation that there will be a unified account of the causal role or evolutionary history of different domains and competences.

Are we aware of neural activity in primary visual cortex?

It is usually assumed that people are visually aware of at least some of the neuronal activity in the primary visual area, V1, of the neocortex. But the neuroanatomy of the macaque monkey suggests that, although primates may be aware of neural activity in other visual cortical areas, they are not directly aware of that in area V1. There is some psychophysical evidence in humans that supports this hypothesis.

Integration of motion and stereopsis in middle temporal cortical area of macaques

The primate visual system incorporates a highly specialized subsystem for the analysis of motion in the visual field. A key element of this subsystem is the middle temporal (MT) cortical area, which contains a majority of direction-selective neurons. MT neurons are also selective for binocular disparity (depth), which is perplexing given that they are not sensitive to motion through depth. What is the role of disparity in MT? Our data suggest an important link between disparity and transparent motion detection. Motion signals in different directions tend to inhibit each other within a given MT receptive field. This inhibition has an averaging effect which minimizes MT responses to random motion signals created by light intensity changes and other non-motion stimuli (motion noise). But, in the absence of disparity cues, inhibition may also occur between surfaces moving in different directions through the same part of the visual field (transparent motion), thus impairing the detection of either surface. Here we show that inhibition in MT occurs mainly between motion signals with similar disparities. Transparent surface movements at different depths are thus represented independently in MT (that is, without inhibiting each other) whereas spurious motion signals from a given surface tend to cancel out. To our knowledge, these results provide the first evidence for a functional integration of motion and disparity in MT.

Binocular rivalry is not chaotic

Time series of the durations each eye was dominant during binocular rivalry were obtained psychophysically. The oscillations showed an adaptation effect with mean and standard deviations of rivalry dominance durations increasing as a square root function of time over the course of a trial. The data were corrected for this non-stationarity. Dominance durations had a log-normal probability distribution and the autocorrelation function revealed no short term correlations in the time series. In an attempt to distinguish whether the variability of durations was due to a deterministic, low-dimensional chaotic attractor or to a stochastic process, the data were subjected to two tests. The first was calculation of correlation dimensions and the second was nonlinear forecasting of the time series. Both tests included comparisons with randomized 'surrogate data' as controls. In neither case was there a large difference between test results for actual data and surrogate data. We conclude that chaos is not a major factor underlying variability in binocular rivalry.

Visual attention modulates metacontrast masking

How does the human visual system 'bind' different fragments in the visual scene to create enduring representations of objects? A visual illusion known as 'metacontrast' or backward masking provides compelling evidence that perception is not instantaneous and that it occurs sequentially in distinct stages. If a solid white target square is displayed for 50 ms in a tachistoscope, switched off, and followed by a 50 ms display of two flanking mask squares, remarkably, subjects report seeing only the two flanking squares: the first square is simply not 'seen'. By plotting the magnitude of masking as a function of the delay between the target and mask (the stimulus onset asynchrony), one can obtain a characteristic 'U'-shaped function with optimum masking occurring at about 50 ms, and no masking with synchronous target and mask presentations or at delays higher than 300 ms. The illusion is also highly sensitive to elementary stimulus dimensions such as colour, orientation and spatial frequency, and it has been suggested that it is based on 'low level' autonomous visual mechanisms rather than cognitive processes. Here we describe a novel visual stimulus that demonstrates that metacontrast can be strongly modulated by 'top down' influence such as voluntary visual attention.

Interocular suppression in the primary visual cortex: a possible neural basis of binocular rivalry

In an attempt to demonstrate a physiological basis for the alternating suppression of perception when the two eyes view very different contours (binocular rivalry), we studied the responses of neurons in the lateral geniculate nucleus (LGN) and area 17 of cats for drifting gratings of different orientation, spatial frequency and contrast in the two eyes. Almost half of the LGN neurons studied exhibited modest inhibitory interocular interaction, but independent of interocular differences in orientation. Monocularly driven units in layer 4 of area 17 behaved similarly. However, for the majority of binocular cortical cells, the response to a grating of optimal orientation in one eye was suppressed by a grating of very different orientation shown to the other eye, over a wide range of spatial frequency and independent of relative spatial phase. This interocular suppression exhibits a remarkable non-linearity: a grating of non-preferred orientation in one eye causes significant interocular suppression only if the neuron is already responding to an appropriate stimulus in the other eye [Sengpiel and Blakemore (1994) Nature, 368, 847-850]. We propose that the switches in perceptual dominance during binocular rivalry depend on interocular interactions at the level of binocular neurons of the primary visual cortex, which might involve intracortical inhibition between adjacent ocular dominance columns. The spontaneous alternations in perceptual suppression that occur during prolonged viewing of rivalrous patterns remain to be explained, although significant variation in the strength of neuronal suppression in such conditions was occasionally seen.

Defining the neural bases of visual selective attention: conceptual and empirical issues

This paper focuses on conceptual and empirical issues relevant to defining the neural bases of visual selective attention. At the most general level, it is held that the integration of human and monkey research is essential to developing a generally applicable, yet precise, understanding of attentional mechanisms. More specific issues that are considered here include: 1) the general definition of attention (as a process, state, etc.) and the operational definition of attention in experimental work, 2) the possibility that different forms of attention use distinctive neural circuits, 3) the levels of the system at which attention may modulate sensory inflow, 4) the degree to which circuits and levels addressed by attentional modulation depend on task (sensory and behavioral) variables and 5) the nature of cellular processes that may underlie attentional modulation. The available techniques for examining neural processes in humans and monkeys are considered in light of these issues and the need for direct comparability between human and monkey experiments.

Psychophysical evidence for area V2 involvement in the reduction of subjective contour tilt aftereffects by binocular rivalry

Previous research suggests binocular rivalry disrupts extrastriate, but not striate processes, although the locus along the visual pathway at which such disruption first occurs is uncertain. It has been argued that subjective contours arise via a two-stage process in which end-stopped cells feed into orientation-sensitive neurones in V2, and that orientation aftereffects induced with subjective contours are the product of mechanisms similar to those giving rise to real contour aftereffects. If binocular rivalry disrupts the acquisition of subjective contour aftereffects, then it follows from this model that rivalry disrupts processing in V2. Experiments reported here confirm this and provide evidence which suggests binocular rivalry arises through interactions between binocular neurones, rather than via some type of specialized binocular rivalry mechanism.

A new twist on the rotating-trapezoid illusion: evidence for neural-adaptation effects

In a series of experiments, the selective-adaptation paradigm was applied to the rotating-trapezoid illusion in an effort to demonstrate neural-adaptation effects in the figural reversal of this classic illusion. Prior to viewing the standard trapezoid, the observer adapted to a rectangle rotating unambiguously in the same direction as the trapezoid or in the opposite direction. In accordance with the neural hypothesis, illusion strength was greatest when the two figures rotated in the same direction and weakest when the two figures rotated in opposite directions. Results were confirmed with two separate dependent variables: the observer's 'first look' at the illusion after adaptation and the observer's reversal rate during a test period. These findings were discussed in terms of (a) the basic similarity of results for the rotating trapezoid and reversible figures such as the Necker cube and (b) the need for a multiprocess model of both classes of illusions which emphasizes bottom-up and top-down processes.

Visually guided attention is neutralized when informative cues are visible but unperceived

The ability to voluntarily shift the focus of visual attention away from the focus of gaze was investigated in a novel paradigm designed to elaborate the stages of processing underlying this ability. A basic experimental method used to investigate guided visual attention involves measuring response times to targets presented at positions of which the observer has been informed by an orienting cue. Binocular rivalry was utilized to dissociate presentation of the orienting cue from visual awareness of that cue. The findings indicated that when an informative cue was presented to an eye during the dominance phase, thus reaching visual awareness, manual response times were significantly affected by cue validity. In contrast, when the same cue was presented to an eye during suppression, and thus was not seen by observers, response times were not influenced by cue validity. We conclude that to guide attention, neural signals registering informative visual cues must be processed at stages lying beyond the site of rivalry suppression. Implications for investigating the neural basis of visual attention are discussed.

Reduction of a pattern-induced motion aftereffect by binocular rivalry suggests the involvement of extrastriate mechanisms

Previous research suggests that plaid-induced motion aftereffects (MAEs) involve extrastriate mechanisms (Wenderoth et al., 1988). There is evidence also that binocular rivalry occurs beyond V1 and that it disrupts the processing of MAEs which are believed to be based upon extrastriate mechanisms (e.g. the spiral MAE) but not MAEs, such as linear MAE induced by a drifting grating, which are thought to arise in striate cortex (Wiesenfelder & Blake, 1990). The logical inference is that binocular rivalry during drifting plaid-induced adaptation should reduce the MAEs which result. We report experiments which confirm this prediction.

Monocularly induced 2-deoxyglucose patterns in the visual cortex and lateral geniculate nucleus of the cat: II. Awake animals and strabismic animals

In the course of experiments studying the organization of ocular dominance columns in the visual cortex of cats, we noticed that--contrary to common belief--labelling with 2-deoxyglucose after monocular stimulation failed to induce a pattern of ocular dominance columns but resulted in a rather homogenous 2-deoxyglucose uptake throughout area 17 in anaesthetized and paralysed animals. We wondered whether 2-deoxyglucose columns could be obtained in awake animals and/or in strabismic animals, which have a more pronounced segregation of ocular dominance columns. To this end, we investigated 2-deoxyglucose patterns after monocular stimulation in three groups of animals: (i) in awake normally reared cats, (ii) in awake strabismic cats and (iii) in anaesthetized and paralysed strabismic cats. Additionally, we labelled ocular dominance columns with intraocular [3H]proline injections. In all cats, monocular stimulation induced 2-deoxyglucose patterns that were in precise register with the proline-labelled ocular dominance columns in layer IV. Regions of increased 2-deoxyglucose uptake extended in a columnar fashion through all cortical layers. In contrast to normally reared animals, in strabismic cats, the expression of 2-deoxyglucose labelled ocular dominance columns was not abolished by anaesthesia or paralysis. However, there was a difference between the 2-deoxyglucose patterns in the awake normally reared cats and the strabismic animals. In the former, the patches of 2-deoxyglucose labelling were smaller and occupied less territory than the afferents of the stimulated eye in layer IV. Together with the results of the previous study, these data indicate that in awake normally reared and in awake and anaesthetized strabismic cats, but not in anaesthetized and paralysed normally reared animals, monocular stimulation activates selectively neurons in columns that are in register with the termination sites of afferents from the stimulated eye. This suggests the existence of a mechanism in normally reared animals which restricts cortical activation after monocular stimulation to territories that are in register with the afferents from the stimulated eye. This mechanism appears to be effective only when the animals are awake and actively exploring their environment. This and the fact that the active columns were narrower than the terminal fields of the stimulated eye suggest an active inhibitory process, perhaps related to mechanisms of selective attention. The observation that ocular dominance columns persist in strabismic cats even under anaesthesia can be accounted for by the lack of binocular convergence in these animals.

The visual system and levels of perception: properties of neuromental organization

To see whether the mental and the neural have common attributes that could resolve some of the traditional dichotomies, we review neuroscientific data on the visual system. The results show that neuronal and perceptual function share a parallel and hierarchical architecture which is manifest not only in the anatomy and physiology of the visual system, but also in normal perception and in the deficits caused by lesions in different parts of the system. Based on the description of parallel hierarchical levels of active information processing in the visual brain, we suggest a concept of dissociable levels of perception, advocating that the phenomenal perception and recognition is realized in the functional integrity of a network of reciprocal cortico-cortical connections. The properties shared by neuronal and perceptional functions provide a basis for a neuromental monism in which both functions are attributed a causal role.

Binocular rivalry suppression disrupts recovery from motion adaptation

The motion aftereffect (MAE) lasts longer when the test period does not immediately follow adaptation, a phenomenon called storage. Does storage of the MAE occur if the test target is present but rendered phenomenally invisible owing to the presence of a rival target presented to the other eye during the storage period? Our experiment addressed this question. Following adaptation to a drifting grating, an intervening period preceded testing with a stationary grating. During this period, the adapted eye either viewed the test target immediately or was occluded, and the unadapted eye either viewed a high-contrast rival target or was occluded. Thus four conditions were employed. The duration of the residual MAE was found to be longer for the rivalry condition (grating and rival target viewed) than for the normal MAE condition (grating viewed), and comparable to that in the stored MAE condition (both eyes occluded). Thus, the MAE is stored when the test target is rendered invisible due to binocular rivalry, indicating that a suppressed target is ineffective at promoting decay of the MAE. So while suppression does not prevent information about the adapting grating from reaching the site of generation of the MAE (Lehmkuhle & Fox, 1975), it can prevent information about the test target from reaching the site of the stored MAE. Current models attribute the MAE to reduced responsiveness of direction-selective cortical neurons (Sutherland, 1961; Barlow & Hill, 1963). Thus, storage should reflect a differential return of these adapted cells to preadapted response levels, dependent on postadaptation stimulation.(ABSTRACT TRUNCATED AT 250 WORDS)

The neurobiology of blindsight

Some patients can respond to visual stimuli presented within their clinically absolute visual field defects that have been caused by partial destruction of striate cortex. This puzzling phenomenon of looking, pointing, detecting and discriminating without seeing has been called blindsight, and has fascinated philosophers and neuroscientists alike as a spotlight on the nature of unconscious or covert awareness, and the means it provides of studying the visual information carried by pathways other than the major route through the striate cortex.

Corticothalamic connections of the superior temporal sulcus in rhesus monkeys

The corticothalamic connections of the superior temporal sulcus (STS) were studied by means of the autoradiographic technique. The results indicate that corticothalamic connections of the STS in general reciprocate thalamocortical connections. The cortex of the upper bank of the STS-multimodal areas TPO and PGa-projects to four major thalamic targets: the pulvinar complex, the mediodorsal nucleus, the limitans-suprageniculate nucleus, as well as intralaminar nuclei. Within the pulvinar complex, the main projections of the upper bank of the STS are directed to the medial pulvinar (PM) nucleus. Rostral upper bank regions tend to project caudally and medially within the PM nucleus, caudal upper bank regions, more laterally and ventrally. The mid-portion of the upper bank tends to occupy the central sector of the PM nucleus. There are also relatively minor projections from upper bank regions to the lateral pulvinar (PL) and oral pulvinar (PO) nuclei. In contrast to the upper bank, the projections from the lower bank are directed primarily to the pulvinar complex, with only minor projections to intralaminar nuclei. The rostral portion of the lower bank projects mainly to caudal and medial regions of the PM nucleus, whereas the caudal lower bank projects predominantly to the lateral PM nucleus, and also to the PL, PO, and inferior pulvinar (PI) nuclei. The mid-portion of the lower bank projects mainly to central and lateral portions of the PM nucleus, and also to the PI and PL nuclei. The rostral depth of the STS projects mainly to the PM nucleus, with only minor connections to the PO, PI, and PL nuclei. The mid-portion of multimodal area TPO of the upper bank, areas TPO2 and TPO3, projects preferentially to the central sector of the PM nucleus. It is possible that this STS-thalamic connectivity has a role in behavior that is dependent upon more than one sensory modality.

Apparent motion can survive binocular rivalry suppression

For short-range motion, observers dichoptically viewed a random-dot cinematogram and a rival target. Upon keypress, the first frame of the cinematogram was replaced by the second frame. Observers judged the direction of motion, which was governed by the initial position of the central region. Performance was well above chance during both dominance and suppression. For long-range motion, observers rated the motion produced by sequentially flashing two small spots, with the first spot contained within a rivalrous region. Suppression reduced but did not prevent perception of this motion. Presenting the second motion frame to both eyes weakened both forms of motion.