Towards the neuronal correlate of visual awareness

Quantized visual awareness

The proposed model holds that, at its most fundamental level, visual awareness is quantized. That is to say that visual awareness arises as individual bits of awareness through the action of neural circuits with hundreds to thousands of neurons in at least the human striate cortex. Circuits with specific topologies will reproducibly result in visual awareness that correspond to basic aspects of vision like color, motion, and depth. These quanta of awareness (qualia) are produced by the feedforward sweep that occurs through the geniculocortical pathway but are not integrated into a conscious experience until recurrent processing from centers like V4 or V5 select the appropriate qualia being produced in V1 to create a percept. The model proposed here has the potential to shift the focus of the search for visual awareness to the level of microcircuits and these likely exist across the kingdom Animalia. Thus establishing qualia as the fundamental nature of visual awareness will not only provide a deeper understanding of awareness, but also allow for a more quantitative understanding of the evolution of visual awareness throughout the animal kingdom.

The psychophysics of brain rhythms

It is becoming increasingly apparent that brain oscillations in various frequency bands play important roles in perceptual and attentional processes. Understandably, most of the associated experimental evidence comes from human or animal electrophysiological studies, allowing direct access to the oscillatory activities. However, such periodicities in perception and attention should, in theory, also be observable using the proper psychophysical tools. Here, we review a number of psychophysical techniques that have been used by us and other authors, in successful and sometimes unsuccessful attempts, to reveal the rhythmic nature of perceptual and attentional processes. We argue that the two existing and largely distinct debates about discrete vs. continuous perception and parallel vs. sequential attention should in fact be regarded as two facets of the same question: how do brain rhythms shape the psychological operations of perception and attention?

Intercepting the First Pass: Rapid Categorization is Suppressed for Unseen Stimuli

The operations and processes that the human brain employs to achieve fast visual categorization remain a matter of debate. A first issue concerns the timing and place of rapid visual categorization and to what extent it can be performed with an early feed-forward pass of information through the visual system. A second issue involves the categorization of stimuli that do not reach visual awareness. There is disagreement over the degree to which these stimuli activate the same early mechanisms as stimuli that are consciously perceived. We employed continuous flash suppression (CFS), EEG recordings, and machine learning techniques to study visual categorization of seen and unseen stimuli. Our classifiers were able to predict from the EEG recordings the category of stimuli on seen trials but not on unseen trials. Rapid categorization of conscious images could be detected around 100 ms on the occipital electrodes, consistent with a fast, feed-forward mechanism of target detection. For the invisible stimuli, however, CFS eliminated all traces of early processing. Our results support the idea of a fast mechanism of categorization and suggest that this early categorization process plays an important role in later, more subtle categorizations, and perceptual processes.

Neural Correlates of Cross-modally Induced Changes in Tactile Awareness

When a single tactile stimulus is presented together with two tones, participants often report perceiving two touches. It is a matter of debate whether this cross-modal effect of audition on touch reflects the interplay between modalities at early perceptual or at later processing stages, and which brain processes determine what in the end is consciously perceived. Event-related brain potentials (ERPs) were recorded while rare single tactile stimuli accompanied by two tones (1T2A) were presented among frequent tactile double stimuli accompanied by two tones (2T2A). Although participants were instructed to ignore the tones and to respond to single tactile stimuli only, they often failed to respond to 1T2A stimuli (“illusory double touches,” 1T2A(i)). ERPs to “illusory double touches” versus “real double touches” (2T2A) differed 50 msec after the (missing) second touch. This suggests that at an early sensory stage, illusory and real touches are processed differently. On the other hand, although similar stimuli elicited a tactile mismatch negativity (MMN) between 100 and 200 msec in a unisensory tactile experiment, no MMN was observed for the 1T2A(i) stimuli in the multisensory experiment. “Tactile awareness” was associated with a negativity at 250 msec, which was enhanced in response to correctly identified deviants as compared to physically identical deviants that elicited an illusion. Thus, auditory stimuli seem to alter neural mechanisms associated with automatic tactile deviant detection. The present findings contribute to the debate of which processing step in the brain determines what is consciously perceived.

Preserved implicit form perception and orientation adaptation in visual form agnosia

Visual form agnosia is mainly characterized by profound deficits in visual form and shape discrimination. Previous studies have shown that patients retain the capacity for coordinated motor behaviors, color naming and implicit letter perception. However, it is unknown to what extent other visual functions, such as implicit form and orientation perception, are preserved. To address these questions, we investigated a single visual form agnosic patient, X.F., in two distinct experiments. X.F.'s visual lesions were mainly localized in the bilateral occipitotemporal cortex, with the dorsal visual stream and early visual cortex largely spared. In Experiment 1, X.F. named the color of different forms across 12 blocks of trials. After the first six blocks, the combinations of a form with its color were changed and the new combination was presented for the remaining six blocks. X.F.'s reaction time increased during the switch block and was significantly greater than the overall RT changes between adjacent, non-switch blocks. This indicates that X.F. retained the ability to perceive changes in form despite her inability to discriminate the forms. In Experiment 2, X.F. showed selective orientation adaptation effects to different spatial frequencies; that is, her contrast threshold was significantly higher when the adapting and test orientations were the same than when they were orthogonal, although her orientation discrimination performance was severely impaired. These data provide evidence of a functional dissociation between explicit and implicit visual abilities, and suggest that the residual early visual cortex mediates form and orientation processing in the absence of awareness.

Grasp effects of the Ebbinghaus illusion: obstacle avoidance is not the explanation

The perception-versus-action hypothesis states that visual information is processed in two different streams, one for visual awareness (or perception) and one for motor performance. Previous reports that the Ebbinghaus illusion deceives perception but not grasping seemed to indicate that this dichotomy between perception and action was fundamental enough to be reflected in the overt behavior of non-neurological, healthy humans. Contrary to this view we show that the Ebbinghaus illusion affects grasping to the same extent as perception. We also show that the grasp effects cannot be accounted for by non-perceptual obstacle avoidance mechanisms as has recently been suggested. Instead, even subtle variations of the Ebbinghaus illusion affect grasping in the same way as they affect perception. Our results suggest that the same signals are responsible for the perceptual effects and for the motor effects of the Ebbinghaus illusion. This casts doubt on one line of evidence, which used to strongly favor the perception-versus-action hypothesis.

The time course of visual processing: from early perception to decision-making

Experiments investigating the mechanisms involved in visual processing often fail to separate low-level encoding mechanisms from higher-level behaviorally relevant ones. Using an alternating dual-task event-related potential (ERP) experimental paradigm (animals or vehicles categorization) where targets of one task are intermixed among distractors of the other, we show that visual categorization of a natural scene involves different mechanisms with different time courses: a perceptual, task-independent mechanism, followed by a task-related, category-independent process. Although average ERP responses reflect the visual category of the stimulus shortly after visual processing has begun (e.g. 75-80 msec), this difference is not correlated with the subject's behavior until 150 msec poststimulus.

Blindsight: the role of feedforward and feedback corticocortical connections

When human subjects suffer from a lesion to the primary visual cortex, they lose all visual percepts in the region of space that corresponds to the site of the lesion. However, they are still capable of responding to stimuli in this region when asked to 'guess' or to execute forced-choice motor commands related to these stimuli. This phenomenon, termed blindsight, is still only partly understood. Here, the possible roles of feedforward and feedback corticocortical connections in the visual brain in the understanding of blindsight are reviewed. What emerges is substantial evidence in favor of the theory that unconscious visuo-motor transformations, as in blindsight, may be executed in an entirely feedforward processing cycle, while visual awareness is critically dependent on feedback connections to the primary visual cortex.

Behavioural and Neural Correlates of Mental Imagery in Sheep Using Face Recognition Paradigms

Determining objective measures for proof of consciousness in non-human animals has been helped by improved understanding of neural correlates of human consciousness. Functional imaging and neuropsychological studies have shown remarkable overlap between structures involved in actual perception of social and non-social objects and those involved in forming mental images of them. One area of particular interest is individual face recognition. This involves regions of the temporal lobe that are mainly only activated by actual perception or mental imagery of faces. Using behavioural, neuroanatomical and neurophysiological approaches in sheep, we have found that they have similar specialized abilities for recognizing many individuals from their faces. They have developed the same specialized neural processing regions in the temporal lobe for aiding such recognition. Furthermore, parallel activation of other brain regions controlling behavioural and emotional responses only occurs when they are overtly interested in the individuals whose faces they perceive. Such interest might therefore equate to their becoming consciously aware of them. Preliminary experiments have indicated that sheep may form and use mental images and that the regions of the temporal lobe that respond to faces can also do so under conditions where faces are suggested but do not actually appear. Such similarities between humans and sheep in this form of social recognition make it difficult to claim that humans can form mental images of faces whereas sheep cannot. While the ability to form and use mental imagery is not in itself definitive proof of consciousness, it is an important component part.

A neurofunctional theory of visual consciousness

This paper develops an empirically motivated theory of visual consciousness. It begins by outlining neuropsychological support for Jackendoff's (1987) hypothesis that visual consciousness involves mental representations at an intermediate level of processing. It then supplements that hypothesis with the further requirement that attention, which can come under the direction of high level representations, is also necessary for consciousness. The resulting theory is shown to have a number of philosophical consequences. If correct, higher-order thought accounts, the multiple drafts account, and the widely held belief that sensation precedes perception will all be found wanting. The theory will also be used to illustrate and defend a methodology that fills the gulf between functionalists who ignore the brain and neural reductionists who repudiate functionalism.

The detection of visual signals by macaque frontal eye field during masking

The neural link between a sensory signal and its behavioral report was investigated in macaques trained to locate an intermittently detectable visual target. Neurons in the frontal eye field, an area involved in converting the outcome of visual processing into motor commands, responded at short latencies to the target stimulus whether or not the monkey reported its presence. Neural activity immediately preceding the visual response to the mask was significantly greater on hits than on misses, and was significantly greater on false alarms than on correct rejections. The results show that visual signals masked by light are not filtered out at early stages of visual processing; furthermore, the magnitude of early visual responses in prefrontal cortex predicts the behavioral report.

The neural generation of a unified illusion in human vision

The neural mechanisms of visual binding in humans were investigated by measuring the brain's high-frequency electric responses (36-44 Hz) to the subjective visual perception of a unified three-dimensional illusion. 40 Hz synchronization was found over occipital and right parieto-temporal areas 500-300 ms before visual awareness of the three-dimensional Gestalt was reported, but not during the viewing of the illusion. At lower frequency bands (8-13 Hz and 13-20 Hz) no corresponding synchronization was found. 40 Hz synchronization thus directly correlates with the construction and emergence of a unified visual percept and may reflect the rapid formation of transient functional connections between spatially separated cortical areas.

Event-related brain potential correlates of two states of conscious awareness in memory

We report an event-related potential (ERP) experiment of human recognition memory that explored the relation between conscious awareness and electrophysiological activity of the brain. We recorded ERPs from healthy adults while they made "remember" and "know" recognition judgments about previously seen words. These two kinds of judgments reflect "autonoetic" and "noetic" awareness, respectively. The ERP effects differed between the two kinds of awareness while they were similar for "true" and "false" recognition. Noetic awareness was associated with a temporoparietal positivity in the N400 range (325-600 ms) and a late (600-1,000 ms) frontocentral negativity, whereas autonoetic awareness was associated with a widespread, late, bifrontal and left parietotemporal (600-1000 ms) positivity. In the very late (1,300-1, 900 ms) time window, a right frontal positivity was observed for both remember and know judgments of both true and false targets. These results provide physiological evidence for two types of conscious awareness in episodic memory retrieval.

Visual awareness of objects correlates with activity of right occipital cortex

In the search for human neural correlates of visual awareness, cortical magnetic responses to coherent and meaningful objects were compared with responses to disorganized and meaningless non-objects when observers tried to detect the coherent objects. Three brief stimulus durations were included to vary the detection rate of the objects. Of the multiple brain regions activated, only the right lateral occipital cortex showed signals correlating with the proportion of correct object detections. The results suggest an important role for this area in visual awareness of objects.