Cortical interactions in vision and awareness: hierarchies in reverse

Suppression of top-down influence decreases both behavioral and V1 neuronal response sensitivity to stimulus orientations in cats

How top-down influence affects behavioral detection of visual signals and neuronal response sensitivity in the primary visual cortex (V1) remains poorly understood. This study examined both behavioral performance in stimulus orientation identification and neuronal response sensitivity to stimulus orientations in the V1 of cat before and after top-down influence of area 7 (A7) was modulated by non-invasive transcranial direct current stimulation (tDCS). Our results showed that cathode (c) but not sham (s) tDCS in A7 significantly increased the behavioral threshold in identifying stimulus orientation difference, which effect recovered after the tDCS effect vanished. Consistently, c-tDCS but not s-tDCS in A7 significantly decreased the response selectivity bias of V1 neurons for stimulus orientations, which effect could recover after withdrawal of the tDCS effect. Further analysis showed that c-tDCS induced reduction of V1 neurons in response selectivity was not resulted from alterations of neuronal preferred orientation, nor of spontaneous activity. Instead, c-tDCS in A7 significantly lowered the visually-evoked response, especially the maximum response of V1 neurons, which caused a decrease in response selectivity and signal-to-noise ratio. By contrast, s-tDCS exerted no significant effect on the responses of V1 neurons. These results indicate that top-down influence of A7 may enhance behavioral identification of stimulus orientations by increasing neuronal visually-evoked response and response selectivity in the V1.

Effects of top-down influence suppression on behavioral and V1 neuronal contrast sensitivity functions in cats

To explore the relative contributions of higher-order and primary visual cortex (V1) to visual perception, we compared cats' behavioral and V1 neuronal contrast sensitivity functions (CSF) and threshold versus external noise contrast (TvC) functions before and after top-down influence of area 7 (A7) was modulated with transcranial direct current stimulation (tDCS). We found that suppressing top-down influence of A7 with cathode-tDCS, but not sham-tDCS, reduced behavioral and neuronal contrast sensitivity in the same range of spatial frequencies and increased behavioral and neuronal contrast thresholds in the same range of external noise levels. The neuronal CSF and TvC functions were highly correlated with their behavioral counterparts both before and after the top-down suppression. Analysis of TvC functions using the Perceptual Template Model (PTM) indicated that top-down influence of A7 increased both behavioral and V1 neuronal contrast sensitivity by reducing internal additive noise and the impact of external noise.

•

Top-down suppression lowers both behavioral and V1 neuronal CSF functions

•

Top-down suppression raises both behavioral and V1 neuronal TvC functions

•

The neuronal CSFs and TvCs are highly correlated with their behavioral counterparts

•

Top-down influence lowers internal additive noise and impact of external noise in V1

Characterization of Feedback Neurons in the High-Level Visual Cortical Areas That Project Directly to the Primary Visual Cortex in the Cat

Previous studies indicate that top-down influence plays a critical role in visual information processing and perceptual detection. However, the substrate that carries top-down influence remains poorly understood. Using a combined technique of retrograde neuronal tracing and immunofluorescent double labeling, we characterized the distribution and cell type of feedback neurons in cat's high-level visual cortical areas that send direct connections to the primary visual cortex (V1: area 17). Our results showed: (1) the high-level visual cortex of area 21a at the ventral stream and PMLS area at the dorsal stream have a similar proportion of feedback neurons back projecting to the V1 area, (2) the distribution of feedback neurons in the higher-order visual area 21a and PMLS was significantly denser than in the intermediate visual cortex of area 19 and 18, (3) feedback neurons in all observed high-level visual cortex were found in layer II-III, IV, V, and VI, with a higher proportion in layer II-III, V, and VI than in layer IV, and (4) most feedback neurons were CaMKII-positive excitatory neurons, and few of them were identified as inhibitory GABAergic neurons. These results may argue against the segregation of ventral and dorsal streams during visual information processing, and support "reverse hierarchy theory" or interactive model proposing that recurrent connections between V1 and higher-order visual areas constitute the functional circuits that mediate visual perception. Also, the corticocortical feedback neurons from high-level visual cortical areas to the V1 area are mostly excitatory in nature.

Computing an Average When Part of the Population Is Not Perceived

The syndrome of unilateral spatial neglect (USN) after right-hemisphere damage is characterized by failure of salient left-sided stimuli to activate an orienting response, attract attention, and gain access to conscious awareness. The explicit failure processing left-sided visual information is not uniform, however, and patients seem to be more successful performing certain visual tasks than others. The source of this difference is still not clear. We focus on processing of visual scene statistical properties, asking whether, in computing the average size of an array of objects, USN patients give appropriate weight to objects on the left; disregard left-side objects entirely; or assign them an intermediate, lower weight, in accord with their tendency to neglect these objects. The interest in testing this question stems from a series of studies in healthy individuals that led Chong and Treisman [Chong, S. C., & Treisman, A. Statistical processing: Computing the average size in perceptual groups. Vision Research, 45, 891–900, 2005a; Chong, S. C., & Treisman, A. Attentional spread in the statistical processing of visual displays. Perception & Psychophysics, 67, 1–13, 2005b] to propose that processing of statistical properties (like the average size of visual scene elements) is carried out in parallel, with no need for serial allocation of focal attention to the different scene elements. Our results corroborate this suggestion, showing that objects in the left (“neglected”) hemispace contribute to average size computation, despite a marked imbalance in spatial distribution of attention, which leads to a reduced weight of left-side elements in the averaging computation. This finding sheds light on the nature of the impairment in USN and on basic mechanisms underlying statistical processing in vision. We confirm that statistical processing depends mainly on spread-attention mechanisms, which are largely spared in USN.

Why is "blindsight" blind? A new perspective on primary visual cortex, recurrent activity and visual awareness

The neuropsychological phenomenon of blindsight has been taken to suggest that the primary visual cortex (V1) plays a unique role in visual awareness, and that extrastriate activation needs to be fed back to V1 in order for the content of that activation to be consciously perceived. The aim of this review is to evaluate this theoretical framework and to revisit its key tenets. Firstly, is blindsight truly a dissociation of awareness and visual detection? Secondly, is there sufficient evidence to rule out the possibility that the loss of awareness resulting from a V1 lesion simply reflects reduced extrastriate responsiveness, rather than a unique role of V1 in conscious experience? Evaluation of these arguments and the empirical evidence leads to the conclusion that the loss of phenomenal awareness in blindsight may not be due to feedback activity in V1 being the hallmark awareness. On the basis of existing literature, an alternative explanation of blindsight is proposed. In this view, visual awareness is a "global" cognitive function as its hallmark is the availability of information to a large number of perceptual and cognitive systems; this requires inter-areal long-range synchronous oscillatory activity. For these oscillations to arise, a specific temporal profile of neuronal activity is required, which is established through recurrent feedback activity involving V1 and the extrastriate cortex. When V1 is lesioned, the loss of recurrent activity prevents inter-areal networks on the basis of oscillatory activity. However, as limited amount of input can reach extrastriate cortex and some extrastriate neuronal selectivity is preserved, computations involving comparison of neural firing rates within a cortical area remain possible. This enables "local" read-out from specific brain regions, allowing for the detection and discrimination of basic visual attributes. Thus blindsight is blind due to lack of "global" long-range synchrony, and it functions via "local" neural readout from extrastriate areas.

Critical time course of right frontoparietal involvement in mental number space

Neuropsychological, neurophysiological, and neuroimaging studies suggest that right frontoparietal circuits may be necessary for the processing of mental number space, also known as the mental number line (MNL). Here we sought to specify the critical time course of three nodes that have previously been related to MNL processing: right posterior parietal cortex (rPPC), right FEF (rFEF), and right inferior frontal gyrus (rIFG). The effects of single-pulse TMS delivered at 120% distance-adjusted individual motor threshold were investigated in 21 participants, within a window of 0-400 msec (sampling interval = 33 msec) from the onset of a central digit (1-9, 5 excluded). Pulses were delivered in a random order and with equal probability at each time point, intermixed with noTMS trials. To analyze whether and when TMS interfered with MNL processing, we fitted bimodal Gaussian functions to the observed data and measured effects on changes in the Spatial-Numerical Association of Response Codes (SNARC) effect (i.e., an advantage for left- over right-key responses to small numbers and right- over left-key responses to large numbers) and in overall performance efficiency. We found that, during magnitude judgment with unimanual key-press responses, TMS reduced the SNARC effect in the earlier period of the fitted functions (∼25-60 msec) when delivered over rFEF (small and large numbers) and rIFG (small numbers); TMS further reduced the SNARC effect for small numbers in a later period when delivered to rFEF (∼200 msec). In contrast, TMS of rPPC did not interfere with the SNARC effect but generally reduced performance for small numbers and enhanced it for large numbers, thus producing a pattern reminiscent of "neglect" in mental number space. Our results confirm the causal role of an intact right frontoparietal network in the processing of mental number space. They also indicate that rPPC is specifically tied to explicit number magnitude processing and that rFEF and rIFG contribute to interfacing mental visuospatial codes with lateralized response codes. Overall, our findings suggest that both ventral and dorsal frontoparietal circuits are causally involved and functionally connected in the mapping of numbers to space.

Conscious awareness is necessary for processing race and gender information from faces

Previous studies suggested that emotions can be correctly interpreted from facial expressions in the absence of conscious awareness of the face. Our goal was to explore whether subordinate information about a face's gender and race could also become available without awareness of the face. Participants classified the race or the gender of unfamiliar faces that were ambiguous with regard to these dimensions. The ambiguous faces were preceded by face-images that unequivocally represented gender and race, rendered consciously invisible by simultaneous continuous-flash-suppression. The classification of ambiguous faces was biased away from the category of the adaptor only when it was consciously visible. The duration of subjective visibility correlated with the aftereffect strength. Moreover, face identity was consequential only if consciously perceived. These results suggest that while conscious awareness is not needed for basic level categorization, it is needed for subordinate categorization. Emotional information might be unique in this respect.

Temporal dissociation of global and local features by hierarchy of vision

Most objects in our environment are organized hierarchically with a global whole embedding its local parts, but the way we recognize these features remains unclear. Using a visual masking paradigm, we examined the temporal dissociation between global and local feature as proposed in Reverse Hierarchy Theory, RHT (Ahissar & Hochstein, 2000), where global and local information are assumed to be processed, respectively, by feed-forward and feedback systems. We found that in a long Stimulus Onset Asynchrony (SOA) condition, both global and local information were recognized adequately. However, in a short SOA condition, global information was recognized correctly while local recognition was critically disrupted. Consistent with RHT, it is suggested that local information is processed in a feedback system; this processing is then interrupted by the mask stimulus presented later at the primary visual area. Global information, by contrast, is transferred via a feed-forward system, and is not disrupted by the mask.

Configurational factors in the perception of faces and non-facial objects: an ERP study

During the viewing of human faces, it is easier to recognize detailed features if the face is presented in an unusual configuration; for example, a split face. The present study used electroencephalography to investigate the brain activity elicited in response to a neutral, inverted, and split face and compared this to the activity produced in response to a non-facial stimulus (a clock). Results showed that the N170 response amplitude was larger and its latency longer during recognition of split and inverted faces as compared to a normal face, whereas no amplitude change was seen for the different clock configurations. However, for the P300 component, larger amplitudes were observed in both the face and the object condition. Taken together, the results suggest that unusual human face presentations are detected at earlier stages than unusual object presentations.

Segregation of visual selection and saccades in human frontal eye fields

The premotor theory of attention suggests that target processing and generation of a saccade to the target are interdependent. Temporally precise transcranial magnetic stimulation (TMS) was delivered over the human frontal eye fields, the area most frequently associated with the premotor theory in association with eye movements, while subjects performed a visually instructed pro-/antisaccade task. Visual analysis and saccade preparation were clearly separated in time, as indicated by 2 distinct time points of TMS delivery that resulted in elevated saccade latencies. These results show that visual analysis and saccade preparation, although frequently enacted together, are dissociable processes.

Altered figure-ground perception in monkeys with an extra-striate lesion

The visual system binds and segments the elements of an image into coherent objects and their surroundings. Recent findings demonstrate that primary visual cortex is involved in this process of figure-ground organization. In the primary visual cortex the late part of a neural response to a stimulus correlates with figure-ground segregation and perception. Such a late onset indicates an involvement of feedback projections from higher visual areas. To investigate the possible role of feedback in figure-ground perception we removed dorsal extra-striate areas of the monkey visual cortex. The findings show that figure-ground perception is reduced when the figure is presented in the lesioned hemifield and perception is normal when the figure appeared in the intact hemifield. In conclusion, our observations show the importance for recurrent processing in visual perception.

Behavioral detection of electrical microstimulation in different cortical visual areas

The extent to which areas in the visual cerebral cortex differ in their ability to support perceptions has been the subject of considerable speculation. Experiments examining the activity of individual neurons have suggested that activity in later stages of the visual cortex is more closely linked to perception than that in earlier stages [1-9]. In contrast, results from functional imaging, transcranial magnetic stimulation, and lesion studies have been interpreted as showing that earlier stages are more closely coupled to perception [10-15]. We examined whether neuronal activity in early and later stages differs in its ability to support detectable signals by measuring behavioral thresholds for detecting electrical microstimulation in different cortical areas in two monkeys. By training the animals to perform a two-alternative temporal forced-choice task, we obtained criterion-free thresholds from five visual areas--V1, V2, V3A, MT, and the inferotemporal cortex. Every site tested yielded a reliable threshold. Thresholds varied little within and between visual areas, rising gradually from early to later stages. We similarly found no systematic differences in the slopes of the psychometric detection functions from different areas. These results suggest that neuronal signals of similar magnitude evoked in any part of visual cortex can generate percepts.

Human visual cortex responds to invisible chromatic flicker

When two isoluminant colors alternate at frequencies of 25 Hz or higher, observers perceive only one fused color. Chromatic flicker beyond the fusion frequency induces flicker adaptation in human observers and stimulates monkey V1 neurons. Here we use functional magnetic resonance imaging (fMRI) to show that many human visual cortical areas, with the exception of VO, can distinguish between fused chromatic flicker and its matched nonflickering control. This result supports the existence of significant intracortical temporal filtering of high-frequency chromatic information. The result also suggests that a considerable difference in cortical activation in many visual cortical areas does not necessarily lead to different conscious experiences.

Figure-ground activity in V1 and guidance of saccadic eye movements

Every day we shift our gaze about 150.000 times mostly without noticing it. The direction of these gaze shifts are not random but directed by sensory information and internal factors. After each movement the eyes hold still for a brief moment so that visual information at the center of our gaze can be processed in detail. This means that visual information at the saccade target location is sufficient to accurately guide the gaze shift but yet is not sufficiently processed to be fully perceived. In this paper I will discuss the possible role of activity in the primary visual cortex (V1), in particular figure-ground activity, in oculo-motor behavior. Figure-ground activity occurs during the late response period of V1 neurons and correlates with perception. The strength of figure-ground responses predicts the direction and moment of saccadic eye movements. The superior colliculus, a gaze control center that integrates visual and motor signals, receives direct anatomical connections from V1. These projections may convey the perceptual information that is required for appropriate gaze shifts. In conclusion, figure-ground activity in V1 may act as an intermediate component linking visual and motor signals.

Strength of figure-ground activity in monkey primary visual cortex predicts saccadic reaction time in a delayed detection task

When and where are decisions made? In the visual system a saccade, which is a fast shift of gaze toward a target in the visual scene, is the behavioral outcome of a decision. Current neurophysiological data and reaction time models show that saccadic reaction times are determined by a build-up of activity in motor-related structures, such as the frontal eye fields. These structures depend on the sensory evidence of the stimulus. Here we use a delayed figure-ground detection task to show that late modulated activity in the visual cortex (V1) predicts saccadic reaction time. This predictive activity is part of the process of figure-ground segregation and is specific for the saccade target location. These observations indicate that sensory signals are directly involved in the decision of when and where to look.

Looking back: corticothalamic feedback and early visual processing

Although once regarded as a simple sensory relay on the way to the cortex, it is increasingly apparent that the thalamus has a role in the ongoing moment-by-moment processing of sensory input and in cognition. This involves extensive corticofugal feedback connections and the interplay of these with the local thalamic circuitry and the other converging inputs. Here, using the feline visual system as the primary model, some of the latest developments in this field are reviewed and placed in the perspective of an integrated view of system function. Cortical feedback mediated by ionotropic and metabotropic glutamate receptors, and effects mediated by the neuromodulator nitric oxide, all have a role in integrating the thalamic mechanism into the cortical circuit. The essential point is that the perspective of higher-level sensory mechanisms shifts and modulates the thalamic circuitry in ways that optimize abstraction of a meaningful representation of the external world. This review is part of the TINS special issue on The Neural Substrates of Cognition.

Acquiring long-term representations of visual classes following extensive extrastriate damage

Different areas of human visual cortex are thought to play different roles in the learning of visual information: whereas in low/intermediate cortical areas, plasticity may be manifested by enhanced selectivity to learned visual features, in higher-level areas, plasticity may result in generalization and development of tolerance to degraded versions of the learned stimuli. The most effective tolerance to degraded information is presumably achieved in the case of cooperation between the different forms of plasticity. Whether this tolerance to degraded information also applies when the visual input is degraded as a result of a lesion to lower levels of the visual system remains an open question. To address this, we studied visual classification learning in a patient with an extensive bilateral lesion affecting intermediate/low-level visual areas but sparing higher-level areas. Despite difficulty in perceiving the stimuli, the patient learned to classify them, albeit not as quickly as control participants. Moreover, the patient's learning was maintained over the long term and was accompanied by improved discrimination of individual stimuli. These findings demonstrate that degraded output from lesioned, lower areas can be exploited in the service of a new visual task and the results likely implicate a combination of bottom-up and top-down processing during visual learning.

The reverse hierarchy theory of visual perceptual learning

Perceptual learning can be defined as practice-induced improvement in the ability to perform specific perceptual tasks. We previously proposed the Reverse Hierarchy Theory as a unifying concept that links behavioral findings of visual learning with physiological and anatomical data. Essentially, it asserts that learning is a top-down guided process, which begins at high-level areas of the visual system, and when these do not suffice, progresses backwards to the input levels, which have a better signal-to-noise ratio. This simple concept has proved powerful in explaining a broad range of findings, including seemingly contradicting data. We now extend this concept to describe the dynamics of skill acquisition and interpret recent behavioral and electrophysiological findings.