Shape perception enhances perceived contrast: evidence for excitatory predictive feedback?

Subjective perception of objects depends on the interaction between the validity of context-based expectations and signal reliability

Predictive coding theories of visual perception assume that expectations based on prior knowledge modulate the processing of information. However, the underlying mechanisms remain debated. Some accounts propose that expectations enhance the perception of expected relative to unexpected stimuli while others assume the opposite. Recently, the opposing process theory suggested that enhanced perception of expected vs. unexpected stimuli may occur alternatively depending upon the reliability of the visual signal. When the signal is noisy, perception would be biassed toward what is expected since anything else may be too noisy to be resolved. When the signal is unambiguous, perception would be biassed toward what diverges from expectations and is more informative. Our study tested this hypothesis, using a perceptual matching task to investigate the influence of expectations on the perceived sharpness of objects in context. Participants saw two blurred images depicting the same object and had to adjust the blur level of one object to match the blur level of the other one. We manipulated the validity of expectations about objects by varying their scene context (congruent or incongruent context leading to valid or invalid expectations about the object). We also manipulated the reliability of the visual signal by varying the initial blur level of object pairs. Results showed that expectations validity differentially affected the perception of objects depending on signal reliability. Perception of validly expected objects was enhanced (sharpened) relative to unexpected objects when visual inputs were unreliable while this effect reversed to the benefit of unexpected objects when the signal was more reliable.

V1-Origin Bidirectional Plasticity in Visual Thalamo-Ventral Pathway and Its Contribution to Saliency Detection of Dynamic Visual Inputs

Visual neural plasticity and V1 saliency detection are vital for efficient coding of dynamically changing visual inputs. However, how does neural plasticity contribute to saliency detection of temporal statistically distributed visual stream remains unclear. Therefore, we adopted randomly presented but unevenly distributed stimuli with multiple orientations and examined the single-unit responses evoked by this biased orientation-adaptation protocol by single-unit recordings in the visual thalamo-ventral pathway of cats (of either sex). We found neuronal responses potentiated when the probability of biased orientation was slightly higher than other nonbiased ones and suppressed when the probability became much higher. This single neuronal short-term bidirectional plasticity is selectively induced by optimal stimuli but is interocularly transferable. It is inducible in LGN, Area 17, and Area 21a with distinct and hierarchically progressive patterns. With the results of latency analysis, receptive field structural test, cortical lesion, and simulations, we suggest this bidirectional plasticity may principally originate from the adaptation competition between excitatory and inhibitory components of V1 neuronal receptive field. In our simulation, above bidirectional plasticity could achieve saliency detection of dynamic visual inputs. These findings demonstrate a rapid probability dependent plasticity on the neural coding of visual stream and suggest its functional role in the efficient coding and saliency detection of dynamic environment.SIGNIFICANCE STATEMENT Novel elements within a dynamic visual stream can pop up from the context, which is vital for rapid response to a dynamically changing world. Saliency detection is a promising bottom-up mechanism contributing to efficient selection of visual inputs, wherein visual adaptation also plays a significant role. However, the saliency detection of dynamic visual stream is poorly understood. Here, we found a novel form of visual short-term bidirectional plasticity in multistages of the visual system that contributes to saliency detection of dynamic visual inputs. This bidirectional plasticity may principally originate from the local balance of excitation inhibition in primary visual cortex and propagates to lower and higher visual areas with progressive pattern change. Our findings suggest the excitation-inhibition balance within the visual system contributes to visual efficient coding.

Mechanisms of Surround Suppression Effect on the Contrast Sensitivity of V1 Neurons in Cats

Surround suppression (SS) is a phenomenon that a neuron’s response to visual stimuli within the classical receptive field (cRF) is suppressed by a concurrent stimulation in the surrounding receptive field (sRF) beyond the cRF. Studies show that SS affects neuronal response contrast sensitivity in the primary visual cortex (V1). However, the underlying mechanisms remain unclear. Here, we examined SS effect on the contrast sensitivity of cats’ V1 neurons with different preferred SFs using external noise-masked visual stimuli and perceptual template model (PTM) analysis at the system level. The contrast sensitivity was evaluated by the inverted threshold contrast of neurons in response to circular gratings of different contrasts in the cRF with or without an annular grating in the sRF. Our results showed that SS significantly reduced the contrast sensitivity of cats’ V1 neurons. The SS-induced reduction of contrast sensitivity was not correlated with SS strength but was dependent on neuron’s preferred SF, with a larger reduction for neurons with low preferred SFs than those with high preferred SFs. PTM analysis of threshold versus external noise contrast (TvC) functions indicated that SS decreased contrast sensitivity by increasing both the internal additive noise and impact of external noise for neurons with low preferred SFs, but improving only internal additive noise for neurons with high preferred SFs. Furthermore, the SS effect on the contrast-response function of low- and high-SF neurons also exhibited different mechanisms in contrast gain and response gain. Collectively, these results suggest that the mechanisms of SS effect on neuronal contrast sensitivity may depend on neuronal populations with different SFs.

Effects of top-down influence suppression on behavioral and V1 neuronal contrast sensitivity functions in cats

To explore the relative contributions of higher-order and primary visual cortex (V1) to visual perception, we compared cats' behavioral and V1 neuronal contrast sensitivity functions (CSF) and threshold versus external noise contrast (TvC) functions before and after top-down influence of area 7 (A7) was modulated with transcranial direct current stimulation (tDCS). We found that suppressing top-down influence of A7 with cathode-tDCS, but not sham-tDCS, reduced behavioral and neuronal contrast sensitivity in the same range of spatial frequencies and increased behavioral and neuronal contrast thresholds in the same range of external noise levels. The neuronal CSF and TvC functions were highly correlated with their behavioral counterparts both before and after the top-down suppression. Analysis of TvC functions using the Perceptual Template Model (PTM) indicated that top-down influence of A7 increased both behavioral and V1 neuronal contrast sensitivity by reducing internal additive noise and the impact of external noise.

•

Top-down suppression lowers both behavioral and V1 neuronal CSF functions

•

Top-down suppression raises both behavioral and V1 neuronal TvC functions

•

The neuronal CSFs and TvCs are highly correlated with their behavioral counterparts

•

Top-down influence lowers internal additive noise and impact of external noise in V1

Characterization of Feedback Neurons in the High-Level Visual Cortical Areas That Project Directly to the Primary Visual Cortex in the Cat

Previous studies indicate that top-down influence plays a critical role in visual information processing and perceptual detection. However, the substrate that carries top-down influence remains poorly understood. Using a combined technique of retrograde neuronal tracing and immunofluorescent double labeling, we characterized the distribution and cell type of feedback neurons in cat's high-level visual cortical areas that send direct connections to the primary visual cortex (V1: area 17). Our results showed: (1) the high-level visual cortex of area 21a at the ventral stream and PMLS area at the dorsal stream have a similar proportion of feedback neurons back projecting to the V1 area, (2) the distribution of feedback neurons in the higher-order visual area 21a and PMLS was significantly denser than in the intermediate visual cortex of area 19 and 18, (3) feedback neurons in all observed high-level visual cortex were found in layer II-III, IV, V, and VI, with a higher proportion in layer II-III, V, and VI than in layer IV, and (4) most feedback neurons were CaMKII-positive excitatory neurons, and few of them were identified as inhibitory GABAergic neurons. These results may argue against the segregation of ventral and dorsal streams during visual information processing, and support "reverse hierarchy theory" or interactive model proposing that recurrent connections between V1 and higher-order visual areas constitute the functional circuits that mediate visual perception. Also, the corticocortical feedback neurons from high-level visual cortical areas to the V1 area are mostly excitatory in nature.

Top-down influence affects the response adaptation of V1 neurons in cats

The visual system lowers its perceptual sensitivity to a prolonged presentation of the same visual signal. This brain plasticity, called visual adaptation, is generally attributed to the response adaptation of neurons in the visual cortex. Although well-studied in the neurons of the primary visual cortex (V1), the contribution of high-level visual cortical regions to the response adaptation of V1 neurons is unclear. In the present study, we measured the response adaptation strength of V1 neurons before and after the top-down influence of the area 21a (A21a), a higher-order visual cortex homologous to the primate V4 area, was modulated with a noninvasive tool of transcranial direct current stimulation (tDCS). Our results showed that the response adaptation of V1 neurons enhanced significantly after applying anode (a-) tDCS in A21a when compared with that before a-tDCS, whereas the response adaptation of V1 neurons weakened after cathode (c-) tDCS relative to before c-tDCS in A21a. By contrast, sham (s-) tDCS in A21a had no significant impact on the response adaptation of V1 neurons. Further analysis indicated that a-tDCS in A21a significantly increased both the initial response (IR) of V1 neurons to the first several (five) trails of visual stimulation and the plateau response (PR) to the prolonged visual stimulation; the increase in PR was lower than in IR, which caused an enhancement in response adaptation. Conversely, c-tDCS significantly decreased both IR and PR of V1 neurons; the reduction in PR was smaller than in IR, which resulted in a weakness in response adaptation. Furthermore, the tDCS-induced changes of V1 neurons in response and response adaptation could recover after tDCS effect vanished, but did not occur after the neuronal activity in A21a was silenced by electrolytic lesions. These results suggest that the top-down influence of A21a may alter the response adaptation of V1 neurons through activation of local inhibitory circuitry, which enhances network inhibition in the V1 area upon an increased top-down input, weakens inhibition upon a decreased top-down input, and thus maintains homeostasis of V1 neurons in response to the long-presenting visual signals.

Topographic signatures of global object perception in human visual cortex

Our visual system readily groups dynamic fragmented input into global objects. How the brain represents global object perception remains however unclear. To address this question, we recorded brain responses using functional magnetic resonance imaging whilst observers viewed a dynamic bistable stimulus that could either be perceived globally (i.e., as a grouped and coherently moving shape) or locally (i.e., as ungrouped and incoherently moving elements). We further estimated population receptive fields and used these to back-project the brain activity measured during stimulus perception into visual space via a searchlight procedure. Global perception resulted in universal suppression of responses in lower visual cortex accompanied by wide-spread enhancement in higher object-sensitive cortex. However, follow-up experiments indicated that higher object-sensitive cortex is suppressed if global perception lacks shape grouping, and that grouping-related suppression can be diffusely confined to stimulated sites and accompanied by background enhancement once stimulus size is reduced. These results speak to a non-generic involvement of higher object-sensitive cortex in perceptual grouping and point to an enhancement-suppression mechanism mediating the perception of figure and ground.

•

Lower visual cortex activity to grouped vs ungrouped dynamic stimuli is suppressed.

•

When grouping a shape, activity in higher object-sensitive cortex is enhanced.

•

Without shape grouping, activity in higher object-sensitive cortex is suppressed.

•

Grouping-related suppression can be diffusely confined to stimulated cortical sites.

Clarifying frequency-dependent brightness enhancement: delta- and theta-band flicker, not alpha-band flicker, consistently seen as brightest

Frequency-dependent brightness enhancement, a perceptual illusion in which a flickering light can appear twice as bright as a constant light, has historically been reported to produce maximum effects at a flicker rate within the alpha (8-12 Hz) band (Bartley in J Exp Psychol 23(3):313-319, 1938). Our recent examinations of this phenomenon using brightness discrimination between two flickering stimuli, however, have instead revealed the brightest percepts from theta-band (4-7 Hz) flicker (Bertrand et al. in Sci Rep 8(1):6152, 2018). Two primary questions arise from these seemingly contradictory findings: first, could task differences between these studies have caused recruitment of discrete oscillatory processes? Second, could the reported theta-band flicker enhancement be the result of an aliased alpha rhythm, sequentially sampling two stimulus locations, resulting in an ~ 5 Hz half-alpha rhythm? Here, we investigated these questions with two experiments: one replicating Bartley's (1938) adjustment paradigm, and one containing both Bartley's adjustment task and Bertrand's (2018) discrimination task, but presenting stimuli only sequentially (rather than concurrently). Examination of a range of frequencies (2-12 Hz) revealed the greatest brightness enhancement arising from flicker in the delta- and theta-band across all conditions, regardless of the spatial or temporal configuration of the stimuli. We speculate that these slower rhythms play an integral role in complex visual operations (e.g., a discrimination decision) where the entrainment of the endogenous neural rhythm to matched exogenous rhythmic stimulation promotes more efficient processing of visual information and thus produces perceptual biases as seen in frequency-dependent brightness enhancement.

Action sharpens sensory representations of expected outcomes

When we produce actions we predict their likely consequences. Dominant models of action control suggest that these predictions are used to ‘cancel’ perceptual processing of expected outcomes. However, normative Bayesian models of sensory cognition developed outside of action propose that rather than being cancelled, expected sensory signals are represented with greater fidelity (sharpened). Here, we distinguished between these models in an fMRI experiment where participants executed hand actions (index vs little finger movement) while observing movements of an avatar hand. Consistent with the sharpening account, visual representations of hand movements (index vs little finger) could be read out more accurately when they were congruent with action and these decoding enhancements were accompanied by suppressed activity in voxels tuned away from, not towards, the expected stimulus. Therefore, inconsistent with dominant action control models, these data show that sensorimotor prediction sharpens expected sensory representations, facilitating veridical perception of action outcomes.

Our brains predict the likely sensory consequences of actions we take; one theory is that these sensory responses are suppressed, but another theory is that they are sharpened. Here, the authors show using fMRI evidence consistent with the sharpening account for sensory consequences of hand movements.

Effects of meaningfulness on perception: Alpha-band oscillations carry perceptual expectations and influence early visual responses

Perceptual experience results from a complex interplay of bottom-up input and prior knowledge about the world, yet the extent to which knowledge affects perception, the neural mechanisms underlying these effects, and the stages of processing at which these two sources of information converge, are still unclear. In several experiments we show that language, in the form of verbal labels, both aids recognition of ambiguous “Mooney” images and improves objective visual discrimination performance in a match/non-match task. We then used electroencephalography (EEG) to better understand the mechanisms of this effect. The improved discrimination of images previously labeled was accompanied by a larger occipital-parietal P1 evoked response to the meaningful versus meaningless target stimuli. Time-frequency analysis of the interval between the cue and the target stimulus revealed increases in the power of posterior alpha-band (8–14 Hz) oscillations when the meaning of the stimuli to be compared was trained. The magnitude of the pre-target alpha difference and the P1 amplitude difference were positively correlated across individuals. These results suggest that prior knowledge prepares the brain for upcoming perception via the modulation of alpha-band oscillations, and that this preparatory state influences early (~120 ms) stages of visual processing.

Entrainment of theta, not alpha, oscillations is predictive of the brightness enhancement of a flickering stimulus

Frequency-dependent brightness enhancement, where a flickering light can appear twice as bright as an equiluminant constant light, has been reported to exist within the alpha (8–12 Hz) band. Could oscillatory neural activity be driving this perceptual effect? Here, in two experiments, human subjects reported which of two flickering stimuli were brighter. Strikingly, 4 Hz stimuli were reported as brighter more than 80% of the time when compared to all other tested frequencies, even though all stimuli were equiluminant and of equal temporal length. Electroencephalography recordings showed that inter-trial phase coherence (ITC) of theta (4 Hz) was: (1) Significantly greater than alpha, contralateral to the flickering stimulus; (2) Enhanced by the presence of a second ipsilateral 4 Hz flickering stimulus; and (3) Uniquely lateralized, unlike the alpha band. Importantly, on trials with two identical stimuli (i.e. 4 Hz vs 4 Hz), the brightness discrimination judgment could be predicted by the hemispheric balance in the amount of 4 Hz ITC. We speculate that the theta rhythm plays a distinct information transfer role, where its ability to share information between hemispheres via entrainment promotes a better processing of visual information to inform a discrimination decision.

The rhythms of predictive coding? Pre-stimulus phase modulates the influence of shape perception on luminance judgments

Predictive coding is an influential model emphasizing interactions between feedforward and feedback signals. Here, we investigated the temporal dynamics of these interactions. Two gray disks with different versions of the same stimulus, one enabling predictive feedback (a 3D-shape) and one impeding it (random-lines), were simultaneously presented on the left and right of fixation. Human subjects judged the luminance of the two disks while EEG was recorded. The choice of 3D-shape or random-lines as the brighter disk was used to assess the influence of feedback signals on sensory processing in each trial (i.e., as a measure of post-stimulus predictive coding efficiency). Independently of the spatial response (left/right), we found that this choice fluctuated along with the pre-stimulus phase of two spontaneous oscillations: a ~5 Hz oscillation in contralateral frontal electrodes and a ~16 Hz oscillation in contralateral occipital electrodes. This pattern of results demonstrates that predictive coding is a rhythmic process, and suggests that it could take advantage of faster oscillations in low-level areas and slower oscillations in high-level areas.