Top-Down Feedback Controls the Cortical Representation of Illusory Contours in Mouse Primary Visual Cortex

It's all in the timing: delayed feedback in autism may weaken predictive mechanisms during contour integration

Humans rely on predictive and integrative mechanisms during visual processing to efficiently resolve incomplete or ambiguous sensory signals. Although initial low-level sensory data are conveyed by feedforward connections, feedback connections are believed to shape sensory processing through automatic conveyance of statistical probabilities based on prior exposure to stimulus configurations. Individuals with autism spectrum disorder (ASD) show biases in stimulus processing toward parts rather than wholes, suggesting their sensory processing may be less shaped by statistical predictions acquired through prior exposure to global stimulus properties. Investigations of illusory contour (IC) processing in neurotypical (NT) adults have established a well-tested marker of contour integration characterized by a robust modulation of the visually evoked potential (VEP)-the IC-effect-that occurs over lateral occipital scalp during the timeframe of the visual N1 component. Converging evidence strongly supports the notion that this IC-effect indexes a signal with significant feedback contributions. Using high-density VEPs, we compared the IC-effect in 6- to 17-yr-old children with ASD (n = 32) or NT development (n = 53). Both groups of children generated an IC-effect that was equivalent in amplitude. However, the IC-effect notably onset 21 ms later in ASD, even though initial VEP afference was identical across groups. This suggests that feedforward information predominated during perceptual processing for 15% longer in ASD compared with NT children. This delay in the feedback-dependent IC-effect, in the context of known developmental differences between feedforward and feedback fibers, suggests a potential pathophysiological mechanism of visual processing in ASD, whereby ongoing stimulus processing is less shaped by visual feedback.NEW & NOTEWORTHY Children with autism often present with an atypical visual perceptual style that emphasizes parts or details over the whole. Using electroencephalography (EEG), this study identifies delays in the visual feedback from higher-order sensory brain areas to primary sensory regions. Because this type of visual feedback is thought to carry information about prior sensory experiences, individuals with autism may have difficulty efficiently using prior experience or putting together parts into a whole to help make sense of incoming new visual information. This provides empirical neural evidence to support theories of disrupted sensory perception mechanisms in autism.

Brightness illusions drive a neuronal response in the primary visual cortex under top-down modulation

Brightness illusions are a powerful tool in studying vision, yet their neural correlates are poorly understood. Based on a human paradigm, we presented illusory drifting gratings to mice. Primary visual cortex (V1) neurons responded to illusory gratings, matching their direction selectivity for real gratings, and they tracked the spatial phase offset between illusory and real gratings. Illusion responses were delayed compared to real gratings, in line with the theory that processing illusions requires feedback from higher visual areas (HVAs). We provide support for this theory by showing a reduced V1 response to illusions, but not real gratings, following HVAs optogenetic inhibition. Finally, we used the pupil response (PR) as an indirect perceptual report and showed that the mouse PR matches the human PR to perceived luminance changes. Our findings resolve debates over whether V1 neurons are involved in processing illusions and highlight the involvement of feedback from HVAs.

Dependence of Contextual Modulation in Macaque V1 on Interlaminar Signal Flow

In visual cortex, neural correlates of subjective perception can be generated by modulation of activity from beyond the classical receptive field (CRF). In macaque V1, activity generated by nonclassical receptive field (nCRF) stimulation involves different intracortical circuitry than activity generated by CRF stimulation, suggesting that interactions between neurons across V1 layers differ under CRF and nCRF stimulus conditions. We measured border ownership modulation within large populations of V1 neurons. We found that neurons in single columns preferred the same side of objects located outside of the CRF. In addition, we found that interactions between pairs of neurons situated across feedback/horizontal and input layers differed between CRF and nCRF stimulation. Furthermore, the magnitude of border ownership modulation was predicted by greater information flow from feedback/horizontal to input layers. These results demonstrate that the flow of signals between layers covaries with the degree to which neurons integrate information from beyond the CRF.

Cortical depth profiles in primary visual cortex for illusory and imaginary experiences

Visual illusions and mental imagery are non-physical sensory experiences that involve cortical feedback processing in the primary visual cortex. Using laminar functional magnetic resonance imaging (fMRI) in two studies, we investigate if information about these internal experiences is visible in the activation patterns of different layers of primary visual cortex (V1). We find that imagery content is decodable mainly from deep layers of V1, whereas seemingly 'real' illusory content is decodable mainly from superficial layers. Furthermore, illusory content shares information with perceptual content, whilst imagery content does not generalise to illusory or perceptual information. Together, our results suggest that illusions and imagery, which differ immensely in their subjective experiences, also involve partially distinct early visual microcircuits. However, overlapping microcircuit recruitment might emerge based on the nuanced nature of subjective conscious experience.

Involvement of superior colliculus in complex figure detection of mice

Object detection is an essential function of the visual system. Although the visual cortex plays an important role in object detection, the superior colliculus can support detection when the visual cortex is ablated or silenced. Moreover, it has been shown that superficial layers of mouse SC (sSC) encode visual features of complex objects, and that this code is not inherited from the primary visual cortex. This suggests that mouse sSC may provide a significant contribution to complex object vision. Here, we use optogenetics to show that mouse sSC is involved in figure detection based on differences in figure contrast, orientation, and phase. Additionally, our neural recordings show that in mouse sSC, image elements that belong to a figure elicit stronger activity than those same elements when they are part of the background. The discriminability of this neural code is higher for correct trials than for incorrect trials. Our results provide new insight into the behavioral relevance of the visual processing that takes place in sSC.

It's all in the timing: Delayed feedback in autism may weaken predictive mechanisms during contour integration

Humans rely on predictive mechanisms during visual processing to efficiently resolve incomplete or ambiguous sensory signals. While initial low-level sensory data are conveyed by feedforward connections, feedback connections are believed to shape sensory processing through conveyance of statistical predictions based on prior exposure to stimulus configurations. Individuals with autism spectrum disorder (ASD) show biases in stimulus processing toward parts rather than wholes, suggesting their sensory processing may be less shaped by statistical predictions acquired through prior exposure to global stimulus properties. Investigations of illusory contour (IC) processing in neurotypical (NT) adults have established a well-tested marker of contour integration characterized by a robust modulation of the visually evoked potential (VEP) - the IC-effect - that occurs over lateral occipital scalp during the timeframe of the N1 component. Converging evidence strongly supports the notion that this IC-effect indexes a signal with significant feedback contributions. Using high-density VEPs, we compared the IC-effect in 6-17-year-old children with ASD (n=32) or NT development (n=53). Both groups of children generated an IC-effect that was equivalent in amplitude. However, the IC-effect notably onset 21ms later in ASD, even though timing of initial VEP afference was identical across groups. This suggests that feedforward information predominated during perceptual processing for 15% longer in ASD compared to NT children. This delay in the feedback dependent IC-effect, in the context of known developmental differences between feedforward and feedback fibers, suggests a potential pathophysiological mechanism of visual processing in ASD, whereby ongoing stimulus processing is less shaped by statistical prediction mechanisms.

Visual experience induces 4-8 Hz synchrony between V1 and higher-order visual areas

Visual perceptual experience induces persistent 4-8 Hz oscillations in the mouse primary visual cortex (V1), encoding visual familiarity. Recent studies suggest that higher-order visual areas (HVAs) are functionally specialized and segregated into information streams processing distinct visual features. However, whether visual memories are processed and stored within the distinct streams is not understood. We report here that V1 and lateromedial (LM), but not V1 and anterolateral, become more phase synchronized in 4-8 Hz after the entrainment of visual stimulus that maximally induces responses in LM. Directed information analysis reveals changes in the top-down functional connectivity between V1 and HVAs. Optogenetic inactivation of LM reduces post-stimulus oscillation peaks in V1 and impairs visual discrimination behavior. Our results demonstrate that 4-8 Hz familiarity-evoked oscillations are specific for the distinct visual features and are present in the corresponding HVAs, where they may be used for the inter-areal communication with V1 during memory-related behaviors.

Reconstructing visual illusory experiences from human brain activity

Visual illusions provide valuable insights into the brain's interpretation of the world given sensory inputs. However, the precise manner in which brain activity translates into illusory experiences remains largely unknown. Here, we leverage a brain decoding technique combined with deep neural network (DNN) representations to reconstruct illusory percepts as images from brain activity. The reconstruction model was trained on natural images to establish a link between brain activity and perceptual features and then tested on two types of illusions: illusory lines and neon color spreading. Reconstructions revealed lines and colors consistent with illusory experiences, which varied across the source visual cortical areas. This framework offers a way to materialize subjective experiences, shedding light on the brain's internal representations of the world.

Continuous multiplexed population representations of task context in the mouse primary visual cortex

Effective task execution requires the representation of multiple task-related variables that determine how stimuli lead to correct responses. Even the primary visual cortex (V1) represents other task-related variables such as expectations, choice, and context. However, it is unclear how V1 can flexibly accommodate these variables without interfering with visual representations. We trained mice on a context-switching cross-modal decision task, where performance depends on inferring task context. We found that the context signal that emerged in V1 was behaviorally relevant as it strongly covaried with performance, independent from movement. Importantly, this signal was integrated into V1 representation by multiplexing visual and context signals into orthogonal subspaces. In addition, auditory and choice signals were also multiplexed as these signals were orthogonal to the context representation. Thus, multiplexing allows V1 to integrate visual inputs with other sensory modalities and cognitive variables to avoid interference with the visual representation while ensuring the maintenance of task-relevant variables.

Local minimization of prediction errors drives learning of invariant object representations in a generative network model of visual perception

The ventral visual processing hierarchy of the cortex needs to fulfill at least two key functions: perceived objects must be mapped to high-level representations invariantly of the precise viewing conditions, and a generative model must be learned that allows, for instance, to fill in occluded information guided by visual experience. Here, we show how a multilayered predictive coding network can learn to recognize objects from the bottom up and to generate specific representations via a top-down pathway through a single learning rule: the local minimization of prediction errors. Trained on sequences of continuously transformed objects, neurons in the highest network area become tuned to object identity invariant of precise position, comparable to inferotemporal neurons in macaques. Drawing on this, the dynamic properties of invariant object representations reproduce experimentally observed hierarchies of timescales from low to high levels of the ventral processing stream. The predicted faster decorrelation of error-neuron activity compared to representation neurons is of relevance for the experimental search for neural correlates of prediction errors. Lastly, the generative capacity of the network is confirmed by reconstructing specific object images, robust to partial occlusion of the inputs. By learning invariance from temporal continuity within a generative model, the approach generalizes the predictive coding framework to dynamic inputs in a more biologically plausible way than self-supervised networks with non-local error-backpropagation. This was achieved simply by shifting the training paradigm to dynamic inputs, with little change in architecture and learning rule from static input-reconstructing Hebbian predictive coding networks.

Peripheral and central sensation: multisensory orienting and recognition across species

Attentional bottlenecks force animals to deeply process only a selected fraction of sensory inputs. This motivates a unifying central-peripheral dichotomy (CPD), which separates multisensory processing into functionally defined central and peripheral senses. Peripheral senses (e.g., human audition and peripheral vision) select a fraction of the sensory inputs by orienting animals' attention; central senses (e.g., human foveal vision) allow animals to recognize the selected inputs. Originally used to understand human vision, CPD can be applied to multisensory processes across species. I first describe key characteristics of central and peripheral senses, such as the degree of top-down feedback and density of sensory receptors, and then show CPD as a framework to link ecological, behavioral, neurophysiological, and anatomical data and produce falsifiable predictions.

Severely Attenuated Visual Feedback Processing in Children on the Autism Spectrum

Individuals on the autism spectrum often exhibit atypicality in their sensory perception, but the neural underpinnings of these perceptual differences remain incompletely understood. One proposed mechanism is an imbalance in higher-order feedback re-entrant inputs to early sensory cortices during sensory perception, leading to increased propensity to focus on local object features over global context. We explored this theory by measuring visual evoked potentials during contour integration as considerable work has revealed that these processes are largely driven by feedback inputs from higher-order ventral visual stream regions. We tested the hypothesis that autistic individuals would have attenuated evoked responses to illusory contours compared with neurotypical controls. Electrophysiology was acquired while 29 autistic and 31 neurotypical children (7-17 years old, inclusive of both males and females) passively viewed a random series of Kanizsa figure stimuli, each consisting of four inducers that were aligned either at random rotational angles or such that contour integration would form an illusory square. Autistic children demonstrated attenuated automatic contour integration over lateral occipital regions relative to neurotypical controls. The data are discussed in terms of the role of predictive feedback processes on perception of global stimulus features and the notion that weakened "priors" may play a role in the visual processing anomalies seen in autism.SIGNIFICANCE STATEMENT Children on the autism spectrum differ from typically developing children in many aspects of their processing of sensory stimuli. One proposed mechanism for these differences is an imbalance in higher-order feedback to primary sensory regions, leading to an increased focus on local object features rather than global context. However, systematic investigation of these feedback mechanisms remains limited. Using EEG and a visual illusion paradigm that is highly dependent on intact feedback processing, we demonstrated significant disruptions to visual feedback processing in children with autism. This provides much needed experimental evidence that advances our understanding of the contribution of feedback processing to visual perception in autism spectrum disorder.

Stimulus-evoked and resting-state alpha oscillations show a linked dependence on patterned visual experience for development

Persistent visual impairments after congenital blindness due to dense bilateral cataracts have been attributed to altered visual cortex development within a sensitive period. Occipital alpha (8-14 Hz) oscillations were found to be reduced after congenital cataract reversal, while participants performed visual motion tasks. However, it has been unclear whether reduced alpha oscillations were task-specific, or linked to impaired visual behavior in cataract-reversed individuals. Here, we compared resting-state and stimulus-evoked alpha activity between individuals who had been treated for dense bilateral congenital cataracts (CC, n = 13, mean duration of blindness = 11.0 years) and age-matched, normally sighted individuals (SC, n = 13). We employed the visual impulse response function, adapted from VanRullen and MacDonald (2012), to test for the characteristic alpha response to visual white noise. Participants observed white noise stimuli changing in luminance with equal power at frequencies between 0 and 30 Hz. Compared to SC individuals, CC individuals demonstrated a reduced likelihood of exhibiting an evoked alpha response. Moreover, stimulus-evoked alpha power was reduced and correlated with a corresponding reduction of resting-state alpha power in the same CC individuals. Finally, CC individuals with an above-threshold evoked alpha peak had better visual acuity than CC individual without an evoked alpha peak. Since alpha oscillations have been linked to feedback communication, we suggest that the concurrent impairment in resting-state and stimulus-evoked alpha oscillations indicates an altered interaction of top-down and bottom-up processing in the visual hierarchy, which likely contributes to incomplete behavioral recovery in individuals who experienced transient congenital blindness.

Suppression of top-down influence decreases both behavioral and V1 neuronal response sensitivity to stimulus orientations in cats

How top-down influence affects behavioral detection of visual signals and neuronal response sensitivity in the primary visual cortex (V1) remains poorly understood. This study examined both behavioral performance in stimulus orientation identification and neuronal response sensitivity to stimulus orientations in the V1 of cat before and after top-down influence of area 7 (A7) was modulated by non-invasive transcranial direct current stimulation (tDCS). Our results showed that cathode (c) but not sham (s) tDCS in A7 significantly increased the behavioral threshold in identifying stimulus orientation difference, which effect recovered after the tDCS effect vanished. Consistently, c-tDCS but not s-tDCS in A7 significantly decreased the response selectivity bias of V1 neurons for stimulus orientations, which effect could recover after withdrawal of the tDCS effect. Further analysis showed that c-tDCS induced reduction of V1 neurons in response selectivity was not resulted from alterations of neuronal preferred orientation, nor of spontaneous activity. Instead, c-tDCS in A7 significantly lowered the visually-evoked response, especially the maximum response of V1 neurons, which caused a decrease in response selectivity and signal-to-noise ratio. By contrast, s-tDCS exerted no significant effect on the responses of V1 neurons. These results indicate that top-down influence of A7 may enhance behavioral identification of stimulus orientations by increasing neuronal visually-evoked response and response selectivity in the V1.

Contextual drive of neuronal responses in mouse V1 in the absence of feedforward input

Neurons in the primary visual cortex (V1) respond to stimuli in their receptive field (RF), which is defined by the feedforward input from the retina. However, V1 neurons are also sensitive to contextual information outside their RF, even if the RF itself is unstimulated. Here, we examined the cortical circuits for V1 contextual responses to gray disks superimposed on different backgrounds. Contextual responses began late and were strongest in the feedback-recipient layers of V1. They differed between the three main classes of inhibitory neurons, with particularly strong contextual drive of VIP neurons, indicating a contribution of disinhibitory circuits to contextual drive. Contextual drive was strongest when the gray disk was perceived as figure, occluding its background, rather than a hole. Our results link contextual drive in V1 to perceptual organization and provide previously unknown insight into how recurrent processing shapes the response of sensory neurons to facilitate figure perception.

Magnocellular and parvocellular contributions to brain network dysfunction during learning and memory: Implications for schizophrenia

Memory deficits are core features of schizophrenia, and a central aim in biological psychiatry is to identify the etiology of these deficits. Scrutiny is naturally focused on the dorsolateral prefrontal cortex and the hippocampal cortices, given these structures' roles in memory and learning. The fronto-hippocampal framework is valuable but restrictive. Network-based underpinnings of learning and memory are substantially diverse and include interactions between hetero-modal and early sensory networks. Thus, a loss of fidelity in sensory information may impact memorial and cognitive processing in higher-order brain sub-networks, becoming a sensory source for learning and memory deficits. In this overview, we suggest that impairments in magno- and parvo-cellular visual pathways result in degraded inputs to core learning and memory networks. The ascending cascade of aberrant neural events significantly contributes to learning and memory deficits in schizophrenia. We outline the network bases of these effects, and suggest that any network perspectives of dysfunction in schizophrenia must assess the impact of impaired perceptual contributions. Finally, we speculate on how this framework enriches the space of biomarkers and expands intervention strategies to ameliorate this prototypical disconnection syndrome.

Awareness-independent gradual spread of object-based attention

Although attention can be directed at certain objects, how object-based attention spreads within an object and whether this spread interacts with awareness remain unclear. Using a modified spatial cuing paradigm with backward masking, we addressed these issues with either visible or invisible displays presenting the real (Experiment 1) and illusory (Experiment 2) U-shaped objects (UOs), whose ends and middles, the possible locations of the cue and target, have iso-eccentric distances from the fixation. These equidistant ends and middles of UOs offered us a unique opportunity to examine whether attention gradually spreads within a given object, i.e., within an UO, attention spreads from its cued-end to uncued-end via the uncued-middle. Despite the visibility (visible or invisible) of UOs, both experiments supported this gradual spread manner by showing a faster response of human participants (male and female) to the target in the uncued-middle than that in the uncued-end. Our results thus indicate a gradual spread of object-based attention and further reveal that this gradual spread is independent of both the “visual objectness” (whether the object is defined as the real or illusory boundaries) and conscious access to objects.

A flexible Python-based touchscreen chamber for operant conditioning reveals improved visual perception of cardinal orientations in mice

Natural scenes are composed of a wide range of edge angles and spatial frequencies, with a strong overrepresentation of vertical and horizontal edges. Correspondingly, many mammalian species are much better at discriminating these cardinal orientations compared to obliques. A potential reason for this increased performance could be an increased number of neurons in the visual cortex that are tuned to cardinal orientations, which is likely to be an adaptation to the natural scene statistics. Such biased angular tuning has recently been shown in the mouse primary visual cortex. However, it is still unknown if mice also show a perceptual dominance of cardinal orientations. Here, we describe the design of a novel custom-built touchscreen chamber that allows testing natural scene perception and orientation discrimination performance by applying different task designs. Using this chamber, we applied an iterative convergence towards orientation discrimination thresholds for cardinal or oblique orientations in different cohorts of mice. Surprisingly, the expert discrimination performance was similar for both groups but showed large inter-individual differences in performance and training time. To study the discrimination of cardinal and oblique stimuli in the same mice, we, therefore, applied, a different training regime where mice learned to discriminate cardinal and oblique gratings in parallel. Parallel training revealed a higher task performance for cardinal orientations in an early phase of the training. The performance for both orientations became similar after prolonged training, suggesting that learning permits equally high perceptual tuning towards oblique stimuli. In summary, our custom-built touchscreen chamber offers a flexible tool to test natural visual perception in rodents and revealed a training-induced increase in the perception of oblique gratings. The touchscreen chamber is entirely open-source, easy to build, and freely available to the scientific community to conduct visual or multimodal behavioral studies. It is also based on the FAIR principles for data management and sharing and could therefore serve as a catalyst for testing the perception of complex and natural visual stimuli across behavioral labs.

The strength of feedback processing is associated with resistance to visual backward masking during Illusory Contour processing in adult humans

Re-entrant feedback processing is a key mechanism of visual object-recognition, especially under compromised viewing conditions where only sparse information is available and object features must be interpolated. Illusory Contour stimuli are commonly used in conjunction with Visual Evoked Potentials (VEP) to study these filling-in processes, with characteristic modulation of the VEP in the ∼100-150 ms timeframe associated with this re-entrant processing. Substantial inter-individual variability in timing and amplitude of feedback-related VEP modulation is observed, raising the question whether this variability might underlie inter-individual differences in the ability to form strong perceptual gestalts. Backward masking paradig ms have been used to study inter-individual variance in the ability to form robust object perceptions before processing of the mask interferes with object-recognition. Some individuals recognize objects when the time between target object and mask is extremely short, whereas others struggle to do so even at longer target-to-mask intervals. We asked whether timing and amplitude of feedback-related VEP modulations were associated with individual differences in resistance to backward masking. Participants (N=40) showed substantial performance variability in detecting Illusory Contours at intermediate target-to-mask intervals (67 ms and 117 ms), allowing us to use kmeans clustering to divide the population into four performance groups (poor, low-average, high-average, superior). There was a clear relationship between the amplitude (but not the timing) of feedback-related VEP modulation and Illusory Contour detection during backward masking. We conclude that individual differences in the strength of feedback processing in neurotypical humans lead to differences in the ability to quickly establish perceptual awareness of incomplete visual objects.

The promise of layer-specific neuroimaging for testing predictive coding theories of psychosis

Predictive coding potentially provides an explanatory model for understanding the neurocognitive mechanisms of psychosis. It proposes that cognitive processes, such as perception and inference, are implemented by a hierarchical system, with the influence of each level being a function of the estimated precision of beliefs at that level. However, predictive coding models of psychosis are insufficiently constrained-any phenomenon can be explained in multiple ways by postulating different changes to precision at different levels of processing. One reason for the lack of constraint in these models is that the core processes are thought to be implemented by the function of specific cortical layers, and the technology to measure layer specific neural activity in humans has until recently been lacking. As a result, our ability to constrain the models with empirical data has been limited. In this review we provide a brief overview of predictive processing models of psychosis and then describe the potential for newly developed, layer specific neuroimaging techniques to test and thus constrain these models. We conclude by discussing the most promising avenues for this research as well as the technical and conceptual challenges which may limit its application.

Visual illusion susceptibility in autism: A neural model

While atypical sensory perception is reported among individuals with autism spectrum disorder (ASD), the underlying neural mechanisms of autism that give rise to disruptions in sensory perception remain unclear. We developed a neural model with key physiological, functional and neuroanatomical parameters to investigate mechanisms underlying the range of representations of visual illusions related to orientation perception in typically developed subjects compared to individuals with ASD. Our results showed that two theorized autistic traits, excitation/inhibition imbalance and weakening of top‐down modulation, could be potential candidates for reduced susceptibility to some visual illusions. Parametric correlation between cortical suppression, balance of excitation/inhibition, feedback from higher visual areas on one hand and susceptibility to a class of visual illusions related to orientation perception on the other hand provide the opportunity to investigate the contribution and complex interactions of distinct sensory processing mechanisms in ASD. The novel approach used in this study can be used to link behavioural, functional and neuropathological studies; estimate and predict perceptual and cognitive heterogeneity in ASD; and form a basis for the development of novel diagnostics and therapeutics.

Indicators and criteria of consciousness: ethical implications for the care of behaviourally unresponsive patients

BACKGROUND

Assessing consciousness in other subjects, particularly in non-verbal and behaviourally disabled subjects (e.g., patients with disorders of consciousness), is notoriously challenging but increasingly urgent. The high rate of misdiagnosis among disorders of consciousness raises the need for new perspectives in order to inspire new technical and clinical approaches.

MAIN BODY

We take as a starting point a recently introduced list of operational indicators of consciousness that facilitates its recognition in challenging cases like non-human animals and Artificial Intelligence to explore their relevance to disorders of consciousness and their potential ethical impact on the diagnosis and healthcare of relevant patients. Indicators of consciousness mean particular capacities that can be deduced from observing the behaviour or cognitive performance of the subject in question (or from neural correlates of such performance) and that do not define a hard threshold in deciding about the presence of consciousness, but can be used to infer a graded measure based on the consistency amongst the different indicators. The indicators of consciousness under consideration offer a potential useful strategy for identifying and assessing residual consciousness in patients with disorders of consciousness, setting the theoretical stage for an operationalization and quantification of relevant brain activity.

CONCLUSIONS

Our heuristic analysis supports the conclusion that the application of the identified indicators of consciousness to its disorders will likely inspire new strategies for assessing three very urgent issues: the misdiagnosis of disorders of consciousness; the need for a gold standard in detecting consciousness and diagnosing its disorders; and the need for a refined taxonomy of disorders of consciousness.

Effects of top-down influence suppression on behavioral and V1 neuronal contrast sensitivity functions in cats

To explore the relative contributions of higher-order and primary visual cortex (V1) to visual perception, we compared cats' behavioral and V1 neuronal contrast sensitivity functions (CSF) and threshold versus external noise contrast (TvC) functions before and after top-down influence of area 7 (A7) was modulated with transcranial direct current stimulation (tDCS). We found that suppressing top-down influence of A7 with cathode-tDCS, but not sham-tDCS, reduced behavioral and neuronal contrast sensitivity in the same range of spatial frequencies and increased behavioral and neuronal contrast thresholds in the same range of external noise levels. The neuronal CSF and TvC functions were highly correlated with their behavioral counterparts both before and after the top-down suppression. Analysis of TvC functions using the Perceptual Template Model (PTM) indicated that top-down influence of A7 increased both behavioral and V1 neuronal contrast sensitivity by reducing internal additive noise and the impact of external noise.

•

Top-down suppression lowers both behavioral and V1 neuronal CSF functions

•

Top-down suppression raises both behavioral and V1 neuronal TvC functions

•

The neuronal CSFs and TvCs are highly correlated with their behavioral counterparts

•

Top-down influence lowers internal additive noise and impact of external noise in V1

Higher Order Visual Areas Enhance Stimulus Responsiveness in Mouse Primary Visual Cortex

Over the past few years, the various areas that surround the primary visual cortex (V1) in the mouse have been associated with many functions, ranging from higher order visual processing to decision-making. Recently, some studies have shown that higher order visual areas influence the activity of the primary visual cortex, refining its processing capabilities. Here, we studied how in vivo optogenetic inactivation of two higher order visual areas with different functional properties affects responses evoked by moving bars in the primary visual cortex. In contrast with the prevailing view, our results demonstrate that distinct higher order visual areas similarly modulate early visual processing. In particular, these areas enhance stimulus responsiveness in the primary visual cortex, by more strongly amplifying weaker compared with stronger sensory-evoked responses (for instance specifically amplifying responses to stimuli not moving along the direction preferred by individual neurons) and by facilitating responses to stimuli entering the receptive field of single neurons. Such enhancement, however, comes at the expense of orientation and direction selectivity, which increased when the selected higher order visual areas were inactivated. Thus, feedback from higher order visual areas selectively amplifies weak sensory-evoked V1 responses, which may enable more robust processing of visual stimuli.

Prediction, Suppression of Visual Response, and Modulation of Visual Perception: Insights From Visual Evoked Potentials and Representational Momentum

When a visual object changes its position along with certain sequential regularities, the visual system rapidly and automatically forms a prediction regarding the future position of the object based on the regularities. Such prediction can drastically alter visual perception. A phenomenon called representational momentum (RM: a predictive displacement of the perceived final position of a visual object along its recent regular pattern) has provided extensive evidence for the predictive modulation of visual perception. The purpose of the present study was to identify neural effects that could explain individual differences in the strength of the predictive modulation of visual perception as measured by RM. For this purpose, in two experiments with a conventional RM paradigm where a bar was discretely presented in a regular rotation manner (with a step of 18° in Experiment 1 and a step of 20° in Experiment 2), visual evoked potentials (VEPs) in response to the regularly rotated bar were measured, and correlations between the magnitudes of RM and VEPs were examined. The results showed that the magnitudes of RM and central P2 were negatively correlated, consistently in both experiments; participants who showed a smaller central P2 tended to exhibit greater RM. Together with a previous proposal that central P2 would represent delayed reactivation of lower visual areas around the striate and prestriate cortices via reentrant feedback projections from higher areas, the present results suggest that greater suppression of delayed reactivation of lower visual areas (as indicated by smaller central P2) may underlie stronger predictive modulation of visual perception (as indicated by greater RM).

Predictive coding feedback results in perceived illusory contours in a recurrent neural network

Modern feedforward convolutional neural networks (CNNs) can now solve some computer vision tasks at super-human levels. However, these networks only roughly mimic human visual perception. One difference from human vision is that they do not appear to perceive illusory contours (e.g. Kanizsa squares) in the same way humans do. Physiological evidence from visual cortex suggests that the perception of illusory contours could involve feedback connections. Would recurrent feedback neural networks perceive illusory contours like humans? In this work we equip a deep feedforward convolutional network with brain-inspired recurrent dynamics. The network was first pretrained with an unsupervised reconstruction objective on a natural image dataset, to expose it to natural object contour statistics. Then, a classification decision head was added and the model was finetuned on a form discrimination task: squares vs. randomly oriented inducer shapes (no illusory contour). Finally, the model was tested with the unfamiliar "illusory contour" configuration: inducer shapes oriented to form an illusory square. Compared with feedforward baselines, the iterative "predictive coding" feedback resulted in more illusory contours being classified as physical squares. The perception of the illusory contour was measurable in the luminance profile of the image reconstructions produced by the model, demonstrating that the model really "sees" the illusion. Ablation studies revealed that natural image pretraining and feedback error correction are both critical to the perception of the illusion. Finally we validated our conclusions in a deeper network (VGG): adding the same predictive coding feedback dynamics again leads to the perception of illusory contours.

Cortical and Subcortical Circuits for Cross-Modal Plasticity Induced by Loss of Vision

Cortical areas are highly interconnected both via cortical and subcortical pathways, and primary sensory cortices are not isolated from this general structure. In primary sensory cortical areas, these pre-existing functional connections serve to provide contextual information for sensory processing and can mediate adaptation when a sensory modality is lost. Cross-modal plasticity in broad terms refers to widespread plasticity across the brain in response to losing a sensory modality, and largely involves two distinct changes: cross-modal recruitment and compensatory plasticity. The former involves recruitment of the deprived sensory area, which includes the deprived primary sensory cortex, for processing the remaining senses. Compensatory plasticity refers to plasticity in the remaining sensory areas, including the spared primary sensory cortices, to enhance the processing of its own sensory inputs. Here, we will summarize potential cellular plasticity mechanisms involved in cross-modal recruitment and compensatory plasticity, and review cortical and subcortical circuits to the primary sensory cortices which can mediate cross-modal plasticity upon loss of vision.

Impaired Adaptation and Laminar Processing of the Oddball Paradigm in the Primary Visual Cortex of Fmr1 KO Mouse

Both adaptation and novelty detection are an integral part of sensory processing. Recent animal oddball studies have advanced our understanding of circuitry underlying contextual processing in early sensory areas. However, it is unclear how adaptation and mismatch (MM) responses depend on the tuning properties of neurons and their laminar position. Furthermore, given that reduced habituation and sensory overload are among the hallmarks of altered sensory perception in autism, we investigated how oddball processing might be altered in a mouse model of fragile X syndrome (FX). Using silicon probe recordings and a novel spatial frequency (SF) oddball paradigm, we discovered that FX mice show reduced adaptation and enhanced MM responses compared to control animals. Specifically, we found that adaptation is primarily restricted to neurons with preferred oddball SF in FX compared to WT mice. Mismatch responses, on the other hand, are enriched in the superficial layers of WT animals but are present throughout lamina in FX animals. Last, we observed altered neural dynamics in FX mice in response to stimulus omissions. Taken together, we demonstrated that reduced feature adaptation coexists with impaired laminar processing of oddball responses, which might contribute to altered sensory perception in FX syndrome and autism.

A continuum hypothesis of psychotomimetic rapid antidepressants

Ketamine, classical psychedelics and sleep deprivation are associated with rapid effects on depression. Interestingly, these interventions also have common psychotomimetic actions, mirroring aspects of psychosis such as an altered sense of self, perceptual distortions and distorted thinking. This raises the question whether these interventions might be acute antidepressants through the same mechanisms that underlie some of their psychotomimetic effects. That is, perhaps some symptoms of depression can be understood as occupying the opposite end of a spectrum where elements of psychosis can be found on the other side. This review aims at reviewing the evidence underlying a proposed continuum hypothesis of psychotomimetic rapid antidepressants, suggesting that a range of psychotomimetic interventions are also acute antidepressants as well as trying to explain these common features in a hierarchical predictive coding framework, where we hypothesise that these interventions share a common mechanism by increasing the flexibility of prior expectations. Neurobiological mechanisms at play and the role of different neuromodulatory systems affected by these interventions and their role in controlling the precision of prior expectations and new sensory evidence will be reviewed. The proposed hypothesis will also be discussed in relation to other existing theories of antidepressants. We also suggest a number of novel experiments to test the hypothesis and highlight research areas that could provide further insights, in the hope to better understand the acute antidepressant properties of these interventions.

Postnatal Development of Visual Cortical Function in the Mammalian Brain

This review aims to discuss (1) the refinement of mammalian visual cortical circuits and the maturation of visual functions they subserve in primary visual cortex (V1) and other visual cortical areas, and (2) existing evidence supporting the notion of differential rates of maturation of visual functions in different species. It is well known that different visual functions and their underlying circuitry mature and attain adultlike characteristics at different stages in postnatal development with varying growth rates. The developmental timecourse and duration of refinement varies significantly both in V1 of various species and among different visual cortical areas; while basic visual functions like spatial acuity mature earlier requiring less time, higher form perception such as contour integration is more complex and requires longer postnatal time to refine. This review will highlight the importance of systematic comparative analysis of the differential rates of refinement of visual circuitry and function as that may help reveal underlying key mechanisms necessary for healthy visual development during infancy and adulthood. This type of approach will help future studies to establish direct links between various developmental aspects of different visual cortical areas in both human and animal models; thus enhancing our understanding of vision related neurological disorders and their potential therapeutic remedies.