Feedforward and feedback interactions between visual cortical areas use different population activity patterns

Circuit-motivated generalized affine models characterize stimulus-dependent visual cortical shared variability

Correlated variability in the visual cortex is modulated by stimulus properties. The stimulus dependence of correlated variability impacts stimulus coding and is indicative of circuit structure. An affine model combining a multiplicative factor and an additive offset has been proposed to explain how correlated variability in primary visual cortex (V1) depends on stimulus orientations. However, whether the affine model could be extended to explain modulations by other stimulus variables or variability shared between two brain areas is unknown. Motivated by a simple neural circuit mechanism, we modified the affine model to better explain the contrast dependence of neural variability shared within either primary or secondary visual cortex (V1 or V2) as well as the orientation dependence of neural variability shared between V1 and V2. Our results bridge neural circuit mechanisms and statistical models and provide a parsimonious explanation for the stimulus dependence of correlated variability within and between visual areas.

Subcortical origin of nonlinear sound encoding in auditory cortex

A major challenge in neuroscience is to understand how neural representations of sensory information are transformed by the network of ascending and descending connections in each sensory system. By recording from neurons at several levels of the auditory pathway, we show that much of the nonlinear encoding of complex sounds in auditory cortex can be explained by transformations in the midbrain and thalamus. Modeling cortical neurons in terms of their inputs across these subcortical populations enables their responses to be predicted with unprecedented accuracy. By contrast, subcortical responses cannot be predicted from descending cortical inputs, indicating that ascending transformations are irreversible, resulting in increasingly lossy, higher-order representations across the auditory pathway. Rather, auditory cortex selectively modulates the nonlinear aspects of thalamic auditory responses and the functional coupling between subcortical neurons without affecting the linear encoding of sound. These findings reveal the fundamental role of subcortical transformations in shaping cortical responses.

Thalamocortical architectures for flexible cognition and efficient learning

The brain exhibits a remarkable ability to learn and execute context-appropriate behaviors. How it achieves such flexibility, without sacrificing learning efficiency, is an important open question. Neuroscience, psychology, and engineering suggest that reusing and repurposing computations are part of the answer. Here, we review evidence that thalamocortical architectures may have evolved to facilitate these objectives of flexibility and efficiency by coordinating distributed computations. Recent work suggests that distributed prefrontal cortical networks compute with flexible codes, and that the mediodorsal thalamus provides regularization to promote efficient reuse. Thalamocortical interactions resemble hierarchical Bayesian computations, and their network implementation can be related to existing gating, synchronization, and hub theories of thalamic function. By reviewing recent findings and providing a novel synthesis, we highlight key research horizons integrating computation, cognition, and systems neuroscience.

Flexible neural population dynamics govern the speed and stability of sensory encoding in mouse visual cortex

Time courses of neural responses underlie real-time sensory processing and perception. How these temporal dynamics change may be fundamental to how sensory systems adapt to different perceptual demands. By simultaneously recording from hundreds of neurons in mouse primary visual cortex, we examined neural population responses to visual stimuli at sub-second timescales, during different behavioural states. We discovered that during active behavioural states characterised by locomotion, single-neurons shift from transient to sustained response modes, facilitating rapid emergence of visual stimulus tuning. Differences in single-neuron response dynamics were associated with changes in temporal dynamics of neural correlations, including faster stabilisation of stimulus-evoked changes in the structure of correlations during locomotion. Using Factor Analysis, we examined temporal dynamics of latent population responses and discovered that trajectories of population activity make more direct transitions between baseline and stimulus-encoding neural states during locomotion. This could be partly explained by dampening of oscillatory dynamics present during stationary behavioural states. Functionally, changes in temporal response dynamics collectively enabled faster, more stable and more efficient encoding of new visual information during locomotion. These findings reveal a principle of how sensory systems adapt to perceptual demands, where flexible neural population dynamics govern the speed and stability of sensory encoding.

Neural manifolds in V1 change with top-down signals from V4 targeting the foveal region

High-dimensional brain activity is often organized into lower-dimensional neural manifolds. However, the neural manifolds of the visual cortex remain understudied. Here, we study large-scale multi-electrode electrophysiological recordings of macaque (Macaca mulatta) areas V1, V4, and DP with a high spatiotemporal resolution. We find that the population activity of V1 contains two separate neural manifolds, which correlate strongly with eye closure (eyes open/closed) and have distinct dimensionalities. Moreover, we find strong top-down signals from V4 to V1, particularly to the foveal region of V1, which are significantly stronger during the eyes-open periods. Finally, in silico simulations of a balanced spiking neuron network qualitatively reproduce the experimental findings. Taken together, our analyses and simulations suggest that top-down signals modulate the population activity of V1. We postulate that the top-down modulation during the eyes-open periods prepares V1 for fast and efficient visual responses, resulting in a type of visual stand-by state.

Thalamocortical interactions shape hierarchical neural variability during stimulus perception

The brain is organized hierarchically to process sensory signals. But, how do functional connections within and across areas contribute to this hierarchical order? We addressed this problem in the thalamocortical network, while monkeys detected vibrotactile stimulus. During this task, we quantified neural variability and directed functional connectivity in simultaneously recorded neurons sharing the cutaneous receptive field within and across VPL and areas 3b and 1. Before stimulus onset, VPL and area 3b exhibited similar fast dynamics while area 1 showed slower timescales. During the stimulus presence, inter-trial neural variability increased along the network VPL-3b-1 while VPL established two main feedforward pathways with areas 3b and 1 to process the stimulus. This lower variability of VPL and area 3b was found to regulate feedforward thalamocortical pathways. Instead, intra-cortical interactions were only anticipated by higher intrinsic timescales in area 1. Overall, our results provide evidence of hierarchical functional roles along the thalamocortical network.

Distinct feedforward and feedback pathways for cell-type specific attention effects

Selective attention is thought to depend on enhanced firing activity in extrastriate areas. Theories suggest that this enhancement depends on selective inter-areal communication via gamma (30-80 Hz) phase-locking. To test this, we simultaneously recorded from different cell types and cortical layers of macaque V1 and V4. We find that while V1-V4 gamma phase-locking between local field potentials increases with attention, the V1 gamma rhythm does not engage V4 excitatory-neurons, but only fast-spiking interneurons in L4 of V4. By contrast, attention enhances V4 spike-rates in both excitatory and inhibitory cells, most strongly in L2/3. The rate increase in L2/3 of V4 precedes V1 in time. These findings suggest enhanced signal transmission with attention does not depend on inter-areal gamma phase-locking and show that the endogenous gamma rhythm has cell-type- and layer-specific effects on downstream target areas. Similar findings were made in the mouse visual system, based on opto-tagging of identified interneurons.

A multi-region recurrent circuit for evidence accumulation in rats

Decision-making based on noisy evidence requires accumulating evidence and categorizing it to form a choice. Here we evaluate a proposed feedforward and modular mapping of this process in rats: evidence accumulated in anterodorsal striatum (ADS) is categorized in prefrontal cortex (frontal orienting fields, FOF). Contrary to this, we show that both regions appear to be indistinguishable in their encoding/decoding of accumulator value and communicate this information bidirectionally. Consistent with a role for FOF in accumulation, silencing FOF to ADS projections impacted behavior throughout the accumulation period, even while nonselective FOF silencing did not. We synthesize these findings into a multi-region recurrent neural network trained with a novel approach. In-silico experiments reveal that multiple scales of recurrence in the cortico-striatal circuit rescue computation upon nonselective FOF perturbations. These results suggest that ADS and FOF accumulate evidence in a recurrent and distributed manner, yielding redundant representations and robustness to certain perturbations.

Multiscale chemogenetic dissection of fronto-temporal top-down regulation for object memory in primates

Visual object memory is a fundamental element of various cognitive abilities, and the underlying neural mechanisms have been extensively examined especially in the anterior temporal cortex of primates. However, both macroscopic large-scale functional network in which this region is embedded and microscopic neuron-level dynamics of top-down regulation it receives for object memory remains elusive. Here, we identified the orbitofrontal node as a critical partner of the anterior temporal node for object memory by combining whole-brain functional imaging during rest and a short-term object memory task in male macaques. Focal chemogenetic silencing of the identified orbitofrontal node downregulated both the local orbitofrontal and remote anterior temporal nodes during the task, in association with deteriorated mnemonic, but not perceptual, performance. Furthermore, imaging-guided neuronal recordings in the same monkeys during the same task causally revealed that orbitofrontal top-down modulation enhanced stimulus-selective mnemonic signal in individual anterior temporal neurons while leaving bottom-up perceptual signal unchanged. Furthermore, similar activity difference was also observed between correct and mnemonic error trials before silencing, suggesting its behavioral relevance. These multifaceted but convergent results provide a multiscale causal understanding of dynamic top-down regulation of the anterior temporal cortex along the ventral fronto-temporal network underpinning short-term object memory in primates.

Attention spotlight in V1-based cortico-cortical interactions in human visual hierarchy

Attention is often viewed as a mental spotlight, which can be scaled like a zoom lens at specific spatial locations and features a center-surround gradient. Here, we demonstrate a neural signature of attention spotlight in signal transmission along the visual hierarchy. fMRI background connectivity analysis was performed between retinotopic V1 and downstream areas to characterize the spatial distribution of inter-areal interaction under two attentional states. We found that, compared to diffused attention, focal attention sharpened the spatial gradient in the strength of the background connectivity. Dynamic causal modeling analysis further revealed the effect of attention in both the feedback and feedforward connectivity between V1 and extrastriate cortex. In a context which induced a strong effect of crowding, the effect of attention in the background connectivity profile diminished. Our findings reveal a context-dependent attention prioritization in information transmission via modulating the recurrent processing across the early stages in human visual cortex.

A dynamic neural resource model bridges sensory and working memory

Probing memory of a complex visual image within a few hundred milliseconds after its disappearance reveals significantly greater fidelity of recall than if the probe is delayed by as little as a second. Classically interpreted, the former taps into a detailed but rapidly decaying visual sensory or 'iconic' memory (IM), while the latter relies on capacity-limited but comparatively stable visual working memory (VWM). While iconic decay and VWM capacity have been extensively studied independently, currently no single framework quantitatively accounts for the dynamics of memory fidelity over these time scales. Here, we extend a stationary neural population model of VWM with a temporal dimension, incorporating rapid sensory-driven accumulation of activity encoding each visual feature in memory, and a slower accumulation of internal error that causes memorized features to randomly drift over time. Instead of facilitating read-out from an independent sensory store, an early cue benefits recall by lifting the effective limit on VWM signal strength imposed when multiple items compete for representation, allowing memory for the cued item to be supplemented with information from the decaying sensory trace. Empirical measurements of human recall dynamics validate these predictions while excluding alternative model architectures. A key conclusion is that differences in capacity classically thought to distinguish IM and VWM are in fact contingent upon a single resource-limited WM store.

Uncovering the Role of the Early Visual Cortex in Visual Mental Imagery

The question of whether the early visual cortex (EVC) is involved in visual mental imagery remains a topic of debate. In this paper, I propose that the inconsistency in findings can be explained by the unique challenges associated with investigating EVC activity during imagery. During perception, the EVC processes low-level features, which means that activity is highly sensitive to variation in visual details. If the EVC has the same role during visual mental imagery, any change in the visual details of the mental image would lead to corresponding changes in EVC activity. Within this context, the question should not be whether the EVC is 'active' during imagery but how its activity relates to specific imagery properties. Studies using methods that are sensitive to variation in low-level features reveal that imagery can recruit the EVC in similar ways as perception. However, not all mental images contain a high level of visual details. Therefore, I end by considering a more nuanced view, which states that imagery can recruit the EVC, but that does not mean that it always does so.

Brain-wide arousal signals are segregated from movement planning in the superior colliculus

The superior colliculus (SC) is traditionally considered a brain region that functions as an interface between processing visual inputs and generating eye movement outputs. Although its role as a primary reflex center is thought to be conserved across vertebrate species, evidence suggests that the SC has evolved to support higher-order cognitive functions including spatial attention. When it comes to oculomotor areas such as the SC, it is critical that high precision fixation and eye movements are maintained even in the presence of signals related to ongoing changes in cognition and brain state, both of which have the potential to interfere with eye position encoding and movement generation. In this study, we recorded spiking responses of neuronal populations in the SC while monkeys performed a memory-guided saccade task and found that the activity of some of the neurons fluctuated over tens of minutes. By leveraging the statistical power afforded by high-dimensional neuronal recordings, we were able to identify a low-dimensional pattern of activity that was correlated with the subjects' arousal levels. Importantly, we found that the spiking responses of deep-layer SC neurons were less correlated with this brain-wide arousal signal, and that neural activity associated with changes in pupil size and saccade tuning did not overlap in population activity space with movement initiation signals. Taken together, these findings provide a framework for understanding how signals related to cognition and arousal can be embedded in the population activity of oculomotor structures without compromising the fidelity of the motor output.

Top-down modulation of visual cortical stimulus encoding and gamma independent of firing rates

Neurons in primary visual cortex integrate sensory input with signals reflecting the animal's internal state to support flexible behavior. Internal variables, such as expectation, attention, or current goals, are imposed in a top-down manner via extensive feedback projections from higher-order areas. We optogenetically activated a high-order visual area, area 21a, in the lightly anesthetized cat (OptoTD), while recording from neuronal populations in V1. OptoTD induced strong, up to several fold, changes in gamma-band synchronization together with much smaller changes in firing rate, and the two effects showed no correlation. OptoTD effects showed specificity for the features of the simultaneously presented visual stimuli. OptoTD-induced changes in gamma synchronization, but not firing rates, were predictive of simultaneous changes in the amount of encoded stimulus information. Our findings suggest that one important role of top-down signals is to modulate synchronization and the information encoded by populations of sensory neurons.

Frequency Propagation: Multimechanism Learning in Nonlinear Physical Networks

We introduce frequency propagation, a learning algorithm for nonlinear physical networks. In a resistive electrical circuit with variable resistors, an activation current is applied at a set of input nodes at one frequency and an error current is applied at a set of output nodes at another frequency. The voltage response of the circuit to these boundary currents is the superposition of an activation signal and an error signal whose coefficients can be read in different frequencies of the frequency domain. Each conductance is updated proportionally to the product of the two coefficients. The learning rule is local and proved to perform gradient descent on a loss function. We argue that frequency propagation is an instance of a multimechanism learning strategy for physical networks, be it resistive, elastic, or flow networks. Multimechanism learning strategies incorporate at least two physical quantities, potentially governed by independent physical mechanisms, to act as activation and error signals in the training process. Locally available information about these two signals is then used to update the trainable parameters to perform gradient descent. We demonstrate how earlier work implementing learning via chemical signaling in flow networks (Anisetti, Scellier, et al., 2023) also falls under the rubric of multimechanism learning.

On the relationship between foveal mask interference and mental imagery in peripheral object recognition

A delayed foveal mask affects perception of peripheral stimuli. The effect is determined by the timing of the mask and by the similarity with the peripheral stimulus. A congruent mask enhances performance, while an incongruent one impairs it. It is hypothesized that foveal masks disrupt a feedback mechanism reaching the foveal cortex. This mechanism could be part of a broader circuit associated with mental imagery, but this hypothesis has not as yet been tested. We investigated the link between mental imagery and foveal feedback. We tested the relationship between performance fluctuations caused by the foveal mask-measured in terms of discriminability (d') and criterion (C)-and the scores from two questionnaires designed to assess mental imagery vividness (VVIQ) and another exploring object imagery, spatial imagery and verbal cognitive styles (OSIVQ). Contrary to our hypotheses, no significant correlations were found between VVIQ and the mask's impact on d' and C. Neither the object nor spatial subscales of OSIVQ correlated with the mask's impact. In conclusion, our findings do not substantiate the existence of a link between foveal feedback and mental imagery. Further investigation is needed to determine whether mask interference might occur with more implicit measures of imagery.

Action of GABAB receptor on local network oscillation in somatosensory cortex of oral part: focusing on NMDA receptor

The balance of activity between glutamatergic and GABAergic networks is particularly important for oscillatory neural activities in the brain. Here, we investigated the roles of GABAB receptors in network oscillation in the oral somatosensory cortex (OSC), focusing on NMDA receptors. Neural oscillation at the frequency of 8-10 Hz was elicited in rat brain slices after caffeine application. Oscillations comprised a non-NMDA receptor-dependent initial phase and a later NMDA receptor-dependent oscillatory phase, with the oscillator located in the upper layer of the OSC. Baclofen was applied to investigate the actions of GABAB receptors. The later NMDA receptor-dependent oscillatory phase completely disappeared, but the initial phase did not. These results suggest that GABAB receptors mainly act on NMDA receptor, in which metabotropic actions of GABAB receptors may contribute to the attenuation of NMDA receptor activities. A regulatory system for network oscillation involving GABAB receptors may be present in the OSC.

Paying attention to natural scenes in area V1

Natural scene responses in the primary visual cortex are modulated simultaneously by attention and by contextual signals about scene statistics stored across the connectivity of the visual processing hierarchy. We hypothesized that attentional and contextual signals interact in V1 in a manner that primarily benefits the representation of natural stimuli, rich in high-order statistical structure. Recording from two macaques engaged in a spatial attention task, we found that attention enhanced the decodability of stimulus identity from population responses evoked by natural scenes, but not by synthetic stimuli lacking higher-order statistical regularities. Population analysis revealed that neuronal responses converged to a low-dimensional subspace only for natural stimuli. Critically, we determined that the attentional enhancement in stimulus decodability was captured by the natural-scene subspace, indicating an alignment between the attentional and natural stimulus variance. These results suggest that attentional and contextual signals interact in V1 in a manner optimized for natural vision.

Behavior-relevant top-down cross-modal predictions in mouse neocortex

Animals adapt to a constantly changing world by predicting their environment and the consequences of their actions. The predictive coding hypothesis proposes that the brain generates predictions and continuously compares them with sensory inputs to guide behavior. However, how the brain reconciles conflicting top-down predictions and bottom-up sensory information remains unclear. To address this question, we simultaneously imaged neuronal populations in the mouse somatosensory barrel cortex and posterior parietal cortex during an auditory-cued texture discrimination task. In mice that had learned the task with fixed tone-texture matching, the presentation of mismatched pairing induced conflicts between tone-based texture predictions and actual texture inputs. When decisions were based on the predicted rather than the actual texture, top-down information flow was dominant and texture representations in both areas were modified, whereas dominant bottom-up information flow led to correct representations and behavioral choice. Our findings provide evidence for hierarchical predictive coding in the mouse neocortex.

Time-varying generalized linear models: characterizing and decoding neuronal dynamics in higher visual areas

To create a behaviorally relevant representation of the visual world, neurons in higher visual areas exhibit dynamic response changes to account for the time-varying interactions between external (e.g., visual input) and internal (e.g., reward value) factors. The resulting high-dimensional representational space poses challenges for precisely quantifying individual factors' contributions to the representation and readout of sensory information during a behavior. The widely used point process generalized linear model (GLM) approach provides a powerful framework for a quantitative description of neuronal processing as a function of various sensory and non-sensory inputs (encoding) as well as linking particular response components to particular behaviors (decoding), at the level of single trials and individual neurons. However, most existing variations of GLMs assume the neural systems to be time-invariant, making them inadequate for modeling nonstationary characteristics of neuronal sensitivity in higher visual areas. In this review, we summarize some of the existing GLM variations, with a focus on time-varying extensions. We highlight their applications to understanding neural representations in higher visual areas and decoding transient neuronal sensitivity as well as linking physiology to behavior through manipulation of model components. This time-varying class of statistical models provide valuable insights into the neural basis of various visual behaviors in higher visual areas and hold significant potential for uncovering the fundamental computational principles that govern neuronal processing underlying various behaviors in different regions of the brain.

Reaction time for correct identification of vowels in consonant-vowel syllables and of vowel segments

Reaction times for correct vowel identification were measured to determine the effects of intertrial intervals, vowel, and cue type. Thirteen adults with normal hearing, aged 20-38 years old, participated. Stimuli included three naturally produced syllables (/ba/ /bi/ /bu/) presented whole or segmented to isolate the formant transition or static formant center. Participants identified the vowel presented via loudspeaker by mouse click. Results showed a significant effect of intertrial intervals, no significant effect of cue type, and a significant vowel effect-suggesting that feedback occurs, vowel identification may depend on cue duration, and vowel bias may stem from focal structure.

Visual experience induces 4-8 Hz synchrony between V1 and higher-order visual areas

Visual perceptual experience induces persistent 4-8 Hz oscillations in the mouse primary visual cortex (V1), encoding visual familiarity. Recent studies suggest that higher-order visual areas (HVAs) are functionally specialized and segregated into information streams processing distinct visual features. However, whether visual memories are processed and stored within the distinct streams is not understood. We report here that V1 and lateromedial (LM), but not V1 and anterolateral, become more phase synchronized in 4-8 Hz after the entrainment of visual stimulus that maximally induces responses in LM. Directed information analysis reveals changes in the top-down functional connectivity between V1 and HVAs. Optogenetic inactivation of LM reduces post-stimulus oscillation peaks in V1 and impairs visual discrimination behavior. Our results demonstrate that 4-8 Hz familiarity-evoked oscillations are specific for the distinct visual features and are present in the corresponding HVAs, where they may be used for the inter-areal communication with V1 during memory-related behaviors.

Cellular and laminar architecture: A short history and commentary

The feedforward/feedback classification, as originally stated in relation to early visual areas in the macaque monkey, has had a significant influence on ideas of laminar interactions, area reciprocity, and cortical hierarchical organization. In some contrast with this macroscale "laminar connectomics," a more cellular approach to cortical connections, as briefly surveyed here, points to a still underappreciated heterogeneity of neuronal subtypes and complex microcircuitries. From the perspective of heterogeneities, the question of how brain regions interact and influence each other quickly leads to discussions about concurrent hierarchical and nonhierarchical cortical features, brain organization as a multiscale system forming nested groups and hierarchies, connectomes annotated by multiple biological attributes, and interleaved and overlapping scales of organization.

Brain-like Flexible Visual Inference by Harnessing Feedback-Feedforward Alignment

In natural vision, feedback connections support versatile visual inference capabilities such as making sense of the occluded or noisy bottom-up sensory information or mediating pure top-down processes such as imagination. However, the mechanisms by which the feedback pathway learns to give rise to these capabilities flexibly are not clear. We propose that top-down effects emerge through alignment between feedforward and feedback pathways, each optimizing its own objectives. To achieve this co-optimization, we introduce Feedback-Feedforward Alignment (FFA), a learning algorithm that leverages feedback and feedforward pathways as mutual credit assignment computational graphs, enabling alignment. In our study, we demonstrate the effectiveness of FFA in co-optimizing classification and reconstruction tasks on widely used MNIST and CIFAR10 datasets. Notably, the alignment mechanism in FFA endows feedback connections with emergent visual inference functions, including denoising, resolving occlusions, hallucination, and imagination. Moreover, FFA offers bio-plausibility compared to traditional back-propagation (BP) methods in implementation. By repurposing the computational graph of credit assignment into a goal-driven feedback pathway, FFA alleviates weight transport problems encountered in BP, enhancing the bio-plausibility of the learning algorithm. Our study presents FFA as a promising proof-of-concept for the mechanisms underlying how feedback connections in the visual cortex support flexible visual functions. This work also contributes to the broader field of visual inference underlying perceptual phenomena and has implications for developing more biologically inspired learning algorithms.

Early selection of task-relevant features through population gating

Brains can gracefully weed out irrelevant stimuli to guide behavior. This feat is believed to rely on a progressive selection of task-relevant stimuli across the cortical hierarchy, but the specific across-area interactions enabling stimulus selection are still unclear. Here, we propose that population gating, occurring within primary auditory cortex (A1) but controlled by top-down inputs from prelimbic region of medial prefrontal cortex (mPFC), can support across-area stimulus selection. Examining single-unit activity recorded while rats performed an auditory context-dependent task, we found that A1 encoded relevant and irrelevant stimuli along a common dimension of its neural space. Yet, the relevant stimulus encoding was enhanced along an extra dimension. In turn, mPFC encoded only the stimulus relevant to the ongoing context. To identify candidate mechanisms for stimulus selection within A1, we reverse-engineered low-rank RNNs trained on a similar task. Our analyses predicted that two context-modulated neural populations gated their preferred stimulus in opposite contexts, which we confirmed in further analyses of A1. Finally, we show in a two-region RNN how population gating within A1 could be controlled by top-down inputs from PFC, enabling flexible across-area communication despite fixed inter-areal connectivity.

Different roles of response covariability and its attentional modulation in the sensory cortex and posterior parietal cortex

The covariability of neural responses in the neuron population is highly relevant to the information encoding. Cognitive processes, such as attention, are found to modulate the covariability in the visual cortex to improve information encoding, suggesting the computational advantage of covariability modulation in the neural system. However, is the covariability modulation a general mechanism for enhanced information encoding throughout the information processing pathway, or only adopted in certain processing stages, depending on the property of neural representation? Here, with ultrahigh-field MRI, we examined the covariability, which was estimated by noise correlation, in different attention states in the early visual cortex and posterior parietal cortex (PPC) of the human brain, and its relationship to the quality of information encoding. Our results showed that while attention decreased the covariability to improve the stimulus encoding in the early visual cortex, covariability modulation was not observed in the PPC, where covariability had little impact on information encoding. Further, attention promoted the information flow between the early visual cortex and PPC, with an apparent emphasis on a flow from high- to low-dimensional representations, suggesting the existence of a reduction in the dimensionality of neural representation from the early visual cortex to PPC. Finally, the neural response patterns in the PPC could predict the amplitudes of covariability change in the early visual cortex, indicating a top-down control from the PPC to early visual cortex. Our findings reveal the specific roles of the sensory cortex and PPC during attentional modulation of covariability, determined by the complexity and fidelity of the neural representation in each cortical region.

Increasing associative plasticity in temporo-occipital back-projections improves visual perception of emotions

The posterior superior temporal sulcus (pSTS) is a critical node in a network specialized for perceiving emotional facial expressions that is reciprocally connected with early visual cortices (V1/V2). Current models of perceptual decision-making increasingly assign relevance to recursive processing for visual recognition. However, it is unknown whether inducing plasticity into reentrant connections from pSTS to V1/V2 impacts emotion perception. Using a combination of electrophysiological and neurostimulation methods, we demonstrate that strengthening the connectivity from pSTS to V1/V2 selectively increases the ability to perceive facial expressions associated with emotions. This behavior is associated with increased electrophysiological activity in both these brain regions, particularly in V1/V2, and depends on specific temporal parameters of stimulation that follow Hebbian principles. Therefore, we provide evidence that pSTS-to-V1/V2 back-projections are instrumental to perception of emotion from facial stimuli and functionally malleable via manipulation of associative plasticity.

Identification of interacting neural populations: methods and statistical considerations

As improved recording technologies have created new opportunities for neurophysiological investigation, emphasis has shifted from individual neurons to multiple populations that form circuits, and it has become important to provide evidence of cross-population coordinated activity. We review various methods for doing so, placing them in six major categories while avoiding technical descriptions and instead focusing on high-level motivations and concerns. Our aim is to indicate what the methods can achieve and the circumstances under which they are likely to succeed. Toward this end, we include a discussion of four cross-cutting issues: the definition of neural populations, trial-to-trial variability and Poisson-like noise, time-varying dynamics, and causality.

A recruitment through coherence theory of working memory

The interactions between prefrontal cortex and other areas during working memory have been studied for decades. Here we outline a conceptual framework describing interactions between these areas during working memory, and review evidence for key elements of this model. We specifically suggest that a top-down signal sent from prefrontal to sensory areas drives oscillations in these areas. Spike timing within sensory areas becomes locked to these working-memory-driven oscillations, and the phase of spiking conveys information about the representation available within these areas. Downstream areas receiving these phase-locked spikes from sensory areas can recover this information via a combination of coherent oscillations and gating of input efficacy based on the phase of their local oscillations. Although the conceptual framework is based on prefrontal interactions with sensory areas during working memory, we also discuss the broader implications of this framework for flexible communication between brain areas in general.

The Spatial Precision of Contextual Feedback Signals in Human V1

Neurons in the primary visual cortex (V1) receive sensory inputs that describe small, local regions of the visual scene and cortical feedback inputs from higher visual areas processing the global scene context. Investigating the spatial precision of this visual contextual modulation will contribute to our understanding of the functional role of cortical feedback inputs in perceptual computations. We used human functional magnetic resonance imaging (fMRI) to test the spatial precision of contextual feedback inputs to V1 during natural scene processing. We measured brain activity patterns in the stimulated regions of V1 and in regions that we blocked from direct feedforward input, receiving information only from non-feedforward (i.e., feedback and lateral) inputs. We measured the spatial precision of contextual feedback signals by generalising brain activity patterns across parametrically spatially displaced versions of identical images using an MVPA cross-classification approach. We found that fMRI activity patterns in cortical feedback signals predicted our scene-specific features in V1 with a precision of approximately 4 degrees. The stimulated regions of V1 carried more precise scene information than non-stimulated regions; however, these regions also contained information patterns that generalised up to 4 degrees. This result shows that contextual signals relating to the global scene are similarly fed back to V1 when feedforward inputs are either present or absent. Our results are in line with contextual feedback signals from extrastriate areas to V1, describing global scene information and contributing to perceptual computations such as the hierarchical representation of feature boundaries within natural scenes.

Convolutional neural networks for vision neuroscience: significance, developments, and outstanding issues

Convolutional Neural Networks (CNN) are a class of machine learning models predominately used in computer vision tasks and can achieve human-like performance through learning from experience. Their striking similarities to the structural and functional principles of the primate visual system allow for comparisons between these artificial networks and their biological counterparts, enabling exploration of how visual functions and neural representations may emerge in the real brain from a limited set of computational principles. After considering the basic features of CNNs, we discuss the opportunities and challenges of endorsing CNNs as in silico models of the primate visual system. Specifically, we highlight several emerging notions about the anatomical and physiological properties of the visual system that still need to be systematically integrated into current CNN models. These tenets include the implementation of parallel processing pathways from the early stages of retinal input and the reconsideration of several assumptions concerning the serial progression of information flow. We suggest design choices and architectural constraints that could facilitate a closer alignment with biology provide causal evidence of the predictive link between the artificial and biological visual systems. Adopting this principled perspective could potentially lead to new research questions and applications of CNNs beyond modeling object recognition.

Robust and efficient representations of dynamic stimuli in hierarchical neural networks via temporal smoothing

Introduction

Efficient coding that minimizes informational redundancy of neural representations is a widely accepted neural coding principle. Despite the benefit, maximizing efficiency in neural coding can make neural representation vulnerable to random noise. One way to achieve robustness against random noise is smoothening neural responses. However, it is not clear whether the smoothness of neural responses can hold robust neural representations when dynamic stimuli are processed through a hierarchical brain structure, in which not only random noise but also systematic error due to temporal lag can be induced.

Methods

In the present study, we showed that smoothness via spatio-temporally efficient coding can achieve both efficiency and robustness by effectively dealing with noise and neural delay in the visual hierarchy when processing dynamic visual stimuli.

Results

The simulation results demonstrated that a hierarchical neural network whose bidirectional synaptic connections were learned through spatio-temporally efficient coding with natural scenes could elicit neural responses to visual moving bars similar to those to static bars with the identical position and orientation, indicating robust neural responses against erroneous neural information. It implies that spatio-temporally efficient coding preserves the structure of visual environments locally in the neural responses of hierarchical structures.

Discussion

The present results suggest the importance of a balance between efficiency and robustness in neural coding for visual processing of dynamic stimuli across hierarchical brain structures.

Noninvasive modulation of predictive coding in humans: causal evidence for frequency-specific temporal dynamics

Increasing evidence indicates that the brain predicts sensory input based on past experiences, importantly constraining how we experience the world. Despite a growing interest on this framework, known as predictive coding, most of such approaches to multiple psychological domains continue to be theoretical or primarily provide correlational evidence. We here explored the neural basis of predictive processing using noninvasive brain stimulation and provide causal evidence of frequency-specific modulations in humans. Participants received 20 Hz (associated with top-down/predictions), 50 Hz (associated with bottom-up/prediction errors), or sham transcranial alternating current stimulation on the left dorsolateral prefrontal cortex while performing a social perception task in which facial expression predictions were induced and subsequently confirmed or violated. Left prefrontal 20 Hz stimulation reinforced stereotypical predictions. In contrast, 50 Hz and sham stimulation failed to yield any significant behavioral effects. Moreover, the frequency-specific effect observed was further supported by electroencephalography data, which showed a boost of brain activity at the stimulated frequency band. These observations provide causal evidence for how predictive processing may be enabled in the human brain, setting up a needed framework to understand how it may be disrupted across brain-related conditions and potentially restored through noninvasive methods.

Solving the binding problem: Assemblies form when neurons enhance their firing rate-they don't need to oscillate or synchronize

When we look at an image, its features are represented in our visual system in a highly distributed manner, calling for a mechanism that binds them into coherent object representations. There have been different proposals for the neuronal mechanisms that can mediate binding. One hypothesis is that binding is achieved by oscillations that synchronize neurons representing features of the same perceptual object. This view allows separate communication channels between different brain areas. Another hypothesis is that binding of features that are represented in different brain regions occurs when the neurons in these areas that respond to the same object simultaneously enhance their firing rate, which would correspond to directing object-based attention to these features. This review summarizes evidence in favor of and against these two hypotheses, examining the neuronal correlates of binding and assessing the time course of perceptual grouping. I conclude that enhanced neuronal firing rates bind features into coherent object representations, whereas oscillations and synchrony are unrelated to binding.

Comparing representations and computations in single neurons versus neural networks

Single-neuron-level explanations have been the gold standard in neuroscience for decades. Recently, however, neural-network-level explanations have become increasingly popular. This increase in popularity is driven by the fact that the analysis of neural networks can solve problems that cannot be addressed by analyzing neurons independently. In this opinion article, I argue that while both frameworks employ the same general logic to link physical and mental phenomena, in many cases the neural network framework provides better explanatory objects to understand representations and computations related to mental phenomena. I discuss what constitutes a mechanistic explanation in neural systems, provide examples, and conclude by highlighting a number of the challenges and considerations associated with the use of analyses of neural networks to study brain function.

Multiplexed Subspaces Route Neural Activity Across Brain-wide Networks

Cognition is flexible. Behaviors can change on a moment-by-moment basis. Such flexibility is thought to rely on the brain's ability to route information through different networks of brain regions in order to support different cognitive computations. However, the mechanisms that determine which network of brain regions is engaged are unknown. To address this, we combined cortex-wide calcium imaging with high-density electrophysiological recordings in eight cortical and subcortical regions of mice. Different dimensions within the population activity of each brain region were functionally connected with different cortex-wide 'subspace networks' of regions. These subspace networks were multiplexed, allowing a brain region to simultaneously interact with multiple independent, yet overlapping, networks. Alignment of neural activity within a region to a specific subspace network dimension predicted how neural activity propagated between regions. Thus, changing the geometry of the neural representation within a brain region could be a mechanism to selectively engage different brain-wide networks to support cognitive flexibility.

Suppressing feedback signals to visual cortex abolishes attentional modulation

Attention improves perception by enhancing the neural encoding of sensory information. A long-standing hypothesis is that cortical feedback projections carry top-down signals to influence sensory coding. However, this hypothesis has never been tested to establish causal links. We used viral tools to label feedback connections from cortical area V4 targeting early visual cortex (area V1). While monkeys performed a visual-spatial attention task, inactivating feedback axonal terminals in V1 without altering local intracortical and feedforward inputs reduced the response gain of single cells and impaired the accuracy of neural populations for encoding external stimuli. These effects are primarily manifested in the superficial layers of V1 and propagate to downstream area V4. Attention enhances sensory coding across visual cortex by specifically altering the strength of corticocortical feedback in a layer-dependent manner.

Information-processing dynamics in neural networks of macaque cerebral cortex reflect cognitive state and behavior

One of the essential functions of biological neural networks is the processing of information. This includes everything from processing sensory information to perceive the environment, up to processing motor information to interact with the environment. Due to methodological limitations, it has been historically unclear how information processing changes during different cognitive or behavioral states and to what extent information is processed within or between the network of neurons in different brain areas. In this study, we leverage recent advances in the calculation of information dynamics to explore neural-level processing within and between the frontoparietal areas AIP, F5, and M1 during a delayed grasping task performed by three macaque monkeys. While information processing was high within all areas during all cognitive and behavioral states of the task, interareal processing varied widely: During visuomotor transformation, AIP and F5 formed a reciprocally connected processing unit, while no processing was present between areas during the memory period. Movement execution was processed globally across all areas with predominance of processing in the feedback direction. Furthermore, the fine-scale network structure reconfigured at the neuron level in response to different grasping conditions, despite no differences in the overall amount of information present. These results suggest that areas dynamically form higher-order processing units according to the cognitive or behavioral demand and that the information-processing network is hierarchically organized at the neuron level, with the coarse network structure determining the behavioral state and finer changes reflecting different conditions.

Spatiotemporal dynamics in large-scale cortical networks

Investigating links between nervous system function and behavior requires monitoring neuronal activity at a range of spatial and temporal scales. Here, we summarize recent progress in applying two distinct but complementary approaches to the study of network dynamics in the neocortex. Mesoscopic calcium imaging allows simultaneous monitoring of activity across most of the cortex at moderate spatiotemporal resolution. Electrophysiological recordings provide extremely high temporal resolution of neural signals at multiple targeted locations. A number of recent studies have used these tools to reveal novel patterns of activity across distributed cortical subnetworks. This growing body of work strongly supports the hypothesis that the dynamic coordination of spatially distinct regions is a fundamental aspect of cortical function that supports cognition and behavior.

Population burst propagation across interacting areas of the brain

For many perceptual and behavioral tasks, a prominent feature of neural spike trains involves high firing rates across relatively short intervals of time. We call these events "population bursts." Because during a population burst information is, presumably, transmitted from one part of the brain to another, burst timing should reveal activity related to the flow of information across neural circuits. We developed a statistical method (based on a point process model) of determining, accurately, the time of the maximum (peak) population firing rate on a trial-by-trial basis and used it to characterize burst propagation across areas. We then examined the tendency of peak firing rates in distinct brain areas to shift earlier or later in time, together, across repeated trials, and found this trial-to-trial coupling of peak times to be a sensitive indicator of interaction across populations. In the data we examined, from the Allen Brain Observatory, we found many very strong correlations (95% confidence intervals above 0.75) in cases where standard methods were unable to demonstrate cross-area correlation. The statistical model introduced cross-area covariation only through population-level trial-dependent time shifts and gain constants (values of which were learned from the data), yet it provided very good fits to data histograms, including histograms of spike count correlations within and across visual areas. Our results demonstrate the utility of carefully assessing timing and propagation, across brain regions, of transient bursts in neural population activity, based on multiple spike train recordings.NEW & NOTEWORTHY We developed a novel statistical method for identifying coordinated propagation of activity across populations of spiking neurons, with high temporal accuracy. Using simultaneous recordings from three visual areas we document precise timing relationships on a trial-by-trial basis, and we show how previously existing techniques can fail to discover coordinated activity in cases where the new approach finds very strong cross-area correlation.

Disentangling the flow of signals between populations of neurons

Technological advances now allow us to record from large populations of neurons across multiple brain areas. These recordings may illuminate how communication between areas contributes to brain function, yet a substantial barrier remains: how do we disentangle the concurrent, bidirectional flow of signals between populations of neurons? We propose here a dimensionality reduction framework, delayed latents across groups (DLAG), that disentangles signals relayed in each direction, identifies how these signals are represented by each population and characterizes how they evolve within and across trials. We demonstrate that DLAG performs well on synthetic datasets similar in scale to current neurophysiological recordings. Then we study simultaneously recorded populations in primate visual areas V1 and V2, where DLAG reveals signatures of bidirectional yet selective communication. Our framework lays a foundation for dissecting the intricate flow of signals across populations of neurons, and how this signalling contributes to cortical computation.

Modular Organization of Signal Transmission in Primate Somatosensory Cortex

Axonal patches are known as the major sites of synaptic connections in the cerebral cortex of higher order mammals. However, the functional role of these patches is highly debated. Patches are formed by populations of nearby neurons in a topographic manner and are recognized as the termination fields of long-distance lateral connections within and between cortical areas. In addition, axons form numerous boutons that lie outside the patches, whose function is also unknown. To better understand the functional roles of these two distinct populations of boutons, we compared individual and collective morphological features of axons within and outside the patches of intra-areal, feedforward, and feedback pathways by way of tract tracing in the somatosensory cortex of New World monkeys. We found that, with the exception of tortuosity, which is an invariant property, bouton spacing and axonal convergence properties differ significantly between axons within patch and no-patch domains. Principal component analyses corroborated the clustering of axons according to patch formation without any additional effect by the type of pathway or laminar distribution. Stepwise logistic regression identified convergence and bouton density as the best predictors of patch formation. These findings support that patches are specific sites of axonal convergence that promote the synchronous activity of neuronal populations. On the other hand, no-patch domains could form a neuroanatomical substrate to diversify the responses of cortical neurons.