A hierarchy of intrinsic timescales across primate cortex

The Distributed Nature of Working Memory

Studies in humans and non-human primates have provided evidence for storage of working memory contents in multiple regions ranging from sensory to parietal and prefrontal cortex. We discuss potential explanations for these distributed representations: (i) features in sensory regions versus prefrontal cortex differ in the level of abstractness and generalizability; and (ii) features in prefrontal cortex reflect representations that are transformed for guidance of upcoming behavioral actions. We propose that the propensity to produce persistent activity is a general feature of cortical networks. Future studies may have to shift focus from asking where working memory can be observed in the brain to how a range of specialized brain areas together transform sensory information into a delayed behavioral response.

The graphical brain: Belief propagation and active inference

This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference-and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models. Crucially, these models can entertain both discrete and continuous states, leading to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to elucidate the requisite message passing in terms of its form and scheduling. To accommodate mixed generative models (of discrete and continuous states), one also has to consider link nodes or factors that enable discrete and continuous representations to talk to each other. When mapping the implicit computational architecture onto neuronal connectivity, several interesting features emerge. For example, Bayesian model averaging and comparison, which link discrete and continuous states, may be implemented in thalamocortical loops. These and other considerations speak to a computational connectome that is inherently state dependent and self-organizing in ways that yield to a principled (variational) account. We conclude with simulations of reading that illustrate the implicit neuronal message passing, with a special focus on how discrete (semantic) representations inform, and are informed by, continuous (visual) sampling of the sensorium.

AUTHOR SUMMARY

This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference-and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models that can entertain both discrete and continuous states. This leads to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to characterize the requisite message passing, and link this formal characterization to canonical microcircuits and extrinsic connectivity in the brain.

Neuronal pattern separation of motion-relevant input in LIP activity

In various regions of the brain, neurons discriminate sensory stimuli by decreasing the similarity between ambiguous input patterns. Here, we examine whether this process of pattern separation may drive the rapid discrimination of visual motion stimuli in the lateral intraparietal area (LIP). Starting with a simple mean-rate population model that captures neuronal activity in LIP, we show that overlapping input patterns can be reformatted dynamically to give rise to separated patterns of neuronal activity. The population model predicts that a key ingredient of pattern separation is the presence of heterogeneity in the response of individual units. Furthermore, the model proposes that pattern separation relies on heterogeneity in the temporal dynamics of neural activity and not merely in the mean firing rates of individual neurons over time. We confirm these predictions in recordings of macaque LIP neurons and show that the accuracy of pattern separation is a strong predictor of behavioral performance. Overall, results propose that LIP relies on neuronal pattern separation to facilitate decision-relevant discrimination of sensory stimuli.NEW & NOTEWORTHY A new hypothesis is proposed on the role of the lateral intraparietal (LIP) region of cortex during rapid decision making. This hypothesis suggests that LIP alters the representation of ambiguous inputs to reduce their overlap, thus improving sensory discrimination. A combination of computational modeling, theoretical analysis, and electrophysiological data shows that the pattern separation hypothesis links neural activity to behavior and offers novel predictions on the role of LIP during sensory discrimination.

Feedforward and feedback frequency-dependent interactions in a large-scale laminar network of the primate cortex

Interactions between top-down and bottom-up processes in the cerebral cortex hold the key to understanding attentional processes, predictive coding, executive control, and a gamut of other brain functions. However, the underlying circuit mechanism remains poorly understood and represents a major challenge in neuroscience. We approached this problem using a large-scale computational model of the primate cortex constrained by new directed and weighted connectivity data. In our model, the interplay between feedforward and feedback signaling depends on the cortical laminar structure and involves complex dynamics across multiple (intralaminar, interlaminar, interareal, and whole cortex) scales. The model was tested by reproducing, as well as providing insights into, a wide range of neurophysiological findings about frequency-dependent interactions between visual cortical areas, including the observation that feedforward pathways are associated with enhanced gamma (30 to 70 Hz) oscillations, whereas feedback projections selectively modulate alpha/low-beta (8 to 15 Hz) oscillations. Furthermore, the model reproduces a functional hierarchy based on frequency-dependent Granger causality analysis of interareal signaling, as reported in recent monkey and human experiments, and suggests a mechanism for the observed context-dependent hierarchy dynamics. Together, this work highlights the necessity of multiscale approaches and provides a modeling platform for studies of large-scale brain circuit dynamics and functions.

Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice

Correlates of value are routinely observed in the prefrontal cortex (PFC) during reward-guided decision making. In previous work (Hunt et al., 2015), we argued that PFC correlates of chosen value are a consequence of varying rates of a dynamical evidence accumulation process. Yet within PFC, there is substantial variability in chosen value correlates across individual neurons. Here we show that this variability is explained by neurons having different temporal receptive fields of integration, indexed by examining neuronal spike rate autocorrelation structure whilst at rest. We find that neurons with protracted resting temporal receptive fields exhibit stronger chosen value correlates during choice. Within orbitofrontal cortex, these neurons also sustain coding of chosen value from choice through the delivery of reward, providing a potential neural mechanism for maintaining predictions and updating stored values during learning. These findings reveal that within PFC, variability in temporal specialisation across neurons predicts involvement in specific decision-making computations.

DOI:http://dx.doi.org/10.7554/eLife.18937.001

History-dependent variability in population dynamics during evidence accumulation in cortex

We studied how the posterior parietal cortex combined new information with ongoing activity dynamics as mice accumulated evidence during a virtual-navigation task. Using new methods to analyze population activity on single trials, we found that activity transitioned rapidly between different sets of active neurons. Each event in a trial — whether an evidence cue or a behavioral choice — caused seconds-long modifications to the probabilities that govern how one activity pattern transitions to the next, forming a short-term memory. A sequence of evidence cues triggered a chain of these modifications resulting in a signal for accumulated evidence. Multiple distinguishable activity patterns were possible for the same accumulated evidence because representations of ongoing events were influenced by previous within and across trial events. Therefore, evidence accumulation need not require the explicit competition between groups of neurons, as in winner-take-all models, but could instead emerge implicitly from general dynamical properties that instantiate short-term memory.

A hierarchy of timescales explains distinct effects of local inhibition of primary visual cortex and frontal eye fields

Within the primate visual system, areas at lower levels of the cortical hierarchy process basic visual features, whereas those at higher levels, such as the frontal eye fields (FEF), are thought to modulate sensory processes via feedback connections. Despite these functional exchanges during perception, there is little shared activity between early and late visual regions at rest. How interactions emerge between regions encompassing distinct levels of the visual hierarchy remains unknown. Here we combined neuroimaging, non-invasive cortical stimulation and computational modelling to characterize changes in functional interactions across widespread neural networks before and after local inhibition of primary visual cortex or FEF. We found that stimulation of early visual cortex selectively increased feedforward interactions with FEF and extrastriate visual areas, whereas identical stimulation of the FEF decreased feedback interactions with early visual areas. Computational modelling suggests that these opposing effects reflect a fast-slow timescale hierarchy from sensory to association areas.

DOI:http://dx.doi.org/10.7554/eLife.15252.001

In humans, the parts of the brain involved in vision are organized into distinct regions that are arranged into a hierarchy. Each of these regions contains neurons that are specialized for a particular role, such as responding to shape, color or motion. To actually ‘see’ an object, these different regions must communicate with each other and exchange information via connections between lower and higher levels of the hierarchy. However, it remains unclear how these connections work.

A brain region called the primary visual cortex is the lowest level of the visual cortical hierarchy as it is the first area to receive information from the eye. This region then passes information to higher regions in the hierarchy including the frontal eye fields (FEF), which help to control visual attention and eye movements. In turn, the FEF is thought to provide ‘feedback’ to the primary visual cortex.

Cocchi et al. examined how the FEF and primary visual cortex communicate with the rest of the brain by temporarily inhibiting the activity of these regions in human volunteers. The experiments show that inhibiting the primary visual cortex increased communication between this region and higher level visual areas. On the other hand, inhibiting the FEF reduced communication between this region and lower visual areas.

Computer simulations revealed that inhibiting particular brain regions alters communication between visual regions by changing the timing of local neural activity. In the simulations, inhibiting the primary visual cortex slows down neural activity in that region, leading to better communication with higher regions, which already operate on slower timescales. By contrast, inhibition of the FEF reduces its influence on lower visual regions by increasing the difference in timescales of neural activity between these regions.

The next step is to determine whether similar mechanisms regulate changes in the activity of neural networks outside of the visual system.

DOI:http://dx.doi.org/10.7554/eLife.15252.002

A reanalysis of "Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons"

Neuronal activity in the central nervous system varies strongly in time and across neuronal populations. It is a longstanding proposal that such fluctuations generically arise from chaotic network dynamics. Various theoretical studies predict that the rich dynamics of rate models operating in the chaotic regime can subserve circuit computation and learning. Neurons in the brain, however, communicate via spikes and it is a theoretical challenge to obtain similar rate fluctuations in networks of spiking neuron models.

A recent study investigated spiking balanced networks of leaky integrate and fire (LIF) neurons and compared their dynamics to a matched rate network with identical topology, where single unit input-output functions were chosen from isolated LIF neurons receiving Gaussian white noise input. A mathematical analogy between the chaotic instability in networks of rate units and the spiking network dynamics was proposed.

Here we revisit the behavior of the spiking LIF networks and these matched rate networks. We find expected hallmarks of a chaotic instability in the rate network: For supercritical coupling strength near the transition point, the autocorrelation time diverges. For subcritical coupling strengths, we observe critical slowing down in response to small external perturbations. In the spiking network, we found in contrast that the timescale of the autocorrelations is insensitive to the coupling strength and that rate deviations resulting from small input perturbations rapidly decay. The decay speed even accelerates for increasing coupling strength.

In conclusion, our reanalysis demonstrates fundamental differences between the behavior of pulse-coupled spiking LIF networks and rate networks with matched topology and input-output function. In particular there is no indication of a corresponding chaotic instability in the spiking network.

How do abnormalities in the brain's spontaneous activity translate into symptoms in schizophrenia? From an overview of resting state activity findings to a proposed spatiotemporal psychopathology

Schizophrenia is a complex neuropsychiatric disorder with a variety of symptoms that include sensorimotor, affective, cognitive, and social changes. The exact neuronal mechanisms underlying these symptoms remain unclear though. Neuroimaging has focused mainly on the brain's extrinsic activity, specifically task-evoked or stimulus-induced activity, as related to the sensorimotor, affective, cognitive, and social functions. Recently, the focus has shifted to the brain's spontaneous activity, otherwise known as its resting state activity. While various spatial and temporal abnormalities have been observed in spontaneous activity in schizophrenia, their meaning and significance for the different psychopathological symptoms in schizophrenia, are yet to be defined. The first aim in this paper is to provide an overview of recent findings concerning changes in the spatial (e.g., functional connectivity) and temporal (e.g., couplings between different frequency fluctuations) properties of spontaneous activity in schizophrenia. The second aim is to link these spatiotemporal changes to the various psychopathological symptoms of schizophrenia, with a specific focus on basic symptoms, formal thought disorder, and ego-disturbances. Based on the various findings described, we postulate that the spatiotemporal changes on the neuronal level of the brain's spontaneous activity transform into corresponding spatiotemporal changes on the psychological level which, in turn, leads to the different kinds of psychopathological symptoms. We consequently suggest a spatiotemporal rather than cognitive or sensory approach to the condition, amounting to what we describe as "Spatiotemporal Psychopathology".

Toward Deep Brain Monitoring with Superficial EEG Sensors Plus Neuromodulatory Focused Ultrasound

Noninvasive recordings of electrophysiological activity have limited anatomic specificity and depth. We hypothesized that spatially tagging a small volume of brain with a unique electroencephalography (EEG) signal induced by pulsed focused ultrasound could overcome those limitations. As a first step toward testing this hypothesis, we applied transcranial ultrasound (2 MHz, 200-ms pulses applied at 1050 Hz for 1 s at a spatial peak temporal average intensity of 1.4 W/cm(2)) to the brains of anesthetized rats while simultaneously recording EEG signals. We observed a significant 1050-Hz electrophysiological signal only when ultrasound was applied to a living brain. Moreover, amplitude demodulation of the EEG signal at 1050 Hz yielded measurement of gamma band (>30 Hz) brain activity consistent with direct measurements of that activity. These results represent preliminary support for use of pulsed focused ultrasound as a spatial tagging mechanism for non-invasive EEG-based mapping of deep brain activity with high spatial resolution.

How the prefrontal executive got its stripes

Pathways from cortical and subcortical structures give the prefrontal cortex a panoramic view of the sensory environment and the internal milieu of motives and drives. The prefrontal cortex also receives privileged information from the output of the basal ganglia and cerebellum and innervates widely the inhibitory thalamic reticular nucleus that gates thalamo-cortical communication. Connections, in general, are strongly related to the systematic structural variation of the cortex that can be traced to development. Insights from development have profound implications for the special connections of the prefrontal cortex for executive control, learning and memory, and vulnerability in psychiatric and neurologic diseases.

Predict or classify: The deceptive role of time-locking in brain signal classification

Several experimental studies claim to be able to predict the outcome of simple decisions from brain signals measured before subjects are aware of their decision. Often, these studies use multivariate pattern recognition methods with the underlying assumption that the ability to classify the brain signal is equivalent to predict the decision itself. Here we show instead that it is possible to correctly classify a signal even if it does not contain any predictive information about the decision. We first define a simple stochastic model that mimics the random decision process between two equivalent alternatives, and generate a large number of independent trials that contain no choice-predictive information. The trials are first time-locked to the time point of the final event and then classified using standard machine-learning techniques. The resulting classification accuracy is above chance level long before the time point of time-locking. We then analyze the same trials using information theory. We demonstrate that the high classification accuracy is a consequence of time-locking and that its time behavior is simply related to the large relaxation time of the process. We conclude that when time-locking is a crucial step in the analysis of neural activity patterns, both the emergence and the timing of the classification accuracy are affected by structural properties of the network that generates the signal.

Varying Timescales of Stimulus Integration Unite Neural Adaptation and Prototype Formation

Human visual perception is both stable and adaptive. Perception of complex objects, such as faces, is shaped by the long-term average of experience as well as immediate, comparative context. Measurements of brain activity have demonstrated corresponding neural mechanisms, including norm-based responses reflective of stored prototype representations, and adaptation induced by the immediately preceding stimulus. Here, we consider the possibility that these apparently separate phenomena can arise from a single mechanism of sensory integration operating over varying timescales. We used fMRI to measure neural responses from the fusiform gyrus while subjects observed a rapid stream of face stimuli. Neural activity at this cortical site was best explained by the integration of sensory experience over multiple sequential stimuli, following a decaying-exponential weighting function. Although this neural activity could be mistaken for immediate neural adaptation or long-term, norm-based responses, it in fact reflected a timescale of integration intermediate to both. We then examined the timescale of sensory integration across the cortex. We found a gradient that ranged from rapid sensory integration in early visual areas, to long-term, stable representations in higher-level, ventral-temporal cortex. These findings were replicated with a new set of face stimuli and subjects. Our results suggest that a cascade of visual areas integrate sensory experience, transforming highly adaptable responses at early stages to stable representations at higher levels.

Reservoir Computing Properties of Neural Dynamics in Prefrontal Cortex

Primates display a remarkable ability to adapt to novel situations. Determining what is most pertinent in these situations is not always possible based only on the current sensory inputs, and often also depends on recent inputs and behavioral outputs that contribute to internal states. Thus, one can ask how cortical dynamics generate representations of these complex situations. It has been observed that mixed selectivity in cortical neurons contributes to represent diverse situations defined by a combination of the current stimuli, and that mixed selectivity is readily obtained in randomly connected recurrent networks. In this context, these reservoir networks reproduce the highly recurrent nature of local cortical connectivity. Recombining present and past inputs, random recurrent networks from the reservoir computing framework generate mixed selectivity which provides pre-coded representations of an essentially universal set of contexts. These representations can then be selectively amplified through learning to solve the task at hand. We thus explored their representational power and dynamical properties after training a reservoir to perform a complex cognitive task initially developed for monkeys. The reservoir model inherently displayed a dynamic form of mixed selectivity, key to the representation of the behavioral context over time. The pre-coded representation of context was amplified by training a feedback neuron to explicitly represent this context, thereby reproducing the effect of learning and allowing the model to perform more robustly. This second version of the model demonstrates how a hybrid dynamical regime combining spatio-temporal processing of reservoirs, and input driven attracting dynamics generated by the feedback neuron, can be used to solve a complex cognitive task. We compared reservoir activity to neural activity of dorsal anterior cingulate cortex of monkeys which revealed similar network dynamics. We argue that reservoir computing is a pertinent framework to model local cortical dynamics and their contribution to higher cognitive function.

One of the most noteworthy properties of primate behavior is its diversity and adaptability. Human and non-human primates can learn an astonishing variety of novel behaviors that could not have been directly anticipated by evolution. How then can the nervous system be prewired to anticipate the ability to represent such an open class of behaviors? Recent developments in a branch of recurrent neural networks, referred to as reservoir computing, begins to shed light on this question. The novelty of reservoir computing is that the recurrent connections in the network are fixed, and only the connections from these neurons to the output neurons change with learning. The fixed recurrent connections provide the network with an inherent high dimensional dynamics that creates essentially all possible spatial and temporal combinations of the inputs which can then be selected, by learning, to perform the desired task. This high dimensional mixture of activity inherent to reservoirs has begun to be found in the primate cortex. Here we make direct comparisons between dynamic coding in the cortex and in reservoirs performing the same task, and contribute to the emerging evidence that cortex has significant reservoir properties.

A Probabilistic Approach to Receptive Field Mapping in the Frontal Eye Fields

Studies of the neuronal mechanisms of perisaccadic vision often lack the resolution needed to determine important changes in receptive field (RF) structure. Such limited analytical power can lead to inaccurate descriptions of visuomotor processing. To address this issue, we developed a precise, probabilistic technique that uses a generalized linear model (GLM) for mapping the visual RFs of frontal eye field (FEF) neurons during stable fixation (Mayo et al., 2015). We previously found that full-field RF maps could be obtained using 1–8 dot stimuli presented at frame rates of 10–150 ms. FEF responses were generally robust to changes in the number of stimuli presented or the rate of presentation, which allowed us to visualize RFs over a range of spatial and temporal resolutions. Here, we compare the quality of RFs obtained over different stimulus and GLM parameters to facilitate future work on the detailed mapping of FEF RFs. We first evaluate the interactions between the number of stimuli presented per trial, the total number of trials, and the quality of RF mapping. Next, we vary the spatial resolution of our approach to illustrate the tradeoff between visualizing RF sub-structure and sampling at high resolutions. We then evaluate local smoothing as a possible correction for situations where under-sampling occurs. Finally, we provide a preliminary demonstration of the usefulness of a probabilistic approach for visualizing full-field perisaccadic RF shifts. Our results present a powerful, and perhaps necessary, framework for studying perisaccadic vision that is applicable to FEF and possibly other visuomotor regions of the brain.

Magnitude Estimation with Noisy Integrators Linked by an Adaptive Reference

Judgments of physical stimuli show characteristic biases; relatively small stimuli are overestimated whereas relatively large stimuli are underestimated (regression effect). Such biases likely result from a strategy that seeks to minimize errors given noisy estimates about stimuli that itself are drawn from a distribution, i.e., the statistics of the environment. While being conceptually well described, it is unclear how such a strategy could be implemented neurally. The present paper aims toward answering this question. A theoretical approach is introduced that describes magnitude estimation as two successive stages of noisy (neural) integration. Both stages are linked by a reference memory that is updated with every new stimulus. The model reproduces the behavioral characteristics of magnitude estimation and makes several experimentally testable predictions. Moreover, the model identifies the regression effect as a means of minimizing estimation errors and explains how this optimality strategy depends on the subject's discrimination abilities and on the stimulus statistics. The latter influence predicts another property of magnitude estimation, the so-called range effect. Beyond being successful in describing decision-making, the present work suggests that noisy integration may also be important in processing magnitudes.

Processing Timescales as an Organizing Principle for Primate Cortex

An emerging view posits a timescale-based cortical topography, with integration windows increasing from sensory to association areas. In this issue, Chaudhuri et al. (2015) present a cortical model wherein a hierarchy of timescales arises from local and inter-regional circuit dynamics.

Canonical computations of cerebral cortex

The idea that there is a fundamental cortical circuit that performs canonical computations remains compelling though far from proven. Here we review evidence for two canonical operations within sensory cortical areas: a feedforward computation of selectivity; and a recurrent computation of gain in which, given sufficiently strong external input, perhaps from multiple sources, intracortical input largely, but not completely, cancels this external input. This operation leads to many characteristic cortical nonlinearities in integrating multiple stimuli. The cortical computation must combine such local processing with hierarchical processing across areas. We point to important changes in moving from sensory cortex to motor and frontal cortex and the possibility of substantial differences between cortex in rodents vs. species with columnar organization of selectivity.

Functional hierarchy underlies preferential connectivity disturbances in schizophrenia

Schizophrenia may involve an elevated excitation/inhibition (E/I) ratio in cortical microcircuits. It remains unknown how this regulatory disturbance maps onto neuroimaging findings. To address this issue, we implemented E/I perturbations within a neural model of large-scale functional connectivity, which predicted hyperconnectivity following E/I elevation. To test predictions, we examined resting-state functional MRI in 161 schizophrenia patients and 164 healthy subjects. As predicted, patients exhibited elevated functional connectivity that correlated with symptom levels, and was most prominent in association cortices, such as the fronto-parietal control network. This pattern was absent in patients with bipolar disorder (n = 73). To account for the pattern observed in schizophrenia, we integrated neurobiologically plausible, hierarchical differences in association vs. sensory recurrent neuronal dynamics into our model. This in silico architecture revealed preferential vulnerability of association networks to E/I imbalance, which we verified empirically. Reported effects implicate widespread microcircuit E/I imbalance as a parsimonious mechanism for emergent inhomogeneous dysconnectivity in schizophrenia.

Neural Basis of Strategic Decision Making

Human choice behaviors during social interactions often deviate from the predictions of game theory. This might arise partly from the limitations in the cognitive abilities necessary for recursive reasoning about the behaviors of others. In addition, during iterative social interactions, choices might change dynamically as knowledge about the intentions of others and estimates for choice outcomes are incrementally updated via reinforcement learning. Some of the brain circuits utilized during social decision making might be general-purpose and contribute to isomorphic individual and social decision making. By contrast, regions in the medial prefrontal cortex (mPFC) and temporal parietal junction (TPJ) might be recruited for cognitive processes unique to social decision making.

Untangling Brain-Wide Dynamics in Consciousness by Cross-Embedding

Brain-wide interactions generating complex neural dynamics are considered crucial for emergent cognitive functions. However, the irreducible nature of nonlinear and high-dimensional dynamical interactions challenges conventional reductionist approaches. We introduce a model-free method, based on embedding theorems in nonlinear state-space reconstruction, that permits a simultaneous characterization of complexity in local dynamics, directed interactions between brain areas, and how the complexity is produced by the interactions. We demonstrate this method in large-scale electrophysiological recordings from awake and anesthetized monkeys. The cross-embedding method captures structured interaction underlying cortex-wide dynamics that may be missed by conventional correlation-based analysis, demonstrating a critical role of time-series analysis in characterizing brain state. The method reveals a consciousness-related hierarchy of cortical areas, where dynamical complexity increases along with cross-area information flow. These findings demonstrate the advantages of the cross-embedding method in deciphering large-scale and heterogeneous neuronal systems, suggesting a crucial contribution by sensory-frontoparietal interactions to the emergence of complex brain dynamics during consciousness.

Low frequency steady-state brain responses modulate large scale functional networks in a frequency-specific means

Neural oscillations are essential for brain functions. Research has suggested that the frequency of neural oscillations is lower for more integrative and remote communications. In this vein, some resting-state studies have suggested that large scale networks function in the very low frequency range (<1 Hz). However, it is difficult to determine the frequency characteristics of brain networks because both resting-state studies and conventional frequency tagging approaches cannot simultaneously capture multiple large scale networks in controllable cognitive activities. In this preliminary study, we aimed to examine whether large scale networks can be modulated by task-induced low frequency steady-state brain responses (lfSSBRs) in a frequency-specific pattern. In a revised attention network test, the lfSSBRs were evoked in the triple network system and sensory-motor system, indicating that large scale networks can be modulated in a frequency tagging way. Furthermore, the inter- and intranetwork synchronizations as well as coherence were increased at the fundamental frequency and the first harmonic rather than at other frequency bands, indicating a frequency-specific modulation of information communication. However, there was no difference among attention conditions, indicating that lfSSBRs modulate the general attention state much stronger than distinguishing attention conditions. This study provides insights into the advantage and mechanism of lfSSBRs. More importantly, it paves a new way to investigate frequency-specific large scale brain activities.

Distinct recurrent versus afferent dynamics in cortical visual processing

How intracortical recurrent circuits in mammalian sensory cortex influence dynamics of sensory representation is not understood. Previous methods could not distinguish the relative contributions of recurrent circuits and thalamic afferents to cortical dynamics. We accomplish this by optogenetically manipulating thalamus and cortex. Over the initial 40 ms of visual stimulation, excitation from recurrent circuits in visual cortex progressively increased to exceed direct thalamocortical excitation. Even when recurrent excitation exceeded thalamic excitation, upon silencing thalamus, sensory-evoked activity in cortex decayed rapidly, with a time constant of 10 ms, which is similar to a neuron's integration time window. In awake mice, this cortical decay function predicted the time-locking of cortical activity to thalamic input at frequencies <15 Hz and attenuation of the cortical response to higher frequencies. Under anesthesia, depression at thalamocortical synapses disrupted the fidelity of sensory transmission. Thus, we determine dynamics intrinsic to cortical recurrent circuits that transform afferent input in time.

A Large-Scale Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex

We developed a large-scale dynamical model of the macaque neocortex, which is based on recently acquired directed- and weighted-connectivity data from tract-tracing experiments, and which incorporates heterogeneity across areas. A hierarchy of timescales naturally emerges from this system: sensory areas show brief, transient responses to input (appropriate for sensory processing), whereas association areas integrate inputs over time and exhibit persistent activity (suitable for decision-making and working memory). The model displays multiple temporal hierarchies, as evidenced by contrasting responses to visual versus somatosensory stimulation. Moreover, slower prefrontal and temporal areas have a disproportionate impact on global brain dynamics. These findings establish a circuit mechanism for "temporal receptive windows" that are progressively enlarged along the cortical hierarchy, suggest an extension of time integration in decision making from local to large circuits, and should prompt a re-evaluation of the analysis of functional connectivity (measured by fMRI or electroencephalography/magnetoencephalography) by taking into account inter-areal heterogeneity.

Spatial diversity of spontaneous activity in the cortex

The neocortex is a layered sheet across which a basic organization is thought to widely apply. The variety of spontaneous activity patterns is similar throughout the cortex, consistent with the notion of a basic cortical organization. However, the basic organization is only an outline which needs adjustments and additions to account for the structural and functional diversity across cortical layers and areas. Such diversity suggests that spontaneous activity is spatially diverse in any particular behavioral state. Accordingly, this review summarizes the laminar and areal diversity in cortical activity during fixation and slow oscillations, and the effects of attention, anesthesia and plasticity on the cortical distribution of spontaneous activity. Among questions that remain open, characterizing the spatial diversity in spontaneous membrane potential may help elucidate how differences in circuitry among cortical regions supports their varied functions. More work is also needed to understand whether cortical spontaneous activity not only reflects cortical circuitry, but also contributes to determining the outcome of plasticity, so that it is itself a factor shaping the functional diversity of the cortex.

Time-varying effective connectivity during visual object naming as a function of semantic demands

Accumulating evidence suggests that visual object understanding involves a rapid feedforward sweep, after which subsequent recurrent interactions are necessary. The extent to which recurrence plays a critical role in object processing remains to be determined. Recent studies have demonstrated that recurrent processing is modulated by increasing semantic demands. Differentially from previous studies, we used dynamic causal modeling to model neural activity recorded with magnetoencephalography while 14 healthy humans named two sets of visual objects that differed in the degree of semantic accessing demands, operationalized in terms of the values of basic psycholinguistic variables associated with the presented objects (age of acquisition, frequency, and familiarity). This approach allowed us to estimate the directionality of the causal interactions among brain regions and their associated connectivity strengths. Furthermore, to understand the dynamic nature of connectivity (i.e., the chronnectome; Calhoun et al., 2014) we explored the time-dependent changes of effective connectivity during a period (200-400 ms) where adding semantic-feature information improves modeling and classifying visual objects, at 50 ms increments. First, we observed a graded involvement of backward connections, that became active beyond 200 ms. Second, we found that semantic demands caused a suppressive effect in the backward connection from inferior frontal cortex (IFC) to occipitotemporal cortex over time. These results complement those from previous studies underscoring the role of IFC as a common source of top-down modulation, which drives recurrent interactions with more posterior regions during visual object recognition. Crucially, our study revealed the inhibitory modulation of this interaction in situations that place greater demands on the conceptual system.

Spatiotemporal Spike Coding of Behavioral Adaptation in the Dorsal Anterior Cingulate Cortex

The frontal cortex controls behavioral adaptation in environments governed by complex rules. Many studies have established the relevance of firing rate modulation after informative events signaling whether and how to update the behavioral policy. However, whether the spatiotemporal features of these neuronal activities contribute to encoding imminent behavioral updates remains unclear. We investigated this issue in the dorsal anterior cingulate cortex (dACC) of monkeys while they adapted their behavior based on their memory of feedback from past choices. We analyzed spike trains of both single units and pairs of simultaneously recorded neurons using an algorithm that emulates different biologically plausible decoding circuits. This method permits the assessment of the performance of both spike-count and spike-timing sensitive decoders. In response to the feedback, single neurons emitted stereotypical spike trains whose temporal structure identified informative events with higher accuracy than mere spike count. The optimal decoding time scale was in the range of 70-200 ms, which is significantly shorter than the memory time scale required by the behavioral task. Importantly, the temporal spiking patterns of single units were predictive of the monkeys' behavioral response time. Furthermore, some features of these spiking patterns often varied between jointly recorded neurons. All together, our results suggest that dACC drives behavioral adaptation through complex spatiotemporal spike coding. They also indicate that downstream networks, which decode dACC feedback signals, are unlikely to act as mere neural integrators.

The frequency dimension of fMRI dynamic connectivity: Network connectivity, functional hubs and integration in the resting brain

The large-scale functional MRI connectome of the human brain is composed of multiple resting-state networks (RSNs). However, the network dynamics, such as integration and segregation between and within RSNs is largely unknown. To address this question we created high-resolution "frequency graphlets", connectivity matrices derived across the low-frequency spectrum of the BOLD fMRI resting-state signal (0.01-0.1 Hz) in a cohort of 100 subjects. We then apply and compare graph theoretical measures across the frequency graphlets. Our results show that the within- and between-network connectivity and presence of functional hubs shift as a function of frequency. Furthermore, we show that the small world network property peaks at different frequencies with corresponding spatial connectivity profiles. We conclude that the frequency dependence of the network connectivity and the spatial configuration of functional hubs suggest that the dynamics of large-scale network integration and segregation operate at different time scales.

Asynchronous Rate Chaos in Spiking Neuronal Circuits

The brain exhibits temporally complex patterns of activity with features similar to those of chaotic systems. Theoretical studies over the last twenty years have described various computational advantages for such regimes in neuronal systems. Nevertheless, it still remains unclear whether chaos requires specific cellular properties or network architectures, or whether it is a generic property of neuronal circuits. We investigate the dynamics of networks of excitatory-inhibitory (EI) spiking neurons with random sparse connectivity operating in the regime of balance of excitation and inhibition. Combining Dynamical Mean-Field Theory with numerical simulations, we show that chaotic, asynchronous firing rate fluctuations emerge generically for sufficiently strong synapses. Two different mechanisms can lead to these chaotic fluctuations. One mechanism relies on slow I-I inhibition which gives rise to slow subthreshold voltage and rate fluctuations. The decorrelation time of these fluctuations is proportional to the time constant of the inhibition. The second mechanism relies on the recurrent E-I-E feedback loop. It requires slow excitation but the inhibition can be fast. In the corresponding dynamical regime all neurons exhibit rate fluctuations on the time scale of the excitation. Another feature of this regime is that the population-averaged firing rate is substantially smaller in the excitatory population than in the inhibitory population. This is not necessarily the case in the I-I mechanism. Finally, we discuss the neurophysiological and computational significance of our results.

A neuro-computational model of economic decisions

Neuronal recordings and lesion studies indicate that key aspects of economic decisions take place in the orbitofrontal cortex (OFC). Previous work identified in this area three groups of neurons encoding the offer value, the chosen value, and the identity of the chosen good. An important and open question is whether and how decisions could emerge from a neural circuit formed by these three populations. Here we adapted a biophysically realistic neural network previously proposed for perceptual decisions (Wang XJ. Neuron 36: 955-968, 2002; Wong KF, Wang XJ. J Neurosci 26: 1314-1328, 2006). The domain of economic decisions is significantly broader than that for which the model was originally designed, yet the model performed remarkably well. The input and output nodes of the network were naturally mapped onto two groups of cells in OFC. Surprisingly, the activity of interneurons in the network closely resembled that of the third group of cells, namely, chosen value cells. The model reproduced several phenomena related to the neuronal origins of choice variability. It also generated testable predictions on the excitatory/inhibitory nature of different neuronal populations and on their connectivity. Some aspects of the empirical data were not reproduced, but simple extensions of the model could overcome these limitations. These results render a biologically credible model for the neuronal mechanisms of economic decisions. They demonstrate that choices could emerge from the activity of cells in the OFC, suggesting that chosen value cells directly participate in the decision process. Importantly, Wang's model provides a platform to investigate the implications of neuroscience results for economic theory.

'Activity-silent' working memory in prefrontal cortex: a dynamic coding framework

•

WM is thought to depend on persistent maintenance of stationary activity states.

•

However, population-level analyses reveal that brain activity is highly dynamic.

•

Accumulating evidence implicates activity-silent neural states for WM.

•

Dynamic coding suggests that WM is encoded in patterns of functional connectivity.

Working memory (WM) provides the functional backbone to high-level cognition. Maintenance in WM is often assumed to depend on the stationary persistence of neural activity patterns that represent memory content. However, accumulating evidence suggests that persistent delay activity does not always accompany WM maintenance but instead seems to wax and wane as a function of the current task relevance of memoranda. Furthermore, new methods for measuring and analysing population-level patterns show that activity states are highly dynamic. At first glance, these dynamics seem at odds with the very nature of WM. How can we keep a stable thought in mind while brain activity is constantly changing? This review considers how neural dynamics might be functionally important for WM maintenance.

Hierarchical process memory: memory as an integral component of information processing

Models of working memory (WM) commonly focus on how information is encoded into and retrieved from storage at specific moments. However, in the majority of real-life processes, past information is used continuously to process incoming information across multiple timescales. Considering single-unit, electrocorticography, and functional imaging data, we argue that (i) virtually all cortical circuits can accumulate information over time, and (ii) the timescales of accumulation vary hierarchically, from early sensory areas with short processing timescales (10s to 100s of milliseconds) to higher-order areas with long processing timescales (many seconds to minutes). In this hierarchical systems perspective, memory is not restricted to a few localized stores, but is intrinsic to information processing that unfolds throughout the brain on multiple timescales.

Dwelling quietly in the rich club: brain network determinants of slow cortical fluctuations

For more than a century, cerebral cartography has been driven by investigations of structural and morphological properties of the brain across spatial scales and the temporal/functional phenomena that emerge from these underlying features. The next era of brain mapping will be driven by studies that consider both of these components of brain organization simultaneously--elucidating their interactions and dependencies. Using this guiding principle, we explored the origin of slowly fluctuating patterns of synchronization within the topological core of brain regions known as the rich club, implicated in the regulation of mood and introspection. We find that a constellation of densely interconnected regions that constitute the rich club (including the anterior insula, amygdala and precuneus) play a central role in promoting a stable, dynamical core of spontaneous activity in the primate cortex. The slow timescales are well matched to the regulation of internal visceral states, corresponding to the somatic correlates of mood and anxiety. In contrast, the topology of the surrounding 'feeder' cortical regions shows unstable, rapidly fluctuating dynamics likely to be crucial for fast perceptual processes. We discuss these findings in relation to psychiatric disorders and the future of connectomics.

On self-feedback connectivity in neural mass models applied to event-related potentials

Neural mass models (NMMs) applied to neuroimaging data often do not emphasise intrinsic self-feedback within a neural population. However, based on mean-field theory, any population of coupled neurons is intrinsically endowed with effective self-coupling. In this work, we examine the effectiveness of three cortical NMMs with different self-feedbacks using a dynamic causal modelling approach. Specifically, we compare the classic Jansen and Rit (1995) model (no self-feedback), a modified model by Moran et al. (2007) (only inhibitory self-feedback), and our proposed model with inhibitory and excitatory self-feedbacks. Using bifurcation analysis, we show that single-unit Jansen-Rit model is less robust in generating oscillatory behaviour than the other two models. Next, under Bayesian inversion, we simulate single-channel event-related potentials (ERPs) within a mismatch negativity auditory oddball paradigm. We found fully self-feedback model (FSM) to provide the best fit to single-channel data. By analysing the posterior covariances of model parameters, we show that self-feedback connections are less sensitive to the generated evoked responses than the other model parameters, and hence can be treated analogously to "higher-order" parameter corrections of the original Jansen-Rit model. This is further supported in the more realistic multi-area case where FSM can replicate data better than JRM and MoM in the majority of subjects by capturing the finer features of the ERP data more accurately. Our work informs how NMMs with full self-feedback connectivity are not only more consistent with the underlying neurophysiology, but can also account for more complex features in ERP data.

Differences in human cortical gene expression match the temporal properties of large-scale functional networks

We explore the relationships between the cortex functional organization and genetic expression (as provided by the Allen Human Brain Atlas). Previous work suggests that functional cortical networks (resting state and task based) are organized as two large networks (differentiated by their preferred information processing mode) shaped like two rings. The first ring–Visual-Sensorimotor-Auditory (VSA)–comprises visual, auditory, somatosensory, and motor cortices that process real time world interactions. The second ring–Parieto-Temporo-Frontal (PTF)–comprises parietal, temporal, and frontal regions with networks dedicated to cognitive functions, emotions, biological needs, and internally driven rhythms. We found–with correspondence analysis–that the patterns of expression of the 938 genes most differentially expressed across the cortex organized the cortex into two sets of regions that match the two rings. We confirmed this result using discriminant correspondence analysis by showing that the genetic profiles of cortical regions can reliably predict to what ring these regions belong. We found that several of the proteins–coded by genes that most differentiate the rings–were involved in neuronal information processing such as ionic channels and neurotransmitter release. The systematic study of families of genes revealed specific proteins within families preferentially expressed in each ring. The results showed strong congruence between the preferential expression of subsets of genes, temporal properties of the proteins they code, and the preferred processing modes of the rings. Ionic channels and release-related proteins more expressed in the VSA ring favor temporal precision of fast evoked neural transmission (Sodium channels SCNA1, SCNB1 potassium channel KCNA1, calcium channel CACNA2D2, Synaptotagmin SYT2, Complexin CPLX1, Synaptobrevin VAMP1). Conversely, genes expressed in the PTF ring favor slower, sustained, or rhythmic activation (Sodium channels SCNA3, SCNB3, SCN9A potassium channels KCNF1, KCNG1) and facilitate spontaneous transmitter release (calcium channel CACNA1H, Synaptotagmins SYT5, Complexin CPLX3, and synaptobrevin VAMP2).

Oscillatory multiplexing of neural population codes for interval timing and working memory

Interval timing and working memory are critical components of cognition that are supported by neural oscillations in prefrontal-striatal-hippocampal circuits. In this review, the properties of interval timing and working memory are explored in terms of behavioral, anatomical, pharmacological, and neurophysiological findings. We then describe the various neurobiological theories that have been developed to explain these cognitive processes - largely independent of each other. Following this, a coupled excitatory - inhibitory oscillation (EIO) model of temporal processing is proposed to address the shared oscillatory properties of interval timing and working memory. Using this integrative approach, we describe a hybrid model explaining how interval timing and working memory can originate from the same oscillatory processes, but differ in terms of which dimension of the neural oscillation is utilized for the extraction of item, temporal order, and duration information. This extension of the striatal beat-frequency (SBF) model of interval timing (Matell and Meck, 2000, 2004) is based on prefrontal-striatal-hippocampal circuit dynamics and has direct relevance to the pathophysiological distortions observed in time perception and working memory in a variety of psychiatric and neurological conditions.