A Multi-task Platform for Profiling Cognitive and Motivational Constructs in Humans and Nonhuman Primates

Background

Understanding the neurobiological substrates of psychiatric disorders requires comprehensive evaluations of cognitive and motivational functions in preclinical research settings. The translational validity of such evaluations will be supported by (1) tasks with high construct validity that are engaging and easy to teach to human and nonhuman participants, (2) software that enables efficient switching between multiple tasks in single sessions, (3) software that supports tasks across a broad range of physical experimental setups, and (4) by platform architectures that are easily extendable and customizable to encourage future optimization and development.

New Method

We describe the Multi-task Universal Suite for Experiments ( M-USE ), a software platform designed to meet these requirements. It leverages the Unity video game engine and C# programming language to (1) support immersive and engaging tasks for humans and nonhuman primates, (2) allow experimenters or participants to switch between multiple tasks within-session, (3) generate builds that function across computers, tablets, and websites, and (4) is freely available online with documentation and tutorials for users and developers. M-USE includes a task library with seven pre-existing tasks assessing cognitive and motivational constructs of perception, attention, working memory, cognitive flexibility, motivational and affective self-control, relational long-term memory, and visuo-spatial problem solving.

Results

M-USE was used to test NHPs on up to six tasks per session, all available as part of the Task Library, and to extract performance metrics for all major cognitive and motivational constructs spanning the Research Domain Criteria (RDoC) of the National Institutes of Mental Health.

Comparison with Existing Methods

Other experiment design and control systems exist, but do not provide the full range of features available in M-USE, including a pre-existing task library for cross-species assessments; the ability to switch seamlessly between tasks in individual sessions; cross-platform build capabilities; license-free availability; and its leveraging of video-engine capabilities used to gamify tasks.

Conclusions

The new multi-task platform facilitates cross-species translational research for understanding the neurobiological substrates of higher cognitive and motivational functions.

Noradrenergic alpha-2a Receptor Stimulation Enhances Prediction Error Signaling in Anterior Cingulate Cortex and Striatum

The noradrenergic system is implicated to support behavioral flexibility by increasing exploration during periods of uncertainty and by enhancing working memory for goal-relevant stimuli. Possible sources mediating these pro-cognitive effects are α2A adrenoceptors (α2AR) in prefrontal cortex or the anterior cingulate cortex facilitating fronto-striatal learning processes. We tested this hypothesis by selectively stimulating α2ARs using Guanfacine during feature-based attentional set shifting in nonhuman primates. We found that α2A stimulation improved learning from errors and facilitates updating the target feature of an attentional set. Neural recordings in the anterior cingulate cortex (ACC), the dorsolateral prefrontal cortex (dlPFC), and the striatum showed that α2A stimulation selectively enhanced the neural representation of negative reward prediction errors in neurons of the ACC and of positive prediction errors in the striatum, but not in dlPFC. This modulation was accompanied by enhanced encoding of the feature and location of the attended target across the fronto-striatal network. Enhanced learning was paralleled by enhanced encoding of outcomes in putative fast-spiking interneurons in the ACC, dlPFC, and striatum but not in broad spiking cells, pointing to an interneuron mediated mechanism of α2AR action. These results illustrate that α2A receptors causally support the noradrenergic enhancement of updating attention sets through an enhancement of prediction error signaling in the ACC and the striatum.

Generating Patient-Specific Acoustic Simulations for Transcranial Focused Ultrasound Procedures Based on Optical Tracking Information

Optical tracking is a real-time transducer positioning method for transcranial focused ultrasound (tFUS) procedures, but the predicted focus from optical tracking typically does not incorporate subject-specific skull information. Acoustic simulations can estimate the pressure field when propagating through the cranium but rely on accurately replicating the positioning of the transducer and skull in a simulated space. Here, we develop and characterize the accuracy of a workflow that creates simulation grids based on optical tracking information in a neuronavigated phantom with and without transmission through an ex vivo skull cap. The software pipeline could replicate the geometry of the tFUS procedure within the limits of the optical tracking system (transcranial target registration error (TRE): 3.9 ± 0.7 mm). The simulated focus and the free-field focus predicted by optical tracking had low Euclidean distance errors of 0.5±0.1 and 1.2±0.4 mm for phantom and skull cap, respectively, and some skull-specific effects were captured by the simulation. However, the TRE of simulation informed by optical tracking was 4.6±0.2, which is as large or greater than the focal spot size used by many tFUS systems. By updating the position of the transducer using the original TRE offset, we reduced the simulated TRE to 1.1 ± 0.4 mm. Our study describes a software pipeline for treatment planning, evaluates its accuracy, and demonstrates an approach using MR-acoustic radiation force imaging as a method to improve dosimetry. Overall, our software pipeline helps estimate acoustic exposure, and our study highlights the need for image feedback to increase the accuracy of tFUS dosimetry.

Routing states transition during oscillatory bursts and attentional selection

Brain-wide information routing relies on the spatio-temporal dynamics of neural activity, but it remains unclear how routing states emerge at fast spiking timescales and relate to slower activity dynamics during cognitive processes. Here, we show that localized spiking events participate in directional routing states with spiking activity in distant brain areas that dynamically switch or amplify states during oscillatory bursts, attentional selection, and decision-making. Modeling and neural recordings from lateral prefrontal cortex (LPFC), anterior cingulate cortex (ACC), and striatum of nonhuman primates revealed that cross-regional routing states arise within 20 ms following individual neuron spikes, with LPFC spikes leading the activity in ACC and striatum. The baseline routing state amplified during LPFC beta bursts between LPFC and striatum and switched direction during ACC theta/alpha bursts between ACC and LPFC. Selective attention amplified theta-/alpha-band-specific lead ensembles in ACC, while decision-making increased the lead of ACC and LPFC spikes to the striatum.

M1-selective muscarinic allosteric modulation enhances cognitive flexibility and effective salience in nonhuman primates

Acetylcholine (ACh) in cortical neural circuits mediates how selective attention is sustained in the presence of distractors and how flexible cognition adjusts to changing task demands. The cognitive domains of attention and cognitive flexibility might be differentially supported by the M1 muscarinic acetylcholine receptor (mAChR) subtype. Understanding how M1 mAChR mechanisms support these cognitive subdomains is of highest importance for advancing novel drug treatments for conditions with altered attention and reduced cognitive control including Alzheimer's disease or schizophrenia. Here, we tested this question by assessing how the subtype-selective M1 mAChR positive allosteric modulator (PAM) VU0453595 affects visual search and flexible reward learning in nonhuman primates. We found that allosteric potentiation of M1 mAChRs enhanced flexible learning performance by improving extradimensional set shifting, reducing latent inhibition from previously experienced distractors and reducing response perseveration in the absence of adverse side effects. These procognitive effects occurred in the absence of apparent changes of attentional performance during visual search. In contrast, nonselective ACh modulation using the acetylcholinesterase inhibitor (AChEI) donepezil improved attention during visual search at doses that did not alter cognitive flexibility and that already triggered gastrointestinal cholinergic side effects. These findings illustrate that M1 mAChR positive allosteric modulation enhances cognitive flexibility without affecting attentional filtering of distraction, consistent with M1 activity boosting the effective salience of relevant over irrelevant objects specifically during learning. These results suggest that M1 PAMs are versatile compounds for enhancing cognitive flexibility in disorders spanning schizophrenia and Alzheimer's diseases.

Anterior cingulate cortex causally supports flexible learning under motivationally challenging and cognitively demanding conditions

Anterior cingulate cortex (ACC) and striatum (STR) contain neurons encoding not only the expected values of actions, but also the value of stimulus features irrespective of actions. Values about stimulus features in ACC or STR might contribute to adaptive behavior by guiding fixational information sampling and biasing choices toward relevant objects, but they might also have indirect motivational functions by enabling subjects to estimate the value of putting effort into choosing objects. Here, we tested these possibilities by modulating neuronal activity in ACC and STR of nonhuman primates using transcranial ultrasound stimulation while subjects learned the relevance of objects in situations with varying motivational and cognitive demands. Motivational demand was indexed by varying gains and losses during learning, while cognitive demand was varied by increasing the uncertainty about which object features could be relevant during learning. We found that ultrasound stimulation of the ACC, but not the STR, reduced learning efficiency and prolonged information sampling when the task required averting losses and motivational demands were high. Reduced learning efficiency was particularly evident at higher cognitive demands and when subjects experienced loss of already attained tokens. These results suggest that the ACC supports flexible learning of feature values when loss experiences impose a motivational challenge and when uncertainty about the relevance of objects is high. Taken together, these findings provide causal evidence that the ACC facilitates resource allocation and improves visual information sampling during adaptive behavior.

Gains and Losses Affect Learning Differentially at Low and High Attentional Load

Prospective gains and losses influence cognitive processing, but it is unresolved how they modulate flexible learning in changing environments. The prospect of gains might enhance flexible learning through prioritized processing of reward-predicting stimuli, but it is unclear how far this learning benefit extends when task demands increase. Similarly, experiencing losses might facilitate learning when they trigger attentional reorienting away from loss-inducing stimuli, but losses may also impair learning by increasing motivational costs or when negative outcomes are overgeneralized. To clarify these divergent views, we tested how varying magnitudes of gains and losses affect the flexible learning of feature values in environments that varied attentional load by increasing the number of interfering object features. With this task design, we found that larger prospective gains improved learning efficacy and learning speed, but only when attentional load was low. In contrast, expecting losses impaired learning efficacy, and this impairment was larger at higher attentional load. These findings functionally dissociate the contributions of gains and losses on flexible learning, suggesting they operate via separate control mechanisms. One mechanism is triggered by experiencing loss and reduces the ability to reduce distractor interference, impairs assigning credit to specific loss-inducing features, and decreases efficient exploration during learning. The second mechanism is triggered by experiencing gains, which enhances prioritizing reward-predicting stimulus features as long as the interference of distracting features is limited. Taken together, these results support a rational theory of cognitive control during learning, suggesting that experiencing losses and experiencing distractor interference impose costs for learning.

Dose-Dependent Dissociation of Pro-cognitive Effects of Donepezil on Attention and Cognitive Flexibility in Rhesus Monkeys

Background

Donepezil exerts pro-cognitive effects by nonselectively enhancing acetylcholine (ACh) across multiple brain systems. Two brain systems that mediate pro-cognitive effects of attentional control and cognitive flexibility are the prefrontal cortex and the anterior striatum, which have different pharmacokinetic sensitivities to ACh modulation. We speculated that these area-specific ACh profiles lead to distinct optimal dose ranges for donepezil to enhance the cognitive domains of attention and flexible learning.

Methods

To test for dose-specific effects of donepezil on different cognitive domains, we devised a multitask paradigm for nonhuman primates that assessed attention and cognitive flexibility. The nonhuman primates received either vehicle or variable doses of donepezil before task performance. We measured intracerebral donepezil and its strength in preventing the breakdown of ACh within the prefrontal cortex and anterior striatum using solid phase microextraction neurochemistry.

Results

The highest administered donepezil dose improved attention and made the subjects more robust against distractor interference, but it did not improve flexible learning. In contrast, only a lower dose range of donepezil improved flexible learning and reduced perseveration, but without distractor-dependent attentional improvement. Neurochemical measurements confirmed a dose-dependent increase of extracellular donepezil and decreases in choline within the prefrontal cortex and the striatum.

Conclusions

The donepezil dose for maximally improving attention differed from the dose range that enhanced cognitive flexibility despite the availability of the drug in two major brain systems supporting these functions. These results suggest that in our cohort of adult monkeys, donepezil traded improvements in attention for improvements in cognitive flexibility at a given dose range.

Learning at Variable Attentional Load Requires Cooperation of Working Memory, Meta-learning, and Attention-augmented Reinforcement Learning

Flexible learning of changing reward contingencies can be realized with different strategies. A fast learning strategy involves using working memory of recently rewarded objects to guide choices. A slower learning strategy uses prediction errors to gradually update value expectations to improve choices. How the fast and slow strategies work together in scenarios with real-world stimulus complexity is not well known. Here, we aim to disentangle their relative contributions in rhesus monkeys while they learned the relevance of object features at variable attentional load. We found that learning behavior across six monkeys is consistently best predicted with a model combining (i) fast working memory and (ii) slower reinforcement learning from differently weighted positive and negative prediction errors as well as (iii) selective suppression of nonchosen feature values and (iv) a meta-learning mechanism that enhances exploration rates based on a memory trace of recent errors. The optimal model parameter settings suggest that these mechanisms cooperate differently at low and high attentional loads. Whereas working memory was essential for efficient learning at lower attentional loads, enhanced weighting of negative prediction errors and meta-learning were essential for efficient learning at higher attentional loads. Together, these findings pinpoint a canonical set of learning mechanisms and suggest how they may cooperate when subjects flexibly adjust to environments with variable real-world attentional demands.

A Kiosk Station for the Assessment of Multiple Cognitive Domains and Cognitive Enrichment of Monkeys

Nonhuman primates (NHP's) are self-motivated to perform cognitive tasks on touchscreens in their animal housing setting. To leverage this ability, fully integrated hardware and software solutions are needed that work within housing and husbandry routines while also spanning cognitive task constructs of the Research Domain Criteria (RDoC). Here, we detail such an integrated robust hardware and software solution for running cognitive tasks in cage-housed NHP's with a cage-mounted Kiosk Station (KS-1). KS-1 consists of a frame for mounting flexibly on housing cages, a touchscreen animal interface with mounts for receptables, reward pumps, and cameras, and a compact computer cabinet with an interface for controlling behavior. Behavioral control is achieved with a Unity3D program that is virtual-reality capable, allowing semi-naturalistic visual tasks to assess multiple cognitive domains.KS-1 is fully integrated into the regular housing routines of monkeys. A single person can operate multiple KS-1's. Monkeys engage with KS-1 at high motivation and cognitive performance levels at high intra-individual consistency. KS-1 is optimized for flexible mounting onto standard apartment cage systems and provides a new design variation complementing existing cage-mounted touchscreen systems. KS-1 has a robust animal interface with options for gaze/reach monitoring. It has an integrated user interface for controlling multiple cognitive tasks using a common naturalistic object space designed to enhance task engagement. All custom KS-1 components are open-sourced.In summary, KS-1 is a versatile new tool for cognitive profiling and cognitive enrichment of cage-housed monkeys. It reliably measures multiple cognitive domains which promises to advance our understanding of animal cognition, inter-individual differences, and underlying neurobiology in refined, ethologically meaningful behavioral foraging contexts.

Interneuron-specific gamma synchronization indexes cue uncertainty and prediction errors in lateral prefrontal and anterior cingulate cortex

Inhibitory interneurons are believed to realize critical gating functions in cortical circuits, but it has been difficult to ascertain the content of gated information for well-characterized interneurons in primate cortex. Here, we address this question by characterizing putative interneurons in primate prefrontal and anterior cingulate cortex while monkeys engaged in attention demanding reversal learning. We find that subclasses of narrow spiking neurons have a relative suppressive effect on the local circuit indicating they are inhibitory interneurons. One of these interneuron subclasses showed prominent firing rate modulations and (35–45 Hz) gamma synchronous spiking during periods of uncertainty in both, lateral prefrontal cortex (LPFC) and anterior cingulate cortex (ACC). In LPFC, this interneuron subclass activated when the uncertainty of attention cues was resolved during flexible learning, whereas in ACC it fired and gamma-synchronized when outcomes were uncertain and prediction errors were high during learning. Computational modeling of this interneuron-specific gamma band activity in simple circuit motifs suggests it could reflect a soft winner-take-all gating of information having high degree of uncertainty. Together, these findings elucidate an electrophysiologically characterized interneuron subclass in the primate, that forms gamma synchronous networks in two different areas when resolving uncertainty during adaptive goal-directed behavior.

Translating Expectation into Visual Selection through a Beta-Synchronous Fronto-Parietal Neural Subnetwork

Top-down expectancy critically determines how fast sensory inputs are processed. Fiebelkorn & Kastner show that translating expectancy into fast stimulus processing is mediated by a subnetwork of beta-synchronized neurons across the fronto-parietal attention network. This finding suggests that precise spike timing determines how efficient fronto-parietal activity selects visual inputs.

Interactions of Medial and Lateral Prefrontal Cortex in Hierarchical Predictive Coding

Cognitive control and decision-making rely on the interplay of medial and lateral prefrontal cortex (mPFC/lPFC), particularly for circumstances in which correct behavior requires integrating and selecting among multiple sources of interrelated information. While the interaction between mPFC and lPFC is generally acknowledged as a crucial circuit in adaptive behavior, the nature of this interaction remains open to debate, with various proposals suggesting complementary roles in (i) signaling the need for and implementing control, (ii) identifying and selecting appropriate behavioral policies from a candidate set, and (iii) constructing behavioral schemata for performance of structured tasks. Although these proposed roles capture salient aspects of conjoint mPFC/lPFC function, none are sufficiently well-specified to provide a detailed account of the continuous interaction of the two regions during ongoing behavior. A recent computational model of mPFC and lPFC, the Hierarchical Error Representation (HER) model, places the regions within the framework of hierarchical predictive coding, and suggests how they interact during behavioral periods preceding and following salient events. In this manuscript, we extend the HER model to incorporate real-time temporal dynamics and demonstrate how the extended model is able to capture single-unit neurophysiological, behavioral, and network effects previously reported in the literature. Our results add to the wide range of results that can be accounted for by the HER model, and provide further evidence for predictive coding as a unifying framework for understanding PFC function and organization.

A roadmap for development of neuro-oscillations as translational biomarkers for treatment development in neuropsychopharmacology

New treatment development for psychiatric disorders depends critically upon the development of physiological measures that can accurately translate between preclinical animal models and clinical human studies. Such measures can be used both as stratification biomarkers to define pathophysiologically homogeneous patient populations and as target engagement biomarkers to verify similarity of effects across preclinical and clinical intervention. Traditional "time-domain" event-related potentials (ERP) have been used translationally to date but are limited by the significant differences in timing and distribution across rodent, monkey and human studies. By contrast, neuro-oscillatory responses, analyzed within the "time-frequency" domain, are relatively preserved across species permitting more precise translational comparisons. Moreover, neuro-oscillatory responses are increasingly being mapped to local circuit mechanisms and may be useful for investigating effects of both pharmacological and neuromodulatory interventions on excitatory/inhibitory balance. The present paper provides a roadmap for development of neuro-oscillatory responses as translational biomarkers in neuropsychiatric treatment development.

MAD saccade: statistically robust saccade threshold estimation via the median absolute deviation

Saccade detection is a critical step in the analysis of gaze data. A common method for saccade detection is to use a simple threshold for velocity or acceleration values, which can be estimated from the data using the mean and standard deviation. However, this method has the downside of being influenced by the very signal it is trying to detect, the outlying velocities or accelerations that occur during saccades. We propose instead to use the median absolute deviation (MAD), a robust estimator of dispersion that is not influenced by outliers. We modify an algorithm proposed by Nyström and colleagues, and quantify saccade detection performance in both simulated and human data. Our modified algorithm shows a significant and marked improvement in saccade detection - showing both more true positives and less false negatives - especially under higher noise levels. We conclude that robust estimators can be widely adopted in other common, automatic gaze classification algorithms due to their ease of implementation.

Dissociation of nicotinic α7 and α4/β2 sub-receptor agonists for enhancing learning and attentional filtering in nonhuman primates

RATIONALE

Nicotinic acetylcholine receptors (nAChRs) modulate attention, memory, and higher executive functioning, but it is unclear how nACh sub-receptors mediate different mechanisms supporting these functions.

OBJECTIVES

We investigated whether selective agonists for the alpha-7 nAChR versus the alpha-4/beta-2 nAChR have unique functional contributions for value learning and attentional filtering of distractors in the nonhuman primate.

METHODS

Two adult rhesus macaque monkeys performed reversal learning following systemic administration of either the alpha-7 nAChR agonist PHA-543613 or the alpha-4/beta-2 nAChR agonist ABT-089 or a vehicle control. Behavioral analysis quantified performance accuracy, speed of processing, reversal learning speed, the control of distractor interference, perseveration tendencies, and motivation.

RESULTS

We found that the alpha-7 nAChR agonist PHA-543613 enhanced the learning speed of feature values but did not modulate how salient distracting information was filtered from ongoing choice processes. In contrast, the selective alpha-4/beta-2 nAChR agonist ABT-089 did not affect learning speed but reduced distractibility. This dissociation was dose-dependent and evident in the absence of systematic changes in overall performance, reward intake, motivation to perform the task, perseveration tendencies, or reaction times.

CONCLUSIONS

These results suggest nicotinic sub-receptor specific mechanisms consistent with (1) alpha-4/beta-2 nAChR specific amplification of cholinergic transients in prefrontal cortex linked to enhanced cue detection in light of interferences, and (2) alpha-7 nAChR specific activation prolonging cholinergic transients, which could facilitate subjects to follow-through with newly established attentional strategies when outcome contingencies change. These insights will be critical for developing function-specific drugs alleviating attention and learning deficits in neuro-psychiatric diseases.

A Distinct Class of Bursting Neurons with Strong Gamma Synchronization and Stimulus Selectivity in Monkey V1

Cortical computation depends on interactions between excitatory and inhibitory neurons. The contributions of distinct neuron types to sensory processing and network synchronization in primate visual cortex remain largely undetermined. We show that in awake monkey V1, there exists a distinct cell type (››30% of neurons) that has narrow-waveform (NW) action potentials and high spontaneous discharge rates and fires in high-frequency bursts. These neurons are more stimulus selective and phase locked to 30- to 80-Hz gamma oscillations than other neuron types. Unlike other neuron types, their gamma-phase locking is highly predictive of orientation tuning. We find evidence for strong rhythmic inhibition in these neurons, suggesting that they interact with interneurons to act as excitatory pacemakers for the V1 gamma rhythm. We did not find a similar class of NW bursting neurons in L2-L4 of mouse V1. Given its properties, this class of NW bursting neurons should be pivotal for the encoding and transmission of stimulus information.

Cell-Type Specific Burst Firing Interacts with Theta and Beta Activity in Prefrontal Cortex During Attention States

Population-level theta and beta band activity in anterior cingulate and prefrontal cortices (ACC/PFC) are prominent signatures of self-controlled, adaptive behaviors. But how these rhythmic activities are linked to cell-type specific activity has remained unclear. Here, we suggest such a cell-to-systems level linkage. We found that the rate of burst spiking events is enhanced particularly during attention states and that attention-specific burst spikes have a unique temporal relationship to local theta and beta band population-level activities. For the 5-10 Hz theta frequency range, bursts coincided with transient increases of local theta power relative to nonbursts, particularly for bursts of putative interneurons. For the 16-30 Hz beta frequency, bursts of putative interneurons phase synchronized stronger than nonbursts, and were associated with larger beta power modulation. In contrast, burst of putative pyramidal cells showed similar beta power modulation as nonbursts, but were accompanied by stronger beta power only when they occurred early in the beta cycle. These findings suggest that in the ACC/PFC during attention states, mechanisms underlying burst firing are intimately linked to narrow band population-level activities, providing a cell-type specific window into rhythmic inhibitory gating and the emergence of rhythmically coherent network states during goal directed behavior.

Adaptive spike-artifact removal from local field potentials uncovers prominent beta and gamma band neuronal synchronization

BACKGROUND

Many neurons synchronize their action potentials to the phase of local field potential (LFP) fluctuations in one or more frequency bands. Analyzing this spike-to-LFP synchronization is challenging, however, when neural spikes and LFP are generated in the same local circuit, because the spike's action potential waveform leak into the LFP and distort phase synchrony estimates. Existing approaches to address this spike bleed-through artifact relied on removing the average action potential waveforms of neurons, but this leaves artifacts in the LFP and distorts synchrony estimates.

NEW METHOD

We describe a spike-removal method that surpasses these limitations by decomposing individual action potentials into their frequency components before their removal from the LFP. The adaptively estimated frequency components allow for variable spread, strength and temporal variation of the spike artifact.

RESULTS

This adaptive approach effectively removes spike bleed-through artifacts in synthetic data with known ground truth, and in single neuron and LFP recordings in nonhuman primate striatum. For a large population of neurons with both narrow and broad action potential waveforms, the use of adaptive artifact removal uncovered 20-35 Hz beta and 35-45 Hz gamma band spike-LFP synchronization that would have remained contaminated otherwise.

COMPARISON WITH EXISTING METHODS

We demonstrate that adaptive spike-artifact removal cleans LFP data that remained contaminated when applying existing Bayesian and non-Bayesian methods of average spike-artifact removal.

CONCLUSIONS

Applying adaptive spike-removal from field potentials allows to estimate the phase at which neurons synchronize and the consistency of their phase-locked firing for both beta and low gamma frequencies. These metrics may prove essential to understand cell-to-circuit neuronal interactions in multiple brain systems.

Multineuromodulator measurements across fronto-striatal network areas of the behaving macaque using solid-phase microextraction

Different neuromodulators rarely act independent from each other to modify neural processes but are instead coreleased, gated, or modulated. To understand this interdependence of neuromodulators and their collective influence on local circuits during different brain states, it is necessary to reliably extract local concentrations of multiple neuromodulators in vivo. Here we describe results using solid-phase microextraction (SPME), a method providing sensitive, multineuromodulator measurements. SPME is a sampling method that is coupled with mass spectrometry to quantify collected analytes. Reliable measurements of glutamate, dopamine, acetylcholine, and choline were made simultaneously within frontal cortex and striatum of two macaque monkeys (Macaca mulatta) during goal-directed behavior. We find glutamate concentrations several orders of magnitude higher than acetylcholine and dopamine in all brain regions. Dopamine was reliably detected in the striatum at tenfold higher concentrations than acetylcholine. Acetylcholine and choline concentrations were detected with high consistency across brain areas within monkeys and between monkeys. These findings illustrate that SPME microprobes provide a versatile novel tool to characterize multiple neuromodulators across different brain areas in vivo to understand the interdependence and covariation of neuromodulators during goal-directed behavior. Such data would be important to better distinguish between different behavioral states and characterize dysfunctional brain states that may be evident in psychiatric disorders.NEW & NOTEWORTHY Our paper reports a reliable and sensitive novel method for measuring the absolute concentrations of glutamate, acetylcholine, choline, dopamine, and serotonin in brain circuits in vivo. We show that this method reliably samples multiple neurochemicals in three brain areas simultaneously while nonhuman primates are engaged in goal-directed behavior. We further describe how the methodology we describe here may be used by electrophysiologists as a low-barrier-to-entry tool for measuring multiple neurochemicals.

USE: An integrative suite for temporally-precise psychophysical experiments in virtual environments for human, nonhuman, and artificially intelligent agents

BACKGROUND

There is a growing interest in complex, active, and immersive behavioral neuroscience tasks. However, the development and control of such tasks present unique challenges.

NEW METHOD

The Unified Suite for Experiments (USE) is an integrated set of hardware and software tools for the design and control of behavioral neuroscience experiments. The software, developed using the Unity video game engine, supports both active tasks in immersive 3D environments and static 2D tasks used in more traditional visual experiments. The custom USE SyncBox hardware, based around an Arduino Mega2560 board, integrates and synchronizes multiple data streams from different pieces of experimental hardware. The suite addresses three key issues with developing cognitive neuroscience experiments in Unity: tight experimental control, accurate sub-ms timing, and accurate gaze target identification.

RESULTS

USE is a flexible framework to realize experiments, enabling (i) nested control over complex tasks, (ii) flexible use of 3D or 2D scenes and objects, (iii) touchscreen-, button-, joystick- and gaze-based interaction, and (v) complete offline reconstruction of experiments for post-processing and temporal alignment of data streams.

COMPARISON WITH EXISTING METHODS

Most existing experiment-creation tools are not designed to support the development of video-game-like tasks. Those that do use older or less popular video game engines as their base, and are not as feature-rich or enable as precise control over timing as USE.

CONCLUSIONS

USE provides an integrated, open source framework for a wide variety of active behavioral neuroscience experiments using human and nonhuman participants, and artificially-intelligent agents.

Feature-specific prediction errors and surprise across macaque fronto-striatal circuits

To adjust expectations efficiently, prediction errors need to be associated with the precise features that gave rise to the unexpected outcome, but this credit assignment may be problematic if stimuli differ on multiple dimensions and it is ambiguous which feature dimension caused the outcome. Here, we report a potential solution: neurons in four recorded areas of the anterior fronto-striatal networks encode prediction errors that are specific to feature values of different dimensions of attended multidimensional stimuli. The most ubiquitous prediction error occurred for the reward-relevant dimension. Feature-specific prediction error signals a) emerge on average shortly after non-specific prediction error signals, b) arise earliest in the anterior cingulate cortex and later in dorsolateral prefrontal cortex, caudate and ventral striatum, and c) contribute to feature-based stimulus selection after learning. Thus, a widely-distributed feature-specific eligibility trace may be used to update synaptic weights for improved feature-based attention.

In order to adjust expectations efficiently, prediction errors need to be associated with the features that gave rise to the unexpected outcome. Here, the authors show that neurons in anterior fronto-striatal networks encode prediction errors that are specific to feature values of different stimulus dimensions.

Changes of Attention during Value-Based Reversal Learning Are Tracked by N2pc and Feedback-Related Negativity

Previously learned reward values can have a pronounced impact, behaviorally and neurophysiologically, on the allocation of selective attention. All else constant, stimuli previously associated with a high value gain stronger attentional prioritization than stimuli previously associated with a low value. The N2pc, an ERP component indicative of attentional target selection, has been shown to reflect aspects of this prioritization, by changes of mean amplitudes closely corresponding to selective enhancement of high value target processing and suppression of high value distractor processing. What has remained unclear so far is whether the N2pc also reflects the flexible and repeated behavioral adjustments needed in a volatile task environment, in which the values of stimuli are reversed often and unannounced. Using a value-based reversal learning task, we found evidence that the N2pc amplitude flexibly and reversibly tracks value-based choices during the learning of reward associated stimulus colors. Specifically, successful learning of current value-contingencies was associated with reduced N2pc amplitudes, and this effect was more apparent for distractor processing, compared with target processing. In addition, following a value reversal the feedback related negativity(FRN), an ERP component that reflects feedback processing, was amplified and co-occurred with increased N2pc amplitudes in trials following low-value feedback. Importantly, participants that showed the greatest adjustment in N2pc amplitudes based on feedback were also the most efficient learners. These results allow further insight into how changes in attentional prioritization in an uncertain and volatile environment support flexible adjustments of behavior.

Brief activation of GABAergic interneurons initiates the transition to ictal events through post-inhibitory rebound excitation

Activation of γ-aminobutyric acid (GABA_A) receptors have been associated with the onset of epileptiform events. To investigate if a causal relationship exists between GABA_A receptor activation and ictal event onset, we activated inhibitory GABAergic networks in the superficial layer (2/3) of the somatosensory cortex during hyperexcitable conditions using optogenetic techniques in mice expressing channelrhodopsin-2 in all GABAergic interneurons. We found that a brief 30ms light pulse reliably triggered either an interictal-like event (IIE) or ictal-like ("ictal") event in the in vitro cortical 4-Aminopyridine (4-AP) slice model. The link between light pulse and epileptiform event onset was lost following blockade of GABA_A receptors with bicuculline methiodide. Additionally, recording the chronological sequence of events following a light pulse in a variety of configurations (whole-cell, gramicidin-perforated patch, and multi-electrode array) demonstrated an initial hyperpolarization followed by post-inhibitory rebound spiking and a subsequent slow depolarization at the transition to epileptiform activity. Furthermore, the light-triggered ictal events were independent of the duration or intensity of the initiating light pulse, suggesting an underlying regenerative mechanism. Moreover, we demonstrated that brief GABA_A receptor activation can initiate ictal events in the in vivo 4-AP mouse model, in another common in vitro model of epileptiform activity, and in neocortical tissue resected from epilepsy patients. Our findings reveal that the synchronous activation of GABAergic interneurons is a robust trigger for ictal event onset in hyperexcitable cortical networks.

Theta and beta synchrony coordinate frontal eye fields and anterior cingulate cortex during sensorimotor mapping

The frontal eye fields (FEFs) and the anterior cingulate cortex (ACC) are commonly coactivated for cognitive saccade tasks, but whether this joined activation indexes coordinated activity underlying successful guidance of sensorimotor mapping is unknown. Here we test whether ACC and FEF circuits coordinate through phase synchronization of local field potential and neural spiking activity in macaque monkeys performing memory-guided and pro- and anti-saccades. We find that FEF and ACC showed prominent synchronization at a 3–9 Hz theta and a 12–30 Hz beta frequency band during the delay and preparation periods with a strong Granger-causal influence from ACC to FEF. The strength of theta- and beta-band coherence between ACC and FEF but not variations in power predict correct task performance. Taken together, the results support a role of ACC in cognitive control of frontoparietal networks and suggest that narrow-band theta and to some extent beta rhythmic activity indexes the coordination of relevant information during periods of enhanced control demands.

Frontal eye fields (FEF) and anterior cingulate cortex (ACC) are coactivated during cognitive tasks, but the precise format of their interaction is not known. Here the authors show that phase coupling between ACC -FEF in theta and beta frequency bands better predicts behavioural performance.

A computational psychiatry approach identifies how alpha-2A noradrenergic agonist Guanfacine affects feature-based reinforcement learning in the macaque

Noradrenaline is believed to support cognitive flexibility through the alpha 2A noradrenergic receptor (a2A-NAR) acting in prefrontal cortex. Enhanced flexibility has been inferred from improved working memory with the a2A-NA agonist Guanfacine. But it has been unclear whether Guanfacine improves specific attention and learning mechanisms beyond working memory, and whether the drug effects can be formalized computationally to allow single subject predictions. We tested and confirmed these suggestions in a case study with a healthy nonhuman primate performing a feature-based reversal learning task evaluating performance using Bayesian and Reinforcement learning models. In an initial dose-testing phase we found a Guanfacine dose that increased performance accuracy, decreased distractibility and improved learning. In a second experimental phase using only that dose we examined the faster feature-based reversal learning with Guanfacine with single-subject computational modeling. Parameter estimation suggested that improved learning is not accounted for by varying a single reinforcement learning mechanism, but by changing the set of parameter values to higher learning rates and stronger suppression of non-chosen over chosen feature information. These findings provide an important starting point for developing nonhuman primate models to discern the synaptic mechanisms of attention and learning functions within the context of a computational neuropsychiatry framework.

Long-Range Attention Networks: Circuit Motifs Underlying Endogenously Controlled Stimulus Selection

Attention networks comprise brain areas whose coordinated activity implements stimulus selection. This selection is reflected in spatially referenced priority maps across frontal-parietal-collicular areas and is controlled through interactions with circuits representing behavioral goals, including prefrontal, cingulate, and striatal circuits, among others. We review how these goal-providing structures control stimulus selection through long-range dynamic projection motifs. These motifs (i) combine feature-tuned subnetworks to a distributed priority map, (ii) establish endogenously controlled, long-range coherent activity at 4-10 Hz theta and 12-30 Hz beta-band frequencies, and (iii) are composed of unique cell types implementing long-range networks through disynaptic disinhibition, dendritic gating, and feedforward inhibitory gain control. This evidence reveals common circuit motifs used to coordinate attentionally selected information across multi-node brain networks during goal-directed behavior.

Prefrontal and anterior cingulate cortex neurons encode attentional targets even when they do not apparently bias behavior

Neurons in anterior cingulate and prefrontal cortex (ACC/PFC) carry information about behaviorally relevant target stimuli. This information is believed to affect behavior by exerting a top-down attentional bias on stimulus selection. However, attention information may not necessarily be a biasing signal but could be a corollary signal that is not directly related to ongoing behavioral success, or it could reflect the monitoring of targets similar to an eligibility trace useful for later attentional adjustment. To test this suggestion we quantified how attention information relates to behavioral success in neurons recorded in multiple subfields in macaque ACC/PFC during a cued attention task. We found that attention cues activated three separable neuronal groups that encoded spatial attention information but were differently linked to behavioral success. A first group encoded attention targets on correct and error trials. This group spread across ACC/PFC and represented targets transiently after cue onset, irrespective of behavior. A second group encoded attention targets on correct trials only, closely predicting behavior. These neurons were not only prevalent in lateral prefrontal but also in anterior cingulate cortex. A third group encoded target locations only on error trials. This group was evident in ACC and PFC and was activated in error trials "as if" attention was shifted to the target location but without evidence for such behavior. These results show that only a portion of neuronaly available information about attention targets biases behavior. We speculate that additionally a unique neural subnetwork encodes counterfactual attention information.

A Flexible Mechanism of Rule Selection Enables Rapid Feature-Based Reinforcement Learning

Learning in a new environment is influenced by prior learning and experience. Correctly applying a rule that maps a context to stimuli, actions, and outcomes enables faster learning and better outcomes compared to relying on strategies for learning that are ignorant of task structure. However, it is often difficult to know when and how to apply learned rules in new contexts. In our study we explored how subjects employ different strategies for learning the relationship between stimulus features and positive outcomes in a probabilistic task context. We test the hypothesis that task naive subjects will show enhanced learning of feature specific reward associations by switching to the use of an abstract rule that associates stimuli by feature type and restricts selections to that dimension. To test this hypothesis we designed a decision making task where subjects receive probabilistic feedback following choices between pairs of stimuli. In the task, trials are grouped in two contexts by blocks, where in one type of block there is no unique relationship between a specific feature dimension (stimulus shape or color) and positive outcomes, and following an un-cued transition, alternating blocks have outcomes that are linked to either stimulus shape or color. Two-thirds of subjects (n = 22/32) exhibited behavior that was best fit by a hierarchical feature-rule model. Supporting the prediction of the model mechanism these subjects showed significantly enhanced performance in feature-reward blocks, and rapidly switched their choice strategy to using abstract feature rules when reward contingencies changed. Choice behavior of other subjects (n = 10/32) was fit by a range of alternative reinforcement learning models representing strategies that do not benefit from applying previously learned rules. In summary, these results show that untrained subjects are capable of flexibly shifting between behavioral rules by leveraging simple model-free reinforcement learning and context-specific selections to drive responses.

A Role of Phase-Resetting in Coordinating Large Scale Neural Networks During Attention and Goal-Directed Behavior

Short periods of oscillatory activation are ubiquitous signatures of neural circuits. A broad range of studies documents not only their circuit origins, but also a fundamental role for oscillatory activity in coordinating information transfer during goal directed behavior. Recent studies suggest that resetting the phase of ongoing oscillatory activity to endogenous or exogenous cues facilitates coordinated information transfer within circuits and between distributed brain areas. Here, we review evidence that pinpoints phase resetting as a critical marker of dynamic state changes of functional networks. Phase resets: (1) set a "neural context" in terms of narrow band frequencies that uniquely characterizes the activated circuits; (2) impose coherent low frequency phases to which high frequency activations can synchronize, identifiable as cross-frequency correlations across large anatomical distances; (3) are critical for neural coding models that depend on phase, increasing the informational content of neural representations; and (4) likely originate from the dynamics of canonical E-I circuits that are anatomically ubiquitous. These multiple signatures of phase resets are directly linked to enhanced information transfer and behavioral success. We survey how phase resets re-organize oscillations in diverse task contexts, including sensory perception, attentional stimulus selection, cross-modal integration, Pavlovian conditioning, and spatial navigation. The evidence we consider suggests that phase-resets can drive changes in neural excitability, ensemble organization, functional networks, and ultimately, overt behavior.

Attentional Selection Can Be Predicted by Reinforcement Learning of Task-relevant Stimulus Features Weighted by Value-independent Stickiness

Attention includes processes that evaluate stimuli relevance, select the most relevant stimulus against less relevant stimuli, and bias choice behavior toward the selected information. It is not clear how these processes interact. Here, we captured these processes in a reinforcement learning framework applied to a feature-based attention task that required macaques to learn and update the value of stimulus features while ignoring nonrelevant sensory features, locations, and action plans. We found that value-based reinforcement learning mechanisms could account for feature-based attentional selection and choice behavior but required a value-independent stickiness selection process to explain selection errors while at asymptotic behavior. By comparing different reinforcement learning schemes, we found that trial-by-trial selections were best predicted by a model that only represents expected values for the task-relevant feature dimension, with nonrelevant stimulus features and action plans having only a marginal influence on covert selections. These findings show that attentional control subprocesses can be described by (1) the reinforcement learning of feature values within a restricted feature space that excludes irrelevant feature dimensions, (2) a stochastic selection process on feature-specific value representations, and (3) value-independent stickiness toward previous feature selections akin to perseveration in the motor domain. We speculate that these three mechanisms are implemented by distinct but interacting brain circuits and that the proposed formal account of feature-based stimulus selection will be important to understand how attentional subprocesses are implemented in primate brain networks.

Ketamine Alters Outcome-Related Local Field Potentials in Monkey Prefrontal Cortex

A subanesthetic dose of the noncompetitive N-methyl-d-aspartate receptor antagonist ketamine is known to induce a schizophrenia-like phenotype in humans and nonhuman primates alike. The transient behavioral changes mimic the positive, negative, and cognitive symptoms of the disease but the neural mechanisms behind these changes are poorly understood. A growing body of evidence indicates that the cognitive control processes associated with prefrontal cortex (PFC) regions relies on groups of neurons synchronizing at narrow-band frequencies measurable in the local field potential (LFP). Here, we recorded LFPs from the caudo-lateral PFC of 2 macaque monkeys performing an antisaccade task, which requires the suppression of an automatic saccade toward a stimulus and the initiation of a goal-directed saccade in the opposite direction. Preketamine injection activity showed significant differences in a narrow 20-30 Hz beta frequency band between correct and error trials in the postsaccade response epoch. Ketamine significantly impaired the animals' performance and was associated with a loss of the differences in outcome-specific beta-band power. Instead, we observed a large increase in high-gamma-band activity. Our results suggest that the PFC employs beta-band synchronization to prepare for top-down cognitive control of saccades and the monitoring of task outcome.

Burst firing synchronizes prefrontal and anterior cingulate cortex during attentional control

BACKGROUND

It is widely held that single cells in anterior cingulate and lateral prefrontal cortex (ACC/PFC) coordinate their activity during attentional processes, although cellular activity that may underlie such coordination across ACC/PFC has not been identified. We thus recorded cells in five ACC/PFC subfields of macaques engaged in a selective attention task, characterized those spiking events that indexed attention, and identified how spiking of distinct cell populations synchronized between brain areas.

RESULTS

We found that cells in ACC/PFC increased the firing of brief 200 Hz spike bursts when subjects shifted attention and engaged in selective visual processing. In contrast to nonburst spikes, burst spikes synchronized over large distances to local field potentials at narrow beta (12-20 Hz) and at gamma (50-75 Hz) frequencies. Long-range burst synchronization was anatomically specific, functionally connecting those subfields in area 24 (ACC) and area 46 (PFC) that are key players of attentional control. By splitting cells into putative excitatory (pE) and inhibitory (pI) cells by their broad and narrow spikes, we identified that bursts of pI cells preceded and that bursts of pE cells followed in time periods of maximal beta coherent network activity. In contrast, gamma bursts were transient impulses with equal timing across cell classes.

CONCLUSIONS

These findings suggest that processes underlying burst firing and burst synchronization are candidate mechanisms to coordinate attention information across brain areas. We speculate that distinct burst-firing motifs realize beta and gamma synchrony to trigger versus maintain functional network states during goal-directed behavior.

Dorsolateral Prefrontal Cortex Deactivation in Monkeys Reduces Preparatory Beta and Gamma Power in the Superior Colliculus

Cognitive control requires the selection and maintenance of task-relevant stimulus-response associations, or rules. The dorsolateral prefrontal cortex (DLPFC) has been implicated by lesion, functional imaging, and neurophysiological studies to be involved in encoding rules, but the mechanisms by which it modulates other brain areas are poorly understood. Here, the functional relationship of the DLPFC with the superior colliculus (SC) was investigated by bilaterally deactivating the DLPFC while recording local field potentials (LFPs) in the SC in monkeys performing an interleaved pro- and antisaccade task. Event-related LFPs showed differences between pro- and antisaccades and responded prominently to stimulus presentation. LFP power after stimulus onset was higher for correct saccades than erroneous saccades. Deactivation of the DLPFC did not affect stimulus onset related LFP activity, but reduced high beta (20-30 Hz) and high gamma (60-150 Hz) power during the preparatory period for both pro- and antisaccades. Spike rate during the preparatory period was positively correlated with gamma power and this relationship was attenuated by DLPFC deactivation. These results suggest that top-down control of the SC by the DLPFC may be mediated by beta oscillations.

Anterior Cingulate Cortex Cells Identify Process-Specific Errors of Attentional Control Prior to Transient Prefrontal-Cingulate Inhibition

Errors indicate the need to adjust attention for improved future performance. Detecting errors is thus a fundamental step to adjust and control attention. These functions have been associated with the dorsal anterior cingulate cortex (dACC), predicting that dACC cells should track the specific processing states giving rise to errors in order to identify which processing aspects need readjustment. Here, we tested this prediction by recording cells in the dACC and lateral prefrontal cortex (latPFC) of macaques performing an attention task that dissociated 3 processing stages. We found that, across prefrontal subareas, the dACC contained the largest cell populations encoding errors indicating (1) failures of inhibitory control of the attentional focus, (2) failures to prevent bottom-up distraction, and (3) lapses when implementing a choice. Error-locked firing in the dACC showed the earliest latencies across the PFC, emerged earlier than reward omission signals, and involved a significant proportion of putative inhibitory interneurons. Moreover, early onset error-locked response enhancement in the dACC was followed by transient prefrontal-cingulate inhibition, possibly reflecting active disengagement from task processing. These results suggest a functional specialization of the dACC to track and identify the actual processes that give rise to erroneous task outcomes, emphasizing its role to control attentional performance.

Attentional modulation of cell-class-specific gamma-band synchronization in awake monkey area v4

Selective visual attention is subserved by selective neuronal synchronization, entailing precise orchestration among excitatory and inhibitory cells. We tentatively identified these as broad (BS) and narrow spiking (NS) cells and analyzed their synchronization to the local field potential in two macaque monkeys performing a selective visual attention task. Across cells, gamma phases scattered widely but were unaffected by stimulation or attention. During stimulation, NS cells lagged BS cells on average by ∼60° and gamma synchronized twice as strongly. Attention enhanced and reduced the gamma locking of strongly and weakly activated cells, respectively. During a prestimulus attentional cue period, BS cells showed weak gamma synchronization, while NS cells gamma-synchronized as strongly as with visual stimulation. These analyses reveal the cell-type-specific dynamics of the gamma cycle in macaque visual cortex and suggest that attention affects neurons differentially depending on cell type and activation level.

Neuronal coding of implicit emotion categories in the subcallosal cortex in patients with depression

BACKGROUND

The subcallosal cingulate and adjacent ventromedial prefrontal cortex (collectively referred to here as the subcallosal cortex or SCC) have been identified as key brain areas in emotional processing. The SCC's role in affective valuation as well as severe mood and motivational disturbances, such as major depression, has been largely inferred from measures of neuronal population activity using functional neuroimaging. On the basis of imaging studies, it is unclear whether the SCC predominantly processes 1) negatively valenced affective content, 2) affective arousal, or 3) category-specific affective information.

METHODS

To clarify these putative functional roles of the SCC, we measured single neuron activity in the SCC of 15 human subjects undergoing deep brain stimulation for depression while they viewed emotionally evocative images grouped into categories that varied in emotional valence (pleasantness) and arousal.

RESULTS

We found that the majority of responsive neurons were modulated by specific emotion categories, rather than by valence or arousal alone. Moreover, although these emotion-category-specific neurons responded to both positive and negative emotion categories, a significant majority were selective for negatively valenced emotional content.

CONCLUSIONS

These findings reveal that single SCC neuron activity reflects the automatic valuational processing and implicit emotion categorization of visual stimuli. Furthermore, because of the predominance of neuronal signals in SCC conveying negative affective valuations and the increased activity in this region among depressed people, the effectiveness of depression therapies that alter SCC neuronal activity may relate to the down-regulation of a previously negative emotional processing bias.

Dynamic functional connectivity: promise, issues, and interpretations

The brain must dynamically integrate, coordinate, and respond to internal and external stimuli across multiple time scales. Non-invasive measurements of brain activity with fMRI have greatly advanced our understanding of the large-scale functional organization supporting these fundamental features of brain function. Conclusions from previous resting-state fMRI investigations were based upon static descriptions of functional connectivity (FC), and only recently studies have begun to capitalize on the wealth of information contained within the temporal features of spontaneous BOLD FC. Emerging evidence suggests that dynamic FC metrics may index changes in macroscopic neural activity patterns underlying critical aspects of cognition and behavior, though limitations with regard to analysis and interpretation remain. Here, we review recent findings, methodological considerations, neural and behavioral correlates, and future directions in the emerging field of dynamic FC investigations.