The influence of recent decisions on future goal selection

Static and dynamic coding in distinct cell types during associative learning in the prefrontal cortex

The prefrontal cortex maintains information in memory through static or dynamic population codes depending on task demands, but whether the population coding schemes used are learning-dependent and differ between cell types is currently unknown. We investigate the population coding properties and temporal stability of neurons recorded from male macaques in two mapping tasks during and after stimulus-response associative learning, and then we use a Strategy task with the same stimuli and responses as control. We identify a heterogeneous population coding for stimuli, responses, and novel associations: static for putative pyramidal cells and dynamic for putative interneurons that show the strongest selectivity for all the variables. The population coding of learned associations shows overall the highest stability driven by cell types, with interneurons changing from dynamic to static coding after successful learning. The results support that prefrontal microcircuitry expresses mixed population coding governed by cell types and changes its stability during associative learning.

Ventrolateral prefrontal neurons of the monkey encode instructions in the 'pragmatic' format of the associated behavioral outcomes

The prefrontal cortex plays an important role in coding rules and producing context-appropriate behaviors. These processes necessarily require the generation of goals based on current context. Indeed, instructing stimuli are prospectively encoded in prefrontal cortex in relation to behavioral demands, but the coding format of this neural representation is, to date, largely unknown. In order to study how instructions and behaviors are encoded in prefrontal cortex, we recorded the activity of monkeys (Macaca mulatta) ventrolateral prefrontal neurons in a task requiring to perform (Action condition) or withhold (Inaction condition) grasping actions on real objects. Our data show that there are neurons responding in different task phases, and that the neuronal population discharge is stronger in the Inaction condition when the instructing cue is presented, and in the Action condition in the subsequent phases, from object presentation to action execution. Decoding analyses performed on neuronal populations showed that the neural activity recorded during the initial phases of the task shares the same type of format with that recorded during the final phases. We propose that this format has a pragmatic nature, that is instructions and goals are encoded by prefrontal neurons as predictions of the behavioral outcome.

Goal given moment modulates the time period of gamma oscillations in nidopallium caudolaterale during the goal-directed behavior of pigeon

The cognitive processes of goal-directed navigation are believed to be organized around and serve the identification and selection of goals. Differences in LFP signals in avian nidopallium caudolaterale (NCL) under different goal location/distance information in the goal-directed behavior have been studied. However, for goals that are multifarious constructs that include various information, the modulation of goal time information on the LFP of NCL during goal-directed behavior remains unclear. In this study, we recorded the LFP activity from the NCL of eight pigeons as they performed two goal-directed decision-making tasks in a plus-maze. During the two tasks with different goal time information, spectral analysis revealed significant LFP power selectively enhanced in the slow gamma band (40-60 Hz), while the slow gamma band of LFP which could effectively decode the behavioral goal of the pigeons existed in different time periods. These findings suggest that the LFP activity in the gamma band correlates with the goal-time information, and help to shed light on the contribution of the gamma rhythm recorded from the NCL in goal-directed behavior.

Effects of contraction bias on the decision process in the macaque prefrontal cortex

Our representation of magnitudes such as time, distance, and size is not always veridical because it is affected by multiple biases. From a Bayesian perspective, estimation errors are considered to be the result of an optimization mechanism for the behavior in a noisy environment by integrating previous experience with the incoming sensory information. One influence of the distribution of past stimuli on perceptual decisions is represented by the regression toward the mean, a type of contraction bias. Using a spatial discrimination task with 2 stimuli presented sequentially at different distances from the center, we show that this bias is also present in macaques when comparing the magnitude of 2 distances. We found that the contraction of the first stimulus magnitude toward the center of the distribution accounted for some of the changes in performance, even more so than the effect of difficulty related to the ratio between stimulus magnitudes. At the neural level in the dorsolateral prefrontal cortex, the coding of the decision after the presentation of the second stimulus reflected the effect of the contraction bias on the discriminability of the stimuli at the behavioral level.

Restart errors reaction time of a two-step inhibition process account for the violation of the race model's independence in multi-effector selective stop signal task

Goal-oriented actions often require the coordinated movement of two or more effectors. Sometimes multi-effector movements need to be adjusted according to a continuously changing environment, requiring stopping an effector without interrupting the movement of the others. This form of control has been investigated by the selective Stop Signal Task (SST), requiring the inhibition of an effector of a multicomponent action. This form of selective inhibition has been hypothesized to act through a two-step process, where a temporary global inhibition deactivating all the ongoing motor responses is followed by a restarting process that reactivates only the moving effector. When this form of inhibition takes place, the reaction time (RT) of the moving effector pays the cost of the previous global inhibition. However, it is poorly investigated if and how this cost delays the RT of the effector that was required to be stopped but was erroneously moved (Stop Error trials). Here we measure the Stop Error RT in a group of participants instructed to simultaneously rotate the wrist and lift the foot when a Go Signal occurred, and interrupt both movements (non-selective Stop version) or only one of them (selective Stop version) when a Stop Signal was presented. We presented this task in two experimental conditions to evaluate how different contexts can influence a possible proactive inhibition on the RT of the moving effector in the selective Stop versions. In one context, we provided the foreknowledge of the effector to be inhibited by presenting the same selective or non-selective Stop versions in the same block of trials. In a different context, while providing no foreknowledge of the effector(s) to be stopped, the selective and non-selective Stop versions were intermingled, and the information on the effector to be stopped was delivered at the time of the Stop Signal presentation. We detected a cost in both Correct and Error selective Stop RTs that was influenced by the different task conditions. Results are discussed within the framework of the race model related to the SST, and its relationship with a restart model developed for selective versions of this paradigm.

Does positive feeling lead to more impulsiveness? - Implication of previous rewarded experience on location-dependent motoric impulsivity

Positive feeling or rewarding experience is crucial for individuals to operative their cognitive activities via an outcome evaluation of incentive reinforcement. For a long time, rewarding process or outcome evaluation is assumed greatly influenced by neuronal construct that holds individuals' impulsiveness, a capacity to inhibit unwanted behaviors provoked in a given situation. In the present study, we proposed that the outcome evaluation or rewarding experience can influence the occurrence of impulsiveness too. We hypothesized that animals would be more likely to deliver impulsive action in the place where it was previously associated with reinforcing process, in which central dopamine may play an important role. By employing five-choice serial reaction time task (5-CSRTT), we examined whether one of the five holes where rats made a correct response to get the reward would gain a higher probability to deliver premature or perseverative activities than other holes in the next trial of 5-CSRTT under baseline or longer waiting period condition. The effects of D1 receptor antagonist SCH23390 were also evaluated in the above paradigm. We demonstrated that (i) the influence on motoric impulsive response from previous rewarded experience can be described in a behavioral paradigm such as the 5-CSRTT, (ii) both prematures and perseverations at the hole associated with previous rewarding were about one-fifth of probability, however were statistically not correlated unless the interventions of inter-trial interval = 7 plus SCH23390, and (iii) the hole associated with the positive reinforcement of the 5-CSRTT appears more likely for rats to carry out an intuitive impetus under SCH23390 in a longer waiting condition. Our results may shed some insight toward the role of rewarding process in impulsive behavior.

Perceptual decisions are biased toward relevant prior choices

Perceptual decisions are biased by recent perceptual history-a phenomenon termed 'serial dependence.' Here, we investigated what aspects of perceptual decisions lead to serial dependence, and disambiguated the influences of low-level sensory information, prior choices and motor actions. Participants discriminated whether a brief visual stimulus lay to left/right of the screen center. Following a series of biased 'prior' location discriminations, subsequent 'test' location discriminations were biased toward the prior choices, even when these were reported via different motor actions (using different keys), and when the prior and test stimuli differed in color. By contrast, prior discriminations about an irrelevant stimulus feature (color) did not substantially influence subsequent location discriminations, even though these were reported via the same motor actions. Additionally, when color (not location) was discriminated, a bias in prior stimulus locations no longer influenced subsequent location discriminations. Although low-level stimuli and motor actions did not trigger serial-dependence on their own, similarity of these features across discriminations boosted the effect. These findings suggest that relevance across perceptual decisions is a key factor for serial dependence. Accordingly, serial dependence likely reflects a high-level mechanism by which the brain predicts and interprets new incoming sensory information in accordance with relevant prior choices.

A Network Activity Reconfiguration Underlies the Transition from Goal to Action

Neurons in prefrontal cortex (PF) represent mnemonic information about current goals until the action can be selected and executed. However, the neuronal dynamics underlying the transition from goal into specific actions are poorly understood. Here, we show that the goal-coding PF network is dynamically reconfigured from mnemonic to action selection states and that such reconfiguration is mediated by cell assemblies with heterogeneous excitability. We recorded neuronal activity from PF while monkeys selected their actions on the basis of memorized goals. Many PF neurons encoded the goal, but only a minority of them did so across both memory retention and action selection stages. Interestingly, about half of this minority of neurons switched their goal preference across the goal-action transition. Our computational model led us to propose a PF network composed of heterogeneous cell assemblies with single-state and bistable local dynamics able to produce both dynamical stability and input susceptibility simultaneously.

Neural Correlates of Strategy Switching in the Macaque Orbital Prefrontal Cortex

We can adapt flexibly to environment changes and search for the most appropriate rule to a context. The orbital prefrontal cortex (PFo) has been associated with decision making, rule generation and maintenance, and more generally has been considered important for behavioral flexibility. To better understand the neural mechanisms underlying the flexible behavior, we studied the ability to generate a switching signal in monkey PFo when a strategy is changed. In the strategy task, we used a visual cue to instruct two male rhesus monkeys either to repeat their most recent choice (i.e., stay strategy) or to change it (i.e., shift strategy). To identify the strategy switching-related signal, we compared nonswitch and switch trials, which cued the same or a different strategy from the previous trial, respectively. We found that the switching-related signal emerged during the cue presentation and it was combined with the strategy signal in a subpopulation of cells. Moreover, the error analysis showed that the activity of the switch-related cells reflected whether the monkeys erroneously switched or not the strategy, rather than what was required for that trial. The function of the switching signal could be to prompt the use of different strategies when older strategies are no longer appropriate, conferring the ability to adapt flexibly to environmental changes. In our task, the switching signal might contribute to the implementation of the strategy cued, overcoming potential interference effects from the strategy previously cued. Our results support the idea that ascribes to PFo an important role for behavioral flexibility.SIGNIFICANCE STATEMENT We can flexibly adapt our behavior to a changing environment. One of the prefrontal areas traditionally associated with the ability to adapt to new contingencies is the orbital prefrontal cortex (PFo). We analyzed the switching related activity using a strategy task in which two rhesus monkeys were instructed by a visual cue either to repeat or change their most recent choice, respectively using a stay or a shift strategy. We found that PFo neurons were modulated by the strategy switching signal, pointing to the importance of PFo in behavioral flexibility by generating control over the switching of strategies.

Autocorrelation Structure in the Macaque Dorsolateral, But not Orbital or Polar, Prefrontal Cortex Predicts Response-Coding Strength in a Visually Cued Strategy Task

In previous work, we studied the activity of neurons in the dorsolateral (PFdl), orbital (PFo), and polar (PFp) prefrontal cortex while monkeys performed a strategy task with 2 spatial goals. A cue instructed 1 of 2 strategies in each trial: stay with the previous goal or shift to the alternative goal. Each trial started with a fixation period, followed by a cue. Subsequently, a delay period was followed by a "go" signal that instructed the monkeys to choose one goal. After each choice, feedback was provided. In this study, we focused on the temporal receptive fields of the neurons, as measured by the decay in autocorrelation (time constant) during the fixation period, and examined the relationship with response and strategy coding. The temporal receptive field in PFdl correlated with the response-related but not with the strategy-related modulation in the delay and the feedback periods: neurons with longer time constants in PFdl tended to show stronger and more prolonged response coding. No such correlation was found in PFp or PFo. These findings demonstrate that the temporal specialization of neurons for temporally extended computations is predictive of response coding, and neurons in PFdl, but not PFp or PFo, develop such predictive properties.

Dopamine and eye movement control in Parkinson's disease: deficits in corollary discharge signals?

Movement in Parkinson's disease (PD) is fragmented, and the patients depend on visual information in their behavior. This suggests that the patients may have deficits in internally monitoring their own movements. Internal monitoring of movements is assumed to rely on corollary discharge signals that enable the brain to predict the sensory consequences of actions. We studied early-stage PD patients (N = 14), and age-matched healthy control participants (N = 14) to examine whether PD patients reveal deficits in updating their sensory representations after eye movements. The participants performed a double-saccade task where, in order to accurately fixate a second target, the participant must correct for the displacement caused by the first saccade. In line with previous reports, the patients had difficulties in fixating the second target when the eye movement was performed without visual guidance. Furthermore, the patients had difficulties in taking into account the error in the first saccade when making a saccade toward the second target, especially when eye movements were made toward the side with dominant motor symptoms. Across PD patients, the impairments in saccadic eye movements correlated with the integrity of the dopaminergic system as measured with [123I]FP-CIT SPECT: Patients with lower striatal (caudate, anterior putamen, and posterior putamen) dopamine transporter binding made larger errors in saccades. This effect was strongest when patients made memory-guided saccades toward the second target. Our results provide tentative evidence that the motor deficits in PD may be partly due to deficits in internal monitoring of movements.

Independent coding of absolute duration and distance magnitudes in the prefrontal cortex

The estimation of space and time can interfere with each other, and neuroimaging studies have shown overlapping activation in the parietal and prefrontal cortical areas. We used duration and distance discrimination tasks to determine whether space and time share resources in prefrontal cortex (PF) neurons. Monkeys were required to report which of two stimuli, a red circle or blue square, presented sequentially, were longer and farther, respectively, in the duration and distance tasks. In a previous study, we showed that relative duration and distance are coded by different populations of neurons and that the only common representation is related to goal coding. Here, we examined the coding of absolute duration and distance. Our results support a model of independent coding of absolute duration and distance metrics by demonstrating that not only relative magnitude but also absolute magnitude are independently coded in the PF.

NEW & NOTEWORTHY

Human behavioral studies have shown that spatial and duration judgments can interfere with each other. We investigated the neural representation of such magnitudes in the prefrontal cortex. We found that the two magnitudes are independently coded by prefrontal neurons. We suggest that the interference among magnitude judgments might depend on the goal rather than the perceptual resource sharing.

Determining Monkey Free Choice Long before the Choice Is Made: The Principal Role of Prefrontal Neurons Involved in Both Decision and Motor Processes

When choices are made freely, they might emerge from pre-existing neural activity. However, whether neurons in the prefrontal cortex (PF) show this anticipatory effect and, if so, in which part of the process they are involved is still debated. To answer this question, we studied PF activity in monkeys while they performed a strategy task. In this task when the stimulus changed from the previous trial, the monkeys had to shift their response to one of two spatial goals, excluding the one that had been previously selected. Under this free-choice condition, the prestimulus activity of the same neurons that are involved in decision and motor processes predicted future choices. These neurons developed the same goal preferences during the prestimulus presentation as they did later in the decision phase. In contrast, the same effect was not observed in motor-only neurons and it was present but weaker in decision-only neurons. Overall, our results suggest that the PF neuronal activity predicts upcoming actions mainly through the decision-making network that integrate in time decision and motor task aspects.

Event- and time-dependent decline of outcome information in the primate prefrontal cortex

The prefrontal cortex (PF) is involved in outcome-based flexible adaptation in a dynamically changing environment. The outcome signal dissipates gradually over time, but the temporal dynamics of this dissipation remains unknown. To examine this issue, we analyzed the outcome-related activity of PF neurons in 2 monkeys in a distance discrimination task. The initial prestimulus period of this task varied in duration, allowing us to dissociate the effects of time and event on the decline in previous outcome-related activity -previous correct versus previous error. We observed 2 types of decline in previous outcome representation: PF neurons that ceased to encode the previous outcome as time passed (time-dependent) and neurons that maintained their signal but it decreased rapidly after the occurrence of a new external event (event-dependent). Although the time-dependent dynamics explained the decline in a greater proportion of neurons, the event-dependent decline was also observed in a significant population of neurons.

Neurophysiology of rule switching in the corticostriatal circuit

The ability to adjust behavioral responses to cues in a changing environment is crucial for survival. Activity in the medial Prefrontal Cortex (mPFC) is thought to both represent rules to guide behavior as well as detect and resolve conflicts between rules in changing contingencies. While lesion and pharmacological studies have supported a crucial role for mPFC in this type of set-shifting, an understanding of how mPFC represents current rules or detects and resolves conflict between different rules is still unclear. Meanwhile, medial dorsal striatum (mDS) receives major projections from mPFC and neural activity of mDS is closely linked to action selection, making the mDS a potential major player for enacting rule-guided action policies. However, exactly what is signaled by mPFC and how this impacts neural signals in mDS is not well known. In this review, we will summarize what is known about neural signals of rules and set shifting in both prefrontal cortex and dorsal striatum, as well as provide questions and directions for future experiments.

Neural Encoding of Self and Another Agent's Goal in the Primate Prefrontal Cortex: Human-Monkey Interactions

The primate prefrontal cortex represents both past and future goals. To investigate its role in representing the goals of other agents, we designed a nonmatch-to-goal task that involved a human-monkey (H-M) interaction. During each trial, 2 of 4 potential goal objects were presented randomly to the left or right part of a display screen, and the monkey's (or human's) task was to choose the one that did not match the object goal previously chosen. Human and monkey trials were intermixed, and each agent, when acting as observer, was required to monitor the other actor's choice to switch the object goal choice in case it became the actor on the subsequent trial. We found neurons encoding the actor, either the monkey itself or the human, neurons encoding the agent future goal position and neurons encoding the agent previous goal position. In the category of neurons encoding the human future goal, we differentiated between those encoding the future goal of both agents and those encoding only the human agent future goal. While the first one might represent a covert mental simulation in the human trials, the other one could represent a prediction signal of the other's agent choice.

Automatic comparison of stimulus durations in the primate prefrontal cortex: the neural basis of across-task interference

Rhesus monkeys performed two tasks, both requiring a choice between a red square and a blue circle. In the duration task, the two stimuli appeared sequentially on each trial, for varying durations, and, later, during the choice phase of the task, the monkeys needed to choose the one that had lasted longer. In the matching-to-sample task, one of the two stimuli appeared twice as a sample, with durations matching those in the duration task, and the monkey needed to choose that stimulus during the choice phase. Although stimulus duration was irrelevant in the matching-to-sample task, the monkeys made twice as many errors when the second stimulus was shorter. This across-task interference supports an order-dependent model of the monkeys' choice and reveals something about their strategy in the duration task. The monkeys tended to choose the second stimulus when its duration exceeded the first and to choose the alternative stimulus otherwise. For the duration task, this strategy obviated the need to store stimulus-duration conjunctions for both stimuli, but it generated errors on the matching-to-sample task. We examined duration coding in prefrontal neurons and confirmed that a population of cells encoded relative duration during the matching-to-sample task, as expected from the order-dependent errors.