Prospection, Perseverance, and Insight in Sequential Behavior

General mechanisms of task engagement in the primate frontal cortex

Staying engaged is necessary to maintain goal-directed behaviors. Despite this, engagement exhibits continuous, intrinsic fluctuations. Even in experimental settings, animals, unlike most humans, repeatedly and spontaneously move between periods of complete task engagement and disengagement. We, therefore, looked at behavior in male macaques (macaca mulatta) in four tasks while recording fMRI signals. We identified consistent autocorrelation in task disengagement. This made it possible to build models capturing task-independent engagement. We identified task general patterns of neural activity linked to impending sudden task disengagement in mid-cingulate gyrus. By contrast, activity centered in perigenual anterior cingulate cortex (pgACC) was associated with maintenance of performance across tasks. Importantly, we carefully controlled for task-specific factors such as the reward history and other motivational effects, such as response vigor, in our analyses. Moreover, we showed pgACC activity had a causal link to task engagement: transcranial ultrasound stimulation of pgACC changed task engagement patterns.

Hierarchical control over foraging behavior by anterior cingulate cortex

Foraging is a natural behavior that involves making sequential decisions to maximize rewards while minimizing the costs incurred when doing so. The prevalence of foraging across species suggests that a common brain computation underlies its implementation. Although anterior cingulate cortex is believed to contribute to foraging behavior, its specific role has been contentious, with predominant theories arguing either that it encodes environmental value or choice difficulty. Additionally, recent attempts to characterize foraging have taken place within the reinforcement learning framework, with increasingly complex models scaling with task complexity. Here we review reinforcement learning foraging models, highlighting the hierarchical structure of many foraging problems. We extend this literature by proposing that ACC guides foraging according to principles of model-based hierarchical reinforcement learning. This idea holds that ACC function is organized hierarchically along a rostral-caudal gradient, with rostral structures monitoring the status and completion of high-level task goals (like finding food), and midcingulate structures overseeing the execution of task options (subgoals, like harvesting fruit) and lower-level actions (such as grabbing an apple).

Goal commitment is supported by vmPFC through selective attention

When striking a balance between commitment to a goal and flexibility in the face of better options, people often demonstrate strong goal perseveration. Here, using functional MRI (n = 30) and lesion patient (n = 26) studies, we argue that the ventromedial prefrontal cortex (vmPFC) drives goal commitment linked to changes in goal-directed selective attention. Participants performed an incremental goal pursuit task involving sequential decisions between persisting with a goal versus abandoning progress for better alternative options. Individuals with stronger goal perseveration showed higher goal-directed attention in an interleaved attention task. Increasing goal-directed attention also affected abandonment decisions: while pursuing a goal, people lost their sensitivity to valuable alternative goals while remaining more sensitive to changes in the current goal. In a healthy population, individual differences in both commitment biases and goal-oriented attention were predicted by baseline goal-related activity in the vmPFC. Among lesion patients, vmPFC damage reduced goal commitment, leading to a performance benefit.

Debates on the dorsomedial prefrontal/dorsal anterior cingulate cortex: insights for future research

The dorsomedial prefrontal cortex/dorsal anterior cingulate cortex (dmPFC/dACC) is a brain area subject to many theories and debates over its function(s). Even its precise anatomical borders are subject to much controversy. In the past decades, the dmPFC/dACC has been associated with more than 15 different cognitive processes, which sometimes appear quite unrelated (e.g. body perception, cognitive conflict). As a result, understanding what the dmPFC/dACC does has become a real challenge for many neuroscientists. Several theories of this brain area's function(s) have been developed, leading to successive and competitive publications bearing different models, which sometimes contradict each other. During the last two decades, the lively scientific exchanges around the dmPFC/dACC have promoted fruitful research in cognitive neuroscience. In this review, we provide an overview of the anatomy of the dmPFC/dACC, summarize the state of the art of functions that have been associated with this brain area and present the main theories aiming at explaining the dmPFC/dACC function(s). We explore the commonalities and the arguments between the different theories. Finally, we explain what can be learned from these debates for future investigations of the dmPFC/dACC and other brain regions' functions.

Using lickometry to infer differential contributions of salience network regions during compulsion-like alcohol drinking

Alcohol use disorder extracts substantial personal, social and clinical costs, and continued intake despite negative consequences (compulsion-like consumption) can contribute strongly. Here we discuss lickometry, a simple method where lick times are determined across a session, while analysis across many aspects of licking can offer important insights into underlying psychological and action strategies, including their brain mechanisms. We first describe studies implicating anterior insula (AIC) and dorsal medial prefrontal cortex (dMPF) in compulsion-like responding for alcohol, then review work suggesting that AIC/ventral frontal cortex versus dMPF regulate different aspects of behavior (oral control and overall response strategy, versus moment-to-moment action organization). We then detail our lickometer work comparing alcohol-only drinking (AOD) and compulsion-like drinking under moderate- or higher-challenge (ModChD or HiChD, using quinine-alcohol). Many studies have suggested utilization of one of two main strategies, with higher motivation indicated by more bouts, and greater palatability suggested by longer, faster bouts. Instead, ModChD shows decreased variability in many lick measures, which is unexpected but consistent with the suggested importance of automaticity for addiction. Also surprising is that HiChD retains several behavior changes seen with ModChD, reduced tongue variability and earlier bout start, even though intake is otherwise disrupted. Since AIC-related measures are retained under both moderate- and higher-challenge, we propose a novel hypothesis that AIC sustains overall commitment regardless of challenge level, while disordered licking during HiChD mirrors the effects of dMPF inhibition. Thus, while AIC provides overall drive despite challenge, the ability to act is ultimately determined within the dMPF.

Frontopolar cortex represents complex features and decision value during choice between environments

Important decisions often involve choosing between complex environments that define future item encounters. Despite its importance for adaptive behavior and distinct computational challenges, decision-making research primarily focuses on item choice, ignoring environment choice altogether. Here we contrast previously studied item choice in ventromedial prefrontal cortex with lateral frontopolar cortex (FPl) linked to environment choice. Furthermore, we propose a mechanism for how FPl decomposes and represents complex environments during decision making. Specifically, we trained a choice-optimized, brain-naive convolutional neural network (CNN) and compared predicted CNN activation with actual FPl activity. We showed that the high-dimensional FPl activity decomposes environment features to represent the complexity of an environment to make such choice possible. Moreover, FPl functionally connects with posterior cingulate cortex for guiding environment choice. Further probing FPl's computation revealed a parallel processing mechanism in extracting multiple environment features.

Dissecting the neurocomputational bases of patch-switching

The survival and well-being of humans require solving the patch-switching problem: we must decide when to stop collecting rewards in a current patch and travel somewhere else where gains may be higher. Previous studies suggested that frontal regions are underpinned by several processes in the context of foraging decisions such as tracking task difficulty, and/or the value of exploring the environment. To dissociate between these processes, participants completed an fMRI patch-switching learning task inspired by behavioral ecology. By analyzing >11,000 trials collected across 21 participants, we found that the activation in the cingulate cortex was closely related to several patch-switching-related variables including the decision to leave the current patch, the encounter of a new patch, the harvest value, and the relative forage value. Learning-induced changes in the patch-switching threshold were tracked by activity within frontoparietal regions including the superior frontal gyrus and angular gyrus. Our findings suggest that frontoparietal regions shape patch-switching learning apart from encoding classical non-learning foraging processes. These findings provide a novel neurobiological understanding of how learning emerges neurocomputationally shaping patch-switching behavior with implications in real-life choices such as job selection and pave the way for future studies to probe the causal role of these neurobiological mechanisms.

Expertise increases planning depth in human gameplay

A hallmark of human intelligence is the ability to plan multiple steps into the future1,2. Despite decades of research3-5, it is still debated whether skilled decision-makers plan more steps ahead than novices6-8. Traditionally, the study of expertise in planning has used board games such as chess, but the complexity of these games poses a barrier to quantitative estimates of planning depth. Conversely, common planning tasks in cognitive science often have a lower complexity9,10 and impose a ceiling for the depth to which any player can plan. Here we investigate expertise in a complex board game that offers ample opportunity for skilled players to plan deeply. We use model fitting methods to show that human behaviour can be captured using a computational cognitive model based on heuristic search. To validate this model, we predict human choices, response times and eye movements. We also perform a Turing test and a reconstruction experiment. Using the model, we find robust evidence for increased planning depth with expertise in both laboratory and large-scale mobile data. Experts memorize and reconstruct board features more accurately. Using complex tasks combined with precise behavioural modelling might expand our understanding of human planning and help to bridge the gap with progress in artificial intelligence.

Imagining the future self through thought experiments

The ability of the mind to conceptualize what is not present is essential. It allows us to reason counterfactually about what might have happened had events unfolded differently or had another course of action been taken. It allows us to think about what might happen - to perform 'Gedankenexperimente' (thought experiments) - before we act. However, the cognitive and neural mechanisms mediating this ability are poorly understood. We suggest that the frontopolar cortex (FPC) keeps track of and evaluates alternative choices (what we might have done), whereas the anterior lateral prefrontal cortex (alPFC) compares simulations of possible future scenarios (what we might do) and evaluates their reward values. Together, these brain regions support the construction of suppositional scenarios.

Smaller rostral cingulate volume and psychosocial correlates in veterans at risk for suicide

Suicide research/clinical work remain in dire need of effective tools that can better predict suicidal behavior. A growing body of literature has started to focus on the role that neuroimaging may play in helping explain the path towards suicide. Specifically, structural alterations of rostral anterior cingulate cortex (rost-ACC) may represent a biological marker and/or indicator of suicide risk in Major Depressive Disorder (MDD). Furthermore, the construct of "grit," defined as perseverance for goal-attainment and shown to be associated with suicidality, is modulated by rost-ACC. The aim was to examine relationships among rost-ACC gray matter volume, grit, and suicidality in U.S. Military Veterans. Participants were age-and-sex-matched Veterans with MDD: with suicide attempt (MDD+SA:n = 23) and without (MDD-SA:n = 37). Groups did not differ in depression symptomatology. Participants underwent diagnostic interview, clinical symptom assessment, and 3T-MRI-scan. A Group (SA-vs.-No-SA) x Cingulate-region (rostral-caudal-posterior) x Hemisphere (left-right) mixed-model-multivariate-ANOVA was conducted. Left-rost-ACC was significantly smaller in MDD+SA, Group x Cingulate-region x Hemisphere-interaction. Lower grit and less left-rost-ACC gray matter each predicted suicide attempt history, but grit level was a more robust predictor of SA. Both structural alterations of rost-ACC and grit level represent potentially valuable tools for suicide risk assessment.

Neural responses in macaque prefrontal cortex are linked to strategic exploration

Humans have been shown to strategically explore. They can identify situations in which gathering information about distant and uncertain options is beneficial for the future. Because primates rely on scarce resources when they forage, they are also thought to strategically explore, but whether they use the same strategies as humans and the neural bases of strategic exploration in monkeys are largely unknown. We designed a sequential choice task to investigate whether monkeys mobilize strategic exploration based on whether information can improve subsequent choice, but also to ask the novel question about whether monkeys adjust their exploratory choices based on the contingency between choice and information, by sometimes providing the counterfactual feedback about the unchosen option. We show that monkeys decreased their reliance on expected value when exploration could be beneficial, but this was not mediated by changes in the effect of uncertainty on choices. We found strategic exploratory signals in anterior and mid-cingulate cortex (ACC/MCC) and dorsolateral prefrontal cortex (dlPFC). This network was most active when a low value option was chosen, which suggests a role in counteracting expected value signals, when exploration away from value should to be considered. Such strategic exploration was abolished when the counterfactual feedback was available. Learning from counterfactual outcome was associated with the recruitment of a different circuit centered on the medial orbitofrontal cortex (OFC), where we showed that monkeys represent chosen and unchosen reward prediction errors. Overall, our study shows how ACC/MCC-dlPFC and OFC circuits together could support exploitation of available information to the fullest and drive behavior towards finding more information through exploration when it is beneficial.

Visuospatial information foraging describes search behavior in learning latent environmental features

In the real world, making sequences of decisions to achieve goals often depends upon the ability to learn aspects of the environment that are not directly perceptible. Learning these so-called latent features requires seeking information about them. Prior efforts to study latent feature learning often used single decisions, used few features, and failed to distinguish between reward-seeking and information-seeking. To overcome this, we designed a task in which humans and monkeys made a series of choices to search for shapes hidden on a grid. On our task, the effects of reward and information outcomes from uncovering parts of shapes could be disentangled. Members of both species adeptly learned the shapes and preferred to select tiles expected to be informative earlier in trials than previously rewarding ones, searching a part of the grid until their outcomes dropped below the average information outcome-a pattern consistent with foraging behavior. In addition, how quickly humans learned the shapes was predicted by how well their choice sequences matched the foraging pattern, revealing an unexpected connection between foraging and learning. This adaptive search for information may underlie the ability in humans and monkeys to learn latent features to support goal-directed behavior in the long run.

Humans account for cognitive costs when finding shortcuts: An information-theoretic analysis of navigation

When faced with navigating back somewhere we have been before we might either retrace our steps or seek a shorter path. Both choices have costs. Here, we ask whether it is possible to characterize formally the choice of navigational plans as a bounded rational process that trades off the quality of the plan (e.g., its length) and the cognitive cost required to find and implement it. We analyze the navigation strategies of two groups of people that are firstly trained to follow a "default policy" taking a route in a virtual maze and then asked to navigate to various known goal destinations, either in the way they want ("Go To Goal") or by taking novel shortcuts ("Take Shortcut"). We address these wayfinding problems using InfoRL: an information-theoretic approach that formalizes the cognitive cost of devising a navigational plan, as the informational cost to deviate from a well-learned route (the "default policy"). In InfoRL, optimality refers to finding the best trade-off between route length and the amount of control information required to find it. We report five main findings. First, the navigational strategies automatically identified by InfoRL correspond closely to different routes (optimal or suboptimal) in the virtual reality map, which were annotated by hand in previous research. Second, people deliberate more in places where the value of investing cognitive resources (i.e., relevant goal information) is greater. Third, compared to the group of people who receive the "Go To Goal" instruction, those who receive the "Take Shortcut" instruction find shorter but less optimal solutions, reflecting the intrinsic difficulty of finding optimal shortcuts. Fourth, those who receive the "Go To Goal" instruction modulate flexibly their cognitive resources, depending on the benefits of finding the shortcut. Finally, we found a surprising amount of variability in the choice of navigational strategies and resource investment across participants. Taken together, these results illustrate the benefits of using InfoRL to address navigational planning problems from a bounded rational perspective.

The rostral zona incerta: a subcortical integrative hub and potential DBS target for OCD

BACKGROUND

The zona incerta (ZI) is involved in mediating survival behaviors and is connected to a wide range of cortical and subcortical structures, including key basal ganglia nuclei. Based on these connections and their links to behavioral modulation, we propose that the ZI is a connectional hub for mediating between top-down and bottom-up control and a possible target for deep brain stimulation for obsessive-compulsive disorder.

METHODS

We analyzed the trajectory of cortical fibers to the ZI in nonhuman and human primates based on tracer injections in monkeys and high-resolution diffusion magnetic resonance imaging in humans. The organization of cortical and subcortical connections within the ZI were identified in the nonhuman primate studies.

RESULTS

Monkey anatomical data and human diffusion magnetic resonance imaging data showed a similar trajectory of fibers/streamlines to the ZI. Prefrontal cortex/anterior cingulate cortex terminals all converged within the rostral ZI, with dorsal and lateral areas being most prominent. Motor areas terminated caudally. Dense subcortical reciprocal connections included the thalamus, medial hypothalamus, substantia nigra/ventral tegmental area, reticular formation, and pedunculopontine nucleus and a dense nonreciprocal projection to the lateral habenula. Additional connections included the amygdala, dorsal raphe nucleus, and periaqueductal gray.

CONCLUSIONS

Dense connections with dorsal and lateral prefrontal cortex/anterior cingulate cortex cognitive control areas and the lateral habenula and the substantia nigra/ventral tegmental area, coupled with inputs from the amygdala, hypothalamus, and brainstem, suggest that the rostral ZI is a subcortical hub positioned to modulate between top-down and bottom-up control. A deep brain stimulation electrode placed in the rostral ZI would not only involve connections common to other deep brain stimulation sites but also capture several critically distinctive connections.

Relationship between nuclei-specific amygdala connectivity and mental health dimensions in humans

There has been increasing interest in using neuroimaging measures to predict psychiatric disorders. However, predictions usually rely on large brain networks and large disorder heterogeneity. Thus, they lack both anatomical and behavioural specificity, preventing the advancement of targeted interventions. Here we address both challenges. First, using resting-state functional magnetic resonance imaging, we parcellated the amygdala, a region implicated in mood disorders, into seven nuclei. Next, a questionnaire factor analysis provided subclinical mental health dimensions frequently altered in anxious-depressive individuals, such as negative emotions and sleep problems. Finally, for each behavioural dimension, we identified the most predictive resting-state functional connectivity between individual amygdala nuclei and highly specific regions of interest, such as the dorsal raphe nucleus in the brainstem or medial frontal cortical regions. Connectivity in circumscribed amygdala networks predicted behaviours in an independent dataset. Our results reveal specific relations between mental health dimensions and connectivity in precise subcortical networks.

Novelty, uncertainty, and the looming horizon

Novelty and uncertainty are powerful drivers of exploration that are often conflated. In this issue of Neuron, Cockburn and colleagues dissociate the two and report a key interaction: close to task termination, novel options appear much more attractive relative to uncertain options.

Feedback-related EEG dynamics separately reflect decision parameters, biases, and future choices

Optimal decision making in complex environments requires dynamic learning from unexpected events. To speed up learning, we should heavily weight information that indicates state-action-outcome contingency changes and ignore uninformative fluctuations in the environment. Often, however, unrelated information is hard to ignore and can potentially bias our learning. Here we used computational modelling and EEG to investigate learning behaviour in a modified probabilistic choice task that introduced two task-irrelevant factors that were uninformative for optimal task performance, but nevertheless could potentially bias learning: pay-out magnitudes were varied randomly and, occasionally, feedback presentation was enhanced by visual surprise. We found that participants' overall good learning performance was biased by distinct effects of these non-normative factors. On the neural level, these parameters are represented in a dynamic and spatiotemporally dissociable sequence of EEG activity. Later in feedback processing the different streams converged on a central to centroparietal positivity reflecting a signal that is interpreted by downstream learning processes that adjust future behaviour.

Medial and orbital frontal cortex in decision-making and flexible behavior

The medial frontal cortex and adjacent orbitofrontal cortex have been the focus of investigations of decision-making, behavioral flexibility, and social behavior. We review studies conducted in humans, macaques, and rodents and argue that several regions with different functional roles can be identified in the dorsal anterior cingulate cortex, perigenual anterior cingulate cortex, anterior medial frontal cortex, ventromedial prefrontal cortex, and medial and lateral parts of the orbitofrontal cortex. There is increasing evidence that the manner in which these areas represent the value of the environment and specific choices is different from subcortical brain regions and more complex than previously thought. Although activity in some regions reflects distributions of reward and opportunities across the environment, in other cases, activity reflects the structural relationships between features of the environment that animals can use to infer what decision to take even if they have not encountered identical opportunities in the past.

Inhibitory control of frontal metastability sets the temporal signature of cognition

Cortical dynamics are organized over multiple anatomical and temporal scales. The mechanistic origin of the temporal organization and its contribution to cognition remain unknown. Here we demonstrate the cause of this organization by studying a specific temporal signature (time constant and latency) of neural activity. In monkey frontal areas, recorded during flexible decisions, temporal signatures display specific area-dependent ranges, as well as anatomical and cell-type distributions. Moreover, temporal signatures are functionally adapted to behaviorally relevant timescales. Fine-grained biophysical network models, constrained to account for experimentally observed temporal signatures, reveal that after-hyperpolarization potassium and inhibitory GABA-B conductances critically determine areas' specificity. They mechanistically account for temporal signatures by organizing activity into metastable states, with inhibition controlling state stability and transitions. As predicted by models, state durations non-linearly scale with temporal signatures in monkey, matching behavioral timescales. Thus, local inhibitory-controlled metastability constitutes the dynamical core specifying the temporal organization of cognitive functions in frontal areas.

The effect of apathy and compulsivity on planning and stopping in sequential decision-making

Real-life decision-making often comprises sequences of successive decisions about whether to take opportunities as they are encountered or keep searching for better ones instead. We investigated individual differences related to such sequential decision-making and link them especially to apathy and compulsivity in a large online sample (discovery sample: n = 449 and confirmation sample: n = 756). Our cognitive model revealed distinct changes in the way participants evaluated their environments and planned their own future behaviour. Apathy was linked to decision inertia, i.e., automatically persisting with a sequence of searches for longer than appropriate given the value of searching. Thus, despite being less motivated, they did not avoid the effort associated with longer searches. In contrast, compulsivity was linked to self-reported insensitivity to the cost of continuing with a sequence of searches. The objective measures of behavioural cost insensitivity were clearly linked to compulsivity only in the discovery sample. While the confirmation sample showed a similar effect, it did not reach significance. Nevertheless, in both samples, participants reported awareness of such bias (experienced as "overchasing"). In addition, this awareness made them report preemptively avoiding situations related to the bias. However, we found no evidence of them actually preempting more in the task, which might mean a misalignment of their metacognitive beliefs or that our behavioural measures were incomplete. In summary, individual variation in distinct, fundamental aspects of sequential decision-making can be linked to variation in 2 measures of behavioural traits associated with psychological illness in the normal population.

Descending neurons coordinate anterior grooming behavior in Drosophila

The brain coordinates the movements that constitute behavior, but how descending neurons convey the myriad of commands required to activate the motor neurons of the limbs in the right order and combinations to produce those movements is not well understood. For anterior grooming behavior in the fly, we show that its component head sweeps and leg rubs can be initiated separately, or as a set, by different descending neurons. Head sweeps and leg rubs are mutually exclusive movements of the front legs that normally alternate, and we show that circuits in the ventral nerve cord as well as in the brain can resolve competing commands. Finally, the left and right legs must work together to remove debris. The coordination for leg rubs can be achieved by unilateral activation of a single descending neuron, while a similar manipulation of a different descending neuron decouples the legs to produce single-sided head sweeps. Taken together, these results demonstrate that distinct descending neurons orchestrate the complex alternation between the movements that make up anterior grooming.

Prefrontal connectomics: from anatomy to human imaging

The fundamental importance of prefrontal cortical connectivity to information processing and, therefore, disorders of cognition, emotion, and behavior has been recognized for decades. Anatomic tracing studies in animals have formed the basis for delineating the direct monosynaptic connectivity, from cells of origin, through axon trajectories, to synaptic terminals. Advances in neuroimaging combined with network science have taken the lead in developing complex wiring diagrams or connectomes of the human brain. A key question is how well these magnetic resonance imaging (MRI)-derived networks and hubs reflect the anatomic "hard wiring" first proposed to underlie the distribution of information for large-scale network interactions. In this review, we address this challenge by focusing on what is known about monosynaptic prefrontal cortical connections in non-human primates and how this compares to MRI-derived measurements of network organization in humans. First, we outline the anatomic cortical connections and pathways for each prefrontal cortex (PFC) region. We then review the available MRI-based techniques for indirectly measuring structural and functional connectivity, and introduce graph theoretical methods for analysis of hubs, modules, and topologically integrative features of the connectome. Finally, we bring these two approaches together, using specific examples, to demonstrate how monosynaptic connections, demonstrated by tract-tracing studies, can directly inform understanding of the composition of PFC nodes and hubs, and the edges or pathways that connect PFC to cortical and subcortical areas.

Frontopolar Cortex Response to Positive Feedback Relates to Nonincentivized Task Persistence

When individuals make decisions whether to persist at a task, their decision-making is informed by whether success is pending or accomplished. If pending, the brain facilitates behavioral persistence; if the goal is accomplished or no longer desired, the brain enables switching away from the current task. Feedback, which is known to differentially engage reward neurocircuitry, may modulate goal-directed behavior such as task persistence. However, prior studies are confounded by offering external incentives for persistence. This study tested whether neural response to feedback differed as a function of nonincentivized task persistence in 99 human participants ages 13-30 (60 females). Individuals who persisted engaged the frontopolar cortex (FPC) to a greater extent during receipt of task-relevant positive feedback compared with negative feedback. For individuals who quit, task-irrelevant monetary reward engaged the FPC to a greater extent compared with positive feedback. FPC activation in response to positive feedback is identified as a key contributor to task persistence.

Formalizing planning and information search in naturalistic decision-making

Decisions made by mammals and birds are often temporally extended. They require planning and sampling of decision-relevant information. Our understanding of such decision-making remains in its infancy compared with simpler, forced-choice paradigms. However, recent advances in algorithms supporting planning and information search provide a lens through which we can explain neural and behavioral data in these tasks. We review these advances to obtain a clearer understanding for why planning and curiosity originated in certain species but not others; how activity in the medial temporal lobe, prefrontal and cingulate cortices may support these behaviors; and how planning and information search may complement each other as means to improve future action selection.

Identification and disruption of a neural mechanism for accumulating prospective metacognitive information prior to decision-making

More than one type of probability must be considered when making decisions. It is as necessary to know one's chance of performing choices correctly as it is to know the chances that desired outcomes will follow choices. We refer to these two choice contingencies as internal and external probability. Neural activity across many frontal and parietal areas reflected internal and external probabilities in a similar manner during decision-making. However, neural recording and manipulation approaches suggest that one area, the anterior lateral prefrontal cortex (alPFC), is highly specialized for making prospective, metacognitive judgments on the basis of internal probability; it is essential for knowing which decisions to tackle, given its assessment of how well they will be performed. Its activity predicted prospective metacognitive judgments, and individual variation in activity predicted individual variation in metacognitive judgments. Its disruption altered metacognitive judgments, leading participants to tackle perceptual decisions they were likely to fail.

The Best Laid Plans: Computational Principles of Anterior Cingulate Cortex

Despite continual debate for the past 30 years about the function of anterior cingulate cortex (ACC), its key contribution to neurocognition remains unknown. However, recent computational modeling work has provided insight into this question. Here we review computational models that illustrate three core principles of ACC function, related to hierarchy, world models, and cost. We also discuss four constraints on the neural implementation of these principles, related to modularity, binding, encoding, and learning and regulation. These observations suggest a role for ACC in hierarchical model-based hierarchical reinforcement learning (HMB-HRL), which instantiates a mechanism motivating the execution of high-level plans.

Behavioral indicators of succeeding and failing under higher-challenge compulsion-like alcohol drinking in rat

Intake despite negative consequences (compulsivity) contributes strongly to the harm of alcohol use disorder, making the underlying psychological and circuit mechanisms of great importance. To gain insight into possible underlying action strategies, we compared rat licking microstructure across compulsion-like and non-compulsive conditions. We previously showed that drinking under a moderate-challenge, quinine-alcohol model (Alc-ModQ) shows less variable responding in many measures, suggesting a more automatic strategy to overcome challenge. Here, we reanalyzed our original data, newly focusing on the behavioral profile of higher-challenge intake (100 mg/L quinine in alcohol, Alc-HighQ). Alc-HighQ greatly dropped consumption, yet retained aspects of greater automaticity and drive seen with Alc-ModQ, including earlier bout initiation and measures suggesting more stereotyped tongue control. In contrast, Alc-HighQ disordered bout generation and timing. Importantly, only fast-starting bouts persisted under Alc-HighQ, and while there were many fewer longer Alc-HighQ bouts, they still contributed >50 % of consumption. Also, longer bouts under Alc-HighQ had an early, several-second period with greater chance of stopping, but afterwards showed similar persistence and recovery from slow licking as other drinking conditions. Together, our findings elucidate novel behavioral indicators of successful and unsuccessful epochs of Alc-HighQ, compulsion-like intake. We also relate findings to congruent human and animal work implicating anterior insula and medial prefrontal cortices as critical for compulsion-like alcohol responding, and where ventral frontal cortex has been more associated with overall action plan and tongue control (retained under Alc-HighQ), with medial cortex more related to proximal action timing (disrupted under Alc-HighQ except after faster bout initiation).

Polarity of uncertainty representation during exploration and exploitation in ventromedial prefrontal cortex

Environments furnish multiple information sources for making predictions about future events. Here we use behavioural modelling and functional magnetic resonance imaging to describe how humans select predictors that might be most relevant. First, during early encounters with potential predictors, participants' selections were explorative and directed towards subjectively uncertain predictors (positive uncertainty effect). This was particularly the case when many future opportunities remained to exploit knowledge gained. Then, preferences for accurate predictors increased over time, while uncertain predictors were avoided (negative uncertainty effect). The behavioural transition from positive to negative uncertainty-driven selections was accompanied by changes in the representations of belief uncertainty in ventromedial prefrontal cortex (vmPFC). The polarity of uncertainty representations (positive or negative encoding of uncertainty) changed between exploration and exploitation periods. Moreover, the two periods were separated by a third transitional period in which beliefs about predictors' accuracy predominated. The vmPFC signals a multiplicity of decision variables, the strength and polarity of which vary with behavioural context.

Where is Cingulate Cortex? A Cross-Species View

To compare findings across species, neuroscience relies on cross-species homologies, particularly in terms of brain areas. For cingulate cortex, a structure implicated in behavioural adaptation and control, a homologous definition across mammals is available - but currently not employed by most rodent researchers. The standard partitioning of rodent cingulate cortex is inconsistent with that in any other model species, including humans. Reviewing the existing literature, we show that the homologous definition better aligns results of rodent studies with those of other species, and reveals a clearer structural and functional organisation within rodent cingulate cortex itself. Based on these insights, we call for widespread adoption of the homologous nomenclature, and reinterpretation of previous studies originally based on the nonhomologous partitioning of rodent cingulate cortex.

Circuits, Networks, and Neuropsychiatric Disease: Transitioning From Anatomy to Imaging

Since the development of cellular and myelin stains, anatomy has formed the foundation for understanding circuitry in the human brain. However, recent functional and structural studies using magnetic resonance imaging have taken the lead in this endeavor. These innovative and noninvasive approaches have the advantage of studying connectivity patterns under different conditions directly in the human brain. They demonstrate dynamic and structural changes within and across networks linked to normal function and to a wide range of psychiatric illnesses. However, these indirect methods are unable to link networks to the hardwiring that underlies them. In contrast, anatomic invasive experimental studies can. Following a brief review of prefrontal cortical, anterior cingulate, and striatal connections and the different methodologies used, this article discusses how data from anatomic studies can help inform how hardwired connections are linked to the functional and structural networks identified in imaging studies.

The neural basis of predictive pursuit

It remains unclear whether and, if so, how nonhuman animals make on-the-fly predictions during pursuit. Here we used a novel laboratory pursuit task that incentivizes the prediction of future prey positions. We trained three macaques to perform a joystick-controlled pursuit task in which prey follow intelligent escape algorithms. Subjects aimed toward the likely future positions of the prey, which indicated that they generate internal predictions and use these to guide behavior. We then developed a generative model that explains real-time pursuit trajectories and showed that our subjects use prey position, velocity and acceleration to make predictions. We identified neurons in the dorsal anterior cingulate cortex whose responses track these three variables. These neurons multiplexed prediction-related variables with a distinct and explicit representation of the future position of the prey. Our results provide a clear demonstration that the brain can explicitly represent future predictions and highlight the critical role of anterior cingulate cortex for future-oriented cognition.

Neural computations underlying strategic social decision-making in groups

When making decisions in groups, the outcome of one's decision often depends on the decisions of others, and there is a tradeoff between short-term incentives for an individual and long-term incentives for the groups. Yet, little is known about the neurocomputational mechanisms at play when weighing different utilities during repeated social interactions. Here, using model-based fMRI and Public-good-games, we find that the ventromedial prefrontal cortex encodes immediate expected rewards as individual utility while the lateral frontopolar cortex encodes group utility (i.e., pending rewards of alternative strategies beneficial for the group). When it is required to change one's strategy, these brain regions exhibited changes in functional interactions with brain regions engaged in switching strategies. Moreover, the anterior cingulate cortex and the temporoparietal junction updated beliefs about the decision of others during interactions. Together, our findings provide a neurocomputational account of how the brain dynamically computes effective strategies to make adaptive collective decisions.

Planning Your Way: How Humans Strategically Evaluate Prospective Decisions

We are capable of planning ahead by incorporating dynamic factors influencing future choices. In this issue of Neuron, Kolling et al. (2018) present fMRI results of a novel task that demonstrates how humans evaluate alternative environments by prospectively incorporating their characteristics over time and account for their own decision tendencies.

A connectional hub in the rostral anterior cingulate cortex links areas of emotion and cognitive control

We investigated afferent inputs from all areas in the frontal cortex (FC) to different subregions in the rostral anterior cingulate cortex (rACC). Using retrograde tracing in macaque monkeys, we quantified projection strength by counting retrogradely labeled cells in each FC area. The projection from different FC regions varied across injection sites in strength, following different spatial patterns. Importantly, a site at the rostral end of the cingulate sulcus stood out as having strong inputs from many areas in diverse FC regions. Moreover, it was at the integrative conjunction of three projection trends across sites. This site marks a connectional hub inside the rACC that integrates FC inputs across functional modalities. Tractography with monkey diffusion magnetic resonance imaging (dMRI) located a similar hub region comparable to the tracing result. Applying the same tractography method to human dMRI data, we demonstrated that a similar hub can be located in the human rACC.

Hierarchical reasoning by neural circuits in the frontal cortex

Humans process information hierarchically. In the presence of hierarchies, sources of failures are ambiguous. Humans resolve this ambiguity by assessing their confidence after one or more attempts. To understand the neural basis of this reasoning strategy, we recorded from dorsomedial frontal cortex (DMFC) and anterior cingulate cortex (ACC) of monkeys in a task in which negative outcomes were caused either by misjudging the stimulus or by a covert switch between two stimulus-response contingency rules. We found that both areas harbored a representation of evidence supporting a rule switch. Additional perturbation experiments revealed that ACC functioned downstream of DMFC and was directly and specifically involved in inferring covert rule switches. These results‏ reveal the computational principles of hierarchical reasoning, as implemented by cortical circuits.

The macaque anterior cingulate cortex translates counterfactual choice value into actual behavioral change

The neural mechanisms mediating sensory-guided decision making have received considerable attention but animals often pursue behaviors for which there is currently no sensory evidence. Such behaviors are guided by internal representations of choice values that have to be maintained even when these choices are unavailable. We investigated how four macaque monkeys maintained representations of the value of counterfactual choices– choices that could not be taken at the current moment but which could be taken in the future. Using functional magnetic resonance imaging, we found two different patterns of activity co-varying with values of counterfactual choices in a circuit spanning hippocampus, anterior lateral prefrontal cortex, and anterior cingulate cortex (ACC). ACC activity also reflected whether the internal value representations would be translated into actual behavioral change. To establish the causal importance of ACC for this translation process, we used a novel technique, Transcranial Focused Ultrasound Stimulation, to reversibly disrupt ACC activity.

Looking for Mr(s) Right: Decision bias can prevent us from finding the most attractive face

In realistic and challenging decision contexts, people may show biases that prevent them from choosing their favored options. For example, astronomer Johannes Kepler famously interviewed several candidate fiancées sequentially, but was rejected when attempting to return to a previous candidate. Similarly, we examined human performance on searches for attractive faces through fixed-length sequences by adapting optimal stopping computational theory developed from behavioral ecology and economics. Although economics studies have repeatedly found that participants sample too few options before choosing the best-ranked number from a series, we instead found overlong searches with many sequences ending without choice. Participants employed irrationally high choice thresholds, compared to the more lax, realistic standards of a Bayesian ideal observer, which achieved better-ranked faces. We consider several computational accounts and find that participants most resemble a Bayesian model that decides based on altered attractiveness values. These values may produce starkly different biases in the facial attractiveness domain than in other decision domains.