Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making

Revisiting the role of computational neuroimaging in the era of integrative neuroscience

Computational models have become integral to human neuroimaging research, providing both mechanistic insights and predictive tools for human cognition and behavior. However, concerns persist regarding the ecological validity of lab-based neuroimaging studies and whether their spatiotemporal resolution is not sufficient for capturing neural dynamics. This review aims to re-examine the utility of computational neuroimaging, particularly in light of the growing prominence of alternative neuroscientific methods and the growing emphasis on more naturalistic behaviors and paradigms. Specifically, we will explore how computational modeling can both enhance the analysis of high-dimensional imaging datasets and, conversely, how neuroimaging, in conjunction with other data modalities, can inform computational models through the lens of neurobiological plausibility. Collectively, this evidence suggests that neuroimaging remains critical for human neuroscience research, and when enhanced by computational models, imaging can serve an important role in bridging levels of analysis and understanding. We conclude by proposing key directions for future research, emphasizing the development of standardized paradigms and the integrative use of computational modeling across neuroimaging techniques.

Cross-species translational paradigms for assessing positive valence system as defined by the RDoC matrix

Functions associated with processing reward-related information are fundamental drivers of motivation, learning, and goal-directed behavior. Such functions have been classified as the positive valence system under the Research Domain and Criteria (RDoC) criteria and are negatively impacted across a range of psychiatric disorders and mental illnesses. The positive valence system is composed of three comprehensive categories containing related but dissociable functions that are organized into either Reward Responsiveness, Reward Learning, or Reward Valuation. The presence of overlapping behavioral dysfunction across diagnostic mental disorders is in-part what motivated the RDoC initiative, which emphasized that the study of mental illness focus on investigating relevant behavior and cognitive functions and their underlying mechanisms, rather than separating efforts on diagnostic categories (i.e., transdiagnostic). Moreover, the RDoC approach is well-suited for preclinical neuroscience research, as the rise in genetic toolboxes and associated neurotechnologies enables researchers to probe specific cellular targets with high specificity. Thus, there is an opportunity to dissect whether behaviors and cognitive functions are supported by shared or distinct neural mechanisms. For preclinical research to effectively inform our understandings of human behavior however, the cognitive and behavioral paradigms should have predictive, neurobiological, and pharmacological predictive validity to the human test. Touchscreen-based testing systems provide a further advantage for this endeavor enabling tasks to be presented to animals using the same media and task design as in humans. Here, we outline the primary categories of the positive valence system and review the work that has been done cross-species to investigate the neurobiology and neurochemistry underlying reward-related functioning. Additionally, we provide clinical tasks outlined by RDoC, along with validity and/or need for further validation for analogous rodent paradigms with a focus on implementing the touchscreen-based cognitive testing systems.

Nucleus accumbens dopamine release reflects Bayesian inference during instrumental learning

Dopamine release in the nucleus accumbens has been hypothesized to signal reward prediction error, the difference between observed and predicted reward, suggesting a biological implementation for reinforcement learning. Rigorous tests of this hypothesis require assumptions about how the brain maps sensory signals to reward predictions, yet this mapping is still poorly understood. In particular, the mapping is non-trivial when sensory signals provide ambiguous information about the hidden state of the environment. Previous work using classical conditioning tasks has suggested that reward predictions are generated conditional on probabilistic beliefs about the hidden state, such that dopamine implicitly reflects these beliefs. Here we test this hypothesis in the context of an instrumental task (a two-armed bandit), where the hidden state switches repeatedly. We measured choice behavior and recorded dLight signals reflecting dopamine release in the nucleus accumbens core. Model comparison among a wide set of cognitive models based on the behavioral data favored models that used Bayesian updating of probabilistic beliefs. These same models also quantitatively matched the dopamine measurements better than non-Bayesian alternatives. We conclude that probabilistic belief computation contributes to instrumental task performance in mice and is reflected in mesolimbic dopamine signaling.

Multiple faces of anxiety: a frontal lobe perspective

Marked dysregulation of the human prefrontal cortex (PFC) and anterior cingulate cortex (ACC) characterises a variety of anxiety disorders, and its amelioration is a key feature of treatment success. Overall treatment response, however, is highly variable, and about a third of patients are resistant to treatment. In this review we hypothesise that a major contributor to this variation in treatment response are the multiple faces of anxiety induced by distinct forms of frontal cortex dysregulation. Comparison of findings from humans and non-human primates reveals marked similarity in the functional organisation of threat regulation across the frontal lobes. This organisation is discussed in relation to the 'predatory imminence continuum' model of threat and the differential engagement of executive functions at the core of both emotion generation and regulation strategies.

Dissociable Roles of the Dorsolateral and Ventromedial Prefrontal Cortex in Human Categorization

Models of human categorization predict the prefrontal cortex (PFC) serves a central role in category learning. The dorsolateral prefrontal cortex (dlPFC) and ventromedial prefrontal cortex (vmPFC) have been implicated in categorization; however, it is unclear whether both are critical for categorization and whether they support unique functions. We administered three categorization tasks to patients with PFC lesions (mean age, 69.6 years; 5 men, 5 women) to examine how the prefrontal subregions contribute to categorization. These included a rule-based (RB) task that was solved via a unidimensional rule, an information integration (II) task that was solved by combining information from two stimulus dimensions, and a deterministic/probabilistic (DP) task with stimulus features that had varying amounts of category-predictive information. Compared with healthy comparison participants, both patient groups had impaired performance. Impairments in the dlPFC patients were largest during the RB task, whereas impairments in the vmPFC patients were largest during the DP task. A hierarchical model was fit to the participants' data to assess learning deficits in the patient groups. PFC damage was correlated with a regularization term that limited updates to attention after each trial. Our results suggest that the PFC, as a whole, is important for learning to orient attention to relevant stimulus information. The dlPFC may be especially important for rule-based learning, whereas the vmPFC may be important for focusing attention on deterministic (highly diagnostic) features and ignoring less predictive features. These results support overarching functions of the dlPFC in executive functioning and the vmPFC in value-based decision-making.

Cortico-striatal white-matter connectivity underlies the ability to exert goal-directed control

The balance between goal-directed and habitual control has been proposed to determine the flexibility of instrumental behaviour, in both humans and animals. This view is supported by neuroscientific studies that have implicated dissociable neural pathways in the ability to flexibly adjust behaviour when outcome values change. A previous Diffusion Tensor Imaging study provided preliminary evidence that flexible instrumental performance depends on the strength of parallel cortico-striatal white-matter pathways previously implicated in goal-directed and habitual control. Specifically, estimated white-matter strength between caudate and ventromedial prefrontal cortex correlated positively with behavioural flexibility, and posterior putamen-premotor cortex connectivity correlated negatively, in line with the notion that these pathways compete for control. However, the sample size of the original study was limited, and so far, there have been no attempts to replicate these findings. In the present study, we aimed to conceptually replicate these findings by testing a large sample of 205 young adults to relate cortico-striatal connectivity to performance on the slips-of-action task. In short, we found only positive neural correlates of goal-directed performance, including striatal connectivity (caudate and anterior putamen) with the dorsolateral prefrontal cortex. However, we failed to provide converging evidence for the existence of a neural habit system that puts limits on the capacity for flexible, goal-directed action. We discuss the implications of our findings for dual-process theories of instrumental action.

Neural correlates of chocolate brand preference: A functional MRI study

BACKGROUND AND PURPOSE

Preferences can be developed for, or against, specific brands and services. Using two functional magnetic resonance imaging (fMRI) experiments, this study investigated two dissociable aspects of reward processing, craving and liking, in chocolate lovers. The goal was to further delineate the neural basis supporting branding effects using familiar chocolate (FC) and unfamiliar chocolate (UC) brand images.

METHODS

In the first experiment, subjects rated their subjective craving and liking on a scale of 1-5 (weak-strong) for each FC and UC image. In the second experiment, they performed a choice task between FC and UC images.

RESULTS

Both the craving and liking ratings were significantly greater for FC and were differentially correlated with choice behavior. Craving ratings predicted greater preference for UC, and liking ratings predicted greater preference for FC. A contrast of neural activity for UC versus FC choice trials revealed significantly greater activation for UC choices in the bilateral inferior frontal gyrus and right caudate head. Response times for the FC images were faster than UC images; fMRI activity in the ventromedial prefrontal cortex was significantly correlated with response times during FC trials, but not UC trials. These correlations were significantly different from each other at the group level.

CONCLUSIONS

The choices for branded chocolate products are driven by higher subjective reward ratings and lower neural processing demands.

The hippocampus dissociates present from past and future goals

Our brain adeptly navigates goals across time frames, distinguishing between urgent needs and those of the past or future. The hippocampus is a region known for supporting mental time travel and organizing information along its longitudinal axis, transitioning from detailed posterior representations to generalized anterior ones. This study investigates the role of the hippocampus in distinguishing goals over time: whether the hippocampus encodes time regardless of detail or abstraction, and whether the hippocampus preferentially activates its anterior region for temporally distant goals (past and future) and its posterior region for immediate goals. We use a space-themed experiment with 7T functional MRI on 31 participants to examine how the hippocampus encodes the temporal distance of goals. During a simulated Mars mission, we find that the hippocampus tracks goals solely by temporal proximity. We show that past and future goals activate the left anterior hippocampus, while current goals engage the left posterior hippocampus. This suggests that the hippocampus maps goals using timestamps, extending its long axis system to include temporal goal organization.

Dysfunctional feedback processing in male methamphetamine abusers: Evidence from neurophysiological and computational approaches

Methamphetamine use disorder (MUD) as a major public health risk is associated with dysfunctional neural feedback processing. Although dysfunctional feedback processing in people who are substance dependent has been explored in several behavioral, computational, and electrocortical studies, this mechanism in MUDs requires to be well understood. Furthermore, the current understanding of latent components of their behavior such as learning speed and exploration-exploitation dilemma is still limited. In addition, the association between the latent cognitive components and the related neural mechanisms also needs to be explored. Therefore, in this study, the underlying neurocognitive mechanisms of feedback processing of such impairment, and age/gender-matched healthy controls are evaluated within a probabilistic learning task with rewards and punishments. Mathematical modeling results based on the Q-learning paradigm suggested that MUDs show less sensitivity in distinguishing optimal options. Additionally, it may be worth noting that MUDs exhibited a slight decrease in their ability to learn from negative feedback compared to healthy controls. Also through the lens of underlying neural mechanisms, MUDs showed lower theta power at the medial-frontal areas while responding to negative feedback. However, other EEG measures of reinforcement learning including feedback-related negativity, parietal-P300, and activity flow from the medial frontal to lateral prefrontal regions, remained intact in MUDs. On the other hand, the elimination of the linkage between value sensitivity and medial-frontal theta activity in MUDs was observed. The observed dysfunction could be due to the adverse effects of methamphetamine on the cortico-striatal dopamine circuit, which is reflected in the anterior cingulate cortex activity as the most likely region responsible for efficient behavior adjustment. These findings could help us to pave the way toward tailored therapeutic approaches.

Artificial neural networks for model identification and parameter estimation in computational cognitive models

Computational cognitive models have been used extensively to formalize cognitive processes. Model parameters offer a simple way to quantify individual differences in how humans process information. Similarly, model comparison allows researchers to identify which theories, embedded in different models, provide the best accounts of the data. Cognitive modeling uses statistical tools to quantitatively relate models to data that often rely on computing/estimating the likelihood of the data under the model. However, this likelihood is computationally intractable for a substantial number of models. These relevant models may embody reasonable theories of cognition, but are often under-explored due to the limited range of tools available to relate them to data. We contribute to filling this gap in a simple way using artificial neural networks (ANNs) to map data directly onto model identity and parameters, bypassing the likelihood estimation. We test our instantiation of an ANN as a cognitive model fitting tool on classes of cognitive models with strong inter-trial dependencies (such as reinforcement learning models), which offer unique challenges to most methods. We show that we can adequately perform both parameter estimation and model identification using our ANN approach, including for models that cannot be fit using traditional likelihood-based methods. We further discuss our work in the context of the ongoing research leveraging simulation-based approaches to parameter estimation and model identification, and how these approaches broaden the class of cognitive models researchers can quantitatively investigate.

Value Estimation versus Effort Mobilization: A General Dissociation between Ventromedial and Dorsomedial Prefrontal Cortex

Deciding on a course of action requires both an accurate estimation of option values and the right amount of effort invested in deliberation to reach sufficient confidence in the final choice. In a previous study, we have provided evidence, across a series of judgment and choice tasks, for a dissociation between the ventromedial prefrontal cortex (vmPFC), which would represent option values, and the dorsomedial prefrontal cortex (dmPFC), which would represent the duration of deliberation. Here, we first replicate this dissociation and extend it to the case of an instrumental learning task, in which 24 human volunteers (13 women) choose between options associated with probabilistic gains and losses. According to fMRI data recorded during decision-making, vmPFC activity reflects the sum of option values generated by a reinforcement learning model and dmPFC activity the deliberation time. To further generalize the role of the dmPFC in mobilizing effort, we then analyze fMRI data recorded in the same participants while they prepare to perform motor and cognitive tasks (squeezing a handgrip or making numerical comparisons) to maximize gains or minimize losses. In both cases, dmPFC activity is associated with the output of an effort regulation model, and not with response time. Taken together, these results strengthen a general theory of behavioral control that implicates the vmPFC in the estimation of option values and the dmPFC in the energization of relevant motor and cognitive processes.

Impaired value-based decision-making in Parkinson's disease apathy

Apathy is a common and disabling complication of Parkinson's disease characterized by reduced goal-directed behaviour. Several studies have reported dysfunction within prefrontal cortical regions and projections from brainstem nuclei whose neuromodulators include dopamine, serotonin and noradrenaline. Work in animal and human neuroscience have confirmed contributions of these neuromodulators on aspects of motivated decision-making. Specifically, these neuromodulators have overlapping contributions to encoding the value of decisions, and influence whether to explore alternative courses of action or persist in an existing strategy to achieve a rewarding goal. Building upon this work, we hypothesized that apathy in Parkinson's disease should be associated with an impairment in value-based learning. Using a four-armed restless bandit reinforcement learning task, we studied decision-making in 75 volunteers; 53 patients with Parkinson's disease, with and without clinical apathy, and 22 age-matched healthy control subjects. Patients with apathy exhibited impaired ability to choose the highest value bandit. Task performance predicted an individual patient's apathy severity measured using the Lille Apathy Rating Scale (R = -0.46, P < 0.001). Computational modelling of the patient's choices confirmed the apathy group made decisions that were indifferent to the learnt value of the options, consistent with previous reports of reward insensitivity. Further analysis demonstrated a shift away from exploiting the highest value option and a reduction in perseveration, which also correlated with apathy scores (R = -0.5, P < 0.001). We went on to acquire functional MRI in 59 volunteers; a group of 19 patients with and 20 without apathy and 20 age-matched controls performing the Restless Bandit Task. Analysis of the functional MRI signal at the point of reward feedback confirmed diminished signal within ventromedial prefrontal cortex in Parkinson's disease, which was more marked in apathy, but not predictive of their individual apathy severity. Using a model-based categorization of choice type, decisions to explore lower value bandits in the apathy group activated prefrontal cortex to a similar degree to the age-matched controls. In contrast, Parkinson's patients without apathy demonstrated significantly increased activation across a distributed thalamo-cortical network. Enhanced activity in the thalamus predicted individual apathy severity across both patient groups and exhibited functional connectivity with dorsal anterior cingulate cortex and anterior insula. Given that task performance in patients without apathy was no different to the age-matched control subjects, we interpret the recruitment of this network as a possible compensatory mechanism, which compensates against symptomatic manifestation of apathy in Parkinson's disease.

From learned value to sustained bias: how reward conditioning changes attentional priority

Introduction

Attentional bias to reward-associated stimuli can occur even when it interferes with goal-driven behavior. One theory posits that dopaminergic signaling in the striatum during reward conditioning leads to changes in visual cortical and parietal representations of the stimulus used, and this, in turn, sustains attentional bias even when reward is discontinued. However, only a few studies have examined neural activity during both rewarded and unrewarded task phases.

Methods

In the current study, participants first completed a reward-conditioning phase, during which responses to certain stimuli were associated with monetary reward. These stimuli were then included as non-predictive cues in a spatial cueing task. Participants underwent functional brain imaging during both task phases.

Results

The results show that striatal activity during the learning phase predicted increased visual cortical and parietal activity and decreased ventro-medial prefrontal cortex activity in response to conditioned stimuli during the test. Striatal activity was also associated with anterior cingulate cortex activation when the reward-conditioned stimulus directed attention away from the target.

Discussion

Our findings suggest that striatal activity during reward conditioning predicts the degree to which reward history biases attention through learning-induced changes in visual and parietal activities.

Artificial neural networks for model identification and parameter estimation in computational cognitive models

Computational cognitive models have been used extensively to formalize cognitive processes. Model parameters offer a simple way to quantify individual differences in how humans process information. Similarly, model comparison allows researchers to identify which theories, embedded in different models, provide the best accounts of the data. Cognitive modeling uses statistical tools to quantitatively relate models to data that often rely on computing/estimating the likelihood of the data under the model. However, this likelihood is computationally intractable for a substantial number of models. These relevant models may embody reasonable theories of cognition, but are often under-explored due to the limited range of tools available to relate them to data. We contribute to filling this gap in a simple way using artificial neural networks (ANNs) to map data directly onto model identity and parameters, bypassing the likelihood estimation. We test our instantiation of an ANN as a cognitive model fitting tool on classes of cognitive models with strong inter-trial dependencies (such as reinforcement learning models), which offer unique challenges to most methods. We show that we can adequately perform both parameter estimation and model identification using our ANN approach, including for models that cannot be fit using traditional likelihood-based methods. We further discuss our work in the context of the ongoing research leveraging simulation-based approaches to parameter estimation and model identification, and how these approaches broaden the class of cognitive models researchers can quantitatively investigate.

A theory of the neural mechanisms underlying negative cognitive bias in major depression

The widely acknowledged cognitive theory of depression, developed by Aaron Beck, focused on biased information processing that emphasizes the negative aspects of affective and conceptual information. Current attempts to discover the neurological mechanism underlying such cognitive and affective bias have successfully identified various brain regions associated with severally biased functions such as emotion, attention, rumination, and inhibition control. However, the neurobiological mechanisms of how individuals in depression develop this selective processing toward negative is still under question. This paper introduces a neurological framework centered around the frontal-limbic circuit, specifically analyzing and synthesizing the activity and functional connectivity within the amygdala, hippocampus, and medial prefrontal cortex. Firstly, a possible explanation of how the positive feedback loop contributes to the persistent hyperactivity of the amygdala in depression at an automatic level is established. Building upon this, two hypotheses are presented: hypothesis 1 revolves around the bidirectional amygdalohippocampal projection facilitating the amplification of negative emotions and memories while concurrently contributing to the impediment of the retrieval of opposing information in the hippocampus attractor network. Hypothesis 2 highlights the involvement of the ventromedial prefrontal cortex in the establishment of a negative cognitive framework through the generalization of conceptual and emotional information in conjunction with the amygdala and hippocampus. The primary objective of this study is to improve and complement existing pathological models of depression, pushing the frontiers of current understanding in neuroscience of affective disorders, and eventually contributing to successful recovery from the debilitating affective disorders.

Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

Active reinforcement learning enables dynamic prediction and control, where one should not only maximize rewards but also minimize costs such as of inference, decisions, actions, and time. For an embodied agent such as a human, decisions are also shaped by physical aspects of actions. Beyond the effects of reward outcomes on learning processes, to what extent can modeling of behavior in a reinforcement-learning task be complicated by other sources of variance in sequential action choices? What of the effects of action bias (for actions per se) and action hysteresis determined by the history of actions chosen previously? The present study addressed these questions with incremental assembly of models for the sequential choice data from a task with hierarchical structure for additional complexity in learning. With systematic comparison and falsification of computational models, human choices were tested for signatures of parallel modules representing not only an enhanced form of generalized reinforcement learning but also action bias and hysteresis. We found evidence for substantial differences in bias and hysteresis across participants-even comparable in magnitude to the individual differences in learning. Individuals who did not learn well revealed the greatest biases, but those who did learn accurately were also significantly biased. The direction of hysteresis varied among individuals as repetition or, more commonly, alternation biases persisting from multiple previous actions. Considering that these actions were button presses with trivial motor demands, the idiosyncratic forces biasing sequences of action choices were robust enough to suggest ubiquity across individuals and across tasks requiring various actions. In light of how bias and hysteresis function as a heuristic for efficient control that adapts to uncertainty or low motivation by minimizing the cost of effort, these phenomena broaden the consilient theory of a mixture of experts to encompass a mixture of expert and nonexpert controllers of behavior.

Corticostriatal activity related to performance during continuous de novo motor learning

Corticostriatal regions play a pivotal role in visuomotor learning. However, less research has been done on how fMRI activity in their subregions is related to task performance, which is provided as visual feedback during motor learning. To address this, we conducted an fMRI experiment in which participants acquired a complex de novo motor skill using continuous or binary visual feedback related to performance. We found a highly selective response related to performance in the entire striatum in both conditions and a relatively higher response in the caudate nucleus for the binary feedback condition. However, the ventromedial prefrontal cortex (vmPFC) response was significant only for the continuous feedback condition. Furthermore, we also found functional distinction of the striatal subregions in random versus goal-directed motor control. These findings underscore the substantial effects of the visual feedback indicating performance on distinct corticostriatal responses, thereby elucidating its significance in reinforcement-based motor learning.

Neural and computational underpinnings of biased confidence in human reinforcement learning

While navigating a fundamentally uncertain world, humans and animals constantly evaluate the probability of their decisions, actions or statements being correct. When explicitly elicited, these confidence estimates typically correlates positively with neural activity in a ventromedial-prefrontal (VMPFC) network and negatively in a dorsolateral and dorsomedial prefrontal network. Here, combining fMRI with a reinforcement-learning paradigm, we leverage the fact that humans are more confident in their choices when seeking gains than avoiding losses to reveal a functional dissociation: whereas the dorsal prefrontal network correlates negatively with a condition-specific confidence signal, the VMPFC network positively encodes task-wide confidence signal incorporating the valence-induced bias. Challenging dominant neuro-computational models, we found that decision-related VMPFC activity better correlates with confidence than with option-values inferred from reinforcement-learning models. Altogether, these results identify the VMPFC as a key node in the neuro-computational architecture that builds global feeling-of-confidence signals from latent decision variables and contextual biases during reinforcement-learning.

Learning and memory deficits produced by aspartame are heritable via the paternal lineage

Environmental exposures produce heritable traits that can linger in the population for one or two generations. Millions of individuals consume substances such as artificial sweeteners daily that are declared safe by regulatory agencies without evaluation of their potential heritable effects. We show that consumption of aspartame, an FDA-approved artificial sweetener, daily for up to 16-weeks at doses equivalent to only 7-15% of the FDA recommended maximum daily intake value (equivalent to 2-4 small, 8 oz diet soda drinks per day) produces significant spatial learning and memory deficits in mice. Moreover, the cognitive deficits are transmitted to male and female descendants along the paternal lineage suggesting that aspartame's adverse cognitive effects are heritable, and that they are more pervasive than current estimates, which consider effects in the directly exposed individuals only. Traditionally, deleterious environmental exposures of pregnant and nursing women are viewed as risk factors for the health of future generations. Environmental exposures of men are not considered to pose similar risks. Our findings suggest that environmental exposures of men can produce adverse impact on cognitive function in future generations and demonstrate the need for considering heritable effects via the paternal lineage as part of the regulatory evaluations of artificial sweeteners.

Hippocampal timestamp for goals

Our brain must manage multiple goals that differ in their temporal proximity. Some goals require immediate attention, while others have already been accomplished, or will be relevant later in time. Here, we examined how the hippocampus represents the temporal distance to different goals using a novel space-themed paradigm during 7T functional MRI (n=31). The hippocampus has an established role in mental time travel and a system in place to stratify information along its longitudinal axis on the basis of representational granularity. Previous work has documented a functional transformation from fine-grained, detail rich representations in the posterior hippocampus to coarse, gist-like representations in the anterior hippocampus. We tested whether the hippocampus uses this long axis system to dissociate goals based upon their temporal distance from the present. We hypothesized that the hippocampus would distinguish goals relevant for ones' current needs from those that are removed in time along the long axis, with temporally removed past and future goals eliciting increasingly anterior activation. We sent participants on a mission to Mars where they had to track goals that differed in when they needed to be accomplished. We observed a long-axis dissociation, where temporally removed past and future goals activated the left anterior hippocampus and current goals activated the left posterior hippocampus. Altogether, this study demonstrates that the timestamp attached to a goal is a key driver in where the goal is represented in the hippocampus. This work extends the scope of the hippocampus' long axis system to the goal-mapping domain.

Occipital and parietal cortex participate in a cortical network for transsaccadic discrimination of object shape and orientation

Saccades change eye position and interrupt vision several times per second, necessitating neural mechanisms for continuous perception of object identity, orientation, and location. Neuroimaging studies suggest that occipital and parietal cortex play complementary roles for transsaccadic perception of intrinsic versus extrinsic spatial properties, e.g., dorsomedial occipital cortex (cuneus) is sensitive to changes in spatial frequency, whereas the supramarginal gyrus (SMG) is modulated by changes in object orientation. Based on this, we hypothesized that both structures would be recruited to simultaneously monitor object identity and orientation across saccades. To test this, we merged two previous neuroimaging protocols: 21 participants viewed a 2D object and then, after sustained fixation or a saccade, judged whether the shape or orientation of the re-presented object changed. We, then, performed a bilateral region-of-interest analysis on identified cuneus and SMG sites. As hypothesized, cuneus showed both saccade and feature (i.e., object orientation vs. shape change) modulations, and right SMG showed saccade-feature interactions. Further, the cuneus activity time course correlated with several other cortical saccade/visual areas, suggesting a 'functional network' for feature discrimination. These results confirm the involvement of occipital/parietal cortex in transsaccadic vision and support complementary roles in spatial versus identity updating.

Cognitive and neural bases of visual-context-guided decision-making

Humans adjust their behavioral strategies based on feedback, a process that may depend on intrinsic preferences and contextual factors such as visual salience. In this study, we hypothesized that decision-making based on visual salience is influenced by habitual and goal-directed processes, which can be evidenced by changes in attention and subjective valuation systems. To test this hypothesis, we conducted a series of studies to investigate the behavioral and neural mechanisms underlying visual salience-driven decision-making. We first established the baseline behavioral strategy without salience in Experiment 1 (n = 21). We then highlighted the utility or performance dimension of the chosen outcome using colors in Experiment 2 (n = 30). We demonstrated that the difference in staying frequency increased along the salient dimension, confirming a salience effect. Furthermore, the salience effect was abolished when directional information was removed in Experiment 3 (n = 28), suggesting that the salience effect is feedback-specific. To generalize our findings, we replicated the feedback-specific salience effects using eye-tracking and text emphasis. The fixation differences between the chosen and unchosen values were enhanced along the feedback-specific salient dimension in Experiment 4 (n = 48) but unchanged after removing feedback-specific information in Experiment 5 (n = 32). Moreover, the staying frequency was correlated with fixation properties, confirming that salience guides attention deployment. Lastly, our neuroimaging study (Experiment 6, n = 25) showed that the striatum subregions encoded salience-based outcome evaluation, while the vmPFC encoded salience-based behavioral adjustments. The connectivity of the vmPFC-ventral striatum accounted for individual differences in utility-driven, whereas the vmPFC-dmPFC for performance-driven behavioral adjustments. Together, our results provide a neurocognitive account of how task-irrelevant visual salience drives decision-making by involving attention and the frontal-striatal valuation systems. PUBLIC SIGNIFICANCE STATEMENT: Humans may use the current outcome to make behavior adjustments. How this occurs may depend on stable individual preferences and contextual factors, such as visual salience. Under the hypothesis that visual salience determines attention and subsequently modulates subjective valuation, we investigated the underlying behavioral and neural bases of visual-context-guided outcome evaluation and behavioral adjustments. Our findings suggest that the reward system is orchestrated by visual context and highlight the critical role of attention and the frontal-striatal neural circuit in visual-context-guided decision-making that may involve habitual and goal-directed processes.

Aberrant uncertainty processing is linked to psychotic-like experiences, autistic traits, and is reflected in pupil dilation during probabilistic learning

Aberrant belief updating due to misestimation of uncertainty and an increased perception of the world as volatile (i.e., unstable) has been found in autism and psychotic disorders. Pupil dilation tracks events that warrant belief updating, likely reflecting the adjustment of neural gain. However, whether subclinical autistic or psychotic symptoms affect this adjustment and how they relate to learning in volatile environments remains to be unraveled. We investigated the relationship between behavioral and pupillometric markers of subjective volatility (i.e., experience of the world as unstable), autistic traits, and psychotic-like experiences in 52 neurotypical adults with a probabilistic reversal learning task. Computational modeling revealed that participants with higher psychotic-like experience scores overestimated volatility in low-volatile task periods. This was not the case for participants scoring high on autistic-like traits, who instead showed a diminished adaptation of choice-switching behavior in response to risk. Pupillometric data indicated that individuals with higher autistic- or psychotic-like trait and experience scores differentiated less between events that warrant belief updating and those that do not when volatility was high. These findings are in line with misestimation of uncertainty accounts of psychosis and autism spectrum disorders and indicate that aberrancies are already present at the subclinical level.

A tripartite view of the posterior cingulate cortex

The posterior cingulate cortex (PCC) is one of the least understood regions of the cerebral cortex. By contrast, the anterior cingulate cortex has been the subject of intensive investigation in humans and model animal systems, leading to detailed behavioural and computational theoretical accounts of its function. The time is right for similar progress to be made in the PCC given its unique anatomical and physiological properties and demonstrably important contributions to higher cognitive functions and brain diseases. Here, we describe recent progress in understanding the PCC, with a focus on convergent findings across species and techniques that lay a foundation for establishing a formal theoretical account of its functions. Based on this converging evidence, we propose that the broader PCC region contains three major subregions - the dorsal PCC, ventral PCC and retrosplenial cortex - that respectively support the integration of executive, mnemonic and spatial processing systems. This tripartite subregional view reconciles inconsistencies in prior unitary theories of PCC function and offers promising new avenues for progress.

Temporal Dynamics Underlying Prelimbic Prefrontal Cortical Regulation of Action Selection and Outcome Evaluation during Risk/Reward Decision-Making

Risk/reward decision-making is a dynamic process that includes periods of deliberation before action selection and evaluation of the action outcomes that bias subsequent choices. Inactivation of the prelimbic (PL) cortex has revealed its integral role in updating decision biases in the face of changes in probabilistic reward contingencies, yet how phasic PL signals during different phases of the decision process influence choice remains unclear. We used temporally specific optogenetic inhibition to selectively disrupt PL activity coinciding with action selection and outcome phases to examine how these signals influence choice. Male rats expressing the inhibitory opsin eArchT within PL excitatory neurons were well trained on a probabilistic discounting task, entailing choice between small/certain versus large/risky rewards, the probability of which varied over a session (50-12.5%). During testing, brief light pulses suppressed PL activity before choice or after different outcomes. Prechoice suppression reduced bias toward more preferred/higher utility options and disrupted how recent outcomes influenced subsequent choice. Inhibition during risky losses induced a similar profile, but here, the impact of reward omissions were either amplified or diminished, relative to the context of the estimated profitability of the risky option. Inhibition during large or small reward receipt reduced risky choice when this option was more profitable, suggesting these signals can both reinforce rewarded risky choices and also act as a relative value comparator signal that augments incentive for larger rewards. These findings reveal multifaceted contributions by the PL in implementing decisions and integrating action-outcome feedback to assign context to the decision space.SIGNIFICANCE STATEMENT The PL prefrontal cortex plays an integral role in guiding risk/reward decisions, but how activity in this region during different phases of the decision process influences choice is unclear. By using temporally specific optogenetic manipulations of this activity, the present study unveiled previously uncharacterized and differential contributions by PL in implementing decision policies and how evaluation of decision outcomes shape subsequent choice. These findings provide novel insight into the dynamic processes engaged by the PL that underlie action selection in situations involving reward uncertainty that may aid in understanding the mechanism underlying normal and aberrant decision-making processes.

Neural mechanisms underlying the hierarchical construction of perceived aesthetic value

Little is known about how the brain computes the perceived aesthetic value of complex stimuli such as visual art. Here, we used computational methods in combination with functional neuroimaging to provide evidence that the aesthetic value of a visual stimulus is computed in a hierarchical manner via a weighted integration over both low and high level stimulus features contained in early and late visual cortex, extending into parietal and lateral prefrontal cortices. Feature representations in parietal and lateral prefrontal cortex may in turn be utilized to produce an overall aesthetic value in the medial prefrontal cortex. Such brain-wide computations are not only consistent with a feature-based mechanism for value construction, but also resemble computations performed by a deep convolutional neural network. Our findings thus shed light on the existence of a general neurocomputational mechanism for rapidly and flexibly producing value judgements across an array of complex novel stimuli and situations.

Importance of prefrontal meta control in human-like reinforcement learning

Recent investigation on reinforcement learning (RL) has demonstrated considerable flexibility in dealing with various problems. However, such models often experience difficulty learning seemingly easy tasks for humans. To reconcile the discrepancy, our paper is focused on the computational benefits of the brain's RL. We examine the brain's ability to combine complementary learning strategies to resolve the trade-off between prediction performance, computational costs, and time constraints. The complex need for task performance created by a volatile and/or multi-agent environment motivates the brain to continually explore an ideal combination of multiple strategies, called meta-control. Understanding these functions would allow us to build human-aligned RL models.

Dissociable behavioural signatures of co-existing impulsivity and apathy in decision-making

Apathy and impulsivity are expressed in a wide range of neuropsychiatric disorders, and, to a less severe extent, in healthy people too. Although traditionally considered to be opposite extremes of a single motivational spectrum, recent epidemiological questionnaire-based data suggest that both traits can in fact co-exist within the same individual. Here, we sought to investigate the relationship between these constructs in healthy people within a controlled task environment that examines the ability to make a decision under temporal uncertainty and measures the vigour of the response. Sixty participants performed a new version of the Traffic Light Task and completed self-report questionnaire measures of apathy and impulsivity. The task required individuals to make rapid decision-making for time-sensitive reward by squeezing a hand-held dynamometer as quickly as possible after a predictable event occurred (a traffic light turning green). Although apathy and impulsivity were positively correlated in questionnaire assessments, the two traits were associated with distinct behavioural signatures on the task. Impulsivity was expressed as an inflexible tendency to generate rapid anticipatory responses, regardless of cost-benefit information. Apathy, on the other hand, was associated with a blunted effect of reward on response vigour. These findings reveal how apathy and impulsivity are related to distinct dimensions of goal-directed behaviour, explaining how these traits might co-exist in the same individuals.

The interpretation of computational model parameters depends on the context

Reinforcement Learning (RL) models have revolutionized the cognitive and brain sciences, promising to explain behavior from simple conditioning to complex problem solving, to shed light on developmental and individual differences, and to anchor cognitive processes in specific brain mechanisms. However, the RL literature increasingly reveals contradictory results, which might cast doubt on these claims. We hypothesized that many contradictions arise from two commonly-held assumptions about computational model parameters that are actually often invalid: That parameters generalize between contexts (e.g. tasks, models) and that they capture interpretable (i.e. unique, distinctive) neurocognitive processes. To test this, we asked 291 participants aged 8-30 years to complete three learning tasks in one experimental session, and fitted RL models to each. We found that some parameters (exploration / decision noise) showed significant generalization: they followed similar developmental trajectories, and were reciprocally predictive between tasks. Still, generalization was significantly below the methodological ceiling. Furthermore, other parameters (learning rates, forgetting) did not show evidence of generalization, and sometimes even opposite developmental trajectories. Interpretability was low for all parameters. We conclude that the systematic study of context factors (e.g. reward stochasticity; task volatility) will be necessary to enhance the generalizability and interpretability of computational cognitive models.

Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T

The model-free algorithms of "reinforcement learning" (RL) have gained clout across disciplines, but so too have model-based alternatives. The present study emphasizes other dimensions of this model space in consideration of associative or discriminative generalization across states and actions. This "generalized reinforcement learning" (GRL) model, a frugal extension of RL, parsimoniously retains the single reward-prediction error (RPE), but the scope of learning goes beyond the experienced state and action. Instead, the generalized RPE is efficiently relayed for bidirectional counterfactual updating of value estimates for other representations. Aided by structural information but as an implicit rather than explicit cognitive map, GRL provided the most precise account of human behavior and individual differences in a reversal-learning task with hierarchical structure that encouraged inverse generalization across both states and actions. Reflecting inference that could be true, false (i.e., overgeneralization), or absent (i.e., undergeneralization), state generalization distinguished those who learned well more so than action generalization. With high-resolution high-field fMRI targeting the dopaminergic midbrain, the GRL model's RPE signals (alongside value and decision signals) were localized within not only the striatum but also the substantia nigra and the ventral tegmental area, including specific effects of generalization that also extend to the hippocampus. Factoring in generalization as a multidimensional process in value-based learning, these findings shed light on complexities that, while challenging classic RL, can still be resolved within the bounds of its core computations.

Sex differences in neural substrates of risk taking: Implications for sex-specific vulnerabilities to internet gaming disorder

BACKGROUND AND AIMS

Sex differences in internet gaming disorder (IGD) remain unknown. Investigating sex-specific neural features that underlie the core risk factor (i.e., risk-taking) of IGD would help in understanding sex-specific vulnerabilities to IGD and advance sex-specific treatments and prevention for IGD.

METHODS

111 participants (28 IGD males, 27 IGD females, 26 recreational game user (RGU) males, 30 RGU females) completed a probability discounting task during fMRI scanning.

RESULTS

First, among RGUs, males showed a higher risk-taking tendency and greater neural activation associated with risk/value evaluation for reward (the ventromedial prefrontal cortex (vmPFC), anterior cingulate cortex (ACC), left putamen) and smaller activation associated with cognitive control (the inferior frontal gyrus) than females during the contrast of risky-safe choices. Moreover, males showed a greater modulatory effect of risky choices on the connection from the vmPFC/ACC to the left putamen than females. Second, IGD males showed decreased activation in the vmPFC/ACC and left putamen compared to RGU males, whereas this decrease did not exist in IGD females.

DISCUSSION

Males show a higher risk-taking tendency than females. Altered neural substrates associated with risky decision-making exist in IGD males but not in IGD females.

CONCLUSIONS

The present findings fill the gap in information on the behavioral and neural substrates underlying IGD among females and demonstrate that a high risk-taking tendency is a risk factor and core symptom only in IGD males but not in IGD females. It is necessary to design and adopt distinct treatments and prevention strategies for IGD in males and females.

Driver's turning intent recognition model based on brain activation and contextual information

Traffic situations like turning at intersections are destined for safety-critical situations and accidents. Human errors are one of the main reasons for accidents in these situations. A model that recognizes the driver's turning intent could help to reduce accidents by warning the driver or stopping the vehicle before a dangerous turning maneuver. Most models that aim at predicting the probability of a driver's turning intent use only contextual information, such as gap size or waiting time. The objective of this study is to investigate whether the combination of context information and brain activation measurements enhances the recognition of turning intent. We conducted a driving simulator study while simultaneously measuring brain activation using high-density fNIRS. A neural network model for turning intent recognition was trained on the fNIRS and contextual data. The input variables were analyzed using SHAP (SHapley Additive exPlanations) feature importance analysis to show the positive effect of the inclusion of brain activation data. Both the model's evaluation and the feature importance analysis suggest that the combination of context information and brain activation leads to an improved turning intent recognition. The fNIRS results showed increased brain activation differences during the "turn" decision-making phase before turning execution in parts of the left motor cortices, such as the primary motor cortex (PMC; putative BA 4), premotor area (PMA; putative BA 6), and supplementary motor area (SMA; putative BA 8). Furthermore, we also observed increased activation differences in the left prefrontal areas, potentially in the left middle frontal gyrus (putative BA 9), which has been associated with the control of executive functions, such as decision-making and action planning. We hypothesize that brain activation measurements could be a more direct indicator with potentially high specificity for the turning behavior and thus help to increase the recognition model's performance.

Contribution of the sensorimotor beta oscillations and the cortico-basal ganglia-thalamic circuitry during value-based decision making: A simultaneous EEG-fMRI investigation

In decision neuroscience, the motor system has primarily been considered to be involved in executing choice actions. However, a competing perspective suggests its engagement in the evaluation of options, traditionally considered to be performed by the brain's valuation system. Here, we investigate the role of the motor system in value-based decision making by determining the neural circuitries associated with the sensorimotor beta oscillations previously identified to encode decision options. In a simultaneous EEG-fMRI study, participants evaluated reward and risk associated with a forthcoming action. A significant sensorimotor beta desynchronization was identified prior to and independent of response. The level of beta desynchronization showed evidence of encoding the reward levels. This beta desynchronization covaried, on a trial-by-trial level, with BOLD activity in the cortico-basal ganglia-thalamic circuitry. In contrast, there was only a weak covariation within the valuation network, despite significant modulation of its BOLD activity by reward levels. These results suggest that the way in which decision variables are processed differs in the valuation network and in the cortico-basal ganglia-thalamic circuitry. We propose that sensorimotor beta oscillations indicate incentive motivational drive towards a choice action computed from the decision variables even prior to making a response, and it arises from the cortico-basal ganglia-thalamic circuitry.

Value, Confidence, Deliberation: A Functional Partition of the Medial Prefrontal Cortex Demonstrated across Rating and Choice Tasks

Deciding about courses of action involves minimizing costs and maximizing benefits. Decision neuroscience studies have implicated both the ventral and dorsal medial PFC (vmPFC and dmPFC) in signaling goal value and action cost, but the precise functional role of these regions is still a matter of debate. Here, we suggest a more general functional partition that applies not only to decisions but also to judgments about goal value (expected reward) and action cost (expected effort). In this conceptual framework, cognitive representations related to options (reward value and effort cost) are dissociated from metacognitive representations (confidence and deliberation) related to solving the task (providing a judgment or making a choice). We used an original approach aimed at identifying consistencies across several preference tasks, from likeability ratings to binary decisions involving both attribute integration and option comparison. fMRI results in human male and female participants confirmed the vmPFC as a generic valuation system, its activity increasing with reward value and decreasing with effort cost. In contrast, more dorsal regions were not concerned with the valuation of options but with metacognitive variables, confidence being reflected in mPFC activity and deliberation time in dmPFC activity. Thus, there was a dissociation between the effort attached to choice options (represented in the vmPFC) and the effort invested in deliberation (represented in the dmPFC), the latter being expressed in pupil dilation. More generally, assessing commonalities across preference tasks might help in reaching a unified view of the neural mechanisms underlying the cost/benefit tradeoffs that drive human behavior.SIGNIFICANCE STATEMENT Decision neuroscience studies have implicated the medial PFC in forming the cognitive representations that drive human choice behavior. However, different studies using different tasks have suggested somewhat inconsistent links between precise computational variables and specific brain regions. Here, we use fMRI to demonstrate a robust functional partition of the medial PFC that generalizes across tasks involving an estimation of goal value and/or action cost to provide a judgment or make a choice. This general functional partition makes a critical dissociation between neural representations of decisional factors (the expected costs and benefits attached to a given option) and metacognitive estimates (confidence in the judgment or choice, and effort invested in the deliberation process).

Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal

During adolescence, youth venture out, explore the wider world, and are challenged to learn how to navigate novel and uncertain environments. We investigated how performance changes across adolescent development in a stochastic, volatile reversal-learning task that uniquely taxes the balance of persistence and flexibility. In a sample of 291 participants aged 8-30, we found that in the mid-teen years, adolescents outperformed both younger and older participants. We developed two independent cognitive models, based on Reinforcement learning (RL) and Bayesian inference (BI). The RL parameter for learning from negative outcomes and the BI parameters specifying participants' mental models were closest to optimal in mid-teen adolescents, suggesting a central role in adolescent cognitive processing. By contrast, persistence and noise parameters improved monotonically with age. We distilled the insights of RL and BI using principal component analysis and found that three shared components interacted to form the adolescent performance peak: adult-like behavioral quality, child-like time scales, and developmentally-unique processing of positive feedback. This research highlights adolescence as a neurodevelopmental window that can create performance advantages in volatile and uncertain environments. It also shows how detailed insights can be gleaned by using cognitive models in new ways.

Learning under social versus nonsocial uncertainty: A meta-analytic approach

Much of the uncertainty that clouds our understanding of the world springs from the covert values and intentions held by other people. Thus, it is plausible that specialized mechanisms that compute learning signals under uncertainty of exclusively social origin operate in the brain. To test this hypothesis, we scoured academic databases for neuroimaging studies involving learning under uncertainty, and performed a meta‐analysis of brain activation maps that compared learning in the face of social versus nonsocial uncertainty. Although most of the brain activations associated with learning error signals were shared between social and nonsocial conditions, we found some evidence for functional segregation of error signals of exclusively social origin during learning in limited regions of ventrolateral prefrontal cortex and insula. This suggests that most behavioral adaptations to navigate social environments are reused from frontal and subcortical areas processing generic value representation and learning, but that a specialized circuitry might have evolved in prefrontal regions to deal with social context representation and strategic action.

Alcohol-Drinking Under Limited-Access Procedures During Mature Adulthood Accelerates the Onset of Cognitive Impairment in Mice

A history of heavy drinking increases vulnerability to, and the severity of, Alzheimer’s disease (AD) and related dementias, with alcohol use disorder identified as the strongest modifiable risk factor for early-onset dementia. Heavy drinking has increased markedly in women over the past 10 years, particularly in mature adult women during the coronavirus (COVID-19) pandemic. This is concerning as women are more sensitive to many alcohol-related disease states, including AD and related dementias. Herein, we conducted two studies to determine if a 1-month period of binge drinking during mature adulthood (i.e., 5–9 months of age) impairs spatial and working memory to a greater extent in female vs. male C57BL/6J (B6J) mice. The anxiogenic and cognitive-impairing effects of binge drinking were also compared between mature adult and old B6J mice (18 months of age) in a third study. Throughout, females consumed more alcohol than males, indicating that a sex difference in binge drinking persists into old age. Despite the sex difference in intake, we detected no consistent sex difference in our measures of alcohol withdrawal-induced anxiety during a behavioral test battery. Although mature adult females exhibited more cognitive deficits than males, the precise outcome exhibiting a female-selective effect varied across studies. Old mice drank lower amounts of alcohol than mature adult mice, yet their blood ethanol concentrations (BECs) were within error of the 80 mg/dl criterion for binge drinking, indicative of an age-related slowing of alcohol metabolism. As expected, 18-month-old controls exhibited more signs of cognitive impairment than their 6-month-old counterparts, and binge drinking history impaired the Morris water maze performance of mice of both ages. In contrast, binge drinking history impaired the radial arm maze performance of 6-month-old mice only, and the extent of the impairment was comparable to the behavior exhibited by the older mice. We conclude from our studies that: (1) both biological sex and the age of drinking onset are subject factors that impact voluntary alcohol consumption by mice into old age; (2) binge drinking during later life elicits a negative affective state that is relatively sex-independent; (3) binge drinking during both mature adulthood and old age impairs spatial learning and memory; (4) binge drinking during mature adulthood accelerates deficits in working memory; and (5) mature adult females tend to exhibit more alcohol-induced cognitive impairments than males. If relevant to humans, these findings suggest that binge-like drinking by older adult men and women induces a negative affective state and cognitive decline, but that mature adult women, in particular, may be more sensitive to both the immediate and persistent cognitive-impairing effects of heavy drinking.

Prefrontal control of social influence in risk decision making

To optimize our decisions, we may change our mind by utilizing social information. Here, we examined how changes of mind were modulated by Social Misalignment Sensitivity (SMS), egocentric tendency, and decision preferences in a decision-making paradigm including both risk and social information. Combining functional magnetic resonance imaging with computational modeling, we showed that both SMS and egocentric tendency modulated changes of mind under the influence of social information. While SMS was represented in the dorsal anterior cingulate cortex (dACC) and superior parietal gyrus (SPG) in the socially aligned situation, a distributed brain network was activated in the misaligned condition, including not only the dACC and SPG but also superior frontal gyrus and precuneus. These results suggest that SMS is related to a monitoring brain system, the scope of which varies according to the level of misalignment with social majority. The dorsolateral prefrontal cortex selectively interacted with SMS among the participants with a low switching threshold, indicating that its regulation on SMS may be sensitive to inter-individual variation. Our findings highlight the predominant roles of SMS and the prefrontal control system towards changes of mind under social influence.

Spared performance but increased uncertainty in schizophrenia: Evidence from a probabilistic decision-making task

Aberrant attribution of salience to in fact little informative events might explain the emergence of positive symptoms in schizophrenia and has been linked to belief uncertainty. Uncertainty is thought to be encoded by neuromodulators, including norepinephrine. However, norepinephrinergic encoding of uncertainty, measured as task-related pupil dilation, has rarely been explored in schizophrenia. Here, we addressed this question by comparing individuals with a disorder from the schizophrenia spectrum to a non-psychiatric control group on behavioral and pupillometric measures in a probabilistic prediction task, where different levels of uncertainty were introduced. Behaviorally, patients performed similar to controls, but their belief uncertainty was higher, particularly when instability of the task environment was high, suggesting an increased sensitivity to this instability. Furthermore, while pupil dilation scaled positively with uncertainty, this was less the case for patients, suggesting aberrant neuromodulatory regulation of neural gain, which may hinder the reduction of uncertainty in the long run. Together, the findings point to abnormal uncertainty processing and norepinephrinergic signaling in schizophrenia, potentially informing future development of both psychopharmacological therapies and psychotherapeutic approaches that deal with the processing of uncertain information.

Motivational signals disrupt metacognitive signals in the human ventromedial prefrontal cortex

A growing body of evidence suggests that, during decision-making, BOLD signal in the ventromedial prefrontal cortex (VMPFC) correlates both with motivational variables – such as incentives and expected values – and metacognitive variables – such as confidence judgments – which reflect the subjective probability of being correct. At the behavioral level, we recently demonstrated that the value of monetary stakes bias confidence judgments, with gain (respectively loss) prospects increasing (respectively decreasing) confidence judgments, even for similar levels of difficulty and performance. If and how this value-confidence interaction is reflected in the VMPFC remains unknown. Here, we used an incentivized perceptual decision-making fMRI task that dissociates key decision-making variables, thereby allowing to test several hypotheses about the role of the VMPFC in the value-confidence interaction. While our initial analyses seemingly indicate that the VMPFC combines incentives and confidence to form an expected value signal, we falsified this conclusion with a meticulous dissection of qualitative activation patterns. Rather, our results show that strong VMPFC confidence signals observed in trials with gain prospects are disrupted in trials with no – or negative (loss) – monetary prospects. Deciphering how decision variables are represented and interact at finer scales seems necessary to better understand biased (meta)cognition.

The human ventromedial prefrontal cortex helps to determine value and confidence in certain decisions, but only in situations when there is a potential for a (monetary) reward.

Investigating Differences in Behavior and Brain in Human-Human and Human-Autonomous Vehicle Interactions in Time-Critical Situations

Some studies provide evidence that humans could actively exploit the alleged technological advantages of autonomous vehicles (AVs). This implies that humans may tend to interact differently with AVs as compared to human driven vehicles (HVs) with the knowledge that AVs are programmed to be risk-averse. Hence, it is important to investigate how humans interact with AVs in complex traffic situations. Here, we investigated whether participants would value interactions with AVs differently compared to HVs, and if these differences can be characterized on the behavioral and brain-level. We presented participants with a cover story while recording whole-head brain activity using fNIRS that they were driving under time pressure through urban traffic in the presence of other HVs and AVs. Moreover, the AVs were programmed defensively to avoid collisions and had faster braking reaction times than HVs. Participants would receive a monetary reward if they managed to finish the driving block within a given time-limit without risky driving maneuvers. During the drive, participants were repeatedly confronted with left-lane turning situations at unsignalized intersections. They had to stop and find a gap to turn in front of an oncoming stream of vehicles consisting of HVs and AVs. While the behavioral results did not show any significant difference between the safety margin used during the turning maneuvers with respect to AVs or HVs, participants tended to be more certain in their decision-making process while turning in front of AVs as reflected by the smaller variance in the gap size acceptance as compared to HVs. Importantly, using a multivariate logistic regression approach, we were able to predict whether the participants decided to turn in front of HVs or AVs from whole-head fNIRS in the decision-making phase for every participant (mean accuracy = 67.2%, SD = 5%). Channel-wise univariate fNIRS analysis revealed increased brain activation differences for turning in front of AVs compared to HVs in brain areas that represent the valuation of actions taken during decision-making. The insights provided here may be useful for the development of control systems to assess interactions in future mixed traffic environments involving AVs and HVs.

Cortical Thickness and Clinical Findings in Prescholar Children With Autism Spectrum Disorder

The term autism spectrum disorder (ASD) includes a wide variability of clinical presentation, and this clinical heterogeneity seems to reflect a still unclear multifactorial etiopathogenesis, encompassing different genetic risk factors and susceptibility to environmental factors. Several studies and many theories recognize as mechanisms of autism a disruption of brain development and maturation time course, suggesting the existence of common neurobiological substrates, such as defective synaptic structure and aberrant brain connectivity. Magnetic resonance imaging (MRI) plays an important role in both assessment of region-specific structural changes and quantification of specific alterations in gray or white matter, which could lead to the identification of an MRI biomarker. In this study, we performed measurement of cortical thickness in a selected well-known group of preschool ASD subjects with the aim of finding correlation between cortical metrics and clinical scores to understand the underlying mechanism of symptoms and to support early clinical diagnosis. Our results confirm that recent brain MRI techniques combined with clinical data can provide some useful information in defining the cerebral regions involved in ASD although large sample studies with homogeneous analytical and multisite approaches are needed.

Mine or Ours? Neural Basis of the Exploitation of Common-Pool Resources

Why do people often exhaust unregulated common (shared) natural resources but manage to preserve similar private resources? To answer this question, in this study we combine a neurobiological, economic and cognitive modeling approach. Using functional magnetic resonance imaging on 50 participants, we show that a sharp decrease of common and private resources is associated with deactivation of the ventral striatum, a brain region involved in the valuation of outcomes. Across individuals, when facing a common resource, ventral striatal activity is anticorrelated with resource preservation (less harvesting), whereas with private resources the opposite pattern is observed. This indicates that neural value signals distinctly modulate behavior in response to the depletion of common vs private resources. Computational modeling suggested that overharvesting of common resources was facilitated by the modulatory effect of social comparison on value signals. These results provide an explanation of people’s tendency to over-exploit unregulated common natural resources.

The neurobiology of drug addiction: cross-species insights into the dysfunction and recovery of the prefrontal cortex

A growing preclinical and clinical body of work on the effects of chronic drug use and drug addiction has extended the scope of inquiry from the putative reward-related subcortical mechanisms to higher-order executive functions as regulated by the prefrontal cortex. Here we review the neuroimaging evidence in humans and non-human primates to demonstrate the involvement of the prefrontal cortex in emotional, cognitive, and behavioral alterations in drug addiction, with particular attention to the impaired response inhibition and salience attribution (iRISA) framework. In support of iRISA, functional and structural neuroimaging studies document a role for the prefrontal cortex in assigning excessive salience to drug over non-drug-related processes with concomitant lapses in self-control, and deficits in reward-related decision-making and insight into illness. Importantly, converging insights from human and non-human primate studies suggest a causal relationship between drug addiction and prefrontal insult, indicating that chronic drug use causes the prefrontal cortex damage that underlies iRISA while changes with abstinence and recovery with treatment suggest plasticity of these same brain regions and functions. We further dissect the overlapping and distinct characteristics of drug classes, potential biomarkers that inform vulnerability and resilience, and advancements in cutting-edge psychological and neuromodulatory treatment strategies, providing a comprehensive landscape of the human and non-human primate drug addiction literature as it relates to the prefrontal cortex.

Neural Representation of Costs and Rewards in Decision Making

Decision making is crucial for animal survival because the choices they make based on their current situation could influence their future rewards and could have potential costs. This review summarises recent developments in decision making, discusses how rewards and costs could be encoded in the brain, and how different options are compared such that the most optimal one is chosen. The reward and cost are mainly encoded by the forebrain structures (e.g., anterior cingulate cortex, orbitofrontal cortex), and their value is updated through learning. The recent development on dopamine and the lateral habenula's role in reporting prediction errors and instructing learning will be emphasised. The importance of dopamine in powering the choice and accounting for the internal state will also be discussed. While the orbitofrontal cortex is the place where the state values are stored, the anterior cingulate cortex is more important when the environment is volatile. All of these structures compare different attributes of the task simultaneously, and the local competition of different neuronal networks allows for the selection of the most appropriate one. Therefore, the total value of the task is not encoded as a scalar quantity in the brain but, instead, as an emergent phenomenon, arising from the computation at different brain regions.

The role of anterior prefrontal cortex (area 10) in face-to-face deception measured with fNIRS

Anterior prefrontal cortex (PFC, Brodmann area 10) activations are often, but not always, found in neuroimaging studies investigating deception, and the precise role of this area remains unclear. To explore the role of the PFC in face-to-face deception, we invited pairs of participants to play a card game involving lying and lie detection while we used functional near infrared spectroscopy (fNIRS) to record brain activity in the PFC. Participants could win points for successfully lying about the value of their cards or for detecting lies. We contrasted patterns of brain activation when the participants either told the truth or lied, when they were either forced into this or did so voluntarily and when they either succeeded or failed to detect a lie. Activation in the anterior PFC was found in both lie production and detection, unrelated to reward. Analysis of cross-brain activation patterns between participants identified areas of the PFC where the lead player’s brain activity synchronized their partner’s later brain activity. These results suggest that during situations that involve close interpersonal interaction, the anterior PFC supports processing widely involved in deception, possibly relating to the demands of monitoring one’s own and other people’s behaviour.

Internal manipulation of perceptual representations in human flexible cognition: A computational model

Executive functions represent a set of processes in goal-directed cognition that depend on integrated cortical-basal ganglia brain systems and form the basis of flexible human behaviour. Several computational models have been proposed for studying cognitive flexibility as a key executive function and the Wisconsin card sorting test (WCST) that represents an important neuropsychological tool to investigate it. These models clarify important aspects that underlie cognitive flexibility, particularly decision-making, motor response, and feedback-dependent learning processes. However, several studies suggest that the categorisation processes involved in the solution of the WCST include an additional computational stage of category representation that supports the other processes. Surprisingly, all models of the WCST ignore this fundamental stage and they assume that decision making directly triggers actions. Thus, we propose a novel hypothesis where the key mechanisms of cognitive flexibility and goal-directed behaviour rely on the acquisition of suitable representations of percepts and their top-down internal manipulation. Moreover, we propose a neuro-inspired computational model to operationalise this hypothesis. The capacity of the model to support cognitive flexibility was validated by systematically reproducing and interpreting the behaviour exhibited in the WCST by young and old healthy adults, and by frontal and Parkinson patients. The results corroborate and further articulate the hypothesis that the internal manipulation of representations is a core process in goal-directed flexible cognition.

Aberrant prefrontal cortical-striatal functional connectivity in children with primary complex motor stereotypies

Motor stereotypies are rhythmic, repetitive, prolonged, predictable, and purposeless movements that stop with distraction. Although once believed to occur only in children with neurodevelopmental disorders such as autism, the presence and persistence of complex motor stereotypies (CMS) in otherwise typically developing children (primary CMS) has been well-established. Little, however, is known about the underlying pathophysiology of these unwanted actions. The aim of the present study was to use resting-state functional magnetic resonance imaging to evaluate functional connectivity within frontal-striatal circuits that are essential for goal-directed and habitual activity in children with primary complex motor stereotypies. Functional connectivity between prefrontal cortical and striatal regions, considered essential for developing goal-directed behaviors, was reduced in children with primary CMS compared to their typically developing peers. In contrast, functional connectivity between motor/premotor and striatal regions, critical for developing and regulating habitual behaviors, did not differ between groups. This documented alteration of prefrontal to striatal connectivity could provide the underlying mechanism for the presence and persistence of complex motor stereotypies in otherwise developmentally normal children.

Value network engagement and effects of memory-related processing during encoding and retrieval of value

Decision makers rely on episodic memory to calculate choice values in everyday life, yet it is unclear how neural mechanisms of valuation differ when value-related information is encoded versus retrieved from episodic memory. The current fMRI study compared neural correlates of value while information was encoded versus retrieved from memory. Scanned tasks were followed by a behavioral episodic memory test for item-attribute associations. Our analyses sought to (i) identify neural correlates of value that were distinct and common across encoding and retrieval, and (ii) determine whether neural mechanisms of valuation and episodic memory interact. The study yielded three primary findings. First, value-related activation in the fronto-striatal reward circuit and posterior parietal cortex was comparable across valuation phases. Second, value-related activation in select fronto-parietal and salience regions was significantly greater at value retrieval than encoding. Third, there was no interaction between neural correlates of valuation and episodic memory. Taken with prior research, the present study indicates that fronto-parietal and salience regions play a key role in retrieval-dependent valuation and context-specific effects likely determine whether neural correlates of value interact with episodic memory.

Reduced adaptation of glutamatergic stress response is associated with pessimistic expectations in depression

Stress is a significant risk factor for the development of major depressive disorder (MDD), yet the underlying mechanisms remain unclear. Preclinically, adaptive and maladaptive stress-induced changes in glutamatergic function have been observed in the medial prefrontal cortex (mPFC). Here, we examine stress-induced changes in human mPFC glutamate using magnetic resonance spectroscopy (MRS) in two healthy control samples and a third sample of unmedicated participants with MDD who completed the Maastricht acute stress task, and one sample of healthy control participants who completed a no-stress control manipulation. In healthy controls, we find that the magnitude of mPFC glutamate response to the acute stressor decreases as individual levels of perceived stress increase. This adaptative glutamate response is absent in individuals with MDD and is associated with pessimistic expectations during a 1-month follow-up period. Together, this work shows evidence for glutamatergic adaptation to stress that is significantly disrupted in MDD.