A computational model of craving and obsession

Aberrant neural computation of social controllability in nicotine-dependent humans

Social controllability, or the ability to exert control during social interactions, is crucial for optimal decision-making. Inability to do so might contribute to maladaptive behaviors such as smoking, which often takes place in social settings. Here, we examined social controllability in nicotine-dependent humans as they performed an fMRI task where they could influence the offers made by simulated partners. Computational modeling revealed that smokers under-estimated the influence of their actions and self-reported a reduced sense of control, compared to non-smokers. These findings were replicated in a large independent sample of participants recruited online. Neurally, smokers showed reduced tracking of forward projected choice values in the ventromedial prefrontal cortex, and impaired computation of social prediction errors in the midbrain. These results demonstrate that smokers were less accurate in estimating their personal influence when the social environment calls for control, providing a neurocomputational account for the social cognitive deficits in this population. Pre-registrations: OSF Registries|How interoceptive state interacts with value-based decision-making in addiction (fMRI study). OSF Registries|COVID-19: social cognition, mental health, and social distancing (online study).

Naturalistic drug cue reactivity in heroin use disorder: orbitofrontal synchronization as a marker of craving and recovery

Movies captivate groups of individuals (the audience), especially if they contain themes of common motivational interest to the group. In drug addiction, a key mechanism is maladaptive motivational salience attribution whereby drug cues outcompete other reinforcers within the same environment or context. We predicted that while watching a drug-themed movie, where cues for drugs and other stimuli share a continuous narrative context, fMRI responses in individuals with heroin use disorder (iHUD) will preferentially synchronize during drug scenes. Results revealed such drug-biased synchronization in the orbitofrontal cortex (OFC), ventromedial and ventrolateral prefrontal cortex, and insula. After 15 weeks of inpatient treatment, there was a significant reduction in this drug-biased shared response in the OFC, which correlated with a concomitant reduction in dynamically-measured craving, suggesting synchronized OFC responses to a drug-themed movie as a neural marker of craving and recovery in iHUD.

The utility of a latent-cause framework for understanding addiction phenomena

Computational models of addiction often rely on a model-free reinforcement learning (RL) formulation, owing to the close associations between model-free RL, habitual behavior and the dopaminergic system. However, such formulations typically do not capture key recurrent features of addiction phenomena such as craving and relapse. Moreover, they cannot account for goal-directed aspects of addiction that necessitate contrasting, model-based formulations. Here we synthesize a growing body of evidence and propose that a latent-cause framework can help unify our understanding of several recurrent phenomena in addiction, by viewing them as the inferred return of previous, persistent "latent causes". We demonstrate that applying this framework to Pavlovian and instrumental settings can help account for defining features of craving and relapse such as outcome-specificity, generalization, and cyclical dynamics. Finally, we argue that this framework can bridge model-free and model-based formulations, and account for individual variability in phenomenology by accommodating the memories, beliefs, and goals of those living with addiction, motivating a centering of the individual, subjective experience of addiction and recovery.

Aberrant neural computation of social controllability in nicotine-dependent humans

Social controllability, defined as the ability to exert influence when interacting with others, is crucial for optimal decision-making. Inability to do so might contribute to maladaptive behaviors such as drug use, which often takes place in social settings. Here, we examined nicotine-dependent humans using fMRI, as they made choices that could influence the proposals from simulated partners. Computational modeling revealed that smokers under-estimated the influence of their actions and self-reported a reduced sense of control, compared to non-smokers. These findings were replicated in a large independent sample of participants recruited online. Neurally, smokers showed reduced tracking of forward projected choice values in the ventromedial prefrontal cortex, and impaired computation of social prediction errors in the midbrain. These results demonstrate that smokers were less accurate in estimating their personal influence when the social environment calls for control, providing a neurocomputational account for the social cognitive deficits in this population.

Computational models of behavioral addictions: State of the art and future directions

Non-pharmacological behavioral addictions, such as pathological gambling, videogaming, social networking, or internet use, are becoming major public health concerns. It is not yet clear how behavioral addictions could share many major neurobiological and behavioral characteristics with substance use disorders, despite the absence of direct pharmacological influences. A deeper understanding of the neurocognitive mechanisms of addictive behavior is needed, and computational modeling could be one promising approach to explain intricately entwined cognitive and neural dynamics. This review describes computational models of addiction based on reinforcement learning algorithms, Bayesian inference, and biophysical neural simulations. We discuss whether computational frameworks originally conceived to explain maladaptive behavior in substance use disorders can be effectively extended to non-substance-related behavioral addictions. Moreover, we introduce recent studies on behavioral addictions that exemplify the possibility of such extension and propose future directions.

Etiopathogenic Models of Psychosis Spectrum Illnesses Must Resolve Four Key Features

Etiopathogenic models for psychosis spectrum illnesses are converging on a number of key processes, such as the influence of specific genes on the synthesis of proteins important in synaptic functioning, alterations in how neurons respond to synaptic inputs and engage in synaptic pruning, and microcircuit dysfunction that leads to more global cortical information processing vulnerabilities. Disruptions in prefrontal operations then accumulate and propagate over time, interacting with environmental factors, developmental processes, and homeostatic mechanisms, eventually resulting in symptoms of psychosis and disability. However, there are 4 key features of psychosis spectrum illnesses that are of primary clinical relevance but have been difficult to assimilate into a single model and have thus far received little direct attention: 1) the bidirectionality of the causal influences for the emergence of psychosis, 2) the catastrophic clinical threshold seen in first episodes of psychosis and why it is irreversible in some individuals, 3) observed biotypes that are neurophysiologically distinct but clinically both convergent and divergent, and 4) a reconciliation of the role of striatal dopaminergic dysfunction with models of prefrontal cortical state instability. In this selective review, we briefly describe these 4 hallmark features and we argue that theoretically driven computational perspectives making use of both algorithmic and neurophysiologic models are needed to reduce this complexity and variability of psychosis spectrum illnesses in a principled manner.

A generative framework for the study of delusions

Despite the ubiquity of delusional information processing in psychopathology and everyday life, formal characterizations of such inferences are lacking. In this article, we propose a generative framework that entails a computational mechanism which, when implemented in a virtual agent and given new information, generates belief updates (i.e., inferences about the hidden causes of the information) that resemble those seen in individuals with delusions. We introduce a particular form of Dirichlet process mixture model with a sampling-based Bayesian inference algorithm. This procedure, depending on the setting of a single parameter, preferentially generates highly precise (i.e. over-fitting) explanations, which are compartmentalized and thus can co-exist despite being inconsistent with each other. Especially in ambiguous situations, this can provide the seed for delusional ideation. Further, we show by simulation how the excessive generation of such over-precise explanations leads to new information being integrated in a way that does not lead to a revision of established beliefs. In all configurations, whether delusional or not, the inference generated by our algorithm corresponds to Bayesian inference. Furthermore, the algorithm is fully compatible with hierarchical predictive coding. By virtue of these properties, the proposed model provides a basis for the empirical study and a step toward the characterization of the aberrant inferential processes underlying delusions.

A review of mathematical modeling of addiction regarding both (neuro-) psychological processes and the social contagion perspectives

Addiction is a complex biopsychosocial phenomenon, impacted by biological predispositions, psychological processes, and the social environment. Using mathematical and computational models that allow for surrogative reasoning may be a promising avenue for gaining a deeper understanding of this complex behavior. This paper reviews and classifies a selection of formal models of addiction focusing on the intra- and inter-individual dynamics, i.e., (neuro) psychological models and social models. We find that these modeling approaches to addiction are too disjoint and argue that in order to unravel the complexities of biopsychosocial processes of addiction, models should integrate intra- and inter-individual factors.

The Relationship Between Affective and Obsessive-Compulsive Symptoms in Internet Use Disorder

We investigated the relationships and diagnostic power of symptoms associated with affective disorders, obsessive-compulsive disorder, and drug addictions on Internet use disorder. Moreover, we tested whether Internet use disorder is characterized by a specific network of symptoms. One-hundred-and-four young adults (78 women) were assessed in laboratory using self-report measures of Internet addiction, alcohol use disorder, cannabis abuse, depression, anxiety, and stress symptoms, impulsiveness, and obsessive-compulsive symptoms. Only hoarding, obsessing, and depression symptoms were positively linked to Internet use disorder severity, with hoarding having greater power and accuracy than other obsessive-compulsive and affective symptoms. Only individuals with mild-moderate Internet use disorder were characterized by a network of strong and positive associations of affective and obsessive-compulsive symptoms. These findings may encourage future longitudinal studies aimed at identifying potential clinical criteria for the diagnosis of Internet use disorder and treatment targets.

Computational models of drug use and addiction: A review

In this brief review, we describe current computational models of drug-use and addiction that fall into 2 broad categories: mathematically based models that rely on computational theories, and brain-based models that link computations to brain areas or circuits. Across categories, many are models of learning and decision-making, which may be compromised in addiction. Several mathematical models take predictive coding approaches, focusing on Bayesian prediction error. Other models focus on learning processes and (traditional) prediction error. Brain-based models have incorporated prefrontal cortex, basal ganglia, and the dopamine system, based on the effects of drugs on dopamine, motivation, and executive control circuits. Several models specifically describe how behavioral control may transition from habitual to goal-directed systems, consistent with computational accounts of compromised "model-based" control. Some brain-based models have linked this to the transition of behavioral control from ventral to dorsal striatum. Overall, we propose that while computational models capture some aspects of addiction and have advanced our thinking, most have focused on the effects of drug use rather than addiction per se, most have not been tested on and/or supported by human data, and few capture multiple stages and symptoms of addiction. We conclude by suggesting a path forward for computational models of addiction. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality

Several decision-making vulnerabilities have been identified as underlying causes for addictive behaviours, or the repeated execution of stereotyped actions despite their adverse consequences. These vulnerabilities are mostly associated with brain alterations caused by the consumption of substances of abuse. However, addiction can also happen in the absence of a pharmacological component, such as seen in pathological gambling and videogaming. We use a new reinforcement learning model to highlight a previously neglected vulnerability that we suggest interacts with those already identified, whilst playing a prominent role in non-pharmacological forms of addiction. Specifically, we show that a dual-learning system (i.e. combining model-based and model-free) can be vulnerable to highly rewarding, but suboptimal actions, that are followed by a complex ramification of stochastic adverse effects. This phenomenon is caused by the overload of the capabilities of an agent, as time and cognitive resources required for exploration, deliberation, situation recognition, and habit formation, all increase as a function of the depth and richness of detail of an environment. Furthermore, the cognitive overload can be aggravated due to alterations (e.g. caused by stress) in the bounded rationality, i.e. the limited amount of resources available for the model-based component, in turn increasing the agent's chances to develop or maintain addictive behaviours. Our study demonstrates that, independent of drug consumption, addictive behaviours can arise in the interaction between the environmental complexity and the biologically finite resources available to explore and represent it.

Modeling subjective belief states in computational psychiatry: interoceptive inference as a candidate framework

The nascent field computational psychiatry has undergone exponential growth since its inception. To date, much of the published work has focused on choice behaviors, which are primarily modeled within a reinforcement learning framework. While this initial normative effort represents a milestone in psychiatry research, the reality is that many psychiatric disorders are defined by disturbances in subjective states (e.g., depression, anxiety) and associated beliefs (e.g., dysmorphophobia, paranoid ideation), which are not considered in normative models. In this paper, we present interoceptive inference as a candidate framework for modeling subjective-and associated belief-states in computational psychiatry. We first introduce the notion and significance of modeling subjective states in computational psychiatry. Next, we present the interoceptive inference framework, and in particular focus on the relationship between interoceptive inference (i.e., belief updating) and emotions. Lastly, we will use drug craving as an example of subjective states to demonstrate the feasibility of using interoceptive inference to model the psychopathology of subjective states.

Beyond simple tests of value: measuring addiction as a heterogeneous disease of computation-specific valuation processes

Addiction is considered to be a neurobiological disorder of learning and memory because addiction is capable of producing lasting changes in the brain. Recovering addicts chronically struggle with making poor decisions that ultimately lead to relapse, suggesting a view of addiction also as a neurobiological disorder of decision-making information processing. How the brain makes decisions depends on how decision-making processes access information stored as memories in the brain. Advancements in circuit-dissection tools and recent theories in neuroeconomics suggest that neurally dissociable valuation processes access distinct memories differently, and thus are uniquely susceptible as the brain changes during addiction. If addiction is to be considered a neurobiological disorder of memory, and thus decision-making, the heterogeneity with which information is both stored and processed must be taken into account in addiction studies. Addiction etiology can vary widely from person to person. We propose that addiction is not a single disease, nor simply a disorder of learning and memory, but rather a collection of symptoms of heterogeneous neurobiological diseases of distinct circuit-computation-specific decision-making processes.

Computational Nosology and Precision Psychiatry

This article provides an illustrative treatment of psychiatric morbidity that offers an alternative to the standard nosological model in psychiatry. It considers what would happen if we treated diagnostic categories not as causes of signs and symptoms, but as diagnostic consequences of psychopathology and pathophysiology. This reformulation (of the standard nosological model) opens the door to a more natural description of how patients present-and of their likely responses to therapeutic interventions. In brief, we describe a model that generates symptoms, signs, and diagnostic outcomes from latent psychopathological states. In turn, psychopathology is caused by pathophysiological processes that are perturbed by (etiological) causes such as predisposing factors, life events, and therapeutic interventions. The key advantages of this nosological formulation include (i) the formal integration of diagnostic (e.g., DSM) categories and latent psychopathological constructs (e.g., the dimensions of the Research Domain Criteria); (ii) the provision of a hypothesis or model space that accommodates formal, evidence-based hypothesis testing (using Bayesian model comparison); and (iii) the ability to predict therapeutic responses (using a posterior predictive density), as in precision medicine. These and other advantages are largely promissory at present: The purpose of this article is to show what might be possible, through the use of idealized simulations.

The Computational Complexity of Valuation and Motivational Forces in Decision-Making Processes

The concept of value is fundamental to most theories of motivation and decision making. However, value has to be measured experimentally. Different methods of measuring value produce incompatible valuation hierarchies. Taking the agent's perspective (rather than the experimenter's), we interpret the different valuation measurement methods as accessing different decision-making systems and show how these different systems depend on different information processing algorithms. This identifies the translation from these multiple decision-making systems into a single action taken by a given agent as one of the most important open questions in decision making today. We conclude by looking at how these different valuation measures accessing different decision-making systems can be used to understand and treat decision dysfunction such as in addiction.

Contingency Management and Deliberative Decision-Making Processes

Contingency management is an effective treatment for drug addiction. The current explanation for its success is rooted in alternative reinforcement theory. We suggest that alternative reinforcement theory is inadequate to explain the success of contingency management and produce a model based on demand curves that show how little the monetary rewards offered in this treatment would affect drug use. Instead, we offer an explanation of its success based on the concept that it accesses deliberative decision-making processes. We suggest that contingency management is effective because it offers a concrete and immediate alternative to using drugs, which engages deliberative processes, improves the ability of those deliberative processes to attend to non-drug options, and offsets more automatic action-selection systems. This theory makes explicit predictions that can be tested, suggests which users will be most helped by contingency management, and suggests improvements in its implementation.

Improved planning abilities in binge eating

Objective

The role of planning in binge eating episodes is unknown. We investigated the characteristics of planning associated with food cues in binging patients. We studied planning based on backward reasoning, reasoning that determines a sequence of actions back to front from the final outcome.

Method

A cross-sectional study was conducted with 20 healthy participants, 20 bulimia nervosa (BN), 22 restrictive (ANR) and 23 binging anorexia nervosa (ANB), without any concomitant impulsive disorder. In neutral/relaxing, binge food and stressful conditions, backward reasoning was assessed with the Race game, promotion of delayed large rewards with an intertemporal discounting task, attention with the Simon task, and repeating a dominant behavior with the Go/No-go task.

Results

BN and to a lower extent ANB patients succeeded more at the Race game in food than in neutral condition. This difference discriminated binging from non-binging participants. Backward reasoning in the food condition was associated with lower approach behavior toward food in BN patients, and higher food avoidance in ANB patients. Enhanced backward reasoning in the food condition related to preferences for delayed large rewards in BN patients. In BN and ANB patients the enhanced success rate at the Race game in the food condition was associated with higher attention paid to binge food.

Conclusion

These findings introduce a novel process underlying binges: planning based on backward reasoning is associated with binges. It likely aims to reduce craving for binge foods and extend binge refractory period in BN patients, and avoid binging in ANB patients. Shifts between these goals might explain shifts between eating disorder subtypes.

Deep brain stimulation of nucleus accumbens region in alcoholism affects reward processing

The influence of bilateral deep brain stimulation (DBS) of the nucleus nucleus (NAcc) on the processing of reward in a gambling paradigm was investigated using H₂[¹⁵O]-PET (positron emission tomography) in a 38-year-old man treated for severe alcohol addiction. Behavioral data analysis revealed a less risky, more careful choice behavior under active DBS compared to DBS switched off. PET showed win- and loss-related activations in the paracingulate cortex, temporal poles, precuneus and hippocampus under active DBS, brain areas that have been implicated in action monitoring and behavioral control. Except for the temporal pole these activations were not seen when DBS was deactivated. These findings suggest that DBS of the NAcc may act partially by improving behavioral control.

Dynamics of decision-related activity in hippocampus

Place-selective activity in hippocampal neurons can be modulated by the trajectory that will be taken in the immediate future ("prospective coding"), information that could be useful in neural processes elaborating choices in route planning. To determine if and how hippocampal prospective neurons participate in decision making, we measured the time course of the evolution of prospective activity by recording place responses in rats performing a T-maze alternation task. After five or seven alternation trials, the routine was unpredictably interrupted by a photodetector-triggered visual cue as the rat crossed the middle of central arm, signaling it to suddenly change its intended choice. Comparison of the delays between light cue presentation and the onset of prospective activity for neurons with firing fields at various locations after the trigger point revealed a 420 ms processing delay. This surprisingly long delay indicates that prospective activity in the hippocampus appears much too late to generate planning or decision signals. This provides yet another example of a prominent brain activity that is unlikely to play a functional role in the cognitive function that it appears to represent (planning future trajectories). Nonetheless, the hippocampus may provide other contextual information to areas active at the earliest stages of selecting future paths, which would then return signals that help establish hippocampal prospective activity.

Individual Differences in Nucleus Accumbens Dopamine Receptors Predict Development of Addiction-Like Behavior: A Computational Approach

Clinical and experimental observations show individual differences in the development of addiction. Increasing evidence supports the hypothesis that dopamine receptor availability in the nucleus accumbens (NAc) predisposes drug reinforcement. Here, modeling striatal-midbrain dopaminergic circuit, we propose a reinforcement learning model for addiction based on the actor-critic model of striatum. Modeling dopamine receptors in the NAc as modulators of learning rate for appetitive—but not aversive—stimuli in the critic—but not the actor—we define vulnerability to addiction as a relatively lower learning rate for the appetitive stimuli, compared to aversive stimuli, in the critic. We hypothesize that an imbalance in this learning parameter used by appetitive and aversive learning systems can result in addiction. We elucidate that the interaction between the degree of individual vulnerability and the duration of exposure to drug has two progressive consequences: deterioration of the imbalance and establishment of an abnormal habitual response in the actor. Using computational language, the proposed model describes how development of compulsive behavior can be a function of both degree of drug exposure and individual vulnerability. Moreover, the model describes how involvement of the dorsal striatum in addiction can be augmented progressively. The model also interprets other forms of addiction, such as obesity and pathological gambling, in a common mechanism with drug addiction. Finally, the model provides an answer for the question of why behavioral addictions are triggered in Parkinson's disease patients by D2 dopamine agonist treatments.

Human behavioral pharmacology, past, present, and future: symposium presented at the 50th annual meeting of the Behavioral Pharmacology Society

A symposium held at the 50th annual meeting of the Behavioral Pharmacology Society in May 2007 reviewed progress in the human behavioral pharmacology of drug abuse. Studies on drug self-administration in humans are reviewed that assessed reinforcing and subjective effects of drugs of abuse. The close parallels observed between studies in humans and laboratory animals using similar behavioral techniques have broadened our understanding of the complex nature of the pharmacological and behavioral factors controlling drug self-administration. The symposium also addressed the role that individual differences, such as sex, personality, and genotype play in determining the extent of self-administration of illicit drugs in human populations. Knowledge of how these factors influence human drug self-administration has helped validate similar differences observed in laboratory animals. In recognition that drug self-administration is but one of many choices available in the lives of humans, the symposium addressed the ways in which choice behavior can be studied in humans. These choice studies in human drug abusers have opened up new and exciting avenues of research in laboratory animals. Finally, the symposium reviewed behavioral pharmacology studies conducted in drug abuse treatment settings and the therapeutic benefits that have emerged from these studies.

Increased error-related thalamic activity during early compared to late cocaine abstinence

Altered cognitive control is implicated in the shaping of cocaine dependence. One of the key component processes of cognitive control is error monitoring. Our previous imaging work highlighted greater activity in distinct cortical and subcortical regions including the dorsal anterior cingulate cortex (dACC), thalamus and insula when participants committed an error during the stop signal task (Li et al., 2008b). Importantly, dACC, thalamic and insular activity has been associated with drug craving. One hypothesis is that the intense interoceptive activity during craving prevents these cerebral structures from adequately registering error and/or monitoring performance. Alternatively, the dACC, thalamus and insula show abnormally heightened responses to performance errors, suggesting that excessive responses to salient stimuli such as drug cues could precipitate craving. The two hypotheses would each predict decreased and increased activity during stop error (SE) as compared to stop success (SS) trials in the SST. Here we showed that cocaine dependent patients (PCD) experienced greater subjective feeling of loss of control and cocaine craving during early (average of day 6) compared to late (average of day 18) abstinence. Furthermore, compared to PCD during late abstinence, PCD scanned during early abstinence showed increased thalamic as well as insular but not dACC responses to errors (SE>SS). These findings support the hypothesis that heightened thalamic reactivity to salient stimuli co-occur with cocaine craving and loss of self control.

Covert Expectation-of-Reward in Rat Ventral Striatum at Decision Points

Flexible decision-making strategies (such as planning) are a key component of adaptive behavior, yet their neural mechanisms have remained resistant to experimental analysis. Theories of planning require prediction and evaluation of potential future rewards, suggesting that reward signals may covertly appear at decision points. To test this idea, we recorded ensembles of ventral striatal neurons on a spatial decision task, in which hippocampal ensembles are known to represent future possibilities at decision points. We found representations of reward which were not only activated at actual reward delivery sites, but also at a high-cost choice point and before error correction. This expectation-of-reward signal at decision points was apparent at both the single cell and the ensemble level, and vanished with behavioral automation. We conclude that ventral striatal representations of reward are more dynamic than suggested by previous reports of reward- and cue-responsive cells, and may provide the necessary signal for evaluation of internally generated possibilities considered during flexible decision-making.

A unified framework for addiction: vulnerabilities in the decision process

The understanding of decision-making systems has come together in recent years to form a unified theory of decision-making in the mammalian brain as arising from multiple, interacting systems (a planning system, a habit system, and a situation-recognition system). This unified decision-making system has multiple potential access points through which it can be driven to make maladaptive choices, particularly choices that entail seeking of certain drugs or behaviors. We identify 10 key vulnerabilities in the system: (1) moving away from homeostasis, (2) changing allostatic set points, (3) euphorigenic "reward-like" signals, (4) overvaluation in the planning system, (5) incorrect search of situation-action-outcome relationships, (6) misclassification of situations, (7) overvaluation in the habit system, (8) a mismatch in the balance of the two decision systems, (9) over-fast discounting processes, and (10) changed learning rates. These vulnerabilities provide a taxonomy of potential problems with decision-making systems. Although each vulnerability can drive an agent to return to the addictive choice, each vulnerability also implies a characteristic symptomology. Different drugs, different behaviors, and different individuals are likely to access different vulnerabilities. This has implications for an individual's susceptibility to addiction and the transition to addiction, for the potential for relapse, and for the potential for treatment.

Addiction as vulnerabilities in the decision process

In our target article, we proposed that addiction could be envisioned as misperformance of a decision-making machinery described by two systems (deliberative and habit systems). Several commentators have argued that Pavlovian learning also produces actions. We agree and note that Pavlovian action-selection will provide several additional vulnerabilities. Several commentators have suggested that addiction arises from sociological parameters. We note in our response how sociological effects can change decision-making variables to provide additional vulnerabilities. Commentators generally have agreed that our theory provides a framework within which to site addiction and treatment, but additional work will be needed to determine whether our taxonomy will help identify and treat subpopulations within the addicted community.

A framework for studying the neurobiology of value-based decision making

Neuroeconomics is the study of the neurobiological and computational basis of value-based decision making. Its goal is to provide a biologically based account of human behaviour that can be applied in both the natural and the social sciences. This Review proposes a framework to investigate different aspects of the neurobiology of decision making. The framework allows us to bring together recent findings in the field, highlight some of the most important outstanding problems, define a common lexicon that bridges the different disciplines that inform neuroeconomics, and point the way to future applications.

Nucleus Accumbens is Involved in Human Action Monitoring: Evidence from Invasive Electrophysiological Recordings

The Nucleus accumbens (Nacc) has been proposed to act as a limbic-motor interface. Here, using invasive intraoperative recordings in an awake patient suffering from obsessive-compulsive disease (OCD), we demonstrate that its activity is modulated by the quality of performance of the subject in a choice reaction time task designed to tap action monitoring processes. Action monitoring, that is, error detection and correction, is thought to be supported by a system involving the dopaminergic midbrain, the basal ganglia, and the medial prefrontal cortex. In surface electrophysiological recordings, action monitoring is indexed by an error-related negativity (ERN) appearing time-locked to the erroneous responses and emanating from the medial frontal cortex. In preoperative scalp recordings the patient's ERN was found to be significantly increased compared to a large (n = 83) normal sample, suggesting enhanced action monitoring processes. Intraoperatively, error-related modulations were obtained from the Nacc but not from a site 5 mm above. Importantly, cross-correlation analysis showed that error-related activity in the Nacc preceded surface activity by 40 ms. We propose that the Nacc is involved in action monitoring, possibly by using error signals from the dopaminergic midbrain to adjust the relative impact of limbic and prefrontal inputs on frontal control systems in order to optimize goal-directed behavior.

Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point

Neural ensembles were recorded from the CA3 region of rats running on T-based decision tasks. Examination of neural representations of space at fast time scales revealed a transient but repeatable phenomenon as rats made a decision: the location reconstructed from the neural ensemble swept forward, first down one path and then the other. Estimated representations were coherent and preferentially swept ahead of the animal rather than behind the animal, implying it represented future possibilities rather than recently traveled paths. Similar phenomena occurred at other important decisions (such as in recovery from an error). Local field potentials from these sites contained pronounced theta and gamma frequencies, but no sharp wave frequencies. Forward-shifted spatial representations were influenced by task demands and experience. These data suggest that the hippocampus does not represent space as a passive computation, but rather that hippocampal spatial processing is an active process likely regulated by cognitive mechanisms.