The roles of valuation and reward processing in cognitive function and psychiatric disorders

Neurobiological foundations and clinical relevance of effort-based decision-making

Applying effort-based decision-making tasks provides insights into specific variables influencing choice behaviors. The current review summarizes the structural and functional neuroanatomy of effort-based decision-making. Across 39 examined studies, the review highlights the ventromedial prefrontal cortex in forming reward-based predictions, the ventral striatum encoding expected subjective values driven by reward size, the dorsal anterior cingulate cortex for monitoring choices to maximize rewards, and specific motor areas preparing for effort expenditure. Neuromodulation techniques, along with shifting environmental and internal states, are promising novel treatment interventions for altering neural alterations underlying decision-making. Our review further articulates the translational promise of this construct into the development, maintenance and treatment of psychiatric conditions, particularly those characterized by reward-, effort- and valuation-related deficits.

The roles of intrinsic motivation and capability-related factors in cognitive effort-based decision-making

Individual differences in cognitive effort-based decision-making can be used to reveal human motivations to invest effort into a given task. Preferences among options that differ by dimensions related to demand levels (i.e., the interaction of task characteristics and performance measures) are also heavily influenced by how likely a person can succeed at a given option. However, most existing cognitive effort-based research has focused primarily on demand-related factors, leading to confounding inferences about the motivation behind these choices. This study used an adaptive algorithm to adjust relative demand levels for three cognitive tasks to investigate general and individual differences in demand preferences. The results highlight an overall pattern of individual differences in intrinsic motivation to perform challenging tasks, supporting research that found cognitive effort aversive to some but attractive to others. These results suggest that relative demand levels and intrinsic task factors drive the motivation to select an action.

Developmental deviation in delay discounting as a transdiagnostic indicator of risk for child psychopathology

BACKGROUND

The tendency to prefer smaller, immediate rewards over larger, delayed rewards is known as delay discounting (DD). Developmental deviations in DD may be key in characterizing psychiatric and neurodevelopmental disorders. Recent work empirically supported DD as a transdiagnostic process in various psychiatric disorders. Yet, there is a lack of research relating developmental changes in DD from mid-childhood to adolescence to psychiatric and neurodevelopmental disorders. Additionally, examining the interplay between socioeconomic status/total household income (THI) and psychiatric symptoms is vital for a more comprehensive understanding of pediatric pathology and its complex relationship with DD.

METHODS

The current study addresses this gap in a robust psychiatric sample of 1843 children and adolescents aged 5-18 (M = 10.6, SD = 3.17; 1,219 males, 624 females). General additive models (GAMs) characterized the shape of age-related changes in monetary and food reward discounting for nine psychiatric disorders compared with neurotypical youth (NT; n = 123). Over 40% of our sample possessed a minimum of at least three psychiatric or neurodevelopmental disorders. We used bootstrap-enhanced Louvain community detection to map DD-related comorbidity patterns. We derived five subtypes based on diagnostic categories present in our sample. DD patterns were then compared across each of the subtypes. Further, we evaluated the effect of cognitive ability, emotional and behavioral problems, and THI in relation to DD across development.

RESULTS

Higher discounting was found in six of the nine disorders we examined relative to NT. DD was consistently elevated across development for most disorders, except for depressive disorders, with age-specific DD differences compared with NTs. Community detection analyses revealed that one comorbidity subtype consisting primarily of Attention-Deficit/Hyperactivity Disorder (ADHD) Combined Presentation and anxiety disorders displayed the highest overall emotional/behavioral problems and greater DD for the food reward. An additional subtype composed mainly of ADHD, predominantly Inattentive Presentation, learning, and developmental disorders, showed the greatest DD for food and monetary rewards compared with the other subtypes. This subtype had deficits in reasoning ability, evidenced by low cognitive and academic achievement performance. For this ADHD-I and developmental disorders subtype, THI was related to DD across the age span such that participants with high THI showed no differences in DD compared with NTs. In contrast, participants with low THI showed significantly worse DD trajectories than all others. Our results also support prior work showing that DD follows nonlinear developmental patterns.

CONCLUSIONS

We demonstrate preliminary evidence for DD as a transdiagnostic marker of psychiatric and neurodevelopmental disorders in children and adolescents. Comorbidity subtypes illuminate DD heterogeneity, facilitating the identification of high-risk individuals. Importantly, our findings revealed a marked link between DD and intellectual reasoning, with children from lower-income households exhibiting lower reasoning skills and heightened DD. These observations underscore the potential consequences of compromised self-regulation in economically disadvantaged individuals with these disorders, emphasizing the need for tailored interventions and further research to support improved outcomes.

The neurophysiological Behavioral Perspective Model of consumer choice and its contribution to the intentional behaviorist research programme

Cognitive explanations raise epistemological problems not faced by accounts confined to observable variables. Many explanatory components of cognitive models are unobservable: beliefs, attitudes, and intentions, for instance, must be made empirically available to the researcher in the form of measures of observable behavior from which the latent variables are inferred. The explanatory variables are abstract and theoretical and rely, if they are to enter investigations and explanations, on reasoned agreement on how they can be captured by proxy variables derived from what people say and how they behave. Psychometrics must be founded upon a firm, intersubjective agreement among researchers and users of research on the relationship of behavioral measures to the intentional constructs to which they point and the latent variables they seek to operationalize. Only if these considerations are adequately addressed can we arrive at consistent interpretations of the data. This problem provides the substance of the intentional behaviorist research programme which seeks to provide a rationale for the cognitive explanation. Within this programme, two versions of the Behavioral Perspective Model (BPM), an extensional portrayal of socioeconomic behavior and a corresponding intentional approach, address the task of identifying where intentional explanation becomes necessary and the form it should take. This study explores a third version, based on neurophysiological substrates of consumer choice as a contributor to this task. The nature of "value" is closely related to the rationale for a neurophysiological model of consumer choice. The variables involved are operationally specified and measured with high intersubjective agreement. The intentional model (BPM-I), depicting consumer action in terms of mental processes such as perception, deliberation, and choice, extends the purview of the BPM to new situations and areas of explanation.

Association between inflammation, reward processing, and ibuprofen-induced increases of miR-23b in astrocyte-enriched extracellular vesicles: A randomized, placebo-controlled, double-blind, exploratory trial in healthy individuals

Ibuprofen, a non-steroidal, anti-inflammatory drug, modulates inflammation but may also have neuroprotective effects on brain health that are poorly understood. Astrocyte-enriched extracellular vesicles (AEEVs) facilitate cell-to-cell communication and - among other functions - regulate inflammation and metabolism via microribonucleic acids (miRNAs). Dysfunctions in reward-related processing and inflammation have been proposed to be critical pathophysiological pathways in individuals with mood disorders. This investigation examined whether changes in AEEV cargo induced by an anti-inflammatory agent results in inflammatory modulation that is associated with reward-related processing. Data from a double-blind, randomized, repeated-measures study in healthy volunteers were used to examine the effects of AEEV miRNAs on brain activation during reward-related processing. In three separate visits, healthy participants (N = 20) received a single dose of either placebo, 200 mg, or 600 mg of ibuprofen, completed the monetary incentive delay task during functional magnetic resonance imaging, and provided a blood sample for cytokine and AEEV collection. AEEV miRNA content profiling showed that ibuprofen dose-dependently increased AEEV miR-23b-3p expression with greater increase following the 600 mg administration than placebo. Those individuals who received 600 mg and showed the highest miR-23b-3p expression also showed the (a) lowest serum tumor necrosis factor (TNF) and interleukin-17A (IL-17A) concentrations; and had the (b) highest striatal brain activation during reward anticipation. These results support the hypothesis that ibuprofen alters the composition of miRNAs in AEEVs. This opens the possibility that AEEV cargo could be used to modulate brain processes that are important for mental health.

Fluoxetine degrades luminance perceptual thresholds while enhancing motivation and reward sensitivity

Selective serotonin reuptake inhibitors (SSRIs) increase serotonin activity in the brain. While they are mostly known for their antidepressant properties, they have been shown to improve visual functions in amblyopia and impact cognitive functions ranging from attention to motivation and sensitivity to reward. Yet, a clear understanding of the specific action of serotonin to each of bottom-up sensory and top-down cognitive control components and their interaction is still missing. To address this question, we characterize, in two adult male macaques, the behavioral effects of fluoxetine, a specific SSRI, on visual perception under varying bottom-up (luminosity, distractors) and top-down (uncertainty, reward biases) constraints while they are performing three different visual tasks. We first manipulate target luminosity in a visual detection task, and we show that fluoxetine degrades luminance perceptual thresholds. We then use a target detection task in the presence of spatial distractors, and we show that under fluoxetine, monkeys display both more liberal responses as well as a degraded perceptual spatial resolution. In a last target selection task, involving free choice in the presence of reward biases, we show that monkeys display an increased sensitivity to reward outcome under fluoxetine. In addition, we report that monkeys produce, under fluoxetine, more trials and less aborts, increased pupil size, shorter blink durations, as well as task-dependent changes in reaction times. Overall, while low level vision appears to be degraded by fluoxetine, performances in the visual tasks are maintained under fluoxetine due to enhanced top-down control based on task outcome and reward maximization.

Structure-function coupling within the reward network in preschool children predicts executive functioning in later childhood

Early differences in reward behavior have been linked to executive functioning development. The nucleus accumbens (NAc) and orbitofrontal cortex (OFC) are activated by reward-related tasks and identified as key nodes of the brain circuit that underlie reward processing. We aimed to investigate the relation between NAc-OFC structural and functional connectivity in preschool children, as well as associations with future reward sensitivity and executive function. We showed that NAc-OFC structural and functional connectivity were not significantly associated in preschool children, but both independently predicted sensitivity to reward in males in a left-lateralized manner. Moreover, significant NAc-OFC structure-function coupling was only found in individuals who performed poorly on executive function tasks in later childhood, but not in the middle- and high-performing groups. As structure-function coupling is proposed to measure functional specialization, this finding suggests premature functional specialization within the reward network, which may impede dynamic communication with other regions, affects executive function development. Our study also highlights the utility of multimodal imaging data integration when studying the effects of reward network functional flexibility in the preschool age, a critical period in brain and executive function development.

•

Functional connectivity is not tethered to structural connectivity in preschool age.

•

Higher degree of SC-FC coupling reflects lower plasticity in early childhood.

•

Gender differences in reward sensitivity were present as early as in preschool age.

•

Early reward network SC-FC coupling affects later executive function.

Value-based cognition and drug dependency

Value-based decision-making is thought to play an important role in drug dependency. Achieving elevated levels of euphoria or ameliorating dysphoria/pain may motivate goal-directed drug consumption in both drug-naïve and long-time users. In other words, drugs become viewed as the preferred means of attaining a desired internal state. The bias towards choosing drugs may affect one's cognition. Observed biases in learning, attention and memory systems within the brain gradually focus one's cognitive functions towards drugs and related cues to the exclusion of other stimuli. In this narrative review, the effects of drug use on learning, attention and memory are discussed with a particular focus on changes across brain-wide functional networks and the subsequent impact on behaviour. These cognitive changes are then incorporated into the cycle of addiction, an established model outlining the transition from casual drug use to chronic dependency. If drug use results in the elevated salience of drugs and their cues, the studies highlighted in this review strongly suggest that this salience biases cognitive systems towards the motivated pursuit of addictive drugs. This bias is observed throughout the cycle of addiction, possibly contributing to the persistent hold that addictive drugs have over the dependent. Taken together, the excessive valuation of drugs as the preferred means of achieving a desired internal state affects more than just decision-making, but also learning, attentional and mnemonic systems. This eventually narrows the focus of one's thoughts towards the pursuit and consumption of addictive drugs.

Valuation system connectivity is correlated with poly-drug use in young adults

Poly-drug consumption contributes to fatal overdose in more than half of all poly-drug users. Analyzing decision-making networks may give insight into the motivations behind poly-drug use. We correlated average functional connectivity of the valuation system (VS), executive control system (ECS) and valuation-control complex (VCC) in a large population sample (n = 992) with drug use behaviour. VS connectivity is correlated with sedative use, ECS connectivity is separately correlated with hallucinogens and opiates. Network connectivity is also correlated with drug use via two-way interactions with other substances including alcohol and tobacco. These preliminary findings can contribute to our understanding of the common combinations of substance co-use and associated neural patterns.

Value network engagement and effects of memory-related processing during encoding and retrieval of value

Decision makers rely on episodic memory to calculate choice values in everyday life, yet it is unclear how neural mechanisms of valuation differ when value-related information is encoded versus retrieved from episodic memory. The current fMRI study compared neural correlates of value while information was encoded versus retrieved from memory. Scanned tasks were followed by a behavioral episodic memory test for item-attribute associations. Our analyses sought to (i) identify neural correlates of value that were distinct and common across encoding and retrieval, and (ii) determine whether neural mechanisms of valuation and episodic memory interact. The study yielded three primary findings. First, value-related activation in the fronto-striatal reward circuit and posterior parietal cortex was comparable across valuation phases. Second, value-related activation in select fronto-parietal and salience regions was significantly greater at value retrieval than encoding. Third, there was no interaction between neural correlates of valuation and episodic memory. Taken with prior research, the present study indicates that fronto-parietal and salience regions play a key role in retrieval-dependent valuation and context-specific effects likely determine whether neural correlates of value interact with episodic memory.

Value, drug addiction and the brain

Over the years, various models have been proposed to explain the psychology and biology of drug addiction, built primarily around the habit and compulsion models. Recent research indicates drug addiction may be goal-directed, motivated by excessive valuation of drugs. Drug consumption may initially occur for the sake of pleasure but may transition to a means of escaping withdrawal, stress and negative emotions. In this hypothetical paper, we propose a value-based neurobiological model for drug addiction. We posit that during dependency, the value-based decision-making system in the brain is not inactive but has instead prioritized drugs as the reward of choice. In support of this model, we consider the role of valuation in choice, its influence on pleasure and punishment, and how valuation is contrasted in impulsive and compulsive behaviours. We then discuss the neurobiology of value, beginning with the dopaminergic system and its relationship with incentive salience before moving to brain-wide networks involved in valuation, control and prospection. These value-based neurobiological components are then integrated into the cycle of addiction as we consider the development of drug dependency from a valuation perspective. We conclude with a discussion of cognitive interventions utilizing value-based decision-making, highlighting not just advances in recalibrating the valuation system to focus on non-drug rewards, but also areas for improvement in refining this approach.

The impact of training methodology and representation on rule-based categorization: An fMRI study

Hélie, Shamloo, & Ell (2017) showed that regular classification learning instructions (A/B) promote between-category knowledge in rule-based categorization whereas conceptual learning instructions (YES/NO) promote learning within-category knowledge with the same categories. Here we explore how these tasks affect brain activity using fMRI. Participants learned two sets of two categories. Computational models were fit to the behavioral data to determine the type of knowledge learned by each participant. fMRI contrasts were computed to compare BOLD signal between the tasks and between the types of knowledge. The results show that participants in the YES/NO task had more activity in the pre-supplementary motor area, prefrontal cortex, and the angular/supramarginal gyrus. These brain areas are related to working memory and part of the dorsal attention network, which showed increased task-based functional connectivity with the medial temporal lobes. In contrast, participants in the A/B task had more activity in the thalamus and caudate. These results suggest that participants in the YES/NO task used bivalent rules and may have treated each contextual question as a separate task, switching task each time the question changed. Activity in the A/B condition was more consistent with participants applying direct Stimulus → Response rules. With regards to knowledge representation, there was a large shared network of brain areas, but participants learning between-category information showed additional posterior parietal activity, which may be related to the inhibition of incorrect motor programs.

Associations Between Delay Discounting and Connectivity of the Valuation-control System in Healthy Young Adults

The process of valuation assists in determining if an object or course of action is rewarding. Delay discounting is the observed decay of a rewards' subjective value over time. Encoding the subjective value of rewards across a spectrum has been attributed to brain regions belonging to the valuation and executive control systems. The valuation system (VS) encodes reward value over short and long delays, influencing reinforcement learning and reward representation. The executive control system (ECS) becomes more active as choice difficulty increases, integrating contextual and mnemonic information with salience signals in the modulation of decision-making. Here, we aimed to identify resting-state functional connectivity-based patterns of the VS and ECS correlated with value-setting and delay discounting (outside-scanner paradigm) in a large (n = 992) cohort of healthy young adults from the Human Connectome Project (HCP). Results suggest the VS may be involved in value-setting of small, immediate rewards while the ECS may be involved in value-setting and delay discounting for large and small rewards over a range of delays. We observed magnitude sensitive connections involving the posterior cingulate cortex, time-sensitive connections with the ventromedial and lateral prefrontal cortex while connections involving the posterior parietal cortex appeared both magnitude- and time-sensitive. The ventromedial prefrontal cortex and posterior parietal cortex could act as "comparator" regions, weighing the value of small rewards against large rewards across various delay duration to aid in decision-making.

Ineffective risk-reward learning in schizophrenia

The underpinnings of poor decision-making in schizophrenia could reflect excessively risky or inhibited behaviors. This study employed the Balloon Analogue Risk Task (BART) to compare decision-making in schizophrenia cases to that of healthy controls. Individuals with schizophrenia performed significantly differently across three trials, failing to improve their performance as shown by the control group. In the control group, cognitive ability, measured with the Wechsler Adult Intelligence Scale (WAIS-III) showed that Perceptual Organization scores predicted Average Inflations per Trial, Total Balloon Pops, and Total Earnings. Although the schizophrenia cases failed to learn, group performance on the BART was not associated with cognitive ability, but regression analyses showed 41.4% of average inflations per trial were explained by Excitement, Delusions, Emotional Withdrawal, and Poor Rapport; total balloon pops were only explained by emotional withdrawal and Total Earnings were reduced by Delusions, Excitement and Poor Rapport. Only healthy participants demonstrated a relation between cognitive ability performance improvement across trials. Schizophrenia cases showed less risk-taking, and earned significantly less money overall. Identifying the determinants of poor decision-making could inform interventions and possible treatments to improve their function and perhaps be of relevance to public safety if decisions are overly risky.

Reframing appetitive reinforcement learning and reward valuation as effects mediated by hippocampal-dependent behavioral inhibition

Traditional theories of neuroeconomics focus on reinforcement learning and reward value. We propose here a novel reframing of reinforcement learning and motivation that includes a hippocampal-dependent regulatory mechanism which balances cue-induced behavioral excitation with behavioral inhibition. This mechanism enables interoceptive cues produced by respective food or drug satiety to antagonize the ability of excitatory food- and drug-related environmental cues to retrieve the memories of food and drug reinforcers, thereby suppressing the power of those cues to evoke appetitive behavior. When the operation of this mechanism is impaired, ability of satiety signals to inhibit appetitive behavior is weakened because the relative balance between inhibition and simple excitation is shifted toward increased retrieval of food and drug memories by environmental cues. In the present paper, we (1) describe the associative processes that constitute this mechanism of hippocampal-dependent behavior inhibition; (2) describe how a prevailing obesity-promoting diet and drugs of abuse produce hippocampal pathophysiologies that can selectively impair this inhibitory function; and (3) propose how glucagon-like peptide 1 (GLP-1), an incretin hormone that is recognized as an important satiety signal, may work to protect the hippocampal-dependent inhibition. Our perspective may add to neuroscientific and neuroeconomic analyses of both overeating and drug abuse by outlining the role of hippocampal-dependent memory processes in the control of both food and drug seeking behaviors. In addition, this view suggests that consideration should be given to diet- and drug induced hippocampal pathophysiologies, as potential novel targets for the treatment of dysregulated energy and drug intake.

Sensitivity to gains during risky decision-making differentiates chronic cocaine users from stimulant-naïve controls

BACKGROUND

Chronic cocaine use has been consistently associated with decision-making impairments that contribute to the development and maintenance of drug-taking. However, the underlying cognitive processes of risk-seeking behaviours observed in chronic cocaine users (CU) have so far remained unclear. Here we therefore tested whether CU differ from stimulant-naïve controls in their sensitivity to gain, loss, and probability of loss information when making decisions under risk.

METHOD

A sample of 96 participants (56 CU and 40 controls) performed the no-feedback version of the Columbia Card Task, designed to assess risk-taking in relation to gain, loss, and probability of loss information. Additionally, cognitive performance and impulsivity were determined. Current and recent substance use was objectively assessed by toxicological urine and hair analysis.

RESULTS

Compared to controls, CU showed increased risk-seeking in unfavourable decision scenarios in which the loss probability was high and the returns were low, and a tendency for increased risk aversion in more favourable decision scenarios. In comparison to controls, CU were less sensitive to gain, but similarly sensitive to loss and probability of loss information. Further analysis revealed that individual differences in sensitivity to loss and probability of loss information were related to cognitive performance and impulsivity.

CONCLUSION

Reduced sensitivity to gains in people with CU may contribute to their propensity for making risky decisions. While these alterations in gain sensitivity might directly relate to cocaine use per se, the individual psychopathological profile of CU might moderate sensitivity to loss information.

Reward processing in certain versus uncertain contexts in schizophrenia: An event-related potential (ERP) study

Disturbances in motivation are prominent in the clinical presentation of people with schizophrenia and might reflect a disturbance in reward processing. Recent advances in affective neuroscience have subdivided reward processing into distinct components, but there are two limitations of the prior work in schizophrenia. First, studies typically focus on only one component rather than on the unfolding of reward processing across multiple stages. Second, studies have not considered the impact of certainty effects, which represent an important contextual factor that impacts processing. We examined whether individuals with schizophrenia show the typical certainty effects across three phases of reward processing: cue evaluation, feedback anticipation, and feedback receipt. Electroencephalography from 74 healthy controls and 92 people with schizophrenia was recorded during a cued gambling task under conditions in which cues indicated forthcoming reward outcomes that were certain or uncertain. Controls demonstrated the expected certainty effects across each stage. Initial cue evaluation (cue P300) was intact in the schizophrenia group, but people with schizophrenia showed diminished certainty effects during feedback anticipation (stimulus-preceding negativity [SPN]) and receipt (feedback reward positivity [fRewP] and feedback P300). During feedback receipt, event-related potentials in people with schizophrenia were similar to controls for the uncertain context but larger than controls for the certain context. Essentially, people with schizophrenia appeared to process certain feedback as though it were uncertain. These findings show, for the first time, that the fundamental distinction between certain and uncertain contexts is altered in schizophrenia at a neural level. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

A role for the CD38 rs3796863 polymorphism in alcohol and monetary reward: evidence from CD38 knockout mice and alcohol self-administration, [11C]-raclopride binding, and functional MRI in humans

Background: Cluster of differentiation 38 (CD38) is a transmembrane protein expressed in dopaminergic reward pathways in the brain, including the nucleus accumbens (NAc). The GG genotype of a common single nucleotide polymorphism (SNP) within CD38, rs3796863, is associated with increased social reward.Objective: Examine whether CD38 rs3796863 and Cd38 knockout (KO) are associated with reward-related neural and behavioral phenotypes.Methods: Data from four independent human studies were used to test whether rs3796863 genotype is associated with: (1) intravenous alcohol self-administration (n = 64, 30 females), (2) alcohol-stimulated dopamine (DA) release measured using ¹¹C-raclopride positron emission tomography (n = 22 men), (3) ventral striatum (VS) response to positive feedback measured using a card guessing functional magnetic resonance imaging (fMRI) paradigm (n = 531, 276 females), and (4) resting state functional connectivity (rsfc) of the VS (n = 51, 26 females). In a fifth study, we used a mouse model to examine whether cd38 knockout influences stimulated DA release in the NAc core and dorsal striatum using fast-scanning cyclic voltammetry.Results: Relative to T allele carriers, G homozygotes at rs3796863 within CD38 were characterized by greater alcohol self-administration, alcohol-stimulated dopamine release, VS response to positive feedback, and rsfc between the VS and anterior cingulate cortex. High-frequency stimulation reduced DA release among Cd38 KO mice had reduced dopamine release in the NAc.Conclusion: Converging evidence suggests that CD38 rs3796863 genotype may increase DA-related reward response and alcohol consumption.

Behavioral Paradigms to Probe Individual Mouse Differences in Value-Based Decision Making

Value-based decision making relies on distributed neural systems that weigh the benefits of actions against the cost required to obtain a given outcome. Perturbations of these systems are thought to underlie abnormalities in action selection seen across many neuropsychiatric disorders. Genetic tools in mice provide a promising opportunity to explore the cellular components of these systems and their molecular foundations. However, few tasks have been designed that robustly characterize how individual mice integrate differential reward benefits and cost in their selection of actions. Here we present a forced-choice, two-alternative task in which each option is associated with a specific reward outcome, and unique operant contingency. We employed global and individual trial measures to assess the choice patterns and behavioral flexibility of mice in response to differing "choice benefits" (modeled as varying reward magnitude ratios) and different modalities of "choice cost" (modeled as either increasing repetitive motor output to obtain reward or increased delay to reward delivery). We demonstrate that (1) mouse choice is highly sensitive to the relative benefit of outcomes; (2) choice costs are heavily discounted in environments with large discrepancies in relative reward; (3) divergent cost modalities are differentially integrated into action selection; (4) individual mouse sensitivity to reward benefit is correlated with sensitivity to reward costs. These paradigms reveal stable individual animal differences in value-based action selection, thereby providing a foundation for interrogating the neural circuit and molecular pathophysiology of goal-directed dysfunction.

Reward systems and cognitions in Major Depressive Disorder

A lack of motivation and anhedonia represent frequent and pervasive symptoms in depression, although with poor specificity. Historically described as a response bias, reward-related impairments in depression may account for the important aspects of the cognitive impairments associated with diagnosis of major depressive disorder. Reward processing is a broad psychological construct that can be parsed into 3 distinct components known as "reinforcement learning" (learning), "reward responsiveness" (liking), and "motivation to obtain a reward" (wanting). Depressed patients respond hyposensitively to reward and maladaptively to punishment: this pattern is related to a dysfunction in the frontostriatal systems modulated by the monoamine systems; seems to be observed in medicated and unmedicated patients with depression and in healthy individuals with high levels of anhedonia; and could be observed in patients with a history of depression, even when in full remission. Considered to be cognitive impairments, reward-related-impairments may also constitute part of an underlying neurobiological vulnerability to major depressive disorder (MDD). For example, the reward-related impairment is state dependent and, more or less, correlated with symptom severity in some studies but has also been proposed as being trait like, with endophenotype characteristics, possibly contributing to the persistence of the disease or treatment resistance. The 3 core aspects of reward processing have specific neurobiological correlates that involve the ventral and dorsal striatum, lateral habenula, ventral tegmental area, orbitofrontal cortex, anterior cingulate cortex, and ventromedial and dorsolateral prefrontal cortex. These structures underline the important role of the dopaminergic mesolimbic pathway, but glutamate and serotonin could also have an important role, at least in some aspects of reward-related impairments.

The impact of reward on attention in schizophrenia

Traditionally, attention was thought to be directed by either top-down goals or bottom-up salience. Recent studies have shown that the reward history of a stimulus feature also acts as a powerful attentional cue. This is particularly relevant in schizophrenia, which is characterized by motivational and attentional deficits. Here, we examine the impact of reward on selective attention. Forty-eight people with schizophrenia (PSZ) and 34 non-psychiatric control subject (NCS) discriminated the location of a target dot appearing inside a left circle or right circle. The circles were different colors, one of which was associated with reward via pre-training. In the first 2 blocks, targets were equally likely to appear in the left or right circle. In the last 4 blocks, the target was 75% likely on one side, thus allowing us to separately examine how attention was impacted by reward (color) and probability (location). PSZ had slower overall reaction times (RTs) than NCS. Both groups showed robust effects of spatial probability and reward history, with faster RTs for the rewarded color and for the more probable location. These effects were similar in PSZ and NCS. Negative symptom severity correlated with overall RT slowing, but there were no correlations between symptoms and reward-associated biasing of attention. PSZ demonstrated RT slowing but normal reward history and spatial probability-driven RT facilitation. These results are conceptually similar to prior findings showing intact implicit reward effects on response bias, and suggest that implicit processing of reward and probability is intact in PSZ.

Cognitive performance of juvenile monkeys after chronic fluoxetine treatment

Potential long term effects on brain development are a concern when drugs are used to treat depression and anxiety in childhood. In this study, male juvenile rhesus monkeys (three-four years of age) were dosed with fluoxetine or vehicle (N=16/group) for two years. Histomorphometric examination of cortical dendritic spines conducted after euthanasia at one year postdosing (N=8/group) suggested a trend toward greater dendritic spine synapse density in prefrontal cortex of the fluoxetine-treated monkeys. During dosing, subjects were trained for automated cognitive testing, and evaluated with a test of sustained attention. After dosing was discontinued, sustained attention, recognition memory and cognitive flexibility were evaluated. Sustained attention was affected by fluoxetine, both during and after dosing, as indexed by omission errors. Response accuracy was not affected by fluoxetine in post-dosing recognition memory and cognitive flexibility tests, but formerly fluoxetine-treated monkeys compared to vehicle controls had more missed trial initiations and choices during testing. Drug treatment also interacted with genetic and environmental variables: MAOA genotype (high- and low transcription rate polymorphisms) and testing location (upper or lower tier of cages). Altered development of top-down cortical regulation of effortful attention may be relevant to this pattern of cognitive test performance after juvenile fluoxetine treatment.