Instant transformation of learned repulsion into motivational "wanting"

Control of fluid intake in dehydrated rats and evolution of sodium appetite

The objective of the present work is to examine from a new perspective the existence of causal factors not predicted by the classical theory that thirst and sodium appetite are two distinct motivations. For example, we ask why water deprivation induces sodium appetite, thirst is not "water appetite", and intracellular dehydration potentially causes sodium appetite. Contrary to the classical theory, we suggest that thirst first, and sodium appetite second, designate a temporal sequence underlying the same motivation. The single motivation becomes an "intervenient variable" a concept borrowed from the literature, fully explained in the text, between causes of dehydration (extracellular, intracellular, or both together), and respective behavioral responses subserved by hindbrain-dependent inhibition (e.g., lateral parabrachial nucleus) and forebrain facilitation (e.g., angiotensin II). A corollary is homology between rat sodium appetite and marine teleost thirst-like motivation that we name "protodipsia". The homology argument rests on similarities between behavior (salty water intake) and respective neuroanatomical as well as functional mechanisms. Tetrapod origin in a marine environment provides additional support for the homology. The single motivation hypothesis is also consistent with ingestive behaviors in nature given similarities (e.g., thirst producing brackish water intake) between the behavior of the laboratory rat and wild animals, rodents included. The hypotheses of single motivation and homology might explain why hyperosmotic rats, or eventually any other hyperosmotic tetrapod, shows paradoxical signs of sodium appetite. They might also explain how ingestive behaviors determined by dehydration and subserved by hindbrain inhibitory mechanisms contributed to tetrapod transition from sea to land.

Control of sodium appetite by hindbrain aldosterone-sensitive neurons

Mineralocorticoids play a key role in hydromineral balance by regulating sodium retention and potassium wasting. Through favoring sodium, mineralocorticoids can cause hypertension from fluid overload under conditions of hyperaldosteronism, such as aldosterone-secreting tumors. An often-overlooked mechanism by which aldosterone functions to increase sodium is through stimulation of salt appetite. To drive sodium intake, aldosterone targets neurons in the hindbrain which uniquely express 11β-hydroxysteroid dehydrogenase type 2 (HSD2). This enzyme is a necessary precondition for aldosterone-sensing cells as it metabolizes glucocorticoids - preventing their activation of the mineralocorticoid receptor. In this review, we will consider the role of hindbrain HSD2 neurons in regulating sodium appetite by discussing HSD2 expression in the brain, regulation of hindbrain HSD2 neuron activity, and the circuitry mediating the effects of these aldosterone-sensitive neurons. Reducing the activity of hindbrain HSD2 neurons may be a viable strategy to reduce sodium intake and cardiovascular risk, particularly for conditions of hyperaldosteronism.

Regulation of reinforcement learning parameters captures long-term changes in rat behaviour

In uncertain environments in which resources fluctuate continuously, animals must permanently decide whether to stabilise learning and exploit what they currently believe to be their best option, or instead explore potential alternatives and learn fast from new observations. While such a trade-off has been extensively studied in pretrained animals facing non-stationary decision-making tasks, it is yet unknown how they progressively tune it while learning the task structure during pretraining. Here, we compared the ability of different computational models to account for long-term changes in the behaviour of 24 rats while they learned to choose a rewarded lever in a three-armed bandit task across 24 days of pretraining. We found that the day-by-day evolution of rat performance and win-shift tendency revealed a progressive stabilisation of the way they regulated reinforcement learning parameters. We successfully captured these behavioural adaptations using a meta-learning model in which either the learning rate or the inverse temperature was controlled by the average reward rate.

Disentangling pain and fatigue in chronic fatigue syndrome: a resting state connectivity study before and after cognitive behavioral therapy

BACKGROUND

Fatigue is a central feature of myalgic encephalomyelitis or chronic fatigue syndrome (ME/CFS), but many ME/CFS patients also report comorbid pain symptoms. It remains unclear whether these symptoms are related to similar or dissociable brain networks. This study used resting-state fMRI to disentangle networks associated with fatigue and pain symptoms in ME/CFS patients, and to link changes in those networks to clinical improvements following cognitive behavioral therapy (CBT).

METHODS

Relationships between pain and fatigue symptoms and cortico-cortical connectivity were assessed within ME/CFS patients at baseline (N = 72) and after CBT (N = 33) and waiting list (WL, N = 18) and compared to healthy controls (HC, N = 29). The analyses focused on four networks previously associated with pain and/or fatigue, i.e. the fronto-parietal network (FPN), premotor network (PMN), somatomotor network (SMN), and default mode network (DMN).

RESULTS

At baseline, variation in pain and fatigue symptoms related to partially dissociable brain networks. Fatigue was associated with higher SMN-PMN connectivity and lower SMN-DMN connectivity. Pain was associated with lower PMN-DMN connectivity. CBT improved SMN-DMN connectivity, compared to WL. Larger clinical improvements were associated with larger increases in frontal SMN-DMN connectivity. No CBT effects were observed for PMN-DMN or SMN-PMN connectivity.

CONCLUSIONS

These results provide insight into the dissociable neural mechanisms underlying fatigue and pain symptoms in ME/CFS and how they are affected by CBT in successfully treated patients. Further investigation of how and in whom behavioral and biomedical treatments affect these networks is warranted to improve and individualize existing or new treatments for ME/CFS.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Effects of outcome revaluation on attentional prioritisation of reward-related stimuli

Stimuli associated with rewards can acquire the ability to capture our attention independently of our goals and intentions. Here, we examined whether attentional prioritisation of reward-related cues is sensitive to changes in the value of the reward itself. To this end, we incorporated an instructed outcome devaluation (Experiment 1a), "super-valuation" (Experiment 1b), or value switch (Experiment 2) into a visual search task, using eye-tracking to examine attentional prioritisation of stimuli signalling high- and low-value rewards. In Experiments 1a and 1b, we found that prioritisation of high- and low-value stimuli was insensitive to devaluation of a previously high-value outcome, and super-valuation of a previously low-value outcome, even when participants were provided with further experience of receiving that outcome. In Experiment 2, following a value-switch manipulation, we found that prioritisation of a high-value stimulus could not be overcome with knowledge of the new values of outcomes alone. Only when provided with further experience of receiving the outcomes did patterns of attentional prioritisation of high- and low-value stimuli switch, in line with the updated values of the outcomes they signalled. To reconcile these findings, we suggest that participants were motivated to engage in effortful updating of attentional control settings when there was a relative difference between reward values at test (Experiment 2) but that previous settings were allowed to persist when both outcomes had the same value at test (Experiments 1a and 1b). These findings provide a novel framework to further understand the role of cognitive control in driving reward-modulated attention and behaviour.

Bayesianism and wishful thinking are compatible

Bayesian principles show up across many domains of human cognition, but wishful thinking-where beliefs are updated in the direction of desired outcomes rather than what the evidence implies-seems to threaten the universality of Bayesian approaches to the mind. In this Article, we show that Bayesian optimality and wishful thinking are, despite first appearances, compatible. The setting of opposing goals can cause two groups of people with identical prior beliefs to reach opposite conclusions about the same evidence through fully Bayesian calculations. We show that this is possible because, when people set goals, they receive privileged information in the form of affective experiences, and this information systematically supports goal-consistent conclusions. We ground this idea in a formal, Bayesian model in which affective prediction errors drive wishful thinking. We obtain empirical support for our model across five studies.

Neural substrates of parallel devaluation-sensitive and devaluation-insensitive Pavlovian learning in humans

We aim to differentiate the brain regions involved in the learning and encoding of Pavlovian associations sensitive to changes in outcome value from those that are not sensitive to such changes by combining a learning task with outcome devaluation, eye-tracking, and functional magnetic resonance imaging in humans. Contrary to theoretical expectation, voxels correlating with reward prediction errors in the ventral striatum and subgenual cingulate appear to be sensitive to devaluation. Moreover, regions encoding state prediction errors appear to be devaluation insensitive. We can also distinguish regions encoding predictions about outcome taste identity from predictions about expected spatial location. Regions encoding predictions about taste identity seem devaluation sensitive while those encoding predictions about an outcome's spatial location seem devaluation insensitive. These findings suggest the existence of multiple and distinct associative mechanisms in the brain and help identify putative neural correlates for the parallel expression of both devaluation sensitive and insensitive conditioned behaviors.

A goal-centric outlook on learning

Goals play a central role in human cognition. However, computational theories of learning and decision-making often take goals as given. Here, we review key empirical findings showing that goals shape the representations of inputs, responses, and outcomes, such that setting a goal crucially influences the central aspects of any learning process: states, actions, and rewards. We thus argue that studying goal selection is essential to advance our understanding of learning. By following existing literature in framing goal selection within a hierarchy of decision-making problems, we synthesize important findings on the principles underlying goal value attribution and exploration strategies. Ultimately, we propose that a goal-centric perspective will help develop more complete accounts of learning in both biological and artificial agents.

Prefrontal Dopamine in Flexible Adaptation to Environmental Changes: A Game for Two Players

Deficits in cognitive flexibility have been characterized in affective, anxiety, and neurodegenerative disorders. This paper reviews data, mainly from studies on animal models, that support the existence of a cortical-striatal brain circuit modulated by dopamine (DA), playing a major role in cognitive/behavioral flexibility. Moreover, we reviewed clinical findings supporting misfunctioning of this circuit in Parkinson's disease that could be responsible for some important non-motoric symptoms. The reviewed findings point to a role of catecholaminergic transmission in the medial prefrontal cortex (mpFC) in modulating DA's availability in the nucleus accumbens (NAc), as well as a role of NAc DA in modulating the motivational value of natural and conditioned stimuli. The review section is accompanied by a preliminary experiment aimed at testing weather the extinction of a simple Pavlovian association fosters increased DA transmission in the mpFC and inhibition of DA transmission in the NAc.

The right superior temporal gyrus plays a role in semantic-rule learning: Evidence supporting a reinforcement learning model

In real-life communication, individuals use language that carries evident rewarding and punishing elements, such as praise and criticism. A common trend is to seek more praise while avoiding criticism. Furthermore, semantics is crucial for conveying information, but such semantic access to native and foreign languages is subtly distinct. To investigate how rule learning occurs in different languages and to highlight the importance of semantics in this process, we investigated both verbal and non-verbal rule learning in first (L1) and second (L2) languages using a reinforcement learning framework, including a semantic rule and a color rule. Our computational modeling on behavioral and brain imaging data revealed that individuals may be more motivated to learn and adhere to rules in an L1 compared to L2, with greater striatum activation during the outcome phase in the L1. Additionally, results on the learning rates and inverse temperature in the two rule learning tasks showed that individuals tend to be conservative and are reluctant to change their judgments regarding rule learning of semantic information. Moreover, the greater the prediction errors, the greater activation of the right superior temporal gyrus in the semantic-rule learning condition, demonstrating that such learning has differential neural correlates than symbolic rule learning. Overall, the findings provide insight into the neural mechanisms underlying rule learning in different languages, and indicate that rule learning involving verbal semantics is not a general symbolic learning that resembles a conditioned stimulus-response, but rather has its own specific characteristics.

Contexts facilitate dynamic value encoding in the mesolimbic dopamine system

Adaptive behavior in a dynamic environment often requires rapid revaluation of stimuli that deviates from well-learned associations. The divergence between stable value-encoding and appropriate behavioral output remains a critical test to theories of dopamine's function in learning, motivation, and motor control. Yet how dopamine neurons are involved in the revaluation of cues when the world changes to alter our behavior remains unclear. Here we make use of pharmacology, in vivo electrophysiology, fiber photometry, and optogenetics to resolve the contributions of the mesolimbic dopamine system to the dynamic reorganization of reward-seeking. Male and female rats were trained to discriminate when a conditioned stimulus would be followed by sucrose reward by exploiting the prior, non-overlapping presentation of a separate discrete cue - an occasion setter. Only when the occasion setter's presentation preceded the conditioned stimulus did the conditioned stimulus predict sucrose delivery. As a result, in this task we were able to dissociate the average value of the conditioned stimulus from its immediate expected value on a trial-to-trial basis. Both the activity of ventral tegmental area dopamine neurons and dopamine signaling in the nucleus accumbens were essential for rats to successfully update behavioral responding in response to the occasion setter. Moreover, dopamine release in the nucleus accumbens following the conditioned stimulus only occurred when the occasion setter indicated it would predict reward. Downstream of dopamine release, we found that single neurons in the nucleus accumbens dynamically tracked the value of the conditioned stimulus. Together these results reveal a novel mechanism within the mesolimbic dopamine system for the rapid revaluation of motivation.

The role of sex on sign-tracking acquisition and outcome devaluation sensitivity in Long Evans rats

Cues that predict rewards can trigger reward-seeking behaviors but also can, in some cases, become targets of motivation themselves. One behavioral phenomenon that captures this idea is sign-tracking in which animals, including humans, interact with reward-predictive cues even though it is not necessary to do so. Sign-tracking in rats has been studied in the domain of motivation and in how motivated behaviors can or cannot become excessive and habit-like over time. Many prior studies look at sign-tracking examine this behavior in male subjects, but there are few papers that look at this behavior in female subjects. Moreover, it is unknown where there might be sex-related variation in how flexible sign-tracking is when faced with changing reward values. Therefore, we asked if there were sex differences in the acquisition of sign-tracking behavior and if there were any sex differences in how sensitive animals were in their sign-tracking following reward devaluation. In contrast to previous reports, we found that males and females show no differences in how they acquire sign-tracking and in ultimate sign-tracking levels following training. Additionally, we found no difference in how quickly males and females learned to devalue the food reward, and we found no differences in sign-tracking levels by sex following outcome devaluation. We believe that this is primarily due to our experiment being performed in the Long Evans strain but also believe that there are many other factors contributing to differences between our study and previous work.

Separating desire from prediction of outcome value

Individuals typically want what they expect to like, often based on memories of previous positive experiences. However, in some situations desire can decouple completely from memories and from learned predictions of outcome value. The potential for desire to separate from prediction arises from independent operating rules that control motivational incentive salience. Incentive salience, or 'wanting', is a type of mesolimbic desire that evolved for adaptive goals, but can also generate maladaptive addictions. Two proof-of-principle examples are presented here to show how motivational 'wanting' can soar above memory-based predictions of outcome value: (i) 'wanting what is remembered to be disgusting', and (ii) 'wanting what is predicted to hurt'. Consequently, even outcomes remembered and predicted to be negatively aversive can become positively 'wanted'. Similarly, in human addictions, people may experience powerful cue-triggered cravings for outcomes that are not predicted to be enjoyable.

Effects of predictive and incentive value manipulation on sign- and goal-tracking behavior

When a neutral stimulus is repeatedly paired with an appetitive reward, two different types of conditioned approach responses may develop: a sign-tracking response directed toward the neutral cue, or a goal-tracking response directed toward the location of impending reward delivery. Sign-tracking responses have been postulated to result from attribution of incentive value to conditioned cues, while goal-tracking reflects the assignment of only predictive value to the cue. We therefore hypothesized that sign-tracking rats would be more sensitive to manipulations of incentive value, while goal-tracking rats would be more responsive to changes in the predictive value of the cue. We tested sign- and goal-tracking before and after devaluation of a food reward using lithium chloride, and tested whether either response could be learned under negative contingency conditions that precluded any serendipitous reinforcement of the behavior that might support instrumental learning. We also tested the effects of blocking the predictive value of a cue using simultaneous presentation of a pre-conditioned cue. We found that sign-tracking was sensitive to outcome devaluation, while goal-tracking was not. We also confirmed that both responses are Pavlovian because they can be learned under negative contingency conditions. Goal-tracking was almost completely blocked by a pre-conditioned cue, while sign-tracking was much less sensitive to such interference. These results indicate that sign- and goal-tracking may follow different rules of reinforcement learning and suggest a need to revise current models of associative learning to account for these differences.

Nucleus accumbens core acetylcholine receptors modulate the balance of flexible and inflexible cue-directed motivation

Sign-tracking is a conditioned response where animals interact with reward-predictive cues due to the cues having motivational value, or incentive salience. The nucleus accumbens core (NAc) has been implicated in mediating the sign-tracking response. Additionally, acetylcholine (ACh) transmission throughout the striatum has been attributed to both incentive motivation and behavioral flexibility. Here, we demonstrate a role for NAc ACh receptors in the flexibility of sign-tracking. Sign-tracking animals were exposed to an omission contingency, in which vigorous sign-tracking was punished by reward omission. Animals rapidly adjusted their behavior, but they maintained sign-tracking in a less vigorous manner that did not cancel reward. Within this context of sign-tracking being persistent yet flexible in structure, blockade of NAc nicotinic receptors (nAChRs) led to a persistence in the initial sign-tracking response during omission followed by a period of change in the makeup of sign-tracking, whereas blockade of muscarinic receptors (mAChRs) oppositely enhanced the omission-related development of the new sign-tracking behaviors. Later, once omission learning had occurred, nAChR blockade uniquely led to reduced sign-tracking and elevated reward-directed behaviors instead. These results indicate that NAc ACh receptors have opposing roles in maintaining learned patterns of sign-tracking, with nAChRs having a special involvement in regulating the structure of the sign-tracking response.

Attentional bias for high-calorie food cues by the level of hunger and satiety in individuals with binge eating behaviors

Introduction

The abnormal hyperreactivity to food cues in individuals with binge eating behaviors could be regulated by hedonic or reward-based system, overriding the homeostatic system. The aim of the present study was to investigate whether attentional bias for food cues is affected by the level of hunger, maintaining the normal homeostatic system in individuals with binge eating behaviors.

Methods

A total of 116 female participants were recruited and divided into four groups: hungry-binge eating group (BE) (n = 29), satiated BE (n = 29), hungry-control (n = 29), satiated control (n = 29). While participants completed a free-viewing task on high or low-calorie food cues, visual attentional processes were recorded using an eye tracker.

Results

The results revealed that BE group showed longer initial fixation duration toward high-calorie food cues in both hunger and satiety condition in the early stage, whereas the control group showed longer initial fixation duration toward high-calorie food cues only in hunger conditions. Moreover, in the late stage, the BE group stared more at the high-calorie food cue, compared to control group regardless of hunger and satiety.

Discussion

The findings suggest that automatic attentional bias for food cues in individuals with binge eating behaviors occurred without purpose or awareness is not affected by the homeostatic system, while strategic attention is focused on high-calorie food. Therefore, the attentional processing of food cues in binge eating group is regulated by hedonic system rather than homeostatic system, leading to vulnerability to binge eating.

Neural substrates of parallel devaluation-sensitive and devaluation-insensitive Pavlovian learning in humans

Pavlovian learning depends on multiple and parallel associations leading to distinct classes of conditioned responses that vary in their flexibility following changes in the value of an associated outcome. Here, we aimed to differentiate brain areas involved in learning and encoding associations that are sensitive to changes in the value of an outcome from those that are not sensitive to such changes. To address this question, we combined a Pavlovian learning task with outcome devaluation, eye-tracking and functional magnetic resonance imaging. We used computational modeling to identify brain regions involved in learning stimulus-reward associations and stimulus-stimulus associations, by testing for brain areas correlating with reward-prediction errors and state-prediction errors, respectively. We found that, contrary to theoretical predictions about reward prediction errors being exclusively model-free, voxels correlating with reward prediction errors in the ventral striatum and subgenual anterior cingulate cortex were sensitive to devaluation. On the other hand, brain areas correlating with state prediction errors were found to be devaluation insensitive. In a supplementary analysis, we distinguished brain regions encoding predictions about outcome taste identity from those involved in encoding predictions about its expected spatial location. A subset of regions involved in taste identity predictions were devaluation sensitive while those involved in encoding predictions about spatial location were devaluation insensitive. These findings provide insights into the role of multiple associative mechanisms in the brain in mediating Pavlovian conditioned behavior - illustrating how distinct neural pathways can in parallel produce both devaluation sensitive and devaluation insensitive behaviors.

Sodium Intake and Disease: Another Relationship to Consider

Sodium (Na+) is crucial for numerous homeostatic processes in the body and, consequentially, its levels are tightly regulated by multiple organ systems. Sodium is acquired from the diet, commonly in the form of NaCl (table salt), and substances that contain sodium taste salty and are innately palatable at concentrations that are advantageous to physiological homeostasis. The importance of sodium homeostasis is reflected by sodium appetite, an "all-hands-on-deck" response involving the brain, multiple peripheral organ systems, and endocrine factors, to increase sodium intake and replenish sodium levels in times of depletion. Visceral sensory information and endocrine signals are integrated by the brain to regulate sodium intake. Dysregulation of the systems involved can lead to sodium overconsumption, which numerous studies have considered causal for the development of diseases, such as hypertension. The purpose here is to consider the inverse-how disease impacts sodium intake, with a focus on stress-related and cardiometabolic diseases. Our proposition is that such diseases contribute to an increase in sodium intake, potentially eliciting a vicious cycle toward disease exacerbation. First, we describe the mechanism(s) that regulate each of these processes independently. Then, we highlight the points of overlap and integration of these processes. We propose that the analogous neural circuitry involved in regulating sodium intake and blood pressure, at least in part, underlies the reciprocal relationship between neural control of these functions. Finally, we conclude with a discussion on how stress-related and cardiometabolic diseases influence these circuitries to alter the consumption of sodium.

Reward-Mediated, Model-Free Reinforcement-Learning Mechanisms in Pavlovian and Instrumental Tasks Are Related

Model-free and model-based computations are argued to distinctly update action values that guide decision-making processes. It is not known, however, if these model-free and model-based reinforcement learning mechanisms recruited in operationally based instrumental tasks parallel those engaged by pavlovian-based behavioral procedures. Recently, computational work has suggested that individual differences in the attribution of incentive salience to reward predictive cues, that is, sign- and goal-tracking behaviors, are also governed by variations in model-free and model-based value representations that guide behavior. Moreover, it is not appreciated if these systems that are characterized computationally using model-free and model-based algorithms are conserved across tasks for individual animals. In the current study, we used a within-subject design to assess sign-tracking and goal-tracking behaviors using a pavlovian conditioned approach task and then characterized behavior using an instrumental multistage decision-making (MSDM) task in male rats. We hypothesized that both pavlovian and instrumental learning processes may be driven by common reinforcement-learning mechanisms. Our data confirm that sign-tracking behavior was associated with greater reward-mediated, model-free reinforcement learning and that it was also linked to model-free reinforcement learning in the MSDM task. Computational analyses revealed that pavlovian model-free updating was correlated with model-free reinforcement learning in the MSDM task. These data provide key insights into the computational mechanisms mediating associative learning that could have important implications for normal and abnormal states.SIGNIFICANCE STATEMENT Model-free and model-based computations that guide instrumental decision-making processes may also be recruited in pavlovian-based behavioral procedures. Here, we used a within-subject design to test the hypothesis that both pavlovian and instrumental learning processes were driven by common reinforcement-learning mechanisms. Sign-tracking and goal-tracking behaviors were assessed in rats using a pavlovian conditioned approach task, and then instrumental behavior was characterized using an MSDM task. We report that sign-tracking behavior was associated with greater model-free, but not model-based, learning in the MSDM task. These data suggest that pavlovian and instrumental behaviors may be driven by conserved reinforcement-learning mechanisms.

Humans have a basic physical and psychological need to move the body: Physical activity as a primary drive

Physical activity, while less necessary for survival in modern times, is still essential for thriving in life, and low levels of movement are related to numerous physical and mental health problems. However, we poorly understand why people move on a day-to-day basis and how to promote greater energy expenditure. Recently, there has been a turn to understand automatic processes with close examination of older theories of behavior. This has co-occurred with new developments in the study of non-exercise activity thermogenesis (NEAT). In this narrative review, it is hypothesized that psycho-physiological drive is important to understand movement in general and NEAT, specifically. Drive, in short, is a motivation state, characterized by arousal and felt tension, energizing the organism to acquire a basic need. Movement is a biological necessity, like food, water, and sleep, but varies across the lifespan and having the greatest impact before adolescence. Movement meets various criteria for a primary drive: (a) deprivation of it produces feelings of tension, such as an urge or craving, known as affectively-charged motivation states, and particularly the feelings of being antsy, restless, hyper or cooped up, (b) provision of the need quickly reduces tension - one can be satiated, and may even over-consume, (c) it can be provoked by qualities of the environment, (d) it is under homeostatic control, (e) there is an appetite (i.e., appetence) for movement but also aversion, and (f) it has a developmental time course. Evidence for drive has mainly come from children and populations with hyperkinetic disorders, such as those with anorexia nervosa, restless legs syndrome, and akathisia. It is also stimulated in conditions of deprivation, such as bed rest, quarantine, long flights, and physical restraint. It seems to be lacking in the hypokinetic disorders, such as depression and Parkinson's. Thus, drive is associated with displeasure and negative reinforcement, subsuming it within the theory of hedonic drive, but it may fit better within new paradigms, such as the WANT model (Wants and Aversions for Neuromuscular Tasks). Recently developed measurement tools, such as the CRAVE scale, may permit the earnest investigation of movement drive, satiation, and motivation states in humans.

The positive valence system, adaptive behaviour and the origins of reward

Although the hey-day of motivation as an area of study is long past, the issues with which motivational theorists grappled have not grown less important: i.e. the development of deterministic explanations for the particular tuning of the nervous system to specific changes in the internal and external environment and the organisation of adaptive behavioural responses to those changes. Here, we briefly elaborate these issues in describing the structure and function of the 'positive valence system'. We describe the origins of adaptive behaviour in an ascending arousal system, sensitive to peripheral regulatory changes, that modulates and activates various central motivational states. Associations between these motivational states and sensory inputs underlie evaluative conditioning and generate the representation of the 'unconditioned' stimuli fundamental to Pavlovian conditioning. As a consequence, associations with these stimuli can generate Pavlovian conditioned responses through the motivational control of stimulus event associations with sensory and affective components of the valence system to elicit conditioned orienting, consummatory and preparatory responses, particularly the affective responses reflecting Pavlovian excitation and inhibition, arousal and reinforcement, the latter used to control the formation of habits. These affective processes also provoke emotional responses, allowing the externalisation of positive valence in hedonic experience to generate the goal or reward values that mediate goal-directed action. Together these processes form the positive valence system, ensure the maintenance of adaptive behaviour and, through the association of sensory events and emotional responses through consummatory experience, provide the origins of reward.

Intersubjectivity as an antidote to stress: Using dyadic active inference model of intersubjectivity to predict the efficacy of parenting interventions in reducing stress—through the lens of dependent origination in Buddhist Madhyamaka philosophy

Intersubjectivity refers to one person’s awareness in relation to another person’s awareness. It is key to well-being and human development. From infancy to adulthood, human interactions ceaselessly contribute to the flourishing or impairment of intersubjectivity. In this work, we first describe intersubjectivity as a hallmark of quality dyadic processes. Then, using parent-child relationship as an example, we propose a dyadic active inference model to elucidate an inverse relation between stress and intersubjectivity. We postulate that impaired intersubjectivity is a manifestation of underlying problems of deficient relational benevolence, misattributing another person’s intentions (over-mentalizing), and neglecting the effects of one’s own actions on the other person (under-coupling). These problems can exacerbate stress due to excessive variational free energy in a person’s active inference engine when that person feels threatened and holds on to his/her invalid (mis)beliefs. In support of this dyadic model, we briefly describe relevant neuroimaging literature to elucidate brain networks underlying the effects of an intersubjectivity-oriented parenting intervention on parenting stress. Using the active inference dyadic model, we identified critical interventional strategies necessary to rectify these problems and hereby developed a coding system in reference to these strategies. In a theory-guided quantitative review, we used this coding system to code 35 clinical trials of parenting interventions published between 2016 and 2020, based on PubMed database, to predict their efficacy for reducing parenting stress. The results of this theory-guided analysis corroborated our hypothesis that parenting intervention can effectively reduce parenting stress if the intervention is designed to mitigate the problems of deficient relational benevolence, under-coupling, and over-mentalizing. We integrated our work with several dyadic concepts identified in the literature. Finally, inspired by Arya Nagarjuna’s Buddhist Madhyamaka Philosophy, we described abstract expressions of Dependent Origination as a relational worldview to reflect on the normality, impairment, and rehabilitation of intersubjectivity.

Brain regulation of hunger and motivation: The case for integrating homeostatic and hedonic concepts and its implications for obesity and addiction

Obesity and other eating disorders are marked by dysregulations to brain metabolic, hedonic, motivational, and sensory systems that control food intake. Classic approaches in hunger research have distinguished between hedonic and homeostatic processes, and have mostly treated these systems as independent. Hindbrain structures and a complex network of interconnected hypothalamic nuclei control metabolic processes, energy expenditure, and food intake while mesocorticolimbic structures are though to control hedonic and motivational processes associated with food reward. However, it is becoming increasingly clear that hedonic and homeostatic brain systems do not function in isolation, but rather interact as part of a larger network that regulates food intake. Incentive theories of motivation provide a useful route to explore these interactions. Adapting incentive theories of motivation can enable researchers to better how motivational systems dysfunction during disease. Obesity and addiction are associated with profound alterations to both hedonic and homeostatic brain systems that result in maladaptive patterns of consumption. A subset of individuals with obesity may experience pathological cravings for food due to incentive sensitization of brain systems that generate excessive 'wanting' to eat. Further progress in understanding how the brain regulates hunger and appetite may depend on merging traditional hedonic and homeostatic concepts of food reward and motivation.

Restriction of dietary protein in rats increases progressive-ratio motivation for protein

Low-protein diets can impact food intake and appetite, but it is not known if motivation for food is changed. In the present study, we used an operant behavioral task - the progressive ratio test - to assess whether motivation for different foods was affected when rats were maintained on a protein-restricted diet (REST, 5% protein diet) compared to non-restricted control rats (CON, 18% protein). Rats were tested either with nutritionally-balanced pellets (18.7% protein, Experiment 1) or protein-rich pellets (35% protein, Experiment 2) as reinforcers. Protein restriction increased breakpoint for protein-rich pellets, relative to CON rats, whereas no difference in breakpoint for nutritionally-balanced pellets was observed between groups. When given free access to either nutritionally-balanced pellets or protein-rich pellets, REST and CON rats did not differ in their intake. We also tested whether a previous history of protein restriction might affect present motivation for different types of food by assessing breakpoint of previously REST animals that were subsequently put on standard maintenance chow (protein-repleted rats, REPL, Experiment 2). REPL rats did not show increased breakpoint, relative to their initial encounter with protein-rich pellets while they were protein-restricted. This study demonstrates that restriction of dietary protein induces a selective increased motivation for protein-rich food, a behavior that disappears once rats are not in need of protein.

O-GlcNAcylation in Ventral Tegmental Area Dopaminergic Neurons Regulates Motor Learning and the Response to Natural Reward

Protein O-GlcNAcylation is a post-translational modification that links environmental stimuli with changes in intracellular signal pathways, and its disturbance has been found in neurodegenerative diseases and metabolic disorders. However, its role in the mesolimbic dopamine (DA) system, especially in the ventral tegmental area (VTA), needs to be elucidated. Here, we found that injection of Thiamet G, an O-GlcNAcase (OGA) inhibitor, in the VTA and nucleus accumbens (NAc) of mice, facilitated neuronal O-GlcNAcylation and decreased the operant response to sucrose as well as the latency to fall in rotarod test. Mice with DAergic neuron-specific knockout of O-GlcNAc transferase (OGT) displayed severe metabolic abnormalities and died within 4-8 weeks after birth. Furthermore, mice specifically overexpressing OGT in DAergic neurons in the VTA had learning defects in the operant response to sucrose, and impaired motor learning in the rotarod test. Instead, overexpression of OGT in GABAergic neurons in the VTA had no effect on these behaviors. These results suggest that protein O-GlcNAcylation of DAergic neurons in the VTA plays an important role in regulating the response to natural reward and motor learning in mice.

Modeling incentive salience in Pavlovian learning more parsimoniously using a multiple attribute model

We present a multi-attribute incentive salience (MAIS) model as a computational account of incentive salience in model-based Pavlovian learning. A model of incentive salience as a joint function of reward value and physiological state has been previously proposed by Zhang et al. (2009). In that model, the function takes additive or multiplicative forms depending on whether a preference shifts from positive to negative or vice versa. We demonstrate that arbitrarily varying this function is unnecessary to explain observed data. A multiplicative function is sufficient if one takes into account empirical data suggesting the incentive salience function for an incentive is comprised of multiple physiological signals. We compare our model to the previously proposed model on two datasets. We find the MAIS model predicts the outcomes equally well, fits empirical data describing multiple sensory representations of a single stimulus, better approximates the dual-structure appetitive-aversive nature of the reward system, is compatible with existing knowledge about incentive salience in Pavlovian learning, and better describes revaluation in Pavlovian learning. This model addresses a call (Dayan & Berridge, 2014) for algorithmic and computational models of model-based Pavlovian learning that consistently and fully explain empirical observations. Because a multi-attribute model is relevant even for simple Pavlovian associations, it should be useful in a wide variety of decision-making contexts, including agent modeling and addiction research.

Effort-motivated behavior resolves paradoxes in appetitive conditioning

Motivated behavior has long been studied by psychologists, ethologists, and neuroscientists. To date, many scientists agree with the view that cue and reward attraction is the product of a dopamine-dependent unconscious process called incentive salience or "wanting". This process allows the influence of multiple factors such as hunger and odors on motivational attraction. In some cases, however, the resulting motivated behavior differs from what the incentive salience hypothesis would predict. I argue that seeking behavior under reward uncertainty illustrates this situation: Organisms do not just "want" (appetite-based attraction) cues that are inconsistent or associated with reward occasionally, they "hope" that those cues will consistently predict reward procurement in the ongoing trial. Said otherwise, they become motivated to invest time and energy to find consistent cue-reward associations despite no guarantee of success (effort-based attraction). A multi-test comparison of performance between individuals trained under uncertainty and certainty reveals behavioral paradoxes suggesting that the concept of incentive salience cannot fully account for responding to inconsistent cues. A mathematical model explains how appetite-based and effort-based attractions might combine their effects.

Smoke signals: A study of the neurophysiological reaction of smokers and non-smokers to smoking cues inserted into antismoking public service announcements

Tobacco addiction is one of the biggest health emergencies in the world, Antismoking Public Service Announcements (PSAs) represent the main public tool against smoking; however, smoking-related cues (SCs) often included in PSAs can trigger ambiguous cerebral reactions that could impact the persuasiveness and efficacy of the antismoking message. This study aimed to investigate the electroencephalographic (EEG) response in adult smokers and non-smokers during the exposure to SCs presented in antismoking PSAs video, in order to identify eventual neurophysiological features of SCs' 'boomerang effect' elicited in smokers. EEG frontal Alpha asymmetry and frontal Theta were analyzed in 92 adults (30 no smokers, 31 low smokers, 31 high smokers) from EEG recorded during the vision of 3 antismoking PSAs, statistical analysis was conducted using ANOVA. Main results showed a significant interaction between smoking cue condition (Pre and Post) and smoking habit (in particular for female heavy smokers) for the frontal Alpha asymmetry. Since the relative higher right frontal Alpha activity is associated with approach towards a stimulus, it is suggested that the relative left frontal Alpha increase in response to SCs might reflect an appetitive approach in response to it. In the light of the Incentive Sensitization Theory, this pattern can be interpreted as a neurophysiological signal in response to SCs that could undermine the message's effectiveness contributing to the maintenance of the addiction.

Protein Appetite Drives Macronutrient-Related Differences in Ventral Tegmental Area Neural Activity

Control of protein intake is essential for numerous biological processes as several amino acids cannot be synthesized de novo, however, its neurobiological substrates are still poorly understood. In the present study, we combined in vivo fiber photometry with nutrient-conditioned flavor in a rat model of protein appetite to record neuronal activity in the VTA, a central brain region for the control of food-related processes. In adult male rats, protein restriction increased preference for casein (protein) over maltodextrin (carbohydrate). Moreover, protein consumption was associated with a greater VTA response, relative to carbohydrate. After initial nutrient preference, a switch from a normal balanced diet to protein restriction induced rapid development of protein preference but required extensive exposure to macronutrient solutions to induce elevated VTA responses to casein. Furthermore, prior protein restriction induced long-lasting food preference and VTA responses. This study reveals that VTA circuits are involved in protein appetite in times of need, a crucial process for animals to acquire an adequate amount of protein in their diet.SIGNIFICANCE STATEMENT Acquiring insufficient protein in one's diet has severe consequences for health and ultimately will lead to death. In addition, a low level of dietary protein has been proposed as a driver of obesity as it can leverage up intake of fat and carbohydrate. However, much remains unknown about the role of the brain in ensuring adequate intake of protein. Here, we show that in a state of protein restriction a key node in brain reward circuitry, the VTA, is activated more strongly during consumption of protein than carbohydrate. Moreover, although rats' behavior changed to reflect new protein status, patterns of neural activity were more persistent and only loosely linked to protein status.

Value, drug addiction and the brain

Over the years, various models have been proposed to explain the psychology and biology of drug addiction, built primarily around the habit and compulsion models. Recent research indicates drug addiction may be goal-directed, motivated by excessive valuation of drugs. Drug consumption may initially occur for the sake of pleasure but may transition to a means of escaping withdrawal, stress and negative emotions. In this hypothetical paper, we propose a value-based neurobiological model for drug addiction. We posit that during dependency, the value-based decision-making system in the brain is not inactive but has instead prioritized drugs as the reward of choice. In support of this model, we consider the role of valuation in choice, its influence on pleasure and punishment, and how valuation is contrasted in impulsive and compulsive behaviours. We then discuss the neurobiology of value, beginning with the dopaminergic system and its relationship with incentive salience before moving to brain-wide networks involved in valuation, control and prospection. These value-based neurobiological components are then integrated into the cycle of addiction as we consider the development of drug dependency from a valuation perspective. We conclude with a discussion of cognitive interventions utilizing value-based decision-making, highlighting not just advances in recalibrating the valuation system to focus on non-drug rewards, but also areas for improvement in refining this approach.

Endogenous variation in ventromedial prefrontal cortex state dynamics during naturalistic viewing reflects affective experience

How we process ongoing experiences is shaped by our personal history, current needs, and future goals. Consequently, ventromedial prefrontal cortex (vmPFC) activity involved in processing these subjective appraisals appears to be highly idiosyncratic across individuals. To elucidate the role of the vmPFC in processing our ongoing experiences, we developed a computational framework and analysis pipeline to characterize the spatiotemporal dynamics of individual vmPFC responses as participants viewed a 45-minute television drama. Through a combination of functional magnetic resonance imaging, facial expression tracking, and self-reported emotional experiences across four studies, our data suggest that the vmPFC slowly transitions through a series of discretized states that broadly map onto affective experiences. Although these transitions typically occur at idiosyncratic times across people, participants exhibited a marked increase in state alignment during high affectively valenced events in the show. Our work suggests that the vmPFC ascribes affective meaning to our ongoing experiences.

Positive Affect: Nature and brain bases of liking and wanting

The positive affect of rewards is an important contributor to well-being. Reward involves components of pleasure 'liking', motivation 'wanting', and learning. 'Liking' refers to the hedonic impact of positive events, with underlying mechanisms that include hedonic hotspots in limbic brain structures that amplify 'liking' reactions. 'Wanting' refers to incentive salience, a motivational process that makes reward cues attractive and able to trigger craving for their reward, mediated by larger dopamine-related mesocorticolimbic networks. Under normal conditions, 'liking' and 'wanting' cohere. However, 'liking' and 'wanting' can be dissociated by alterations in neural signaling, either induced in animal neuroscience laboratories or arising spontaneously in addictions and other affective disorders, which can be detrimental to positive well-being.

A new GABAergic somatostatin projection from the BNST onto accumbal parvalbumin neurons controls anxiety

The prevailing view is that parvalbumin (PV) interneurons play modulatory roles in emotional response through local medium spiny projection neurons (MSNs). Here, we show that PV activity within the nucleus accumbens shell (sNAc) is required for producing anxiety-like avoidance when mice are under anxiogenic situations. Firing rates of sNAc^PV neurons were negatively correlated to exploration time in open arms (threatening environment). In addition, sNAc^PV neurons exhibited high excitability in a chronic stress mouse model, which generated excessive maladaptive avoidance behavior in an anxiogenic context. We also discovered a novel GABAergic pathway from the anterior dorsal bed nuclei of stria terminalis (adBNST) to sNAc^PV neurons. Optogenetic activation of these afferent terminals in sNAc produced an anxiolytic effect via GABA transmission. Next, we further demonstrated that chronic stressors attenuated the inhibitory synaptic transmission at adBNST^GABA → sNAc^PV synapses, which in turn explains the hyperexcitability of sNAc PV neurons on stressed models. Therefore, activation of these GABAergic afferents in sNAc rescued the excessive avoidance behavior related to an anxious state. Finally, we identified that the majority GABAergic input neurons, which innervate sNAc^PV cells, were expressing somatostatin (SOM), and also revealed that coordination between SOM- and PV- cells functioning in the BNST → NAc circuit has an inhibitory influence on anxiety-like responses. Our findings provide a potentially neurobiological basis for therapeutic interventions in pathological anxiety.

Les addictions sous l’angle neurocognitif

Les principaux modèles neurocognitifs conçoivent l’addiction comme le résultat d’un déséquilibre de trois systèmes cérébraux en constante interaction : un circuit striatoamygdalien qui favorise les comportements automatiques, habituels et saillants, le cortex préfrontal impliqué dans la prise de décision et dans le contrôle inhibiteur. Enfin, la région insulaire permet un traitement proprioceptif à l’origine d’états émotionnels conscients, ce qui exerce une influence sur la prise de décision. L’influence du stress ainsi que les perspectives cliniques sont discutées.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Evaluation of an angiotensin Type 1 receptor blocker on the reconsolidation of fear memory

Inhibition of the angiotensin type 1 receptor (AT₁R) has been shown to decrease fear responses in both humans and rodents. These effects are attributed to modulation of extinction learning, however the contribution of AT₁R to alternative memory processes remains unclear. Using classic Pavlovian conditioning combined with radiotelemetry and whole-genome RNA sequencing, we evaluated the effects of the AT₁R antagonist losartan on fear memory reconsolidation. Following the retrieval of conditioned auditory fear memory, animals were given a single intraperitoneal injection of losartan or saline. In response to the conditioned stimulus (CS), losartan-treated animals exhibited significantly less freezing at 24 h and 1 week; an effect that was dependent upon memory reactivation and independent of conditioned cardiovascular reactivity. Using an unbiased whole-genome RNA sequencing approach, transcriptomic analysis of the basolateral amygdala (BLA) identified losartan-dependent differences in gene expression during the reconsolidation phase. These findings demonstrate that post-retrieval losartan modifies behavioral and transcriptomic markers of conditioned fear memory, supporting an important regulatory role for this receptor in reconsolidation and as a potential pharmacotherapeutic target for maladaptive fear disorders such as PTSD.

Molecular Mechanisms of Reconsolidation-Dependent Memory Updating

Memory is not a stable record of experience, but instead is an ongoing process that allows existing memories to be modified with new information through a reconsolidation-dependent updating process. For a previously stable memory to be updated, the memory must first become labile through a process called destabilization. Destabilization is a protein degradation-dependent process that occurs when new information is presented. Following destabilization, a memory becomes stable again through a protein synthesis-dependent process called restabilization. Much work remains to fully characterize the mechanisms that underlie both destabilization and subsequent restabilization, however. In this article, we briefly review the discovery of reconsolidation as a potential mechanism for memory updating. We then discuss the behavioral paradigms that have been used to identify the molecular mechanisms of reconsolidation-dependent memory updating. Finally, we outline what is known about the molecular mechanisms that support the memory updating process. Understanding the molecular mechanisms underlying reconsolidation-dependent memory updating is an important step toward leveraging this process in a therapeutic setting to modify maladaptive memories and to improve memory when it fails.

Intersubject representational similarity analysis reveals individual variations in affective experience when watching erotic movies

We spend much of our lives pursuing or avoiding affective experiences. However, surprisingly little is known about how these experiences are represented in the brain and if they are shared across individuals. Here, we explored variations in the construction of an affective experience during a naturalistic viewing paradigm based on subjective preferences in sociosexual desire and self-control using intersubject representational similarity analysis (IS-RSA). We found that when watching erotic movies, intersubject variations in sociosexual desire preferences of 26 heterosexual males were associated with similarly structured fluctuations in the cortico-striatal reward, default mode, and mentalizing networks. In contrast, variations in the self-control preferences were associated with shared dynamics in the fronto-parietal executive control and cingulo-insular salience networks. Importantly, these results were specific to the affective experience, as we did not observe any relationship with variation in preferences when individuals watched neutral movies. Moreover, these results appear to require multivariate representations of preferences as we did not observe any significant associations using single scalar summary scores. Our findings indicate that multidimensional variations in individual preferences can be used to uncover unique dimensions of an affective experience, and that IS-RSA can provide new insights into the neural processes underlying psychological experiences elicited through naturalistic experimental designs.

Habitual Behavior Is Goal-Driven

We address the relation between goal-driven and habitual behaviors. Whereas in recent years the two have been juxtaposed, we suggest that habitual behavior is in fact goal-driven. To support this view, we show that habitual behavior is sensitive to changes in goal properties (reward contingencies), namely goal value and its expectancy of attainment. Whereas adjustment to these properties may be slower for habitual (or overlearned) than for nonhabitual behavior, this is likely due to the routinized (or automatic) nature of such behavior, characterized as it is by reduced attention to its consequences. Furthermore, we show that habitual behavior’s prolonged persistence despite its manifest detachment from the original goal likely stems from its attachment to a different goal. Thus, there is no need to postulate purposeless behavior. The view that habitual behavior is goal-driven offers an integrative account of a considerable body of evidence and is consistent with a functional account of psychological processes.

Salt need needs investigation

Expensive and extensive studies on the epidemiology of excessive Na intake and its pathology have been conducted over four decades. The resultant consensus that dietary Na is toxic, as well as the contention that it is less so, ignores the root cause of the attractiveness of salted food. The extant hypotheses are that most Na is infiltrated into our bodies via heavily salted industrialised food without our knowledge and that mere exposure early in life determines lifelong intake. However, these hypotheses are poorly evidenced and are meagre explanations for the comparable salt intake of people worldwide despite their markedly different diets. The love of salt begins at birth for some, vacillates in infancy, climaxes during adolescent growth, settles into separate patterns for men and women in adulthood and, with age, fades for some and persists for others. Salt adds flavour to food. It sustains and protects humans in exertion, may modulate their mood and contributes to their ailments. It may have as yet unknown benefits that may promote its delectability, and it generates controversy. An understanding of the predilection for salt should allow a more evidence-based and effective reduction of the health risks associated with Na surfeit and deficiency. The purpose of this brief review is to show the need for research into the determinants of salt intake by summarising the little we know.

The central amygdala recruits mesocorticolimbic circuitry for pursuit of reward or pain

How do brain mechanisms create maladaptive attractions? Here intense maladaptive attractions are created in laboratory rats by pairing optogenetic channelrhodopsin (ChR2) stimulation of central nucleus of amygdala (CeA) in rats with encountering either sucrose, cocaine, or a painful shock-delivering object. We find that pairings make the respective rats pursue either sucrose exclusively, or cocaine exclusively, or repeatedly self-inflict shocks. CeA-induced maladaptive attractions, even to the painful shock-rod, recruit mesocorticolimbic incentive-related circuitry. Shock-associated cues also gain positive incentive value and are pursued. Yet the motivational effects of paired CeA stimulation can be reversed to negative valence in a Pavlovian fear learning situation, where CeA ChR2 pairing increases defensive reactions. Finally, CeA ChR2 valence can be switched to neutral by pairing with innocuous stimuli. These results reveal valence plasticity and multiple modes for motivation via mesocorticolimbic circuitry under the control of CeA activation.

Sign-tracking behavior is sensitive to outcome devaluation in a devaluation context-dependent manner: implications for analyzing habitual behavior

Motivationally attractive cues can draw in behavior in a phenomenon termed incentive salience. Incentive cue attraction is an important model for animal models of drug seeking and relapse. One question of interest is the extent to which the pursuit of motivationally attractive cues is related to the value of the paired outcome or can become unrelated and habitual. We studied this question using a sign-tracking (ST) paradigm in rats, in which a lever stimulus preceding food reward comes to elicit conditioned lever-interaction behavior. We asked whether reinforcer devaluation by means of conditioned taste aversion, a classic test of habitual behavior, can modify ST to incentive cues, and whether this depends upon the manner in which reinforcer devaluation takes place. In contrast to several recent reports, we conclude that ST is indeed sensitive to reinforcer devaluation. However, this effect depends critically upon the congruence between the context in which taste aversion is learned and the context in which it is tested. When the taste aversion successfully transfers to the testing context, outcome value strongly influences ST behavior, both when the outcome is withheld (in extinction) and when animals can learn from outcome feedback (reacquisition). When taste aversion does not transfer to the testing context, ST remains high. In total, the extent to which ST persists after outcome devaluation is closely related to the extent to which that outcome is truly devalued in the task context. We believe this effect of context on devaluation can reconcile contradictory findings about the flexibility/inflexibility of ST. We discuss this literature and relate our findings to the study of habits generally.

FGF21 and the Physiological Regulation of Macronutrient Preference

The ability to respond to variations in nutritional status depends on regulatory systems that monitor nutrient intake and adaptively alter metabolism and feeding behavior during nutrient restriction. There is ample evidence that the restriction of water, sodium, or energy intake triggers adaptive responses that conserve existing nutrient stores and promote the ingestion of the missing nutrient, and that these homeostatic responses are mediated, at least in part, by nutritionally regulated hormones acting within the brain. This review highlights recent research that suggests that the metabolic hormone fibroblast growth factor 21 (FGF21) acts on the brain to homeostatically alter macronutrient preference. Circulating FGF21 levels are robustly increased by diets that are high in carbohydrate but low in protein, and exogenous FGF21 treatment reduces the consumption of sweet foods and alcohol while alternatively increasing the consumption of protein. In addition, while control mice adaptively shift macronutrient preference and increase protein intake in response to dietary protein restriction, mice that lack either FGF21 or FGF21 signaling in the brain fail to exhibit this homeostatic response. FGF21 therefore mediates a unique physiological niche, coordinating adaptive shifts in macronutrient preference that serve to maintain protein intake in the face of dietary protein restriction.

Food Reward and Food Choice. An Inquiry Through The Liking and Wanting Model

What if consumers are getting obese because eating less calories is more difficult for persons that have a higher pleasure and desire towards food (Ikeda et al., 2005) and food companies do not help given only a two extreme option choice to satisfy their needs (i.e., low calories vs. high calories or healthy vs. unhealthy)? Reward systems are being described with a new conceptual approach where liking—the pleasure derived from eating a given food—and wanting—motivational value, desire, or craving—can be seen as the significant forces guiding eating behavior. Our work shows that pleasure (liking), desire (wanting), and the interaction between them influence and are good predictors of food choice and food intake. Reward responses to food are closely linked to food choice, inducing to caloric overconsumption. Based on the responses given to a self-administered questionnaire measuring liking and wanting attitudes, we found three different segments named ‘Reward lovers,’ ‘Half epicurious,’ and ‘Non indulgents’. Their behavior when choosing food is quite different. Results show differential effects on caloric consumption depending on segments. The introduction of more food choices that try to balance their content is a win-win strategy for consumers, companies, and society.

Associative structure of conditioned inhibition produced by inhibitory perceptual learning treatment

Exposure to a set of complex stimuli yields an enhanced ability to discriminate between these stimuli. In previous experimental studies, two distinguishable stimuli, X and A, were each repeatedly paired with a common Stimulus B to create compound Stimuli XB and AB. Prior evidence suggests that unique Features X and A form mutually inhibitory associations. This was evidenced by pairing Feature A with a biologically relevant stimulus (i.e., an unconditioned stimulus [US]) and observing that Stimulus X alone later serves to inhibit anticipatory behaviors for that US. These observations may reflect the mutually inhibitory nature of the two Features X and A. However, by assessing the influence of X on behavior that anticipates the US rather than Feature A, these experiments tested inhibition only indirectly. In the present experiments, a more direct measure of inhibition is proposed and tested with rats. We found evidence of retardation and negative summation of associations between unique Features X and A in their capacity to serve as competing cues during overshadowing treatments. Stimulus X was less susceptible to overshadowing by A (which is indicative of retardation of the establishment of an X-A within-compound association) and was able to suppress overshadowing by A of another stimulus (Y) when X was presented with Y at test (which is indicative of negative summation of the representation of A by X). Thus, XB/AB trials were seen to establish an inhibitory relationship between X and A.

Affective valence in the brain: modules or modes?

How do brain systems evaluate the affective valence of a stimulus - that is, its quality of being good or bad? One possibility is that a neural subsystem, or 'module' (such as a subregion of the brain, a projection pathway, a neuronal population or an individual neuron), is permanently dedicated to mediate only one affective function, or at least only one specific valence - an idea that is termed here the 'affective modules' hypothesis. An alternative possibility is that a given neural module can exist in multiple neurobiological states that give it different affective functions - an idea termed here the 'affective modes' hypothesis. This suggests that the affective function or valence mediated by a neural module need not remain permanently stable but rather can change dynamically across different situations. An evaluation of evidence for the 'affective modules' versus 'affective modes' hypotheses may be useful for advancing understanding of the affective organization of limbic circuitry.