Effects of Motivational Downshifts on Specific Pavlovian-Instrumental Transfer in Rats

Response-independent outcome presentations dissociate stimulus and value based choice

A stimulus that predicts the delivery of a specific food outcome can bias performance towards instrumental actions that earn that same outcome in a phenomenon known as specific Pavlovian-instrumental transfer (PIT). The precise mechanism by which the specific instrumental action is selected under these circumstances has remained elusive. The present set of experiments explored whether treatments that undermine the response-outcome (R-O) association also affect the expression of specific PIT. Consistent with previous work, in Experiment 1 we showed that specific PIT remains intact after an instrumental degradation treatment that attempted to undermine R-O associations. However, we additionally demonstrated that outcome-devaluation sensitivity also persisted after degradation, suggesting that R-O associations were impervious to the degradation treatment, and precluding any conclusions about the necessity of R-O associations for specific PIT expression. Nevertheless, given the two-lever two-outcome design of this experiment it is possible that R-O associations were indeed undermined by degradation and that the devaluation effect was driven by distinct, incidental Pavlovian lever-outcome associations. To nullify the obscuring effects of these incidental Pavlovian associations, we used a bidirectional lever for instrumental conditioning that could be pushed to the left or the right for distinct outcomes. In Experiment 2 we demonstrated that specific PIT could be observed on this bidirectional manipulandum whether the subjects were hungry or sated, consistent with the literature. The critical third Experiment used an identical design to Experiment 1 except that the two instrumental responses were made on the single bidirectional manipulanda. Here, specific PIT was intact after instrumental degradation and, crucially, we saw no evidence of outcome devaluation sensitivity in these same subjects, suggesting that the R-O associations were weakened or undermined by this treatment. We conclude that the expression of specific PIT is resistant to treatments that undermine R-O associations and disrupt value based choice, and discuss how these findings contribute to our understanding of the associative framework supporting behavioral control.

Category-specific general Pavlovian-instrumental transfer

Modern living is characterized by easy access to highly palatable energy-dense foods. Environmental cues associated with palatable foods increase seeking of those foods (specific transfer) and other palatable foods (general transfer). We conducted a series of studies testing the boundaries of food cue-reactivity by evaluating the impact of broader flavor associations (i.e. saltiness, sweetness) in eliciting general transfer effects. Experiment 1 was an online experiment with fictive rewards that tested if two actions associated with different food rewards (chip and chocolate points) could be provoked by images of other foods that were either similar or distinct in flavor from the foods associated with these instrumental actions. We observed that response excitation was only elicited by similarly flavored food cues, whereas distinctly flavored food cues inhibited response rates relative to control cues. Experiment 2 confirmed this observation in a classroom setting where real food rewards were contingent on task performance. Experiment 3 was an online study that further confirmed the reliability of the effects with a well powered sample. There were moderate-to-strong associations between specific and general transfer effects across all studies, suggesting overlapping cognitive processes are responsible for both transfer effects. These data improve the mechanistic understanding of how broad category associations can moderate the impact of food cues on food choices. This knowledge could be helpful for improving the precision of psychological interventions that seek to mitigate the impact of food cue-reactivity.

Unraveling the influence of Pavlovian cues on decision-making: A pre-registered meta-analysis on Pavlovian-to-instrumental transfer

Amidst the replicability crisis, promoting transparency and rigor in research becomes imperative. The Pavlovian-to-Instrumental Transfer (PIT) paradigm is increasingly used in human studies to offer insights into how Pavlovian cues, by anticipating rewards or punishments, influence decision-making and potentially contribute to the development of clinical conditions. However, research on this topic faces challenges, including methodological variability and the need for standardized approaches, which can undermine the quality and robustness of experimental findings. Hence, we conducted a meta-analysis to unravel the methodological, task-related, individual, training, and learning factors that can modulate PIT. By scrutinizing these factors, the present meta-analysis reviews the current literature on human PIT, provides practical guidelines for future research to enhance study outcomes and refine methodologies, and identifies knowledge gaps that can serve as a direction for future studies aiming to advance the comprehension of how Pavlovian cues shape decision-making.

Ghrelin receptor antagonism and satiety attenuate Pavlovian-instrumental transfer

Animals rely on learned cues to guide their behaviour for rewards such as food. The Pavlovian-instrumental transfer (PIT) task can be used to investigate the influence of Pavlovian stimuli on instrumental responding. Ghrelin, an orexigenic peptide, and its receptor, growth hormone secretagogue receptor 1A (GHS-R1A), has received growing interest for its role in reward-motivated learning and behaviours. A significant population of GHS-R1A have been identified within the ventral tegmental area (VTA), a critical node in the mesolimbic reward circuit that is necessary for the expression of PIT. As ghrelin has been found to increase dopaminergic activity in the VTA, we predicted that GHS-R1A antagonism with JMV-2959 would attenuate PIT. Further, given the relationship between hunger levels and changes in ghrelin signalling, we sought to compare the effects GHS-R1A antagonism with those of satiety, hypothesizing parallel effects, with each attenuating PIT. Rats received daily sessions of Pavlovian and then instrumental training over 3 weeks. Across three experiments, we examined the effects of a shift to satiety, or treatment with the GHS-R1A antagonist JMV-2959, either peripherally or directly into the VTA. We found that presentations of a stimulus paired with food reward enhanced responding for food across all conditions, thus demonstrating the expected PIT effect. Further, GHS-R1A antagonism, both peripherally and within the VTA, as well as satiety significantly reduced the magnitude of the PIT effect compared to control conditions. These results clarify our understanding of ghrelin signalling in PIT and begin to elucidate the role of feeding-related peptides in the modulation of reward-related responding.

High fat diet allows food-predictive stimuli to energize action performance in the absence of hunger, without distorting insulin signaling on accumbal cholinergic interneurons

Obesity can disrupt how food-predictive stimuli control action performance and selection. These two forms of control recruit cholinergic interneurons (CIN) located in the nucleus accumbens core (NAcC) and shell (NAcS), respectively. Given that obesity is associated with insulin resistance in this region, we examined whether interfering with CIN insulin signaling disrupts how food-predictive stimuli control actions. To interfere with insulin signaling we used a high-fat diet (HFD) or genetic excision of insulin receptor (InsR) from cholinergic cells. HFD left intact the capacity of food-predictive stimuli to energize performance of an action earning food when mice were tested hungry. However, it allowed this energizing effect to persist when the mice were tested sated. This persistence was linked to NAcC CIN activity but was not associated with distorted CIN insulin signaling. Accordingly, InsR excision had no effect on how food-predicting stimuli control action performance. Next, we found that neither HFD nor InsR excision altered the capacity of food-predictive stimuli to guide action selection. Yet, this capacity was associated with changes in NAcS CIN activity. These results indicate that insulin signaling on accumbal CIN does not modulate how food-predictive stimuli control action performance and selection. However, they show that HFD allows food-predictive stimuli to energize performance of an action earning food in the absence of hunger.

Diet and obesity effects on cue-driven food-seeking: insights from studies of Pavlovian-instrumental transfer in rodents and humans

Our modern environment is said to be obesogenic, promoting the consumption of calorically dense foods and reducing energy expenditure. One factor thought to drive excess energy intake is the abundance of cues signaling the availability of highly palatable foods. Indeed, these cues exert powerful influences over food-related decision-making. Although obesity is associated with changes to several cognitive domains, the specific role of cues in producing this shift and on decision-making more generally, remains poorly understood. Here we review the literature examining how obesity and palatable diets affect the ability of Pavlovian cues to influence instrumental food-seeking behaviors by examining rodent and human studies incorporating Pavlovian-instrumental transfer (PIT) protocols. There are two types of PIT: (a) general PIT that tests whether cues can energize actions elicited in the pursuit of food generally, and (b) specific PIT which tests whether cues can elicit an action that earns a specific food outcome when faced with a choice. Both types of PIT have been shown to be vulnerable to alterations as a result of changes to diet and obesity. However, effects appear to be driven less by increases in body fat and more by palatable diet exposure per se. We discuss the limitations and implications of the current findings. The challenges for future research are to uncover the mechanisms underlying these alterations to PIT, which appear unrelated to excess weight itself, and to better model the complex determinants of food choice in humans.

Flexible control of Pavlovian-instrumental transfer based on expected reward value

The Pavlovian-instrumental transfer (PIT) paradigm is widely used to assay the motivational influence of reward-predictive cues, reflected by their ability to invigorate instrumental behavior. Leading theories assume that a cue's motivational properties are tied to predicted reward value. We outline an alternative view that recognizes that reward-predictive cues may suppress rather than motivate instrumental behavior under certain conditions, an effect termed positive conditioned suppression. We posit that cues signaling imminent reward delivery tend to inhibit instrumental behavior, which is exploratory by nature, in order to facilitate efficient retrieval of the expected reward. According to this view, the motivation to engage in instrumental behavior during a cue should be inversely related to the value of the predicted reward, since there is more to lose by failing to secure a high-value reward than a low-value reward. We tested this hypothesis in rats using a PIT protocol known to induce positive conditioned suppression. In Experiment 1, cues signaling different reward magnitudes elicited distinct response patterns. Whereas the one-pellet cue increased instrumental behavior, cues signaling three or nine pellets suppressed instrumental behavior and elicited high levels of food-port activity. Experiment 2 found that reward-predictive cues suppressed instrumental behavior and increased food-port activity in a flexible manner that was disrupted by post-training reward devaluation. Further analyses suggest that these findings were not driven by overt competition between the instrumental and food-port responses. We discuss how the PIT task may provide a useful tool for studying cognitive control over cue-motivated behavior in rodents. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Outcome devaluation by specific satiety disrupts sensory-specific Pavlovian-to-instrumental transfer

Reward predictive cues can selectively motivate instrumental behaviors that predict the same rewarding outcomes, an effect known as specific Pavlovian-to-instrumental transfer (PIT). This selective effect is thought to be mediated by a representation of the sensory specific properties of an outcome, that has become associated with both the Pavlovian cue and the instrumental response during initial learning. Specific satiety is a common method of outcome devaluation that reduces an outcome's value but might also lead to the habituation of the outcome's sensory properties. Previous research has demonstrated that specific PIT is insensitive to changes in specific outcome value following taste aversion devaluation, as well as general satiety manipulations, and therefore specific satiety should not disrupt specific PIT by reducing outcome value. The present rodent experiments used a specific satiety devaluation procedure immediately prior to a specific PIT test to show that habituation of these outcome specific sensory representations can disrupt its efficacy as a stimulus and abolish the specific PIT effect. Experiment 1 employed a two-lever choice test to show that a non-devalued stimulus supports specific PIT, whereas a devalued stimulus abolished the specific PIT effect. Experiment 2 replicated this procedure while controlling for response competition by using a single-lever test to confirm that a devalued stimulus abolishes the specific PIT effect. These findings demonstrate that specific satiety can disrupt the ability of an outcome specific representation to support specific PIT. Given previous findings that specific PIT is insensitive to changes in outcome value by general satiety and taste aversion devaluation, this suggests that specific satiety devaluation might disrupt the use of sensory specific outcome representations to guide behavior via a mechanism that is independent of the outcome's current value.

General Pavlovian-to-instrumental transfer in humans: Evidence from Bayesian inference

When repeatedly paired with rewarding outcomes (i.e., Pavlovian conditioning), environmental cues may acquire predictive and motivational significance and later enhance instrumental responding for the same (i.e., outcome-specific transfer) or motivationally similar (i.e., general transfer) outcomes. Although outcome-specific and general Pavlovian-to-Instrumental Transfer (PIT) are characterized by different neural substrates and behavioral mechanisms, general transfer has never been studied in isolation from outcome-specific transfer in humans. The first aim of the present study was to test whether the general transfer effect could emerge in isolation and independently of outcome-specific transfer. Our results showed that general transfer can be elicited without the concurrent presence of outcome-specific transfer, supporting the idea that outcome-specific and general transfer can be studied independently of each other. The second aim of the present study was to clarify whether the affordance-like properties of the outcomes can affect the general transfer. In fact, a critical difference in current studies on general transfer concerns the use of cues associated with outcomes for which an action was previously learned (or not) during the instrumental training. This apparently minor difference affects the affordance-like properties of the outcome and may also be transferred to the cue, in turn impacting general transfer. Results revealed a general transfer of the same magnitude regardless of whether cues were associated with reward earned or not during instrumental conditioning. These findings increase the current knowledge on the incentive motivational mechanism behind general transfer, indicating that it is independent of the motor features of the outcome.

Sensory-Specific Satiety Dissociates General and Specific Pavlovian-Instrumental Transfer

Pavlovian conditioning enables predictive stimuli to control action performance and action selection. The present experiments used sensory-specific satiety to examine the role of outcome value in these two forms of control. Experiment 1 employed a general Pavlovian-instrumental transfer design to show that a stimulus predicting a food outcome energizes the performance of an instrumental action earning another food outcome. This energizing effect was removed when the stimulus-predicted outcome or a novel outcome was devalued by sensory-specific satiety. Experiments 2 and 3 employed a specific Pavlovian-instrumental transfer design to demonstrate that a stimulus predicting a particular food outcome promotes the selection of an instrumental action earning the same, but not a different, food outcome. Remarkably, this effect was maintained when all or just one of the stimulus-predicted outcomes were devalued by sensory-specific satiety. These results indicate that satiety alone removes the expression of general PIT. By contrast, satiety or outcome-specific devaluation does not regulate the expression of specific PIT, which is insensitive to changes in outcome value. This dissociation is consistent with the view that general and specific PIT are two separate phenomena driven by distinct psychological mechanisms.

Persistent effects of acute trauma on Pavlovian-to-instrumental transfer

In humans, an acutely traumatic experience can lead to post-traumatic stress disorder (PTSD), which is often characterized by changes in anxiety and motivation months after trauma. There are few demonstrations of the persistent motivational effects of an acute stressor in rodent approaches to PTSD. In two experiments, we evaluated the persistent effects of a battery of footshocks in one context on appetitive Pavlovian conditioning, instrumental learning, and Pavlovian-to-instrumental transfer (PIT) in a different context. In Experiment 1, a battery of footshocks before appetitive training caused deficits in single-outcome PIT (SO-PIT) in male Long Evans rats. The same battery of footshocks after appetitive training, but before testing had little effect on SO-PIT overall, but there were some deficits in within-stimulus expression of SO-PIT. In Experiment 2, the battery of footshocks had no effect on sensory-specific PIT in male or female rats, but two sex differences emerged: males showed more generalized fear from the aversive to the appetitive context compared to females, and females showed less evidence for sensory-specific PIT compared to males. Males showed robust sensory-specific PIT, with clear extinction and spontaneous recovery of the sensory-specific PIT effect across test sessions. These findings show that (a) an acute trauma can have persistent effects on general motivational processes and (b) in sensory-specific PIT, females may show transfer through generalized motivational processes, whereas males may rely on specific features of the cues and outcomes to augment instrumental responding selectively. We discuss implications for current approaches to stress and motivation in preclinical approaches to PTSD.