Fractionating choice: A study on reward discrimination, preference, and relative valuation in the rat (Rattus norvegicus)

Altered reward sensitivity to sucrose outcomes prior to drug exposure in alcohol preferring rats

Addiction involves key impairments in reward sensitivity (RS). The current study explored impaired RS to natural reward as a predisposing factor to addictive-like behavior. Alcohol preferring (P) rats are selectively bred based on significantly greater ethanol consumption and preference and offer the ability to inspect differences in subjects with a positive family history of addictive-like behavior. P rat's RS was compared to RS in the well-used Sprague-Dawley (SD) strain. To assess RS in a novel manner, instrumental incentive contrast, discrimination and consumption of sucrose solution were examined. Animals performed in a free operant situation for different sucrose concentration solutions using a block of 'mixed' trials with alternating outcome concentrations (e.g., 5 and 10 % sucrose) to change outcome value in a predictable manner. Animals also performed for reward in blocks of single outcome trials (5 or 10 or 20 or 40 % sucrose daily exposure) surrounding the mixed block. RS (e.g., reward discrimination and contrast effects between and within-sessions) was measured by changes in trials completed, instrumental response latency and consumption. P rats expressed an altered profile of RS with a greater tendency toward equivalent responding to different outcomes within the same session and an absence of incentive contrast from diverse reward comparisons. In contrast, SD animals expressed within-session reward discrimination and a subset of incentive contrast effects. These effects were moderated by food deprivation more consistently in SD compared to P rats. P rat alterations in processing natural rewards could predispose them to addictive-like behaviors including greater alcohol consumption and preference.

Effort-reward balance and work motivation in rats: Effects of context and order of experience

Being motivated means exerting effort toward a goal. The 'law of least work' emphasizes a preference for exerting relatively less effort. The law crosses boundaries among species and between physical and mental work. Organisms should be highly sensitive to shifts in effort-reward balance (ERB) in order to make optimal choices. We used a free operant-foraging task to investigate changes in ERB on choice between options requiring more or less effort. Results showed a consistent preference for the option with less effort and insensitivity to shifts in ERB. A second aim explored the influence of order of experience on effort choice. Choice for the more effortful option significantly increased after experiencing an equal effort-reward relationship during the initial free operant-foraging session. This relative increase in choice for the effortful option persisted even after effort-reward imbalance. The findings highlight the importance of contextual factors such as order of experience when examining the impact of shifting effort-reward associations. Instead of ignoring or reducing order effects, the sequence of experience (e.g. for shifts in ERB) could be manipulated to enhance or reduce value of outcomes or effort itself.

Translating striatal activity from brain slice to whole animal neurophysiology: A guide for neuroscience research integrating diverse levels of analysis

An important goal of this review is highlighting research in neuroscience as examples of multilevel functional and anatomical analyses addressing basic science issues and applying results to the understanding of diverse disorders. The research of Dr. Michael Levine, a leader in neuroscience, exemplifies this approach by uncovering fundamental properties of basal ganglia function and translating these findings to clinical applications. The review focuses on neurophysiological research connecting results from in vitro and in vivo recordings. A second goal is to utilize these research connections to produce novel, accurate descriptions for corticostriatal processing involved in varied, complex functions. Medium spiny neurons in striatum act as integrators combining input with baseline activity creating motivational "events." Basic research on corticostriatal synapses is described and links developed to issues with clinical relevance such as inhibitory gating, self-injurious behavior, and relative reward valuation. Work is highlighted on dopamine-glutamate interactions. Individual medium spiny neurons express both D₁ and D₂ receptors and encode information in a bivalent manner depending upon the mix of receptors involved. Current work on neurophysiology of reward processing has taken advantage of these basic approaches at the cellular and molecular levels. Future directions in studying physiology of reward processing and action sequencing could profit by incorporating the divergent ways dopamine modulates incoming neurochemical signals. Primary investigators leading research teams should mirror Mike Levine's efforts in "climbing the mountain" of scientific inquiry by performing analyses at different levels of inquiry, integrating the findings, and building comprehensive answers to problems unsolvable without this bold approach.

An investigation of variety effects during operant responding in the rat utilizing different reward flavors

Humans and nonhuman animals respond to food diversity by increasing intake and appetitive behaviors, reflecting enhanced valuation for items presented in the context of variety. Previous work on food variety effects has posited two main explanatory mechanisms. Variety could slow habituation processes by decreasing exposure to a single food item or could elicit contrast effects in which comparisons between items impact relative valuation. This study used three flavors of sucrose rewards to investigate rats' responses to qualitative reward variety in different variety contexts: low (2 flavors) and high (3 flavors) conditions. Control sessions used only a single flavored pellet (no variety). Animals were tested in low (10 trials), moderate (20 trials) and high consumption (30 trials) sessions. A trial within each session was defined as completion of the operant response and acquisition of the reward pellet. Cues associated with flavors were used to examine predictability and between-trial ('micro') variety. Indicators of a variety effect were found including faster responding for rewards during the variety context compared to an initial control (no variety) context. This decrease in response latency continued to be observed for some measures in post-variety control contexts. The most robust statistical finding of variety effects was found using trial-by-trial analysis, with shorter response latencies obtained for trials with outcomes differing from the preceding trial compared to successive trials with identical outcomes. These results have implications for understanding how a general reward context like variety impacts behavior, and for informing clinical approaches focusing on motivation and eating disorders.

A possible social relative reward effect: Influences of outcome inequity between rats during operant responding

Social interactions/situations have dramatic influences on motivation. Creating animal models examining these influences promotes a better understanding of the psychological and biological underpinnings of social motivation. Rodents are sensitive to social history/experience during associative conditioning and food-sharing tasks. Would reward-oriented operant behavior be sensitive to social influences by showing a negative contrast-like effect when another organism obtains a greater value outcome? We used a side-by-side arrangement of operant response chambers wherein one animal obtained consistently high reward signaled by a discrete cue. The neighboring, experimental rat experienced different combinations of high and low reward trial sequences. Control conditions included distraction from a conspecific in the neighboring chamber (rat distractor) or cue/food dispenser operating without a conspecific (program distractor) in addition to testing subjects alone. Results support an influence of the other animal actively performing the task on the experimental subject's behavior. Primarily, responding was significantly slower for the low reward trials while the neighboring rat was receiving the higher magnitude reward. The lever-press and not food-cup retrieval latency was significantly slower during exposure to a conspecific neighbor performing the operant task. The effect was not obtained in all session sequences and was more pronounced using longer series of consecutive low reward trials. The slowing effect was also obtained with the program-distractor experience in a different trial sequence. These findings suggest a social-induced negative incentive contrast effect in rats possibly mediated by an outcome inequity process that could have key similarities to complex situational-affective effects on motivation involving frustration or jealously.

Neural encoding of choice during a delayed response task in primate striatum and orbitofrontal cortex

Reward outcomes are available in many diverse situations and all involve choice. If there are multiple outcomes each rewarding, then decisions regarding relative value lead to choosing one over another. Important factors related to choice context should be encoded and utilized for this form of adaptive choosing. These factors can include the number of alternatives, the pacing of choice behavior and the possibility to reverse one's choice. An essential step in understanding if the context of choice is encoded is to directly compare choice with a context in which choice is absent. Neural activity in orbitofrontal cortex and striatum encodes potential value parameters related to reward quality and quantity as well as relative preference. We examined how neural activations in these brain regions are sensitive to choice situations and potentially involved in a prediction for the upcoming outcome selection. Neural activity was recorded and compared between a two-choice spatial delayed response task and an imperative 'one-option' task. Neural activity was obtained that extended from the instruction cue to the movement similar to previous work utilizing the identical imperative task. Orbitofrontal and striatal neural responses depended upon the decision about the choice of which reward to collect. Moreover, signals to predictive instruction cues that precede choice were selective for the choice situation. These neural responses could reflect chosen value with greater information on relative value of individual options as well as encode choice context itself embedded in the task as a part of the post-decision variable.

The effects of ethanol on diverse components of choice in the rat: reward discrimination, preference and relative valuation

Alcohol consumption impairs judgment and choice. How alcohol alters these crucial processes is primarily unknown. Choice can be fractionated into different components including reward discrimination, preference and relative valuation that can function together or in isolation depending upon diverse factors including choice context. We examined the diverse components and contextual effects by analyzing the effects of alcohol drinking on choice behavior in a task with a reduced level of temporal and spatial constraints. Rats were trained to drink 10% ethanol during 6 weeks of behavior testing using a combined sucrose-fade and two-bottle free-choice procedure. Two different sucrose pellet outcomes (e.g., constant vs. variable) were presented each week to examine the impact of voluntary drinking on reward-based decision-making. Behavioral contexts of single option, free choice and extinction were examined for each outcome set. Comparisons were made between alcohol and control groups and within the alcohol group over time to inspect choice profiles. Between-group results showed alcohol drinking animals expressed altered place preference and modified sucrose reward approach latencies. The within-group profile showed that alcohol drinking animals can express adequate reward discrimination, preference and incentive contrast during free choice. All of these components were significantly reduced during the context of extinction. Control animals were also impacted by extinction but not as severely. The findings point to a need for a greater focus on the context and the diverse components of choice when examining external and internal factors influencing decision-making during alcohol or other substance of abuse exposure.

Effects of anandamide administration on components of reward processing during free choice

Previous research has implicated the positive modulation of anandamide, an endocannabinoid neurotransmitter, on feeding behavior. Anandamide is particularly noteworthy as it acts as an endogenous ligand of the CB1 receptor, the same receptor that is activated by tetrahydrocannabinol, the primary psychoactive component in Cannabis sativa. Cannabis legalization in North America has presented with a need to study endocannabinoid agonists and their effects on behavior. Much has yet to be determined in terms of the role of the endocannabinoid system in decision-making scenarios. The research presented here tested the hypothesis that anandamide would augment motivation and reward processing via appetitive and consummatory measures during an operant, foraging task. A three-box design was used in order to provide the animals with a free choice, exploratory foraging environment. Discrimination, preference, and incentive contrast were analyzed as discrete measures of decision-making in the three-box paradigm. Anandamide administration (1mg/kg) was found to significantly increase motivation for the optimal foraging outcome and alter basic processing of reward information involved in discrimination and relative valuation. The positive effects of anandamide on eating behavior and motivation have implications toward possible treatment modalities for patient populations presenting with disorders of motivation. These findings suggest the need for continued investigation of the endocannabinoid system as a central component of motivated behavior.

Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation

The striatum is a key brain region involved in reward processing. Striatal activity has been linked to encoding reward magnitude and integrating diverse reward outcome information. Recent work has supported the involvement of striatum in the valuation of outcomes. The present work extends this idea by examining striatal activity during dynamic shifts in value that include different levels and directions of magnitude disparity. A novel task was used to produce diverse relative reward effects on a chain of instrumental action. Rats (Rattus norvegicus) were trained to respond to cues associated with specific outcomes varying by food pellet magnitude. Animals were exposed to single-outcome sessions followed by mixed-outcome sessions, and neural activity was compared among identical outcome trials from the different behavioral contexts. Results recording striatal activity show that neural responses to different task elements reflect incentive contrast as well as other relative effects that involve generalization between outcomes or possible influences of outcome variety. The activity that was most prevalent was linked to food consumption and post-food consumption periods. Relative encoding was sensitive to magnitude disparity. A within-session analysis showed strong contrast effects that were dependent upon the outcome received in the immediately preceding trial. Significantly higher numbers of responses were found in ventral striatum linked to relative outcome effects. Our results support the idea that relative value can incorporate diverse relationships, including comparisons from specific individual outcomes to general behavioral contexts. The striatum contains these diverse relative processes, possibly enabling both a higher information yield concerning value shifts and a greater behavioral flexibility.

Effects of striatal lesions on components of choice: Reward discrimination, preference, and relative valuation

The striatum is a key structure involved in reward processing and choice. Recently, we have developed a paradigm to explore how components of reward processing work together or independently during choice behavior. These components include reward discrimination, preference and relative valuation, and the goal of the present study was to determine how the striatum is involved in these dissociable components during this novel free choice paradigm. We tested choice utilizing two different outcome series with one being a more straightforward single-option discrimination anchored by a 0 reward outcome, and the other as a multi-option outcome discrimination of greater difficulty. We compared the free choice reward task to a sequential reward task and an extinction task. Striatal lesions impaired responding only in the free choice version with alterations in both appetitive and consummatory measures. Ventral striatal lesions had greater impact altering discrimination, preference and relative valuation in both the single and multi-option week studies. A major factor involved in these deficits was a significant aversion to the multi-option that contained a larger outcome option but with a longer delay to reward. Dorsal striatal lesions caused less impairment even leading to enhanced choice behavior compared to control animals during the more difficult multi-option free choice series. Overall, the results suggest that the context of action is crucial when linking striatal function to choice behavior and its diverse components. The implications include the idea that striatal involvement in decision-making is increased when responses are self-paced and diverse in a more naturalistic environment.