Operant sensation seeking engages similar neural substrates to operant drug seeking in C57 mice

Limiting Hearing Loss in Transgenic Mouse Models

Transgenic mice provide unprecedented access to manipulate and visualize neural circuits; however, those on a C57BL/6 background develop progressive hearing loss, significantly confounding systems-level and behavioral analysis. While outbreeding can limit hearing loss, it introduces strain variability and complicates the generation of complex genotypes. Here, we propose an approach to preserve hearing by crossing transgenic mice with congenic B6.CAST-Cdh23Ahl + mice, which maintain low-threshold hearing into adulthood. Widefield and two-photon imaging of the auditory cortex revealed that 2.5-month-old C57BL/6 mice exhibit elevated thresholds to high-frequency tones and widespread cortical reorganization, with most neurons responding best to lower frequencies. In contrast, Ahl+ C57BL/6 mice exhibited robust neural responses across tested frequencies and sound levels (4-64 kHz, 30-90 dB SPL) and retained low thresholds into adulthood. Our approach offers a cost-effective solution for generating complex genotypes and facilitates more interpretable systems neuroscience research by eliminating confounding effects from hearing loss.

Non-motor symptoms associated with progressive loss of dopaminergic neurons in a mouse model of Parkinson's disease

Parkinson's disease (PD) is characterized by three main motor symptoms: bradykinesia, rigidity and tremor. PD is also associated with diverse non-motor symptoms that may develop in parallel or precede motor dysfunctions, ranging from autonomic system dysfunctions and impaired sensory perception to cognitive deficits and depression. Here, we examine the role of the progressive loss of dopaminergic transmission in behaviors related to the non-motor symptoms of PD in a mouse model of the disease (the TIF-IADATCreERT2 strain). We found that in the period from 5 to 12 weeks after the induction of a gradual loss of dopaminergic neurons, mild motor symptoms became detectable, including changes in the distance between paws while standing as well as the swing speed and step sequence. Male mutant mice showed no apparent changes in olfactory acuity, no anhedonia-like behaviors, and normal learning in an instrumental task; however, a pronounced increase in the number of operant responses performed was noted. Similarly, female mice with progressive dopaminergic neuron degeneration showed normal learning in the probabilistic reversal learning task and no loss of sweet-taste preference, but again, a robustly higher number of choices were performed in the task. In both males and females, the higher number of instrumental responses did not affect the accuracy or the fraction of rewarded responses. Taken together, these data reveal discrete, dopamine-dependent non-motor symptoms that emerge in the early stages of dopaminergic neuron degeneration.

Individual variations in motives for nicotine self-administration in male rats: evidence in support for a precision psychopharmacology

The significant heterogeneity in smoking behavior among smokers, coupled with the inconsistent efficacy of approved smoking cessation therapies, supports the presence of individual variations in the mechanisms underlying smoking. This emphasizes the need to shift from standardized to personalized smoking cessation therapies. However, informed precision medicine demands precision fundamental research. Tobacco smoking is influenced and sustained by diverse psychopharmacological interactions between nicotine and environmental stimuli. In the classical experimental rodent model for studying tobacco dependence, namely intravenous self-administration of nicotine, seeking behavior is reinforced by the combined delivery of nicotine and a discrete cue (nicotine+cue). Whether self-administration behavior is driven by the same psychopharmacological mechanisms across individual rats remains unknown and unexplored. To address this, we employed behavioral pharmacology and unbiased cluster analysis to investigate individual differences in the mechanisms supporting classical intravenous nicotine self-administration (0.04 mg/kg/infusion) in male outbred Sprague-Dawley rats. Our analysis identified two clusters: one subset of rats sought nicotine primarily for its reinforcing effects, while the second subset sought nicotine to enhance the reinforcing effects of the discrete cue. Varenicline (1 mg/kg i.p.) reduced seeking behavior in the former group, whereas it tended to increase in the latter group. Crucially, despite this fundamental qualitative difference revealed by behavioral manipulation, the two clusters exhibited quantitatively identical nicotine+cue self-administration behavior. The traditional application of rodent models to study the reinforcing and addictive effects of nicotine may mask individual variability in the underlying motivational mechanisms. Accounting for this variability could significantly enhance the predictive validity of translational research.

The effects of sleep restriction during abstinence on oxycodone seeking: Sex-dependent moderating effects of behavioral and hypothalamic-pituitary-adrenal axis-related phenotypes

During opioid use and abstinence, sleep disturbances are common and are thought to exacerbate drug craving. In this study, we tested the hypothesis that sleep restriction during abstinence from oxycodone self-administration would increase drug seeking during extinction and footshock reinstatement tests. We also performed behavioral phenotyping to determine if individual variation in responses to stressors and/or pain are associated with oxycodone seeking during abstinence, as stress, pain and sleep disturbance are often co-occurring phenomena. Sleep restriction during abstinence did not have selective effects on oxycodone seeking for either sex in extinction and footshock reinstatement tests. Some phenotypes were associated with drug seeking; these associations differed by sex and type of drug seeking assessment. In female rats, pain-related phenotypes were related to high levels of drug seeking during the initial extinction session. In male rats, lower anxiety-like behavior in the open field was associated with greater drug seeking, although this effect was lost when correcting for oxycodone intake. Adrenal sensitivity prior to oxycodone exposure was positively associated with footshock reinstatement in females. This work identifies sex-dependent relationships between HPA axis function and opioid seeking, indicating that HPA axis function could be a therapeutic target for the treatment of opioid use disorder, with tailored approaches based on sex. Sleep disturbance during abstinence did not appear to be a major contributing factor to opioid seeking.

State-dependent modulation of positive and negative affective valences by a parabrachial nucleus-to-ventral tegmental area pathway in mice

Appropriately responding to various sensory signals in the environment is essential for animal survival. Accordingly, animal behaviors are closely related to external and internal states, which include the positive and negative emotional values of sensory signals triggered by environmental factors. While the lateral parabrachial nucleus (LPB) plays a key role in nociception and supports negative valences, it also transmits signals including positive valences. However, the downstream neuronal mechanisms of positive and negative valences have not been fully explored. In the present study, we investigated the ventral tegmental area (VTA) as a projection target for LPB neurons. Optogenetic activation of LPB-VTA terminals in male mice elicits positive reinforcement in an operant task and induces both avoidance and attraction in a place-conditioning task. Inhibition of glutamic acid decarboxylase (GAD) 65-expressing cells in the VTA promotes avoidance behavior induced by photoactivation of the LPB-VTA pathway. These findings indicate that the LPB-VTA pathway is one of the LPB outputs for the transmission of positive and negative valence signals, at least in part, with GABAergic modification in VTA.

Open field activity is linked to, but is not affected by, the rate of recovery from reward downshift in female Wistar rats

Frustration is an aversive emotion triggered by unexpected reward downshifts. Using the consummatory successive negative contrast (cSNC) task, a 32-to-2% sucrose downshift was shown to initially suppress consummatory behavior. Such suppression was followed by behavioral recovery over subsequent sessions. Individual differences often emerge in the rate of recovery after the initial consummatory suppression. These experiments were designed to determine whether a stable trait of sensation/novelty seeking (SNS) is related to such individual differences in recovery from reward downshift. In Experiment 1, open field (OF) activity in the central area served as a measure of SNS. A week later, animals received training in the cSNC task involving ten 5-min sessions of access to 32% sucrose followed by four sessions of access to 2% sucrose. Higher OF activity predicted greater consummatory suppression after downshift, but a steeper recovery rate across downshifted sessions. Controls not exposed to the OF showed cSNC, but downshifted animals performed at equivalent levels whether they had OF exposure or not. In Experiment 2, after a 32-to-2% sucrose downshift, fast vs. slow recovery animals displayed similar levels of central activity in the OF. In Experiment 3, animals exhibited similar levels of central activity whether after a 32-to-2% or an 8-to-2% sucrose downshift. In both experiments, activity levels were similar whether immediately after session 12 (onset of recovery) or after session 15 (fully recovered). These results suggest that individual variations in recovery from reward downshift are correlated with levels of SNS as a stable trait.

From Prediction to Action: Dissociable Roles of Ventral Tegmental Area and Substantia Nigra Dopamine Neurons in Instrumental Reinforcement

Reward seeking requires the coordination of motor programs to achieve goals. Midbrain dopamine neurons are critical for reinforcement, and their activation is sufficient for learning about cues, actions, and outcomes. Here we examine in detail the mechanisms underlying the ability of ventral tegmental area (VTA) and substantia nigra (SNc) dopamine neurons to support instrumental learning. By exploiting numerous behavioral tasks in combination with time-limited optogenetic manipulations in male and female rats, we reveal that VTA and SNc dopamine neurons generate reinforcement through separable psychological processes. VTA dopamine neurons imbue actions and their associated cues with motivational value that allows flexible and persistent pursuit, whereas SNc dopamine neurons support time-limited, precise, action-specific learning that is nonscalable and inflexible. This architecture is reminiscent of actor-critic reinforcement learning models with VTA and SNc instructing the critic and actor, respectively. Our findings indicate that heterogeneous dopamine systems support unique forms of instrumental learning that ultimately result in disparate reward-seeking strategies.SIGNIFICANCE STATEMENT Dopamine neurons in the midbrain are essential for learning, motivation, and movement. Here we describe in detail the ability of VTA and SNc dopamine neurons to generate instrumental reinforcement, a process where an agent learns about actions they can emit to earn reward. While rats will avidly work and learn to respond for activation of VTA and SNc dopamine neurons, we find that only VTA dopamine neurons imbue actions and their associated cues with motivational value that spur continued pursuit of reward. Our data support a hypothesis that VTA and SNc dopamine neurons engage distinct psychological processes that have consequences for our understanding of these neurons in health and disease.

Behavioral and neural correlates of licking for 66% alcohol in Wistar rats: Caloric balance or sensation/novelty seeking?

Whereas rodents generally reject high alcohol concentrations, access to 66% alcohol can reinforce operant licking in a progressive ratio situation. Three experiments were conducted to identify a potential mechanism underlying this effect. In Experiment 1, food-restricted male and female Wistar rats received access to either 66% alcohol or water in their home cage for one hour over four sessions. Consumption of alcohol and water was similar, showing that rats neither preferred nor rejected 66% alcohol. Peripheral (but not central) activity in an open field (OF) was higher after access to 66% alcohol than water, a result inconsistent with motor impairment. Blood alcohol concentration was higher after 66% alcohol than water and was positively correlated with fluid displacement and peripheral distance in the OF. c-Fos immunoreactivity after exposure to 66% alcohol vs. water showed increased activation in the nucleus accumbens shell, anterior cingulate cortex, and insular cortex. In Experiment 2, whether access to food was restricted (to an 81-84% of the ad libitum weight) or free (ad libitum), female Wistar rats licked at similar frequency from a sipper tube delivering 66% alcohol. This result is inconsistent with an account based on the caloric content of 66% alcohol. In Experiment 3, food-restricted male and female Wistar rats exhibited a positive correlation between activity in the central area of an OF (an index of sensation/novelty seeking) and licking for 66% alcohol. These results are consistent with the hypothesis that the reinforcing value of 66% alcohol is related to sensation/novelty seeking.

Systemic kappa opioid receptor antagonism accelerates reinforcement learning via augmentation of novelty processing in male mice

Selective inhibition of kappa opioid receptors (KORs) is highly anticipated as a pharmacotherapeutic intervention for substance use disorders and depression. The accepted explanation for KOR antagonist-induced amelioration of aberrant behaviors posits that KORs globally function as a negative valence system; antagonism thereby blunts the behavioral influence of negative internal states such as anhedonia and negative affect. While effects of systemic KOR manipulations have been widely reproduced, explicit evaluation of negative valence as an explanatory construct is lacking. Here, we tested a series of falsifiable hypotheses generated a priori based on the negative valence model by pairing reinforcement learning tasks with systemic pharmacological KOR blockade in male C57BL/6J mice. The negative valence model failed to predict multiple experimental outcomes: KOR blockade accelerated contingency learning during both positive and negative reinforcement without altering innate responses to appetitive or aversive stimuli. We next proposed novelty processing, which influences learning independent of valence, as an alternative explanatory construct. Hypotheses based on novelty processing predicted subsequent observations: KOR blockade increased exploration of a novel, but not habituated, environment and augmented the reinforcing efficacy of novel visual stimuli in a sensory reinforcement task. Together, these results revise and extend long-standing theories of KOR system function.

Effects of isolation housing stress and mouse strain on intravenous cocaine self-administration, sensory stimulus self-administration, and reward preference

Sensory stimuli are natural rewards in mice and humans. Consequently, preference for a drug reward relative to a sensory reward may be an endophenotype of addiction vulnerability. In this study, we developed a novel behavioral assay to quantify the preference for intravenous drug self-administration relative to sensory stimulus self-administration. We used founder strains of the BXD recombinant inbred mouse panel (C57BL/6J, DBA/2J) and a model of stress (isolation vs enriched housing) to assess genetic and epigenetic effects. Following 10 weeks of differential housing, all mice were tested under three reward conditions: sensory rewards available, cocaine rewards available, both rewards available. When a single reward was available (sensory stimuli or cocaine; delivered using distinct levers), DBA/2J mice self-administered significantly more rewards than C57BL/6J mice. When both rewards were available, DBA/2J mice exhibited a significant preference for cocaine relative to sensory stimuli; in contrast, C57BL/6J mice exhibited no preference. Housing condition influenced sensory stimulus self-administration and strain-dependently influenced inactive lever pressing when both rewards were available. Collectively, these data reveal strain effects, housing effects, or both on reward self-administration and preference. Most importantly, this study reveals that genetic mechanisms underlying preference for a drug reward relative to a nondrug reward can be dissected using the full BXD panel.

Monoamine Oxidase B (MAO-B): A Target for Rational Drug Development in Schizophrenia Using PET Imaging as an Example

Monoamine oxidase B (MAO-B) is an important high-density enzyme involved in the generation of oxidative stress and central in the catabolism of dopamine, particularly in brain subcortical regions with putative implications in the pathophysiology of schizophrenia. In this chapter, we review postmortem studies, preclinical models, and peripheral and genetic studies implicating MAO-B in psychosis. A literature search in PubMed was conducted and 64 studies were found to be eligible for systematic review. We found that MAO-B could be identified as a potential target in schizophrenia. Evidence comes mostly from studies of peripheral markers, showing reduced platelet MAO-B activity in schizophrenia, together with preclinical results from MAO-B knock-out mice resulting in a hyperdopaminergic state and behavioral disinhibition. However, whether brain MAO-B is altered in vivo in patients with schizophrenia remains unknown. We therefore review methodological studies involving MAO-B positron emission tomography (PET) radioligands used to quantify MAO-B in vivo in the human brain. Given the limitations of currently available treatments for schizophrenia, elucidating whether MAO-B could be used as a target for risk stratification or clinical staging in schizophrenia could allow for a rational search for newer antipsychotics and the development of new treatments.

Establishment of multi-stage intravenous self-administration paradigms in mice

Genetically tractable animal models provide needed strategies to resolve the biological basis of drug addiction. Intravenous self-administration (IVSA) is the gold standard for modeling psychostimulant and opioid addiction in animals, but technical limitations have precluded the widespread use of IVSA in mice. Here, we describe IVSA paradigms for mice that capture the multi-stage nature of the disorder and permit predictive modeling. In these paradigms, C57BL/6J mice with long-standing indwelling jugular catheters engaged in cocaine- or remifentanil-associated lever responding that was fixed ratio-dependent, dose-dependent, extinguished by withholding the drug, and reinstated by the presentation of drug-paired cues. The application of multivariate analysis suggested that drug taking in both paradigms was a function of two latent variables we termed incentive motivation and discriminative control. Machine learning revealed that vulnerability to drug seeking and relapse were predicted by a mouse's a priori response to novelty, sensitivity to drug-induced locomotion, and drug-taking behavior. The application of these behavioral and statistical-analysis approaches to genetically-engineered mice will facilitate the identification of neural circuits driving addiction susceptibility and relapse and focused therapeutic development.

Jugular Vein Catheter Design and Cocaine Self-Administration Using Mice: A Comprehensive Method

Intravenous self-administration (IVSA) is a behavioral method of voluntary drug intake in animal models which is used to study the reinforcing effects of drugs of abuse. It is considered to have greater face validity in the study of substance use and abuse than other assays, and thus, allows for valuable insight into the neurobiological basis of addiction, and the development of substance abuse disorders. The technique typically involves surgically inserting a catheter into the jugular vein, which enables the infusion of drug solution after the performance of a desired operant behavior. Two nose- poke ports or levers are offered as manipulanda and are randomly assigned as active (reinforced) or inactive (non-reinforced) to allow for the examination of discrimination in the assessment of learning. Here, we describe our methodological approach to this assay in a mouse model, including construction and surgical implantation of a jugular vein catheter, set up of operant chambers, and considerations during each phase of the operant task.

Prenatal ethanol exposure impairs sensory processing and habituation to visual stimuli, effects normalized by enrichment of postnatal environmental

BACKGROUND

Individuals with fetal alcohol spectrum disorders (FASD) often show processing deficits in all sensory modalities. Using an operant light reinforcement model, we tested whether prenatal ethanol exposure (PE) alters operant responding to elicit a contingent sensory stimulus-light onset (turning on the light) and habituation to this behavior in rats. We also explored whether postnatal environmental enrichment could ameliorate PE-induced deficits.

METHODS

Pregnant Sprague Dawley rats were gavaged twice/day with 0 or 3 g/kg/treatment ethanol (15% w/v) during gestational days 8-20, mimicking second-trimester heavy PE in humans. The offspring were reared in a standard housing condition or an enriched condition. Adult male and female offspring underwent an operant light reinforcement experiment with either a short-access or a long-access procedure. A dishabituation test was also conducted to characterize the habituation process.

RESULTS

In the short-access procedure, PE led to increased operant responding to the contingent light onset in both sexes reared in the standard housing condition. Such an effect was not observed in rats reared in enriched conditions due to an overall decrease in responding. Moreover, rats reared in enriched conditions showed greater short-term habituation. In the long access procedure, PE rats showed increased responding and impaired long-term habituation. The long-access procedure facilitated both short-term and long-term habituation in control and PE rats.

CONCLUSION

Prenatal ethanol exposure increases responding to contingent light onset and impairs the long-term habituation process. The PE-induced deficits were ameliorated by rearing in the enriched environment and increasing the duration and frequency of exposure to light onset. The PE-induced effects are like increased sensation-seeking, a subtype of sensory-processing deficit that is often observed in individuals with FASD. Our findings could inform a suitable animal model for investigating the underlying mechanisms and possible intervention strategies for sensory deficits in FASD.

An operant ethanol self-administration paradigm that discriminates between appetitive and consummatory behaviors reveals distinct behavioral phenotypes in commonly used rat strains

Alcohol use disorder (AUD) constitutes a major burden to global health. Recently, the translational success of animal models of AUD has come under increased scrutiny. Efforts to refine models to gain a more precise understanding of the neurobiology of addiction are warranted. Appetitive responding for ethanol (seeking) and its consumption (taking) are governed by distinct neurobiological mechanisms. However, consumption is often inferred from appetitive responding in operant ethanol self-administration paradigms, preventing identification of distinct experimental effects on seeking and taking. In the present study, male Long-Evans, Wistar, and Sprague-Dawley rats were trained to lever press for ethanol using a lickometer-equipped system that precisely measures both appetitive and consummatory behavior. Three distinct operant phenotypes emerged during training: 1) Drinkers, who lever press and consume ethanol; 2) Responders, who lever press but consume little to no ethanol; and 3) Non-responders, who do not lever press. While the prevalence of each phenotype differed across strains, appetitive and consummatory behavior was similar across strains within each phenotype. Appetitive and consummatory behaviors were significantly correlated in Drinkers, but not Responders. Analysis of drinking microstructure showed that greater consumption in Drinkers relative to Responders is due to increased incentive for ethanol rather than increased palatability. Importantly, withdrawal from chronic ethanol exposure resulted in a significant increase in appetitive responding in both Drinkers and Responders, but only Drinkers exhibited a concomitant increase in ethanol consumption. Together, these data reveal important strain differences in appetitive and consummatory responding for ethanol and uncover the presence of distinct operant phenotypes.

Scalable and modular wireless-network infrastructure for large-scale behavioural neuroscience

The use of rodents to acquire understanding of the function of neural circuits and of the physiological, genetic and developmental underpinnings of behaviour has been constrained by limitations in the scalability, automation and high-throughput operation of implanted wireless neural devices. Here we report scalable and modular hardware and software infrastructure for setting up and operating remotely programmable miniaturized wireless networks leveraging Bluetooth Low Energy for the study of the long-term behaviour of large groups of rodents. The integrated system allows for automated, scheduled and real-time experimentation via the simultaneous and independent use of multiple neural devices and equipment within and across laboratories. By measuring the locomotion, feeding, arousal and social behaviours of groups of mice or rats, we show that the system allows for bidirectional data transfer from readily available hardware, and that it can be used with programmable pharmacological or optogenetic stimulation. Scalable and modular wireless-network infrastructure should facilitate the remote operation of fully automated large-scale and long-term closed-loop experiments for the study of neural circuits and animal behaviour.

Rewarding Effects of Nicotine Self-administration Increase Over Time in Male and Female Rats

INTRODUCTION

Smoking and the use of other nicotine-containing products is rewarding in humans. The self-administration of nicotine is also rewarding in male rats. However, it is unknown if there are sex differences in the reward-enhancing effects of nicotine self-administration and if the rewarding effects of nicotine change over time.

METHODS

Rats were prepared with catheters and intracranial self-stimulation (ICSS) electrodes to investigate the effects of nicotine and saline self-administration on reward function. A decrease in thresholds in the ICSS procedure reflects an enhancement of reward function. The ICSS parameters were determined before and after the self-administration sessions from days 1 to 10, and after the self-administration sessions from days 11 to 15.

RESULTS

During the first 10 days, there was no sex difference in nicotine intake, but during the last 5 days, the females took more nicotine than the males. During the first 10 days, nicotine self-administration did not lower the brain reward thresholds but decreased the response latencies. During the last 5 days, nicotine lowered the reward thresholds and decreased the response latencies. An analysis with the 5-day averages (days 1-5, 6-10, and 11-15) showed that the reward enhancing and stimulatory effects of nicotine increased over time. There were no sex differences in the reward-enhancing and stimulatory effects of nicotine. The nicotinic receptor antagonist mecamylamine diminished the reward-enhancing and stimulatory effects of nicotine.

CONCLUSION

These findings indicate that the rewarding effects of nicotine self-administration increase over time, and there are no sex differences in the reward-enhancing effects of nicotine self-administration in rats.

IMPLICATIONS

This study investigated the rewarding effect of nicotine and saline self-administration in male and female rats. The self-administration of nicotine, but not saline, enhanced brain reward function and had stimulatory effects. The rewarding effects of nicotine increased over time in the males and the females. Despite that the females had a higher level of nicotine intake than the males, the reward-enhancing effects of nicotine self-administration were the same. These findings suggest that in new tobacco and e-cigarette users, nicotine's rewarding effects might increase quickly, and a higher level of nicotine use in females might not translate into greater rewarding effects.

Strain and sex dependent effects of isolation housing relative to environmental enrichment on operant sensation seeking in mice

Sensation seeking is a multidimensional phenotype that predicts the development of drug addiction in humans and addiction-like drug seeking in rodents. Several lines of evidence suggest that chronic stress increases sensation seeking and addiction-like drug seeking through common genetic mechanisms. Discovery and characterization of these mechanisms would reveal how chronic stress interacts with the genome to influence sensation seeking and how drugs of abuse hijack these fundamental reward mechanisms to drive addiction. To this end, we tested the hypothesis that chronic isolation housing stress (relative to environmental enrichment) influences operant sensation seeking as a function of strain, sex, or their interaction. To determine if the BXD recombinant inbred panel could be used to identify genetic and epigenetic mechanisms underlying any identified gene-by-environment interactions, we used mice from the two BXD founder strains. Following 10 weeks of differential housing, we assessed operant sensation seeking using several reinforcement schedules. The primary finding from this study was that DBA/2J but not C57BL/6J mice were significantly vulnerable to an isolation-induced increase (relative to environmental enrichment) in sensation seeking during extinction when the sensory reward was no longer available; this effect was significantly more robust in females. These data reveal a previously unknown isolation-induced effect on extinction of operant sensation seeking that is sex-dependent, addiction-relevant, and that can be dissected using the BXD recombinant inbred panel.

Sign tracking predicts suboptimal behavior in a rodent gambling task

RATIONALE

Reward-associated cues can promote maladaptive behavior, including risky decision-making in a gambling setting. A propensity for sign tracking over goal tracking-i.e., interaction with a reward-predictive cue rather than the site of reward-demonstrates an individual's tendency to transfer motivational value to a cue. However, the relationship of sign tracking to risky decision-making remains unclear.

OBJECTIVES

To determine whether sign tracking predicts risky choice, we used a Pavlovian conditioned approach task to evaluate the tendency of male rats to sign track to a lever cue and then trained rats on a rodent gambling task (rGT) with win-associated cues. We also tested the effects of D-amphetamine, quinpirole (a D₂/D₃ receptor agonist), and PD128907 (a D₃ receptor agonist) on gambling behavior in sign tracker and goal tracker individuals.

RESULTS

Increased sign tracking relative to goal tracking was associated with suboptimal performance on the rGT, including decreased selection of the optimal choice, increased selection of a high-risk/high-reward option, and increased impulsive premature choices. Amphetamine increased choices of a low-risk/low-reward option at the expense of optimal and high-risk choices, whereas quinpirole and PD128907 had little effect on choice allocation, but reduced impulsivity. Drug effects were similar across sign tracker and goal tracker individuals.

CONCLUSIONS

Cue reactivity, as measured by sign tracking, is predictive and may be an important driver of risky and impulsive choices in a gambling setting laden with salient audiovisual cues. Evaluating an individual's sign tracking behavior may be an avenue to predict vulnerability to pathological gambling and the efficacy of treatments.

An optimized procedure for robust volitional cocaine intake in mice

Substance use disorder (SUD) is a behavioral disorder characterized by volitional drug consumption. Mouse models of SUD allow for the use of molecular, genetic, and circuit-level tools, providing enormous potential for defining the underlying mechanisms of this disorder. However, the relevance of results depends on the validity of the mouse models used. Self-administration models have long been the preferred preclinical model for SUD as they allow for volitional drug consumption, thus providing strong face validity. While previous work has defined the parameters that influence intravenous cocaine self-administration in other species-such as rats and primates-many of these parameters have not been explicitly assessed in mice. In a series of experiments, we showed that commonly used mouse models of self-administration, where behavior is maintained on a fixed-ratio schedule of reinforcement, show similar levels of responding in the presence and absence of drug delivery-demonstrating that it is impossible to determine when drug consumption is and is not volitional. To address these issues, we have developed a novel mouse self-administration procedure where animals do not need to be pretrained on sucrose and behavior is maintained on a variable-ratio schedule of reinforcement. This procedure increases rates of reinforcement behavior, increases levels of drug intake, and results in clearer delineation between drug-reinforced and saline conditions. Together, these data highlight a major issue with fixed-ratio models in mice that complicates subsequent analysis and provide a simple approach to minimize these confounds with variable-ratio schedules of reinforcement. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Neurobiology of novelty seeking

Neurons in the subthalamic “zone of uncertainty” assign intrinsic value to novel experiences

Glutamatergic input from the insula to the ventral bed nucleus of the stria terminalis controls reward-related behavior

Individuals suffering from substance use disorder often experience relapse events that are attributed to drug craving. Insular cortex (IC) function is implicated in processing drug-predictive cues and is thought to be a critical substrate for drug craving, but the downstream neural circuit effectors of the IC that mediate reward processing are poorly described. Here, we uncover the functional connectivity of an IC projection to the ventral bed nucleus of the stria terminalis (vBNST), a portion of the extended amygdala that has been previously shown to modulate dopaminergic activity within the ventral tegmental area (VTA), and investigate the role of this pathway in reward-related behaviors. We utilized ex vivo slice electrophysiology and in vivo optogenetics to examine the functional connectivity of the IC-vBNST projection and bidirectionally control IC-vBNST terminals in various reward-related behavioral paradigms. We hypothesized that the IC recruits mesolimbic dopamine signaling by activating VTA-projecting, vBNST neurons. Using slice electrophysiology, we found that the IC sends a glutamatergic projection onto vBNST-VTA neurons. Photoactivation of IC-vBNST terminals was sufficient to reinforce behavior in a dopamine-dependent manner. Moreover, silencing the IC-vBNST projection was aversive and resulted in anxiety-like behavior without affecting food consumption. This work provides a potential mechanism by which the IC processes exteroceptive triggers that are predictive of reward.

What is dopamine doing in model-based reinforcement learning?

Experiments have implicated dopamine in model-based reinforcement learning (RL). These findings are unexpected as dopamine is thought to encode a reward prediction error (RPE), which is the key teaching signal in model-free RL. Here we examine two possible accounts for dopamine's involvement in model-based RL: the first that dopamine neurons carry a prediction error used to update a type of predictive state representation called a successor representation, the second that two well established aspects of dopaminergic activity, RPEs and surprise signals, can together explain dopamine's involvement in model-based RL.

Housing conditions during self-administration determine motivation for cocaine in mice following chronic social defeat stress

RATIONALE

Stress exposure has a lasting impact on motivated behavior and can exacerbate existing vulnerabilities for developing a substance use disorder. Several models have been developed to examine how stressful experiences shape drug reward. These range from locomotor sensitization and conditioned place preference to the propensity for drug self-administration or responding to drug-predictive cues. While self-administration studies are considered to have more translational relevance, most of the studies to date have been conducted in rats. Further, many self-administration studies are conducted in single-housed animals, adding the additional stressor of social isolation.

OBJECTIVES

We sought to establish how chronic social defeat stress (CSDS) and social housing conditions impact cocaine self-administration and cocaine-seeking behaviors in C57BL/6 mice.

METHODS

We assessed self-administration behavior (cocaine or saline, 0.5 mg/kg/infusion) in C57BL/6 mice subjected to 10-day CSDS or in unstressed controls. Mice were housed either in pairs or in isolation during self-administration. We compared the effect of housing on acquisition of self-administration, seeking, extinction, drug-induced reinstatement, and after re-exposure to the social stressor.

RESULTS

Pair-housing during self-administration revealed increased social avoidance after CSDS is associated with decreased cocaine intake. In contrast, single-housing revealed stress-sensitive cocaine intake, with increased social avoidance after CSDS associated with increased early cocaine intake. Pair-, but not single-housed mice are susceptible to drug-induced reinstatement independent of CSDS history. Stress re-exposure sensitized cocaine-seeking in stressed single-housed mice.

CONCLUSIONS

The social context surrounding cocaine intake can bidirectionally influence cocaine-related behaviors after psychosocial stress and should be considered when studying stress and drug cross-sensitization.

The pharmacological stressor yohimbine, but not U50,488, increases responding for conditioned reinforcers paired with ethanol or sucrose

RATIONALE

Environmental stimuli paired with alcohol can function as conditioned reinforcers (CRfs) and trigger relapse to alcohol-seeking. In animal models, pharmacological stressors can enhance alcohol consumption and reinstate alcohol-seeking, but it is unknown whether stress can potentiate the conditioned reinforcing properties of alcohol-paired stimuli.

OBJECTIVES

We examined whether the pharmacological stressors, the α-2 adrenoreceptor antagonist yohimbine (vehicle, 1.25, 2.5 mg/kg; IP) and the K-opioid receptor agonist U50,488 (vehicle, 1.25, 2.5 mg/kg; SC), increase responding for conditioned reinforcement, and if their effects interact with the nature of the reward (alcohol vs. sucrose). We subsequently examined the effects of yohimbine (vehicle, 1.25, 2.5 mg/kg; IP) on responding for sensory reinforcement.

METHODS

Male Long-Evans underwent Pavlovian conditioning, wherein a tone-light conditioned stimulus (CS) was repeatedly paired with 12% EtOH or 21.7% sucrose. Next, tests of responding for a CRf were conducted. Responding on the CRf lever delivered the CS, whereas responding on the other lever had no consequences. In a separate cohort of rats, the effects of yohimbine on responding just for the sensory reinforcer were examined.

RESULTS

Both doses of yohimbine, but not U50,488, increased responding for conditioned reinforcement. This enhancement occurred independently of the nature of the reward used during Pavlovian conditioning. Yohimbine-enhanced responding for a CRf was reproducible and stable over five tests; it even persisted when the CS was omitted. Both doses of yohimbine also increased responding for sensory reinforcement.

CONCLUSIONS

Yohimbine increases operant responding for a variety of sensory and conditioned reinforcers. This enhancement may be independent of its stress-like effects.

Ventral Hippocampal Afferents to Nucleus Accumbens Encode Both Latent Vulnerability and Stress-Induced Susceptibility

BACKGROUND

Stress is a major risk factor for depression, but not everyone responds to stress in the same way. Identifying why certain individuals are more susceptible is essential for targeted treatment and prevention. In rodents, nucleus accumbens (NAc) afferents from the ventral hippocampus (vHIP) are implicated in stress-induced susceptibility, but little is known about how this pathway might encode future vulnerability or specific behavioral phenotypes.

METHODS

We used fiber photometry to record in vivo activity in vHIP-NAc afferents during tests of depressive- and anxiety-like behavior in male and female mice, both before and after a sex-specific chronic variable stress protocol, to probe relationships between prestress neural activity and behavior and potential predictors of poststress behavioral adaptation. Furthermore, we examined chronic variable stress-induced alterations in vHIP-NAc activity in vivo and used ex vivo slice electrophysiology to identify the mechanism of this change.

RESULTS

We identified behavioral specificity of the vHIP-NAc pathway to anxiety-like and social interaction behavior. We also showed that this activity is broadly predictive of stress-induced susceptibility in both sexes, while prestress behavior is predictive only of anxiety-like behavior. We observed a stress-induced increase in in vivo vHIP-NAc activity coincident with an increase in spontaneous excitatory postsynaptic current frequency.

CONCLUSIONS

We implicate vHIP-NAc in social interaction and anxiety-like behavior and identify markers of vulnerability in this neural signal, with elevated prestress vHIP-NAc activity predicting increased susceptibility across behavioral domains. Our findings indicate that individual differences in neural activity and behavior play a role in predetermining susceptibility to later stress, providing insight into mechanisms of vulnerability.

Effects of winning cues and relative payout on choice between simulated slot machines

BACKGROUND AND AIMS

Cues associated with winning may encourage gambling. We assessed the effects on risky choice of slot machine of: (1) neutral sounds paired with winning, (2) casino-related cues (such as the sound of coins dropping and pictures of dollar signs) and (3) relative payouts.

DESIGN

Experimental studies in which participants repeatedly chose between safer and riskier simulated slot machines. Safer slot machines paid the same amount regardless of which symbols lined up. Risky machines paid different amounts depending on which symbols lined up. Effects of initially neutral sounds paired with the best payout were assessed between-groups (experiment 1a) and within-participants (experiment 1b). In experiment 2, pairing of casino-related audiovisual cues with payout was assessed within participants, and cue timing was assessed between groups.

SETTING

A university research laboratory in Edmonton, Canada.

PARTICIPANTS

Undergraduate students (n = 630 across three experiments).

MEASUREMENTS

Preference for riskier over safer machines, preference between machines that differed in cues, payout recall and frequency estimates for payouts. Risky choice was calculated as the proportion of choices of the risky machine when presented with a fixed machine of the same expected value.

FINDINGS

In experiment 1a, risky choice was slightly increased by pairing a sound with the best payout compared with pairing the sound with a lower payout (P = 0.04, d = 0.28) but not compared with no sound [P = 0.36, d = 0.13, Bayes factors (BF)₁₀  = 0.22]. In experiment 1b, people did not prefer a machine with a best-payout sound over one with a lower-payout sound (P = 0.67, d = 0.03, BF₁₀  = 0.11). Relative payout affected choice: risky choices were higher for high- than low-payout decisions (P < 0.001, d = 0.53). In experiment 2, people preferred machines with casino-related cues paired with winning (P < 0.001, r²  = 0.11) and cue timing (at choice or concurrently with the win) had no effect (P = 0.95, r²  = 0.0, BF₁₀  = 0.05). Casino-related cues also enhanced payout memory (P = 0.013 and 0.006). Cue effects were not specific to risk: people also preferred fixed-payout machines with casino-related cues (P < 0.001, r²  = 0.16).

CONCLUSIONS

In a gambling simulation, student participants chose more risky slot machines when payouts were relatively higher and when casino-related cues were associated with payouts. Pairing a neutral sound with the best payout did not consistently affect slot machine choice, and the effect of casino cues did not depend on their timing. Casino-related cues enhanced payout memory.

Fentanyl vapor self-administration model in mice to study opioid addiction

Intravenous drug self-administration is considered the "gold standard" model to investigate the neurobiology of drug addiction in rodents. However, its use in mice is limited by frequent complications of intravenous catheterization. Given the many advantages of using mice in biomedical research, we developed a noninvasive mouse model of opioid self-administration using vaporized fentanyl. Mice readily self-administered fentanyl vapor, titrated their drug intake, and exhibited addiction-like behaviors, including escalation of drug intake, somatic signs of withdrawal, drug intake despite punishment, and reinstatement of drug seeking. Electrophysiological recordings from ventral tegmental area dopamine neurons showed a lower amplitude of GABAB receptor-dependent currents during protracted abstinence from fentanyl vapor self-administration. This mouse model of fentanyl self-administration recapitulates key features of opioid addiction, overcomes limitations of the intravenous model, and allows investigation of the neurobiology of opioid addiction in unprecedented ways.

Impulse for animal welfare outside the experiment

Animal welfare is a growing societal concern and the well-being of animals used for experimental purposes is under particular scrutiny. The vast majority of laboratory animals are mice living in small cages that do not offer very much variety. Moreover, the experimental procedure often takes very little time compared to the time these animals have been bred to the desired age or are being held available for animal experimentation. However, for the assessment of animal welfare, the time spent waiting for an experiment or the time spent after finishing an experiment has also to be taken into account. In addition to experimental animals, many additional animals (e.g. for breeding and maintenance of genetic lines, surplus animals) are related to animal experimentation and usually face similar living conditions. Therefore, in terms of improving the overall welfare of laboratory animals, there is not only a need for refinement of experimental conditions but especially for improving living conditions outside the experiment. The improvement of animal welfare thus depends to a large extent on the housing and maintenance conditions of all animals related to experimentation. Given the current state of animal welfare research there is indeed a great potential for improving the overall welfare of laboratory animals.

Within-animal comparisons of novelty and cocaine neuronal ensemble overlap in the nucleus accumbens and prefrontal cortex

Novelty seeking is a personality trait associated with an increased vulnerability for substance abuse. In rodents, elevated novelty seeking has been shown to be a predictor for elevated drug self-administration and compulsive use. While previous studies have shown that both novelty and drugs of abuse have actions within similar mesocorticolimbic regions, little is known as to whether the same neural ensembles are engaged by these two stimuli. Using the TetTag mouse model and Fos immunohistochemistry, we measured neurons engaged by novelty and acute cocaine exposure, respectively in the prefrontal cortex (PFC) and nucleus accumbens (NAc). While there was no significant impact of novelty exposure on the size of the EGFP+ ensemble, we found that cocaine engaged significantly more Fos+ neurons in the NAc, while stress increased the size of the Fos+ ensemble in the PFC. Analysis of ensemble reactivation was specific to the emotional valence of the second stimuli. We found that a greater proportion of the EGFP+ ensemble was reactivated in the groups that paired novelty with a positive (cocaine) or neutral (saline) experience in the NAc, while the novelty/stress paired groups exhibited significantly less ensemble overlap in the PFC. However, only in the NAc shell was this increase in ensemble overlap specific to those exposed to both novelty and cocaine. This suggests that the NAc shell, but not the NAc core or PFC, may play an important role in general reward processing by engaging a similar network of neurons.

Stimulus Complexity and Mouse Strain Drive Escalation of Operant Sensation Seeking Within and Across Sessions in C57BL/6J and DBA/2J Mice

Sensation seeking is a heritable trait that is genetically correlated with substance use; the shared genetic mechanisms underlying these traits are largely unknown. The relationship of sensation seeking and substance use has practical importance because discovering genes that drive sensation seeking can reveal genes driving substance use, and quantification of sensation seeking in mice is higher throughput and less technically challenging than quantification of volitional drug use. In order to fully understand the genetic mechanisms driving sensation seeking, it is critical to first understand the nongenetic factors driving sensation seeking. In the present study, we used the operant sensation seeking paradigm to assess the effects of stimulus complexity on sensation seeking in C57BL/6J and DBA/2J mice. These strains are the founders of the BXD recombinant inbred mouse panel which enables the discovery of genes driving phenotypic variation. This study led to four principal conclusions. First, all sensory stimuli used in the study, regardless of complexity or number of stimulus modalities, served as reinforcers for C57BL/6J and DBA/2J mice. Second, for both C57BL/6J and DBA/2J mice, sensation seeking for a high complexity sensory stimulus was significantly greater than sensation seeking for a low complexity sensory stimulus. Third, for both C57BL/6J and DBA/2J mice, sensation seeking escalated significantly within-session when a multimodal sensory stimulus of medium or high complexity was used but not when a unimodal sensory stimulus of low complexity was used. Finally, both the magnitude of sensation seeking and the magnitude of within-session escalation of sensation seeking were significantly greater in mice from the DBA/2J strain relative to mice from the C57BL/6J strain. Collectively, these findings indicate that stimulus complexity and genetic background drive escalation of operant sensation seeking within and across sessions, and that the BXD recombinant inbred mouse panel can be used to discover the genetic mechanisms underlying these phenomena.

Association between impulsivity and neural activation to alcohol cues in heavy drinkers

This study examines associations between two measures of impulsivity and brain response to alcohol taste cues. Impulsivity is both a risk factor for and a consequence of alcohol use and misuse. Frontostriatal circuits are linked to both impulsivity and addiction-related behaviors, including response to alcohol cues. Non-treatment-seeking heavy drinkers (n = 55) completed (i) an fMRI alcohol taste cue-reactivity paradigm; (ii) the monetary choice questionnaire (MCQ), a measure of choice impulsivity where participants choose between smaller, sooner rewards and larger, delayed rewards; (iii) and the UPPS-P Impulsive Behavior Scale, a self-report measure assessing five impulsivity factors. General linear models identified associations between neural alcohol taste cue-reactivity and impulsivity, adjusting for age, gender, and smoking status. Self-reported sensation seeking was positively associated with alcohol taste cue-elicited activation in frontostriatal regions, such that individuals who reported higher sensation seeking displayed greater neural response to alcohol taste cues. Conversely, delay discounting was negatively associated with activation in frontoparietal regions, such that individuals who reported greater discounting showed less cue-elicited activation. There were no significant associations between other self-reported impulsivity subscales and alcohol taste cue-reactivity. These results indicate that sensation seeking is associated with reward responsivity, while delay discounting is associated with recruitment of self-control circuitry.

Antagonism of μ-opioid receptors reduces sensation seeking-like behavior in mice

Novelty- and sensation-seeking behaviors induce activity of the brain reward system and are associated with increased susceptibility to drug abuse. Endogenous opioids have been implicated in reward-related behavior; however, the involvement of specific opioid receptors in the mechanism of sensation seeking is unknown. Here, we show that selective inhibition of opioid receptors reduce operant sensation seeking in mice. Administration of naltrexone (a nonselective opioid antagonist) reduced instrumental responding for sensory stimuli at one of the tested doses (2 mg/kg). More robust effects were observed in the case of cyprodime, a selective μ opioid receptor antagonist, which reduced instrumental responses by ∼50% at doses of 0.5 mg/kg and larger. Conversely, selective δ and κ receptor antagonists (naltrindole and nor-binaltorphimine, respectively) had no effect on sensation-seeking behavior. Importantly, while naltrexone produces aversion in the conditioned place preference test, cyprodime had no such effect. Therefore, reduced instrumental responding was not correlated with aversive effects of the opioid antagonists. In conclusion, our results revealed a novel mechanism of action of selective opioid receptors antagonists, which may have relevance for their efficacy in the treatment of drug abuse.

Systems genetics of sensation seeking

Sensation seeking is a multifaceted, heritable trait which predicts the development of substance use and abuse in humans; similar phenomena have been observed in rodents. Genetic correlations among sensation seeking and substance use indicate shared biological mechanisms, but the genes and networks underlying these relationships remain elusive. Here, we used a systems genetics approach in the BXD recombinant inbred mouse panel to identify shared genetic mechanisms underlying substance use and preference for sensory stimuli, an intermediate phenotype of sensation seeking. Using the operant sensation seeking (OSS) paradigm, we quantified preference for sensory stimuli in 120 male and 127 female mice from 62 BXD strains and the C57BL/6J and DBA/2J founder strains. We used relative preference for the active and inactive levers to dissociate preference for sensory stimuli from locomotion and exploration phenotypes. We identified genomic regions on chromosome 4 (155.236‐155.742 Mb) and chromosome 13 (72.969‐89.423 Mb) associated with distinct behavioral components of OSS. Using publicly available behavioral data and mRNA expression data from brain regions involved in reward processing, we identified (a) genes within these behavioral QTL exhibiting genome‐wide significant cis‐eQTL and (b) genetic correlations among OSS phenotypes, ethanol phenotypes and mRNA expression. From these analyses, we nominated positional candidates for behavioral QTL associated with distinct OSS phenotypes including Gnb1 and Mef2c. Genetic covariation of Gnb1 expression, preference for sensory stimuli and multiple ethanol phenotypes suggest that heritable variation in Gnb1 expression in reward circuitry partially underlies the widely reported relationship between sensation seeking and substance use.

Intravenous cocaine self-administration in a panel of inbred mouse strains differing in acute locomotor sensitivity to cocaine

RATIONALE

Initial sensitivity to drugs of abuse often predicts subsequent use and abuse, but this relationship is not always observed in human studies. Moreover, studies examining the relationship between initial locomotor sensitivity and the rewarding and reinforcing effects of drugs in animal models have also been equivocal. Understanding the relationship between initial drug effects and propensity to continue use, potentially resulting in the development of a substance use disorder, may help to identify key targets for prevention and treatment.

OBJECTIVES

We examined intravenous cocaine self-administration in a set of mouse strains that were previously identified to be at the phenotypic extremes for cocaine-induced locomotor activation to determine if initial locomotor sensitivity predicted acquisition, extinction, dose response, or progressive ratio (PR) breakpoint.

METHODS

We selected eight inbred mouse strains based on locomotor sensitivity to 20 mg/kg cocaine. These strains, designated as low and high responders, were tested in an intravenous self-administration paradigm that included acquisition of 0.5 mg/(kg*inf) under a FR1 schedule, extinction, re-acquisition, dose response to 0.125, 0.25, 0.5, 1, and 2 mg/(kg*inf), and progressive ratio.

RESULTS

We observed overall differences in self-administration behavior between high and low responders. Low responders self-administered less cocaine and had lower breakpoints under the PR schedule. However, we also observed strain differences within each group. Self-administration in the low responder, LG/J, more closely resembled the behavior of the high-responding group, and the high responder, P/J, had self-administration behavior that more closely resembled the low-responding group.

CONCLUSIONS

We conclude that acute cocaine-induced locomotor activation does predict self-administration behavior, but in a strain-specific manner. These data support the idea that genetic background influences the relationship among addiction-related behaviors.

Developmental differences in reward sensitivity and sensation seeking in adolescence: Testing sex-specific associations with gonadal hormones and pubertal development

Sensation seeking has been found to increase, on average, from childhood to adolescence. Developmental scientists have hypothesized that this change could be driven by the rise of gonadal hormones at puberty, which affect reward-related processing in the brain. In a large, age-heterogeneous, population-based sample of adolescents and young adults (N = 810; ages 13-20 years), we tested for sex-specific associations between age, self-reported pubertal development, gonadal hormones (estradiol and testosterone) as measured in saliva, reward sensitivity as measured by a multivariate battery of in-laboratory tasks (including the Iowa gambling task, balloon analogue risk task, and stoplight task), and self-reported sensation seeking. Reward sensitivity was more strongly associated with sensation seeking in males than females. For both males and females, reward sensitivity was unrelated to age but was higher among those who reported more advanced pubertal development. There were significant sex differences in the effects of self-reported pubertal development on sensation seeking, with a positive association evident in males but a negative association in females. Moreover, gonadal hormones also showed diverging associations with sensation seeking-positive with testosterone but negative with estradiol. Overall, the results indicate that sensation seeking among adolescents and young adults depends on a complex constellation of developmental influences that operate via sex-specific mechanisms. (PsycINFO Database Record

Intravenous self-administration of alcohol in rats-problems with translation to humans

Alcohol is consumed orally by humans, and oral self-administration has been successfully modeled in laboratory animals. Over the last several years, attempts have been made to develop a procedure for the reliable intravenous (IV) self-administration of alcohol in rodents. IV self-administration would provide a better tool for investigating neurobiological mechanisms of alcohol reinforcement and dependence because confounding factors associated with oral self-administration, such as variations in orosensory sensitivity to alcohol and/or its absorption, are avoided. A review of the literature shows that rats, mice and non-human primates can initiate and maintain IV self-administration of alcohol. However, there are 50- to 100-fold interspecies differences in the reported alcohol infusion doses required. Most surprising is that the infusion dose (1-2 mg/kg) that reliably maintains IV alcohol self-administration in rats results in total alcohol intakes of only 20-25 mg/kg/hour, which are unlikely to have significant pharmacological effects. The evidence to support IV self-administration of such low doses of alcohol in rats as well as the potential biological mechanisms underlying such self-administration are discussed. The minute amounts of alcohol shown to reliably maintain IV self-administration behavior in rats challenge the relationship between their blood alcohol levels and the rewarding and reinforcing effects of alcohol.

Pharmacological evidence that 5-HT2C receptor blockade selectively improves decision making when rewards are paired with audiovisual cues in a rat gambling task

RATIONALE

Adding reward-concurrent cues to a rat gambling task (rGT) increases risky choice. This cued version of the task may reflect an "addiction-like" cognitive process, more similar to human gambling than the uncued task. Serotonergic drugs that target 5-HT₂ receptors alter mechanisms linked to impulse control. However, relatively little is known regarding the impact of such agents on either risky decision making, or the ability of conditioned stimuli to bias the choice process, despite potential relevance to addiction development and treatment.

OBJECTIVES

The aim of this study was to determine the effects of SB 242,084 and M100907, selective antagonists at the 5-HT_2C and 5-HT_2A receptors respectively, as well as the selective 5-HT_2C receptor agonist Ro-60-0175, on performance of both cued and uncued versions of the rGT.

RESULTS

SB 242,084 significantly and dose-dependently increased choice of the most optimal option in the cued rGT only, despite concurrently increasing impulsive responses made prematurely on both the cued and uncued rGT. M100907 and Ro-60-0175 did not alter risky decision making, but nevertheless produced the expected decrease in premature responses on both task variants.

CONCLUSIONS

These findings demonstrate that the 5-HT₂ receptor-mediated regulation of risky decision making and motor impulsivity can be pharmacologically dissociated and further show that the presence of highly salient reward-paired cues critically alters the neurochemical regulation of the choice process. Importantly, these results suggest that 5-HT_2C receptor antagonists may be of use in disrupting maladaptive patterns of decision making.

Cannabinoid Receptor 1 and Fatty Acid Amide Hydrolase Contribute to Operant Sensation Seeking in Mice

A large body of evidence in humans and preclinical models supports a role for the endocannabinoid system in the proper execution of motivated or goal-directed behaviors. Operant sensation seeking (OSS) is a task that uses varied sensory stimuli as a reinforcer to maintain operant responding in mice. The purpose of the studies in this report was to begin to explore the role of endocannabinoid signaling in OSS utilizing cannabinoid receptor 1 (CB1R) and fatty acid amide hydrolase (FAAH) knock out mice. Compared to wild type littermate controls, CB1R knock out mice exhibited significantly fewer active responses and earned significantly fewer reinforcers in fixed ratio and progressive ratio schedules. On the other hand, FAAH knock out mice exhibited increased active responses and earned more reinforcers than wild type littermates in fixed ratio but not progressive ratio schedules. These findings support the role of endocannabinoid signaling in motivated behaviors and also expand our understanding of the signaling processes involved in OSS.

Gambling disorder: an integrative review of animal and human studies

Gambling disorder (GD), previously called pathological gambling and classified as an impulse control disorder in DSM-III and DSM-IV, has recently been reclassified as an addictive disorder in the DSM-5. It is widely recognized as an important public health problem associated with substantial personal and social costs, high rates of psychiatric comorbidity, poor physical health, and elevated suicide rates. A number of risk factors have been identified, including some genetic polymorphisms. Animal models have been developed in order to study the underlying neural basis of GD. Here, we discuss recent advances in our understanding of the risk factors, disease course, and pathophysiology. A focus on a phenotype-based dissection of the disorder is included in which known neural correlates from animal and human studies are reviewed. Finally, current treatment approaches are discussed, as well as future directions for GD research.

Shared Neural Mechanisms for the Evaluation of Intense Sensory Stimulation and Economic Reward, Dependent on Stimulation-Seeking Behavior

Why are some people strongly motivated by intense sensory experiences? Here we investigated how people encode the value of an intense sensory experience compared with economic reward, and how this varies according to stimulation-seeking preference. Specifically, we used a novel behavioral task in combination with computational modeling to derive the value individuals assigned to the opportunity to experience an intense tactile stimulus (mild electric shock). We then examined functional imaging data recorded during task performance to see how the opportunity to experience the sensory stimulus was encoded in stimulation-seekers versus stimulation-avoiders. We found that for individuals who positively sought out this kind of sensory stimulation, there was common encoding of anticipated economic and sensory rewards in the ventromedial prefrontal cortex. Conversely, there was robust encoding of the modeled probability of receiving such stimulation in the insula only in stimulation-avoidant individuals. Finally, we found preliminary evidence that sensory prediction error signals may be positively signed for stimulation-seekers, but negatively signed for stimulation-avoiders, in the posterior cingulate cortex. These findings may help explain why high intensity sensory experiences are appetitive for some individuals, but not for others, and may have relevance for the increased vulnerability for some psychopathologies, but perhaps increased resilience for others, in high sensation-seeking individuals.

SIGNIFICANCE STATEMENT

People vary in their preference for intense sensory experiences. Here, we investigated how different individuals evaluate the prospect of an unusual sensory experience (electric shock), compared with the opportunity to gain a more traditional reward (money). We found that in a subset of individuals who sought out such unusual sensory stimulation, anticipation of the sensory outcome was encoded in the same way as that of monetary gain, in the ventromedial prefrontal cortex. Further understanding of stimulation-seeking behavior may shed light on the etiology of psychopathologies such as addiction, for which high or low sensation-seeking personality has been identified as a risk factor.

Decreased Incentive Motivation Following Knockout or Acute Blockade of the Serotonin Transporter: Role of the 5-HT2C Receptor

Acute pharmacological elevation of serotonin (5-hydroxytryptamine; 5-HT) activity decreases operant responding for primary reinforcers, suggesting that 5-HT reduces incentive motivation. The mechanism by which 5-HT alters incentive motivation is unknown, but parallel evidence that 5-HT2C receptor agonists also reduce responding for primary reinforcers implicates this receptor as a potential candidate. These experiments examined whether chronic and acute disruptions of serotonin transporter (SERT) activity altered incentive motivation, and whether the 5-HT2C receptor mediated the effects of elevated 5-HT on behavior. To assess incentive motivation, we measured responding for three different reinforcers: a primary reinforcer (saccharin), a conditioned reinforcer (CRf), and an unconditioned sensory reinforcer (USRf). In the chronic condition, responding was compared between SERT knockout (SERT-KO) mice and their wild-type littermates. In the acute condition, responding was examined in wild-type mice following treatment with 10 or 20 mg/kg citalopram, or its vehicle. The ability of the selective 5-HT2C antagonist SB 242084 to prevent the effects of SERT-KO and citalopram on responding was subsequently examined. Both SERT-KO and citalopram reduced responding for saccharin, a CRf, and a USRf. Treatment with SB 242084 enhanced responding for a CRf and a USRf in SERT-KO mice and blocked the effects of citalopram on CRf and USRf responding. However, SB 242084 was unable to prevent the effects of SERT-KO or citalopram on responding for saccharin. These results support a powerful inhibitory function for 5-HT in the control of incentive motivation, and indicate that the 5-HT2C receptor mediates these effects of 5-HT in a reinforcer-dependent manner.

Responses to drugs of abuse and non-drug rewards in leptin deficient ob/ob mice

RATIONALE

Although leptin receptors are found in hypothalamic nuclei classically associated with homeostatic feeding mechanisms, they are also present in brain regions known to regulate hedonic-based feeding, natural reward processing, and responses to drugs of abuse. The ob/ob mouse is deficient in leptin signaling, and previous work has found altered mesolimbic dopamine signaling and sensitivity to the locomotor activating effects of amphetamine in these mice.

OBJECTIVES

We directly assessed responses to three drugs of abuse and non-drug rewards in the leptin-deficient ob/ob mouse.

METHODS

Ob/ob mice were tested in assays of sweet preference, novelty seeking, and drug reward/reinforcement.

RESULTS

In assays of novelty seeking, novel open field activity and operant sensation seeking were reduced in ob/ob mice, although novel object interaction and novel environment preference were comparable to wild types. We also found that ob/ob mice had specific phenotypes in regard to cocaine: conditioned place preference for 2.5 mg/kg was increased, while the locomotor response to 10 mg/kg was reduced, and cocaine self-administration was the same as wild types. Ob/ob mice also acquired self-administration of the potent opioid remifentanil, but breakpoints for the drug were significantly reduced. Finally, we found significant differences in ethanol drinking in ob/ob mice that correlated negatively with body weight and positively with operant sensation seeking.

CONCLUSIONS

In conclusion, ob/ob mice displayed task-specific deficits in novelty seeking and dissociable differences in reward/reinforcement associated with cocaine, remifentanil, and ethanol.

NMDA Receptors on Dopaminoceptive Neurons Are Essential for Drug-Induced Conditioned Place Preference

Plasticity of the brain's dopamine system plays a crucial role in adaptive behavior by regulating appetitive motivation and the control of reinforcement learning. In this study, we investigated drug- and natural-reward conditioned behaviors in a mouse model in which the NMDA receptor-dependent plasticity of dopaminoceptive neurons was disrupted. We generated a transgenic mouse line with inducible selective inactivation of the NR1 subunit in neurons expressing dopamine D1 receptors (the NR1(D1CreERT2) mice). Whole-cell recordings of spontaneous EPSCs on neurons in the nucleus accumbens confirmed that a population of neurons lacked the NMDA receptor-dependent component of the current. This effect was accompanied by impaired long-term potentiation in the nucleus accumbens and in the CA1 area of the ventral, but not the dorsal, hippocampus. Mutant mice did not differ from control animals when tested for pavlovian or instrumental conditioning. However, NR1(D1CreERT2) mice acquired no preference for a context associated with administration of drugs of abuse. In the conditioned place preference paradigm, mutant mice did not spend more time in the context paired with cocaine, morphine, or ethanol, although these mice acquired a preference for sucrose jelly and an aversion to naloxone injections, as normal. Thus, we observed that the selective inducible ablation of the NMDA receptors specifically blocks drug-associated context memory with no effect on positive reinforcement in general.

Dopamine D3 Receptors Modulate the Ability of Win-Paired Cues to Increase Risky Choice in a Rat Gambling Task

Similar to other addiction disorders, the cues inherent in many gambling procedures are thought to play an important role in mediating their addictive nature. Animal models of gambling-related behavior, while capturing dimensions of economic decision making, have yet to address the impact that these salient cues may have in promoting maladaptive choice. Here, we determined whether adding win-associated audiovisual cues to a rat gambling task (rGT) would influence decision making. Thirty-two male Long-Evans rats were tested on either the cued or uncued rGT. In these tasks, animals chose between four options associated with different magnitudes and frequencies of reward and punishing time-out periods. As in the Iowa Gambling Task, favoring options associated with smaller per-trial rewards but smaller losses and avoiding the tempting "high-risk, high-reward" decks maximized profits. Although the reinforcement contingencies were identical in both task versions, rats' choice of the disadvantageous risky options was significantly greater on the cued task. Furthermore, a D3 receptor agonist increased choice of the disadvantageous options, whereas a D3 antagonist had the opposite effects, only on the cued task. These findings are consistent with the reported role of D3 receptors in mediating the facilitatory effects of cues in addiction. Collectively, these results indicate that the cued rGT is a valuable model with which to study the mechanism by which salient cues can invigorate maladaptive decision making, an important and understudied component of both gambling and substance use disorders. Significance statement: We used a rodent analog of the Iowa Gambling Task to determine whether the addition of audiovisual cues would affect choice preferences. Adding reward-concurrent cues significantly increased risky choice. This is the first clear demonstration that reward-paired cues can bias cost/benefit decision making against a subject's best interests in a manner concordant with elevated addiction susceptibility. Choice on the cued task was uniquely sensitive to modulation by D3 receptor ligands, yet these drugs did not alter decision making on the uncued task. The relatively unprecedented sensitivity of choice on the cued task to D3-receptor-mediated neurotransmission data suggest that similar neurobiological processes underlie the ability of cues to both bias animals toward risky options and facilitate drug addiction.

Responding for a conditioned reinforcer or unconditioned sensory reinforcer in mice: interactions with environmental enrichment, social isolation, and monoamine reuptake inhibitors

RATIONALE

Environmental factors influence the etiology of many psychiatric disorders. Likewise, environmental factors can alter processes central to motivation. Therefore, motivational deficits present in many disorders may be influenced by early life environmental conditions.

OBJECTIVE

We examined whether housing animals in different environmental conditions influenced the ability of sensory stimuli to acquire incentive value and whether elevated monoamine activity altered responsing for these stimuli.

METHODS

Isolation-housed (IH), pair-housed (PH), and environmentally enriched (EE) male C57BL/6N mice were examined in tests of responding for a conditioned reinforcer (CRf) or an unconditioned sensory reinforcer (USRf). The CRf was previously paired with saccharin delivery through Pavlovian conditioning, while the USRf was not conditioned with a reward. Following baseline tests of responding for the CRf or USRf, the effects of elevated monoamine activity were examined.

RESULTS

At baseline, PH and EE mice responded similarly for the CRf or USRf. IH mice responded more for the CRf but exhibited slower acquisition of responding for the USRf. Administration of citalopram, a serotonin transporter blocker, or atomoxetine, a norepinephrine transporter blocker, decreased responding for the CRf and USRf in all groups. The dopamine transporter blocker GBR 12909 generally increased responding for the CRf and USRf, but further analysis revealed enhanced responding for both reinforcers only in EE mice.

CONCLUSIONS

Baseline incentive motivation is strongly influenced by the social component of housing conditions. Furthermore, environmental enrichment increased the sensitivity to elevated dopamine activity, while acute elevations in serotonin and norepinephrine inhibit incentive motivation irrespective of housing condition.

Oral operant ethanol self-administration in the absence of explicit cues, food restriction, water restriction and ethanol fading in C57BL/6J mice

RATIONALE

Mouse models of ethanol (EtOH) self-administration are useful to identify genetic and biological underpinnings of alcohol use disorder.

OBJECTIVES

These experiments developed a novel method of oral operant EtOH self-administration in mice without explicitly paired cues, food/water restriction, or EtOH fading.

METHODS

Following magazine and lever training for 0.2 % saccharin (SAC), mice underwent nine weekly overnight sessions with lever pressing maintained by dipper presentation of 0, 3, 10, or 15 % EtOH in SAC or water vehicle. Ad libitum water was available from a bottle.

RESULTS

Water vehicle mice ingested most fluid from the water bottle in contrast to SAC vehicle mice, which despite lever pressing demands, drank most of their fluid from the liquid dipper. Although EtOH in SAC vehicle mice showed concentration-dependent increases of g/kg EtOH intake, lever pressing decreased with increasing EtOH concentration and did not exceed that of SAC vehicle alone at any EtOH concentration. Mice reinforced with EtOH in water ingested less EtOH than mice reinforced with EtOH in SAC. EtOH in water mice, however, showed concentration-dependent increases in g/kg EtOH intake and lever presses. Fifteen percent EtOH in water mice showed significantly greater levels of lever pressing than water vehicle mice and a significant escalation of responding across weeks of exposure. Naltrexone pretreatment reduced EtOH self-administration and intake in these mice without altering responding in the vehicle control condition during the first hour of the session.

CONCLUSIONS

SAC facilitated EtOH intake but prevented observation of EtOH reinforcement. Water vehicle unmasked EtOH's reinforcing effects.

Individual variation in the motivational properties of a nicotine cue: sign-trackers vs. goal-trackers

RATIONALE

Individuals vary in the extent to which they attribute incentive salience to reward cues. Discrete food and drug (cocaine and opioid) cues become more attractive, eliciting approach toward them, and more "wanted," in that they serve as more effective conditioned reinforcers, in some rats (sign-trackers, STs), than in others (goal-trackers, GTs).

OBJECTIVES

We asked whether there is similar variation in the extent to which a cue associated with a drug from another class, nicotine, acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats that attribute incentive salience to a food cue (i.e., STs and GTs). We then measured the extent to which a cue (a light) paired with intravenous nicotine injections acquired two properties of an incentive stimulus: (1) the ability to elicit approach toward it, and (2) the ability to act as a conditioned reinforcer.

RESULTS

In contrast to previous findings with food, cocaine, and opioid cues, we found that the nicotine cue was equally attractive in STs and GTs, eliciting dose-dependent approach behavior in both. However, the nicotine cue was a more effective conditioned reinforcer in STs than in GTs.

CONCLUSIONS

We suggest the dissociation between these two measures of incentive salience attribution may be related to the fact that when present (as in the test of Pavlovian approach), nicotine can act as a potent "incentive amplifier," and by this action, nicotine may render cues especially salient for all animals.

Increased prefrontal cortex neurogranin enhances plasticity and extinction learning

Increasing plasticity in neurons of the prefrontal cortex (PFC) has been proposed as a possible therapeutic tool to enhance extinction, a process that is impaired in post-traumatic stress disorder, schizophrenia, and addiction. To test this hypothesis, we generated transgenic mice that overexpress neurogranin (a calmodulin-binding protein that facilitates long-term potentiation) in the PFC. Neurogranin overexpression in the PFC enhanced long-term potentiation and increased the rates of extinction learning of both fear conditioning and sucrose self-administration. Our results indicate that elevated neurogranin function within the PFC can enhance local plasticity and increase the rate of extinction learning across different behavioral tasks. Thus, neurogranin can provide a molecular link between enhanced plasticity and enhanced extinction.