The effect of partial reinforcement on instrumental successive negative contrast in inbred Roman High- (RHA-I) and Low- (RLA-I) Avoidance rats

Contribution of the Roman rat lines/strains to personality neuroscience: neurobehavioral modeling of internalizing/externalizing psychopathologies

The Roman high-avoidance (RHA) and low-avoidance (RLA) rat lines/strains were established in Rome through bidirectional selection of Wistar rats for rapid (RHA) or extremely poor (RLA) acquisition of a two-way active avoidance task. Relative to RHAs, RLA rats exhibit enhanced threat sensitivity, anxiety, fear and vulnerability to stress, a passive coping style and increased sensitivity to frustration. Thus, RLA rats' phenotypic profile falls well within the "internalizing" behavior spectrum. Compared with RLAs and other rat strains/stocks, RHAs present increased impulsivity and reward sensitivity, deficits in social behavior and attentional/cognitive processes, novelty-induced hyper-locomotion and vulnerability to psychostimulant sensitization and drug addiction. Thus, RHA rats' phenotypes are consistent with a "disinhibiting externalizing" profile. Many neurobiological/molecular traits differentiate both rat lines/strains. For example, relative to RLA rats, RHAs exhibit decreased function of the prefrontal cortex (PFC), hippocampus and amygdala, increased functional tone of the mesolimbic dopamine system, a deficit of central metabotropic glutamate-2 (mGlu2) receptors, increased density of serotonin 5-HT2A receptors in the PFC, impairment of GABAergic transmission in the PFC, alterations of several synaptic markers and increased density of pyramidal immature dendrític spines in the PFC. These characteristics suggest an immature brain of RHA rats and are reminiscent of schizophrenia features like hypofrontality and disruption of the excitation/inhibition cortical balance. We review evidence supporting RLA rats as a valid model of anxiety/fear, stress and frustration vulnerability, whereas RHA rats represent a promising translational model of neurodevelopmental alterations related to impulsivity, schizophrenia-relevant features and comorbidity with drug addiction vulnerability.

Exploring the effect of pain on response to reward loss in calves

Negative emotional states are known to interact, potentially aggravating one another. In this study, we used a well validated paradigm (successive negative contrast, SNC) to determine if pain from a common procedure (disbudding) influences responses to a reward downshift. Holstein calves (n = 30) were trained to approach a 0.5 L milk reward. Latency to approach, number of vocalisations and pressure applied on the bottle were recorded during training. To assess how pain affected responses to reward downshift, calves were randomly assigned to one of three treatments before the downshift. Two groups were disbudded and provided the 'gold standard' of pain mitigation: intraoperative local anesthesia and analgesia. One of these disbudded groups was then provided supplemental analgesic before testing. The third group was sham disbudded. All calves were then subjected to the reward downshift by reducing the milk reward to just 0.1 L. Interactions were detected between test session and daily trials on pressure applied for the Disbudded group (estimate ± SEM: 0.08 ± 0.05), and on vocalisations for the Sham (0.3 ± 0.1) and Disbudding + Analgesia (0.4 ± 0.1) groups. Our results indicate that SNC is a promising paradigm for measuring negative affect in calves and suggests that pain potentially affects the response to a reward downshift.

A maturational shift in the frontal cortex synaptic transcriptional landscape underlies schizophrenia-relevant behavioural traits: A congenital rat model

Disruption of brain development early in life may underlie the neurobiology behind schizophrenia. We have reported more immature synaptic spines in the frontal cortex (FC) of adult Roman High-Avoidance (RHA-I) rats, a behavioural model displaying schizophrenia-like traits. Here, we performed a whole transcriptome analysis in the FC of 4 months old male RHA-I (n=8) and its counterpart, the Roman Low-Avoidance (RLA-I) (n=8). We identified 203 significant genes with overrepresentation of genes involved in synaptic function. Next, we performed a gene set enrichment analysis (GSEA) for genes co-expressed during neurodevelopment. Gene networks were obtained by weighted gene co-expression network analysis (WGCNA) of a transcriptomic dataset containing human FC during lifespan (n=269). Out of thirty-one functional gene networks, six were significantly enriched in the RHA-I. These were differentially regulated during infancy and enriched in biological ontologies related to myelination, synaptic function, and immune response. We validated differential gene expression in a new cohort of adolescent (<=2 months old) and young-adult (>=3 months old) RHA-I and RLA-I rats. The results confirmed overexpression of Gsn, Nt5cd1, Ppp1r1b, and Slc9a3r1 in young-adult RHA-I, while Cables1, a regulator of Cdk5 phosphorylation in actin regulation and involved in synaptic plasticity and maturation, was significantly downregulated in adolescent RHA-I. This age-related expression change was also observed for presynaptic components Snap25 and Snap29. Our results show a different maturational expression profile of synaptic components in the RHA-I strain, supporting a shift in FC maturation underlying schizophrenia-like behavioural traits and adding construct validity to this strain as a neurodevelopmental model.

Frustrative nonreward and emotional self-medication:Factors modulating alcohol consumption following reward downshift in rats

Life experience involving unexpected incentive loss (e.g., loss of job or a significant other) may result in negative emotional reactions (frustration) and promote alcohol drinking. Similarly, animals exposed to a frustrative 32-to-4% sucrose downshift increase their preference for alcohol (2%) vs. water. This result was interpreted as reflecting emotional self-medication-the consumption of substances that reduce negative emotions. We conducted three experiments examining parametric manipulations of the animal model: (1) effects of a severe reward downshift (32-to-4% sucrose) on consumption of various alcohol concentrations (Experiment 1); (2) effects of different magnitudes of reward downshifts on consumption of 32% alcohol (Experiment 2); and (3) effects of partial reinforcement (an intervention that increases resistance to frustration) on 2% alcohol intake induced by a 32-to-4% sucrose downshift (Experiment 3). The results show that (1) a 32-to-4% sucrose downshift leads to an increase in alcohol intake over a wide range of alcohol concentrations; (2) the greater the reward downshift, the higher the relative increase in alcohol consumption; and (3) a treatment that increases resistance to frustration (partial reinforcement) also attenuates alcohol consumption after a sucrose downshift. These data are discussed in relation to the role of frustrative nonreward in alcohol consumption.

Effects of partial reinforcement on autoshaping in inbred Roman high- and low-avoidance rats

Individuals trained under partial reinforcement (PR) typically show a greater resistance to extinction than individuals exposed to continuous reinforcement (CR). This phenomenon is referred to as the PR extinction effect (PREE) and is interpreted as a consequence of uncertainty-induced frustration counterconditioning. In this study, we assessed the effects of PR and CR in acquisition and extinction in two strains of rats, the inbred Roman high- and low-avoidance (RHA and RLA, respectively) rats. These two strains mainly differ in the expression of anxiety, the RLA rats showing more anxiety-related behaviors (hence, more sensitive to frustration) than the RHA rats. At a neurobiological level, mild stress is known to elevate corticosterone in RLA rats and dopamine in RHA rats. We tested four groups of rats (RHA/CR, RHA/PR, RLA/CR, and RLA/PR) in two successive acquisition-extinction phases to try to consolidate the behavioral effects. Animals received training in a Pavlovian autoshaping procedure with retractable levers as the conditioned stimulus, food pellets as the unconditioned stimulus, and lever presses as the conditioned response. In Phase 1, we observed a PREE in lever pressing in both strains, but this effect was larger and longer lasting in RHA/PR than in RLA/PR rats. In Phase 2, reacquisition was fast and the PREE persisted in both strains, although the two PR groups no longer differed in lever pressing. The results are discussed in terms of frustration theory and of uncertainty-induced sensitization of dopaminergic neurons.

Partial rewarding during clicker training does not improve naïve dogs' learning speed and induces a pessimistic-like affective state

Clicker training is considered a welfare-friendly way of teaching novel behaviors to animals because it is mostly based on the positive reinforcement. However, trainers largely vary in their way of applying this training technique. According to the most, a reward (e.g., food) should follow every click, while others claim that dogs learn faster when the reward is sometimes omitted. One argument against the use of partial rewarding is that it induces frustration in the animal, raising concerns over its welfare consequences. Here, we investigated the effect of partial rewarding not only on training efficacy (learning speed), but also on dogs' affective state. We clicker-trained two groups of dogs: one group received food after every click while the other group received food only 60% of the time. Considering previous evidence of the influencing role of personality on reactions to frustrated expectations, we included measurements of dogs' emotional reactivity. We compared the number of trials needed to reach a learning criterion and their pessimistic bias in a cognitive bias test. No difference between the two groups emerged in terms of learning speed; however, dogs that were partially rewarded during clicker training showed a more pessimistic bias than dogs that were continuously rewarded. Generally, emotional reactivity was positively associated with a more pessimistic bias. Partial rewarding does not improve training efficacy, but it is associated with a negatively valenced affective state, bringing support to the hypothesis that partial rewarding might negatively affect dogs' welfare.

Effects of early life and current housing on sensitivity to reward loss in a successive negative contrast test in pigs

Animals in a negative affective state seem to be more sensitive to reward loss, i.e. an unexpected decrease in reward size. The aim of this study was to investigate whether early-life and current enriched vs. barren housing conditions affect the sensitivity to reward loss in pigs using a successive negative contrast test. Pigs (n = 64 from 32 pens) were housed in barren or enriched conditions from birth onwards, and at 7 weeks of age experienced either a switch in housing conditions (from barren to enriched or vice versa) or not. Allotting pigs to the different treatments was balanced for coping style (proactive vs. reactive). One pig per pen was trained to run for a large reward and one for a small reward. Reward loss was introduced for pigs receiving the large reward after 11 days (reward downshift), i.e. from then onwards, they received the small reward. Pigs housed in barren conditions throughout life generally had a lower probability and higher latency to get the reward than other pigs. Proactive pigs ran overall slower than reactive pigs. After the reward downshift, all pigs ran slower. Nevertheless, reward downshift increased the latency and reduced the probability to get to the reward, but only in pigs exposed to barren conditions in early life, which thus were more sensitive to reward loss than pigs from enriched early life housing. In conclusion, barren housed pigs seemed overall less motivated for the reward, and early life housing conditions had long-term effects on the sensitivity to reward loss.

Do dogs experience frustration? New contributions on successive negative contrast in domestic dogs (Canis familiaris)

An unexpected change in reward quantity or quality frequently elicits a sharp decrease of responses as well as a negative emotional state. This phenomenon is called successive negative contrast (SNC) and, although it has been observed in numerous mammals, results in dogs have been inconsistent. The aim of this study was to evaluate SNC in dogs, comparing the effects of rewards of different qualities in a non-social task carried out in the dogs' usual environment. Dogs were separated into two experimental groups that experienced a downshift from a high quality reward (liver or sausage) to a low quality one (dry food), as well as a control group that always received dry food. The task involved a dog toy with bone shaped pieces that had to be removed to get the food hidden underneath. When the reward changed from liver to dry food, dogs picked up significantly fewer bones than the control group. However, this effect was not observed with sausage. Results show SNC in dogs in a non-social task carried out in their home environment. Additionally, the importance of the discrepancy in the hedonic value of the rewards is highlighted.

Behavioural responses to unexpected changes in reward quality

Successive negative contrast (SNC) effects are changes in anticipatory or consummatory behaviour when animals unexpectedly receive a lower value reward than they have received previously. SNC effects are often assumed to reflect frustration and appear to be influenced by background affective state. However, alternative explanations of SNC, such as the functional-search hypothesis, do not necessarily imply an aversive affective state. We tested 18 dogs in a SNC paradigm using a patch foraging task. Dogs were tested in two conditions, once with the low value reward in all of five trials (unshifted) and once when reward value was altered between high and low (shifted). Following a reward downshift, subjects showed a SNC effect by switching significantly more often between patches compared to the unshifted condition. However, approach latency, foraging time and quantity consumed did not differ between conditions, suggesting non-affective functional search behaviour rather than frustration. There was no relationship between strength of SNC and anxiety-related behaviours as measured in a novel object test and a personality questionnaire (C-BARQ). However, associations with the C-BARQ scores for Trainability and Stranger directed aggression suggest a possible link with behavioural flexibility and coping style. While reward quality clearly affects incentive motivation, the relationship between SNC, frustration and background affective state requires further exploration.

A reappraisal of successive negative contrast in two populations of domestic dogs

When an anticipated food reward is unexpectedly reduced in quality or quantity, many mammals show a successive negative contrast (SNC) effect, i.e. a reduction in instrumental or consummatory responses below the level shown by control animals that have only ever received the lower-value reward. SNC effects are believed to reflect an aversive emotional state, caused by the discrepancy between the expected and the actual reward. Furthermore, how animals respond to such discrepancy has been suggested to be a sign of animals’ background mood state. However, the occurrence and interpretation of SNC effects are not unequivocal, and there is a relative lack of studies conducted outside of laboratory conditions. Here, we tested two populations of domestic dogs (24 owned pet dogs and 21 dogs from rescue kennels) in a SNC paradigm following the methodology by Bentosela et al. (J Comp Psychol 123:125–130, 2009), using a design that allowed a within-, as well as a between-, subjects analysis. We found no evidence of a SNC effect in either population using a within- or between-subjects design. Indeed, the within-subjects analysis revealed a reverse SNC effect, with subjects in the shifted condition showing a significantly higher level of response, even after they received an unexpected reduction in reward quality. Using a within-, rather than a between-, subjects design may be beneficial in studies of SNC due to higher sensitivity and statistical power; however, order effects on subject performance need to be considered. These results suggest that this particular SNC paradigm may not be sufficiently robust to replicate easily in a range of environmental contexts and populations.

Behavioral neuroscience of psychological pain

Pain is a common word used to refer to a wide range of physical and mental states sharing hedonic aversive value. Three types of pain are distinguished in this article: Physical pain, an aversive state related to actual or potential injury and disease; social pain, an aversive emotion associated to social exclusion; and psychological pain, a negative emotion induced by incentive loss. This review centers on psychological pain as studied in nonhuman animals. After covering issues of terminology, the article briefly discusses the daily-life significance of psychological pain and then centers on a discussion of the results originating from two procedures involving incentive loss: successive negative contrast-the unexpected devaluation of a reward-and appetitive extinction-the unexpected omission of a reward. The evidence reviewed points to substantial commonalities, but also some differences and interactions between physical and psychological pains. This evidence is discussed in relation to behavioral, pharmacological, neurobiological, and genetic factors that contribute to the multidimensional experience of psychological pain.