Adjunctive behaviors are operants

The neuropharmacological profile of interval responding during operant tasks

Responses occurring during intervals of operant tasks have been subdivided as interim, facultative, and terminal, depending on the time between response onset and reward. Although interval responses, also known as adjunctive responses, have been described in pigeons, rats, mice, monkeys, and humans, most experiments have been conducted in rats. We review the neurochemical basis of interval responses and examine the hypothesis that these responses modulate operant performance. Preliminary experiments indicate the involvement of biogenic amines, acetylcholine, and GABA during interval responding associated with operant tasks. In particular, catecholaminergic deafferentation of the basal ganglia modulated interval responses as did the peripheral injection of catecholamine reuptake blockers. Under the influence of amphetamine, interval responding may either increase or decrease, so that a wide range of responses must be selected to gauge drug effects. In non-drugged pigeons and rats, the expression of interval responses facilitates operant training.

Mutual facilitation between activity-based anorexia and schedule-induced polydipsia in rats

The objective of this study was to evaluate the possible relationship between drinking (licks) in the schedule-induced polydipsia (SIP) phenomenon and running (turns in the wheel) in the activity-based anorexia (ABA) one. Within-subjects counterbalanced experiments were designed with male Wistar rats which underwent both behavioral procedures; half of them performed the ABA procedure first and the other half the SIP procedure first. In Experiment 1, the initial development of ABA facilitated the subsequent acquisition of SIP, whereas the first acquisition of SIP retarded the subsequent development of ABA. Given that SIP exposure implied food restriction, it could be that adaptation to the food regime contributed to lowering ABA manifestation. Thus, Experiment 2 was carried out in exactly the same way as Experiment 1, with the exception that animals which first went through SIP prior to undergoing the ABA procedure had no food restriction. In this case, both ABA and SIP as first experiences facilitated the further development of SIP and ABA, respectively. This suggests that running in ABA may be functionally similar to drinking in SIP; therefore, both behaviors can be thought of as induced by the schedule/regime of intermittent food availability.

The development of compulsive coping behavior depends on dorsolateral striatum dopamine-dependent mechanisms

Humans greatly differ in how they cope with stress, a natural behavior learnt through negative reinforcement. Some individuals engage in displacement activities, others in exercise or comfort eating, and others still in alcohol use. Across species, adjunctive behaviors, such as polydipsic drinking, are used as a form of displacement activity that reduces stress. Some individuals, in particular those that use alcohol to self-medicate, tend to lose control over such coping behaviors, which become excessive and compulsive. However, the psychological and neural mechanisms underlying this individual vulnerability have not been elucidated. Here we tested the hypothesis that the development of compulsive adjunctive behaviors stems from the functional engagement of the dorsolateral striatum (DLS) dopamine-dependent habit system after a prolonged history of adjunctive responding. We measured in longitudinal studies in male Sprague Dawley rats the sensitivity of early established vs compulsive polydipsic water or alcohol drinking to a bilateral infusion into the anterior DLS (aDLS) of the dopamine receptor antagonist α-flupentixol. While most rats acquired a polydipsic drinking response with water, others only did so with alcohol. Whether drinking water or alcohol, the acquisition of this coping response was insensitive to aDLS dopamine receptor blockade. In contrast, after prolonged experience, adjunctive drinking became dependent on aDLS dopamine at a time when it was compulsive in vulnerable individuals. These data suggest that habits may develop out of negative reinforcement and that the engagement of their underlying striatal system is necessary for the manifestation of compulsive adjunctive behaviors.

Theory of reinforcement schedules

The three principles of reinforcement are (1) events such as incentives and reinforcers increase the activity of an organism; (2) that activity is bounded by competition from other responses; and (3) animals approach incentives and their signs, guided by their temporal and physical conditions, together called the "contingencies of reinforcement." Mathematical models of each of these principles comprised mathematical principles of reinforcement (MPR; Killeen, 1994). Over the ensuing decades, MPR was extended to new experimental contexts. This article reviews the basic theory and its extensions to satiation, warm-up, extinction, sign tracking, pausing, and sequential control in progressive-ratio and multiple schedules. In the latter cases, a single equation balancing target and competing responses governs behavioral contrast and behavioral momentum. Momentum is intrinsic in the fundamental equations, as behavior unspools more slowly from highly aroused responses conditioned by higher rates of incitement than it does from responses from leaner contexts. Habits are responses that have accrued substantial behavioral momentum. Operant responses, being predictors of reinforcement, are approached by making them: The sight and feel of a paw on a lever is approached by placing paw on lever, as attempted for any sign of reinforcement. Behavior in concurrent schedules is governed by approach to momentarily richer patches (melioration). Applications of MPR in behavioral pharmacology and delay discounting are noted.

Environmental enrichment accelerates the acquisition of schedule-induced drinking in rats

Environmental enrichment (EE) provides an improvement in the housing conditions of experimental animals, such as laboratory rats, with greater physical and social stimulation through toys and company in the home cages. Its use is known to influence performance of experimental protocols, but these effects have not been well determined in the schedule-induced drinking (SID) procedure. The main goal of this study was to investigate the effects of EE on the acquisition of SID in 24 12-week-old male Wistar rats, divided into two groups, a group with EE housed with toys and companions, and a group without enrichment in individual housing conditions without toys (social isolation and no environmental enrichment, INEE). A total of 25 sessions, under a fixed time 30 s food reinforcement schedule and with access to water in the experimental chambers were carried out. Sessions lasted 30 min. The results showed that the EE group developed faster the excessive drinking pattern of SID, and drank to higher levels, than the INEE group. The greater development of SID in the EE group contradicts the view of schedule-induced behavior as linked to stress reduction and better suits with the conception of induction related to positive reinforcement.

Motivated to time: Effects of reinforcer devaluation and opportunity cost on interval timing

Prior research suggests that interval timing performance is sensitive to reinforcer devaluation effects and to the rate of competing sources of reinforcement. The present study sought to replicate and account for these findings in rats. A self-paced concurrent fixed-interval (FI) random-ratio (RR) schedule of reinforcement was implemented in which the FI requirement varied across training conditions (12, 24, 48 s). The RR requirement-which imposed an opportunity cost to responding on the FI component-was adjusted so that it took about twice the FI requirement, on average, to complete it. Probe reinforcer devaluation (prefeeding) sessions were conducted at the end of each condition. To assess the effect of contextual reinforcement on timing performance, the RR requirement was removed before the end of the experiment. Consistent with prior findings, performance on the FI component tracked schedule requirement and displayed scalar invariance; the removal of the RR component yielded more premature FI responses. For some rats, prefeeding reduced the number of trials initiated without affecting timing performance; for other rats, prefeeding delayed responding on the FI component but had a weaker effect on trial initiation. These results support the notion that timing and motivational processes are separable, suggesting novel explanations for ostensible motivational effects on timing performance.

Topographical aspects of brief-stimulus presentations: A re-examination of the problem of conditioned reinforcement

Three pigeons were exposed to second-order schedules in which responding under a fixed-interval (FI) component schedule was reinforced according to a variable-interval (VI) schedule of food reinforcement. Completion of each component resulted in either (1) brief presentation of a stimulus present during reinforcement (paired brief stimulus), (2) brief presentation of a stimulus not present during reinforcement (nonpaired brief stimulus), or (3) no stimulus presentation (tandem schedule). Under the two nonpaired brief stimulus conditions, either a change in keylight color or onset of houselight illumination was used as the brief stimulus. Similar patterns of keypecking occurred under tandem and nonpaired keylight brief-stimulus presentations, whereas nonpaired houselight brief-stimulus presentations generated positively accelerated within-component keypeck patterning for two pigeons. When the same keylight brief stimulus was paired with food, positively accelerated patterns of keypecking were obtained for all pigeons. Differences in the effects of nonpaired brief-stimulus presentations on second-order schedule performance suggest that component schedule patterning under nonpaired brief-stimulus procedures is a function of the particular type of stimulus used (i.e., houselight versus keylight). These results suggest that (1) brief houselight illumination may function as a sensory reinforcer, and (2) a briefly presented food-paired stimulus can function as an effective conditioned reinforcer.

The development of compulsive coping behaviour is associated with a downregulation of Arc in a Locus Coeruleus neuronal ensemble

Some compulsive disorders have been considered to stem from the loss of control over coping strategies, such as displacement. However, the cellular mechanisms involved in the acquisition of coping behaviours and their subsequent compulsive manifestation in vulnerable individuals have not been elucidated. Considering the role of the locus coeruleus (LC) noradrenaline-dependent system in stress and related excessive behaviours, we hypothesised that neuroplastic changes in the LC may be associated with the acquisition of an adjunctive polydipsic water drinking, a prototypical displacement behaviour, and the ensuing development of compulsion in vulnerable individuals. Thus, male Sprague Dawley rats were characterised for their tendency, or not, to develop compulsive polydipsic drinking in a schedule-induced polydipsia (SIP) procedure before their fresh brains were harvested. A new quantification tool for RNAscope assays revealed that the development of compulsive adjunctive behaviour was associated with a low mRNA copy number of the plasticity marker Arc in the LC which appeared to be driven by specific adaptations in an ensemble of tyrosine hydroxylase (TH)+, zif268- neurons. This ensemble was specifically engaged by the expression of compulsive adjunctive behaviour, not by stress, because its functional recruitment was not observed in individuals that no longer had access to the water bottle before sacrifice, while it consistently correlated with the levels of polydipsic water drinking only when it had become compulsive. Together these findings suggest that downregulation of Arc mRNA levels in a population of a TH+/zif268- LC neurons represents a signature of the tendency to develop compulsive coping behaviours.

Dramatic increase in lever-pressing activity in rats after training on the progressive ratio schedule of cocaine self-administration

Transition from the highest rate of lever-pressing activity during the unloading (extinction) phase of a cocaine self-administration session to an extremely low activity rate during the remission phase is in many cases gradual. This makes it difficult to assess the duration of the unloading phase after a fixed ratio 1 (FR1) or breakpoint after a progressive-ratio (PR) self-administration session. In addition, 3–5 days of training under the PR schedule results in a dramatic and persistent increase in the rate of presses during PR sessions and in the unloading phase following FR1 self-administration sessions. The goals of this study were to find the definition of the last press demarcating the border between the unloading and remission phases of the session and to determine if this border was also affected by PR training. Rats were trained to self-administer cocaine under the FR1 schedule and then under the PR schedule of drug delivery. Distributions of inter-press intervals (IPIs) during the unloading phase in sessions before and after PR training were compared. It was found that the distribution of cocaine-induced IPIs during the unloading phase was lognormal, bimodal, and independent of previously injected cocaine unit doses. The first mode represented intervals within the short bouts of stereotypic presses and the second mode represented intervals between bouts. The two modes were approximately 0.7 s and 21 s during unloading prior to and 0.6 s and 1.5 s after PR self-administration training. The total number of presses per unloading phase increased eightfold. When the FR1 schedule was restored, the intervals between bouts remained very short for at least 7–10 days and only then started a gradual increase towards baseline levels. The last unloading press was defined as the press followed by the IPI longer than the defined criterion. PR training resulted in a substantial and long-lasting increase in lever-pressing activity during unloading. The duration of the unloading phase did not depend on the rate of lever-pressing activity.

Longer operant lever-press duration requirements induce fewer but longer response bouts in rats

Operant behavior is organized in bouts that are particularly visible under variable-interval (VI) schedules of reinforcement. Previous research showed that increasing the work required to produce a response decreases the rate at which bouts are emitted and increases the minimum interresponse time (IRT). In the current study, the minimum effective IRT was directly manipulated by changing the minimum duration of effective lever presses reinforced on a VI 40-s schedule. Contrary to assumptions of previous models, response durations were variable. Response durations were typically 0.5 s greater than the minimum duration threshold; durations that exceeded this threshold were approximately log-normally distributed. As the required duration threshold increased, rats emitted fewer but longer bouts. This effect may reflect an effort-induced reduction in motivation and a duration-induced facilitation of a response-outcome association.

Effects of pre-operant running and sucrose concentration on operant wheel running on a fixed interval schedule of reinforcement

Prior research proposed that temporal control over the pattern of operant wheel running on a fixed interval (FI) schedule of sucrose reinforcement is a function of automatic reinforcement generated by wheel running and the experimentally arranged sucrose reinforcement. Two experiments were conducted to assess this prediction. In the first experiment, rats ran for different durations (0, 30, 60, and 180 min) prior to a session of operant wheel running on a FI 120-s schedule. In the second experiment, the concentration of sucrose reinforcement on a FI 180-s schedule was varied across values of 0, 5, 15, and 25%. In Experiment 1, as the duration of pre-operant running increased, the postreinforcement pause before initiation of running lengthened while wheel revolutions in the latter part of the FI interval increased. In Experiment 2, wheel revolutions markedly increased then decreased to a plateau early in the FI interval. Neither manipulation increased temporal control of the pattern of wheel running. Instead, results indicate that operant wheel running is regulated by automatic reinforcement generated by wheel activity and an adjunctive pattern of running induced by the temporal presentation of sucrose. Furthermore, the findings question whether the sucrose contingency regulates wheel running as a reinforcing consequence.

The Relevance of Operant Behavior in Conceptualizing the Psychological Well-Being of Captive Animals

The term "psychological well-being" is used in reference to husbandry with animals in human care settings such as research, agriculture, and zoos. This article seeks to clarify and conceptualize the term based upon two approaches that draw from several bodies of literature: the experimental analysis of behavior, experimental psychology, animal welfare and husbandry, farm animal behavior, zoo husbandry, and ethology. One approach focuses on the presence of problem behavior such as stereotypies, depressive-like behavior, and aggression, and emphasizes the conditions under which aberrant behavior in animals under human care occurs. The second approach examines what might be considered wellness by emphasizing opportunities to engage with its environment, or the absence of such opportunities, even if problematic behavior is not exhibited. Here, access to an interactive environment is relatively limited so opportunities for operant (voluntary) behavior could be considered. Designing for operant behavior provides opportunities for variability in both behavior and outcomes. Operant behavior also provides control over the environment, a characteristic that has been a core assumption of well-being. The importance of interactions with one's environment is especially evident in observations that animals prefer opportunities to work for items necessary for sustenance, such as food, over having them delivered freely. These considerations raise the importance of operant behavior to psychological well-being, especially as benefits to animals under human care.

Behavior Stability and Individual Differences in Pavlovian Extended Conditioning

How stable and general is behavior once maximum learning is reached? To answer this question and understand post-acquisition behavior and its related individual differences, we propose a psychological principle that naturally extends associative models of Pavlovian conditioning to a dynamical oscillatory model where subjects have a greater memory capacity than usually postulated, but with greater forecast uncertainty. This results in a greater resistance to learning in the first few sessions followed by an over-optimal response peak and a sequence of progressively damped response oscillations. We detected the first peak and trough of the new learning curve in our data, but their dispersion was too large to also check the presence of oscillations with smaller amplitude. We ran an unusually long experiment with 32 rats over 3,960 trials, where we excluded habituation and other well-known phenomena as sources of variability in the subjects' performance. Using the data of this and another Pavlovian experiment by Harris et al. (2015), as an illustration of the principle we tested the theory against the basic associative single-cue Rescorla–Wagner (RW) model. We found evidence that the RW model is the best non-linear regression to data only for a minority of the subjects, while its dynamical extension can explain the almost totality of data with strong to very strong evidence. Finally, an analysis of short-scale fluctuations of individual responses showed that they are described by random white noise, in contrast with the colored-noise findings in human performance.

Appetitive conditioning task in a shuttle box and its comparison with the active avoidance paradigm

The main features of the Shuttle Box Active Avoidance paradigm (e.g., the use of simple locomotor response as an operant and electrical current as a primary reinforcer) make this task easily automated. However, learning in this paradigm cannot be easily separated from the specificity of fear motivation. Punishment and negative reinforcement highly affect behavior in this task and complicate learning. In the present study, we describe a novel computer-controlled appetitive task in a shuttle box and compare it with active avoidance. The appetitive task was performed in the same shuttle box apparatus, additionally equipped with food dispensers in each compartment, and using a similar protocol. The reinforced reaction included the transition to the feeder in the opposite compartment in response to a stimulus. Animals mastered the appetitive task faster than the active avoidance task in the shuttle box. Other major differences between the models were the number and dynamics of intertrial responses (ITRs). Whereas in active avoidance the number of ITRs was low during learning, in the appetitive task rates were higher and they persisted throughout learning. Overall, the findings demonstrate some benefits of the appetitive task as a control condition to active avoidance: the use of a similar reaction and apparatus, no prior habituation, and fast acquisition.

Culture and Child Attachment Patterns: a Behavioral Systems Synthesis

We propose that the two dominant culture institutions (individualist and collectivist) are neither learned nor cognitively represented by the people who practice them. Instead, they exist as group-level payoff structures that reflect differential distributions of child attachment patterns within a society. Individualist societies reflect an overrepresentation of insecure-avoidant attachments and collectivist societies reflect an overrepresentation of insecure-anxious attachments. Moreover, attachment patterns are embodied rather than representational-schedule-induced rather than incrementally shaped or verbally learned. If attachment patterns are schedule-induced, the prospects are poorer for effecting cultural change through economic incentives or informational campaigns (top-down). Rather, cultural practices will be responsive to changes in family practices-to the extent they affect attachment patterns (bottom-up). For example, if breastfeeding rates decline or the workforce participation of women increases, a society will become more individualist and less collectivist. That is because those practices increase avoidant as compared to anxious attachments. Moreover, because insecurely attached children are behaviorally less flexible than are securely attached children, the former have a greater impact on cultural practices than do the latter.

Effect of Schedule-Induced Behavior on Responses of Spontaneously Hypertensive and Wistar-Kyoto Rats in a Delay-Discounting Task: A Preliminary Report

Delay discounting is the loss of the subjective value of an outcome as the time to its delivery increases. It has been suggested that organisms can become more tolerant of this delay when engaging in schedule-induced behaviors. Schedule-induced behaviors are those that develop at a high rate during intermittent reinforcement schedules without the need of arranged contingency to the reinforcer, and they have been considered as a model of compulsivity. There is evidence that relates compulsivity to greater delay discounting. The rate of delay discounting represents how impulsive the subject is, as the rate of discounting increases the higher the impulsivity. Thus, the main purpose of this study was to undertake a preliminary evaluation of whether developing schedule-induced behaviors affects performance in a delay-discounting task, by comparing spontaneously hypertensive rats (SHRs) and Wistar-Kyoto (WKY) rats. The rats were exposed to a task that consisted of presenting the subjects with two levers: one produced a small, immediate food reinforcer while the other one produced a larger, delayed reinforcer. During Condition A, the levers were presented, and a water bottle and a running wheel were available in the conditioning chambers; during Condition B, only the levers were presented. SHR and WKY rats developed schedule-induced behaviors during Condition A and showed no difference in discounting rates, contradicting previous reports. Lick allocation during response-reinforcer delays and the inter-trial interval (ITI) showed, respectively, pre- and post-food distributions. Discounting rates during Condition B (when rats could not engage in schedule-induced behaviors) did not reach statistical significance difference among strains of animals, although it was observed a tendency for WKY to behave more self-controlled. Likewise it was not found any effect of schedule-induced behavior on discounting rates, however, a tendency for WKY rats to behave more impulsive during access to drink and run seems to tentatively support the idea of schedule-induced behavior as a model of compulsivity in those rats, being impulsivity simply defined as an excess in behavior.

The Bed Nucleus of the Stria Terminalis, Homeostatic Satiety, and Compulsions: What Can We Learn From Polydipsia?

A compulsive phenotype characterizes several neuropsychiatric illnesses - including but not limited to - schizophrenia and obsessive compulsive disorder. Because of its perceived etiological heterogeneity, it is challenging to disentangle the specific neurophysiology that precipitates compulsive behaving. Using polydipsia (or non-regulatory water drinking), we describe candidate neural substrates of compulsivity. We further postulate that aberrant neuroplasticity within cortically projecting structures [i.e., the bed nucleus of the stria terminalis (BNST)] and circuits that encode homeostatic emotions (thirst, hunger, satiety, etc.) underlie compulsive drinking. By transducing an inaccurate signal that fails to represent true homeostatic state, cortical structures cannot select appropriate and adaptive actions. Additionally, augmented dopamine (DA) reactivity in striatal projections to and from the frontal cortex contribute to aberrant homeostatic signal propagation that ultimately biases cortex-dependent behavioral selection. Responding becomes rigid and corresponds with both erroneous, inflexible encoding in both bottom-up structures and in top-down pathways. How aberrant neuroplasticity in circuits that encode homeostatic emotion result in the genesis and maintenance of compulsive behaviors needs further investigation.

Interactions between the effects of food and water motivating operations on food- and water-reinforced responding in mice

Two experiments examined interactions between the effects of food and water motivating operations (MOs) on the food- and water-reinforced operant behavior of mice. In Experiment 1, mice responded for sucrose pellets and then water reinforcement under four different MOs: food deprivation, water deprivation, concurrent food and water deprivation, and no deprivation. The most responding for pellets occurred under food deprivation and the most responding for water occurred under water deprivation. Concurrent food and water deprivation decreased responding for both reinforcers. Nevertheless, water deprivation alone increased pellet-reinforced responding and food deprivation alone likewise increased water-reinforced responding relative to no deprivation. Experiment 2 demonstrated that presession food during concurrent food and water deprivation increased in-session responding for water relative to sessions where no presession food was provided. Conversely, presession water during concurrent food and water deprivation did not increase in-session responding for pellets. These results suggest that a) the reinforcing value of a single stimulus can be affected by multiple MOs, b) a single MO can affect the reinforcing value of multiple stimuli, and c) reinforcing events can also function as MOs. We consider implications for theory and practice and suggest strategies for further basic research on MOs.

Exercise, diet, and the reinforcing value of food in an animal model of anorexia nervosa

Activity-based anorexia (ABA) develops when laboratory rats are subjected to a single meal per day and have access to an activity wheel for the remaining time. Here, we studied the contribution of exercise and diet to the reinforcing value of food during ABA development. Three groups of eight adult male Wistar rats were used: an ABA group with 21.5 hr (then 22 hr) of wheel access and 1 hr (then 30 min) of food access, a control group with the same time exposure to food but without exercise, and a yoked group to the ABA in terms of weight loss. Rats were daily tested on a progressive-ratio schedule to measure their motivation for food. ABA rats gradually reduced their body weight more than the food control group. Animals steadily increased their breaking points in parallel to losses in body weight, but no significant differences were found between groups. Adult rats can develop ABA, but their loss in weight neither resulted in a decrease of food intake nor in the motivation to obtain it.

Between-session memory degradation accounts for within-session changes in fixed-interval performance

A common assumption in the study of fixed-interval (FI) timing is that FI performance is largely stable within sessions, once it is stable between sessions. Within-session changes in FI performance were examined in published data (Daniels and Sanabria, 2017), wherein some rats were trained on a FI 30-s schedule of food reinforcement (FI30) and others on a FI 90-s schedule (FI90). Following stability, FI90 rats were pre-fed for five sessions. Response rates declined as a function of trial, due more to latency lengthening than to run-rate reduction. Latencies were best described by a dynamic gamma-exponential mixture distribution, in which latency lengthening was driven by the growth of the criterion pulse count for a response and not by a reduction in the speed of an endogenous clock. The speed of the clock was selectively sensitive to the length of the FI; the prevalence and length of exponentially-distributed latencies were selectively sensitive to pre-feeding. These findings reveal (a) that parameters governing FI latencies are selectively sensitive to a range of manipulations, (b) a potential degradation of the criterion pulse count between consecutive sessions, and (c) a subsequent recovery of the criterion pulse count within sessions.

Interval timing under a behavioral microscope: Dissociating motivational and timing processes in fixed-interval performance

The distribution of latencies and interresponse times (IRTs) of rats was compared between two fixed-interval (FI) schedules of food reinforcement (FI 30 s and FI 90 s), and between two levels of food deprivation. Computational modeling revealed that latencies and IRTs were well described by mixture probability distributions embodying two-state Markov chains. Analysis of these models revealed that only a subset of latencies is sensitive to the periodicity of reinforcement, and prefeeding only reduces the size of this subset. The distribution of IRTs suggests that behavior in FI schedules is organized in bouts that lengthen and ramp up in frequency with proximity to reinforcement. Prefeeding slowed down the lengthening of bouts and increased the time between bouts. When concatenated, latency and IRT models adequately reproduced sigmoidal FI response functions. These findings suggest that behavior in FI schedules fluctuates in and out of schedule control; an account of such fluctuation suggests that timing and motivation are dissociable components of FI performance. These mixture-distribution models also provide novel insights on the motivational, associative, and timing processes expressed in FI performance. These processes may be obscured, however, when performance in timing tasks is analyzed in terms of mean response rates.

Reinforcement of schedule-induced drinking in rats by lick-contingent shortening of food delivery

Schedule-induced drinking has been a theoretical question of concern ever since it was first described more than 50 years ago. It has been classified as adjunctive behavior; that is, behavior that is induced by an incentive but not reinforced by it. Nevertheless, some authors have argued against this view, claiming that adjunctive drinking is actually a type of operant behavior. If this were true, schedule-induced drinking should be controlled by its consequences, which is the major definition of an operant. The present study tested this hypothesis. In a first experimental phase, a single pellet of food was delivered at regular 90-s intervals, but the interfood interval could be shortened depending on the rat's licking. The degree of contingency between licking the bottle spout and hastening the delivery of the food pellet was 100 %, 50 %, and 0 % for 3 separate groups of animals. Rats that could shorten the interval (100 % and 50 % contingency) drank at a higher rate than those that could not (0 %), and the level of acquisition was positively related to the degree of contingency. In a second phase of the experiment, all groups were exposed to a 100 % contingency, which resulted in all rats developing high levels of schedule-induced drinking. Licking is enhanced if it hastens reinforcement, and can do so at delay characteristics of those present in studies of schedule-induced drinking, thus supporting the view that adjunctive behavior is an operant.

The Effect of Methylphenidate on the Microstructure of Schedule-Induced Polydipsia in an animal model of ADHD

Schedule-induced polydipsia (SIP) was established in spontaneously hypertensive rats (SHR), Wistar Kyoto rats (WKY), and Wistar rats, using a multiple fixed-time (FT) schedule of food delivery, with 30- and 90-s components. Thereafter, animals were exposed to methylphenidate (MPH; 2.5mg/kg/d) for six consecutive SIP sessions. A test to assess possible sensitization effects was also conducted four days after termination of the drug treatment. At baseline, FT 90-s produced longer and more frequent drinking episodes in SHR than in WKY. An analysis of the distribution of inter-lick intervals revealed that drinking was organized in bouts, which were shorter in SHR than in WKY. Across strains and schedules, MPH shifted drinking episodes towards the beginning of inter-food intervals, which may reflect a stimulant effect on SIP. MPH transiently reduced the frequency of drinking episodes in WKY in FT 30-s, and more permanently reduced the frequency of licking bouts in Wistar rats. MPH also increased the length of licking bouts in Wistar rats. Overall, SHR displayed a hyperactive-like pattern of drinking (frequent but short bouts), which 2.5mg/kg MPH appears to reduce in WKY and Wistar but not in SHR rats. It appears that therapeutic effects of MPH on hyperactive-like SIP require higher doses in SHR relative to control strains.

Coal Is Not Black, Snow Is Not White, Food Is Not a Reinforcer: The Roles of Affordances and Dispositions in the Analysis of Behavior

Reinforcers comprise sequences of actions in context. Just as the white of snow and black of coal depend on the interaction of an organism's visual system and the reflectances in its surrounds, reinforcers depend on an organism's motivational state and the affordances-possibilities for perception and action-in its surrounds. Reinforcers are not intrinsic to things but are a relation between what the thing affords, its context, the organism, and his or her history as capitulated in their current state. Reinforcers and other affordances are potentialities rather than intrinsic features. Realizing those potentialities requires motivational operations and stimulus contexts that change the state of the organism-they change its disposition to make the desired response. An expansion of the three-term contingency is suggested in order to help keep us mindful of the importance of behavioral systems, states, emotions, and dispositions in our research programs.

Effects of dopamine agents on a schedule-induced polydipsia procedure in the spontaneously hypertensive rat and in Wistar control rats

The spontaneously hypertensive rat (SHR) has been proposed as an animal model for attention deficit hyperactivity disorder (ADHD), and typically develops excessive patterns of response under most behavioural protocols. Schedule-induced polydipsia (SIP) is the excessive water consumption that occurs as a schedule effect when food is intermittently delivered and animals are partially food- but not water-deprived. SIP has been used as a model of excessive behaviour, and considerable evidence has involved the dopaminergic system in its development and maintenance. The aim of this study was to evaluate the effects of the most common psychostimulants used in ADHD treatment on SIP, comparing their effects in SHRs with rats from control populations. SHR, Wistar Kyoto (WKY) and Wistar rats were submitted to a multiple fixed time (FT) food schedule with two components: 30 s and 90 s. The acute effects of different dopaminergic compounds were evaluated after 40 sessions of SIP acquisition. All animals showed higher adjunctive drinking under FT 30 s than FT 90 s, and SHRs displayed higher asymptotic SIP levels in FT 90 s compared to WKY and Wistar rats. SHRs were less sensitive to dopaminergic agents than control rats in terms of affecting rates of adjunctive drinking. These differences point to an altered dopaminergic system in the SHR and provide new insights into the neurobiological basis of ADHD pharmacological treatments.

Development of bingeing in rats altered by a small operant requirement

Previous studies have shown that providing an optional food for a brief period of time to non-food deprived rats on an intermittent basis in the home cage engenders significantly more intake (binge-type behavior) than when the optional food is provided for a brief period on a daily basis. Experiment 1 examined the effects of placing a small operant response requirement on access to an optional food (vegetable shortening) on the establishment of binge-type behavior. Experiment 2 examined the effects of different schedules of reinforcement, a period of abstinence from shortening, and 24h of food deprivation on established binge-type behavior. In Experiment 1 the group of rats with 30-min access to shortening on an intermittent basis in their home cages (IC) consumed significantly more shortening than the group with 30-min daily access in the home cage (DC). The group with 30-min intermittent access in an operant chamber (IO group) earned significantly more reinforcers than the group with 30-min daily access in an operant chamber (DO). In Experiment 2, the IO group earned significantly more reinforcers than the DO group regardless of the response cost, the period of shortening abstinence, and overnight food deprivation. These results demonstrate that while intermittent access generates binge-type eating, the size of the binge (intake) can be altered by different contingency arrangements.

Activation of serotonin 5-HT2A receptors inhibits high compulsive drinking on schedule-induced polydipsia

RATIONALE

Schedule-induced polydipsia (SIP) is an established model for studying compulsive behaviour in rats. Serotoninergic drugs effectively reduce compulsive drinking on SIP, and high compulsive drinker rats selected by SIP have shown differences in serotoninergic brain activity. However, the specific serotoninergic receptors that modulate compulsive SIP remain unclear.

OBJECTIVE

We investigated the functional role of serotonin 5-hydroxytryptamine 2A or C (5-HT2A/C) receptors in compulsive SIP behaviour.

METHODS

Rats were selected for low (LD) versus high drinking (HD) behaviour on SIP. The effects of the systemic administration of the selective serotonin reuptake inhibitor citalopram, selective norepinephrine reuptake inhibitor atomoxetine, serotonin 5-HT2A/C receptor agonist DOI hydrochloride ((±)-2,5-dimethoxy-4-iodoamphetamine), serotonin 5-HT2C receptor antagonist SB242084, serotonin 5-HT2A receptor antagonist ketanserin and M100907 were assessed on SIP. Subsequently, the effects of DOI were tested after the pre-administration of SB242084, ketanserin and M100907 on SIP.

RESULTS

Citalopram and DOI reduced compulsive drinking in HD compared with LD rats on SIP. In contrast, SB242084 increased compulsive drinking in HD compared with LD rats on SIP. Atomoxetine, ketanserin and M100907 had no effect on SIP. The reduction in water intake produced by DOI was blocked by ketanserin and M100907, but not by SB242084 administration, in HD rats.

CONCLUSIONS

These findings highlight the contribution of serotoninergic 5-HT2A/C receptors compared with noradrenergic mechanisms on SIP and reveal the "therapeutic" activation of serotonin 5-HT2A in the inhibition of the compulsive drinking behaviour in HD rats. Thus, it may represent a potentially new marker of vulnerability and provides additional insight for potential treatments on compulsive behaviours in neuropsychiatric populations.

A microstructural analysis of schedule-induced polydipsia reveals incentive-induced hyperactivity in an animal model of ADHD

Recent research has suggested that frequent short bursts of activity characterize hyperactivity associated with attention deficit hyperactivity disorder (ADHD). This study determined whether such pattern is also visible in schedule-induced polydipsia (SIP) in the spontaneously hypertensive rat (SHR), an animal model of ADHD. Male SHR, Wistar Kyoto (WKY) and Wistar rats were exposed to 40 sessions of SIP using a multiple fixed-time (FT) schedule of food delivery with FT 30-s and FT 90-s components. Stable performance was analyzed to determine the extent to which SIP-associated drinking is organized in bouts. The Bi-Exponential Refractory Model (BERM) of free-operant performance was applied to schedule-induced licks. A model comparison analysis supported BERM as a description of SIP episodes: licks were not produced at a constant rate but organized into bouts within drinking episodes. FT 30-s induced similar overall licking rates, latencies to first licks and episode durations across strains; FT 90-s induced longer episode durations in SHRs and reduced licking rate in WKY and Wistar rats to nearly baseline levels. Across schedules, SHRs made more and shorter bouts when compared to the other strains. These results suggest an incentive-induced hyperactivity in SHR that has been observed in operant behaviour and in children with ADHD.

Different relations between schedule-induced polydipsia and impulsive behaviour in the Spontaneously Hypertensive Rat and in high impulsive Wistar rats: questioning the role of impulsivity in adjunctive behaviour

Rats belonging to three different strains (15 Wistar, 8 Spontaneously Hypertensive - SHR- and 8 Wistar Kyoto - WKY-) were used to evaluate the possible relationship between different levels of impulsivity and development of schedule-induced polydipsia (SIP). We first measured the rats' levels of impulsivity by means of delay-discounting and indifference-point procedures. Secondly, development of SIP was studied under a series of fixed time 15, 30, 60 and 120s food schedules, which were counterbalanced by means of a Latin-square design. Finally, we re-assessed the rats' levels of impulsivity by replicating the delay-discounting test. The findings showed that, starting from equivalent levels of impulsivity, development of SIP differed among the groups of rats. In comparison with the rest of the animals, the SHRs were observed to attain elevated drinking rates under SIP. On the other hand, the Wistar rats which had initial high impulsivity levels similar to those of the SHRs, displayed the lowest rates of induced drinking. Moreover, low levels of impulsivity in Wistar rats prior to SIP acquisition were reflected into high drinking rates. Relation of SIP and impulsivity is questioned by present results, which gives ground to the understanding of the behavioural mechanisms involved in adjunctive behaviour and its usefulness as an animal model of excessive behaviour.

The lack of side effects of an ineffective treatment facilitates the development of a belief in its effectiveness

Some alternative medicines enjoy widespread use, and in certain situations are preferred over conventional, validated treatments in spite of the fact that they fail to prove effective when tested scientifically. We propose that the causal illusion, a basic cognitive bias, underlies the belief in the effectiveness of bogus treatments. Therefore, the variables that modulate the former might affect the latter. For example, it is well known that the illusion is boosted when a potential cause occurs with high probability. In this study, we examined the effect of this variable in a fictitious medical scenario. First, we showed that people used a fictitious medicine (i.e., a potential cause of remission) more often when they thought it caused no side effects. Second, the more often they used the medicine, the more likely they were to develop an illusory belief in its effectiveness, despite the fact that it was actually useless. This behavior may be parallel to actual pseudomedicine usage; that because a treatment is thought to be harmless, it is used with high frequency, hence the overestimation of its effectiveness in treating diseases with a high rate of spontaneous relief. This study helps shed light on the motivations spurring the widespread preference of pseudomedicines over scientific medicines. This is a valuable first step toward the development of scientifically validated strategies to counteract the impact of pseudomedicine on society.