Habituation contributes to within-session changes in free wheel running

A preliminary evaluation of habituation and dishabituation of operant responding in mice

Previous research has suggested that operant response decrements within experimental sessions are due in part to habituation to the repeated presentation of reinforcers. One way to assess the role of habituation in within-session response decrements is to conduct a test for dishabituation, a phenomenon in which a habituated response to a given stimulus recovers following the presentation of some strong or novel stimulus other than the habituated stimulus. Dishabituation of operant responding has been demonstrated on several occasions in the literature, but studies with non-human subjects have thus far been limited to those using rats and pigeons. Two experiments attempting to replicate these findings with mice were conducted. Two groups of mice nose-poked for a sweetened condensed milk/water reinforcer on either a fixed-ratio 4 or variable-interval 15 s schedule of reinforcement. During testing, baseline sessions were then alternated with two test conditions and a control condition. Test conditions included a 5 s auditory stimulus or flashing of the house light presented mid-session. Control conditions were identical to baseline. Dishabituation was not observed for either group in Experiment 1. In Experiment 2, dishabituation was not observed for the fixed-ratio 4 group but was observed for the variable interval 15 s group. Considerations for further study of operant dishabituation in mice are discussed.

Preliminary Evaluations of Habituation of Operant Responding for Sensory Stimuli in Humans

Research suggests that repetitive reinforcers wane in their ability to maintain operant behavior in a manner consistent with habituation. Weaker reinforcers, including sensory stimuli common in human work, may be most impacted by repetition. The present research examined within-session operant responding patterns for visual stimuli in humans from two experiments assessing multiple characteristics of habituation. In Experiment 1, declines in reinforced responding were assessed and stimulus specificity was evaluated to test habituation's contribution to these declines. Seventy-three participants completed two visits, both including a reinforcement paradigm using pictures. With repetition, operant responding declined. The stimulus specificity manipulation did not enhance responding, suggesting that habituation did not contribute to response declines. Several methodological concerns may have contributed to the absence of a stimulus specificity effect. Experiment 2 assessed a separate habituation characteristic, rate of stimulation, to address these methodological concerns and further evaluate habituation. Twenty-eight participants completed the reinforcement paradigm over three visits. Decline in responding was partially supported, but the rate of stimulation did not alter declines. In sum, habituation's contribution to within-session declines for sensory reinforcers was not evident in either experiment. These results suggest that assessment of habituation of sensory reinforcers in humans may require parametric evaluation.

Continuous Aerobic Training in Individualized Intensity Avoids Spontaneous Physical Activity Decline and Improves MCT1 Expression in Oxidative Muscle of Swimming Rats

Although aerobic training has been shown to affect the lactate transport of skeletal muscle, there is no information concerning the effect of continuous aerobic training on spontaneous physical activity (SPA). Because every movement in daily life (i.e., SPA) is generated by skeletal muscle, we think that it is possible that an improvement of SPA could affect the physiological properties of muscle with regard to lactate transport. The aim of this study was to evaluate the effect of 12 weeks of continuous aerobic training in individualized intensity on SPA of rats and their gene expressions of monocarboxylate transporters (MCT) 1 and 4 in soleus (oxidative) and white gastrocnemius (glycolytic) muscles. We also analyzed the effect of continuous aerobic training on aerobic and anaerobic parameters using the lactate minimum test (LMT). Sixty-day-old rats were randomly divided into three groups: a baseline group in which rats were evaluated prior to initiation of the study; a control group (Co) in which rats were kept without any treatment during 12 weeks; and a chronic exercise group (Tr) in which rats swam for 40 min/day, 5 days/week at 80% of anaerobic threshold during 12 weeks. After the experimental period, SPA of rats was measured using a gravimetric method. Rats had their expression of MCTs determined by RT-PCR analysis. In essence, aerobic training is effective in maintaining SPA, but did not prevent the decline of aerobic capacity and anaerobic performance, leading us to propose that the decline of SPA is not fully attributed to a deterioration of physical properties. Changes in SPA were concomitant with changes in MCT1 expression in the soleus muscle of trained rats, suggestive of an additional adaptive response toward increased lactate clearance. This result is in line with our observation showing a better equilibrium on lactate production-remotion during the continuous exercise (LMT). We propose an approach to combat the decline of SPA of rats in their home cages. This new finding is worth for scientists who work with animal models to study the protective effects of exercise.

The HIV-1 transgenic rat model of neuroHIV

Despite the ability of current combination anti-retroviral therapy (cART) to limit the progression of HIV-1 to AIDS, HIV-positive individuals continue to experience neuroHIV in the form of HIV-associated neurological disorders (HAND), which can range from subtle to substantial neurocognitive impairment. NeuroHIV may also influence substance use, abuse, and dependence in HIV-positive individuals. Because of the nature of the virus, variables such as mental health co-morbidities make it difficult to study the interaction between HIV and substance abuse in human populations. Several rodent models have been developed in an attempt to study the transmission and pathogenesis of the HIV-1 virus. The HIV-1 transgenic (HIV-1Tg) rat is a reliable model of neuroHIV because it mimics the condition of HIV-infected patients on cART. Research using this model supports the hypothesis that the presence of HIV-1 viral proteins in the central nervous system increases the sensitivity and susceptibility of HIV-positive individuals to substance abuse.

Stimulus specificity and dishabituation of operant responding in humans

Habituation has recently been addressed within the operant conditioning paradigm. While the literature on this topic is growing, the examination of dishabituation, a fundamental characteristic of habituation, remains limited. This study expanded research on habituation of operant responding in non-human animals to research involving humans. Specifically, dishabituation and stimulus specificity were examined under a variety of conditions involving changes in the reinforcer type, reinforcement schedule, reinforcer amount, and selected properties of the antecedent stimuli for a computerized task with 46 undergraduate students. An additional 3 participants were exposed to a control condition. Evaluation of within session patterns of responding indicates that the introduction of stimulus changes into the operant context reliably produced dishabituation of operant responding in humans.

Dynamic changes in reinforcer effectiveness: satiation and habituation have different implications for theory and practice

Reinforcers lose their effectiveness when they are presented repeatedly. Early researchers labeled this loss of effectiveness as satiation without conducting an experimental analysis. When such an analysis is conducted, habituation provides a more precise and empirically accurate label for the changes in reinforcer effectiveness. This paper reviews some of the data that suggest that habituation occurs to repeatedly presented reinforcers. It also argues that habituation has surprisingly different implications than satiation for theory and practice in behavior analysis. For example, postulating that habituation occurs to repeatedly presented reinforcers suggests ways for maintaining the strength of an existing reinforcer and for weakening the strength of a problematic reinforcer that differ from those implied by an account in terms of satiation. An habituation account may also lead to different ways of conceptualizing the regulation of behavior. For example, habituation may be a single-process contributor to the termination of behaviors that are usually attributed to satiation (e.g., ingestive behaviors such as eating and drinking), fatigue (e.g., energetic behaviors such as running), the waning of attention (e.g., cognitive behaviors such as studying), and pharmacodynamic factors (e.g., drug taking).

"Beetrack": a software for 2D open field locomotion analysis in honey bees

"Beetrack" is a complete software designed to analyze the 2D locomotor behavior of four simultaneous honey bees moving in petri dishes. Several dependent variables can be measured: traveled distance, number of jumps and % of immobility. A spatial analysis can also be performed to detect if the bees are using preferentially one part of the box. The software has been successfully tested with eight honey bees and promise to be an interesting tool in the pharmacology field.

Sensitization and habituation regulate reinforcer effectiveness

We argue that sensitization and habituation occur to the sensory properties of reinforcers when those reinforcers are presented repeatedly or for a prolonged time. Sensitization increases, and habituation decreases, the ability of a reinforcer to control behavior. Supporting this argument, the rate of operant responding changes systematically within experimental sessions even when the programmed rate of reinforcement is held constant across the session. These within-session changes in operant responding are produced by repeated delivery of the reinforcer, and their empirical characteristics correspond to the characteristics of behavior undergoing sensitization and habituation. Two characteristics of habituation (dishabituation, stimulus specificity) are particularly useful in separating habituation from alternative explanations. Arguing that habituation occurs to reinforcers expands the domain of habituation. The argument implies that habituation occurs to biologically important, not just to neutral, stimuli. The argument also implies that habituation may be observed in "voluntary" (operant), not just in reflexive, behavior. Expanding the domain of habituation has important implications for understanding operant and classical conditioning. Habituation may also contribute to the regulation of motivated behaviors. Habituation provides a more accurate and a less cumbersome explanation for motivated behaviors than homeostasis. Habituation also has some surprising, and easily testable, implications for the control of motivated behaviors.

LH. Overweight children habituate slower than non-overweight children to food

We have shown that physiological and behavioral responses habituate to food stimuli and recover when novel stimuli are presented. In addition, physiological responses in obese adults habituate slower to repeated food stimuli than those in non-obese individuals, which is related to greater energy intake. The purpose of this study was to test the hypothesis that instrumental responding in overweight children habituates slower to food cues than in their non-overweight peers. Children were provided the opportunity to work for access to cheeseburger for 10 2-min trials, followed by French fries for 3 2-min trials. Results showed that children who had a body mass index (BMI) at or above the 85th BMI percentile (at risk for overweight; n=17) habituated slower than those with a BMI percentile less than the 85th BMI percentile (non-overweight; n=17). Response recovery to French fries did not differ between groups. Overweight children consumed significantly more grams of food and more energy than non-overweight children. When taken together, these data show that habituation may be an important individual difference characteristic that differentiates overweight from non-overweight children. Implications of this for prevention and treatment of obesity are discussed.

Within-session patterns in variable-interval schedule performance: Variation with deprivation level

Previous research has shown that patterns in operant responding may change within the course of individual experimental sessions. The proper interpretation of such changes is controversial. At least one source of this controversy may lie in unstated experimental practices across laboratories, as published reports often have failed to detail important particulars of deprivation operations. The present study was aimed at gathering descriptive data on the contribution of deprivation operations to the observation of within-session changes. In two experiments, four food deprived pigeons were exposed to a multiple variable-interval 30-s variable-interval 30-s schedule of grain presentation, wherein each grain presentation was kept constant at 5s. In Condition I, a session-entry criterion was in place that permitted the pigeon access to the daily session only if its body weight fell within controlled limits. Within-session rates of responding were generally stable. In Condition II, the entry criterion was removed and experimental sessions were conducted 6 days per week. The effect of removing the session-entry criterion was to increase body weight for all birds and decrease food intake across conditions. With no session entry criterion, robust within-session changes were observed for three of the four pigeons. The results suggest that rich schedules of reinforcement often used in the analysis of within-session changes can produce substantial reductions in deprivation levels that require up to several days to reverse. Future experiments in this area should take precautions to insure that deprivation is tightly controlled and report such measures to eliminate potential errors in replication.

Conditioned taste avoidance induced by forced and voluntary wheel running in rats

Voluntary exercise by rats running in a freely rotating wheel (free wheel) produces conditioned taste avoidance (CTA) of a flavored solution consumed before running [e.g., Lett, B.T., Grant, V.L., 1996. Wheel running induces conditioned taste aversion in rats trained while hungry and thirsty. Physiol. Behav. 59, 699-702]. Forced exercise, swimming or running, also produces CTA in rats [e.g., Masaki, T., Nakajima, S., 2006. Taste aversion induced by forced swimming, voluntary running, forced running, and lithium chloride injection treatments. Physiol. Behav. 88, 411-416]. Energy expenditure may be the critical factor in producing such CTA. If so, forced running in a motorized running wheel should produce CTA equivalent to that produced by a similar amount of voluntary running. In two experiments, we compared forced running in a motorized wheel with voluntary running in a free wheel. Mean distance run over 30 min was equated as closely as possible in the two apparatuses. Both types of exercise produced CTA relative to sedentary, locked-wheel controls. However, voluntary running produced greater CTA than forced running. We consider differences between running in the free and motorized wheels that may account for the differences in strength of CTA.

Neotic preferences in laboratory rodents: Issues, assessment and substrates

Neotic preference refers to the extent to which animals prefer stimuli of differing novelty value. Degree of novelty is determined by within- and between-trials habituation and amount of temporal (novelty) and spatial change (complexity) in stimulation which in turn will determine the amount of curiosity-based approach (neophilia) or fear-based avoidance (neophobia) of novel stimuli. Tests of genuine neotic preferences enable direct assessments of responsiveness to temporal and spatial changes and include measurements of novel versus familiar locations (such as novelty-related location preferences), responsiveness to stimulus complexity (such as object exploration) and learning for exploratory rewards (such as light-contingent bar-pressing). Effects of brain lesions and peripherally administered drugs have implicated several brain areas and neurotransmitters that subserve memory, fear and reward in neotic preferences namely the hippocampus and ACh (memory), the amygdala, GABA and 5-HT (fear), and the mesolimbic DA reward system. However, more attention should be paid to the complexity of interactions between different brain and neurotransmitter systems and improvements in methodology before conclusions should be drawn about the neurobiological basis of neotic preferences.

The "prawn-in-the-tube" procedure in the cuttlefish: habituation or passive avoidance learning?

This study examines whether or not habituation contributes to the regulation of the inhibition of predatory behavior observed during the "prawn-in-the-tube" training procedure. When presented with prawns that are visible behind glass but untouchable, cuttlefish promptly learn to inhibit their capture attempts. The first three experiments demonstrated that the acquired response in the course of training cannot be dishabituated. The fourth experiment demonstrated that the repeated application of a brief visual prawn stimulus, one that is terminated before the cuttlefish can strike, decreases attack latencies. Taken together, the results of this study establish that habituation does not play a significant role in this learning task. In fact, the present findings strengthen the results of previous studies suggesting that passive avoidance learning contributes to the regulation of the inhibition of predatory behavior.

Varying reinforcer duration produces behavioral interactions during multiple schedules

The experiments tested the idea that changes in habituation to the reinforcer contribute to behavioral interactions during multiple schedules. This idea predicts that changing an aspect of the reinforcer should disrupt habituation and produce an interaction. Pigeons and rats responded on multiple variable interval variable interval schedules. Introducing variability into the duration of reinforcers in one component increased response rates in both components when the schedules provided high, but not low, rates of reinforcement. The increases in constant-component response rates grew larger as the session progressed. Within-session decreases in responding were smaller when the other component provided variable-, rather than fixed-, duration reinforcers. These results are consistent with the idea that changes in habituation to the reinforcer contribute to behavioral interactions. They help to explain why interactions do not occur for some subjects under conditions that produce them for others. Finally, the results question the assumption that induction and behavioral contrast are always produced by different theoretical mechanisms.

Stimulus change dishabituates operant responding supported by water reinforcers

The present experiment examined whether habituation contributes to within-session decreases in operant responding for water reinforcers. The experiment asked if this responding can be dis-habituated, a fundamental property of habituated behavior. During baseline, rats' lever pressing was reinforced by water on a variable interval 15-s schedule. During experimental conditions, rats responded on the same schedule and a new stimulus was introduced for 5 min at 15, 30 or 45 min into the 60-min session. The new stimulus was extinction, continuous reinforcement or flashing lights in different conditions. Rate of responding primarily decreased within the session during baseline. Introducing a new stimulus sometimes suppressed (extinction, continuous reinforcement) and sometimes increased (flashing lights) responding while it was in effect. The new stimulus increased responding after it ended and before it was presented in the session. The results are incompatible with the idea that non-habituation satiety factors (e.g., cellular hydration and blood volume) contributed to within-session changes in responding. These satiety factors should increase with increases in consumption, decrease with decreases in consumption and remain constant with constant consumption of water. Nevertheless, all stimulus changes increased operant responding for water. These results support the idea that habituation contributes to within-session decreases in responding for water reinforcers.

Responding for sucrose and wheel-running reinforcement: effect of pre-running

Six male albino Wistar rats were placed in running wheels and exposed to a fixed interval 30-s schedule that produced either a drop of 15% sucrose solution or the opportunity to run for 15s as reinforcing consequences for lever pressing. Each reinforcer type was signaled by a different stimulus. To assess the effect of pre-running, animals were allowed to run for 1h prior to a session of responding for sucrose and running. Results showed that, after pre-running, response rates in the later segments of the 30-s schedule decreased in the presence of a wheel-running stimulus and increased in the presence of a sucrose stimulus. Wheel-running rates were not affected. Analysis of mean post-reinforcement pauses (PRP) broken down by transitions between successive reinforcers revealed that pre-running lengthened pausing in the presence of the stimulus signaling wheel running and shortened pauses in the presence of the stimulus signaling sucrose. No effect was observed on local response rates. Changes in pausing in the presence of stimuli signaling the two reinforcers were consistent with a decrease in the reinforcing efficacy of wheel running and an increase in the reinforcing efficacy of sucrose. Pre-running decreased motivation to respond for running, but increased motivation to work for food.

Habituation contributes to the decline in wheel running within wheel-running reinforcement periods

Habituation appears to play a role in the decline in wheel running within an interval. Aoyama and McSweeney [Aoyama, K., McSweeney, F.K., 2001. Habituation contributes to within-session changes in free wheel running. J. Exp. Anal. Behav. 76, 289-302] showed that when a novel stimulus was presented during a 30-min interval, wheel-running rates following the stimulus increased to levels approximating those earlier in the interval. The present study sought to assess the role of habituation in the decline in running that occurs over a briefer interval. In two experiments, rats responded on fixed-interval 30-s schedules for the opportunity to run for 45 s. Forty reinforcers were completed in each session. In the first experiment, the brake and chamber lights were repeatedly activated and inactivated after 25 s of a reinforcement interval had elapsed to assess the effect on running within the remaining 20 s. Presentations of the brake/light stimulus occurred during nine randomly determined reinforcement intervals in a session. In the second experiment, a 110 dB tone was emitted after 25 s of the reinforcement interval. In both experiments, presentation of the stimulus produced an immediate decline in running that dissipated over sessions. No increase in running following the stimulus was observed in the first experiment until the stimulus-induced decline dissipated. In the second experiment, increases in running were observed following the tone in the first session as well as when data were averaged over several sessions. In general, the results concur with the assertion that habituation plays a role in the decline in wheel running that occurs within both long and short intervals.

Responding for sucrose and wheel-running reinforcement: effect of body weight manipulation

As body weight increases, the excitatory strength of a stimulus signaling an opportunity to run should weaken to a greater degree than that of a stimulus signaling an opportunity to eat. To test this hypothesis, six male albino Wistar rats were placed in running wheels and exposed to a fixed interval 30-s schedule that produced either a drop of 15% sucrose solution or the opportunity to run for 15s as reinforcing consequences for lever pressing. Each reinforcer type was signaled by a different stimulus. The effect of varying body weight on responding maintained by these two reinforcers was investigated by systematically increasing and decreasing post-session food amounts. The initial body weight was 335 g. Body weights were increased to approximately 445 g and subsequently returned to 335 g. As body weight increased, overall and local lever-pressing rates decreased while post-reinforcement pauses lengthened. Analysis of post-reinforcement pauses and local lever-pressing rates in terms of transitions between successive reinforcers revealed that local response rates in the presence of stimuli signaling upcoming wheel and sucrose reinforcers were similarly affected. However, pausing in the presence of the stimulus signaling a wheel-running reinforcer lengthened to a greater extent than did pausing in the presence of the stimulus signaling sucrose. This result suggests that as body weight approaches ad-lib levels, the likelihood of initiation of responding to obtain an opportunity to run approaches zero and the animal "rejects" the opportunity to run in a manner similar to the rejection of less preferred food items in studies of food selectivity.

Dynamic changes in reinforcer effectiveness: theoretical, methodological, and practical implications for applied research

Reinforcers lose their effectiveness when they are presented repeatedly. Traditionally, this loss of effectiveness has been labeled satiation. However, recent evidence suggests that habituation provides a more accurate and useful description. The characteristics of behavior undergoing satiation differ for different stimuli (e.g., food, water), and these characteristics have not been identified for the noningestive reinforcers often used by applied behavior analysts (e.g., praise, attention). As a result, the term satiation provides little guidance for either maintaining or reducing the effectiveness of reinforcers. In contrast, the characteristics of behavior undergoing habituation are well known and are relatively general across species and stimuli. These characteristics provide specific and novel guidance about how to maintain or reduce the effectiveness of a reinforcer. In addition, habituation may lead to a better understanding of several puzzling phenomena in the conditioning literature (e.g., extinction, behavioral contrast), and it may provide a more precise and accurate description of the dynamics of many different types of behavior.

The relation of multiple-schedule behavioral contrast to deprivation, time in session, and within-session changes in responding

Pigeons' keypecking was reinforced by food on baseline schedules of multiple variable interval (VI) x VI x and on contrast schedules of multiple VI x VI y. Deprivation of food was varied by maintaining subjects at 75%, 85%, and 95% (+/- 2%) of their free-feeding weights. Positive and negative behavioral contrast were observed. The size of the contrast was not systematically altered by changes in deprivation. Positive and negative contrast were both larger later in the session than they were earlier. Within-session decreases in responding were steeper for the baseline than for the contrast schedules for positive contrast. Within-session decreases were steeper for the contrast than for the baseline schedules for negative contrast. These results were predicted by the idea that different amounts of habituation to the reinforcer during the baseline and contrast schedules contribute to behavioral contrast. The results show that contrast occurs under conditions that reduce the effect of the following component. The results support the assumption that positive and negative contrast are produced by symmetrical theoretical variables.

Wheel access duration in rats: II. Day-night and within-session changes

Time of day and duration of wheel access were manipulated to see how running changed over days. Young male rats were given 2 hr of wheel access, during either the light or dark phase. Over 24 days, running increased 4-fold in the dark group but remained low and stable in the light group. With rats given either 1 or 4 hr of dark phase wheel access, running increased much more in the 4-hr group (even in Hour 1) than in the 1-hr group. The within-session running pattern for high runners changed from a habituation to a sensitization profile. Running and cocaine self-administration (S. H. Ahmed & G. F. Koob, 1998, 1999) are affected similarly by session length, suggesting running as an interesting addiction model.

Responding for sucrose and wheel-running reinforcement: effects of sucrose concentration and wheel-running reinforcer duration

Six male albino rats were placed in running wheels and exposed to a fixed-interval 30-s schedule of lever pressing that produced either a drop of sucrose solution or the opportunity to run for a fixed duration as reinforcers. Each reinforcer type was signaled by a different stimulus. In Experiment 1, the duration of running was held constant at 15 s while the concentration of sucrose solution was varied across values of 0, 2.5. 5, 10, and 15%. As concentration decreased, postreinforcement pause duration increased and local rates decreased in the presence of the stimulus signaling sucrose. Consequently, the difference between responding in the presence of stimuli signaling wheel-running and sucrose reinforcers diminished, and at 2.5%, response functions for the two reinforcers were similar. In Experiment 2, the concentration of sucrose solution was held constant at 15% while the duration of the opportunity to run was first varied across values of 15, 45, and 90 s then subsequently across values of 5, 10, and 15 s. As run duration increased, postreinforcement pause duration in the presence of the wheel-running stimulus increased and local rates increased then decreased. In summary, inhibitory aftereffects of previous reinforcers occurred when both sucrose concentration and run duration varied; changes in responding were attributable to changes in the excitatory value of the stimuli signaling the two reinforcers.