201
|
Amita H, Matsushima T. Instantaneous and cumulative influences of competition on impulsive choices in domestic chicks. Front Neurosci 2011; 5:101. [PMID: 21954375 PMCID: PMC3174399 DOI: 10.3389/fnins.2011.00101] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2011] [Accepted: 08/17/2011] [Indexed: 12/02/2022] Open
Abstract
This study examined instantaneous and cumulative effects of competitive interactions on impulsiveness in the inter-temporal choices in domestic chicks. Chicks were trained to peck colored beads to gain delayed food rewards (1 or 6 grains of millet delivered after a delay ranging between 0 and 4.5 s), and were tested in binary choices between a small–short delay option (SS) and a large–long delay alternative (LL). To examine whether competitive foraging instantaneously changes impulsiveness, we intraindividually compared choices between two consecutive tests in different contexts, one with competitors and another without. We found that (1) the number of the choice of LL was not influenced by competition in the tests, but (2) the operant peck latency was shortened by competition, suggesting a socially enhanced incentive for food. To further examine the lasting changes, two groups of chicks were consecutively trained and tested daily for 2 weeks according to a “behavioral titration” procedure, one with competitors and another without. Inter-group comparisons of the choices revealed that (3) choice impulsiveness gradually decreased along development, while (4) the chicks trained in competition maintained a higher level of impulsiveness. These results suggest that competitive foraging causes impulsive choices not by direct/contextual modification. Causal link between the instantaneous enhancement of incentive and the gradual effects on impulsiveness remains to be examined. Some (yet unspecified) factors may be indirectly involved.
Collapse
|
202
|
Mahoney AM, Weetjens BJ, Cox C, Beyene N, Mgode G, Jubitana M, Kuipers D, Kazwala R, Mfinanga GS, Durgin A, Poling A. Using giant African pouched rats to detect tuberculosis in human sputum samples: 2010 findings. Pan Afr Med J 2011; 9:28. [PMID: 22145062 PMCID: PMC3215550 DOI: 10.4314/pamj.v9i1.71204] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2011] [Accepted: 07/06/2011] [Indexed: 11/17/2022] Open
Abstract
Giant African pouched rats previously have detected tuberculosis (TB) in human sputum samples in which the presence of TB was not initially detected by smear microscopy. Operant conditioning principles were used to train these rats to indicate TB-positive samples. In 2010, rats trained in this way evaluated 26,665 sputum samples from 12,329 patients. Microscopy performed at DOTS centers found 1,671 (13.6%) of these patients to be TB-positive. Detection rats identified 716 additional TB-positive patients, a 42.8% increase in new-case detection. These previously unreported data, which extend to over 20,000 the number of patients evaluated by pouched rats in simulated second-line screening, suggest that the rats can be highly valuable in that capacity.
Collapse
|
203
|
Eskenazi D, Neumaier JF. Increased expression of the 5-HT6 receptor by viral mediated gene transfer into posterior but not anterior dorsomedial striatum interferes with acquisition of a discrete action-outcome task. J Psychopharmacol 2011; 25:944-51. [PMID: 21088040 PMCID: PMC4723119 DOI: 10.1177/0269881110388330] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Serotonin plays a role in reinforcement learning; however, it is not known which serotonin receptors mediate these effects. Serotonin 6 (5-HT(6)) receptors are abundant in the striatum, a brain area that is involved in reinforcement learning. We previously found that 5-HT(6) receptors in the dorsomedial striatum (DMS) affect reinforcement learning or consolidation over several days. We use viral-mediated gene transfer to discern the role that 5-HT(6) receptors play in mediating post-synaptic responses in anterior versus posterior DMS. Male Long-Evans rats were used to study learning acquisition during a single session of 100 trials on a fixed interval of 20 seconds. In a discrete action-outcome learning task, rats had 10 seconds to press a lever to induce lever retraction and sucrose pellet delivery. In another group of rats, the task had a lever that was continuously extended but only active every 20 seconds, allowing for repetitive, mostly non-reinforced, lever pressing. Results demonstrate that increased expression of 5-HT(6) receptors in the posterior DMS interferes with earning sucrose pellets in only the former task. We take this to indicate that 5-HT(6) receptor signaling in the posterior DMS interferes with acquisition of discrete action-outcome responding.
Collapse
|
204
|
Simpson EH, Kellendonk C, Ward RD, Richards V, Lipatova O, Fairhurst S, Kandel ER, Balsam PD. Pharmacologic rescue of motivational deficit in an animal model of the negative symptoms of schizophrenia. Biol Psychiatry 2011; 69:928-35. [PMID: 21414604 PMCID: PMC3170714 DOI: 10.1016/j.biopsych.2011.01.012] [Citation(s) in RCA: 69] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/13/2010] [Revised: 01/12/2011] [Accepted: 01/12/2011] [Indexed: 10/18/2022]
Abstract
BACKGROUND Deficits in incentive motivation, the energizing of behavior in pursuit of a goal, occur in many psychiatric disorders including schizophrenia. We previously reported deficits in both cognition and incentive motivation in a transgenic mouse model of increased striatal-specific dopamine D2 receptor (D2R) density (D2R-OE mice). This molecular alteration is observed in patients with schizophrenia, making D2R-OE mice a suitable system to study the cellular and molecular mechanisms of motivation and avolition, as well as a tool for testing potential therapies against motivational deficits. METHODS Behavioral studies using operant conditioning methods were performed both to further characterize the incentive motivation deficit in D2R-OE mice and test a novel pharmacological treatment target that arose from an unbiased expression study performed using gene chips and was validated by quantitative reverse transcription polymerase chain reaction, in situ hybridization, and immunohistochemistry. RESULTS The reluctance of D2R-OE mice to work is due neither to intolerance for low rates of reward, decreased reactivity to reward, nor increased sensitivity to satiety or fatigue but to a difference in willingness to work for reward. As in patients with schizophrenia, this deficit was not ameliorated by D2R blockade, suggesting that reversal of the motivational deficit by switching off the transgene results from molecular changes downstream of D2R overexpression. We observed a reversible increase in serotonin subtype 2C (5-HT2C) receptor expression in D2R-OE mice. Systemic injection of a 5-HT2C receptor antagonist increased incentive motivation in D2R-OE and control mice. CONCLUSIONS We propose that targeting 5-HT2C receptors may be a useful approach to modulate incentive motivation in psychiatric illness.
Collapse
|
205
|
Abstract
In two experiments with 6-month-old infants, we found that prior learning of an operant task (remembered for 2 weeks) mediated new learning of a modeling event (remembered for only 1 day) and increased its recall. Infants first learned to associate lever pressing with moving a toy train housed in a large box. One or 2 weeks later, three target actions were modeled on a hand puppet while the train box (a retrieval cue) was in view. Merely retrieving the train memory strengthened it, and simultaneously pairing its retrieved memory with the modeled actions potentiated their learning and recall. When paired 1 week later, deferred imitation increased from 1 day to 4 weeks; when paired 2 weeks later, it increased from 1 day to 6 weeks. The striking parallels between potentiated learning in infants and the prior knowledge effect in adults suggests that the prior knowledge effect originates in early infancy.
Collapse
|
206
|
Nargeot R, Simmers J. Neural mechanisms of operant conditioning and learning-induced behavioral plasticity in Aplysia. Cell Mol Life Sci 2011; 68:803-16. [PMID: 21042832 PMCID: PMC11114654 DOI: 10.1007/s00018-010-0570-9] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2010] [Revised: 10/12/2010] [Accepted: 10/14/2010] [Indexed: 01/17/2023]
Abstract
Associative learning in goal-directed behaviors, in contrast to reflexive behaviors, can alter processes of decision-making in the selection of appropriate action and its initiation, thereby enabling animals, including humans, to gain a predictive understanding of their external environment. In the mollusc Aplysia, recent studies on appetitive operant conditioning in which the animal learns about the positive consequences of its behavior have provided insights into this form of associative learning which, although ubiquitous, remains mechanistically poorly understood. The findings support increasing evidence that central circuit- and cell-wide sites other than chemical synaptic connections, including electrical coupling and membrane conductances controlling intrinsic neuronal excitability and underlying voltage-dependent plateauing or oscillatory mechanisms, may serve as the neural substrates for behavioral plasticity resulting from operant conditioning. Aplysia therefore continues to provide a model system for understanding learning and memory formation that enables establishing the neurobiological links between behavioral, network, and cellular levels of analysis.
Collapse
|
207
|
Sokolowski MBC, Disma G, Abramson CI. A paradigm for operant conditioning in blow flies (Phormia terrae novae Robineau-Desvoidy, 1830). J Exp Anal Behav 2010; 93:81-9. [PMID: 20676269 DOI: 10.1901/jeab.2010.93-81] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2009] [Accepted: 10/20/2009] [Indexed: 11/22/2022]
Abstract
An operant conditioning situation for the blow fly (Protophormia terrae novae) is described. Individual flies are trained to enter and reenter a hole as the operant response. Only a few sessions of contingent reinforcement are required to increase response rates. When the response is no longer followed by food, the rate of entering the hole decreases. Control procedures revealed that rate of responding is not a simple overall result of feeding or of aging. The flies entered into the hole only if the response was required to obtain the food.
Collapse
|
208
|
Loewenstein Y. Synaptic theory of replicator-like melioration. Front Comput Neurosci 2010; 4:17. [PMID: 20617184 PMCID: PMC2896075 DOI: 10.3389/fncom.2010.00017] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2010] [Accepted: 05/25/2010] [Indexed: 11/17/2022] Open
Abstract
According to the theory of Melioration, organisms in repeated choice settings shift their choice preference in favor of the alternative that provides the highest return. The goal of this paper is to explain how this learning behavior can emerge from microscopic changes in the efficacies of synapses, in the context of a two-alternative repeated-choice experiment. I consider a large family of synaptic plasticity rules in which changes in synaptic efficacies are driven by the covariance between reward and neural activity. I construct a general framework that predicts the learning dynamics of any decision-making neural network that implements this synaptic plasticity rule and show that melioration naturally emerges in such networks. Moreover, the resultant learning dynamics follows the Replicator equation which is commonly used to phenomenologically describe changes in behavior in operant conditioning experiments. Several examples demonstrate how the learning rate of the network is affected by its properties and by the specifics of the plasticity rule. These results help bridge the gap between cellular physiology and learning behavior.
Collapse
|
209
|
Coleman K, Maier A. The use of positive reinforcement training to reduce stereotypic behavior in rhesus macaques. Appl Anim Behav Sci 2010; 124:142-148. [PMID: 20431691 PMCID: PMC2859718 DOI: 10.1016/j.applanim.2010.02.008] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Stereotypic behavior is a pervasive problem for captive monkeys and other animals. Once this behavior pattern has started, it can be difficult to alleviate. We tested whether or not using positive reinforcement training (PRT) can reduce this undesired behavior. Subjects for this study were 11 adult, female rhesus macaques (Macaca mulatta) with a history of locomotor stereotypy (e.g., pacing, bouncing, and somersaulting). We assessed baseline levels of stereotypic behavior and then utilized PRT to train six animals to touch a target and accept venipuncture. The other five monkeys served as controls. We assessed stereotypic behavior 1 week a month for 4 months, on days in which the monkey was not trained. Trained animals showed a significant reduction in stereotypic behavior after 1 month of training, compared to control monkeys (Mann Whitney U=28.00, P=0.02). These group differences did not persist after the first month (Month 2: Mann Whitney U=19.50, P=0.40, Month 3: Mann Whitney U=17.0, P=0.71, Month 4: Mann Whitney U=17.00, P=0.72). Still, the majority of the trained monkeys (n=4) engaged in less stereotypic behavior at the end of the study compared to baseline. Thus, training may be an effective way to reduce stereotypic behavior, at least for some individuals.
Collapse
|
210
|
Klink KB, Dierker H, Beutelmann R, Klump GM. Comodulation masking release determined in the mouse (Mus musculus) using a flanking-band paradigm. J Assoc Res Otolaryngol 2010; 11:79-88. [PMID: 19763691 PMCID: PMC2820211 DOI: 10.1007/s10162-009-0186-7] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2008] [Accepted: 08/12/2009] [Indexed: 11/29/2022] Open
Abstract
Comodulation masking release (CMR) has been attributed to auditory processing within one auditory channel (within-channel cues) and/or across several auditory channels (across-channel cues). The present flanking-band (FB) experiment-using a 25-Hz-wide on-frequency noise masker (OFM) centered at the signal frequency of 10 kHz and a single 25-Hz-wide noise FB-was designed to separate the amount of CMR due to within- and across-channel cues and to investigate the role of temporal cues on the size of within-channel CMR. The results demonstrated within-channel CMR in the Naval Medical Research Institute mouse, while no unambiguous evidence could be found for CMR occurring due to across-channel processing (i.e., "true CMR"). The amount of within-channel CMR was dependent on the frequency separation between the FB and the OFM. CMR increased from 4 to 6 dB for a frequency separation of 1 kHz to 18 dB for a frequency separation of 100 Hz. The large increase for a frequency separation of 100 Hz is likely to be due to the exploitation of changes in the temporal pattern of the stimulus upon the addition of the signal. Temporal interaction between both masker bands results in modulations with a large depth at a modulation frequency equal to the beating rate. Adding a signal to the maskers reduces the depth of the modulation. The auditory system of mice might be able to use the change in modulation depth at a beating frequency of 100 Hz as a cue for signal detection, while being unable to detect changes in modulation depth at high modulation frequencies. These results are consistent with other experiments and model predictions for CMR in humans which suggested that the main contribution to the CMR effect stems from processing of within-channel cues.
Collapse
|
211
|
Guillette LM, Farrell TM, Hoeschele M, Sturdy CB. Acoustic Mechanisms of a Species-Based Discrimination of the chick-a-dee Call in Sympatric Black-Capped (Poecile atricapillus) and Mountain Chickadees (P. gambeli). Front Psychol 2010; 1:229. [PMID: 21833284 PMCID: PMC3153834 DOI: 10.3389/fpsyg.2010.00229] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2010] [Accepted: 12/01/2010] [Indexed: 11/24/2022] Open
Abstract
Previous perceptual research with black-capped and mountain chickadees has demonstrated that these species treat each other's namesake chick-a-dee calls as belonging to separate, open-ended categories. Further, the terminal dee portion of the call has been implicated as the most prominent species marker. However, statistical classification using acoustic summary features suggests that all note-types contained within the chick-a-dee call should be sufficient for species classification. The current study seeks to better understand the note-type based mechanisms underlying species-based classification of the chick-a-dee call by black-capped and mountain chickadees. In two, complementary, operant discrimination experiments, both species were trained to discriminate the species of the signaler using either entire chick-a-dee calls, or individual note-types from chick-a-dee calls. In agreement with previous perceptual work we find that the D note had significant stimulus control over species-based discrimination. However, in line with statistical classifications, we find that all note-types carry species information. We discuss reasons why the most easily discriminated note-types are likely candidates to carry species-based cues.
Collapse
|
212
|
de Caigny P, Lukowiak K. A clash of stressors and LTM formation. Commun Integr Biol 2009; 1:125-7. [PMID: 19704867 DOI: 10.4161/cib.1.2.6858] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2008] [Accepted: 08/25/2008] [Indexed: 11/19/2022] Open
Abstract
Stress alters long-term memory formation sometimes enhancing its formation whilst at other times blocking it. It is unclear what the causal mechanisms are that allow stress to either enhance or suppress memory. We have made use of a relatively simple invertebrate model system to attempt to explore the causal mechanisms of how stress alters memory. Here we explore the consequences of presenting to the organism two different ecologically relevant stressors: detection of a predator and crowding. We find that the suppressive effect on memory formation elicited by crowding is more powerful than is the enhancing effect on predator-detection. That is, when the two stressors are experienced by the snail, long- term memory formation is suppressed.
Collapse
|
213
|
Faccidomo S, Besheer J, Stanford PC, Hodge CW. Increased operant responding for ethanol in male C57BL/6J mice: specific regulation by the ERK1/2, but not JNK, MAP kinase pathway. Psychopharmacology (Berl) 2009; 204:135-47. [PMID: 19125235 PMCID: PMC2845162 DOI: 10.1007/s00213-008-1444-9] [Citation(s) in RCA: 51] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/27/2008] [Accepted: 12/16/2008] [Indexed: 11/30/2022]
Abstract
RATIONALE Extracellular signal-regulated protein kinase (ERK(1/2)) is a member of the mitogen-activated protein kinase (MAPK) signaling pathway and a key molecular target for ethanol (EtOH) and other drugs of abuse. OBJECTIVE The aim of the study was to assess the role of two MAPK pathways, ERK(1/2) and c-Jun N-terminal kinase (JNK), on the modulation of EtOH and sucrose self-administration. MATERIALS AND METHODS C57BL/6J mice were trained to lever press on a fixed-ratio 4 schedule with 9% EtOH/2% sucrose, or 2% sucrose, as the reinforcer. In experiments 1 and 2, mice were injected with the MEK(1/2) inhibitor SL 327 (0-100 mg/kg) and the JNK inhibitor AS 6012452 (0-56 mg/kg) prior to self-administration. In experiment 3, SL 327 (0-100 mg/kg) was administered prior to performance on a progressive ratio (PR) schedule of EtOH reinforcement. In experiment 4, SL 327 and AS 601245 were injected 2 h before a locomotor test. RESULTS SL 327 (30 mg/kg) significantly increased EtOH self-administration without affecting locomotion. Higher doses of SL 327 and AS 601245 reduced EtOH-reinforced responding and locomotor activity. Reductions of both ligands on sucrose self-administration were due to decreases in motor activity. SL 327 pretreatment had no effect on PR responding. CONCLUSIONS ERK(1/2) activity is more directly involved in modulating the reinforcing properties of EtOH than JNK activity due to its selective potentiation of EtOH-reinforced responding. The specificity of this effect to EtOH self-administration, rather than sucrose self-administration, suggests that the mechanism by which ERK(1/2) increases EtOH-reinforced responding does not generalize to all reinforcing solutions and is not due to increased motivation to consume EtOH.
Collapse
|
214
|
Cruz FC, Quadros IM, da Planeta CS, Miczek KA. Maternal separation stress in male mice: long-term increases in alcohol intake. Psychopharmacology (Berl) 2008; 201:459-68. [PMID: 18766329 PMCID: PMC4367178 DOI: 10.1007/s00213-008-1307-4] [Citation(s) in RCA: 81] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/20/2008] [Accepted: 08/14/2008] [Indexed: 01/12/2023]
Abstract
RATIONALE In rodents, prolonged maternal separation has been used as a model of developmentally early environmental stress to influence adult drug intake. OBJECTIVES The aim of the present study was to evaluate the long-term effects of prolonged maternal separation on alcohol consumption using two different self-administration procedures in mice: operant alcohol self-administration vs. three-bottle choice. MATERIALS AND METHODS From postnatal day (PND) 1 to 14, pups were separated from the dam (maternal separation, MS) daily for 180 min or were left undisturbed, only handled during cage cleaning (animal facility rearing, AFR). On PND 60, they were assigned to one of two experimental manipulations: either a three-bottle choice or operant oral alcohol self-administration. In the three-bottle choice procedure, mice were given access to 6% or 10% alcohol or 0.05% saccharin solution for 2 h/day for 10 days. In the second experiment, mice were reinforced for nose poking by delivery of oral alcohol (6% or 10% in saccharin) or 0.05% saccharin solutions during daily 30-min sessions. Following the acquisition phase, "break points" were determined. Later, mice were allowed 1 h access to the reinforcing solution with no dosage limitation. RESULTS In the three-bottle choice procedure, MS mice showed higher alcohol intake than AFR at the 10% alcohol concentration. In the operant alcohol self-administration, MS mice achieved higher alcohol intake than AFR at the concentrations 6% and 10% during the 1-h session. CONCLUSIONS The results demonstrate the long-term consequences of MS on alcohol intake in male mice, suggesting early life stress as a risk factor for alcohol consumption and abuse.
Collapse
|
215
|
A cocaine hydrolase engineered from human butyrylcholinesterase selectively blocks cocaine toxicity and reinstatement of drug seeking in rats. Neuropsychopharmacology 2008; 33:2715-25. [PMID: 18199998 PMCID: PMC2562914 DOI: 10.1038/sj.npp.1301666] [Citation(s) in RCA: 105] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Successive rational mutations of human butyrylcholinesterase (BChE) followed by fusion to human serum albumin have yielded an efficient hydrolase that offers realistic options for therapy of cocaine overdose and abuse. This albumin-BChE prevented seizures in rats given a normally lethal cocaine injection (100 mg/kg, i.p.), lowered brain cocaine levels even when administered after the drug, and provided rescue after convulsions commenced. Moreover, it selectively blocked cocaine-induced reinstatement of drug seeking in rats that had previously self-administered cocaine. The enzyme treatment was well tolerated and may be worth exploring for clinical application in humans.
Collapse
|
216
|
Marlowe DB, Festinger DS, Dugosh KL, Arabia PL, Kirby KC. An effectiveness trial of contingency management in a felony preadjudication drug court. J Appl Behav Anal 2008; 41:565-77. [PMID: 19192860 PMCID: PMC2606594 DOI: 10.1901/jaba.2008.41-565] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2007] [Accepted: 11/06/2007] [Indexed: 10/20/2022]
Abstract
This study evaluated a contingency management (CM) program in a drug court. Gift certificates for compliance were delivered at 4- to 6-week intervals (total value = $390.00). Participants in one condition earned gift certificates that escalated by $5.00 increments. Participants in a second condition began earning higher magnitude gift certificates, and the density of reinforcement was gradually decreased. No main effects of CM were detected, which appears to be attributable to a ceiling effect from the intensive contingencies already delivered in the drug court and the low density of reinforcement. Preplanned interaction analyses suggested that participants with more serious criminal backgrounds might have performed better in the CM conditions. This suggests that CM programs may be best suited for more incorrigible drug offenders.
Collapse
|
217
|
Woods AM, Bouton ME. Occasional Reinforced Responses During Extinction Can Slow the Rate of Reacquisition of an Operant Response. LEARNING AND MOTIVATION 2007; 38:56-74. [PMID: 19132143 PMCID: PMC2614821 DOI: 10.1016/j.lmot.2006.07.003] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Three experiments with rats examined reacquisition of an operant response after either extinction or a response-elimination procedure that included occasional reinforced responses during extinction. In each experiment, reacquisition was slower when response elimination had included occasional reinforced responses, although the effect was especially evident when responding was examined immediately following each response-reinforcer pairing during reacquisition (Experiments 2 and 3). An extinction procedure with added noncontingent reinforcers also slowed reacquisition (Experiment 3). The results are consistent with research in classical conditioning (Bouton, Woods, & Pineño, 2004) and suggest that rapid reacquisition after extinction is analogous to a renewal effect that occurs when reinforced responses signal a return to the conditioning context. Clinical implications are also discussed.
Collapse
|
218
|
Teresa Araujo Silva M, Leyser Gonçalves F, Garcia-Mijares M. Neural events in the reinforcement contingency. THE BEHAVIOR ANALYST 2007; 30:17-30. [PMID: 22478485 PMCID: PMC2223162 DOI: 10.1007/bf03392140] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
When neural events are analyzed as stimuli and responses, functional relations among them and among overt stimuli and responses can be unveiled. The integration of neuroscience and the experimental analysis of behavior is beginning to provide empirical evidence of involvement of neural events in the three-term contingency relating discriminative stimuli, responses, and consequences. This paper is aimed at highlighting exemplar instances in the development of this issue. It has long been known that the electrical stimulation of certain cerebral areas can have a reinforcing function. Extraordinary technological advances in recent years show that neural activity can be selected by consequences. For example, the activity of in vitro isolated neurons that receive dopamine as a reinforcer functions as a cellular analogue of operant conditioning. The in vivo activity of populations of neurons of rats and monkeys can be recorded on an instant-to-instant basis and can then be used to move mechanical arms or track a target as a function of consequences. Neural stimulation acts as a discriminative stimulus for operant responses that are in turn maintained by neural consequences. Together with investigations on the molecular basis of classical conditioning, those studies are examples of possibilities that are being created for the study of behavior-environment interactions within the organism. More important, they show that, as an element in the three-term contingency, neural activity follows the same laws as other events.
Collapse
|
219
|
Sangha S, Scheibenstock A, Morrow R, Lukowiak K. Extinction requires new RNA and protein synthesis and the soma of the cell right pedal dorsal 1 in Lymnaea stagnalis. J Neurosci 2003; 23:9842-51. [PMID: 14586013 PMCID: PMC6740901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/27/2023] Open
Abstract
Lymnaea stagnalis were operantly conditioned to not perform aerial respiratory behavior. This learned response was subsequently extinguished. Here, we show that spaced extinction training is more effective than massed extinction training, in addition to the occurrence of spontaneous recovery. We also find evidence of a critical period within the first hour after extinction training in which new RNA and protein synthesis must occur for a memory of extinction training to be established. The memory for extinction training can also be extended using cooling and by preventing aerial respiration from occurring after extinction training. In addition, we demonstrate that memory formation of extinction training requires the soma of the cell right pedal dorsal 1, a cell that we have previously shown to be necessary for long-term memory consolidation and reconsolidation. This finding implies that the events that lead to the formation of extinction memory occur in the same cell that is responsible for long-term memory of operant conditioning. All of these data are consistent with the hypothesis that, during extinction, a new associative memory is being formed and that this new memory covers up, but does not abolish, the "old" memory.
Collapse
|
220
|
Sangha S, Scheibenstock A, Lukowiak K. Reconsolidation of a long-term memory in Lymnaea requires new protein and RNA synthesis and the soma of right pedal dorsal 1. J Neurosci 2003; 23:8034-40. [PMID: 12954865 PMCID: PMC6740499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/04/2023] Open
Abstract
Reconsolidation of a long-term memory (LTM) in the snail Lymnaea stagnalis can be disrupted by cooling, an RNA synthesis blocker (actinomycin D), and by specifically ablating the soma of a cell we know is a site of LTM consolidation (right pedal dorsal 1, RPeD1). Aerial respiratory behavior was conditioned operantly by applying a gentle tactile stimulus to the pneumostome area (the respiratory orifice) every time the snail began to open its pneumostome to perform aerial respiration. This resulted in a reduction of this behavior while leaving cutaneous respiration intact. One week after training one-half of the animals received a memory reactivation session, which was similar to the original training (i.e., animals received reinforcement). All animals then received 1 hr of cooling, an injection of actinomycin D or saline, or the soma ablation procedure. This was followed by a test for savings 4 hr or 4 d later, which was also similar to the original training. Only those animals that received both the memory reactivation session and the treatment showed memory impairment during the test for savings. That is, the impairment was contingent on memory reactivation. These data indicate that reconsolidation requires both new RNA and protein synthesis to stabilize a reactivated memory, and it demonstrates that the soma of RPeD1, a cell that we have shown previously to be required in the consolidation of an LTM, is necessary for reconsolidation. These data suggest that the critical molecular processes occurring during both consolidation and reconsolidation transpire in the same cell in Lymnaea.
Collapse
|
221
|
Kelly MP, Deadwyler SA. Experience-dependent regulation of the immediate-early gene arc differs across brain regions. J Neurosci 2003; 23:6443-51. [PMID: 12878684 PMCID: PMC6740623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/03/2023] Open
Abstract
Previously, we demonstrated that initial acquisition of a lever-press task resulted in higher levels of activity-regulated cytoskeleton-associated protein (Arc) mRNA induction than did overtrained performance (Kelly and Deadwyler, 2002). The present study extends this finding by characterizing (1) the behavioral regulation of Arc protein expression, (2) the time course of decay of Arc mRNA signal in different brain regions immediately after the initial acquisition session, and (3) the persistence of Arc mRNA induction in those same brain regions across sessions. Rats killed after initial acquisition of a simple lever-press response demonstrated significantly elevated levels of Arc protein. Interestingly, of the brain regions that demonstrated Arc mRNA induction 30 min after the acquisition session, there was a differential rate in signal decay, with only half of the regions continuing to demonstrate elevated levels of Arc at 60 min. Similarly, the extent to which Arc mRNA induction persisted across days also varied across brain regions. An unexpected outcome was that areas such as CA1 and CA3 that showed the least persistence in Arc activation immediately after the initial acquisition session showed the greatest perseverance of induction across days of training. Finally, animals less proficient at the task expressed higher levels of Arc mRNA than animals that acquired the task more quickly. Taken together, the results show that Arc mRNA and protein were regulated in an experience-dependent manner; however, the fact that the time course of Arc mRNA expression differed across brain structures suggests a differential rate of consolidation of the newly acquired behavior across specific brain regions.
Collapse
|
222
|
Hayward MD, Pintar JE, Low MJ. Selective reward deficit in mice lacking beta-endorphin and enkephalin. J Neurosci 2002; 22:8251-8. [PMID: 12223579 PMCID: PMC6758085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/26/2023] Open
Abstract
It has been impossible to unequivocally identify which endogenous opioids modulate the incentive value of rewarding stimuli because these peptides are not highly selective for any single opioid receptor subtype. Here, we present evidence based on the measurement of instrumental behavior of beta-endorphin and enkephalin knock-out mice that both opioid peptides play a positive role. A progressive ratio schedule was used to measure how hard an animal would work for food reinforcers. The loss of either opioid reduced responding under this schedule, regardless of the palatability of the three different formulas of reinforcers used. The phenotype of mice lacking both endogenous opioids was nearly identical to the phenotype of mice mutant for either individual opioid. Responses were tested in nondeprived and deprived feeding states but were reduced in beta-endorphin- and enkephalin-deficient mice only when they were maintained under nondeprived conditions. Other operant manipulations ruled out variables that might contribute nonspecifically to this result such as differences in acquisition, early satiation, motor performance deficit, and reduced resistance to extinction. In contrast to the effects on instrumental performance, the loss of either or both endogenous opioids did not influence preference for water flavored with sucrose or saccharin in a two-bottle free-choice drinking paradigm. We conclude that both beta-endorphin and enkephalin positively contribute to the incentive-motivation to acquire food reinforcers. Because the attenuation of operant responding was observed only during a nondeprived motivational state, the hedonics of feeding are likely altered rather than energy homeostasis.
Collapse
|
223
|
Cunningham CL, Fidler TL, Hill KG. Animal models of alcohol's motivational effects. ALCOHOL RESEARCH & HEALTH : THE JOURNAL OF THE NATIONAL INSTITUTE ON ALCOHOL ABUSE AND ALCOHOLISM 2000; 24:85-92. [PMID: 11199282 PMCID: PMC6713011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
Alcohol's positive and negative motivational effects are believed to be important influences on alcohol-seeking behavior and, therefore, key factors among the many and varied causes of alcohol abuse and dependence. Alcohol's positive effects, such as enhanced mood, and negative effects, such as hangover, are considered important factors in motivating drinkers to increase or decrease their drinking. Scientists have developed a variety of animal behavioral models to study alcohol's motivational effects. These models include "self-administration models," in which the animal controls the exposure to alcohol, and "conditioning models," in which the researcher controls the animal's exposure to alcohol. Such models have been used to study the influence of genetic differences on sensitivity to alcohol's positive and negative motivational effects, the brain mechanisms underlying alcohol's motivational effects, as well as relapse and craving.
Collapse
|
224
|
Heyman GM. An economic approach to animal models of alcoholism. ALCOHOL RESEARCH & HEALTH : THE JOURNAL OF THE NATIONAL INSTITUTE ON ALCOHOL ABUSE AND ALCOHOLISM 2000; 24:132-9. [PMID: 11199280 PMCID: PMC6713013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Researchers have long sought an animal model for human alcohol consumption. This article describes an economic-based approach to a model of alcohol preference in rats. The procedures are based on an analogy between clinical accounts of human drinking and the economic analysis of consumption. Both clinical and economic investigators typically define consumption patterns in terms of the influence of negative consequences. For example, the clinical account emphasizes the persistence of heavy drinking despite mounting alcohol-related aversive consequences, and in economic analyses, the term "inelastic demand" is used to refer to the persistence of consumption despite large increases in prices. In the experimental procedure described here, rats worked for alcohol and food. Presses on one lever earned a drink of 10 percent alcohol plus saccharin, and presses on a second lever earned isocaloric drinks of a starch solution. After behavior stabilized, the response requirements (which are analogous to prices) for one or both drinks were increased. The rats maintained baseline alcohol consumption levels despite large increases in the "price" of alcohol. In contrast, the same price increases markedly reduced starch intake. That is, food consumption was sensitive to price hikes, but alcohol consumption was not. The results demonstrate that a common economic framework can be used to describe human and animal behavior and, hence, the possibility of an animal model of human alcohol consumption. The article also points out that economic concepts provide a framework for understanding a wide range of human drinking patterns, including controlled social drinking and excessive alcoholic drinking.
Collapse
|
225
|
Nargeot R, Baxter DA, Byrne JH. In vitro analog of operant conditioning in aplysia. I. Contingent reinforcement modifies the functional dynamics of an identified neuron. J Neurosci 1999; 19:2247-60. [PMID: 10066276 PMCID: PMC6782538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/1998] [Revised: 12/01/1998] [Accepted: 12/30/1998] [Indexed: 02/11/2023] Open
Abstract
Previously, an analog of operant conditioning in Aplysia was developed using the rhythmic motor activity in the isolated buccal ganglia. This analog expressed a key feature of operant conditioning, namely a selective enhancement in the occurrence of a designated motor pattern by contingent reinforcement. Different motor patterns generated by the buccal central pattern generator were induced by monotonic stimulation of a peripheral nerve (i.e., n.2,3). Phasic stimulation of the esophageal nerve (E n.) was used as an analog of reinforcement. The present study investigated the neuronal mechanisms associated with the genesis of different motor patterns and their modifications by contingent reinforcement. The genesis of different motor patterns was related to changes in the functional states of the pre-motor neuron B51. During rhythmic activity, B51 dynamically switched between inactive and active states. Bursting activity in B51 was associated with, and predicted, characteristic features of a specific motor pattern (i.e., pattern I). Contingent reinforcement of pattern I modified the dynamical properties of B51 by decreasing its resting conductance and threshold for eliciting plateau potentials and thus increased the occurrences of pattern I-related activity in B51. These modifications were not observed in preparations that received either noncontingent reinforcement (i.e., yoke control) or no reinforcement (i.e., control). These results suggest that a contingent reinforcement paradigm can regulate the dynamics of neuronal activity that is centrally programmed by the intrinsic cellular properties of neurons.
Collapse
|