Training reinforcement rates, resistance to extinction, and the role of context in reinstatement

Relapse and its mitigation: Toward behavioral inoculation

Relapse following the successful treatment of problem behavior can increase the likelihood of injury and the need for more intensive care. Current research offers some predictions of how treatment procedures may contribute to relapse, and conversely, how the risk of relapse can be mitigated. This review describes relapse-mitigation procedures with varying levels of support, the quantitative models that have influenced the research on relapse mitigation, different experimental methods for measuring relapse mitigation, and directions for future research. We propose that by viewing the implementation of relapse-mitigation procedures as a means of producing behavioral inoculation, clinicians are placed in the proactive and intentional role of exposing their client's behavior to an array of reinforcement and stimulus conditions during treatment with the goal of decreasing the detrimental impact of future treatment challenges.

Choosing a future from a murky past: A generalization-based model of behavior

Remembering the past appears critical in allowing organisms to detect order in an environment, and hence to behave in accordance with likely future events. Yet the shortcomings of remembering and perceiving typically mean that the remembered past differs from the actual past, and hence that behavior does not perfectly track the structure of the environment. Here, we outline how the process of generalization might be used to understand differences between what an organism does, and the structure of the past and potential structure of the environment. We explore how different sources of generalization - both from within the same stimulus situation, and from different stimulus situations - might be modeled quantitatively, and how predictions made by this modeling approach are supported by research. Finally, we discuss how generalization from multiple stimulus situations, longer-term experience, and from stimulus situations in the past that are not identical to the stimulus situation in the present, might contribute to our understanding of how an organism's experience translates into behavior.

Recovery-from-extinction effects in an anuran amphibian: renewal effect, but no reinstatement

Recovery-from-extinction effects in which a conditioned response returns after extinction have been shown in mammals, birds and fish. Thus, these effects appear to be conserved among vertebrates; however, they have yet to be investigated in amphibians. Using prey catching conditioning in the fire-bellied toad (Bombina orientalis), we tested if renewal and reinstatement occurred after extinction when subjects were respectively re-exposed to the context or reinforcer used during conditioning. For renewal, a different context was used during extinction and thus renewal tests assessed if external contextual cues associated during conditioning stimulated prey catching performance. For reinstatement, the reinforcer withheld during extinction was simply delivered again prior to a test assessing if internal cues associated with recent prey consumption stimulated prey catching performance. Conditioning followed a fixed ratio 5 schedule of reinforcement, where five attempts to capture a cricket stimulus displayed on a computer screen were reinforced by delivery of a single live cricket. Performance was measured as the time to reach five prey catching attempts. A significant improvement in prey catching performance during conditioning followed by deterioration with extinction was seen in the experiments. Upon return to the context used for conditioning after extinction, toads showed a renewal effect whereby they displayed faster performance during testing compared to the end of extinction. Conversely, toads showed no reinstatement effect because pre-feeding of a cricket did not influence performance during the test that followed extinction. Reinstatement could have been lost in amphibian phylogeny due to secondary simplification of the nervous system.

Use of a physiological reflex to standardize vagal nerve stimulation intensity improves data reproducibility in a memory extinction assay

BACKGROUND

Modulating brainstem activity, via electrical vagus nerve stimulation (VNS), influences cognitive functions, including memory. However, controlling for changes in stimulus efficacy during chronic studies, and response variability between subjects, is problematic.

OBJECTIVE/HYPOTHESIS

We hypothesized that recruitment of an autonomic reflex, the Hering-Breuer reflex, would provide robust confirmation of VNS efficacy. We compared this to measurement of electrode resistance over time. We also examined whether VNS modulates contextual memory extinction.

METHODS

Electrodes for VNS and diaphragm electromyography recording were implanted into anesthetized Sprague Dawley rats. When conscious, we measured the electrode resistance as well as the minimum VNS current required to evoke the Hering-Breuer reflex, before, and after, an inhibitory avoidance assay - a two chamber, dark/light model, where the dark compartment was paired with an aversive foot shock. The extinction of this contextual memory was assessed in sham and VNS treated rats, with VNS administered for 30 s at 1.5 times the Hering-Breuer reflex threshold during extinction memory formation.

RESULTS

Assessment of VNS-evoked Hering-Breuer reflex successfully identified defective electrodes. VNS accelerated extinction memory and decreased multiple physiological metrics of fear expression. We observed an inverse relationship between memory extinction and respiratory rate during the behavioural assay. Additionally, no current - response relationship between VNS and extinction memory formation was established.

CONCLUSION

These data demonstrate that reliable, experimental VNS studies can be produced by verifying reflex initiation as a consequence of stimulation. Further, studies could be standardised by indexing stimulator efficacy to initiation of autonomic reflexes.

Recaída de Variabilidade Operante com a Combinação dos Procedimentos de Renovação, Restabelecimento e Ressurgência

Resumo O reaparecimento de variabilidade comportamental previamente extinta (i.e., recaída) foi investigado por meio dos modelos experimentais de renovação, restabelecimento e ressurgência. Na Fase de Treino (contexto A), ao serem expostos ao esquema múltiplo Lag 10 Acoplado, ratos apresentaram níveis similares de variabilidade nos dois componentes. Na Fase de Eliminação (contexto B), o esquema múltiplo Repetição Repetição promoveu a extinção da variabilidade. Na Fase de Teste (contexto A), com a suspensão da contingência de repetição e a liberação de reforços independentes, a variabilidade reapareceu no componente “Lag 10”, anteriormente correlacionado com reforçamento da variação, mas não no componente “Acoplado”. Esse resultado sugere que a variabilidade observada no teste de recaída corresponde à variabilidade operante, e não à variabilidade induzida pela extinção.

Generalizing from the Past, Choosing the Future

Behavior in the present depends critically on experience in similar environments in the past. Such past experience may be important in controlling behavior not because it determines the strength of a behavior, but because it allows the structure of the current environment to be detected and used. We explore a prospective-control approach to understanding simple behavior. Under this approach, order in the environment allows even simple organisms to use their personal past to respond according to the likely future. The predicted future controls behavior, and past experience forms the building blocks of the predicted future. We explore how generalization affects the use of past experience to predict and respond to the future. First, we consider how generalization across various dimensions of an event determines the degree to which the structure of the environment exerts control over behavior. Next, we explore generalization from the past to the present as the method of deciding when, where, and what to do. This prospective-control approach is measurable and testable; it builds predictions from events that have already occurred, and assumes no agency. Under this prospective-control approach, generalization is fundamental to understanding both adaptive and maladaptive behavior.

Resurgence when challenging alternative behavior with progressive ratios in children and pigeons

Resurgence is defined as the recurrence of a previously reinforced and then extinguished target response when reducing or eliminating a more recently reinforced alternative response. In experiments with children and pigeons, we evaluated patterns of resurgence across and within sessions through decreases in reinforcer availability by challenging alternative responding with extinction and progressive-ratio schedules. In Phase 1, we reinforced only target responding. In Phase 2, we extinguished target responding while reinforcing an alternative response. Finally, Phase 3 assessed resurgence by (a) extinguishing alternative responding versus (b) introducing a progressive-ratio schedule of reinforcement for alternative responding. In both children and pigeons, resurgence of target responding occurred in both conditions but generally was greater when assessed during extinction than with progressive ratios. Importantly, within-session patterns of resurgence did not differ between testing with progressive ratios and extinction. Resurgence with progressive ratios tended to be greater with longer durations between reinforcers but we observed similar findings with only simulated reinforcers during extinction testing. Therefore, the present investigation reveals that the events contributing to instances of resurgence remain to be understood, and presents an approach from which to examine variables influencing within-session patterns of resurgence.

Stimulus contributions to operant resurgence

In two experiments, pigeons were exposed to a three-phase resurgence procedure (train Response A; extinguish Response A and train Response B; extinguish Response B). In the first experiment, the stimuli associated with phases were different, resulting in a resurgence procedure combined with an ABC renewal procedure. Presenting the novel stimulus, C, during extinction of both responses in the third phase resulted in minimal resurgence. Subsequently, substituting the original training Stimulus A for Stimulus C resulted in resurgence with all pigeons. In the second experiment, resurgence with the same stimuli present in all three phases of the resurgence procedure (AAA) was compared concurrently with a resurgence procedure in which the ABC renewal procedure used in Experiment 1 was superimposed. Substantially more resurgence occurred with the AAA procedure compared to the ABC procedure. Although ABC renewal in combination with the resurgence procedure generated some resurgence, such recurrent responding was attenuated relative to that observed when the stimulus conditions were constant across phases. Combined with earlier research showing the enhancing effects of combining resurgence and ABA renewal procedures, the present results elaborate on how stimuli correlated with certain behavioral histories affect the course of operant resurgence.