Context specificity of both acquisition and extinction of a Pavlovian conditioned response

Autoshaped impulsivity: Some explorations with a neural network model

This study evaluated the effect of delay and magnitude of reinforcement in Pavlovian contingencies, extending the understanding of the phenomenon of autoshaped impulsivity as described in Alcalá's thesis (2017) and Burgos and García-Leal (2015). The effects of adding a trace interval were analyzed on the maintained responses of impulsive choice, seen as the preference of a small and immediate reinforcer over a larger and delayed one, and the role of the contextual unit, as well as the inhibitory units according to the Diffuse Discrepancy Model. In the Simulation, the model with inhibitory units was used, trained in two signals with different delays and reinforcement magnitudes, and subsequently presented concurrently in choice tasks without reinforcement nor learning, using an ABA within-subject design. In general, the DD model successfully simulated the phenomenon of autoshaped impulsivity, consistent with studies from Alcalá's thesis (2017), Burgos and García-Leal (2015), and Picker and Poling (1982). It also predicted the elimination of this effect (autoshaped impulsivity) after introducing a trace interval. The observed results and their implications are discussed, as well as possible future studies with animals and humans.

Recovery-from-extinction effects in an anuran amphibian: renewal effect, but no reinstatement

Recovery-from-extinction effects in which a conditioned response returns after extinction have been shown in mammals, birds and fish. Thus, these effects appear to be conserved among vertebrates; however, they have yet to be investigated in amphibians. Using prey catching conditioning in the fire-bellied toad (Bombina orientalis), we tested if renewal and reinstatement occurred after extinction when subjects were respectively re-exposed to the context or reinforcer used during conditioning. For renewal, a different context was used during extinction and thus renewal tests assessed if external contextual cues associated during conditioning stimulated prey catching performance. For reinstatement, the reinforcer withheld during extinction was simply delivered again prior to a test assessing if internal cues associated with recent prey consumption stimulated prey catching performance. Conditioning followed a fixed ratio 5 schedule of reinforcement, where five attempts to capture a cricket stimulus displayed on a computer screen were reinforced by delivery of a single live cricket. Performance was measured as the time to reach five prey catching attempts. A significant improvement in prey catching performance during conditioning followed by deterioration with extinction was seen in the experiments. Upon return to the context used for conditioning after extinction, toads showed a renewal effect whereby they displayed faster performance during testing compared to the end of extinction. Conversely, toads showed no reinstatement effect because pre-feeding of a cricket did not influence performance during the test that followed extinction. Reinstatement could have been lost in amphibian phylogeny due to secondary simplification of the nervous system.

Renewal of conditioned tentacle lowering by circadian contextual cues in snails Cornu aspersum

Previous experiments using tentacle lowering conditioning in terrestrial snails Cornu aspersum have shown extinction and recovery of the conditioned response (CR) as a consequence of both inserting a delay between the extinction and test (spontaneous recovery) and of re-exposing the animal to the unconditioned stimulus after extinction (reinstatement). Two experiments that examined recovery of the CR due to a change in context (renewal effect) were carried out to continue this line of research. In Experiment 1, subjects received conditioning with an odour (CS) followed by extinction in the presence of another odour (CS + C), before being exposed to the original one (CS). In Experiment 2, conditioning and extinction of an odour CS took place in the presence of different circadian contextual cues (hour of the day and presence of light). The results showed that a return to the original context of conditioned training, after the extinction in a different context, either defined by an odour (Experiment 1) or by circadian cues (Experiment 2), produce a recovery of the CR compared to suitable control groups. These results can be interpreted as an instance of ABA renewal effect and they provide information about psychological mechanisms involved in extinction processes.

Context-dependent extinction of threat memories: influences of healthy aging

Although a substantial progress has been made in recent years on understanding the processes mediating extinction of learned threat, little is known about the context-dependent extinction of threat memories in elderly individuals. We used a 2-day differential threat conditioning and extinction procedure to determine whether young and older adults differed in the contextual recall of conditioned responses after extinction. On Day 1, conditioned stimuli were paired with an aversive electric shock in a 'danger' context and then extinguished in a different 'safe' context. On Day 2, the extinguished stimulus was presented to assess extinction recall (safe context), and threat renewal (danger context). Physiological and verbal report measures of threat conditioning were collected throughout the experiment. Skin conductance response (SCR data revealed no significant differences between age groups during acquisition and extinction of threat conditioning on Day 1. On Day 2, however, older adults showed impaired recall of extinction memory, with increased SCR to the extinguished stimulus in the 'safe' context, and reduced ability to process context properly. In addition, there were no age group differences in fear ratings and contingency awareness, thus revealing that aging selectively impairs extinction memories as indexed by autonomic responses. These results reveal that aging affects the capacity to use context to modulate learned responses to threat, possibly due to changes in brain structures that enable context-dependent behaviour and are preferentially vulnerable during aging.

Testing a cue outside the training context increases attention to the contexts and impairs performance in human predictive learning

One experiment in human predictive learning explored the impact of a context change on attention to contexts and predictive ratings controlled by the cue. In Context A: cue X was paired with an outcome four times, while cue Y was presented without an outcome four times in Context B:. In both contexts filler cues were presented without the outcome. During the test, target cues X and Y were presented either in the context where they were trained, or in the alternative context. With the context change expectation of the outcome X, expressed as predictive ratings, decreased in the presence of X and increased in the presence of Y. Looking at the contexts, expressed as a percentage of the overall gaze dwell time on a trial, was high across the four training trials, and increased with the context change. Results suggest that the presentation of unexpected information leads to increases in attention to contextual cues. Implications for contextual control of behavior are discussed.

Integration of contextual cues into memory depends on "prefrontal" N-methyl-D-aspartate receptors

Every learning event is embedded in a context, but not always does the context become an integral part of the memory; however, for extinction learning it usually does, resulting in context-specific conditioned responding. The neuronal mechanisms underlying contextual control have been mainly investigated for Pavlovian fear extinction with a focus on hippocampal structures. However, the initial acquisition of novel responses can be subject to contextual control as well, although the neuronal mechanisms are mostly unknown. Here, we tested the hypothesis that contextual control of acquisition depends on glutamatergic transmission underlying executive functions in forebrain areas, e.g. by shifting attention to critical cues. Thus, we antagonized N-methyl-D-aspartate (NMDA) receptors with 2-amino-5-phosphonovaleric acid (AP5) in the pigeon nidopallium caudolaterale, the functional analogue of mammalian prefrontal cortex, during the concomitant acquisition and extinction of conditioned responding to two different stimuli. This paradigm has previously been shown to lead to contextual control over extinguished as well as non-extinguished responding. NMDA receptor blockade resulted in an impairment of extinction learning, but left the acquisition of responses to a novel stimulus unaffected. Critically, when responses were tested in a different context in the retrieval phase, we observed that NMDA receptor blockade led to the abolishment of contextual control over acquisition performance. This result is predicted by a model describing response inclination as the product of associative strength and contextual gain. In this model, learning under AP5 leads to a change in the contextual gain on the learned association, possibly via the modulation of attentional mechanisms.