Serial causation: occasion setting in a causal induction task

Occasion setting

Occasion setting refers to the ability of 1 stimulus, an occasion setter, to modulate the efficacy of the association between another, conditioned stimulus (CS) and an unconditioned stimulus (US) or reinforcer. Occasion setters and simple CSs are readily distinguished. For example, occasion setters are relatively immune to extinction and counterconditioning, and their combination and transfer functions differ substantially from those of simple CSs. Similarly, the acquisition of occasion setting is favored when stimuli are separated by longer intervals, by empty trace intervals, and are of different modalities, whereas the opposite conditions typically favor the acquisition of simple associations. Furthermore, the simple conditioning and occasion setting properties of a single stimulus can be independent, for example, that stimulus may simultaneously predict the occurrence of a reinforcer and indicate that another stimulus will not be reinforced. Many behavioral phenomena that are intractable to simple associative analysis are better understood within an occasion setting framework. Besides capturing the distinction between direct and modulatory control common to many arenas in neuroscience, occasion setting provides a model for the hierarchical organization of memory for events and event relations, and for contextual control more broadly. Although early lesion studies further differentiated between occasion setting and simple conditioning functions, little is known about the neurobiology of occasion setting. Modern techniques for precise manipulation and monitoring of neuronal activity in multiple brain regions are ideally suited for disentangling contributions of simple conditioning and occasion setting in associative learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Reinstatement after human feature-positive discrimination learning

In two experiments, using an online conditioned suppression task, we investigated the possibility of reinstatement of extinguished feature-target compound presentations after sequential feature-positive discrimination training in humans. Furthermore, given a hierarchical account of Pavlovian modulation (e.g., Bonardi, 1998; Bonardi and Jennings, 2009), we predicted A-US reinstatement to be stronger than US-only reinstatement. In Experiment 1, participants learned a sequential feature-positive discrimination (X→A⁺|A^-), which was subsequently extinguished (X→A^-). During the following reinstatement phase, group US-only received US-only presentations (not signalled), group A-US received A-US presentations, and the Control group received exposure to the context, but no CSs or USs, for an equal amount of time. Reinstatement of differential X→A/A responding was observed in the US-only group but not in the Control or A-US groups. Although differential X→A/A responding was not significant in group A-US, responding to the X→A compound was significantly stronger compared to that in group US-only. Hence, it could be the case the group A-US showed stronger reinstatement, but that differential responding was abolished due to excitation gained by A. Experiment 2 was set up to circumvent the acquired excitation of A by testing transfer of the feature after A-US reinstatement to a different target, B. Participants acquired two discriminations, X→A/A and Y→B/B, of which X→A was then extinguished. Subsequently, group A-US received reinforced presentations of A during a reinstatement phase while group Control received exposure to the context. Final testing of the novel X→B compound was hypothesized to show higher responding in group A-US than in group Control, but findings of this approach were limited due to acquired equivalence and/or perceptual factors causing a secondary extinction effect. We conclude to have obtained clear evidence in favour of reinstatement of differential responding after human Feature-Positive discrimination training and subsequent compound extinction, but no evidence in favour of A-US presentations being a stronger trigger for reinstatement than are US-only presentations.

Evidence for the interchangeability of an avoidance behavior and a negative occasion setter

Recent research on avoidance behavior provided evidence that such behavior can function as a negative occasion setter. We tested this hypothesis further by investigating whether the modulatory function of a stimulus occasion setter transfers selectively to a relation previously modulated by an avoidance behavior, and whether the modulatory function of an avoidance behavior transfers selectively to a relation previously modulated by a stimulus occasion setter. The three experiments reported in this article provided evidence to support this hypothesis. Furthermore, the results of Experiment 1 suggested that the presence of counterconditioning trials is not a necessary condition for an avoidance behavior to function as a negative occasion setter. All three reported experiments support the occasion-setting account of avoidance behavior.

Context and occasion setting in Drosophila visual learning

In a permanently changing environment, it is by no means an easy task to distinguish potentially important events from negligible ones. Yet, to survive, every animal has to continuously face that challenge. How does the brain accomplish this feat? Building on previous work in Drosophila melanogaster visual learning, we have developed an experimental methodology in which combinations of visual stimuli (colors and patterns) can be arranged such that the same stimuli can either be directly predictive, indirectly predictive, or nonpredictive of punishment. Varying this relationship, we found that wild-type flies can establish different memory templates for the same contextual color cues. The colors can either leave no trace in the pattern memory template, leading to context-independent pattern memory (context generalization), or be learned as a higher-order cue indicating the nature of the pattern-heat contingency leading to context-dependent memory (occasion setting) or serve as a conditioned stimulus predicting the punishment directly (simple conditioning). In transgenic flies with compromised mushroom-body function, the sensitivity to these subtle variations is altered. Our methodology constitutes a new concept for designing learning experiments. Our findings suggest that the insect mushroom bodies stabilize visual memories against context changes and are not required for cognition-like higher-order learning.

Causal impressions: predicting when, not just whether

In 1739, David Hume established the so-called cues to causality--environmental cues that are important to the inference of causality. Although this descriptive account has been corroborated experimentally, it has not been established why these cues are useful, except that they may reflect statistical regularities in the environment. One of the cues to causality, covariation, helps predict whether an effect will occur, but not its time of occurrence. In the present study, evidence is provided that spatial and temporal contiguity improve an observer's ability to predict when an effect will occur, thus complementing the utility of covariation as a predictor of whether an effect will occur. While observing Michotte's (1946/1963) launching effect, participants showed greater accuracy and precision in their predictions of the onset of movement by the launched object when there was spatial and temporal contiguity. Furthermore, when auditory cues that bridged a delayed launch were included, causal ratings and predictability were similarly affected. These results suggest that the everyday inference of causality relies on our ability to predict whether and when an effect will occur.

Conditioning and cognition

Animals' abilities to use internal representations of absent objects to guide adaptive behavior and acquire new information, and to represent multiple spatial, temporal, and object properties of complex events and event sequences, may underlie many aspects of human perception, memory, and symbolic thought. In this review, two classes of simple associative learning tasks that address these core cognitive capacities are discussed. The first set, including reinforcer revaluation and mediated learning procedures, address the power of Pavlovian conditioned stimuli to gain access, through learning, to representations of upcoming events. The second set of investigations concern the construction of complex stimulus representations, as illustrated in studies of contextual learning, the conjunction of explicit stimulus elements in configural learning procedures, and recent studies of episodic-like memory. The importance of identifying both cognitive process and brain system bases of performance in animal models is emphasized.

Serial and simultaneous feature positive discriminations in a human Skinner box

In the present experiment participants were presented either a serial (F-->T+/T-) or a simultaneous (FT+/T-) feature positive discrimination using a Skinner box for humans. After the participants mastered the discrimination, the associative properties of F were examined using a transfer test and a counterconditioning manipulation. F affected responding to a transfer target less in the Serial than in the Simultaneous condition. However, counterconditioning of F did not affect initial discrimination performance in either condition. These results were discussed in the framework of occasion setting, elemental learning, configural learning, and a neural network model.

Estimating causal strength: the role of structural knowledge and processing effort

The strength of causal relations typically must be inferred on the basis of statistical relations between observable events. This article focuses on the problem that there are multiple ways of extracting statistical information from a set of events. In causal structures involving a potential cause, an effect and a third related event, the assumed causal role of this third event crucially determines whether it is appropriate to control for this event when making causal assessments between the potential cause and the effect. Three experiments show that prior assumptions about the causal roles of the learning events affect the way contingencies are assessed with otherwise identical learning input. However, prior assumptions about causal roles is only one factor influencing contingency estimation. The experiments also demonstrate that processing effort affects the way statistical information is processed. These findings provide further evidence for the interaction between bottom-up and top-down influences in the acquisition of causal knowledge. They show that, apart from covariation information or knowledge about mechanisms, abstract assumptions about causal structures also may affect the learning process.