Reinstatement in honeybees is context-dependent

Recovery-from-extinction effects in an anuran amphibian: renewal effect, but no reinstatement

Recovery-from-extinction effects in which a conditioned response returns after extinction have been shown in mammals, birds and fish. Thus, these effects appear to be conserved among vertebrates; however, they have yet to be investigated in amphibians. Using prey catching conditioning in the fire-bellied toad (Bombina orientalis), we tested if renewal and reinstatement occurred after extinction when subjects were respectively re-exposed to the context or reinforcer used during conditioning. For renewal, a different context was used during extinction and thus renewal tests assessed if external contextual cues associated during conditioning stimulated prey catching performance. For reinstatement, the reinforcer withheld during extinction was simply delivered again prior to a test assessing if internal cues associated with recent prey consumption stimulated prey catching performance. Conditioning followed a fixed ratio 5 schedule of reinforcement, where five attempts to capture a cricket stimulus displayed on a computer screen were reinforced by delivery of a single live cricket. Performance was measured as the time to reach five prey catching attempts. A significant improvement in prey catching performance during conditioning followed by deterioration with extinction was seen in the experiments. Upon return to the context used for conditioning after extinction, toads showed a renewal effect whereby they displayed faster performance during testing compared to the end of extinction. Conversely, toads showed no reinstatement effect because pre-feeding of a cricket did not influence performance during the test that followed extinction. Reinstatement could have been lost in amphibian phylogeny due to secondary simplification of the nervous system.

Renewal of conditioned tentacle lowering by circadian contextual cues in snails Cornu aspersum

Previous experiments using tentacle lowering conditioning in terrestrial snails Cornu aspersum have shown extinction and recovery of the conditioned response (CR) as a consequence of both inserting a delay between the extinction and test (spontaneous recovery) and of re-exposing the animal to the unconditioned stimulus after extinction (reinstatement). Two experiments that examined recovery of the CR due to a change in context (renewal effect) were carried out to continue this line of research. In Experiment 1, subjects received conditioning with an odour (CS) followed by extinction in the presence of another odour (CS + C), before being exposed to the original one (CS). In Experiment 2, conditioning and extinction of an odour CS took place in the presence of different circadian contextual cues (hour of the day and presence of light). The results showed that a return to the original context of conditioned training, after the extinction in a different context, either defined by an odour (Experiment 1) or by circadian cues (Experiment 2), produce a recovery of the CR compared to suitable control groups. These results can be interpreted as an instance of ABA renewal effect and they provide information about psychological mechanisms involved in extinction processes.

Different Roles for Honey Bee Mushroom Bodies and Central Complex in Visual Learning of Colored Lights in an Aversive Conditioning Assay

The honey bee is an excellent visual learner, but we know little about how and why it performs so well, or how visual information is learned by the bee brain. Here we examined the different roles of two key integrative regions of the brain in visual learning: the mushroom bodies and the central complex. We tested bees' learning performance in a new assay of color learning that used electric shock as punishment. In this assay a light field was paired with electric shock. The other half of the conditioning chamber was illuminated with light of a different wavelength and not paired with shocks. The unrestrained bee could run away from the light stimulus and thereby associate one wavelength with punishment, and the other with safety. We compared learning performance of bees in which either the central complex or mushroom bodies had been transiently inactivated by microinjection of the reversible anesthetic procaine. Control bees learned to escape the shock-paired light field and to spend more time in the safe light field after a few trials. When ventral lobe neurons of the mushroom bodies were silenced, bees were no longer able to associate one light field with shock. By contrast, silencing of one collar region of the mushroom body calyx did not alter behavior in the learning assay in comparison to control treatment. Bees with silenced central complex neurons did not leave the shock-paired light field in the middle trials of training, even after a few seconds of being shocked. We discussed how mushroom bodies and the central complex both contribute to aversive visual learning with an operant component.

Aversive Learning of Colored Lights in Walking Honeybees

The honeybee has been established as an important model organism in studies on visual learning. So far the emphasis has been on appetitive conditioning, simulating floral discrimination, and homing behavior, where bees perform exceptionally well in visual discrimination tasks. However, bees in the wild also face dangers, and recent findings suggest that what is learned about visual percepts is highly context dependent. A stimulus that follows an unpleasant period, is associated with the feeling of relief- or safety in humans and animals, thus acquiring a positive meaning. Whether this is also the case in honeybees is still an open question. Here, we conditioned bees aversively in a walking arena where each half was illuminated by light of a specific wavelength and intensity, one of which was combined with electric shocks. In this paradigm, the bees' preferences to the different lights were modified through nine conditioning trials, forming robust escape, and avoidance behaviors. Strikingly, we found that while 465 nm (human blue) and 590 nm (human yellow) lights both could acquire negative valences (inducing avoidance response), 525 nm (human green) light could not. This indicates that green light holds an innate meaning of safety which is difficult to overrule even through intensive aversive conditioning. The bees had slight initial preferences to green over the blue and the yellow lights, which could be compensated by adjusting light intensity. However, this initial bias played a minor role while the chromatic properties were the most salient characteristics of the light stimuli during aversive conditioning. Moreover, bees could learn the light signaling safety, revealing the existence of a relief component in aversive operant conditioning, similar to what has been observed in other animals.

CaMKII knockdown affects both early and late phases of olfactory long-term memory in the honeybee

Honeybees are able to solve complex learning tasks and memorize learned information for long time periods. The molecular mechanisms mediating long-term memory (LTM) in the honeybee Apis mellifera are, to a large part, still unknown. We approached this question by investigating the potential function of the calcium/calmodulin-dependent protein kinase II (CaMKII), an enzyme known as a 'molecular memory switch' in vertebrates. CaMKII is able to switch to a calcium-independent constitutively active state, providing a mechanism for a molecular memory and has further been shown to play an essential role in structural synaptic plasticity. Using a combination of knockdown by RNA interference and pharmacological manipulation, we disrupted the function of CaMKII during olfactory learning and memory formation. We found that learning, memory acquisition and mid-term memory were not affected, but all manipulations consistently resulted in an impaired LTM. Both early LTM (24 h after learning) and late LTM (72 h after learning) were significantly disrupted, indicating the necessity of CaMKII in two successive stages of LTM formation in the honeybee.

Molecular mechanisms underlying formation of long-term reward memories and extinction memories in the honeybee (Apis mellifera)

The honeybee (Apis mellifera) has long served as an invertebrate model organism for reward learning and memory research. Its capacity for learning and memory formation is rooted in the ecological need to efficiently collect nectar and pollen during summer to ensure survival of the hive during winter. Foraging bees learn to associate a flower's characteristic features with a reward in a way that resembles olfactory appetitive classical conditioning, a learning paradigm that is used to study mechanisms underlying learning and memory formation in the honeybee. Due to a plethora of studies on appetitive classical conditioning and phenomena related to it, the honeybee is one of the best characterized invertebrate model organisms from a learning psychological point of view. Moreover, classical conditioning and associated behavioral phenomena are surprisingly similar in honeybees and vertebrates, suggesting a convergence of underlying neuronal processes, including the molecular mechanisms that contribute to them. Here I review current thinking on the molecular mechanisms underlying long-term memory (LTM) formation in honeybees following classical conditioning and extinction, demonstrating that an in-depth analysis of the molecular mechanisms of classical conditioning in honeybees might add to our understanding of associative learning in honeybees and vertebrates.

Behavioral and neural bases of extinction learning in Hermissenda

Extinction of classical conditioning is thought to produce new learning that masks or interferes with the original memory. However, research in the nudibranch Hermissenda crassicornis (H.c.) has challenged this view, and instead suggested that extinction erased the original associative memory. We have re-examined extinction in H.c. to test whether extinguished associative memories can be detected on the behavioral and cellular levels, and to characterize the temporal variables involved. Associative conditioning using pairings of light (CS) and rotation (US) produced characteristic suppression of H.c. phototactic behavior. A single session of extinction training (repeated light-alone presentations) reversed suppressed behavior back to pre-training levels when administered 15 min after associative conditioning. This effect was abolished if extinction was delayed by 23 h, and yet was recovered using extended extinction training (three consecutive daily extinction sessions). Extinguished phototactic suppression did not spontaneously recover at any retention interval (RI) tested (2-, 24-, 48-, 72-h), or after additional US presentations (no observed reinstatement). Extinction training (single session, 15 min interval) also reversed the pairing-produced increases in light-evoked spike frequencies of Type B photoreceptors, an identified site of associative memory storage that is causally related to phototactic suppression. These results suggest that the behavioral effects of extinction training are not due to temporary suppression of associative memories, but instead represent a reversal of the underlying cellular changes necessary for the expression of learning. In the companion article, we further elucidate mechanisms responsible for extinction-produced reversal of memory-related neural plasticity in Type B photoreceptors.