Resolving conflict between aversive and appetitive learning of views: how ants shift to a new route during navigation

Ants store and recall views associated with foraging success, facilitating future foraging journeys. Negative views are also learned, but instead prompt avoidance behaviors such as turning away. However, little is known about the aversive view's role in navigation, the effect of cue conflict, or the contextual relationship between learning and recalling. In this study, we tested Myrmecia midas' capacity for aversive learning of views either independently of or in conflict with appetitive events. We either captured and released foragers when reaching a location or let them pass unhindered. After a few journeys, captured foragers exhibited aversive learning by circumventing the capture location and increasing both meandering and scanning. Ants that experienced foraging-appetitive and homing-aversive events on their journeys exhibited lower rates of avoidance behavior and scans than those experiencing aversive events in both outbound and homebound journeys. The foraging-aversive and homing-aversive ants exhibited similar levels of avoidance and scanning as those that experienced the foraging-aversive and homing-appetitive. We found that foragers showed evidence of context specificity in their scanning behavior, but not in other measures of aversive learning. The foragers did not increase their meandering and scans while approaching the views associated with aversive events. In addition to shedding light on the role of aversive views in navigation, our finding has important implications for understanding the learning mechanisms triggered by handling animals.

Inhibitory learning of phototaxis by honeybees in a passive-avoidance task

Honeybees are a standard model for the study of appetitive learning and memory. Yet, fewer attempts have been performed to characterize aversive learning and memory in this insect and uncover its molecular underpinnings. Here, we took advantage of the positive phototactic behavior of bees kept away from the hive in a dark environment and established a passive-avoidance task in which they had to suppress positive phototaxis. Bees placed in a two-compartment box learned to inhibit spontaneous attraction to a compartment illuminated with blue light by associating and entering into that chamber with shock delivery. Inhibitory learning resulted in an avoidance memory that could be retrieved 24 h after training and that was specific to the punished blue light. The memory was mainly operant but involved a Pavlovian component linking the blue light and the shock. Coupling conditioning with transcriptional analyses in key areas of the brain showed that inhibitory learning of phototaxis leads to an up-regulation of the dopaminergic receptor gene Amdop1 in the calyces of the mushroom bodies, consistently with the role of dopamine signaling in different forms of aversive learning in insects. Our results thus introduce new perspectives for uncovering further cellular and molecular underpinnings of aversive learning and memory in bees. Overall, they represent an important step toward comparative learning studies between the appetitive and the aversive frameworks.

UV-light perception is modulated by the odour element of an olfactory-visual compound in restrained honeybees

Honeybees use visual and olfactory cues to detect flowers during foraging trips. Hence, the reward association of a nectar source is a multimodal construct which has at least two major components – olfactory and visual cues. How both sensory modalities are integrated to form a common reward association and whether and how they may interfere, is an open question. The present study used stimulation with UV, blue and green light to evoke distinct photoreceptor activities in the compound eye and two odour components (Geraniol, Citronellol). To test if a compound of both modalities is perceived as the sum of its elements (elemental processing) or as a unique cue (configural processing) we combined monochromatic light with single odour components in positive (PP) and negative patterning (NP) experiments. During PP, the compound of two modalities was rewarded, whereas the single elements were not. For NP, stimuli comprising a single modality were rewarded, whereas the olfactory-visual compound was not. Furthermore, we compared the differentiation abilities between two light stimuli with and without being part of an olfactory-visual compound. Interestingly, the behavioural performances revealed a prominent case of configural processing, but only in those cases when UV light was an element of an olfactory-visual compound. Instead, learning with green- and blue-containing compounds rather supports elemental processing theory.

Counting insects

When counting-like abilities were first described in the honeybee in the mid-1990s, many scholars were sceptical, but such capacities have since been confirmed in a number of paradigms and also in other insect species. Counter to the intuitive notion that counting is a cognitively advanced ability, neural network analyses indicate that it can be mediated by very small neural circuits, and we should therefore perhaps not be surprised that insects and other small-brained animals such as some small fish exhibit such abilities. One outstanding question is how bees actually acquire numerical information. For perception of small numerosities, working-memory capacity may limit the number of items that can be enumerated, but within these limits, numerosity can be evaluated accurately and (at least in primates) in parallel. However, presentation of visual stimuli in parallel does not automatically ensure parallel processing. Recent work on the question of whether bees can see ‘at a glance’ indicates that bees must acquire spatial detail by sequential scanning rather than parallel processing. We explore how this might be tested for a numerosity task in bees and other animals.

This article is part of a discussion meeting issue ‘The origins of numerical abilities’.

Limitations of learning in the proboscis reflex of the flower visiting syrphid fly Eristalis tenax

Flower visiting Eristalis hoverflies feed on nectar and pollen and are known to rely on innate colour preferences. In addition to a preference for visiting yellow flowers, the flies possess an innate proboscis reflex elicited by chemical as well as yellow colour stimuli. In this study we show that the flies' proboscis reflex is only triggered by yellow colour stimuli and not altered by conditioning to other colours. Neither in absolute nor in differential conditioning experiments the flies learned to associate other colours than yellow with reward. Even flies that experienced only blue nutrients during the first four days after hatching could not be trained to extend the proboscis towards other colours than yellow. The natural targets of the visually elicited proboscis reflex are yellow pollen and yellow anthers. One consequence of our findings is that flowers might advertise nectar and pollen rewards for Eristalis hoverflies by a yellow colour hue of nectar guides, nectaries, stamens or pollen. Alternatively, flowers might protect their pollen against Eristalis by displaying other pollen colours than yellow or direct flies by yellow pollen-mimicking floral guides towards nectar resources. Testing the proboscis extension of various hoverfly species in the field showed that only Eristalis hoverflies possess the proboscis reflex elicited by yellow colour hues.

A Tyrosine-Hydroxylase Characterization of Dopaminergic Neurons in the Honey Bee Brain

Dopamine (DA) plays a fundamental role in insect behavior as it acts both as a general modulator of behavior and as a value system in associative learning where it mediates the reinforcing properties of unconditioned stimuli (US). Here we aimed at characterizing the dopaminergic neurons in the central nervous system of the honey bee, an insect that serves as an established model for the study of learning and memory. We used tyrosine hydroxylase (TH) immunoreactivity (ir) to ensure that the neurons detected synthesize DA endogenously. We found three main dopaminergic clusters, C1-C3, which had been previously described; the C1 cluster is located in a small region adjacent to the esophagus (ES) and the antennal lobe (AL); the C2 cluster is situated above the C1 cluster, between the AL and the vertical lobe (VL) of the mushroom body (MB); the C3 cluster is located below the calyces (CA) of the MB. In addition, we found a novel dopaminergic cluster, C4, located above the dorsomedial border of the lobula, which innervates the visual neuropils of the bee brain. Additional smaller processes and clusters were found and are described. The profuse dopaminergic innervation of the entire bee brain and the specific connectivity of DA neurons, with visual, olfactory and gustatory circuits, provide a foundation for a deeper understanding of how these sensory modules are modulated by DA, and the DA-dependent value-based associations that occur during associative learning.

Aversive Learning of Colored Lights in Walking Honeybees

The honeybee has been established as an important model organism in studies on visual learning. So far the emphasis has been on appetitive conditioning, simulating floral discrimination, and homing behavior, where bees perform exceptionally well in visual discrimination tasks. However, bees in the wild also face dangers, and recent findings suggest that what is learned about visual percepts is highly context dependent. A stimulus that follows an unpleasant period, is associated with the feeling of relief- or safety in humans and animals, thus acquiring a positive meaning. Whether this is also the case in honeybees is still an open question. Here, we conditioned bees aversively in a walking arena where each half was illuminated by light of a specific wavelength and intensity, one of which was combined with electric shocks. In this paradigm, the bees' preferences to the different lights were modified through nine conditioning trials, forming robust escape, and avoidance behaviors. Strikingly, we found that while 465 nm (human blue) and 590 nm (human yellow) lights both could acquire negative valences (inducing avoidance response), 525 nm (human green) light could not. This indicates that green light holds an innate meaning of safety which is difficult to overrule even through intensive aversive conditioning. The bees had slight initial preferences to green over the blue and the yellow lights, which could be compensated by adjusting light intensity. However, this initial bias played a minor role while the chromatic properties were the most salient characteristics of the light stimuli during aversive conditioning. Moreover, bees could learn the light signaling safety, revealing the existence of a relief component in aversive operant conditioning, similar to what has been observed in other animals.

Insect Bio-inspired Neural Network Provides New Evidence on How Simple Feature Detectors Can Enable Complex Visual Generalization and Stimulus Location Invariance in the Miniature Brain of Honeybees

The ability to generalize over naturally occurring variation in cues indicating food or predation risk is highly useful for efficient decision-making in many animals. Honeybees have remarkable visual cognitive abilities, allowing them to classify visual patterns by common features despite having a relatively miniature brain. Here we ask the question whether generalization requires complex visual recognition or whether it can also be achieved with relatively simple neuronal mechanisms. We produced several simple models inspired by the known anatomical structures and neuronal responses within the bee brain and subsequently compared their ability to generalize achromatic patterns to the observed behavioural performance of honeybees on these cues. Neural networks with just eight large-field orientation-sensitive input neurons from the optic ganglia and a single layer of simple neuronal connectivity within the mushroom bodies (learning centres) show performances remarkably similar to a large proportion of the empirical results without requiring any form of learning, or fine-tuning of neuronal parameters to replicate these results. Indeed, a model simply combining sensory input from both eyes onto single mushroom body neurons returned correct discriminations even with partial occlusion of the patterns and an impressive invariance to the location of the test patterns on the eyes. This model also replicated surprising failures of bees to discriminate certain seemingly highly different patterns, providing novel and useful insights into the inner workings facilitating and limiting the utilisation of visual cues in honeybees. Our results reveal that reliable generalization of visual information can be achieved through simple neuronal circuitry that is biologically plausible and can easily be accommodated in a tiny insect brain.

We present two very simple neural network models based directly on the neural circuitry of honeybees. These models, using just four large-field visual input neurons from each eye that sparsely connect to a single layer of interneurons within the bee brain learning centres, are able to discriminate complex achromatic patterns without the need for an internal image representation. One model combining the visual input from both eyes showed an impressive invariance to the location of the test patterns on the retina and even succeeded with the partial occlusion of these cues, which would obviously be advantageous for free-flying bees. We show that during generalization experiments, where the models have to distinguish between two novel stimuli, one more similar to a training set of patterns, that both simple models have performances very similar to the empirical honeybee results. Our models only failed to generalize to the correct test pattern when the distractor pattern contained only a few small differences; we discuss how the protocols employed during training enable honeybees to still distinguish these stimuli. This research provides new insights into the surprisingly limited neurobiological complexity that is required for specific cognitive abilities, and how these mechanisms may be employed within the tiny brain of the bee.

Advances and limitations of visual conditioning protocols in harnessed bees

Bees are excellent invertebrate models for studying visual learning and memory mechanisms, because of their sophisticated visual system and impressive cognitive capacities associated with a relatively simple brain. Visual learning in free-flying bees has been traditionally studied using an operant conditioning paradigm. This well-established protocol, however, can hardly be combined with invasive procedures for studying the neurobiological basis of visual learning. Different efforts have been made to develop protocols in which harnessed honey bees could associate visual cues with reinforcement, though learning performances remain poorer than those obtained with free-flying animals. Especially in the last decade, the intention of improving visual learning performances of harnessed bees led many authors to adopt distinct visual conditioning protocols, altering parameters like harnessing method, nature and duration of visual stimulation, number of trials, inter-trial intervals, among others. As a result, the literature provides data hardly comparable and sometimes contradictory. In the present review, we provide an extensive analysis of the literature available on visual conditioning of harnessed bees, with special emphasis on the comparison of diverse conditioning parameters adopted by different authors. Together with this comparative overview, we discuss how these diverse conditioning parameters could modulate visual learning performances of harnessed bees.

Motion cues improve the performance of harnessed bees in a colour learning task

The proboscis extension conditioning (PER) is a successful behavioural paradigm for studying sensory and learning mechanisms in bees. Whilst mainly used with olfactory and tactile stimuli, more recently reliable PER conditioning has been achieved with visual stimuli such as colours and looming stripes. However, the results reported in different studies vary quite strongly, and it remains controversially discussed how to best condition visual PER. It is particularly striking that visual PER leads to more limited performance as compared to visual conditioning of free-flying bees. It could be that visual PER learning is affected by the lack of movement and that the presence of visual motion cues could compensate for it. We tested whether bees would show differences in learning performances when conditioned either with a colour and motion stimulus in combination or with colour alone. Colour acquisition was improved in the presence of the motion stimulus. The result is consistent with the idea that visual learning might be tightly linked to movement in bees, given that they use vision predominantly during flight. Our results further confirm recent findings that successful visual PER conditioning in bees is achievable without obligatorily removing the antennae.

Shared mushroom body circuits underlie visual and olfactory memories in Drosophila

In nature, animals form memories associating reward or punishment with stimuli from different sensory modalities, such as smells and colors. It is unclear, however, how distinct sensory memories are processed in the brain. We established appetitive and aversive visual learning assays for Drosophila that are comparable to the widely used olfactory learning assays. These assays share critical features, such as reinforcing stimuli (sugar reward and electric shock punishment), and allow direct comparison of the cellular requirements for visual and olfactory memories. We found that the same subsets of dopamine neurons drive formation of both sensory memories. Furthermore, distinct yet partially overlapping subsets of mushroom body intrinsic neurons are required for visual and olfactory memories. Thus, our results suggest that distinct sensory memories are processed in a common brain center. Such centralization of related brain functions is an economical design that avoids the repetition of similar circuit motifs.

DOI:http://dx.doi.org/10.7554/eLife.02395.001

Animals tend to associate good and bad things with certain visual scenes, smells and other kinds of sensory information. If we get food poisoning after eating a new food, for example, we tend to associate the taste and smell of the new food with feelings of illness. This is an example of a negative ‘associative memory’, and it can persist for months, even when we know that our sickness was not caused by the new food itself but by some foreign body that should not have been in the food. The same is true for positive associative memories.

It is known that many associative memories contain information from more than one of the senses. Our memory of a favorite food, for instance, includes its scent, color and texture, as well as its taste. However, little is known about the ways in which information from the different senses is processed in the brain. Does each sense have its own dedicated memory circuit, or do multiple senses converge to the same memory circuit?

A number of studies have used olfactory (smell) and visual stimuli to study the basic neuroscience that underpins associative memories in fruit flies. The olfactory experiments traditionally use sugar and electric shocks to induce positive and negative associations with various scents. However, the visual experiments use other methods to induce associations with colors. This means that it is difficult to combine and compare the results of olfactory and visual experiments.

Now, Vogt, Schnaitmann et al. have developed a transparent grid that can be used to administer electric shocks in visual experiments. This allows direct comparisons to be made between the neuronal processing of visual associative memories and the neural processing of olfactory associative memories.

Vogt, Schnaitmann et al. showed that both visual and olfactory stimuli are modulated in the same subset of dopamine neurons for positive associative memories. Similarly, another subset of dopamine neurons was found to drive negative memories of both the visual and olfactory stimuli. The work of Vogt, Schnaitmann et al. shows that associative memories are processed by a centralized circuit that receives both visual and olfactory inputs, thus reducing the number of memory circuits needed for such memories.

DOI:http://dx.doi.org/10.7554/eLife.02395.002

Rules and mechanisms of punishment learning in honey bees: the aversive conditioning of the sting extension response

Honeybees constitute established model organisms for the study of appetitive learning and memory. In recent years, the establishment of the technique of olfactory conditioning of the sting extension response (SER) has yielded new insights into the rules and mechanisms of aversive learning in insects. In olfactory SER conditioning, a harnessed bee learns to associate an olfactory stimulus as the conditioned stimulus with the noxious stimulation of an electric shock as the unconditioned stimulus. Here, we review the multiple aspects of honeybee aversive learning that have been uncovered using Pavlovian conditioning of the SER. From its behavioral principles and sensory variants to its cellular bases and implications for understanding social organization, we present the latest advancements in the study of punishment learning in bees and discuss its perspectives in order to define future research avenues and necessary improvements. The studies presented here underline the importance of studying honeybee learning not only from an appetitive but also from an aversive perspective, in order to uncover behavioral and cellular mechanisms of individual and social plasticity.

APIS-a novel approach for conditioning honey bees

Honey bees perform robustly in different conditioning paradigms. This makes them excellent candidates for studying mechanisms of learning and memory at both an individual and a population level. Here we introduce a novel method of honey bee conditioning: APIS, the Automatic Performance Index System. In an enclosed walking arena where the interior is covered with an electric grid, presentation of odors from either end can be combined with weak electric shocks to form aversive associations. To quantify behavioral responses, we continuously monitor the movement of the bee by an automatic tracking system. We found that escapes from one side to the other, changes in velocity as well as distance and time spent away from the punished odor are suitable parameters to describe the bee's learning capabilities. Our data show that in a short-term memory test the response rate for the conditioned stimulus (CS) in APIS correlates well with response rate obtained from conventional Proboscis Extension Response (PER)-conditioning. Additionally, we discovered that bees modulate their behavior to aversively learned odors by reducing their rate, speed and magnitude of escapes and that both generalization and extinction seem to be different between appetitive and aversive stimuli. The advantages of this automatic system make it ideal for assessing learning rates in a standardized and convenient way, and its flexibility adds to the toolbox for studying honey bee behavior.

Color dependent learning in restrained Africanized honey bees

Associative color learning has been demonstrated to be very poor using restrained European honey bees unless the antennae are amputated. Consequently, our understanding of proximate mechanisms in visual information processing is handicapped. Here we test learning performance of Africanized honey bees under restrained conditions with visual and olfactory stimulation using the proboscis extension response (PER) protocol. Restrained individuals were trained to learn an association between a color stimulus and a sugar-water reward. We evaluated performance for "absolute" learning (learned association between a stimulus and a reward) and "discriminant" learning (discrimination between two stimuli). Restrained Africanized honey bees (AHBs) readily learned the association of color stimulus for both blue and green LED stimuli in absolute and discriminatory learning tasks within 7 presentations, but not with violet as the rewarded color. Additionally, 24-hour memory improved considerably during the discrimination task, compared to absolute association (15%-55%). We found that antennal amputation was unnecessary and reduced performance in AHBs. Thus color learning can now be studied using the PER protocol with intact AHBs. This finding opens the way toward investigating visual and multimodal learning with application of neural techniques commonly used in restrained honey bees.