Associative visual learning by tethered bees in a controlled visual environment

Efficient visual learning by bumble bees in virtual-reality conditions: Size does not matter

Recent developments allowed establishing virtual-reality (VR) setups to study multiple aspects of visual learning in honey bees under controlled experimental conditions. Here, we adopted a VR environment to investigate the visual learning in the buff-tailed bumble bee Bombus terrestris. Based on responses to appetitive and aversive reinforcements used for conditioning, we show that bumble bees had the proper appetitive motivation to engage in the VR experiments and that they learned efficiently elemental color discriminations. In doing so, they reduced the latency to make a choice, increased the proportion of direct paths toward the virtual stimuli and walked faster toward them. Performance in a short-term retention test showed that bumble bees chose and fixated longer on the correct stimulus in the absence of reinforcement. Body size and weight, although variable across individuals, did not affect cognitive performances and had a mild impact on motor performances. Overall, we show that bumble bees are suitable experimental subjects for experiments on visual learning under VR conditions, which opens important perspectives for invasive studies on the neural and molecular bases of such learning given the robustness of these insects and the accessibility of their brain.

Active Sensing in Bees Through Antennal Movements Is Independent of Odor Molecule

When sampling odors, many insects are moving their antennae in a complex but repeatable fashion. Previous studies with bees have tracked antennal movements in only two dimensions, with a low sampling rate and with relatively few odorants. A detailed characterization of the multimodal antennal movement patterns as function of olfactory stimuli is thus wanted. The aim of this study is to test for a relationship between the scanning movements and the properties of the odor molecule. We tracked several key locations on the antennae of bumblebees at high frequency and in three dimensions while stimulating the insect with puffs of 11 common odorants released in a low-speed continuous flow. Water and paraffin were used as negative controls. Movement analysis was done with the neural network Deeplabcut. Bees use a stereotypical oscillating motion of their antennae when smelling odors, similar across all bees, independently of the identity of the odors and hence their diffusivity and vapor pressure. The variability in the movement amplitude among odors is as large as between individuals. The main type of oscillation at low frequencies and large amplitude is triggered by the presence of an odor and is in line with previous work, as is the speed of movement. The second oscillation mode at higher frequencies and smaller amplitudes is constantly present. Antennae are quickly deployed when a stimulus is perceived, decorrelate their movement trajectories rapidly, and oscillate vertically with a large amplitude and laterally with a smaller one. The cone of airspace thus sampled was identified through the 3D understanding of the motion patterns. The amplitude and speed of antennal scanning movements seem to be function of the internal state of the animal, rather than determined by the odorant. Still, bees display an active olfactory sampling strategy. First, they deploy their antennae when perceiving an odor. Second, fast vertical scanning movements further increase the odorant capture rate. Finally, lateral movements might enhance the likelihood to locate the source of odor, similarly to the lateral scanning movement of insects at odor plume boundaries.

Visual learning in tethered bees modifies flight orientation and is impaired by epinastine

Visual-orientation learning of a tethered flying bee was investigated using a flight simulator and a novel protocol in which orientation preference toward trained visual targets was assessed in tests performed before and after appetitive conditioning. Either a blue or a green rectangle (conditioned stimulus, CS) was associated with 30% sucrose solution (unconditioned stimulus, US), whereas the other rectangle was not paired with US. Bees were tested in a closed-looped flight simulator 5 min after ten pairings of the US and CS. Conditioned bees were preferentially oriented to the CS after such training. This increase in preference for CS was maintained for 24 h, indicating the presence of long-term memory. Because the total orienting time was not altered by conditioning, conditioning did not enhance orientation activity itself but increased the relative time for orientation to CS. When 0.4 or 4 mM epinastine (an antagonist of octopamine receptors) was injected into the bee's head 30 min prior to the experiment, both short- and long-term memory formation were significantly impaired, suggesting that octopamine, which is crucial for appetitive olfactory learning in insects, is also involved in visual orientation learning.

Multimodal Information Processing and Associative Learning in the Insect Brain

Simple Summary

Insect behaviors are a great indicator of evolution and provide useful information about the complexity of organisms. The realistic sensory scene of an environment is complex and replete with multisensory inputs, making the study of sensory integration that leads to behavior highly relevant. We summarize the recent findings on multimodal sensory integration and the behaviors that originate from them in our review.

Abstract

The study of sensory systems in insects has a long-spanning history of almost an entire century. Olfaction, vision, and gustation are thoroughly researched in several robust insect models and new discoveries are made every day on the more elusive thermo- and mechano-sensory systems. Few specialized senses such as hygro- and magneto-reception are also identified in some insects. In light of recent advancements in the scientific investigation of insect behavior, it is not only important to study sensory modalities individually, but also as a combination of multimodal inputs. This is of particular significance, as a combinatorial approach to study sensory behaviors mimics the real-time environment of an insect with a wide spectrum of information available to it. As a fascinating field that is recently gaining new insight, multimodal integration in insects serves as a fundamental basis to understand complex insect behaviors including, but not limited to navigation, foraging, learning, and memory. In this review, we have summarized various studies that investigated sensory integration across modalities, with emphasis on three insect models (honeybees, ants and flies), their behaviors, and the corresponding neuronal underpinnings.

The Neural Signature of Visual Learning Under Restrictive Virtual-Reality Conditions

Honey bees are reputed for their remarkable visual learning and navigation capabilities. These capacities can be studied in virtual reality (VR) environments, which allow studying performances of tethered animals in stationary flight or walk under full control of the sensory environment. Here, we used a 2D VR setup in which a tethered bee walking stationary under restrictive closed-loop conditions learned to discriminate vertical rectangles differing in color and reinforcing outcome. Closed-loop conditions restricted stimulus control to lateral displacements. Consistently with prior VR analyses, bees learned to discriminate the trained stimuli. Ex vivo analyses on the brains of learners and non-learners showed that successful learning led to a downregulation of three immediate early genes in the main regions of the visual circuit, the optic lobes (OLs) and the calyces of the mushroom bodies (MBs). While Egr1 was downregulated in the OLs, Hr38 and kakusei were coincidently downregulated in the calyces of the MBs. Our work thus reveals that color discrimination learning induced a neural signature distributed along the sequential pathway of color processing that is consistent with an inhibitory trace. This trace may relate to the motor patterns required to solve the discrimination task, which are different from those underlying pathfinding in 3D VR scenarios allowing for navigation and exploratory learning and which lead to IEG upregulation.

Visual learning in a virtual reality environment upregulates immediate early gene expression in the mushroom bodies of honey bees

Free-flying bees learn efficiently to solve numerous visual tasks. Yet, the neural underpinnings of this capacity remain unexplored. We used a 3D virtual reality (VR) environment to study visual learning and determine if it leads to changes in immediate early gene (IEG) expression in specific areas of the bee brain. We focused on kakusei, Hr38 and Egr1, three IEGs that have been related to bee foraging and orientation, and compared their relative expression in the calyces of the mushroom bodies, the optic lobes and the rest of the brain after color discrimination learning. Bees learned to discriminate virtual stimuli displaying different colors and retained the information learned. Successful learners exhibited Egr1 upregulation only in the calyces of the mushroom bodies, thus uncovering a privileged involvement of these brain regions in associative color learning and the usefulness of Egr1 as a marker of neural activity induced by this phenomenon.

Motion cues from the background influence associative color learning of honey bees in a virtual-reality scenario

Honey bees exhibit remarkable visual learning capacities, which can be studied using virtual reality (VR) landscapes in laboratory conditions. Existing VR environments for bees are imperfect as they provide either open-loop conditions or 2D displays. Here we achieved a true 3D environment in which walking bees learned to discriminate a rewarded from a punished virtual stimulus based on color differences. We included ventral or frontal background cues, which were also subjected to 3D updating based on the bee movements. We thus studied if and how the presence of such motion cues affected visual discrimination in our VR landscape. Our results showed that the presence of frontal, and to a lesser extent, of ventral background motion cues impaired the bees' performance. Whenever these cues were suppressed, color discrimination learning became possible. We analyzed the specific contribution of foreground and background cues and discussed the role of attentional interference and differences in stimulus salience in the VR environment to account for these results. Overall, we show how background and target cues may interact at the perceptual level and influence associative learning in bees. In addition, we identify issues that may affect decision-making in VR landscapes, which require specific control by experimenters.

Visuo-Motor Feedback Modulates Neural Activities in the Medulla of the Honeybee, Apis mellifera

Behavioral and internal-state modulation of sensory processing has been described in several organisms. In insects, visual neurons in the optic lobe are modulated by locomotion, but the degree to which visual-motor feedback modulates these neurons remains unclear. Moreover, it also remains unknown whether self-generated and externally generated visual motion are processed differently. Here, we implemented a virtual reality system that allowed fine-scale control over visual stimulation in relation to animal motion, in combination with multichannel recording of neural activity in the medulla of a female honeybee (Apis mellifera). We found that this activity was modulated by locomotion, although, in most cases, only when the bee had behavioral control over the visual stimulus (i.e., in a closed-loop system). Moreover, closed-loop control modulated a third of the recorded neurons, and the application of octopamine (OA) evoked similar changes in neural responses that were observed in a closed loop. Additionally, in a subset of modulated neurons, fixation on a visual stimulus was preceded by an increase in firing rate. To further explore the relationship between neuromodulation and adaptive control of the visual environment of the bee, we modified motor gain sensitivity while locally injecting an OA receptor antagonist into the medulla. Whereas female honeybees were tuned to a motor gain of -2 to 2 (between the heading of the bee and its visual feedback), local disruption of the OA pathway in the medulla abolished this tuning, resulting in similar low levels of response across levels of motor gain. Our results show that behavioral control modulates neural activity in the medulla and ultimately impacts behavior.SIGNIFICANCE STATEMENT When moving, an animal generates the motion of the visual scene over its retina. We asked whether self-generated and externally generated optic flow are processed differently in the insect medulla. Our results show that closed-loop control of the visual stimulus modulates neural activity as early as the medulla and ultimately impacts behavior. Moreover, blocking octopaminergic modulation further disrupted object-tracking responses. Our results suggest that the medulla is an important site for context-dependent processing of visual information and that placing the animal in a closed-loop environment may be essential to understanding its visual cognition and processing.

Olfactory coding in honeybees

With less than a million neurons, the western honeybee Apis mellifera is capable of complex olfactory behaviors and provides an ideal model for investigating the neurophysiology of the olfactory circuit and the basis of olfactory perception and learning. Here, we review the most fundamental aspects of honeybee's olfaction: first, we discuss which odorants dominate its environment, and how bees use them to communicate and regulate colony homeostasis; then, we describe the neuroanatomy and the neurophysiology of the olfactory circuit; finally, we explore the cellular and molecular mechanisms leading to olfactory memory formation. The vastity of histological, neurophysiological, and behavioral data collected during the last century, together with new technological advancements, including genetic tools, confirm the honeybee as an attractive research model for understanding olfactory coding and learning.

A motion compensation treadmill for untethered wood ants (Formica rufa): evidence for transfer of orientation memories from free-walking training

The natural scale of insect navigation during foraging makes it challenging to study under controlled conditions. Virtual reality and trackball setups have offered experimental control over visual environments while studying tethered insects, but potential limitations and confounds introduced by tethering motivates the development of alternative untethered solutions. In this paper, we validate the use of a motion compensator (or ‘treadmill’) to study visually driven behaviour of freely moving wood ants (Formica rufa). We show how this setup allows naturalistic walking behaviour and preserves foraging motivation over long time frames. Furthermore, we show that ants are able to transfer associative and navigational memories from classical maze and arena contexts to our treadmill. Thus, we demonstrate the possibility to study navigational behaviour over ecologically relevant durations (and virtual distances) in precisely controlled environments, bridging the gap between natural and highly controlled laboratory experiments.

Summary: We have developed and validated a motion compensating treadmill for wood ants which opens new perspectives to study insect navigation behaviour in a fully controlled manner over ecologically relevant durations.

Using virtual worlds to understand insect navigation for bio-inspired systems

Insects perform a wide array of intricate behaviors over large spatial and temporal scales in complex natural environments. A mechanistic understanding of insect cognition has direct implications on how brains integrate multimodal information and can inspire bio-based solutions for autonomous robots. Virtual Reality (VR) offers an opportunity assess insect neuroethology while presenting complex, yet controlled, stimuli. Here, we discuss the use of insects as inspiration for artificial systems, recent advances in different VR technologies, current knowledge gaps, and the potential for application of insect VR research to bio-inspired robots. Finally, we advocate the need to diversify our model organisms, behavioral paradigms, and embrace the complexity of the natural world. This will help us to uncover the proximate and ultimate basis of brain and behavior and extract general principles for common challenging problems.

Considerations for Insect Learning in Integrated Pest Management

The past 100 yr have seen dramatic philosophical shifts in our approach to controlling or managing pest species. The introduction of integrated pest management in the 1970s resulted in the incorporation of biological and behavioral approaches to preserve ecosystems and reduce reliance on synthetic chemical pesticides. Increased understanding of the local ecosystem, including its structure and the biology of its species, can improve efficacy of integrated pest management strategies. Pest management strategies incorporating insect learning paradigms to control insect pests or to use insects to control other pests can mediate risk to nontarget insects, including pollinators. Although our understanding of insect learning is in its early stages, efforts to integrate insect learning into pest management strategies have been promising. Due to considerable differences in cognitive abilities among insect species, a case-by-case assessment is needed for each potential application of insect learning within a pest management strategy.

Learning and Its Neural Correlates in a Virtual Environment for Honeybees

The search for neural correlates of operant and observational learning requires a combination of two (experimental) conditions that are very difficult to combine: stable recording from high order neurons and free movement of the animal in a rather natural environment. We developed a virtual environment (VE) that simulates a simplified 3D world for honeybees walking stationary on an air-supported spherical treadmill. We show that honeybees perceive the stimuli in the VE as meaningful by transferring learned information from free flight to the virtual world. In search for neural correlates of learning in the VE, mushroom body extrinsic neurons were recorded over days during learning. We found changes in the neural activity specific to the rewarded and unrewarded visual stimuli. Our results suggest an involvement of the mushroom body extrinsic neurons in operant learning in the honeybee (Apis mellifera).

Transfer of Visual Learning Between a Virtual and a Real Environment in Honey Bees: The Role of Active Vision

To study visual learning in honey bees, we developed a virtual reality (VR) system in which the movements of a tethered bee walking stationary on a spherical treadmill update the visual panorama presented in front of it (closed-loop conditions), thus creating an experience of immersion within a virtual environment. In parallel, we developed a small Y-maze with interchangeable end-boxes, which allowed replacing repeatedly a freely walking bee into the starting point of the maze for repeated decision recording. Using conditioning and transfer experiments between the VR setup and the Y-maze, we studied the extent to which movement freedom and active vision are crucial for learning a simple color discrimination. Approximately 57% of the bees learned the visual discrimination in both conditions. Transfer from VR to the maze improved significantly the bees’ performances: 75% of bees having chosen the CS+ continued doing so and 100% of bees having chosen the CS− reverted their choice in favor of the CS+. In contrast, no improvement was seen for these two groups of bees during the reciprocal transfer from the Y-maze to VR. In this case, bees exhibited inconsistent choices in the VR setup. The asymmetric transfer between contexts indicates that the information learned in each environment may be different despite the similar learning success. Moreover, it shows that reducing the possibility of active vision and movement freedom in the passage from the maze to the VR impairs the expression of visual learning while increasing them in the reciprocal transfer improves it. Our results underline the active nature of visual processing in bees and allow discussing the developments required for immersive VR experiences in insects.

Using virtual reality to study visual performances of honeybees

Virtual reality (VR) offers an appealing experimental framework for studying visual performances of insects under highly controlled conditions. In the case of the honeybee Apis mellifera, this possibility may fill the gap between behavioural analyses in free-flight and cellular analyses in the laboratory. Using automated, computer-controlled systems, it is possible to generate virtual stimuli or even entire environments that can be modified to test hypotheses on bee visual behaviour. The bee itself can remain tethered in place, making it possible to record neural activity while the bees is performing behavioural tasks. Recent studies have examined visual navigation and attentional processes in VR on flying or walking tethered bees, but experimental paradigms for examining visual learning and memory are only just emerging. Behavioural performances of bees under current experimental conditions are often lower in VR than in natural environments, but further improvements on current experimental protocols seem possible. Here we discuss current developments and conclude that it is essential to tailor the specifications of the VR simulation to the visual processing of honeybees to improve the success of this research endeavour.