Transfer of Visual Learning Between a Virtual and a Real Environment in Honey Bees: The Role of Active Vision

Movement during the acquisition of a visual landmark may be necessary for rapid learning in ants

We conducted laboratory experiments using Japanese carpenter ants (Camponotus japonicus) to investigate whether movement during visual learning can influence the learning performance of ant foragers. We performed three different experiments. In the first experiment, the ants could move freely in a straight maze during the visual learning. The ants in the experiments two and three were fixed to a certain position during the visual learning training. A distinct difference between these two experiments was that the ants in one experiment could perceive an approaching visual stimulus during the training, although they were fixed. After training phases, a Y-maze test was performed. One arm of the Y-maze had a visual stimulus presented to the ants during the training. We found that the ants in the first experiment showed rapid learning and correctly selected the landmark arm. However, the ants in the experiments two and three did not exhibit any preference for the chosen arm. Interestingly, we found differences in the time spent around a certain location in the Y-maze between the experiments two and three. These results suggest that movement during visual learning may influence the rapid learning of ant foragers.

Efficient visual learning by bumble bees in virtual-reality conditions: Size does not matter

Recent developments allowed establishing virtual-reality (VR) setups to study multiple aspects of visual learning in honey bees under controlled experimental conditions. Here, we adopted a VR environment to investigate the visual learning in the buff-tailed bumble bee Bombus terrestris. Based on responses to appetitive and aversive reinforcements used for conditioning, we show that bumble bees had the proper appetitive motivation to engage in the VR experiments and that they learned efficiently elemental color discriminations. In doing so, they reduced the latency to make a choice, increased the proportion of direct paths toward the virtual stimuli and walked faster toward them. Performance in a short-term retention test showed that bumble bees chose and fixated longer on the correct stimulus in the absence of reinforcement. Body size and weight, although variable across individuals, did not affect cognitive performances and had a mild impact on motor performances. Overall, we show that bumble bees are suitable experimental subjects for experiments on visual learning under VR conditions, which opens important perspectives for invasive studies on the neural and molecular bases of such learning given the robustness of these insects and the accessibility of their brain.

Complex preference relationships between native and non-native angiosperms and foraging insect visitors in a suburban greenspace under field and laboratory conditions

The introduction and spread of non-native flora threatens native pollinators and plants. Non-native angiosperms can compete with native plants for pollinators, space, and other resources which can leave native bees without adequate nutritional or nesting resources, particularly specialist species. In the current study, we conducted flower preference experiments through field observations and controlled binary choice tests in an artificial arena to determine the impact of field vs. laboratory methods on flower preferences of native bees for native or non-native flowers within their foraging range. We conducted counts of insect pollinators foraging on the flowers of three plant species in a suburban green belt including one native (Arthropodium strictum) and two non-native (Arctotheca calendula and Taraxacum officinale) plant species. We then collected native halictid bees foraging on each of the three plant species and conducted controlled binary tests to determine their preferences for the flowers of native or non-native plant species. In the field counts, halictid bees visited the native plant significantly more than the non-native species. However, in the behavioural assays when comparing A. strictum vs. A. calendula, Lasioglossum (Chilalictus) lanarium (Family: Halictidae), bees significantly preferred the non-native species, regardless of their foraging history. When comparing A. strictum vs. T. officinale, bees only showed a preference for the non-native flower when it had been collected foraging on the flowers of that plant species immediately prior to the experiment; otherwise, they showed no flower preference. Our results highlight the influence that non-native angiosperms have on native pollinators and we discuss the complexities of the results and the possible reasons for different flower preferences under laboratory and field conditions.

Visual learning in tethered bees modifies flight orientation and is impaired by epinastine

Visual-orientation learning of a tethered flying bee was investigated using a flight simulator and a novel protocol in which orientation preference toward trained visual targets was assessed in tests performed before and after appetitive conditioning. Either a blue or a green rectangle (conditioned stimulus, CS) was associated with 30% sucrose solution (unconditioned stimulus, US), whereas the other rectangle was not paired with US. Bees were tested in a closed-looped flight simulator 5 min after ten pairings of the US and CS. Conditioned bees were preferentially oriented to the CS after such training. This increase in preference for CS was maintained for 24 h, indicating the presence of long-term memory. Because the total orienting time was not altered by conditioning, conditioning did not enhance orientation activity itself but increased the relative time for orientation to CS. When 0.4 or 4 mM epinastine (an antagonist of octopamine receptors) was injected into the bee's head 30 min prior to the experiment, both short- and long-term memory formation were significantly impaired, suggesting that octopamine, which is crucial for appetitive olfactory learning in insects, is also involved in visual orientation learning.

The Neural Signature of Visual Learning Under Restrictive Virtual-Reality Conditions

Honey bees are reputed for their remarkable visual learning and navigation capabilities. These capacities can be studied in virtual reality (VR) environments, which allow studying performances of tethered animals in stationary flight or walk under full control of the sensory environment. Here, we used a 2D VR setup in which a tethered bee walking stationary under restrictive closed-loop conditions learned to discriminate vertical rectangles differing in color and reinforcing outcome. Closed-loop conditions restricted stimulus control to lateral displacements. Consistently with prior VR analyses, bees learned to discriminate the trained stimuli. Ex vivo analyses on the brains of learners and non-learners showed that successful learning led to a downregulation of three immediate early genes in the main regions of the visual circuit, the optic lobes (OLs) and the calyces of the mushroom bodies (MBs). While Egr1 was downregulated in the OLs, Hr38 and kakusei were coincidently downregulated in the calyces of the MBs. Our work thus reveals that color discrimination learning induced a neural signature distributed along the sequential pathway of color processing that is consistent with an inhibitory trace. This trace may relate to the motor patterns required to solve the discrimination task, which are different from those underlying pathfinding in 3D VR scenarios allowing for navigation and exploratory learning and which lead to IEG upregulation.

Visual learning in a virtual reality environment upregulates immediate early gene expression in the mushroom bodies of honey bees

Free-flying bees learn efficiently to solve numerous visual tasks. Yet, the neural underpinnings of this capacity remain unexplored. We used a 3D virtual reality (VR) environment to study visual learning and determine if it leads to changes in immediate early gene (IEG) expression in specific areas of the bee brain. We focused on kakusei, Hr38 and Egr1, three IEGs that have been related to bee foraging and orientation, and compared their relative expression in the calyces of the mushroom bodies, the optic lobes and the rest of the brain after color discrimination learning. Bees learned to discriminate virtual stimuli displaying different colors and retained the information learned. Successful learners exhibited Egr1 upregulation only in the calyces of the mushroom bodies, thus uncovering a privileged involvement of these brain regions in associative color learning and the usefulness of Egr1 as a marker of neural activity induced by this phenomenon.

The short neuropeptide F (sNPF) promotes the formation of appetitive visual memories in honey bees

Motivation can critically influence learning and memory. Multiple neural mechanisms regulate motivational states, among which signalling via specific neuropeptides, such as NPY in vertebrates and NPF and its short variant sNPF in invertebrates, plays an essential role. The honey bee (Apis mellifera) is a privileged model for the study of appetitive learning and memory. Bees learn and memorize sensory cues associated with nectar reward while foraging, and their learning is affected by their feeding state. However, the neural underpinnings of their motivational states remain poorly known. Here we focused on the short neuropeptide F (sNPF) and studied if it modulates the acquisition and formation of colour memories. Artificially increasing sNPF levels in partially fed foragers with a reduced motivation to learn colours resulted in significant colour learning and memory above the levels exhibited by starved foragers. Our results thus identify sNPF as a critical component of motivational processes involved in foraging and in the cognitive processes associated with this activity in honey bees.

Motion cues from the background influence associative color learning of honey bees in a virtual-reality scenario

Honey bees exhibit remarkable visual learning capacities, which can be studied using virtual reality (VR) landscapes in laboratory conditions. Existing VR environments for bees are imperfect as they provide either open-loop conditions or 2D displays. Here we achieved a true 3D environment in which walking bees learned to discriminate a rewarded from a punished virtual stimulus based on color differences. We included ventral or frontal background cues, which were also subjected to 3D updating based on the bee movements. We thus studied if and how the presence of such motion cues affected visual discrimination in our VR landscape. Our results showed that the presence of frontal, and to a lesser extent, of ventral background motion cues impaired the bees' performance. Whenever these cues were suppressed, color discrimination learning became possible. We analyzed the specific contribution of foreground and background cues and discussed the role of attentional interference and differences in stimulus salience in the VR environment to account for these results. Overall, we show how background and target cues may interact at the perceptual level and influence associative learning in bees. In addition, we identify issues that may affect decision-making in VR landscapes, which require specific control by experimenters.

A Flying Platform to Investigate Neuronal Correlates of Navigation in the Honey Bee (Apis mellifera)

Navigating animals combine multiple perceptual faculties, learn during exploration, retrieve multi-facetted memory contents, and exhibit goal-directedness as an expression of their current needs and motivations. Navigation in insects has been linked to a variety of underlying strategies such as path integration, view familiarity, visual beaconing, and goal-directed orientation with respect to previously learned ground structures. Most works, however, study navigation either from a field perspective, analyzing purely behavioral observations, or combine computational models with neurophysiological evidence obtained from lab experiments. The honey bee (Apis mellifera) has long been a popular model in the search for neural correlates of complex behaviors and exhibits extraordinary navigational capabilities. However, the neural basis for bee navigation has not yet been explored under natural conditions. Here, we propose a novel methodology to record from the brain of a copter-mounted honey bee. This way, the animal experiences natural multimodal sensory inputs in a natural environment that is familiar to her. We have developed a miniaturized electrophysiology recording system which is able to record spikes in the presence of time-varying electric noise from the copter's motors and rotors, and devised an experimental procedure to record from mushroom body extrinsic neurons (MBENs). We analyze the resulting electrophysiological data combined with a reconstruction of the animal's visual perception and find that the neural activity of MBENs is linked to sharp turns, possibly related to the relative motion of visual features. This method is a significant technological step toward recording brain activity of navigating honey bees under natural conditions. By providing all system specifications in an online repository, we hope to close a methodological gap and stimulate further research informing future computational models of insect navigation.

Wild non-eusocial bees learn a colour discrimination task in response to simulated predation events

Despite representing the majority of bee species, non-eusocial bees (e.g. solitary, subsocial, semisocial, and quasisocial species) are comparatively understudied in learning, memory, and cognitive-like behaviour compared to eusocial bees, such as honeybees and bumblebees. Ecologically relevant colour discrimination tasks are well-studied in eusocial bees, and research has shown that a few non-eusocial bee species are also capable of colour learning and long-term memory retention. Australia hosts over 2000 native bee species, most of which are non-eusocial, yet evidence of cognitive-like behaviour and learning abilities under controlled testing conditions is lacking. In the current study, I examine the learning ability of a non-eusocial Australian bee, Lasioglossum (Chilalictus) lanarium, using aversive differential conditioning during a colour discrimination task. L. lanarium learnt to discriminate between salient blue- and yellow-coloured stimuli following training with simulated predation events. This study acts as a bridge between cognitive studies on eusocial and non-social bees and introduces a framework for testing non-eusocial wild bees on elemental visual learning tasks using aversive conditioning. Non-eusocial bee species are far more numerous than eusocial species and contribute to agriculture, economics, and ecosystem services in Australia and across the globe. Thus, it is important to study their capacity to learn flower traits allowing for successful foraging and pollination events, thereby permitting us a better understanding of their role in plant-pollinator interactions.

Colored-Light Preference in Zebrafish (Danio rerio)

Over the past decade, the zebrafish has been increasingly employed in biomedical neuroscience research due to its numerous evolutionarily conserved features with mammals. Its simple brain and the several molecular tools available for this species make the zebrafish an appealing model to study mechanisms of complex brain functions, including learning and memory. Most learning paradigms developed for the zebrafish have employed visual stimuli as the associative cue. Spontaneous color preference is a potential confound in such studies. It has been analyzed in zebrafish using colored objects, but with conflicting results. It has rarely been explored with colored light, despite the increasing use of computer-generated visual stimuli. Here, we employ a light emitting diode (RGB-system) light-based color preference task in the plus-maze. In two independent experiments, zebrafish were tested in a four-choice or dual-choice condition by using four different-colored lights (red, green, blue and yellow). Our results suggest a light preference hierarchy that depends on context, since yellow was preferred over green in the four-choice condition whereas blue was preferred over all other colors in the two-choice condition. These results are useful for future color-light-based learning experiments in zebrafish.

The Critical Role of Head Movements for Spatial Representation During Bumblebees Learning Flight

Bumblebees perform complex flight maneuvers around the barely visible entrance of their nest upon their first departures. During these flights bees learn visual information about the surroundings, possibly including its spatial layout. They rely on this information to return home. Depth information can be derived from the apparent motion of the scenery on the bees' retina. This motion is shaped by the animal's flight and orientation: Bees employ a saccadic flight and gaze strategy, where rapid turns of the head (saccades) alternate with flight segments of apparently constant gaze direction (intersaccades). When during intersaccades the gaze direction is kept relatively constant, the apparent motion contains information about the distance of the animal to environmental objects, and thus, in an egocentric reference frame. Alternatively, when the gaze direction rotates around a fixed point in space, the animal perceives the depth structure relative to this pivot point, i.e., in an allocentric reference frame. If the pivot point is at the nest-hole, the information is nest-centric. Here, we investigate in which reference frames bumblebees perceive depth information during their learning flights. By precisely tracking the head orientation, we found that half of the time, the head appears to pivot actively. However, only few of the corresponding pivot points are close to the nest entrance. Our results indicate that bumblebees perceive visual information in several reference frames when they learn about the surroundings of a behaviorally relevant location.

A motion compensation treadmill for untethered wood ants (Formica rufa): evidence for transfer of orientation memories from free-walking training

The natural scale of insect navigation during foraging makes it challenging to study under controlled conditions. Virtual reality and trackball setups have offered experimental control over visual environments while studying tethered insects, but potential limitations and confounds introduced by tethering motivates the development of alternative untethered solutions. In this paper, we validate the use of a motion compensator (or ‘treadmill’) to study visually driven behaviour of freely moving wood ants (Formica rufa). We show how this setup allows naturalistic walking behaviour and preserves foraging motivation over long time frames. Furthermore, we show that ants are able to transfer associative and navigational memories from classical maze and arena contexts to our treadmill. Thus, we demonstrate the possibility to study navigational behaviour over ecologically relevant durations (and virtual distances) in precisely controlled environments, bridging the gap between natural and highly controlled laboratory experiments.

Summary: We have developed and validated a motion compensating treadmill for wood ants which opens new perspectives to study insect navigation behaviour in a fully controlled manner over ecologically relevant durations.

Mushroom Body Extrinsic Neurons in Walking Bumblebees Correlate With Behavioral States but Not With Spatial Parameters During Exploratory Behavior

Central place foraging insects like honeybees and bumblebees learn to navigate efficiently between nest and feeding site. Essential components of this behavior can be moved to the laboratory. A major component of navigational learning is the active exploration of the test arena. These conditions have been used here to search for neural correlates of exploratory walking in the central arena (ground), and thigmotactic walking in the periphery (slope). We chose mushroom body extrinsic neurons (MBENs) because of their learning-related plasticity and their multi-modal sensitivities that may code relevant parameters in a brain state-dependent way. Our aim was to test whether MBENs code space-related components or are more involved in state-dependent processes characterizing exploration and thigmotaxis. MBENs did not respond selectively to body directions or locations. Their spiking activity differently correlated with walking speed depending on the animals' locations: on the ground, reflecting exploration, or on the slope, reflecting thigmotaxis. This effect depended on walking speed in different ways for different animals. We then asked whether these effects depended on spatial parameters or on the two states, exploration and thigmotaxis. Significant epochs of stable changes in spiking did not correlate with restricted locations in the arena, body direction, or walking transitions between ground and slope. We thus conclude that the walking speed dependencies are caused by the two states, exploration and thigmotaxis, rather than by spatial parameters.

The Role of Landscapes and Landmarks in Bee Navigation: A Review

The ability of animals to explore landmarks in their environment is essential to their fitness. Landmarks are widely recognized to play a key role in navigation by providing information in multiple sensory modalities. However, what is a landmark? We propose that animals use a hierarchy of information based upon its utility and salience when an animal is in a given motivational state. Focusing on honeybees, we suggest that foragers choose landmarks based upon their relative uniqueness, conspicuousness, stability, and context. We also propose that it is useful to distinguish between landmarks that provide sensory input that changes ("near") or does not change ("far") as the receiver uses these landmarks to navigate. However, we recognize that this distinction occurs on a continuum and is not a clear-cut dichotomy. We review the rich literature on landmarks, focusing on recent studies that have illuminated our understanding of the kinds of information that bees use, how they use it, potential mechanisms, and future research directions.

Learning and Its Neural Correlates in a Virtual Environment for Honeybees

The search for neural correlates of operant and observational learning requires a combination of two (experimental) conditions that are very difficult to combine: stable recording from high order neurons and free movement of the animal in a rather natural environment. We developed a virtual environment (VE) that simulates a simplified 3D world for honeybees walking stationary on an air-supported spherical treadmill. We show that honeybees perceive the stimuli in the VE as meaningful by transferring learned information from free flight to the virtual world. In search for neural correlates of learning in the VE, mushroom body extrinsic neurons were recorded over days during learning. We found changes in the neural activity specific to the rewarded and unrewarded visual stimuli. Our results suggest an involvement of the mushroom body extrinsic neurons in operant learning in the honeybee (Apis mellifera).