Mushroom body extrinsic neurons in the honeybee (Apis mellifera) brain integrate context and cue values upon attentional stimulus selection

Evolutionary dynamics of mushroom body Kenyon cell types in hymenopteran brains from multifunctional type to functionally specialized types

Evolutionary dynamics of diversification of brain neuronal cell types that have underlain behavioral evolution remain largely unknown. Here, we compared transcriptomes and functions of Kenyon cell (KC) types that compose the mushroom bodies between the honey bee and sawfly, a primitive hymenopteran insect whose KCs likely have the ancestral properties. Transcriptome analyses show that the sawfly KC type shares some of the gene expression profile with each honey bee KC type, although unique gene expression profiles have also been acquired in each honey bee KC type. In addition, functional analysis of two sawfly genes suggested that the functions in learning and memory of the ancestral KC type were heterogeneously inherited among the KC types in the honey bee. Our findings strongly suggest that the functional evolution of KCs in Hymenoptera involved two previously hypothesized processes for evolution of cell function: functional segregation and divergence.

Navigation and dance communication in honeybees: a cognitive perspective

Flying insects like the honeybee experience the world as a metric layout embedded in a compass, the time-compensated sun compass. The focus of the review lies on the properties of the landscape memory as accessible by data from radar tracking and analyses of waggle dance following. The memory formed during exploration and foraging is thought to be composed of multiple elements, the aerial pictures that associate the multitude of sensory inputs with compass directions. Arguments are presented that support retrieval and use of landscape memory not only during navigation but also during waggle dance communication. I argue that bees expect landscape features that they have learned and that are retrieved during dance communication. An intuitive model of the bee's navigation memory is presented that assumes the picture memories form a network of geographically defined locations, nodes. The intrinsic components of the nodes, particularly their generalization process leads to binding structures, the edges. In my view, the cognitive faculties of landscape memory uncovered by these experiments are best captured by the term cognitive map.

Drug effect and addiction research with insects - From Drosophila to collective reward in honeybees

Animals and humans share similar reactions to the effects of addictive substances, including those of their brain networks to drugs. Our review focuses on simple invertebrate models, particularly the honeybee (Apis mellifera), and on the effects of drugs on bee behaviour and brain functions. The drug effects in bees are very similar to those described in humans. Furthermore, the honeybee community is a superorganism in which many collective functions outperform the simple sum of individual functions. The distribution of reward functions in this superorganism is unique - although sublimated at the individual level, community reward functions are of higher quality. This phenomenon of collective reward may be extrapolated to other animal species living in close and strictly organised societies, i.e. humans. The relationship between sociality and reward, based on use of similar parts of the neural network (social decision-making network in mammals, mushroom body in bees), suggests a functional continuum of reward and sociality in animals.

In Search for the Retrievable Memory Trace in an Insect Brain

The search strategy for the memory trace and its semantics is exemplified for the case of olfactory learning in the honeybee brain. The logic of associative learning is used to guide the experimental approach into the brain by identifying the anatomical and functional convergence sites of the conditioned stimulus and unconditioned stimulus pathways. Two of the several convergence sites are examined in detail, the antennal lobe as the first-order sensory coding area, and the input region of the mushroom body as a higher order integration center. The memory trace is identified as the pattern of associative changes on the level of synapses. The synapses are recruited, drop out, and change the transmission properties for both specifically associated stimulus and the non-associated stimulus. Several rules extracted from behavioral studies are found to be mirrored in the patterns of synaptic change. The strengths and the weaknesses of the honeybee as a model for the search for the memory trace are addressed in a comparison with Drosophila. The question is discussed whether the memory trace exists as a hidden pattern of change if it is not retrieved and whether an external reading of the content of the memory trace may ever be possible. Doubts are raised on the basis that the retrieval circuits are part of the memory trace. The concept of a memory trace existing beyond retrieval is defended by referring to two well-documented processes also in the honeybee, memory consolidation during sleep, and transfer of memory across brain areas.

Categorizing Visual Information in Subpopulations of Honeybee Mushroom Body Output Neurons

Multisensory integration plays a central role in perception, as all behaviors usually require the input of different sensory signals. For instance, for a foraging honeybee the association of a food source includes the combination of olfactory and visual cues to be categorized as a flower. Moreover, homing after successful foraging using celestial cues and the panoramic scenery may be dominated by visual cues. Hence, dependent on the context, one modality might be leading and influence the processing of other modalities. To unravel the complex neural mechanisms behind this process we studied honeybee mushroom body output neurons (MBON). MBONs represent the first processing level after olfactory-visual convergence in the honeybee brain. This was physiologically confirmed in our previous study by characterizing a subpopulation of multisensory MBONs. These neurons categorize incoming sensory inputs into olfactory, visual, and olfactory-visual information. However, in addition to multisensory units a prominent population of MBONs was sensitive to visual cues only. Therefore, we asked which visual features might be represented at this high-order integration level. Using extracellular, multi-unit recordings in combination with visual and olfactory stimulation, we separated MBONs with multisensory responses from purely visually driven MBONs. Further analysis revealed, for the first time, that visually driven MBONs of both groups encode detailed aspects within this individual modality, such as light intensity and light identity. Moreover, we show that these features are separated by different MBON subpopulations, for example by extracting information about brightness and wavelength. Most interestingly, the latter MBON population was tuned to separate UV-light from other light stimuli, which were only poorly differentiated from each other. A third MBON subpopulation was neither tuned to brightness nor to wavelength and encoded the general presence of light. Taken together, our results support the view that the mushroom body, a high-order sensory integration, learning and memory center in the insect brain, categorizes sensory information by separating different behaviorally relevant aspects of the multisensory scenery and that these categories are channeled into distinct MBON subpopulations.

A Flying Platform to Investigate Neuronal Correlates of Navigation in the Honey Bee (Apis mellifera)

Navigating animals combine multiple perceptual faculties, learn during exploration, retrieve multi-facetted memory contents, and exhibit goal-directedness as an expression of their current needs and motivations. Navigation in insects has been linked to a variety of underlying strategies such as path integration, view familiarity, visual beaconing, and goal-directed orientation with respect to previously learned ground structures. Most works, however, study navigation either from a field perspective, analyzing purely behavioral observations, or combine computational models with neurophysiological evidence obtained from lab experiments. The honey bee (Apis mellifera) has long been a popular model in the search for neural correlates of complex behaviors and exhibits extraordinary navigational capabilities. However, the neural basis for bee navigation has not yet been explored under natural conditions. Here, we propose a novel methodology to record from the brain of a copter-mounted honey bee. This way, the animal experiences natural multimodal sensory inputs in a natural environment that is familiar to her. We have developed a miniaturized electrophysiology recording system which is able to record spikes in the presence of time-varying electric noise from the copter's motors and rotors, and devised an experimental procedure to record from mushroom body extrinsic neurons (MBENs). We analyze the resulting electrophysiological data combined with a reconstruction of the animal's visual perception and find that the neural activity of MBENs is linked to sharp turns, possibly related to the relative motion of visual features. This method is a significant technological step toward recording brain activity of navigating honey bees under natural conditions. By providing all system specifications in an online repository, we hope to close a methodological gap and stimulate further research informing future computational models of insect navigation.

Search Behavior of Individual Foragers Involves Neurotransmitter Systems Characteristic for Social Scouting

In honey bees search behavior occurs as social and solitary behavior. In the context of foraging, searching for food sources is performed by behavioral specialized foragers, the scouts. When the scouts have found a new food source, they recruit other foragers (recruits). These recruits never search for a new food source on their own. However, when the food source is experimentally removed, they start searching for that food source. Our study provides a detailed description of this solitary search behavior and the variation of this behavior among individual foragers. Furthermore, mass spectrometric measurement showed that the initiation and performance of this solitary search behavior is associated with changes in glutamate, GABA, histamine, aspartate, and the catecholaminergic system in the optic lobes and central brain area. These findings strikingly correspond with the results of an earlier study that showed that scouts and recruits differ in the expression of glutamate and GABA receptors. Together, the results of both studies provide first clear support for the hypothesis that behavioral specialization in honey bees is based on adjusting modulatory systems involved in solitary behavior to increase the probability or frequency of that behavior.

The neuroethology of olfactory sex communication in the honeybee Apis mellifera L

The honeybee Apis mellifera L. is a crucial pollinator as well as a prominent scientific model organism, in particular for the neurobiological study of olfactory perception, learning, and memory. A wealth of information is indeed available about how the worker bee brain detects, processes, and learns about odorants. Comparatively, olfaction in males (the drones) and queens has received less attention, although they engage in a fascinating mating behavior that strongly relies on olfaction. Here, we present our current understanding of the molecules, cells, and circuits underlying bees' sexual communication. Mating in honeybees takes place at so-called drone congregation areas and places high in the air where thousands of drones gather and mate in dozens with virgin queens. One major queen-produced olfactory signal-9-ODA, the major component of the queen pheromone-has been known for decades to attract the drones. Since then, some of the neural pathways responsible for the processing of this pheromone have been unraveled. However, olfactory receptor expression as well as brain neuroanatomical data point to the existence of three additional major pathways in the drone brain, hinting at the existence of 4 major odorant cues involved in honeybee mating. We discuss current evidence about additional not only queen- but also drone-produced pheromonal signals possibly involved in bees' sexual behavior. We also examine data revealing recent evolutionary changes in drone's olfactory system in the Apis genus. Lastly, we present promising research avenues for progressing in our understanding of the neural basis of bees mating behavior.

Mushroom Body Extrinsic Neurons in Walking Bumblebees Correlate With Behavioral States but Not With Spatial Parameters During Exploratory Behavior

Central place foraging insects like honeybees and bumblebees learn to navigate efficiently between nest and feeding site. Essential components of this behavior can be moved to the laboratory. A major component of navigational learning is the active exploration of the test arena. These conditions have been used here to search for neural correlates of exploratory walking in the central arena (ground), and thigmotactic walking in the periphery (slope). We chose mushroom body extrinsic neurons (MBENs) because of their learning-related plasticity and their multi-modal sensitivities that may code relevant parameters in a brain state-dependent way. Our aim was to test whether MBENs code space-related components or are more involved in state-dependent processes characterizing exploration and thigmotaxis. MBENs did not respond selectively to body directions or locations. Their spiking activity differently correlated with walking speed depending on the animals' locations: on the ground, reflecting exploration, or on the slope, reflecting thigmotaxis. This effect depended on walking speed in different ways for different animals. We then asked whether these effects depended on spatial parameters or on the two states, exploration and thigmotaxis. Significant epochs of stable changes in spiking did not correlate with restricted locations in the arena, body direction, or walking transitions between ground and slope. We thus conclude that the walking speed dependencies are caused by the two states, exploration and thigmotaxis, rather than by spatial parameters.

Neural Correlates of Social Behavior in Mushroom Body Extrinsic Neurons of the Honeybee Apis mellifera

The social behavior of honeybees (Apis mellifera) has been extensively investigated, but little is known about its neuronal correlates. We developed a method that allowed us to record extracellularly from mushroom body extrinsic neurons (MB ENs) in a freely moving bee within a small but functioning mini colony of approximately 1,000 bees. This study aimed to correlate the neuronal activity of multimodal high-order MB ENs with social behavior in a close to natural setting. The behavior of all bees in the colony was video recorded. The behavior of the recorded animal was compared with other hive mates and no significant differences were found. Changes in the spike rate appeared before, during or after social interactions. The time window of the strongest effect on spike rate changes ranged from 1 s to 2 s before and after the interaction, depending on the individual animal and recorded neuron. The highest spike rates occurred when the experimental animal was situated close to a hive mate. The variance of the spike rates was analyzed as a proxy for high order multi-unit processing. Comparing randomly selected time windows with those in which the recorded animal performed social interactions showed a significantly increased spike rate variance during social interactions. The experimental set-up employed for this study offers a powerful opportunity to correlate neuronal activity with intrinsically motivated behavior of socially interacting animals. We conclude that the recorded MB ENs are potentially involved in initiating and controlling social interactions in honeybees.

Circuit and Cellular Mechanisms Facilitate the Transformation from Dense to Sparse Coding in the Insect Olfactory System

Transformations between sensory representations are shaped by neural mechanisms at the cellular and the circuit level. In the insect olfactory system, the encoding of odor information undergoes a transition from a dense spatiotemporal population code in the antennal lobe to a sparse code in the mushroom body. However, the exact mechanisms shaping odor representations and their role in sensory processing are incompletely identified. Here, we investigate the transformation from dense to sparse odor representations in a spiking model of the insect olfactory system, focusing on two ubiquitous neural mechanisms: spike frequency adaptation at the cellular level and lateral inhibition at the circuit level. We find that cellular adaptation is essential for sparse representations in time (temporal sparseness), while lateral inhibition regulates sparseness in the neuronal space (population sparseness). The interplay of both mechanisms shapes spatiotemporal odor representations, which are optimized for the discrimination of odors during stimulus onset and offset. Response pattern correlation across different stimuli showed a nonmonotonic dependence on the strength of lateral inhibition with an optimum at intermediate levels, which is explained by two counteracting mechanisms. In addition, we find that odor identity is stored on a prolonged timescale in the adaptation levels but not in the spiking activity of the principal cells of the mushroom body, providing a testable hypothesis for the location of the so-called odor trace.

Learning and Its Neural Correlates in a Virtual Environment for Honeybees

The search for neural correlates of operant and observational learning requires a combination of two (experimental) conditions that are very difficult to combine: stable recording from high order neurons and free movement of the animal in a rather natural environment. We developed a virtual environment (VE) that simulates a simplified 3D world for honeybees walking stationary on an air-supported spherical treadmill. We show that honeybees perceive the stimuli in the VE as meaningful by transferring learned information from free flight to the virtual world. In search for neural correlates of learning in the VE, mushroom body extrinsic neurons were recorded over days during learning. We found changes in the neural activity specific to the rewarded and unrewarded visual stimuli. Our results suggest an involvement of the mushroom body extrinsic neurons in operant learning in the honeybee (Apis mellifera).

Neural Organization of A3 Mushroom Body Extrinsic Neurons in the Honeybee Brain

In the insect brain, the mushroom body is a higher order brain area that is key to memory formation and sensory processing. Mushroom body (MB) extrinsic neurons leaving the output region of the MB, the lobes and the peduncle, are thought to be especially important in these processes. In the honeybee brain, a distinct class of MB extrinsic neurons, A3 neurons, are implicated in playing a role in learning. Their MB arborisations are either restricted to the lobes and the peduncle, here called A3 lobe connecting neurons, or they provide feedback information from the lobes to the input region of the MB, the calyces, here called A3 feedback neurons. In this study, we analyzed the morphology of individual A3 lobe connecting and feedback neurons using confocal imaging. A3 feedback neurons were previously assumed to innervate each lip compartment homogenously. We demonstrate here that A3 feedback neurons do not innervate whole subcompartments, but rather innervate zones of varying sizes in the MB lip, collar, and basal ring. We describe for the first time the anatomical details of A3 lobe connecting neurons and show that their connection pattern in the lobes resemble those of A3 feedback cells. Previous studies showed that A3 feedback neurons mostly connect zones of the vertical lobe that receive input from Kenyon cells of distinct calycal subcompartments with the corresponding subcompartments of the calyces. We can show that this also applies to the neck of the peduncle and the medial lobe, where both types of A3 neurons arborize only in corresponding zones in the calycal subcompartments. Some A3 lobe connecting neurons however connect multiple vertical lobe areas. Contrarily, in the medial lobe, the A3 neurons only innervate one division. We found evidence for both input and output areas in the vertical lobe. Thus, A3 neurons are more diverse than previously thought. The understanding of their detailed anatomy might enable us to derive circuit models for learning and memory and test physiological data.

Neural Correlates of Odor Learning in the Presynaptic Microglomerular Circuitry in the Honeybee Mushroom Body Calyx

The mushroom body (MB) in insects is known as a major center for associative learning and memory, although exact locations for the correlating memory traces remain to be elucidated. Here, we asked whether presynaptic boutons of olfactory projection neurons (PNs) in the main input site of the MB undergo neuronal plasticity during classical odor-reward conditioning and correlate with the conditioned behavior. We simultaneously measured Ca²⁺ responses in the boutons and conditioned behavioral responses to learned odors in honeybees. We found that the absolute amount of the neural change for the rewarded but not for the unrewarded odor was correlated with the behavioral learning rate across individuals. The temporal profile of the induced changes matched with odor response dynamics of the MB-associated inhibitory neurons, suggestive of activity modulation of boutons by this neural class. We hypothesize the circuit-specific neural plasticity relates to the learned value of the stimulus and underlies the conditioned behavior of the bees.

A neural network model for familiarity and context learning during honeybee foraging flights

How complex is the memory structure that honeybees use to navigate? Recently, an insect-inspired parsimonious spiking neural network model was proposed that enabled simulated ground-moving agents to follow learned routes. We adapted this model to flying insects and evaluate the route following performance in three different worlds with gradually decreasing object density. In addition, we propose an extension to the model to enable the model to associate sensory input with a behavioral context, such as foraging or homing. The spiking neural network model makes use of a sparse stimulus representation in the mushroom body and reward-based synaptic plasticity at its output synapses. In our experiments, simulated bees were able to navigate correctly even when panoramic cues were missing. The context extension we propose enabled agents to successfully discriminate partly overlapping routes. The structure of the visual environment, however, crucially determines the success rate. We find that the model fails more often in visually rich environments due to the overlap of features represented by the Kenyon cell layer. Reducing the landmark density improves the agents route following performance. In very sparse environments, we find that extended landmarks, such as roads or field edges, may help the agent stay on its route, but often act as strong distractors yielding poor route following performance. We conclude that the presented model is valid for simple route following tasks and may represent one component of insect navigation. Additional components might still be necessary for guidance and action selection while navigating along different memorized routes in complex natural environments.

Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila

The brain adaptively integrates present sensory input, past experience, and options for future action. The insect mushroom body exemplifies how a central brain structure brings about such integration. Here we use a combination of systematic single-cell labeling, connectomics, transgenic silencing, and activation experiments to study the mushroom body at single-cell resolution, focusing on the behavioral architecture of its input and output neurons (MBINs and MBONs), and of the mushroom body intrinsic APL neuron. Our results reveal the identity and morphology of almost all of these 44 neurons in stage 3 Drosophila larvae. Upon an initial screen, functional analyses focusing on the mushroom body medial lobe uncover sparse and specific functions of its dopaminergic MBINs, its MBONs, and of the GABAergic APL neuron across three behavioral tasks, namely odor preference, taste preference, and associative learning between odor and taste. Our results thus provide a cellular-resolution study case of how brains organize behavior.

Multimodal integration and stimulus categorization in putative mushroom body output neurons of the honeybee

Flowers attract pollinating insects like honeybees by sophisticated compositions of olfactory and visual cues. Using honeybees as a model to study olfactory-visual integration at the neuronal level, we focused on mushroom body (MB) output neurons (MBON). From a neuronal circuit perspective, MBONs represent a prominent level of sensory-modality convergence in the insect brain. We established an experimental design allowing electrophysiological characterization of olfactory, visual, as well as olfactory-visual induced activation of individual MBONs. Despite the obvious convergence of olfactory and visual pathways in the MB, we found numerous unimodal MBONs. However, a substantial proportion of MBONs (32%) responded to both modalities and thus integrated olfactory-visual information across MB input layers. In these neurons, representation of the olfactory-visual compound was significantly increased compared with that of single components, suggesting an additive, but nonlinear integration. Population analyses of olfactory-visual MBONs revealed three categories: (i) olfactory, (ii) visual and (iii) olfactory-visual compound stimuli. Interestingly, no significant differentiation was apparent regarding different stimulus qualities within these categories. We conclude that encoding of stimulus quality within a modality is largely completed at the level of MB input, and information at the MB output is integrated across modalities to efficiently categorize sensory information for downstream behavioural decision processing.

Neural correlates of side-specific odour memory in mushroom body output neurons

Humans and other mammals as well as honeybees learn a unilateral association between an olfactory stimulus presented to one side and a reward. In all of them, the learned association can be behaviourally retrieved via contralateral stimulation, suggesting inter-hemispheric communication. However, the underlying neuronal circuits are largely unknown and neural correlates of across-brain-side plasticity have yet not been demonstrated. We report neural plasticity that reflects lateral integration after side-specific odour reward conditioning. Mushroom body output neurons that did not respond initially to contralateral olfactory stimulation developed a unique and stable representation of the rewarded compound stimulus (side and odour) predicting its value during memory retention. The encoding of the reward-associated compound stimulus is delayed by about 40 ms compared with unrewarded neural activity, indicating an increased computation time for the read-out after lateral integration.

A Simple Computational Model of the Bee Mushroom Body Can Explain Seemingly Complex Forms of Olfactory Learning and Memory

Honeybees are models for studying how animals with relatively small brains accomplish complex cognition, displaying seemingly advanced (or "non-elemental") learning phenomena involving multiple conditioned stimuli. These include "peak shift" [1-4]-where animals not only respond to entrained stimuli, but respond even more strongly to similar ones that are farther away from non-rewarding stimuli. Bees also display negative and positive patterning discrimination [5], responding in opposite ways to mixtures of two odors than to individual odors. Since Pavlov, it has often been assumed that such phenomena are more complex than simple associate learning. We present a model of connections between olfactory sensory input and bees' mushroom bodies [6], incorporating empirically determined properties of mushroom body circuitry (random connectivity [7], sparse coding [8], and synaptic plasticity [9, 10]). We chose not to optimize the model's parameters to replicate specific behavioral phenomena, because we were interested in the emergent cognitive capacities that would pop out of a network constructed solely based on empirical neuroscientific information and plausible assumptions for unknown parameters. We demonstrate that the circuitry mediating "simple" associative learning can also replicate the various non-elemental forms of learning mentioned above and can effectively multi-task by replicating a range of different learning feats. We found that PN-KC synaptic plasticity is crucial in controlling the generalization-discrimination trade-off-it facilitates peak shift and hinders patterning discrimination-and that PN-to-KC connection number can affect this trade-off. These findings question the notion that forms of learning that have been regarded as "higher order" are computationally more complex than "simple" associative learning.