Gap perception in bumblebees

Brightness cues affect gap negotiation behaviours in zebra finches flying between perches

Flying animals have had to evolve robust and effective guidance strategies for dealing with habitat clutter. Birds and insects use optic flow expansion cues to sense and avoid obstacles, but orchid bees have also been shown to use brightness cues during gap negotiation. Such brightness cues might therefore be of general importance in structuring visually guided flight behaviours. To test the hypothesis that brightness cues also affect gap negotiation behaviours in birds, we presented captive zebra finches Taeniopygia guttata with a symmetric or asymmetric background brightness distribution on the other side of a tunnel. The background brightness conditions influenced both the birds' decision to enter the tunnel aperture, and their flight direction upon exit. Zebra finches were more likely to initiate flight through the tunnel if they could see a bright background through it; they were also more likely to fly to the bright side upon exiting. We found no evidence of the centring response that would be expected if optic flow cues were balanced bilaterally during gap negotiation. Instead, the birds entered the tunnel by targeting a clearance of approximately one wing length from its near edge. Brightness cues therefore affect how zebra finches structure their flight when negotiating gaps in enclosed environments.

Analysis of collision avoidance in honeybee flight

Insects are excellent at flying in dense vegetation and navigating through other complex spatial environments. This study investigates the strategies used by honeybees (Apis mellifera) to avoid collisions with an obstacle encountered frontally during flight. Bees were trained to fly through a tunnel that contained a solitary vertically oriented cylindrical obstacle placed along the midline. Flight trajectories of bees were recorded for six conditions in which the diameter of the obstructing cylinder was systematically varied from 25 mm to 160 mm. Analysis of salient events during the bees' flight, such as the deceleration before the obstacle, and the initiation of the deviation in flight path to avoid collisions, revealed a strategy for obstacle avoidance that is based on the relative retinal expansion velocity generated by the obstacle when the bee is on a collision course. We find that a quantitative model, featuring a controller that extracts specific visual cues from the frontal visual field, provides an accurate characterization of the geometry and the dynamics of the manoeuvres adopted by honeybees to avoid collisions. This study paves the way for the design of unmanned aerial systems, by identifying the visual cues that are used by honeybees for performing robust obstacle avoidance flight.

Finding the gap: neuromorphic motion-vision in dense environments

Animals have evolved mechanisms to travel safely and efficiently within different habitats. On a journey in dense terrains animals avoid collisions and cross narrow passages while controlling an overall course. Multiple hypotheses target how animals solve challenges faced during such travel. Here we show that a single mechanism enables safe and efficient travel. We developed a robot inspired by insects. It has remarkable capabilities to travel in dense terrain, avoiding collisions, crossing gaps and selecting safe passages. These capabilities are accomplished by a neuromorphic network steering the robot toward regions of low apparent motion. Our system leverages knowledge about vision processing and obstacle avoidance in insects. Our results demonstrate how insects might safely travel through diverse habitats. We anticipate our system to be a working hypothesis to study insects' travels in dense terrains. Furthermore, it illustrates that we can design novel hardware systems by understanding the underlying mechanisms driving behaviour.

FlyDetector-Automated Monitoring Platform for the Visual-Motor Coordination of Honeybees in a Dynamic Obstacle Scene Using Digital Paradigm

Vision plays a crucial role in the ability of compound-eyed insects to perceive the characteristics of their surroundings. Compound-eyed insects (such as the honeybee) can change the optical flow input of the visual system by autonomously controlling their behavior, and this is referred to as visual-motor coordination (VMC). To analyze an insect's VMC mechanism in dynamic scenes, we developed a platform for studying insects that actively shape the optic flow of visual stimuli by adapting their flight behavior. Image-processing technology was applied to detect the posture and direction of insects' movement, and automatic control technology provided dynamic scene stimulation and automatic acquisition of perceptual insect behavior. In addition, a virtual mapping technique was used to reconstruct the visual cues of insects for VMC analysis in a dynamic obstacle scene. A simulation experiment at different target speeds of 1-12 m/s was performed to verify the applicability and accuracy of the platform. Our findings showed that the maximum detection speed was 8 m/s, and triggers were 95% accurate. The outdoor experiments showed that flight speed in the longitudinal axis of honeybees was more stable when facing dynamic barriers than static barriers after analyzing the change in geometric optic flow. Finally, several experiments showed that the platform can automatically and efficiently monitor honeybees' perception behavior, and can be applied to study most insects and their VMC.

Optic flow enrichment via Drosophila head and retina motions to support inflight position regulation

Developing a functional description of the neural control circuits and visual feedback paths underlying insect flight behaviors is an active research area. Feedback controllers incorporating engineering models of the insect visual system outputs have described some flight behaviors, yet they do not explain how insects are able to stabilize their body position relative to nearby targets such as neighbors or forage sources, especially in challenging environments in which optic flow is poor. The insect experimental community is simultaneously recording a growing library of in-flight head and eye motions that may be linked to increased perception. This study develops a quantitative model of the optic flow experienced by a flying insect or robot during head yawing rotations (distinct from lateral peering motions in previous work) with a single other target in view. This study then applies a model of insect visuomotor feedback to show via analysis and simulation of five species that these head motions sufficiently enrich the optic flow and that the output feedback can provide relative position regulation relative to the single target (asymptotic stability). In the simplifying case of pure rotation relative to the body, theoretical analysis provides a stronger stability guarantee. The results are shown to be robust to anatomical neck angle limits and body vibrations, persist with more detailed Drosophila lateral-directional flight dynamics simulations, and generalize to recent retinal motion studies. Together, these results suggest that the optic flow enrichment provided by head or pseudopupil rotation could be used in an insect's neural processing circuit to enable position regulation.

Through Hawks’ Eyes: Synthetically Reconstructing the Visual Field of a Bird in Flight

Birds of prey rely on vision to execute flight manoeuvres that are key to their survival, such as intercepting fast-moving targets or navigating through clutter. A better understanding of the role played by vision during these manoeuvres is not only relevant within the field of animal behaviour, but could also have applications for autonomous drones. In this paper, we present a novel method that uses computer vision tools to analyse the role of active vision in bird flight, and demonstrate its use to answer behavioural questions. Combining motion capture data from Harris’ hawks with a hybrid 3D model of the environment, we render RGB images, semantic maps, depth information and optic flow outputs that characterise the visual experience of the bird in flight. In contrast with previous approaches, our method allows us to consider different camera models and alternative gaze strategies for the purposes of hypothesis testing, allows us to consider visual input over the complete visual field of the bird, and is not limited by the technical specifications and performance of a head-mounted camera light enough to attach to a bird’s head in flight. We present pilot data from three sample flights: a pursuit flight, in which a hawk intercepts a moving target, and two obstacle avoidance flights. With this approach, we provide a reproducible method that facilitates the collection of large volumes of data across many individuals, opening up new avenues for data-driven models of animal behaviour.

Optic flow based spatial vision in insects

The optic flow, i.e., the displacement of retinal images of objects in the environment induced by self-motion, is an important source of spatial information, especially for fast-flying insects. Spatial information over a wide range of distances, from the animal's immediate surroundings over several hundred metres to kilometres, is necessary for mediating behaviours, such as landing manoeuvres, collision avoidance in spatially complex environments, learning environmental object constellations and path integration in spatial navigation. To facilitate the processing of spatial information, the complexity of the optic flow is often reduced by active vision strategies. These result in translations and rotations being largely separated by a saccadic flight and gaze mode. Only the translational components of the optic flow contain spatial information. In the first step of optic flow processing, an array of local motion detectors provides a retinotopic spatial proximity map of the environment. This local motion information is then processed in parallel neural pathways in a task-specific manner and used to control the different components of spatial behaviour. A particular challenge here is that the distance information extracted from the optic flow does not represent the distances unambiguously, but these are scaled by the animal's speed of locomotion. Possible ways of coping with this ambiguity are discussed.

Production of adaptive movement patterns via an insect inspired spiking neural network central pattern generator

Navigation in ever-changing environments requires effective motor behaviors. Many insects have developed adaptive movement patterns which increase their success in achieving navigational goals. A conserved brain area in the insect brain, the Lateral Accessory Lobe, is involved in generating small scale search movements which increase the efficacy of sensory sampling. When the reliability of an essential navigational stimulus is low, searching movements are initiated whereas if the stimulus reliability is high, a targeted steering response is elicited. Thus, the network mediates an adaptive switching between motor patterns. We developed Spiking Neural Network models to explore how an insect inspired architecture could generate adaptive movements in relation to changing sensory inputs. The models are able to generate a variety of adaptive movement patterns, the majority of which are of the zig-zagging kind, as seen in a variety of insects. Furthermore, these networks are robust to noise. Because a large spread of network parameters lead to the correct movement dynamics, we conclude that the investigated network architecture is inherently well-suited to generating adaptive movement patterns.

Wind and route choice affect performance of bees flying above versus within a cluttered obstacle field

Bees flying through natural landscapes frequently encounter physical challenges, such as wind and cluttered vegetation, but the influence of these factors on flight performance remains unknown. We analyzed 548 videos of wild-caught honeybees (Apis mellifera) flying through an enclosure containing a field of vertical obstacles that bees could choose to fly within (through open corridors, without maneuvering) or above. We varied obstacle field height and wind condition (still, headwinds or tailwinds), and examined how these factors affected bees’ flight altitude, ground speed, and side-to-side casting motions (lateral excursions). When obstacle fields were short, bees flew at altitudes near the midpoint between the tunnel floor and ceiling. When obstacle fields approached or exceeded this midpoint, bees tended to increase their altitude, but they did not always avoid flying through obstacles, despite having the freedom to do so. Bees that flew above the obstacles exhibited 40% faster ground speeds and 36% larger lateral excursions than bees that flew within the obstacle fields. Wind did not affect flight altitude, but bees flew 12–19% faster in tailwinds, and their lateral excursions were 19% larger when flying in headwinds or tailwinds, as compared to still air. Our results show that bees flying through complex environments display flexibility in their route choices (i.e., flying above obstacles in some trials and through them in others), which affects their overall flight performance. Similar choices in natural landscapes could have broad implications for foraging efficiency, pollination, and mortality in wild bees.

Bumblebees display characteristics of active vision during robust obstacle avoidance flight

Insects are remarkable flyers and capable of navigating through highly cluttered environments. We tracked the head and thorax of bumblebees freely flying in a tunnel containing vertically oriented obstacles to uncover the sensorimotor strategies used for obstacle detection and collision avoidance. Bumblebees presented all the characteristics of active vision during flight by stabilizing their head relative to the external environment and maintained close alignment between their gaze and flightpath. Head stabilization increased motion contrast of nearby features against the background to enable obstacle detection. As bees approached obstacles, they appeared to modulate avoidance responses based on the relative retinal expansion velocity (RREV) of obstacles and their maximum evasion acceleration was linearly related to RREVmax. Finally, bees prevented collisions through rapid roll manoeuvres implemented by their thorax. Overall, the combination of visuo-motor strategies of bumblebees highlights elegant solutions developed by insects for visually guided flight through cluttered environments.

Spatial tuning of translational optic flow responses in hawkmoths of varying body size

To safely navigate their environment, flying insects rely on visual cues, such as optic flow. Which cues insects can extract from their environment depends closely on the spatial and temporal response properties of their visual system. These in turn can vary between individuals that differ in body size. How optic flow-based flight control depends on the spatial structure of visual cues, and how this relationship scales with body size, has previously been investigated in insects with apposition compound eyes. Here, we characterised the visual flight control response limits and their relationship to body size in an insect with superposition compound eyes: the hummingbird hawkmoth Macroglossum stellatarum. We used the hawkmoths’ centring response in a flight tunnel as a readout for their reception of translational optic flow stimuli of different spatial frequencies. We show that their responses cut off at different spatial frequencies when translational optic flow was presented on either one, or both tunnel walls. Combined with differences in flight speed, this suggests that their flight control was primarily limited by their temporal rather than spatial resolution. We also observed strong individual differences in flight performance, but no correlation between the spatial response cutoffs and body or eye size.

Ecological Entomology: How Is Gibson's Framework Useful?

To date, numerous studies have demonstrated the fundamental role played by optic flow in the control of goal-directed displacement tasks in insects. Optic flow was first introduced by Gibson as part of their ecological approach to perception and action. While this theoretical approach (as a whole) has been demonstrated to be particularly suitable for the study of goal-directed displacements in humans, its usefulness in carrying out entomological field studies remains to be established. In this review we would like to demonstrate that the ecological approach to perception and action could be relevant for the entomologist community in their future investigations. This approach could provide a conceptual and methodological framework for the community in order to: (i) take a critical look at the research carried out to date, (ii) develop rigorous and innovative experimental protocols, and (iii) define scientific issues that push the boundaries of the current scientific field. After a concise literature review about the perceptual control of displacement in insects, we will present the framework proposed by Gibson and suggest its added value for carrying out research in the field of behavioral ecology in insects.

Aerial course stabilization is impaired in motion-blind flies

Visual motion detection is among the best understood neuronal computations. As extensively investigated in tethered flies, visual motion signals are assumed to be crucial to detect and counteract involuntary course deviations. During free flight, however, course changes are also signalled by other sensory systems. Therefore, it is as yet unclear to what extent motion vision contributes to course control. To address this question, we genetically rendered flies motion-blind by blocking their primary motion-sensitive neurons and quantified their free-flight performance. We found that such flies have difficulty maintaining a straight flight trajectory, much like unimpaired flies in the dark. By unilateral wing clipping, we generated an asymmetry in propulsive force and tested the ability of flies to compensate for this perturbation. While wild-type flies showed a remarkable level of compensation, motion-blind animals exhibited pronounced circling behaviour. Our results therefore directly confirm that motion vision is necessary to fly straight under realistic conditions.

Minding the gap: learning and visual scanning behaviour in nocturnal bull ants

Insects possess small brains but exhibit sophisticated behaviour, specifically their ability to learn to navigate within complex environments. To understand how they learn to navigate in a cluttered environment, we focused on learning and visual scanning behaviour in the Australian nocturnal bull ant, Myrmecia midas, which are exceptional visual navigators. We tested how individual ants learn to detour via a gap and how they cope with substantial spatial changes over trips. Homing M. midas ants encountered a barrier on their foraging route and had to find a 50 cm gap between symmetrical large black screens, at 1 m distance towards the nest direction from the centre of the releasing platform in both familiar (on-route) and semi-familiar (off-route) environments. Foragers were tested for up to 3 learning trips with the changed conditions in both environments. The results showed that on the familiar route, individual foragers learned the gap quickly compared with when they were tested in the semi-familiar environment. When the route was less familiar, and the panorama was changed, foragers were less successful at finding the gap and performed more scans on their way home. Scene familiarity thus played a significant role in visual scanning behaviour. In both on-route and off-route environments, panoramic changes significantly affected learning, initial orientation and scanning behaviour. Nevertheless, over a few trips, success at gap finding increased, visual scans were reduced, the paths became straighter, and individuals took less time to reach the goal.

Summary: Investigation of how nocturnal bull ants learn to move around obstacles in familiar and semi-familiar environments reveals that scene familiarity plays a significant role in navigation.

A micro-CT-based standard brain atlas of the bumblebee

In recent years, bumblebees have become a prominent insect model organism for a variety of biological disciplines, particularly to investigate learning behaviors as well as visual performance. Understanding these behaviors and their underlying neurobiological principles requires a clear understanding of brain anatomy. Furthermore, to be able to compare neuronal branching patterns across individuals, a common framework is required, which has led to the development of 3D standard brain atlases in most of the neurobiological insect model species. Yet, no bumblebee 3D standard brain atlas has been generated. Here we present a brain atlas for the buff-tailed bumblebee Bombus terrestris using micro-computed tomography (micro-CT) scans as a source for the raw data sets, rather than traditional confocal microscopy, to produce the first ever micro-CT-based insect brain atlas. We illustrate the advantages of the micro-CT technique, namely, identical native resolution in the three cardinal planes and 3D structure being better preserved. Our Bombus terrestris brain atlas consists of 30 neuropils reconstructed from ten individual worker bees, with micro-CT allowing us to segment neuropils completely intact, including the lamina, which is a tissue structure often damaged when dissecting for immunolabeling. Our brain atlas can serve as a platform to facilitate future neuroscience studies in bumblebees and illustrates the advantages of micro-CT for specific applications in insect neuroanatomy.

Visual and movement memories steer foraging bumblebees along habitual routes

One persistent question in animal navigation is how animals follow habitual routes between their home and a food source. Our current understanding of insect navigation suggests an interplay between visual memories, collision avoidance and path integration, the continuous integration of distance and direction travelled. However, these behavioural modules have to be continuously updated with instantaneous visual information. In order to alleviate this need, the insect could learn and replicate habitual movements ('movement memories') around objects (e.g. a bent trajectory around an object) to reach its destination. We investigated whether bumblebees, Bombus terrestris, learn and use movement memories en route to their home. Using a novel experimental paradigm, we habituated bumblebees to establish a habitual route in a flight tunnel containing 'invisible' obstacles. We then confronted them with conflicting cues leading to different choice directions depending on whether they rely on movement or visual memories. The results suggest that they use movement memories to navigate, but also rely on visual memories to solve conflicting situations. We investigated whether the observed behaviour was due to other guidance systems, such as path integration or optic flow-based flight control, and found that neither of these systems was sufficient to explain the behaviour.

Information Is Where You Find It: Perception as an Ecologically Well-Posed Problem

Texts on visual perception typically begin with the following premise: Vision is an ill-posed problem, and perception is underdetermined by the available information. If this were really the case, however, it is hard to see how vision could ever get off the ground. James Gibson's signal contribution was his hypothesis that for every perceivable property of the environment, however subtle, there must be a higher order variable of information, however complex, that specifies it-if only we are clever enough to find them. Such variables are informative about behaviorally relevant properties within the physical and ecological constraints of a species' niche. Sensory ecology is replete with instructive examples, including weakly electric fish, the narwal's tusk, and insect flight control. In particular, I elaborate the case of passing through gaps. Optic flow is sufficient to control locomotion around obstacles and through openings. The affordances of the environment, such as gap passability, are specified by action-scaled information. Logically ill-posed problems may thus, on closer inspection, be ecologically well-posed.

Animal Cognition: The Self-Image of a Bumblebee

Knowing one's body dimensions is a core aspect of individual experience and self-awareness. A recent study illustrates how bees take into account their own body size both in preparation for and while traversing small gaps.

From Paths to Routes: A Method for Path Classification

Many animals establish, learn and optimize routes between locations to commute efficiently. One step in understanding route following is defining measures of similarities between the paths taken by the animals. Paths have commonly been compared by using several descriptors (e.g., the speed, distance traveled, or the amount of meandering) or were visually classified into categories by the experimenters. However, similar quantities obtained from such descriptors do not guarantee similar paths, and qualitative classification by experimenters is prone to observer biases. Here we propose a novel method to classify paths based on their similarity with different distance functions and clustering algorithms based on the trajectories of bumblebees flying through a cluttered environment. We established a method based on two distance functions (Dynamic Time Warping and Fréchet Distance). For all combinations of trajectories, the distance was calculated with each measure. Based on these distance values, we grouped similar trajectories by applying the Monte Carlo Reference-Based Consensus Clustering algorithm. Our procedure provides new options for trajectory analysis based on path similarities in a variety of experimental paradigms.

Analysing Head-Thorax Choreography During Free-Flights in Bumblebees

Animals coordinate their various body parts, sometimes in elaborate manners to swim, walk, climb, fly, and navigate their environment. The coordination of body parts is essential to behaviors such as, chasing, escaping, landing, and the extraction of relevant information. For example, by shaping the movement of the head and body in an active and controlled manner, flying insects structure their flights to facilitate the acquisition of distance information. They condense their turns into a short period of time (the saccade) interspaced by a relatively long translation (the intersaccade). However, due to technological limitations, the precise coordination of the head and thorax during insects' free-flight remains unclear. Here, we propose methods to analyse the orientation of the head and thorax of bumblebees Bombus terrestris, to segregate the trajectories of flying insects into saccades and intersaccades by using supervised machine learning (ML) techniques, and finally to analyse the coordination between head and thorax by using artificial neural networks (ANN). The segregation of flights into saccades and intersaccades by ML, based on the thorax angular velocities, decreased the misclassification by 12% compared to classically used methods. Our results demonstrate how machine learning techniques can be used to improve the analyses of insect flight structures and to learn about the complexity of head-body coordination. We anticipate our assay to be a starting point for more sophisticated experiments and analysis on freely flying insects. For example, the coordination of head and body movements during collision avoidance, chasing behavior, or negotiation of gaps could be investigated by monitoring the head and thorax orientation of freely flying insects within and across behavioral tasks, and in different species.

Bumblebees perceive the spatial layout of their environment in relation to their body size and form to minimize inflight collisions

Animals that move through complex habitats must frequently contend with obstacles in their path. Humans and other highly cognitive vertebrates avoid collisions by perceiving the relationship between the layout of their surroundings and the properties of their own body profile and action capacity. It is unknown whether insects, which have much smaller brains, possess such abilities. We used bumblebees, which vary widely in body size and regularly forage in dense vegetation, to investigate whether flying insects consider their own size when interacting with their surroundings. Bumblebees trained to fly in a tunnel were sporadically presented with an obstructing wall containing a gap that varied in width. Bees successfully flew through narrow gaps, even those that were much smaller than their wingspans, by first performing lateral scanning (side-to-side flights) to visually assess the aperture. Bees then reoriented their in-flight posture (i.e., yaw or heading angle) while passing through, minimizing their projected frontal width and mitigating collisions; in extreme cases, bees flew entirely sideways through the gap. Both the time that bees spent scanning during their approach and the extent to which they reoriented themselves to pass through the gap were determined not by the absolute size of the gap, but by the size of the gap relative to each bee's own wingspan. Our findings suggest that, similar to humans and other vertebrates, flying bumblebees perceive the affordance of their surroundings relative their body size and form to navigate safely through complex environments.

Obstacle avoidance in bumblebees is robust to changes in light intensity

Flying safely and avoiding obstacles in low light is crucial for the bumblebees that forage around dawn and dusk. Previous work has shown that bumblebees overcome the limitations of their visual system—typically adapted for bright sunlight—by increasing the time over which they sample photons. While this improves visual sensitivity, it decreases their capacity to resolve fast motion. This study investigates what effect this has on obstacle avoidance in flight, a task that requires the bees to reliably detect obstacles in the frontal visual field and to make a timely diversion to their flight path. In both bright and dim light, bumblebees avoided the 5 cm diameter obstacle at a consistent distance (22 cm) although in dim light they approached it more slowly from a distance of at least at least 80 cm. This suggests that bumblebees have an effective strategy for avoiding obstacles in all light conditions under which they are naturally active, and it is hypothesised that this is based on a time-to-contact prediction.

Wind and obstacle motion affect honeybee flight strategies in cluttered environments

Bees often forage in habitats with cluttered vegetation and unpredictable winds. Navigating obstacles in wind presents a challenge that may be exacerbated by wind-induced motions of vegetation. Although wind-blown vegetation is common in natural habitats, we know little about how the strategies of bees for flying through clutter are affected by obstacle motion and wind. We filmed honeybees Apis mellifera flying through obstacles in a flight tunnel with still air, headwinds or tailwinds. We tested how their ground speeds and centering behavior (trajectory relative to the midline between obstacles) changed when obstacles were moving versus stationary, and how their approach strategies affected flight outcome (successful transit versus collision). We found that obstacle motion affects ground speed: bees flew slower when approaching moving versus stationary obstacles in still air but tended to fly faster when approaching moving obstacles in headwinds or tailwinds. Bees in still air reduced their chances of colliding with obstacles (whether moving or stationary) by reducing ground speed, whereas flight outcomes in wind were not associated with ground speed, but rather with improvement in centering behavior during the approach. We hypothesize that in challenging flight situations (e.g. navigating moving obstacles in wind), bees may speed up to reduce the number of wing collisions that occur if they pass too close to an obstacle. Our results show that wind and obstacle motion can interact to affect flight strategies in unexpected ways, suggesting that wind-blown vegetation may have important effects on foraging behaviors and flight performance of bees in natural habitats.