Edge detection by landing honeybees: behavioural analysis and model simulations of the underlying mechanism

Optic flow based spatial vision in insects

The optic flow, i.e., the displacement of retinal images of objects in the environment induced by self-motion, is an important source of spatial information, especially for fast-flying insects. Spatial information over a wide range of distances, from the animal's immediate surroundings over several hundred metres to kilometres, is necessary for mediating behaviours, such as landing manoeuvres, collision avoidance in spatially complex environments, learning environmental object constellations and path integration in spatial navigation. To facilitate the processing of spatial information, the complexity of the optic flow is often reduced by active vision strategies. These result in translations and rotations being largely separated by a saccadic flight and gaze mode. Only the translational components of the optic flow contain spatial information. In the first step of optic flow processing, an array of local motion detectors provides a retinotopic spatial proximity map of the environment. This local motion information is then processed in parallel neural pathways in a task-specific manner and used to control the different components of spatial behaviour. A particular challenge here is that the distance information extracted from the optic flow does not represent the distances unambiguously, but these are scaled by the animal's speed of locomotion. Possible ways of coping with this ambiguity are discussed.

Optimising Vine Weevil, Otiorhynchus sulcatus F. (Coleoptera: Curculionidae), Monitoring Tool Design

Simple Summary

Vine weevil remains one of the most economically important insect pests of soft-fruit and ornamental crops globally. Growers currently lack effective monitoring systems to determine presence of vine weevil within crops, meaning that controls are often applied too late to prevent economic losses. Development of improved monitoring systems is currently hindered by a lack of knowledge of whether vine weevil adults select a monitoring tool based on its visual appearance. This study used paper cups as refuges to investigate the importance of colour, shape and position of entrances on monitoring tool efficacy. Results indicate that dark, tall refuges with entrances around their base were preferentially entered by adult vine weevil. This information provides the first steps towards developing improved designs for vine weevil monitoring tools.

Abstract

Vine weevil, Otiorhynchus sulcatus F. (Coleoptera: Curculionidae), is an economically important insect pest of horticultural crops. To identify an effective and reliable monitoring system for adult vine weevil, this study investigated the influence of colour, height and entrance position on the efficacy of a model monitoring tool using modified paper cups as refuges. Vine weevil preferences were determined by the number of individuals recorded within a refuge. When provided with a binary choice between black or white refuges, vine weevil adults showed a preference for black refuges. Vine weevils provided with a range of coloured refuges (blue, green, red and yellow) in addition to black and white refuges showed a preference for black and blue over the other colours and white refuges in group choice experiments. Refuge height and entrance position also influenced vine weevil behaviour with individuals exhibiting a preference for taller refuges and those with entrance openings around the refuge base. These results provide insights into refuge selection by adult vine weevils, which can be exploited to improve monitoring tool design. The importance of developing an effective monitoring tool for vine weevil adults as part of an integrated pest management programme is discussed.

Canopy parkour: movement ecology of post-hatch dispersal in a gliding nymphal stick insect, Extatosoma tiaratum

For flightless arboreal arthropods, moving from the understory into tree canopies is cognitively and energetically challenging because vegetational structures present complex three-dimensional landscapes with substantial gaps. Predation risk and wind-induced perturbations in the canopy may further impede the movement process. In the Australian stick insect Extatosoma tiaratum, first-instar nymphs hatch on the forest floor and disperse toward tree canopies in the daytime. Here, we addressed how their tactic responses to environmental cues and movement strategies are adapted to the canopy environment. Newly hatched nymphs ascend with high endurance, travelling >100 m within 60 min. Navigation toward open canopies is underpinned by negative gravitaxis, positive phototaxis and visual responses to vertically oriented contrast patterns. Nymphal E. tiaratum also use directed jumping to cross gaps, and respond to tactile stimulation and potential threat with a self-dropping reflex, resulting in aerial descent. Post-hatch dispersal in E. tiaratum thus consists of visually mediated displacement both on vegetational structures and in the air; within the latter context, gliding is then an effective mechanism enabling recovery after predator- and perturbation-induced descent. These results further support the importance of a diurnal niche, in addition to the arboreal spatial niche, in the evolution of gliding in wingless arboreal invertebrates.

Segregating signal from noise through movement in echolocating bats

Segregating signal from noise is one of the most fundamental problems shared by all biological and human-engineered sensory systems. In echolocating bats that search for small objects such as tiny insects in the presence of large obstacles (e.g., vegetation), this task can pose serious challenges as the echoes reflected from the background might be several times louder than the desired signal. Bats’ ability to adjust their sensing, specifically their echolocation signal and sequence design has been deeply studied. In this study, we show that in addition to adjusting their sensing, bats also use movement in order to segregate desired echoes from background noise. Bats responded to an acoustically echoic background by adjusting their angle of attack. Specifically, the bats in our experiment used movement and not adaptation of sensory acquisition in order to overcome a sensory challenge. They approached the target at a smaller angle of attack, which results in weaker echoes from the background as was also confirmed by measuring the echoes of the setup from the bat’s point of view. Our study demonstrates the importance of movement in active sensing.

Gap perception in bumblebees

A number of insects fly over long distances below the natural canopy, where the physical environment is highly cluttered consisting of obstacles of varying shape, size and texture. While navigating within such environments, animals need to perceive and disambiguate environmental features that might obstruct their flight. The most elemental aspect of aerial navigation through such environments is gap identification and 'passability' evaluation. We used bumblebees to seek insights into the mechanisms used for gap identification when confronted with an obstacle in their flight path and behavioral compensations employed to assess gap properties. Initially, bumblebee foragers were trained to fly though an unobstructed flight tunnel that led to a foraging chamber. After the bees were familiar with this situation, we placed a wall containing a gap that unexpectedly obstructed the flight path on a return trip to the hive. The flight trajectories of the bees as they approached the obstacle wall and traversed the gap were analyzed in order to evaluate their behavior as a function of the distance between the gap and a background wall that was placed behind the gap. Bumblebees initially decelerated when confronted with an unexpected obstacle. Deceleration was first noticed when the obstacle subtended around 35 deg on the retina but also depended on the properties of the gap. Subsequently, the bees gradually traded off their longitudinal velocity to lateral velocity and approached the gap with increasing lateral displacement and lateral velocity. Bumblebees shaped their flight trajectory depending on the salience of the gap, indicated in our case by the optic flow contrast between the region within the gap and on the obstacle, which decreased with decreasing distance between the gap and the background wall. As the optic flow contrast decreased, the bees spent an increasing amount of time moving laterally across the obstacles. During these repeated lateral maneuvers, the bees are probably assessing gap geometry and passability.

The visual ecology of directed aerial descent in first-instar nymphs of the stick insect Extatosoma tiaratum

Many wingless insects perform directed aerial descent (DAD) to return to vegetational structures after falling. Given the complex visual environment and spatial structures of tree canopies, those visual signals used as directional cues are not fully understood. Here, we address the role of visual contrast for DAD in newly hatched nymphs of the stick insect Extatosoma tiaratum under controlled laboratory conditions. Landing preferences of gliding E. tiaratum in various visual environments were studied. We used a single vertical stripe defined by variable contrast edges to test the use of contrast consistency and sharpness. We also used aggregate patterns to examine the effects of target size and the effectiveness of luminance contrast and chromatic contrast. E. tiaratum nymphs were attracted to single stripes with well-defined edges, and particularly favored narrow dark targets. The directionality and accuracy of landing were dependent on target size. Lastly, luminance contrasts were more effective in attracting landings than were chromatic contrasts. Visual contrasts are therefore used as spatial references for landing behavior in DAD. These behaviors may enable nymphs to quickly locate dark or shaded sides of vertically oriented vegetational structures in natural habitats.

Visual motion-sensitive neurons in the bumblebee brain convey information about landmarks during a navigational task

Bees use visual memories to find the spatial location of previously learnt food sites. Characteristic learning flights help acquiring these memories at newly discovered foraging locations where landmarks—salient objects in the vicinity of the goal location—can play an important role in guiding the animal's homing behavior. Although behavioral experiments have shown that bees can use a variety of visual cues to distinguish objects as landmarks, the question of how landmark features are encoded by the visual system is still open. Recently, it could be shown that motion cues are sufficient to allow bees localizing their goal using landmarks that can hardly be discriminated from the background texture. Here, we tested the hypothesis that motion sensitive neurons in the bee's visual pathway provide information about such landmarks during a learning flight and might, thus, play a role for goal localization. We tracked learning flights of free-flying bumblebees (Bombus terrestris) in an arena with distinct visual landmarks, reconstructed the visual input during these flights, and replayed ego-perspective movies to tethered bumblebees while recording the activity of direction-selective wide-field neurons in their optic lobe. By comparing neuronal responses during a typical learning flight and targeted modifications of landmark properties in this movie we demonstrate that these objects are indeed represented in the bee's visual motion pathway. We find that object-induced responses vary little with object texture, which is in agreement with behavioral evidence. These neurons thus convey information about landmark properties that are useful for view-based homing.

Sensory flow shaped by active sensing: sensorimotor strategies in electric fish

Goal-directed behavior in most cases is composed of a sequential order of elementary motor patterns shaped by sensorimotor contingencies. The sensory information acquired thus is structured in both space and time. Here we review the role of motion during the generation of sensory flow focusing on how animals actively shape information by behavioral strategies. We use the well-studied examples of vision in insects and echolocation in bats to describe commonalities of sensory-related behavioral strategies across sensory systems, and evaluate what is currently known about comparable active sensing strategies in electroreception of electric fish. In this sensory system the sensors are dispersed across the animal's body and the carrier source emitting energy used for sensing, the electric organ, is moved while the animal moves. Thus ego-motions strongly influence sensory dynamics. We present, for the first time, data of electric flow during natural probing behavior in Gnathonemus petersii (Mormyridae), which provide evidence for this influence. These data reveal a complex interdependency between the physical input to the receptors and the animal's movements, posture and objects in its environment. Although research on spatiotemporal dynamics in electrolocation is still in its infancy, the emerging field of dynamical sensory systems analysis in electric fish is a promising approach to the study of the link between movement and acquisition of sensory information.

Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action

Insects such as flies or bees, with their miniature brains, are able to control highly aerobatic flight maneuvres and to solve spatial vision tasks, such as avoiding collisions with obstacles, landing on objects, or even localizing a previously learnt inconspicuous goal on the basis of environmental cues. With regard to solving such spatial tasks, these insects still outperform man-made autonomous flying systems. To accomplish their extraordinary performance, flies and bees have been shown by their characteristic behavioral actions to actively shape the dynamics of the image flow on their eyes ("optic flow"). The neural processing of information about the spatial layout of the environment is greatly facilitated by segregating the rotational from the translational optic flow component through a saccadic flight and gaze strategy. This active vision strategy thus enables the nervous system to solve apparently complex spatial vision tasks in a particularly efficient and parsimonious way. The key idea of this review is that biological agents, such as flies or bees, acquire at least part of their strength as autonomous systems through active interactions with their environment and not by simply processing passively gained information about the world. These agent-environment interactions lead to adaptive behavior in surroundings of a wide range of complexity. Animals with even tiny brains, such as insects, are capable of performing extraordinarily well in their behavioral contexts by making optimal use of the closed action-perception loop. Model simulations and robotic implementations show that the smart biological mechanisms of motion computation and visually-guided flight control might be helpful to find technical solutions, for example, when designing micro air vehicles carrying a miniaturized, low-weight on-board processor.

Neuronal encoding of object and distance information: a model simulation study on naturalistic optic flow processing

We developed a model of the input circuitry of the FD1 cell, an identified motion-sensitive interneuron in the blowfly's visual system. The model circuit successfully reproduces the FD1 cell's most conspicuous property: its larger responses to objects than to spatially extended patterns. The model circuit also mimics the time-dependent responses of FD1 to dynamically complex naturalistic stimuli, shaped by the blowfly's saccadic flight and gaze strategy: the FD1 responses are enhanced when, as a consequence of self-motion, a nearby object crosses the receptive field during intersaccadic intervals. Moreover, the model predicts that these object-induced responses are superimposed by pronounced pattern-dependent fluctuations during movements on virtual test flights in a three-dimensional environment with systematic modifications of the environmental patterns. Hence, the FD1 cell is predicted to detect not unambiguously objects defined by the spatial layout of the environment, but to be also sensitive to objects distinguished by textural features. These ambiguous detection abilities suggest an encoding of information about objects-irrespective of the features by which the objects are defined-by a population of cells, with the FD1 cell presumably playing a prominent role in such an ensemble.

Prototypical components of honeybee homing flight behavior depend on the visual appearance of objects surrounding the goal

Honeybees use visual cues to relocate profitable food sources and their hive. What bees see while navigating, depends on the appearance of the cues, the bee's current position, orientation, and movement relative to them. Here we analyze the detailed flight behavior during the localization of a goal surrounded by cylinders that are characterized either by a high contrast in luminance and texture or by mostly motion contrast relative to the background. By relating flight behavior to the nature of the information available from these landmarks, we aim to identify behavioral strategies that facilitate the processing of visual information during goal localization. We decompose flight behavior into prototypical movements using clustering algorithms in order to reduce the behavioral complexity. The determined prototypical movements reflect the honeybee's saccadic flight pattern that largely separates rotational from translational movements. During phases of translational movements between fast saccadic rotations, the bees can gain information about the 3D layout of their environment from the translational optic flow. The prototypical movements reveal the prominent role of sideways and up- or downward movements, which can help bees to gather information about objects, particularly in the frontal visual field. We find that the occurrence of specific prototypes depends on the bees' distance from the landmarks and the feeder and that changing the texture of the landmarks evokes different prototypical movements. The adaptive use of different behavioral prototypes shapes the visual input and can facilitate information processing in the bees' visual system during local navigation.

Honeybees as a model for the study of visually guided flight, navigation, and biologically inspired robotics

Research over the past century has revealed the impressive capacities of the honeybee, Apis mellifera, in relation to visual perception, flight guidance, navigation, and learning and memory. These observations, coupled with the relative ease with which these creatures can be trained, and the relative simplicity of their nervous systems, have made honeybees an attractive model in which to pursue general principles of sensorimotor function in a variety of contexts, many of which pertain not just to honeybees, but several other animal species, including humans. This review begins by describing the principles of visual guidance that underlie perception of the world in three dimensions, obstacle avoidance, control of flight speed, and orchestrating smooth landings. We then consider how navigation over long distances is accomplished, with particular reference to how bees use information from the celestial compass to determine their flight bearing, and information from the movement of the environment in their eyes to gauge how far they have flown. Finally, we illustrate how some of the principles gleaned from these studies are now being used to design novel, biologically inspired algorithms for the guidance of unmanned aerial vehicles.

The role of the pattern edge in goldfish visual motion detection

To understand the function of edges in perception of moving objects, we defined four questions to answer. Is the focus point in visual motion detection of a moving object: (1) the body or the edge of the object, (2) the leading edge or trailing edge of the object, (3) different in scotopic, mesopic and photopic luminance levels, or (4) different for colored objects? We measured the Optomotor Response (OMR) and Edge Triggering Response (ETR) of goldfish. We used a square and sine wave patterns with black and red stripes and a square wave pattern with black and grey stripes to generate OMR's and ETR's in the goldfish. When we used black and red stripes, the black leading edges stimulated an ETR under scotopic conditions, red leading edges stimulated an ETR under photopic conditions, and both black and red leading edges stimulated an ETR under mesopic luminance levels. For black and gray stripes, only black leading edges stimulated an ETR in all three light illumination levels. We observed less OMR and ETR results using the sine wave pattern compared to using the square wave pattern. From these results, we deduced that the goldfish tend to prefer tracking the leading edge of the pattern. The goldfish can also detect the color of the moving pattern under photopic luminance conditions. We decided that ETR is an intriguing factor in OMR, and is suitable as a method of behavioral measurement in visual system research.

Goal seeking in honeybees: matching of optic flow snapshots?

Visual landmarks guide humans and animals including insects to a goal location. Insects, with their miniature brains, have evolved a simple strategy to find their nests or profitable food sources; they approach a goal by finding a close match between the current view and a memorised retinotopic representation of the landmark constellation around the goal. Recent implementations of such a matching scheme use raw panoramic images (‘image matching’) and show that it is well suited to work on robots and even in natural environments. However, this matching scheme works only if relevant landmarks can be detected by their contrast and texture. Therefore, we tested how honeybees perform in localising a goal if the landmarks can hardly be distinguished from the background by such cues. We recorded the honeybees' flight behaviour with high-speed cameras and compared the search behaviour with computer simulations. We show that honeybees are able to use landmarks that have the same contrast and texture as the background and suggest that the bees use relative motion cues between the landmark and the background. These cues are generated on the eyes when the bee moves in a characteristic way in the vicinity of the landmarks. This extraordinary navigation performance can be explained by a matching scheme that includes snapshots based on optic flow amplitudes (‘optic flow matching’). This new matching scheme provides a robust strategy for navigation, as it depends primarily on the depth structure of the environment.

Motion adaptation enhances object-induced neural activity in three-dimensional virtual environment

Many response characteristics of neurons sensitive to visual motion depend on stimulus history and change during prolonged stimulation. Although the changes are usually regarded as adaptive, their functional significance is still not fully understood. With experimenter-defined stimuli, previous research on motion adaptation has mainly focused on enhancing the detection of changes in the stimulus domain, on preventing output saturation and on energy efficient coding. Here we will analyze in the blowfly visual system the functional significance of motion adaptation under the complex stimulus conditions encountered in the three-dimensional world. Identified motion sensitive neurons are confronted with seminatural optic flow as is seen by semi-free-flying animals as well as targeted modifications of it. Motion adaptation is shown to enhance object-induced neural responses in a three-dimensional environment although the overall neuronal response amplitude decreases during prolonged motion stimulation.