Odour-tracking capability of a silkmoth driving a mobile robot with turning bias and time delay

Analysis of Odor-Tracking Performance of Silk Moth Using a Sensory-Motor Intervention System

Animals can adaptively behave in different environmental conditions by converting environmental information obtained from their sensory organs into actions. This sensory-motor integration enables the accomplishment of various tasks and is essential for animal survival. This sensory-motor integration also plays an important role in localization to females, relying on sex pheromones floating in space. In this study, we focused on the localization behavior of the adult male silk moth, Bombyx mori. We investigated sensory-motor integration against time delay using odor plume tracking performance as an index when we set a certain time delay for the sensory and motor responses. Given that it is difficult to directly intervene in the sensory and motor functions of the silk moth, we constructed an intervention system based on a mobile behavior measurement system controlled by them. Using this intervention system, not only can timing the detection of the odor in the environment and timing the presentation of the odor to the silk moth be manipulated, but timing the reflection of the movement of the silk moth can also be manipulated. We analyzed the extent to which the localization strategy of the silk moth could tolerate sensory delays by setting a delay to the odor presentation. We also evaluated behavioral compensation by odor sensory feedback by setting a delay to the motor. The results of the localization experiment have shown that the localization success rate did not decrease when there was a motor delay. However, when there was a sensory delay, the success rate decreased depending on the time delay. Analysis of the change in behavior after detection of the odor stimulus has shown that the movement was more linear when we set a motor delay. However, the movement was accompanied by a large rotational movement when there was a delay in the sensory input. This result has suggested that behavior is compensated for the delay in motor function by feedback control of odor sensation, but not when accompanied by sensory delay. To compensate for this, the silk moth may acquire appropriate information from the environment by making large body movements.

Behavioral algorithms and neural mechanisms underlying odor-modulated locomotion in insects

Odors released from mates and resources such as a host and food are often the first sensory signals that an animal can detect. Changes in locomotion in response to odors are an important mechanism by which animals access resources important to their survival. Odor-modulated changes in locomotion in insects constitute a whole suite of flexible behaviors that allow insects to close in on these resources from long distances and perform local searches to locate and subsequently assess them. Here, we review changes in odor-mediated locomotion across many insect species. We emphasize that changes in locomotion induced by odors are diverse. In particular, the olfactory stimulus is sporadic at long distances and becomes more continuous at short distances. This distance-dependent change in temporal profile produces a corresponding change in an insect's locomotory strategy. We also discuss the neural circuits underlying odor modulation of locomotion.

Production of adaptive movement patterns via an insect inspired spiking neural network central pattern generator

Navigation in ever-changing environments requires effective motor behaviors. Many insects have developed adaptive movement patterns which increase their success in achieving navigational goals. A conserved brain area in the insect brain, the Lateral Accessory Lobe, is involved in generating small scale search movements which increase the efficacy of sensory sampling. When the reliability of an essential navigational stimulus is low, searching movements are initiated whereas if the stimulus reliability is high, a targeted steering response is elicited. Thus, the network mediates an adaptive switching between motor patterns. We developed Spiking Neural Network models to explore how an insect inspired architecture could generate adaptive movements in relation to changing sensory inputs. The models are able to generate a variety of adaptive movement patterns, the majority of which are of the zig-zagging kind, as seen in a variety of insects. Furthermore, these networks are robust to noise. Because a large spread of network parameters lead to the correct movement dynamics, we conclude that the investigated network architecture is inherently well-suited to generating adaptive movement patterns.

Will microfluidics enable functionally integrated biohybrid robots?

The next robotics frontier will be led by biohybrids. Capable biohybrid robots require microfluidics to sustain, improve, and scale the architectural complexity of their core ingredient: biological tissues. Advances in microfluidics have already revolutionized disease modeling and drug development, and are positioned to impact regenerative medicine but have yet to apply to biohybrids. Fusing microfluidics with living materials will improve tissue perfusion and maturation, and enable precise patterning of sensing, processing, and control elements. This perspective suggests future developments in advanced biohybrids.

A novel framework based on a data-driven approach for modelling the behaviour of organisms in chemical plume tracing

We propose a data-driven approach for modelling an organism's behaviour instead of conventional model-based strategies in chemical plume tracing (CPT). CPT models based on this approach show promise in faithfully reproducing organisms' CPT behaviour. To construct the data-driven CPT model, a training dataset of the odour stimuli input toward the organism is needed, along with an output of the organism's CPT behaviour. To this end, we constructed a measurement system comprising an array of alcohol sensors for the measurement of the input and a camera for tracking the output in a real scenario. Then, we determined a transfer function describing the input-output relationship as a stochastic process by applying Gaussian process regression, and established the data-driven CPT model based on measurements of the organism's CPT behaviour. Through CPT experiments in simulations and a real environment, we evaluated the performance of the data-driven CPT model and compared its success rate with those obtained from conventional model-based strategies. As a result, the proposed data-driven CPT model demonstrated a better success rate than those obtained from conventional model-based strategies. Moreover, we considered that the data-driven CPT model could reflect the aspect of an organism's adaptability that modulated its behaviour with respect to the surrounding environment. However, these useful results came from the CPT experiments conducted in simple settings of simulations and a real environment. If making the condition of the CPT experiments more complex, we confirmed that the data-driven CPT model would be less effective for locating an odour source. In this way, this paper not only poses major contributions toward the development of a novel framework based on a data-driven approach for modelling an organism's CPT behaviour, but also displays a research limitation of a data-driven approach at this stage.

Insect-machine hybrid robot

Recently, insect-machine hybrid robots have been developed that incorporate insects into robots or incorporate machines into insects. Most previous studies were motivated to use the function of insects for robots, but this technology can also prove to be useful as an experimental tool for neuroethology. We reviewed hybrid robots in terms of the closed-loop between an insect, a robot, and the real environment. The incorporated biological components provided the robot sensory signals that were received by the insects and the adaptive functions of the brain. The incorporated artificial components permitted us to understand the biological system by controlling insect behavior. Hybrid robots thus extend the roles of mobile robot experiments in neuroethology for both model evaluation and brain function analysis.

Connecting brain to behaviour: a role for general purpose steering circuits in insect orientation?

The lateral accessory lobes (LALs), paired structures that are homologous among all insect species, have been well studied for their role in pheromone tracking in silkmoths and phonotaxis in crickets, where their outputs have been shown to correlate with observed motor activity. Further studies have shown more generally that the LALs are crucial both for an insect's ability to steer correctly and for organising the outputs of the descending pathways towards the motor centres. In this context, we propose a framework by which the LALs may be generally involved in generating steering commands across a variety of insects and behaviours. Across different behaviours, we see that the LAL is involved in generating two kinds of steering: (1) search behaviours and (2) targeted steering driven by direct sensory information. Search behaviours are generated when the current behaviourally relevant cues are not available, and a well-described LAL subnetwork produces activity which increases sampling of the environment. We propose that, when behaviourally relevant cues are available, the LALs may integrate orientation information from several sensory modalities, thus leading to a collective output for steering driven by those cues. These steering commands are then sent to the motor centres, and an additional efference copy is sent back to the orientation-computing areas. In summary, we have taken known aspects of the neurophysiology and function of the insect LALs and generated a speculative framework that suggests how LALs might be involved in steering control for a variety of complex real-world behaviours in insects.

Dropping Counter: A Detection Algorithm for Identifying Odour-Evoked Responses from Noisy Electroantennograms Measured by a Flying Robot

The electroantennogram (EAG) is a technique used for measuring electrical signals from the antenna of an insect. Its rapid response time, quick recovery speed, and high sensitivity make it suitable for odour-tracking tasks employing mobile robots. However, its application to flying robots has not been extensively studied owing to the electrical and mechanical noises generated. In this study, we investigated the characteristics of the EAG mounted on a tethered flying quadcopter and developed a special counter-based algorithm for detecting the odour-generated responses. As the EAG response is negative, the algorithm creates a window and compares the values inside it. Once a value is smaller than the first one, the counter will increase by one and finally turns the whole signal into a clearer odour stimulated result. By experimental evaluation, the new algorithm gives a higher cross-correlation coefficient when compared with the fixed-threshold method. The result shows that the accuracy of this novel algorithm for recognising odour-evoked EAG signals from noise exceeds that of the traditional method; furthermore, the use of insect antennae as odour sensors for flying robots is demonstrated to be feasible.

A biohybrid fly-robot interface system that performs active collision avoidance

We have designed a bio-hybrid fly-robot interface (FRI) to study sensorimotor control in insects. The FRI consists of a miniaturized recording platform mounted on a two-wheeled robot and is controlled by the neuronal spiking activity of an identified visual interneuron, the blowfly H1-cell. For a given turning radius of the robot, we found a proportional relationship between the spike rate of the H1-cell and the relative distance of the FRI from the patterned wall of an experimental arena. Under closed-loop conditions during oscillatory forward movements biased towards the wall, collision avoidance manoeuvres were triggered whenever the H1-cell spike rate exceeded a certain threshold value. We also investigated the FRI behaviour in corners of the arena. The ultimate goal is to enable autonomous and energy-efficient manoeuvrings of the FRI within arbitrary visual environments.

Design and Experimental Evaluation of an Odor Sensing Method for a Pocket-Sized Quadcopter

In this study, we design and verify an intake system using the wake of a pocket-sized quadcopter for the chemical plume tracing (CPT) problem. Solving CPT represents an important technique in the field of engineering because it can be used to perform rescue operations at the time of a disaster and to identify sources of harmful substances. An appropriate intake of air when sensing odors plays an important role in performing CPT. Hence, we used the air flow generated by a quadcopter itself to intake chemical particles into two alcohol sensors. By experimental evaluation, we verified that the quadcopter wake intake method has good directivity and can be used to realize CPT. Concretely, even at various odor source heights, the quadcopter had a three-dimensional CPT success rate of at least 70%. These results imply that, although a further development of three-dimensional CPT is necessary in order to conduct it in unknown and cluttered environments, the intake method proposed in this paper enables a pocket-sized quadcopter to perform three-dimensional CPT.

Descending neurons from the lateral accessory lobe and posterior slope in the brain of the silkmoth Bombyx mori

A population of descending neurons connect the brain and thoracic motor center, playing a critical role in controlling behavior. We examined the anatomical organization of descending neurons (DNs) in the brain of the silkmoth Bombyx mori. Moth pheromone orientation is a good model to investigate neuronal mechanisms of behavior. Based on mass staining and single-cell staining, we evaluated the anatomical organization of neurite distribution by DNs in the brain. Dense innervation was observed in the posterior-ventral part of the brain called the posterior slope (PS). We analyzed the morphology of DNs innervating the lateral accessory lobe (LAL), which is considered important for moth olfactory behavior. We observed that all LAL DNs also innervate the PS, suggesting the integration of signals from the LAL and PS. We also identified a set of DNs innervating the PS but not the LAL. These DNs were sensitive to the sex pheromone, suggesting a role of the PS in motor control for pheromone processing. Here we discuss the organization of descending pathways for pheromone orientation.

A Robot Equipped with a High-Speed LSPR Gas Sensor Module for Collecting Spatial Odor Information from On-Ground Invisible Odor Sources

Improving the efficiency of detecting the spatial distribution of gas information with a mobile robot is a great challenge that requires rapid sample collection, which is basically determined by the speed of operation of gas sensors. The present work developed a robot equipped with a high-speed gas sensor module based on localized surface plasmon resonance. The sensor module is designed to sample gases from an on-ground odor source, such as a footprint material or artificial odor marker, via a fine sampling tubing. The tip of the sampling tubing was placed close to the ground to reduce the sampling time and the effect of natural gas diffusion. On-ground ethanol odor sources were detected by the robot at high resolution (i.e., 2.5 cm when the robot moved at 10 cm/s), and the reading of gas information was demonstrated experimentally. This work may help in the development of environmental sensing robots, such as the development of odor source mapping and multirobot systems with pheromone tracing.

Using insects to drive mobile robots - hybrid robots bridge the gap between biological and artificial systems

The use of mobile robots is an effective method of validating sensory-motor models of animals in a real environment. The well-identified insect sensory-motor systems have been the major targets for modeling. Furthermore, mobile robots implemented with such insect models attract engineers who aim to avail advantages from organisms. However, directly comparing the robots with real insects is still difficult, even if we successfully model the biological systems, because of the physical differences between them. We developed a hybrid robot to bridge the gap. This hybrid robot is an insect-controlled robot, in which a tethered male silkmoth (Bombyx mori) drives the robot in order to localize an odor source. This robot has the following three advantages: 1) from a biomimetic perspective, the robot enables us to evaluate the potential performance of future insect-mimetic robots; 2) from a biological perspective, the robot enables us to manipulate the closed-loop of an onboard insect for further understanding of its sensory-motor system; and 3) the robot enables comparison with insect models as a reference biological system. In this paper, we review the recent works regarding insect-controlled robots and discuss the significance for both engineering and biology.

Insect-controlled Robot: A Mobile Robot Platform to Evaluate the Odor-tracking Capability of an Insect

Robotic odor source localization has been a challenging area and one to which biological knowledge has been expected to contribute, as finding odor sources is an essential task for organism survival. Insects are well-studied organisms with regard to odor tracking, and their behavioral strategies have been applied to mobile robots for evaluation. This "bottom-up" approach is a fundamental way to develop biomimetic robots; however, the biological analyses and the modeling of behavioral mechanisms are still ongoing. Therefore, it is still unknown how such a biological system actually works as the controller of a robotic platform. To answer this question, we have developed an insect-controlled robot in which a male adult silkmoth (Bombyx mori) drives a robot car in response to odor stimuli; this can be regarded as a prototype of a future insect-mimetic robot. In the cockpit of the robot, a tethered silkmoth walked on an air-supported ball and an optical sensor measured the ball rotations. These rotations were translated into the movement of the two-wheeled robot. The advantage of this "hybrid" approach is that experimenters can manipulate any parameter of the robot, which enables the evaluation of the odor-tracking capability of insects and provides useful suggestions for robotic odor-tracking. Furthermore, these manipulations are non-invasive ways to alter the sensory-motor relationship of a pilot insect and will be a useful technique for understanding adaptive behaviors.

Comparative Neuroanatomy of the Lateral Accessory Lobe in the Insect Brain

The lateral accessory lobe (LAL) mediates signals from the central complex to the thoracic motor centers. The results obtained from different insects suggest that the LAL is highly relevant to the locomotion. Perhaps due to its deep location and lack of clear anatomical boundaries, few studies have focused on this brain region. Systematic data of LAL interneurons are available in the silkmoth. We here review individual neurons constituting the LAL by comparing the silkmoth and other insects. The survey through the connectivity and intrinsic organization suggests potential homology in the organization of the LAL among insects.

The neurobiological basis of orientation in insects: insights from the silkmoth mating dance

Counterturning is a common movement pattern during orientation behavior in insects. Once male moths sense sex pheromones and then lose the input, they demonstrate zigzag movements, alternating between left and right turns, to increase the probability to contact with the pheromone plume. We summarize the anatomy and function of the neural circuit involved in pheromone orientation in the silkmoth. A neural circuit, the lateral accessory lobe (LAL), serves a role as the circuit module for zigzag movements and controls this operation using a flip-flop neural switch. Circuit design of the LAL is well conserved across species. We hypothesize that this zigzag module is utilized in a wide range of insect behavior. We introduce two examples of the potential use: orientation flight and the waggle dance in bees.

Dynamical feature extraction at the sensory periphery guides chemotaxis

Behavioral strategies employed for chemotaxis have been described across phyla, but the sensorimotor basis of this phenomenon has seldom been studied in naturalistic contexts. Here, we examine how signals experienced during free olfactory behaviors are processed by first-order olfactory sensory neurons (OSNs) of the Drosophila larva. We find that OSNs can act as differentiators that transiently normalize stimulus intensity—a property potentially derived from a combination of integral feedback and feed-forward regulation of olfactory transduction. In olfactory virtual reality experiments, we report that high activity levels of the OSN suppress turning, whereas low activity levels facilitate turning. Using a generalized linear model, we explain how peripheral encoding of olfactory stimuli modulates the probability of switching from a run to a turn. Our work clarifies the link between computations carried out at the sensory periphery and action selection underlying navigation in odor gradients.

DOI:http://dx.doi.org/10.7554/eLife.06694.001

Fruit flies are attracted to the smell of rotting fruit, and use it to guide them to nearby food sources. However, this task is made more challenging by the fact that the distribution of scent or odor molecules in the air is constantly changing. Fruit flies therefore need to cope with, and exploit, this variation if they are to use odors as cues.

Odor molecules bind to receptors on the surface of nerve cells called olfactory sensory neurons, and trigger nerve impulses that travel along these cells. While many studies have investigated how fruit flies can distinguish between different odors, less is known about how animals can use variation in the strength of an odor to guide them towards its source.

Optogenetics is a technique that allows neuroscientists to control the activities of individual nerve cells, simply by shining light on to them. Because fruit fly larvae are almost transparent, optogenetics can be used on freely moving animals. Now, Schulze, Gomez-Marin et al. have used optogenetics in these larvae to trigger patterns of activity in individual olfactory sensory neurons that mimic the activity patterns elicited by real odors. These virtual realities were then used to study, in detail, some of the principles that control the sensory navigation of a larva—as it moves using a series of forward ‘runs’ and direction-changing ‘turns’.

Olfactory sensory neurons responded most strongly whenever light levels changed rapidly in strength (which simulated a rapid change in odor concentration). On the other hand, these neurons showed relatively little response to constant light levels (i.e., constant odors). This indicates that the activity of olfactory sensory neurons typically represents the rate of change in the concentration of an odor. An independent study by Kim et al. found that olfactory sensory neurons in adult fruit flies also respond in a similar way.

Schulze, Gomez-Marin et al. went on to show that the signals processed by a single type of olfactory sensory neuron could be used to predict a larva's behavior. Larvae tended to turn less when their olfactory sensory neurons were highly active. Low levels and inhibition of activity in the olfactory sensory neurons had the opposite effect; this promoted turning. It remains to be determined how this relatively simple control principle is implemented by the neural circuits that connect sensory neurons to the parts of a larva's nervous system that are involved with movement.

DOI:http://dx.doi.org/10.7554/eLife.06694.002

A simple behaviour provides accuracy and flexibility in odour plume tracking—the robotic control of sensory-motor coupling in silkmoths

Odour plume tracking is an essential behaviour for animal survival. A fundamental strategy for this is moving upstream and then across-stream. Male silkmoths, Bombyx mori, display this strategy as a pre-programmed sequential behaviour. They walk forward (surge) in response to the female sex pheromone and perform a zigzagging “mating dance”. Though pre-programmed, the surge direction is modulated by the bilateral olfactory input and optic flow. However, the nature of interaction between these two sensory modalities and contribution of the resultant motor command to localizing an odour source are still unknown. We evaluated the ability of the silkmoth to localize the odour source under conditions of disturbed sensory-motor coupling, using a silkmoth-driven mobile robot. The significance of the bilateral olfaction of the moth was confirmed by inverting the robot's olfactory input that is acquired using two flexible air-suction tubes and delivered to the antennae of the moth, or its motor output. Inversion of the motor output induced consecutive circling, which was inhibited by covering the visual field of the moth. This suggests that the corollary discharge from the motor command and the reafference of self-generated optic flow generates compensatory signals to guide the surge accurately. Additionally, after inverting the olfactory input, the robot successfully tracked the odour plume by using a combination of behaviours. These results indicate that accurate guidance of the reflexive surge by integrating bilateral olfactory and visual information with innate pre-programmed behaviours increases the flexibility to track an odour plume even under disturbed circumstances.

Reactive searching and infotaxis in odor source localization

Male moths aiming to locate pheromone-releasing females rely on stimulus-adapted search maneuvers complicated by a discontinuous distribution of pheromone patches. They alternate sequences of upwind surge when perceiving the pheromone and cross- or downwind casting when the odor is lost. We compare four search strategies: three reactive versus one cognitive. The former consist of pre-programmed movement sequences triggered by pheromone detections while the latter uses Bayesian inference to build spatial probability maps. Based on the analysis of triphasic responses of antennal lobe neurons (On, inhibition, Off), we propose three reactive strategies. One combines upwind surge (representing the On response to a pheromone detection) and spiral casting, only. The other two additionally include crosswind (zigzag) casting representing the Off phase. As cognitive strategy we use the infotaxis algorithm which was developed for searching in a turbulent medium. Detection events in the electroantennogram of a moth attached to a robot indirectly control this cyborg, depending on the strategy in use. The recorded trajectories are analyzed with regard to success rates, efficiency, and other features. In addition, we qualitatively compare our robotic trajectories to behavioral search paths. Reactive searching is more efficient (yielding shorter trajectories) for higher pheromone doses whereas cognitive searching works better for lower doses. With respect to our experimental conditions (2 m from starting position to pheromone source), reactive searching with crosswind zigzag yields the shortest trajectories (for comparable success rates). Assuming that the neuronal Off response represents a short-term memory, zigzagging is an efficient movement to relocate a recently lost pheromone plume. Accordingly, such reactive strategies offer an interesting alternative to complex cognitive searching.

Dynamic use of optic flow during pheromone tracking by the male silkmoth, Bombyx mori

Several insects require both olfactory and visual cues during odour-source localisation to successfully locate an odour source. In the male silkmoth, Bombyx mori, detection of the female sex pheromone triggers a programmed walking pattern, starting from a surge (straight-line walking) followed by zigzag walking. Although pheromone-triggered behaviour in silkmoths is well understood, the role of visual cues remains obscure. To address this question, we performed behavioural experiments on tethered-walking moths by recording their locomotion during stimulation with a pheromone and a visual motion pattern (optic flow). The experiments were conducted under open- and closed-loop visual stimuli. We found that the use of optic flow input was determined by the behavioural state of surge and zigzagging. Silkmoths exhibited an optomotor response, which is a behavioural visual response, by turning towards the same direction as optic flow stimuli only during surge, but not during zigzagging. In addition, modulation of the zigzag walking pattern was observed when the moths were presented with biased closed-loop visual stimuli (visual feedback with biased constant optic flow); however, the directional preference mechanism was different from that of the optomotor response. Based on these findings, we suggest that the optomotor response is utilised for course control during straight-line walking, whereas the absence of optomotor response during zigzagging is used to effectively perform the programmed walking pattern. Considering the neural basis of programmed behaviour, we speculate that at least two visual pathways are involved in the state-dependent use of optic flow during odour tracking behaviour in silkmoths.

Insect-machine hybrid system for understanding and evaluating sensory-motor control by sex pheromone in Bombyx mori

To elucidate the dynamic information processing in a brain underlying adaptive behavior, it is necessary to understand the behavior and corresponding neural activities. This requires animals which have clear relationships between behavior and corresponding neural activities. Insects are precisely such animals and one of the adaptive behaviors of insects is high-accuracy odor source orientation. The most direct way to know the relationships between neural activity and behavior is by recording neural activities in a brain from freely behaving insects. There is also a method to give stimuli mimicking the natural environment to tethered insects allowing insects to walk or fly at the same position. In addition to these methods an 'insect-machine hybrid system' is proposed, which is another experimental system meeting the conditions necessary for approaching the dynamic processing in the brain of insects for generating adaptive behavior. This insect-machine hybrid system is an experimental system which has a mobile robot as its body. The robot is controlled by the insect through its behavior or the neural activities recorded from the brain. As we can arbitrarily control the motor output of the robot, we can intervene at the relationship between the insect and the environmental conditions.