Robots in invertebrate neuroscience

Neuromorphic sequence learning with an event camera on routes through vegetation

For many robotics applications, it is desirable to have relatively low-power and efficient onboard solutions. We took inspiration from insects, such as ants, that are capable of learning and following routes in complex natural environments using relatively constrained sensory and neural systems. Such capabilities are particularly relevant to applications such as agricultural robotics, where visual navigation through dense vegetation remains a challenging task. In this scenario, a route is likely to have high self-similarity and be subject to changing lighting conditions and motion over uneven terrain, and the effects of wind on leaves increase the variability of the input. We used a bioinspired event camera on a terrestrial robot to collect visual sequences along routes in natural outdoor environments and applied a neural algorithm for spatiotemporal memory that is closely based on a known neural circuit in the insect brain. We show that this method is plausible to support route recognition for visual navigation and more robust than SeqSLAM when evaluated on repeated runs on the same route or routes with small lateral offsets. By encoding memory in a spiking neural network running on a neuromorphic computer, our model can evaluate visual familiarity in real time from event camera footage.

Linking neural circuits to the mechanics of animal behavior in Drosophila larval locomotion

The motions that make up animal behavior arise from the interplay between neural circuits and the mechanical parts of the body. Therefore, in order to comprehend the operational mechanisms governing behavior, it is essential to examine not only the underlying neural network but also the mechanical characteristics of the animal's body. The locomotor system of fly larvae serves as an ideal model for pursuing this integrative approach. By virtue of diverse investigation methods encompassing connectomics analysis and quantification of locomotion kinematics, research on larval locomotion has shed light on the underlying mechanisms of animal behavior. These studies have elucidated the roles of interneurons in coordinating muscle activities within and between segments, as well as the neural circuits responsible for exploration. This review aims to provide an overview of recent research on the neuromechanics of animal locomotion in fly larvae. We also briefly review interspecific diversity in fly larval locomotion and explore the latest advancements in soft robots inspired by larval locomotion. The integrative analysis of animal behavior using fly larvae could establish a practical framework for scrutinizing the behavior of other animal species.

SNS-Toolbox: An Open Source Tool for Designing Synthetic Nervous Systems and Interfacing Them with Cyber-Physical Systems

One developing approach for robotic control is the use of networks of dynamic neurons connected with conductance-based synapses, also known as Synthetic Nervous Systems (SNS). These networks are often developed using cyclic topologies and heterogeneous mixtures of spiking and non-spiking neurons, which is a difficult proposition for existing neural simulation software. Most solutions apply to either one of two extremes, the detailed multi-compartment neural models in small networks, and the large-scale networks of greatly simplified neural models. In this work, we present our open-source Python package SNS-Toolbox, which is capable of simulating hundreds to thousands of spiking and non-spiking neurons in real-time or faster on consumer-grade computer hardware. We describe the neural and synaptic models supported by SNS-Toolbox, and provide performance on multiple software and hardware backends, including GPUs and embedded computing platforms. We also showcase two examples using the software, one for controlling a simulated limb with muscles in the physics simulator Mujoco, and another for a mobile robot using ROS. We hope that the availability of this software will reduce the barrier to entry when designing SNS networks, and will increase the prevalence of SNS networks in the field of robotic control.

Understanding brain functional architecture through robotics

Robotics is increasingly seen as a useful test bed for computational models of the brain functional architecture underlying animal behavior. We provide an overview of past and current work, focusing on probabilistic and dynamical models, including approaches premised on the free energy principle, situating this endeavor in relation to evidence that the brain constitutes a layered control system. We argue that future neurorobotic models should integrate multiple neurobiological constraints and be hybrid in nature.

The neuromechanics of animal locomotion: From biology to robotics and back

Robotics and neuroscience are sister disciplines that both aim to understand how agile, efficient, and robust locomotion can be achieved in autonomous agents. Robotics has already benefitted from neuromechanical principles discovered by investigating animals. These include the use of high-level commands to control low-level central pattern generator-like controllers, which, in turn, are informed by sensory feedback. Reciprocally, neuroscience has benefited from tools and intuitions in robotics to reveal how embodiment, physical interactions with the environment, and sensory feedback help sculpt animal behavior. We illustrate and discuss exemplar studies of this dialog between robotics and neuroscience. We also reveal how the increasing biorealism of simulations and robots is driving these two disciplines together, forging an integrative science of autonomous behavioral control with many exciting future opportunities.

A virtuous cycle between invertebrate and robotics research: perspective on a decade of Living Machines research

Many invertebrates are ideal model systems on which to base robot design principles due to their success in solving seemingly complex tasks across domains while possessing smaller nervous systems than vertebrates. Three areas are particularly relevant for robot designers: Research on flying and crawling invertebrates has inspired new materials and geometries from which robot bodies (their morphologies) can be constructed, enabling a new generation of softer, smaller, and lighter robots. Research on walking insects has informed the design of new systems for controlling robot bodies (their motion control) and adapting their motion to their environment without costly computational methods. And research combining wet and computational neuroscience with robotic validation methods has revealed the structure and function of core circuits in the insect brain responsible for the navigation and swarming capabilities (their mental faculties) displayed by foraging insects. The last decade has seen significant progress in the application of principles extracted from invertebrates, as well as the application of biomimetic robots to model and better understand how animals function. This Perspectives paper on the past 10 years of the Living Machines conference outlines some of the most exciting recent advances in each of these fields before outlining lessons gleaned and the outlook for the next decade of invertebrate robotic research.

New Approaches to 3D Vision

New approaches to 3D vision are enabling new advances in artificial intelligence and autonomous vehicles, a better understanding of how animals navigate the 3D world, and new insights into human perception in virtual and augmented reality. Whilst traditional approaches to 3D vision in computer vision (SLAM: simultaneous localization and mapping), animal navigation (cognitive maps), and human vision (optimal cue integration) start from the assumption that the aim of 3D vision is to provide an accurate 3D model of the world, the new approaches to 3D vision explored in this issue challenge this assumption. Instead, they investigate the possibility that computer vision, animal navigation, and human vision can rely on partial or distorted models or no model at all. This issue also highlights the implications for artificial intelligence, autonomous vehicles, human perception in virtual and augmented reality, and the treatment of visual disorders, all of which are explored by individual articles. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Emergent dynamics in a robotic model based on the Caenorhabditis elegans connectome

We analyze the neural dynamics and their relation with the emergent actions of a robotic vehicle that is controlled by a neural network numerical simulation based on the nervous system of the nematode Caenorhabditis elegans. The robot interacts with the environment through a sensor that transmits the information to sensory neurons, while motor neurons outputs are connected to wheels. This is enough to allow emergent robot actions in complex environments, such as avoiding collisions with obstacles. Working with robotic models makes it possible to simultaneously keep track of the dynamics of all the neurons and also register the actions of the robot in the environment in real time, while avoiding the complex technicalities of simulating a real environment. This allowed us to identify several relevant features of the neural dynamics associated with the emergent actions of the robot, some of which have already been observed in biological worms. These results suggest that some basic aspects of behaviors observed in living beings are determined by the underlying structure of the associated neural network.

Is biorobotics science? Some theoretical reflections

In this paper, we ask one fairly simple question: to what extent can biorobotics be sensibly qualified as science? The answer clearly depends on what 'science' means and whether what is actually done in biorobotics corresponds to this meaning. To respond to this question, we will deploy the distinction between science and so-called technoscience, and isolate different kinds of objects of inquiry in biorobotics research. Capitalising on the distinction between 'proximal' and 'distal' biorobotic hypotheses, we will argue that technoscientific biorobotic studies address proximal hypotheses, whilst scientific biorobotic studies address distal hypotheses. As a result, we argue that bioroboticians can be both considered as scientists and technoscientists and that this is one of the main payoffs of biorobotics. Indeed, technoscientists play an extremely important role in 21st-century culture and in the current critical production of knowledge. Today's world is increasingly technological, or rather, it is a bio-hybrid system in which the biological and the technological are mixed. Therefore, studying the behaviour of robotic systems and the phenomena of animal-robot interaction means analysing, understanding, and shaping our world. Indeed, in the conclusion of the paper, we broadly reflect on the philosophical and disciplinary payoff of seeing biorobotics as a science and/or technoscience for the increasingly bio-hybrid and technical world of the 21st century.

Robotics as a Comparative Method in Ecology and Evolutionary Biology

Comparative biologists have typically used one or more of the following methods to assist in evaluating the proposed functional and performance significance of individual traits: comparative phylogenetic analysis, direct interspecific comparison among species, genetic modification, experimental alteration of morphology (for example by surgically modifying traits), and ecological manipulation where individual organisms are transplanted to a different environment. But comparing organisms as the endpoints of an evolutionary process involves the ceteris paribus assumption: that all traits other than the one(s) of interest are held constant. In a properly controlled experimental study, only the variable of interest changes among the groups being compared. The theme of this paper is that the use of robotic or mechanical models offers an additional tool in comparative biology that helps to minimize the effect of uncontrolled variables by allowing direct manipulation of the trait of interest against a constant background. The structure and movement pattern of mechanical devices can be altered in ways not possible in studies of living animals, facilitating testing hypotheses of the functional and performance significant of individual traits. Robotic models of organismal design are particularly useful in three arenas: (1) controlling variation to allow modification only of the trait of interest, (2) the direct measurement of energetic costs of individual traits, and (3) quantification of the performance landscape. Obtaining data in these three areas is extremely difficult through the study of living organisms alone, and the use of robotic models can reveal unexpected effects. Controlling for all variables except for the length of a swimming flexible object reveals substantial non-linear effects that vary with stiffness. Quantification of the swimming performance surface reveals that there are two peaks with comparable efficiency, greatly complicating the inference of performance from morphology alone. Organisms and their ecological interactions are complex, and dissecting this complexity to understand the effects of individual traits is a grand challenge in ecology and evolutionary biology. Robotics has great promise as a "comparative method," allowing better-controlled comparative studies to analyze the many interacting elements that make up complex behaviors, ecological interactions, and evolutionary histories.

A Looming Spatial Localization Neural Network Inspired by MLG1 Neurons in the Crab Neohelice

Similar to most visual animals, the crab Neohelice granulata relies predominantly on visual information to escape from predators, to track prey and for selecting mates. It, therefore, needs specialized neurons to process visual information and determine the spatial location of looming objects. In the crab Neohelice granulata, the Monostratified Lobula Giant type1 (MLG1) neurons have been found to manifest looming sensitivity with finely tuned capabilities of encoding spatial location information. MLG1s neuronal ensemble can not only perceive the location of a looming stimulus, but are also thought to be able to influence the direction of movement continuously, for example, escaping from a threatening, looming target in relation to its position. Such specific characteristics make the MLG1s unique compared to normal looming detection neurons in invertebrates which can not localize spatial looming. Modeling the MLG1s ensemble is not only critical for elucidating the mechanisms underlying the functionality of such neural circuits, but also important for developing new autonomous, efficient, directionally reactive collision avoidance systems for robots and vehicles. However, little computational modeling has been done for implementing looming spatial localization analogous to the specific functionality of MLG1s ensemble. To bridge this gap, we propose a model of MLG1s and their pre-synaptic visual neural network to detect the spatial location of looming objects. The model consists of 16 homogeneous sectors arranged in a circular field inspired by the natural arrangement of 16 MLG1s' receptive fields to encode and convey spatial information concerning looming objects with dynamic expanding edges in different locations of the visual field. Responses of the proposed model to systematic real-world visual stimuli match many of the biological characteristics of MLG1 neurons. The systematic experiments demonstrate that our proposed MLG1s model works effectively and robustly to perceive and localize looming information, which could be a promising candidate for intelligent machines interacting within dynamic environments free of collision. This study also sheds light upon a new type of neuromorphic visual sensor strategy that can extract looming objects with locational information in a quick and reliable manner.

Organic neuromorphic electronics for sensorimotor integration and learning in robotics

In living organisms, sensory and motor processes are distributed, locally merged, and capable of forming dynamic sensorimotor associations. We introduce a simple and efficient organic neuromorphic circuit for local sensorimotor merging and processing on a robot that is placed in a maze. While the robot is exposed to external environmental stimuli, visuomotor associations are formed on the adaptable neuromorphic circuit. With this on-chip sensorimotor integration, the robot learns to follow a path to the exit of a maze, while being guided by visually indicated paths. The ease of processability of organic neuromorphic electronics and their unconventional form factors, in combination with education-purpose robotics, showcase a promising approach of an affordable, versatile, and readily accessible platform for exploring, designing, and evaluating behavioral intelligence through decentralized sensorimotor integration.

Electric signal synchronization as a behavioural strategy to generate social attention in small groups of mormyrid weakly electric fish and a mobile fish robot

African weakly electric fish communicate at night by constantly emitting and perceiving brief electrical signals (electric organ discharges, EOD) at variable inter-discharge intervals (IDI). While the waveform of single EODs contains information about the sender's identity, the variable IDI patterns convey information about its current motivational and behavioural state. Pairs of fish can synchronize their EODs to each other via echo responses, and we have previously formulated a 'social attention hypothesis' stating that fish use echo responses to address specific individuals and establish brief dyadic communication frameworks within a group. Here, we employed a mobile fish robot to investigate the behaviour of small groups of up to four Mormyrus rume and characterized the social situations during which synchronizations occurred. An EOD-emitting robot reliably evoked social following behaviour, which was strongest in smaller groups and declined with increasing group size. We did not find significant differences in motor behaviour of M. rume with either an interactive playback (echo response) or a random control playback by the robot. Still, the robot reliably elicited mutual synchronizations with other fish. Synchronizations mostly occurred during relatively close social interactions, usually when the fish that initiated synchronization approached either the robot or another fish from a distance. The results support our social attention hypothesis and suggest that electric signal synchronization might facilitate the exchange of social information during a wide range of social behaviours from aggressive territorial displays to shoaling and even cooperative hunting in some mormyrids.

The creation of phenomena in interactive biorobotics

In so-called interactive biorobotics, robotic models of living systems interact with animals in controlled experimental settings. By observing how the focal animal reacts to the stimuli delivered by the robot, one tests hypotheses concerning the determinants of animal behaviour in social contexts. Building on previous methodological reconstructions of interactive biorobotics, this article reflects on the claim, made by several authors in the field, that this strategy may enable one to explain social phenomena in animals. The answer offered here will be negative: interactive biorobotics does not contribute to the explanation of social phenomena. However, it may greatly contribute to the study of animal behaviour by creating social phenomena in the sense discussed by Ian Hacking, i.e. by precisely defining new phenomena to be explained. It will be also suggested that interactive biorobotics can be combined with more classical robot-based approaches to the study of living systems, leading to a so-called simulation-interactive strategy for the mechanistic explanation of social behaviour in animals.

Suppression of motion vision during course-changing, but not course-stabilizing, navigational turns

From mammals to insects, locomotion has been shown to strongly modulate visual-system physiology. Does the manner in which a locomotor act is initiated change the modulation observed? We performed patch-clamp recordings from motion-sensitive visual neurons in tethered, flying Drosophila. We observed motor-related signals in flies performing flight turns in rapid response to looming discs and also during spontaneous turns, but motor-related signals were weak or non-existent in the context of turns made in response to brief pulses of unidirectional visual motion (i.e., optomotor responses). Thus, the act of a locomotor turn is variably associated with modulation of visual processing. These results can be understood via the following principle: suppress visual responses during course-changing, but not course-stabilizing, navigational turns. This principle is likely to apply broadly-even to mammals-whenever visual cells whose activity helps to stabilize a locomotor trajectory or the visual gaze angle are targeted for motor modulation.

Auditory Virtual Reality for Insect Phonotaxis

Insects have a sophisticated ability to navigate real environments. Virtual reality (VR) is a powerful tool for analyzing animal navigation in laboratory studies and is the most successful when used in the study of visually guided behaviors. However, the use of VR with non-visual sensory information, such as sound, on which nocturnal insects rely, for analyzing animal navigation has not been fully studied. We developed an auditory VR for the study of auditory navigation in crickets, Gryllus bimaculatus. The system consisted of a spherical treadmill on which a tethered female cricket walked. Sixteen speakers were placed around the cricket for auditory stimuli. The two optical mice attached to the treadmill measured the cricket’s locomotion, and the sound pressure and direction of the auditory stimuli were controlled at 100 Hz based on the position and heading of the cricket relative to a sound source in a virtual arena. We demonstrated that tethered female crickets selectively responded to the conspecific male calling song and localized the sound source in a virtual arena, which was similar to the behavior of freely walking crickets. Further combinations of our system with neurophysiological techniques will help understand the neural mechanisms for insect auditory navigation.

Average search time bounds in cue-based searches

In this work we consider search problems that evaluate the probability distribution of finding the source at each step in the search. We start with a sample strategy where the movement at each time step is in the immediate neighborhood. The jump probability is taken to be proportional to the normalized difference between the probability of finding the source at the jump location with the probability of finding the source at the present location. We evaluate a lower bound on the average search time for a searcher using this strategy. We next consider the problem of evaluating the lower bound on the search time for a generic strategy which would utilize the source probability distribution to figure out the position of the source. We derive an expression for the lower bound on the search time. We present an analytic expression for this lower bound in a case in which the particles emitted by the source diffuse in a homogeneous manner. For a general probability distribution with entropy E, we find that the lower bound goes as e^{E/2}.

Insect-machine hybrid robot

Recently, insect-machine hybrid robots have been developed that incorporate insects into robots or incorporate machines into insects. Most previous studies were motivated to use the function of insects for robots, but this technology can also prove to be useful as an experimental tool for neuroethology. We reviewed hybrid robots in terms of the closed-loop between an insect, a robot, and the real environment. The incorporated biological components provided the robot sensory signals that were received by the insects and the adaptive functions of the brain. The incorporated artificial components permitted us to understand the biological system by controlling insect behavior. Hybrid robots thus extend the roles of mobile robot experiments in neuroethology for both model evaluation and brain function analysis.

The Logic of Interactive Biorobotics

In recent studies, robots are used to stimulate living systems in controlled experimental settings. This research strategy is here called interactive biorobotics, to distinguish it from classical biorobotics, in which robots are used to simulate, rather than to stimulate, living system behavior. This article offers a methodological analysis of interactive biorobotics and has two goals. The first one is to argue that interactive biorobotics is methodologically different, in some important respects, from classical biorobotics and from countless instances of model-based science. It will be shown that interactive biorobotics does not conform to the so-called "understanding by building" approach or synthetic method, and that it illustrates a novel use of models in science. The second goal is to reflect on the logic of interactive biorobotics. A distinction will be made between two classes of studies, which will be called "proximal" and "distal." In proximal studies, experiments involving robot-animal interaction are brought to bear on theoretical hypotheses on robot-animal interaction. In distal studies, experiments involving robot-animal interaction are brought to bear on theoretical hypotheses on animal-animal interaction. Distal studies involve logical steps which may be particularly hard to justify. This distinction, together with a methodological reflection on the relationship between the context in which the experiments are carried out and the context in which the conclusions are expected to hold, will lead to a checklist of questions which may be useful to justify and evaluate the validity of interactive biorobotics studies. The reconstruction of the logic of interactive biorobotics made here, though preliminary, may contribute to justifying the important role that robots, as tool for stimulating living systems, can play in the contemporary life sciences.

Sensory Feedback and Animal Locomotion: Perspectives from Biology and Biorobotics: An Introduction to the Symposium

The successful completion of many behaviors relies on sensory feedback. This symposium brought together researchers using novel techniques to study how different stimuli are encoded, how and where multimodal feedback is integrated, and how feedback modulates motor output in diverse modes of locomotion (aerial, aquatic, and terrestrial) in a diverse range of taxa (insects, fish, tetrapods), and in robots. Similar to biological organisms, robots can be equipped with integrated sensors and can rely on sensory feedback to adjust the output signal of a controller. Engineers often look to biology for inspiration on how animals have evolved solutions to problems similar to those experienced in robotic movement. Similarly, biologists too must proactively engage with engineers to apply computer and robotic models to test hypotheses and answer questions on the capacity and roles of sensory feedback in generating effective movement. Through a diverse group of researchers, including both biologists and engineers, the symposium attempted to catalyze new interdisciplinary collaborations and identify future research directions for the development of bioinspired sensory control systems, as well as the use of robots to test hypotheses in neuromechanics.

Using insects to drive mobile robots - hybrid robots bridge the gap between biological and artificial systems

The use of mobile robots is an effective method of validating sensory-motor models of animals in a real environment. The well-identified insect sensory-motor systems have been the major targets for modeling. Furthermore, mobile robots implemented with such insect models attract engineers who aim to avail advantages from organisms. However, directly comparing the robots with real insects is still difficult, even if we successfully model the biological systems, because of the physical differences between them. We developed a hybrid robot to bridge the gap. This hybrid robot is an insect-controlled robot, in which a tethered male silkmoth (Bombyx mori) drives the robot in order to localize an odor source. This robot has the following three advantages: 1) from a biomimetic perspective, the robot enables us to evaluate the potential performance of future insect-mimetic robots; 2) from a biological perspective, the robot enables us to manipulate the closed-loop of an onboard insect for further understanding of its sensory-motor system; and 3) the robot enables comparison with insect models as a reference biological system. In this paper, we review the recent works regarding insect-controlled robots and discuss the significance for both engineering and biology.

Predictive control of intersegmental tarsal movements in an insect

In many animals intersegmental reflexes are important for postural and movement control but are still poorly undesrtood. Mathematical methods can be used to model the responses to stimulation, and thus go beyond a simple description of responses to specific inputs. Here we analyse an intersegmental reflex of the foot (tarsus) of the locust hind leg, which raises the tarsus when the tibia is flexed and depresses it when the tibia is extended. A novel method is described to measure and quantify the intersegmental responses of the tarsus to a stimulus to the femoro-tibial chordotonal organ. An Artificial Neural Network, the Time Delay Neural Network, was applied to understand the properties and dynamics of the reflex responses. The aim of this study was twofold: first to develop an accurate method to record and analyse the movement of an appendage and second, to apply methods to model the responses using Artificial Neural Networks. The results show that Artificial Neural Networks provide accurate predictions of tarsal movement when trained with an average reflex response to Gaussian White Noise stimulation compared to linear models. Furthermore, the Artificial Neural Network model can predict the individual responses of each animal and responses to others inputs such as a sinusoid. A detailed understanding of such a reflex response could be included in the design of orthoses or functional electrical stimulation treatments to improve walking in patients with neurological disorders as well as the bio/inspired design of robots.

A Quadruped Robot Exhibiting Spontaneous Gait Transitions from Walking to Trotting to Galloping

The manner in which quadrupeds change their locomotive patterns-walking, trotting, and galloping-with changing speed is poorly understood. In this paper, we provide evidence for interlimb coordination during gait transitions using a quadruped robot for which coordination between the legs can be self-organized through a simple "central pattern generator" (CPG) model. We demonstrate spontaneous gait transitions between energy-efficient patterns by changing only the parameter related to speed. Interlimb coordination was achieved with the use of local load sensing only without any preprogrammed patterns. Our model exploits physical communication through the body, suggesting that knowledge of physical communication is required to understand the leg coordination mechanism in legged animals and to establish design principles for legged robots that can reproduce flexible and efficient locomotion.

Cerebellar-inspired algorithm for adaptive control of nonlinear dielectric elastomer-based artificial muscle

Electroactive polymer actuators are important for soft robotics, but can be difficult to control because of compliance, creep and nonlinearities. Because biological control mechanisms have evolved to deal with such problems, we investigated whether a control scheme based on the cerebellum would be useful for controlling a nonlinear dielectric elastomer actuator, a class of artificial muscle. The cerebellum was represented by the adaptive filter model, and acted in parallel with a brainstem, an approximate inverse plant model. The recurrent connections between the two allowed for direct use of sensory error to adjust motor commands. Accurate tracking of a displacement command in the actuator's nonlinear range was achieved by either semi-linear basis functions in the cerebellar model or semi-linear functions in the brainstem corresponding to recruitment in biological muscle. In addition, allowing transfer of training between cerebellum and brainstem as has been observed in the vestibulo-ocular reflex prevented the steady increase in cerebellar output otherwise required to deal with creep. The extensibility and relative simplicity of the cerebellar-based adaptive-inverse control scheme suggests that it is a plausible candidate for controlling this type of actuator. Moreover, its performance highlights important features of biological control, particularly nonlinear basis functions, recruitment and transfer of training.

Biohybrid Control of General Linear Systems Using the Adaptive Filter Model of Cerebellum

The adaptive filter model of the cerebellar microcircuit has been successfully applied to biological motor control problems, such as the vestibulo-ocular reflex (VOR), and to sensory processing problems, such as the adaptive cancelation of reafferent noise. It has also been successfully applied to problems in robotics, such as adaptive camera stabilization and sensor noise cancelation. In previous applications to inverse control problems, the algorithm was applied to the velocity control of a plant dominated by viscous and elastic elements. Naive application of the adaptive filter model to the displacement (as opposed to velocity) control of this plant results in unstable learning and control. To be more generally useful in engineering problems, it is essential to remove this restriction to enable the stable control of plants of any order. We address this problem here by developing a biohybrid model reference adaptive control (MRAC) scheme, which stabilizes the control algorithm for strictly proper plants. We evaluate the performance of this novel cerebellar-inspired algorithm with MRAC scheme in the experimental control of a dielectric electroactive polymer, a class of artificial muscle. The results show that the augmented cerebellar algorithm is able to accurately control the displacement response of the artificial muscle. The proposed solution not only greatly extends the practical applicability of the cerebellar-inspired algorithm, but may also shed light on cerebellar involvement in a wider range of biological control tasks.

Controlling legs for locomotion-insights from robotics and neurobiology

Walking is the most common terrestrial form of locomotion in animals. Its great versatility and flexibility has led to many attempts at building walking machines with similar capabilities. The control of walking is an active research area both in neurobiology and robotics, with a large and growing body of work. This paper gives an overview of the current knowledge on the control of legged locomotion in animals and machines and attempts to give walking control researchers from biology and robotics an overview of the current knowledge in both fields. We try to summarize the knowledge on the neurobiological basis of walking control in animals, emphasizing common principles seen in different species. In a section on walking robots, we review common approaches to walking controller design with a slight emphasis on biped walking control. We show where parallels between robotic and neurobiological walking controllers exist and how robotics and biology may benefit from each other. Finally, we discuss where research in the two fields diverges and suggest ways to bridge these gaps.

Dynamical feature extraction at the sensory periphery guides chemotaxis

Behavioral strategies employed for chemotaxis have been described across phyla, but the sensorimotor basis of this phenomenon has seldom been studied in naturalistic contexts. Here, we examine how signals experienced during free olfactory behaviors are processed by first-order olfactory sensory neurons (OSNs) of the Drosophila larva. We find that OSNs can act as differentiators that transiently normalize stimulus intensity—a property potentially derived from a combination of integral feedback and feed-forward regulation of olfactory transduction. In olfactory virtual reality experiments, we report that high activity levels of the OSN suppress turning, whereas low activity levels facilitate turning. Using a generalized linear model, we explain how peripheral encoding of olfactory stimuli modulates the probability of switching from a run to a turn. Our work clarifies the link between computations carried out at the sensory periphery and action selection underlying navigation in odor gradients.

DOI:http://dx.doi.org/10.7554/eLife.06694.001

Fruit flies are attracted to the smell of rotting fruit, and use it to guide them to nearby food sources. However, this task is made more challenging by the fact that the distribution of scent or odor molecules in the air is constantly changing. Fruit flies therefore need to cope with, and exploit, this variation if they are to use odors as cues.

Odor molecules bind to receptors on the surface of nerve cells called olfactory sensory neurons, and trigger nerve impulses that travel along these cells. While many studies have investigated how fruit flies can distinguish between different odors, less is known about how animals can use variation in the strength of an odor to guide them towards its source.

Optogenetics is a technique that allows neuroscientists to control the activities of individual nerve cells, simply by shining light on to them. Because fruit fly larvae are almost transparent, optogenetics can be used on freely moving animals. Now, Schulze, Gomez-Marin et al. have used optogenetics in these larvae to trigger patterns of activity in individual olfactory sensory neurons that mimic the activity patterns elicited by real odors. These virtual realities were then used to study, in detail, some of the principles that control the sensory navigation of a larva—as it moves using a series of forward ‘runs’ and direction-changing ‘turns’.

Olfactory sensory neurons responded most strongly whenever light levels changed rapidly in strength (which simulated a rapid change in odor concentration). On the other hand, these neurons showed relatively little response to constant light levels (i.e., constant odors). This indicates that the activity of olfactory sensory neurons typically represents the rate of change in the concentration of an odor. An independent study by Kim et al. found that olfactory sensory neurons in adult fruit flies also respond in a similar way.

Schulze, Gomez-Marin et al. went on to show that the signals processed by a single type of olfactory sensory neuron could be used to predict a larva's behavior. Larvae tended to turn less when their olfactory sensory neurons were highly active. Low levels and inhibition of activity in the olfactory sensory neurons had the opposite effect; this promoted turning. It remains to be determined how this relatively simple control principle is implemented by the neural circuits that connect sensory neurons to the parts of a larva's nervous system that are involved with movement.

DOI:http://dx.doi.org/10.7554/eLife.06694.002

Robotics and neuroscience

In the attempt to build adaptive and intelligent machines, roboticists have looked at neuroscience for more than half a century as a source of inspiration for perception and control. More recently, neuroscientists have resorted to robots for testing hypotheses and validating models of biological nervous systems. Here, we give an overview of the work at the intersection of robotics and neuroscience and highlight the most promising approaches and areas where interactions between the two fields have generated significant new insights. We articulate the work in three sections, invertebrate, vertebrate and primate neuroscience. We argue that robots generate valuable insight into the function of nervous systems, which is intimately linked to behaviour and embodiment, and that brain-inspired algorithms and devices give robots life-like capabilities.

Mechanics and energetics in tool manufacture and use: a synthetic approach

Tool manufacture and use are observed not only in humans but also in other animals such as mammals, birds and insects. Manufactured tools are used for biomechanical functions such as effective control of fluids and small solid objects and extension of reaching. These tools are passive and used with gravity and the animal users' own energy. From the perspective of evolutionary biology, manufactured tools are extended phenotypes of the genes of the animal and exhibit phenotypic plasticity. This incurs energetic cost of manufacture as compared to the case with a fixed tool. This paper studies mechanics and energetics aspects of tool manufacture and use in non-human beings. Firstly, it investigates possible mechanical mechanisms of the use of passive manufactured tools. Secondly, it formulates the energetic cost of manufacture and analyses when phenotypic plasticity benefits an animal tool maker and user. We take a synthetic approach and use a controlled physical model, i.e. a robot arm. The robot is capable of additively manufacturing scoop and gripper structures from thermoplastic adhesives to pick and place fluid and solid objects, mimicking primates and birds manufacturing tools for a similar function. We evaluate the effectiveness of tool use in pick-and-place and explain the mechanism for gripper tools picking up solid objects with a solid-mechanics model. We propose a way to formulate the energetic cost of tool manufacture that includes modes of addition and reshaping, and use it to analyse the case of scoop tools. Experiment results show that with a single motor trajectory, the robot was able to effectively pick and place water, rice grains, a pebble and a plastic box with a scoop tool or gripper tools that were manufactured by itself. They also show that by changing the dimension of scoop tools, the energetic cost of tool manufacture and use could be reduced. The work should also be interesting for engineers to design adaptive machines.

Reactive searching and infotaxis in odor source localization

Male moths aiming to locate pheromone-releasing females rely on stimulus-adapted search maneuvers complicated by a discontinuous distribution of pheromone patches. They alternate sequences of upwind surge when perceiving the pheromone and cross- or downwind casting when the odor is lost. We compare four search strategies: three reactive versus one cognitive. The former consist of pre-programmed movement sequences triggered by pheromone detections while the latter uses Bayesian inference to build spatial probability maps. Based on the analysis of triphasic responses of antennal lobe neurons (On, inhibition, Off), we propose three reactive strategies. One combines upwind surge (representing the On response to a pheromone detection) and spiral casting, only. The other two additionally include crosswind (zigzag) casting representing the Off phase. As cognitive strategy we use the infotaxis algorithm which was developed for searching in a turbulent medium. Detection events in the electroantennogram of a moth attached to a robot indirectly control this cyborg, depending on the strategy in use. The recorded trajectories are analyzed with regard to success rates, efficiency, and other features. In addition, we qualitatively compare our robotic trajectories to behavioral search paths. Reactive searching is more efficient (yielding shorter trajectories) for higher pheromone doses whereas cognitive searching works better for lower doses. With respect to our experimental conditions (2 m from starting position to pheromone source), reactive searching with crosswind zigzag yields the shortest trajectories (for comparable success rates). Assuming that the neuronal Off response represents a short-term memory, zigzagging is an efficient movement to relocate a recently lost pheromone plume. Accordingly, such reactive strategies offer an interesting alternative to complex cognitive searching.

From microseconds to seconds and minutes-time computation in insect hearing

The computation of time in the auditory system of insects is of relevance at rather different time scales, covering a large range from microseconds to several minutes. At the one end of this range, only a few microseconds of interaural time differences are available for directional hearing, due to the small distance between the ears, usually considered too small to be processed reliably by simple nervous systems. Synapses of interneurons in the afferent auditory pathway are, however, very sensitive to a time difference of only 1–2 ms provided by the latency shift of afferent activity with changing sound direction. At a much larger time scale of several tens of milliseconds to seconds, time processing is important in the context species recognition, but also for those insects where males produce acoustic signals within choruses, and the temporal relationship between song elements strongly deviates from a random distribution. In these situations, some species exhibit a more or less strict phase relationship of song elements, based on phase response properties of their song oscillator. Here we review evidence on how this may influence mate choice decisions. In the same dimension of some tens of milliseconds we find species of katydids with a duetting communication scheme, where one sex only performs phonotaxis to the other sex if the acoustic response falls within a very short time window after its own call. Such time windows show some features unique to insects, and although its neuronal implementation is unknown so far, the similarity with time processing for target range detection in bat echolocation will be discussed. Finally, the time scale being processed must be extended into the range of many minutes, since some acoustic insects produce singing bouts lasting quite long, and female preferences may be based on total signaling time.

Control of breathing in invertebrate model systems

The invertebrates have adopted a myriad of breathing strategies to facilitate the extraction of adequate quantities of oxygen from their surrounding environments. Their respiratory structures can take a wide variety of forms, including integumentary surfaces, lungs, gills, tracheal systems, and even parallel combinations of these same gas exchange structures. Like their vertebrate counterparts, the invertebrates have evolved elaborate control strategies to regulate their breathing activity. Our goal in this article is to present the reader with a description of what is known regarding the control of breathing in some of the specific invertebrate species that have been used as model systems to study different mechanistic aspects of the control of breathing. We will examine how several species have been used to study fundamental principles of respiratory rhythm generation, central and peripheral chemosensory modulation of breathing, and plasticity in the control of breathing. We will also present the reader with an overview of some of the behavioral and neuronal adaptability that has been extensively documented in these animals. By presenting explicit invertebrate species as model organisms, we will illustrate mechanistic principles that form the neuronal foundation of respiratory control, and moreover appear likely to be conserved across not only invertebrates, but vertebrate species as well.

Miniature curved artificial compound eyes

In most animal species, vision is mediated by compound eyes, which offer lower resolution than vertebrate single-lens eyes, but significantly larger fields of view with negligible distortion and spherical aberration, as well as high temporal resolution in a tiny package. Compound eyes are ideally suited for fast panoramic motion perception. Engineering a miniature artificial compound eye is challenging because it requires accurate alignment of photoreceptive and optical components on a curved surface. Here, we describe a unique design method for biomimetic compound eyes featuring a panoramic, undistorted field of view in a very thin package. The design consists of three planar layers of separately produced arrays, namely, a microlens array, a neuromorphic photodetector array, and a flexible printed circuit board that are stacked, cut, and curved to produce a mechanically flexible imager. Following this method, we have prototyped and characterized an artificial compound eye bearing a hemispherical field of view with embedded and programmable low-power signal processing, high temporal resolution, and local adaptation to illumination. The prototyped artificial compound eye possesses several characteristics similar to the eye of the fruit fly Drosophila and other arthropod species. This design method opens up additional vistas for a broad range of applications in which wide field motion detection is at a premium, such as collision-free navigation of terrestrial and aerospace vehicles, and for the experimental testing of insect vision theories.

Instantaneous kinematic phase reflects neuromechanical response to lateral perturbations of running cockroaches

Instantaneous kinematic phase calculation allows the development of reduced-order oscillator models useful in generating hypotheses of neuromechanical control. When perturbed, changes in instantaneous kinematic phase and frequency of rhythmic movements can provide details of movement and evidence for neural feedback to a system-level neural oscillator with a time resolution not possible with traditional approaches. We elicited an escape response in cockroaches (Blaberus discoidalis) that ran onto a movable cart accelerated laterally with respect to the animals' motion causing a perturbation. The specific impulse imposed on animals (0.50 [Formula: see text] 0.04 m s[Formula: see text]; mean, SD) was nearly twice their forward speed (0.25 [Formula: see text] 0.06 m s[Formula: see text]. Instantaneous residual phase computed from kinematic phase remained constant for 110 ms after the onset of perturbation, but then decreased representing a decrease in stride frequency. Results from direct muscle action potential recordings supported kinematic phase results in showing that recovery begins with self-stabilizing mechanical feedback followed by neural feedback to an abstracted neural oscillator or central pattern generator. Trials fell into two classes of forward velocity changes, while exhibiting statistically indistinguishable frequency changes. Animals pulled away from the side with front and hind legs of the tripod in stance recovered heading within 300 ms, whereas animals that only had a middle leg of the tripod resisting the pull did not recover within this period. Animals with eight or more legs might be more robust to lateral perturbations than hexapods.

Odour-tracking capability of a silkmoth driving a mobile robot with turning bias and time delay

The reconstruction of mechanisms behind odour-tracking behaviours of animals is expected to enable the development of biomimetic robots capable of adaptive behaviour and effectively locating odour sources. However, because the behavioural mechanisms of animals have not been extensively studied, their behavioural capabilities cannot be verified. In this study, we have employed a mobile robot driven by a genuine insect (insect-controlled robot) to evaluate the behavioural capabilities of a biological system implemented in an artificial system. We used a male silkmoth as the 'driver' and investigated its behavioural capabilities to imposed perturbations during odour tracking. When we manipulated the robot to induce the turning bias, it located the odour source by compensatory turning of the on-board moth. Shifting of the orientation paths to the odour plume boundaries and decreased orientation ability caused by covering the visual field suggested that the moth steered with bilateral olfaction and vision to overcome the bias. An evaluation of the time delays of the moth and robot movements suggested an acceptable range for sensory-motor processing when the insect system was directly applied to artificial systems. Further evaluations of the insect-controlled robot will provide a 'blueprint' for biomimetic robots and strongly promote the field of biomimetics.

The brain's connective core and its role in animal cognition

This paper addresses the question of how the brain of an animal achieves cognitive integration--that is to say how it manages to bring its fullest resources to bear on an ongoing situation. To fully exploit its cognitive resources, whether inherited or acquired through experience, it must be possible for unanticipated coalitions of brain processes to form. This facilitates the novel recombination of the elements of an existing behavioural repertoire, and thereby enables innovation. But in a system comprising massively many anatomically distributed assemblies of neurons, it is far from clear how such open-ended coalition formation is possible. The present paper draws on contemporary findings in brain connectivity and neurodynamics, as well as the literature of artificial intelligence, to outline a possible answer in terms of the brain's most richly connected and topologically central structures, its so-called connective core.

Instability-based mechanism for body undulations in centipede locomotion

Centipedes have many body segments and legs and they generate body undulations during terrestrial locomotion. Centipede locomotion has the characteristic that body undulations are absent at low speeds but appear at faster speeds; furthermore, their amplitude and wavelength increase with increasing speed. There are conflicting reports regarding whether the muscles along the body axis resist or support these body undulations and the underlying mechanisms responsible for the body undulations remain largely unclear. In the present study, we investigated centipede locomotion dynamics using computer simulation with a body-mechanical model and experiment with a centipede-like robot and then conducted dynamic analysis with a simple model to clarify the mechanism. The results reveal that body undulations in these models occur due to an instability caused by a supercritical Hopf bifurcation. We subsequently compared these results with data obtained using actual centipedes. The model and actual centipedes exhibit similar dynamic properties, despite centipedes being complex, nonlinear dynamic systems. Based on our findings, we propose a possible passive mechanism for body undulations in centipedes, similar to a follower force or jackknife instability. We also discuss the roles of the muscles along the body axis in generating body undulations in terms of our physical model.

Robots in the service of animal behavior

As reading fiction can challenge us to better understand fact, using fake animals can sometimes serve as our best solution to understanding the behavior of real animals. The use of dummies, doppelgangers, fakes, and physical models have served to elicit behaviors in animal experiments since the early history of behavior studies, and, more recently, robotic animals have been employed by researchers to further coax behaviors from their study subjects. Here, we review the use of robots in the service of animal behavior, and describe in detail the production and use of one type of robot - "faux" frogs - to test female responses to multisensory courtship signals. The túngara frog (Physalaemus pustulosus) has been a study subject for investigating multimodal signaling, and we discuss the benefits and drawbacks of using the faux frogs we have designed, with the larger aim of inspiring other scientists to consider the appropriate application of physical models and robots in their research.

Robots in human biomechanics--a study on ankle push-off in walking

In biomechanics, explanatory template models are used to identify the basic mechanisms of human locomotion. However, model predictions often lack verification in a realistic environment. We present a method that uses template model mechanics as a blueprint for a bipedal robot and a corresponding computer simulation. The hypotheses derived from template model studies concerning the function of heel-off in walking are analysed and discrepancies between the template model and its real-world anchor are pointed out. Neither extending the ground clearance of the swinging leg nor an impact reduction at touch-down as an effect of heel lifting was supported by the experiments. To confirm the relevance of the experimental findings, a comparison of robot data to human walking data is discussed and we speculate on an alternative explanation of heel-off in human walking, i.e. that the push-off powers the following leg swing.

Behavioural system identification of visual flight speed control in Drosophila melanogaster

Behavioural control in many animals involves complex mechanisms with intricate sensory-motor feedback loops. Modelling allows functional aspects to be captured without relying on a description of the underlying complex, and often unknown, mechanisms. A wide range of engineering techniques are available for modelling, but their ability to describe time-continuous processes is rarely exploited to describe sensory-motor control mechanisms in biological systems. We performed a system identification of visual flight speed control in the fruitfly Drosophila, based on an extensive dataset of open-loop responses previously measured under free flight conditions. We identified a second-order under-damped control model with just six free parameters that well describes both the transient and steady-state characteristics of the open-loop data. We then used the identified control model to predict flight speed responses after a visual perturbation under closed-loop conditions and validated the model with behavioural measurements performed in free-flying flies under the same closed-loop conditions. Our system identification of the fruitfly's flight speed response uncovers the high-level control strategy of a fundamental flight control reflex without depending on assumptions about the underlying physiological mechanisms. The results are relevant for future investigations of the underlying neuromotor processing mechanisms, as well as for the design of biomimetic robots, such as micro-air vehicles.