Insect walking is based on a decentralized architecture revealing a simple and robust controller

NeuroMechFly, a neuromechanical model of adult Drosophila melanogaster

Animal behavior emerges from an interaction between neural network dynamics, musculoskeletal properties and the physical environment. Accessing and understanding the interplay between these elements requires the development of integrative and morphologically realistic neuromechanical simulations. Here we present NeuroMechFly, a data-driven model of the widely studied organism, Drosophila melanogaster. NeuroMechFly combines four independent computational modules: a physics-based simulation environment, a biomechanical exoskeleton, muscle models and neural network controllers. To enable use cases, we first define the minimum degrees of freedom of the leg from real three-dimensional kinematic measurements during walking and grooming. Then, we show how, by replaying these behaviors in the simulator, one can predict otherwise unmeasured torques and contact forces. Finally, we leverage NeuroMechFly's full neuromechanical capacity to discover neural networks and muscle parameters that drive locomotor gaits optimized for speed and stability. Thus, NeuroMechFly can increase our understanding of how behaviors emerge from interactions between complex neuromechanical systems and their physical surroundings.

Insect-Inspired Robots: Bridging Biological and Artificial Systems

This review article aims to address common research questions in hexapod robotics. How can we build intelligent autonomous hexapod robots that can exploit their biomechanics, morphology, and computational systems, to achieve autonomy, adaptability, and energy efficiency comparable to small living creatures, such as insects? Are insects good models for building such intelligent hexapod robots because they are the only animals with six legs? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying relevant and future directions in the field of hexapod robotics over the next decade. After an introduction in section (1), the sections will respectively cover the following three key areas: (2) biomechanics focused on the design of smart legs; (3) locomotion control; and (4) high-level cognition control. These interconnected and interdependent areas are all crucial to improving the level of performance of hexapod robotics in terms of energy efficiency, terrain adaptability, autonomy, and operational range. We will also discuss how the next generation of bioroboticists will be able to transfer knowledge from biology to robotics and vice versa.

Fate of Duplicated Neural Structures

Statistical physics determines the abundance of different arrangements of matter depending on cost-benefit balances. Its formalism and phenomenology percolate throughout biological processes and set limits to effective computation. Under specific conditions, self-replicating and computationally complex patterns become favored, yielding life, cognition, and Darwinian evolution. Neurons and neural circuits sit at a crossroads between statistical physics, computation, and (through their role in cognition) natural selection. Can we establish a statistical physics of neural circuits? Such theory would tell what kinds of brains to expect under set energetic, evolutionary, and computational conditions. With this big picture in mind, we focus on the fate of duplicated neural circuits. We look at examples from central nervous systems, with stress on computational thresholds that might prompt this redundancy. We also study a naive cost-benefit balance for duplicated circuits implementing complex phenotypes. From this, we derive phase diagrams and (phase-like) transitions between single and duplicated circuits, which constrain evolutionary paths to complex cognition. Back to the big picture, similar phase diagrams and transitions might constrain I/O and internal connectivity patterns of neural circuits at large. The formalism of statistical physics seems to be a natural framework for this worthy line of research.

Examples of Gibsonian Affordances in Legged Robotics Research Using an Empirical, Generative Framework

Evidence from empirical literature suggests that explainable complex behaviors can be built from structured compositions of explainable component behaviors with known properties. Such component behaviors can be built to directly perceive and exploit affordances. Using six examples of recent research in legged robot locomotion, we suggest that robots can be programmed to effectively exploit affordances without developing explicit internal models of them. We use a generative framework to discuss the examples, because it helps us to separate-and thus clarify the relationship between-description of affordance exploitation from description of the internal representations used by the robot in that exploitation. Under this framework, details of the architecture and environment are related to the emergent behavior of the system via a generative explanation. For example, the specific method of information processing a robot uses might be related to the affordance the robot is designed to exploit via a formal analysis of its control policy. By considering the mutuality of the agent-environment system during robot behavior design, roboticists can thus develop robust architectures which implicitly exploit affordances. The manner of this exploitation is made explicit by a well constructed generative explanation.

Information-based centralization of locomotion in animals and robots

The centralization of locomotor control from weak and local coupling to strong and global is hard to assess outside of particular modeling frameworks. We developed an empirical, model-free measure of centralization that compares information between control signals and both global and local states. A second measure, co-information, quantifies the net redundancy in global and local control. We first validate that our measures predict centralization in simulations of phase-coupled oscillators. We then test how centralization changes with speed in freely running cockroaches. Surprisingly, across all speeds centralization is constant and muscle activity is more informative of the global kinematic state (the averages of all legs) than the local state of that muscle's leg. Finally we use a legged robot to show that mechanical coupling alone can change the centralization of legged locomotion. The results of these systems span a design space of centralization and co-information for biological and robotic systems.

Static stability predicts the continuum of interleg coordination patterns in Drosophila

During walking, insects must coordinate the movements of their six legs for efficient locomotion. This interleg coordination is speed dependent: fast walking in insects is associated with tripod coordination patterns, whereas slow walking is associated with more variable, tetrapod-like patterns. To date, however, there has been no comprehensive explanation as to why these speed-dependent shifts in interleg coordination should occur in insects. Tripod coordination would be sufficient at low walking speeds. The fact that insects use a different interleg coordination pattern at lower speeds suggests that it is more optimal or advantageous at these speeds. Furthermore, previous studies focused on discrete tripod and tetrapod coordination patterns. Experimental data, however, suggest that changes observed in interleg coordination are part of a speed-dependent spectrum. Here, we explore these issues in relation to static stability as an important aspect for interleg coordination in Drosophila We created a model that uses basic experimentally measured parameters in fruit flies to find the interleg phase relationships that maximize stability for a given walking speed. The model predicted a continuum of interleg coordination patterns spanning the complete range of walking speeds as well as an anteriorly directed swing phase progression. Furthermore, for low walking speeds, the model predicted tetrapod-like patterns to be most stable, whereas at high walking speeds, tripod coordination emerged as most optimal. Finally, we validated the basic assumption of a continuum of interleg coordination patterns in a large set of experimental data from walking fruit flies and compared these data with the model-based predictions.

Simple analytical model reveals the functional role of embodied sensorimotor interaction in hexapod gaits

Insects have various gaits with specific characteristics and can change their gaits smoothly in accordance with their speed. These gaits emerge from the embodied sensorimotor interactions that occur between the insect’s neural control and body dynamic systems through sensory feedback. Sensory feedback plays a critical role in coordinated movements such as locomotion, particularly in stick insects. While many previously developed insect models can generate different insect gaits, the functional role of embodied sensorimotor interactions in the interlimb coordination of insects remains unclear because of their complexity. In this study, we propose a simple physical model that is amenable to mathematical analysis to explain the functional role of these interactions clearly. We focus on a foot contact sensory feedback called phase resetting, which regulates leg retraction timing based on touchdown information. First, we used a hexapod robot to determine whether the distributed decoupled oscillators used for legs with the sensory feedback generate insect-like gaits through embodied sensorimotor interactions. The robot generated two different gaits and one had similar characteristics to insect gaits. Next, we proposed the simple model as a minimal model that allowed us to analyze and explain the gait mechanism through the embodied sensorimotor interactions. The simple model consists of a rigid body with massless springs acting as legs, where the legs are controlled using oscillator phases with phase resetting, and the governed equations are reduced such that they can be explained using only the oscillator phases with some approximations. This simplicity leads to analytical solutions for the hexapod gaits via perturbation analysis, despite the complexity of the embodied sensorimotor interactions. This is the first study to provide an analytical model for insect gaits under these interaction conditions. Our results clarified how this specific foot contact sensory feedback contributes to generation of insect-like ipsilateral interlimb coordination during hexapod locomotion.

Speed dependent phase shifts and gait changes in cockroaches running on substrates of different slipperiness

Background

Many legged animals change gaits when increasing speed. In insects, only one gait change has been documented so far, from slow walking to fast running, which is characterised by an alternating tripod. Studies on some fast-running insects suggested a further gait change at higher running speeds. Apart from speed, insect gaits and leg co-ordination have been shown to be influenced by substrate properties, but the detailed effects of speed and substrate on gait changes are still unclear. Here we investigate high-speed locomotion and gait changes of the cockroach Nauphoeta cinerea, on two substrates of different slipperiness.

Results

Analyses of leg co-ordination and body oscillations for straight and steady escape runs revealed that at high speeds, blaberid cockroaches changed from an alternating tripod to a rather metachronal gait, which to our knowledge, has not been described before for terrestrial arthropods. Despite low duty factors, this new gait is characterised by low vertical amplitudes of the centre of mass (COM), low vertical accelerations and presumably reduced total vertical peak forces. However, lateral amplitudes and accelerations were higher in the faster gait with reduced leg synchronisation than in the tripod gait with distinct leg synchronisation.

Conclusions

Temporally distributed leg force application as resulting from metachronal leg coordination at high running speeds may be particularly useful in animals with limited capabilities for elastic energy storage within the legs, as energy efficiency can be increased without the need for elasticity in the legs. It may also facilitate locomotion on slippery surfaces, which usually reduce leg force transmission to the ground. Moreover, increased temporal overlap of the stance phases of the legs likely improves locomotion control, which might result in a higher dynamic stability.

Six-legged walking in insects: how CPGs, peripheral feedback, and descending signals generate coordinated and adaptive motor rhythms

Walking is a rhythmic locomotor behavior of legged animals, and its underlying mechanisms have been the subject of neurobiological research for more than 100 years. In this article, we review relevant historical aspects and contemporary studies in this field of research with a particular focus on the role of central pattern generating networks (CPGs) and their contribution to the generation of six-legged walking in insects. Aspects of importance are the generation of single-leg stepping, the generation of interleg coordination, and how descending signals influence walking. We first review how CPGs interact with sensory signals from the leg in the generation of leg stepping. Next, we summarize how these interactions are modified in the generation of motor flexibility for forward and backward walking, curve walking, and speed changes. We then review the present state of knowledge with regard to the role of CPGs in intersegmental coordination and how CPGs might be involved in mediating descending influences from the brain for the initiation, maintenance, modification, and cessation of the motor output for walking. Throughout, we aim to specifically address gaps in knowledge, and we describe potential future avenues and approaches, conceptual and methodological, with the latter emphasizing in particular options arising from the advent of neurogenetic approaches to this field of research and its combination with traditional approaches.

Climbing favours the tripod gait over alternative faster insect gaits

To escape danger or catch prey, running vertebrates rely on dynamic gaits with minimal ground contact. By contrast, most insects use a tripod gait that maintains at least three legs on the ground at any given time. One prevailing hypothesis for this difference in fast locomotor strategies is that tripod locomotion allows insects to rapidly navigate three-dimensional terrain. To test this, we computationally discovered fast locomotor gaits for a model based on Drosophila melanogaster. Indeed, the tripod gait emerges to the exclusion of many other possible gaits when optimizing fast upward climbing with leg adhesion. By contrast, novel two-legged bipod gaits are fastest on flat terrain without adhesion in the model and in a hexapod robot. Intriguingly, when adhesive leg structures in real Drosophila are covered, animals exhibit atypical bipod-like leg coordination. We propose that the requirement to climb vertical terrain may drive the prevalence of the tripod gait over faster alternative gaits with minimal ground contact.

Numerous selective forces shape animal locomotion patterns and as a result, different animals evolved to use different gaits. Here, Ramdya et al. use live and in silico Drosophila, as well as an insect-model robot, to gain insights into the conditions that promote the ubiquitous tripod gait observed in most insects.

Advantage of straight walk instability in turning maneuver of multilegged locomotion: a robotics approach

Multilegged locomotion improves the mobility of terrestrial animals and artifacts. Using many legs has advantages, such as the ability to avoid falling and to tolerate leg malfunction. However, many intrinsic degrees of freedom make the motion planning and control difficult, and many contact legs can impede the maneuverability during locomotion. The underlying mechanism for generating agile locomotion using many legs remains unclear from biological and engineering viewpoints. The present study used a centipede-like multilegged robot composed of six body segments and twelve legs. The body segments are passively connected through yaw joints with torsional springs. The dynamic stability of the robot walking in a straight line changes through a supercritical Hopf bifurcation due to the body axis flexibility. We focused on a quick turning task of the robot and quantitatively investigated the relationship between stability and maneuverability in multilegged locomotion by using a simple control strategy. Our experimental results show that the straight walk instability does help the turning maneuver. We discuss the importance and relevance of our findings for biological systems and propose a design principle for a simple control scheme to create maneuverable locomotion of multilegged robots.

How to find home backwards? Locomotion and inter-leg coordination during rearward walking of Cataglyphis fortis desert ants

For insects, flexibility in the performance of terrestrial locomotion is a vital part of facing the challenges of their often unpredictable environment. Arthropods such as scorpions and crustaceans can switch readily from forward to backward locomotion, but in insects this behaviour seems to be less common and, therefore, is only poorly understood. Here we present an example of spontaneous and persistent backward walking in Cataglyphis desert ants that allows us to investigate rearward locomotion within a natural context. When ants find a food item that is too large to be lifted up and to be carried in a normal forward-faced orientation, they will drag the load walking backwards to their home nest. A detailed examination of this behaviour reveals a surprising flexibility of the locomotor output. Compared with forward walks with regular tripod coordination, no main coordination pattern can be assigned to rearward walks. However, we often observed leg-pair-specific stepping patterns. The front legs frequently step with small stride lengths, while the middle and the hind legs are characterized by less numerous but larger strides. But still, these specializations show no rigidly fixed leg coupling, nor are they strictly embedded within a temporal context; therefore, they do not result in a repetitive coordination pattern. The individual legs act as separate units, most likely to better maintain stability during backward dragging.

Effects of head and tail as swinging appendages on the dynamic walking performance of a quadruped robot

We designed a quadruped robot with a one-degree-of-freedom (1-DOF)-pitch head, a 1-DOF-roll tail, and 14 active DOFs in total, which are controlled via a central pattern generator (CPG) based on a Hopf oscillator. Head and tail movements are coupled to the leg movements with fixed phase differences. Experiments show that tail swinging in roll can equilibrate feet–ground reaction forces (GRF), reducing yaw errors and enabling the robot to maintain its direction when trotting. Head swing in pitch has the potential to increase flight time and stride length of the swinging legs and increase the robot's forward velocity when running in bounds.

Controlling legs for locomotion-insights from robotics and neurobiology

Walking is the most common terrestrial form of locomotion in animals. Its great versatility and flexibility has led to many attempts at building walking machines with similar capabilities. The control of walking is an active research area both in neurobiology and robotics, with a large and growing body of work. This paper gives an overview of the current knowledge on the control of legged locomotion in animals and machines and attempts to give walking control researchers from biology and robotics an overview of the current knowledge in both fields. We try to summarize the knowledge on the neurobiological basis of walking control in animals, emphasizing common principles seen in different species. In a section on walking robots, we review common approaches to walking controller design with a slight emphasis on biped walking control. We show where parallels between robotic and neurobiological walking controllers exist and how robotics and biology may benefit from each other. Finally, we discuss where research in the two fields diverges and suggest ways to bridge these gaps.

Conserved patterns of axogenesis in the panarthropod brain

Neuropils in the cerebral midline of Panarthropoda exhibit a wide spectrum of neuroarchitectures--from rudimentary to highly elaborated--and which at first sight defy a unifying neuroarchitectural principle. Developmental approaches have shown that in model arthropods such as insects, conserved cellular and molecular mechanisms first establish a simple axon scaffold in the brain. However, to be adapted for adult life, this immature ground plan is transformed by a developmental process--known in the grasshopper as "fascicle switching"--in which subsets of neurons systematically redirect their growth cones at stereotypic locations across the brain midline. A topographic system of choice points along the transverse brain axis where axons decussate features in all panarthropods studied even though different modes of neurogenesis and varying degrees of neuropilar elaboration are involved. This suggests that the molecular mechanisms regulating choice point selection may be conserved. In combination with recent cladistic interpretations of arthropod phylogeny based on nuclear protein-coding sequences the data argue for this topographic decussation as having evolved early and being a conserved feature of the Panarthropoda. Differences in elaboration likely reflect both the extent to which neuropilar reorganization has progressed during development and the lifestyle of the individual organism.

Spinal circuits can accommodate interaction torques during multijoint limb movements

The dynamic interaction of limb segments during movements that involve multiple joints creates torques in one joint due to motion about another. Evidence shows that such interaction torques are taken into account during the planning or control of movement in humans. Two alternative hypotheses could explain the compensation of these dynamic torques. One involves the use of internal models to centrally compute predicted interaction torques and their explicit compensation through anticipatory adjustment of descending motor commands. The alternative, based on the equilibrium-point hypothesis, claims that descending signals can be simple and related to the desired movement kinematics only, while spinal feedback mechanisms are responsible for the appropriate creation and coordination of dynamic muscle forces. Partial supporting evidence exists in each case. However, until now no model has explicitly shown, in the case of the second hypothesis, whether peripheral feedback is really sufficient on its own for coordinating the motion of several joints while at the same time accommodating intersegmental interaction torques. Here we propose a minimal computational model to examine this question. Using a biomechanics simulation of a two-joint arm controlled by spinal neural circuitry, we show for the first time that it is indeed possible for the neuromusculoskeletal system to transform simple descending control signals into muscle activation patterns that accommodate interaction forces depending on their direction and magnitude. This is achieved without the aid of any central predictive signal. Even though the model makes various simplifications and abstractions compared to the complexities involved in the control of human arm movements, the finding lends plausibility to the hypothesis that some multijoint movements can in principle be controlled even in the absence of internal models of intersegmental dynamics or learned compensatory motor signals.

Kinematic responses to changes in walking orientation and gravitational load in Drosophila melanogaster

Walking behavior is context-dependent, resulting from the integration of internal and external influences by specialized motor and pre-motor centers. Neuronal programs must be sufficiently flexible to the locomotive challenges inherent in different environments. Although insect studies have contributed substantially to the identification of the components and rules that determine locomotion, we still lack an understanding of how multi-jointed walking insects respond to changes in walking orientation and direction and strength of the gravitational force. In order to answer these questions we measured with high temporal and spatial resolution the kinematic properties of untethered Drosophila during inverted and vertical walking. In addition, we also examined the kinematic responses to increases in gravitational load. We find that animals are capable of shifting their step, spatial and inter-leg parameters in order to cope with more challenging walking conditions. For example, flies walking in an inverted orientation decreased the duration of their swing phase leading to increased contact with the substrate and, as a result, greater stability. We also find that when flies carry additional weight, thereby increasing their gravitational load, some changes in step parameters vary over time, providing evidence for adaptation. However, above a threshold that is between 1 and 2 times their body weight flies display locomotion parameters that suggest they are no longer capable of walking in a coordinated manner. Finally, we find that functional chordotonal organs are required for flies to cope with additional weight, as animals deficient in these proprioceptors display increased sensitivity to load bearing as well as other locomotive defects.

A neuromechanical simulation of insect walking and transition to turning of the cockroach Blaberus discoidalis

A neuromechanical simulation of the cockroach Blaberus discoidalis was developed to explore changes in locomotion when the animal transitions from walking straight to turning. The simulation was based upon the biological data taken from three sources. Neural circuitry was adapted from the extensive literature primarily obtained from the studies of neural connections within thoracic ganglia of stick insect and adapted to cockroach. The 3D joint kinematic data on straight, forward walking for cockroach were taken from a paper that describes these movements in all joints simultaneously as the cockroach walked on an oiled-plate tether (Bender et al. in PloS one 5(10):1-15, 2010b). Joint kinematics for turning were only available for some leg joints (Mu and Ritzmann in J Comp Physiol A Neuroethol Sens Neural Behav Physiol 191(11):1037-54, 2005) and thus had to be obtained using the methods that were applied for straight walking by Bender et al. (PloS one 5(10):1-15, 2010b). Once walking, inside turning, and outside turning were characterized, phase and amplitude changes for each joint of each leg were quantified. Apparent reflex reversals and joint activity changes were used to modify sensory coupling pathways between the CPG at each joint of the simulation. Oiled-plate experiments in simulation produced tarsus trajectories in stance similar to those seen in the animal. Simulations including forces that would be experienced if the insect was walking freely (i.e., weight support and friction) again produced similar results. These data were not considered during the design of the simulation, suggesting that the simulation captures some key underlying the principles of walking, turning, and transitioning in the cockroach. In addition, since the nervous system was modeled with realistic neuron models, biologically plausible reflex reversals are simulated, motivating future neurobiological research.

Crawling at High Speeds: Steady Level Locomotion in the Spider Cupiennius salei-Global Kinematics and Implications for Centre of Mass Dynamics

Spiders are an old yet very successful predatory group of arthropods. Their locomotor system differs from those of most other arthropods by the lack of extensor muscles in two major leg joints. Though specific functional characteristics can be expected regarding the locomotion dynamics of spiders, this aspect of movement physiology has been only scarcely examined so far.

This study presents extensive analyses of a large dataset concerning global kinematics and the implications for dynamics of adult female specimens of the large Central American spider Cupiennius salei (Keyserling). The experiments covered the entire speed-range of straight runs at constant speeds. The analyses revealed specific characteristics of velocity dependent changes in the movements of the individual legs, as well as in the translational and rotational degrees of freedom of both the centre of mass and the body.

In contrast to many other fast moving arthropods, C. salei avoid vertical fluctuations of their centre of mass during fast locomotion. Accordingly, aerial phases were not observed here. This behaviour is most likely a consequence of optimising energy expenditure with regard to the specific requirements of spiders' leg anatomy. A strong synchronisation of two alternating sets of legs appears to play only a minor role in the locomotion of large spiders. Reduced frequency and low centre of mass amplitudes as well as low angular changes of the body axes, in turn, seems to be the result of relatively low leg coordination.

Instantaneous kinematic phase reflects neuromechanical response to lateral perturbations of running cockroaches

Instantaneous kinematic phase calculation allows the development of reduced-order oscillator models useful in generating hypotheses of neuromechanical control. When perturbed, changes in instantaneous kinematic phase and frequency of rhythmic movements can provide details of movement and evidence for neural feedback to a system-level neural oscillator with a time resolution not possible with traditional approaches. We elicited an escape response in cockroaches (Blaberus discoidalis) that ran onto a movable cart accelerated laterally with respect to the animals' motion causing a perturbation. The specific impulse imposed on animals (0.50 [Formula: see text] 0.04 m s[Formula: see text]; mean, SD) was nearly twice their forward speed (0.25 [Formula: see text] 0.06 m s[Formula: see text]. Instantaneous residual phase computed from kinematic phase remained constant for 110 ms after the onset of perturbation, but then decreased representing a decrease in stride frequency. Results from direct muscle action potential recordings supported kinematic phase results in showing that recovery begins with self-stabilizing mechanical feedback followed by neural feedback to an abstracted neural oscillator or central pattern generator. Trials fell into two classes of forward velocity changes, while exhibiting statistically indistinguishable frequency changes. Animals pulled away from the side with front and hind legs of the tripod in stance recovered heading within 300 ms, whereas animals that only had a middle leg of the tripod resisting the pull did not recover within this period. Animals with eight or more legs might be more robust to lateral perturbations than hexapods.

Neural control and adaptive neural forward models for insect-like, energy-efficient, and adaptable locomotion of walking machines

Living creatures, like walking animals, have found fascinating solutions for the problem of locomotion control. Their movements show the impression of elegance including versatile, energy-efficient, and adaptable locomotion. During the last few decades, roboticists have tried to imitate such natural properties with artificial legged locomotion systems by using different approaches including machine learning algorithms, classical engineering control techniques, and biologically-inspired control mechanisms. However, their levels of performance are still far from the natural ones. By contrast, animal locomotion mechanisms seem to largely depend not only on central mechanisms (central pattern generators, CPGs) and sensory feedback (afferent-based control) but also on internal forward models (efference copies). They are used to a different degree in different animals. Generally, CPGs organize basic rhythmic motions which are shaped by sensory feedback while internal models are used for sensory prediction and state estimations. According to this concept, we present here adaptive neural locomotion control consisting of a CPG mechanism with neuromodulation and local leg control mechanisms based on sensory feedback and adaptive neural forward models with efference copies. This neural closed-loop controller enables a walking machine to perform a multitude of different walking patterns including insect-like leg movements and gaits as well as energy-efficient locomotion. In addition, the forward models allow the machine to autonomously adapt its locomotion to deal with a change of terrain, losing of ground contact during stance phase, stepping on or hitting an obstacle during swing phase, leg damage, and even to promote cockroach-like climbing behavior. Thus, the results presented here show that the employed embodied neural closed-loop system can be a powerful way for developing robust and adaptable machines.

Quantification of gait parameters in freely walking wild type and sensory deprived Drosophila melanogaster

Coordinated walking in vertebrates and multi-legged invertebrates [corrected] such as Drosophila melanogaster requires a complex neural network coupled to sensory feedback. An understanding of this network will benefit from systems such as Drosophila that have the ability to genetically manipulate neural activities. However, the fly's small size makes it challenging to analyze walking in this system. In order to overcome this limitation, we developed an optical method coupled with high-speed imaging that allows the tracking and quantification of gait parameters in freely walking flies with high temporal and spatial resolution. Using this method, we present a comprehensive description of many locomotion parameters, such as gait, tarsal positioning, and intersegmental and left-right coordination for wild type fruit flies. Surprisingly, we find that inactivation of sensory neurons in the fly's legs, to block proprioceptive feedback, led to deficient step precision, but interleg coordination and the ability to execute a tripod gait were unaffected.DOI:http://dx.doi.org/10.7554/eLife.00231.001.

Quantification of gait parameters in freely walking wild type and sensory deprived Drosophila melanogaster

Coordinated walking in vertebrates and multi-legged invertebrates such as Drosophila melanogaster requires a complex neural network coupled to sensory feedback. An understanding of this network will benefit from systems such as Drosophila that have the ability to genetically manipulate neural activities. However, the fly's small size makes it challenging to analyze walking in this system. In order to overcome this limitation, we developed an optical method coupled with high-speed imaging that allows the tracking and quantification of gait parameters in freely walking flies with high temporal and spatial resolution. Using this method, we present a comprehensive description of many locomotion parameters, such as gait, tarsal positioning, and intersegmental and left-right coordination for wild type fruit flies. Surprisingly, we find that inactivation of sensory neurons in the fly's legs, to block proprioceptive feedback, led to deficient step precision, but interleg coordination and the ability to execute a tripod gait were unaffected.

DOI:http://dx.doi.org/10.7554/eLife.00231.001

Most animals need to be able to move to survive. Animals without limbs, such as snakes, move by generating by wave-like contractions along their bodies, whereas limbed animals, such as vertebrates and arthropods, walk by coordinating the movements of multi-jointed arms and legs. Locomotion in limbed animals involves bending each joint within each arm or leg in a coordinated manner, while also ensuring that the movements of all the limbs are coordinated with each other. In bipeds such as humans, for example, it is critical that one leg is in the stance phase when the other leg is in the swing phase. The rules that govern the coordination of limbs also depend on the gait, so the rules for walking are not the same as the rules for running.

The nervous systems of bipeds and other animals that walk solve these problems by using complex neural circuits that coordinate the firing of the relevant motor neurons. Two general mechanisms are used to coordinate the firing of motor neurons. In one mechanism, local interneurons within the central nervous system coordinate motor neuron activities: in vertebrates these interneurons are found in the spinal cord. A second mechanism, termed proprioception, relies on sensory neurons that report the load and joint angles from the arms and legs back to the central nervous system, and thereby influence the firing of the motor neurons. Remarkably, both of these mechanisms, and also the types of neurons that comprise motor neuron circuits, are conserved from arthropods to vertebrates.

Mendes et al. describe a new approach that can be used to analyze how the fruit fly, D. melanogaster, walks on surfaces. They use a combination of an optical touch sensor and high-speed video imaging to follow the body of the fly as it walks, and also to record when and where it places each of its six feet on the surface as it moves. Then, using a software package called FlyWalker, they are able to extract a large of number of parameters that can be used to describe locomotion in adult fruit flies with high temporal and spatial resolution. Many of these parameters have never been measured or studied before.

Mendes et al. show that fruit flies do not display the abrupt transitions in gait that are typically observed in vertebrates. However, they do modify their neural circuits depending on their speed: indeed it appears that flies use subtly different neural circuitry for walking at slow, medium and fast speeds. Moreover, when genetic methods are used to block sensory feedback, the fly is still able to walk, albeit with reduced coordination and precision. Further, the data suggest that proprioception is less important when flies walk faster compared to when they walk more slowly. The next step in this research will be to combine this new method for analyzing locomotion in flies with the wide range of genetic tools that are available for the study of Drosophila: this will allow researchers to explore in greater detail the components of the motor neuron circuitry and their role in coordinated walking.

DOI:http://dx.doi.org/10.7554/eLife.00231.002

Kinematic and behavioral evidence for a distinction between trotting and ambling gaits in the cockroach Blaberus discoidalis

Earlier observations had suggested that cockroaches might show multiple patterns of leg coordination, or gaits, but these were not followed by detailed behavioral or kinematic measurements that would allow a definite conclusion. We measured the walking speeds of cockroaches exploring a large arena and found that the body movements tended to cluster at one of two preferred speeds, either very slow (<10 cm s(-1)) or fairly fast (∼30 cm s(-1)). To highlight the neural control of walking leg movements, we experimentally reduced the mechanical coupling among the various legs by tethering the animals and allowing them to walk in place on a lightly oiled glass plate. Under these conditions, the rate of stepping was bimodal, clustering at fast and slow speeds. We next used high-speed videos to extract three-dimensional limb and joint kinematics for each segment of all six legs. The angular excursions and three-dimensional motions of the leg joints over the course of a stride were variable, but had different distributions in each gait. The change in gait occurs at a Froude number of ∼0.4, a speed scale at which a wide variety of animals show a transition between walking and trotting. We conclude that cockroaches do have multiple gaits, with corresponding implications for the collection and interpretation of data on the neural control of locomotion.

From neuron to behavior: dynamic equation-based prediction of biological processes in motor control

This article presents the use of continuous dynamic models in the form of differential equations to describe and predict temporal changes in biological processes and discusses several of its important advantages over discontinuous bistable ones, exemplified on the stick insect walking system. In this system, coordinated locomotion is produced by concerted joint dynamics and interactions on different dynamical scales, which is therefore difficult to understand. Modeling using differential equations possesses, in general, the potential for the inclusion of biological detail, the suitability for simulation, and most importantly, parameter manipulation to make predictions about the system behavior. We will show in this review article how, in case of the stick insect walking system, continuous dynamical system models can help to understand coordinated locomotion.

Shifts in a single muscle's control potential of body dynamics are determined by mechanical feedback

Muscles are multi-functional structures that interface neural and mechanical systems. Muscle work depends on a large multi-dimensional space of stimulus (neural) and strain (mechanical) parameters. In our companion paper, we rewrote activation to individual muscles in intact, behaving cockroaches (Blaberus discoidalis L.), revealing a specific muscle's potential to control body dynamics in different behaviours. Here, we use those results to provide the biologically relevant parameters for in situ work measurements. We test four hypotheses about how muscle function changes to provide mechanisms for the observed control responses. Under isometric conditions, a graded increase in muscle stress underlies its linear actuation during standing behaviours. Despite typically absorbing energy, this muscle can recruit two separate periods of positive work when controlling running. This functional change arises from mechanical feedback filtering a linear increase in neural activation into nonlinear work output. Changing activation phase again led to positive work recruitment, but at different times, consistent with the muscle's ability to also produce a turn. Changes in muscle work required considering the natural sequence of strides and separating swing and stance contributions of work. Both in vivo control potentials and in situ work loops were necessary to discover the neuromechanical coupling enabling control.

A single muscle's multifunctional control potential of body dynamics for postural control and running

A neuromechanical approach to control requires understanding how mechanics alters the potential of neural feedback to control body dynamics. Here, we rewrite activation of individual motor units of a behaving animal to mimic the effects of neural feedback without concomitant changes in other muscles. We target a putative control muscle in the cockroach, Blaberus discoidalis (L.), and simultaneously capture limb and body dynamics through high-speed videography and a micro-accelerometer backpack. We test four neuromechanical control hypotheses. We supported the hypothesis that mechanics linearly translates neural feedback into accelerations and rotations during static postural control. However, during running, the same neural feedback produced a nonlinear acceleration control potential restricted to the vertical plane. Using this, we reject the hypothesis from previous work that this muscle acts primarily to absorb energy from the body. The conversion of the control potential is paralleled by nonlinear changes in limb kinematics, supporting the hypothesis that significant mechanical feedback filters the graded neural feedback for running control. Finally, we insert the same neural feedback signal but at different phases in the dynamics. In this context, mechanical feedback enables turning by changing the timing and direction of the accelerations produced by the graded neural feedback.

Deriving neural network controllers from neuro-biological data: implementation of a single-leg stick insect controller

This article presents modular recurrent neural network controllers for single legs of a biomimetic six-legged robot equipped with standard DC motors. Following arguments of Ekeberg et al. (Arthropod Struct Dev 33:287-300, 2004), completely decentralized and sensori-driven neuro-controllers were derived from neuro-biological data of stick-insects. Parameters of the controllers were either hand-tuned or optimized by an evolutionary algorithm. Employing identical controller structures, qualitatively similar behaviors were achieved for robot and for stick insect simulations. For a wide range of perturbing conditions, as for instance changing ground height or up- and downhill walking, swing as well as stance control were shown to be robust. Behavioral adaptations, like varying locomotion speeds, could be achieved by changes in neural parameters as well as by a mechanical coupling to the environment. To a large extent the simulated walking behavior matched biological data. For example, this was the case for body support force profiles and swing trajectories under varying ground heights. The results suggest that the single-leg controllers are suitable as modules for hexapod controllers, and they might therefore bridge morphological- and behavioral-based approaches to stick insect locomotion control.

Sensory Signals of Unloading in One Leg Follow Stance Onset in Another Leg: Transfer of Load and Emergent Coordination in Cockroach Walking

The transfer of load from one leg to another is an essential component in walking, but sense organs that signal this process have rarely been identified. We used high-speed digital imaging and neurophysiological recordings to characterize activities of tibial campaniform sensilla, receptors that detect forces via cuticular strains, in the middle legs of cockroaches during walking. Previous studies demonstrated that the distal tibial sensilla discharge when body load is suddenly decreased in freely standing animals. Sensory recordings during walking showed that distal receptors in the middle leg fired an intense burst near the end of the stance phase. We tested the hypothesis that initiation of distal firing resulted from the action of other legs entering stance. Analysis of leg movements in slow walking showed that sensory bursts in the middle leg closely followed stance onset of the ipsilateral hind leg while the ipsilateral front leg entered stance earlier in phase. Similar phases of leg movement were found in slow walking in experiments in which animals had no implanted recording wires. Those studies also demonstrated that the opposite middle leg entered stance earlier in phase. Measurements of leg positions in walking showed that the hind leg tarsus was placed closest to the middle leg, in keeping with a “targeting” strategy. Triggering of distal bursts in the middle leg by mechanical action of the hind leg could facilitate the onset of swing in the middle leg through local reflex effects and contribute to emergent coordination of leg movements in metachronal gaits.

Neuromechanical response of musculo-skeletal structures in cockroaches during rapid running on rough terrain

A musculo-skeletal structure can stabilize rapid locomotion using neural and/or mechanical feedback. Neural feedback results in an altered feedforward activation pattern, whereas mechanical feedback using visco-elastic structures does not require a change in the neural motor code. We selected musculo-skeletal structures in the cockroach (Blaberus discoidalis)because their single motor neuron innervation allows the simplest possible characterization of activation. We ran cockroaches over a track with randomized blocks of heights up to three times the animal's `hip' (1.5 cm),while recording muscle action potentials (MAPs) from a set of putative control musculo-skeletal structures (femoral extensors 178 and 179). Animals experienced significant perturbations in body pitch, roll and yaw, but reduced speed by less than 20%. Surprisingly, we discovered no significant difference in the distribution of the number of MAPs, the interspike interval, burst phase or interburst period between flat and rough terrain trials. During a few very large perturbations or when a single leg failed to make contact throughout stance, neural feedback was detectable as a phase shift of the central rhythm and alteration of MAP number. System level responses of appendages were consistent with a dominant role of mechanical feedback. Duty factors and gait phases did not change for cockroaches running on flat versus rough terrain. Cockroaches did not use a follow-the-leader gait requiring compensatory corrections on a step-by-step basis. Arthropods appear to simplify control on rough terrain by rapid running that uses kinetic energy to bridge gaps between footholds and distributed mechanical feedback to stabilize the body.

Walking: technology and biology

If all the signs are to be believed, then the twenty-first century will technologically be characterized by machine walking and its relevant products, which possess all chances to become real bulk goods in the course of the next decades. With several university institutes and with Honda and Sony from the industrial side, Japan is today and without any doubt the leading nation in research and development of walking machines. The US and Europe follow at some distance. Walking machines will influence all areas of daily and industrial life and, with the fast evolution of artificial intelligence, will become a real partner of human beings. All relevant technologies are highly interdisciplinary, they will push the future technologies of all technical fields. The special issue on this topic gives a selection of walking machine research and development including some aspects from biology.