A load-based mechanism for inter-leg coordination in insects

Sensorimotor delays constrain robust locomotion in a 3D kinematic model of fly walking

Walking animals must maintain stability in the presence of external perturbations, despite significant temporal delays in neural signaling and muscle actuation. Here, we develop a 3D kinematic model with a layered control architecture to investigate how sensorimotor delays constrain robustness of walking behavior in the fruit fly, Drosophila. Motivated by the anatomical architecture of insect locomotor control circuits, our model consists of three component layers: a neural network that generates realistic 3D joint kinematics for each leg, an optimal controller that executes the joint kinematics while accounting for delays, and an inter-leg coordinator. The model generates realistic simulated walking that matches real fly walking kinematics and sustains walking even when subjected to unexpected perturbations, generalizing beyond its training data. However, we found that the model's robustness to perturbations deteriorates when sensorimotor delay parameters exceed the physiological range. These results suggest that fly sensorimotor control circuits operate close to the temporal limit at which they can detect and respond to external perturbations. More broadly, we show how a modular, layered model architecture can be used to investigate physiological constraints on animal behavior.

Mechanosensory encoding of forces in walking uphill and downhill: force feedback can stabilize leg movements in stick insects

Force feedback could be valuable in adapting walking to diverse terrains, but the effects of changes in substrate inclination on discharges of sensory receptors that encode forces have rarely been examined. In insects, force feedback is provided by campaniform sensilla, mechanoreceptors that monitor forces as cuticular strains. We neurographically recorded responses of stick insect tibial campaniform sensilla to "naturalistic" forces (joint torques) that occur at the hind leg femur-tibia (FT) joint in uphill, downhill, and level walking. The FT joint torques, obtained in a previous study that used inverse dynamics to analyze data from freely moving stick insects, are quite variable during level walking (including changes in sign) but are larger in magnitude and more consistent when traversing sloped surfaces. Similar to vertebrates, insects used predominantly extension torque in propulsion on uphill slopes and flexion torques to brake forward motion when going downhill. Sensory discharges to joint torques reflected the torque direction but, unexpectedly, often occurred as multiple bursts that encoded the rate of change of positive forces (dF/dt) even when force levels were high. All discharges also showed hysteresis (history dependence), as firing substantially decreased or ceased during transient force decrements. These findings have been tested in simulation in a mathematical model of the sensilla (Szczecinski NS, Dallmann CJ, Quinn RD, Zill SN. Bioinspir Biomim 16: 065001, 2021) that accurately reproduced the biological data. Our results suggest the hypothesis that sensory feedback from the femoro-tibial joint indicating force dynamics (dF/dt) can be used to counter the instability in traversing sloped surfaces in animals and, potentially, in walking machines.NEW & NOTEWORTHY Discharges of sensory receptors (campaniform sensilla) in the hind legs of stick insects can differentially signal forces that occur in walking uphill versus walking downhill. Unexpectedly, sensory firing most closely reflects the rate of change of force (dF/dt) even when the force levels are high. These signals have been replicated in a mathematical model of the receptors and could be used to stabilize leg movements both in the animal and in a walking robot.

A hierarchical model for external electrical control of an insect, accounting for inter-individual variation of muscle force properties

Cyborg control of insect movement is promising for developing miniature, high-mobility, and efficient biohybrid robots. However, considering the inter-individual variation of the insect neuromuscular apparatus and its neural control is challenging. We propose a hierarchical model including inter-individual variation of muscle properties of three leg muscles involved in propulsion (retractor coxae), joint stiffness (pro- and retractor coxae), and stance-swing transition (protractor coxae and levator trochanteris) in the stick insect Carausius morosus. To estimate mechanical effects induced by external muscle stimulation, the model is based on the systematic evaluation of joint torques as functions of electrical stimulation parameters. A nearly linear relationship between the stimulus burst duration and generated torque was observed. This stimulus-torque characteristic holds for burst durations of up to 500ms, corresponding to the stance and swing phase durations of medium to fast walking stick insects. Hierarchical Bayesian modeling revealed that linearity of the stimulus-torque characteristic was invariant, with individually varying slopes. Individual prediction of joint torques provides significant benefits for precise cyborg control.

Mechanosensory Control of Locomotion in Animals and Robots: Moving Forward

While animals swim, crawl, walk, and fly with apparent ease, building robots capable of robust locomotion remains a significant challenge. In this review, we draw attention to mechanosensation-the sensing of mechanical forces generated within and outside the body-as a key sense that enables robust locomotion in animals. We discuss differences between mechanosensation in animals and current robots with respect to (1) the encoding properties and distribution of mechanosensors and (2) the integration and regulation of mechanosensory feedback. We argue that robotics would benefit greatly from a detailed understanding of these aspects in animals. To that end, we highlight promising experimental and engineering approaches to study mechanosensation, emphasizing the mutual benefits for biologists and engineers that emerge from moving forward together.

Flexible locomotion in complex environments: the influence of species, speed and sensory feedback on panarthropod inter-leg coordination

Panarthropods (a clade containing arthropods, tardigrades and onychophorans) can adeptly move across a wide range of challenging terrains and their ability to do so given their relatively simple nervous systems makes them compelling study organisms. Studies of forward walking on flat terrain excitingly point to key features in inter-leg coordination patterns that seem to be 'universally' shared across panarthropods. However, when movement through more complex, naturalistic terrain is considered, variability in coordination patterns - from the intra-individual to inter-species level - becomes more apparent. This variability is likely to be due to the interplay between sensory feedback and local pattern-generating activity, and depends crucially on species, walking speed and behavioral goal. Here, I gather data from the literature of panarthropod walking coordination on both flat ground and across more complex terrain. This Review aims to emphasize the value of: (1) designing experiments with an eye towards studying organisms in natural environments; (2) thoughtfully integrating results from various experimental techniques, such as neurophysiological and biomechanical studies; and (3) ensuring that data is collected and made available from a wider range of species for future comparative analyses.

Robust and reusable self-organized locomotion of legged robots under adaptive physical and neural communications

Introduction

Animals such as cattle can achieve versatile and elegant behaviors through automatic sensorimotor coordination. Their self-organized movements convey an impression of adaptability, robustness, and motor memory. However, the adaptive mechanisms underlying such natural abilities of these animals have not been completely realized in artificial legged systems.

Methods

Hence, we propose adaptive neural control that can mimic these abilities through adaptive physical and neural communications. The control algorithm consists of distributed local central pattern generator (CPG)-based neural circuits for generating basic leg movements, an adaptive sensory feedback mechanism for generating self-organized phase relationships among the local CPG circuits, and an adaptive neural coupling mechanism for transferring and storing the formed phase relationships (a gait pattern) into the neural structure. The adaptive neural control was evaluated in experiments using a quadruped robot.

Results

The adaptive neural control enabled the robot to 1) rapidly and automatically form its gait (i.e., self-organized locomotion) within a few seconds, 2) memorize the gait for later recovery, and 3) robustly walk, even when a sensory feedback malfunction occurs. It also enabled maneuverability, with the robot being able to change its walking speed and direction. Moreover, implementing adaptive physical and neural communications provided an opportunity for understanding the mechanism of motor memory formation.

Discussion

Overall, this study demonstrates that the integration of the two forms of communications through adaptive neural control is a powerful way to achieve robust and reusable self-organized locomotion in legged robots.

Adaptive load feedback robustly signals force dynamics in robotic model of Carausius morosus stepping

Animals utilize a number of neuronal systems to produce locomotion. One type of sensory organ that contributes in insects is the campaniform sensillum (CS) that measures the load on their legs. Groups of the receptors are found on high stress regions of the leg exoskeleton and they have significant effects in adapting walking behavior. Recording from these sensors in freely moving animals is limited by technical constraints. To better understand the load feedback signaled by CS to the nervous system, we have constructed a dynamically scaled robotic model of the Carausius morosus stick insect middle leg. The leg steps on a treadmill and supports weight during stance to simulate body weight. Strain gauges were mounted in the same positions and orientations as four key CS groups (Groups 3, 4, 6B, and 6A). Continuous data from the strain gauges were processed through a previously published dynamic computational model of CS discharge. Our experiments suggest that under different stepping conditions (e.g., changing "body" weight, phasic load stimuli, slipping foot), the CS sensory discharge robustly signals increases in force, such as at the beginning of stance, and decreases in force, such as at the end of stance or when the foot slips. Such signals would be crucial for an insect or robot to maintain intra- and inter-leg coordination while walking over extreme terrain.

Sensory signals of unloading in insects are tuned to distinguish leg slipping from load variations in gait: experimental and modeling studies

In control of walking, sensory signals of decreasing forces are used to regulate leg lifting in initiation of swing and to detect loss of substrate grip (leg slipping). We used extracellular recordings in two insect species to characterize and model responses to force decrements of tibial campaniform sensilla, receptors that detect forces as cuticular strains. Discharges to decreasing forces did not occur upon direct stimulation of the sites of mechanotransduction (cuticular caps) but were readily elicited by bending forces applied to the leg. Responses to bending force decreases were phasic but had rate sensitivities similar to discharges elicited by force increases in the opposite direction. Application of stimuli of equivalent amplitude at different offset levels showed that discharges were strongly dependent upon the tonic level of loading: firing was maximal to complete unloading of the leg but substantially decreased or eliminated by sustained loads. The contribution of cuticle properties to sensory responses was also evaluated: discharges to force increases showed decreased adaptation when mechanical stress relaxation was minimized; firing to force decreases could be related to viscoelastic “creep” in the cuticle. Discharges to force decrements apparently occur due to cuticle viscoelasticity that generates transient strains similar to bending in the opposite direction. Tuning of sensory responses through cuticular and membrane properties effectively distinguishes loss of substrate grip/complete unloading from force variations due to gait in walking. We have successfully reproduced these properties in a mathematical model of the receptors. Sensors with similar tuning could fulfil these functions in legs of walking machines.

NEW & NOTEWORTHY Decreases in loading of legs are important in the regulation of posture and walking in both vertebrates and invertebrates. Recordings of activities of tibial campaniform sensilla, which encode forces in insects, showed that their responses are specifically tuned to detect force decreases at the end of the stance phase of walking or when a leg slips. These results have been reproduced in a mathematical model of the receptors and also have potential applications in robotics.

Locomotor resilience through load-dependent modulation of muscle co-contraction

Terrestrial locomotor behavior in variable environments requires resilience to sudden changes in substrate properties. For example, walking animals can adjust to substantial changes in slope and corresponding changes in load distribution among legs. In insects, slope-dependent adjustments have mainly been examined under steady-state conditions, whereas the transition dynamics have been largely neglected. In a previous study, we showed that steady-state adjustments of stick insects to ±45° slopes involve substantial changes in joint torques and muscle activity with only minor changes in leg kinematics. Here, we take a close look at the time course of these adjustments as stick insects compensate for various kinds of disturbances to load distribution. In particular, we test whether the transition from one steady state to another involves distinct transition steps or follows a graded process. To resolve this, we combined simultaneous recordings of whole-body kinematics and hind leg muscle activity to elucidate how freely walking Carausius morosus negotiated a step-change in substrate slope. Step-by-step adjustments reveal that muscle activity changed in a graded manner as a function of body pitch relative to gravity. We further show analogous transient adjustment of muscle activity in response to destabilizing lift-off events of neighboring legs and the disappearance of antagonist co-activation during crawling episodes. Given these three examples of load-dependent regulation of antagonist muscle co-contraction, we conclude that stick insects respond to both transient and sustained changes in load distribution by regulating joint stiffness rather than through distinct transition steps.

Insect-Inspired Robots: Bridging Biological and Artificial Systems

This review article aims to address common research questions in hexapod robotics. How can we build intelligent autonomous hexapod robots that can exploit their biomechanics, morphology, and computational systems, to achieve autonomy, adaptability, and energy efficiency comparable to small living creatures, such as insects? Are insects good models for building such intelligent hexapod robots because they are the only animals with six legs? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying relevant and future directions in the field of hexapod robotics over the next decade. After an introduction in section (1), the sections will respectively cover the following three key areas: (2) biomechanics focused on the design of smart legs; (3) locomotion control; and (4) high-level cognition control. These interconnected and interdependent areas are all crucial to improving the level of performance of hexapod robotics in terms of energy efficiency, terrain adaptability, autonomy, and operational range. We will also discuss how the next generation of bioroboticists will be able to transfer knowledge from biology to robotics and vice versa.

A computational model of insect campaniform sensilla predicts encoding of forces during walking

Control of forces is essential in both animals and walking machines. Insects measure forces as strains in their exoskeletons via campaniform sensilla (CS). Deformations of cuticular caps embedded in the exoskeleton excite afferents that project to the central nervous system. CS afferent firing frequency (i.e. 'discharge') is highly dynamic, correlating with the rate of change of the force. Discharges adapt over time to tonic forces and exhibit hysteresis during cyclic loading.In this study we characterized a phenomenological model that predicts CS discharge, in which discharge is proportional to the instantaneous stimulus force relative to an adaptive variable. In contrast to previous studies of sensory adaptation, our model (1) is nonlinear and (2) reproduces the characteristic power-law adaptation with first order dynamics only (i.e. no 'fractional derivatives' are required to explain dynamics). We solve the response of the system analytically in multiple cases and use these solutions to derive the dynamics of the adaptive variable. We show that the model can reproduce responses of insect CS to many different force stimuli after being tuned to reproduce only one response, suggesting that the model captures the underlying dynamics of the system. We show that adaptation to tonic forces, rate-sensitivity, and hysteresis are different manifestations of the same underlying mechanism: the adaptive variable. We tune the model to replicate the dynamics of three different CS groups from two insects (cockroach and stick insect), demonstrating that it is generalizable. We also invert the model to estimate the stimulus force given the discharge recording from the animal. We discuss the adaptive neural and mechanical processes that the model may mimic and the model's use for understanding the role of load feedback in insect motor control. A preliminary model and results were previously published in the proceedings of the Conference on Biohybrid and Biomimetic Systems.

Universal Features in Panarthropod Inter-Limb Coordination during Forward Walking

Terrestrial animals must often negotiate heterogeneous, varying environments. Accordingly, their locomotive strategies must adapt to a wide range of terrain, as well as to a range of speeds to accomplish different behavioral goals. Studies in Drosophila have found that inter-leg coordination patterns (ICPs) vary smoothly with walking speed, rather than switching between distinct gaits as in vertebrates (e.g., horses transitioning between trotting and galloping). Such a continuum of stepping patterns implies that separate neural controllers are not necessary for each observed ICP. Furthermore, the spectrum of Drosophila stepping patterns includes all canonical coordination patterns observed during forward walking in insects. This raises the exciting possibility that the controller in Drosophila is common to all insects, and perhaps more generally to panarthropod walkers. Here, we survey and collate data on leg kinematics and inter-leg coordination relationships during forward walking in a range of arthropod species, as well as include data from a recent behavioral investigation into the tardigrade Hypsibius exemplaris. Using this comparative dataset, we point to several functional and morphological features that are shared among panarthropods. The goal of the framework presented in this review is to emphasize the importance of comparative functional and morphological analyses in understanding the origins and diversification of walking in Panarthropoda. Introduction.

From Motor-Output to Connectivity: An In-Depth Study of in-vitro Rhythmic Patterns in the Cockroach Periplaneta americana

The cockroach is an established model in the study of locomotion control. While previous work has offered important insights into the interplay among brain commands, thoracic central pattern generators, and the sensory feedback that shapes their motor output, there remains a need for a detailed description of the central pattern generators' motor output and their underlying connectivity scheme. To this end, we monitored pilocarpine-induced activity of levator and depressor motoneurons in two types of novel in-vitro cockroach preparations: isolated thoracic ganglia and a whole-chain preparation comprising the thoracic ganglia and the subesophageal ganglion. Our data analyses focused on the motoneuron firing patterns and the coordination among motoneuron types in the network. The burstiness and rhythmicity of the motoneurons were monitored, and phase relations, coherence, coupling strength, and frequency-dependent variability were analyzed. These parameters were all measured and compared among network units both within each preparation and among the preparations. Here, we report differences among the isolated ganglia, including asymmetries in phase and coupling strength, which indicate that they are wired to serve different functions. We also describe the intrinsic default gait and a frequency-dependent coordination. The depressor motoneurons showed mostly similar characteristics throughout the network regardless of interganglia connectivity; whereas the characteristics of the levator motoneurons activity were mostly ganglion-dependent, and influenced by the presence of interganglia connectivity. Asymmetries were also found between the anterior and posterior homolog parts of the thoracic network, as well as between ascending and descending connections. Our analyses further discover a frequency-dependent inversion of the interganglia coordination from alternations between ipsilateral homolog oscillators to simultaneous activity. We present a detailed scheme of the network couplings, formulate coupling rules, and review a previously suggested model of connectivity in light of our new findings. Our data support the notion that the inter-hemiganglia coordination derives from the levator networks and their coupling with local depressor interneurons. Our findings also support a dominant role of the metathoracic ganglion and its ascending output in governing the anterior ganglia motor output during locomotion in the behaving animal.

Effect of Thoracic Connective Lesion on Inter-Leg Coordination in Freely Walking Stick Insects

Multi-legged locomotion requires appropriate coordination of all legs with coincident ground contact. Whereas behaviourally derived coordination rules can adequately describe many aspects of inter-leg coordination, the neural mechanisms underlying these rules are still not entirely clear. The fact that inter-leg coordination is strongly affected by cut thoracic connectives in tethered walking insects, shows that neural information exchange among legs is important. As yet, recent studies have shown that load transfer among legs can contribute to inter-leg coordination through mechanical coupling alone, i.e., without neural information exchange among legs. Since naturalistic load transfer among legs works only in freely walking animals but not in tethered animals, we tested the hypothesis that connective lesions have less strong effects if mechanical coupling through load transfer among legs is possible. To do so, we recorded protraction/retraction angles of all legs in unrestrained walking stick insects that either had one thoracic connective cut or had undergone a corresponding sham operation. In lesioned animals, either a pro-to-mesothorax or a meso-to-metathorax connective was cut. Overall, our results on temporal coordination were similar to published reports on tethered walking animals, in that the phase relationship of the legs immediately adjacent to the lesion was much less precise, although the effect on mean phase was relatively weak or absent. Lesioned animals could walk at the same speed as the control group, though with a significant sideward bias toward the intact side. Detailed comparison of lesion effects in free-walking and supported animals reveal that the strongest differences concern the spatial coordination among legs. In free walking, lesioned animals, touch-down and lift-off positions shifted significantly in almost all legs, including legs of the intact body side. We conclude that insects with disrupted neural information transfer through one connective adjust to this disruption differently if they experience naturalistic load distribution. While mechanical load transfer cannot compensate for lesion-induced effects on temporal inter-leg coordination, several compensatory changes in spatial coordination occur only if animals carry their own weight.

Reconstruction of motor control circuits in adult Drosophila using automated transmission electron microscopy

To investigate circuit mechanisms underlying locomotor behavior, we used serial-section electron microscopy (EM) to acquire a synapse-resolution dataset containing the ventral nerve cord (VNC) of an adult female Drosophila melanogaster. To generate this dataset, we developed GridTape, a technology that combines automated serial-section collection with automated high-throughput transmission EM. Using this dataset, we studied neuronal networks that control leg and wing movements by reconstructing all 507 motor neurons that control the limbs. We show that a specific class of leg sensory neurons synapses directly onto motor neurons with the largest-caliber axons on both sides of the body, representing a unique pathway for fast limb control. We provide open access to the dataset and reconstructions registered to a standard atlas to permit matching of cells between EM and light microscopy data. We also provide GridTape instrumentation designs and software to make large-scale EM more accessible and affordable to the scientific community.

Leg amputation modifies coordinated activation of the middle leg muscles in the cricket Gryllus bimaculatus

Insects alter their walking pattern in order to respond to demands of an ever-changing environment, such as varying ground surface textures. They also exhibit resilient and flexible ability to retain the capacity to walk even after substantial changes in their body properties, e.g. leg amputation. While the motor control paradigm governing the inter-leg coordination in such adaptive walking has been extensively described in past studies, the mechanism remains unknown. Here, we examined this question by using the cricket (Gryllus bimaculatus), which shows a tetrapod/tripod gait on a flat surfaces, like many other insects. We performed leg amputation experiments to investigate modifications of leg movements and coordination of muscle activities. We simultaneously recorded (1) the leg movements, locomotion velocity, and body rotation and (2) the leg movements and leg muscles activities before and after leg amputation. Crickets displayed adaptive coordination of leg movement patterns in response to amputations. The activation timings of levator muscles in both middle legs tended to synchronize in phase when both legs were amputated at the coxatrochanteral joint. This supports the hypothesis that an intrinsic contralateral connection within the mesothoracic ganglion exists, and that mechanosensory feedback from the legs override this connection, resulting in the anti-phase movement of a normal gait.

Distributed control of motor circuits for backward walking in Drosophila

How do descending inputs from the brain control leg motor circuits to change how an animal walks? Conceptually, descending neurons are thought to function either as command-type neurons, in which a single type of descending neuron exerts a high-level control to elicit a coordinated change in motor output, or through a population coding mechanism, whereby a group of neurons, each with local effects, act in combination to elicit a global motor response. The Drosophila Moonwalker Descending Neurons (MDNs), which alter leg motor circuit dynamics so that the fly walks backwards, exemplify the command-type mechanism. Here, we identify several dozen MDN target neurons within the leg motor circuits, and show that two of them mediate distinct and highly-specific changes in leg muscle activity during backward walking: LBL40 neurons provide the hindleg power stroke during stance phase; LUL130 neurons lift the legs at the end of stance to initiate swing. Through these two effector neurons, MDN directly controls both the stance and swing phases of the backward stepping cycle. These findings suggest that command-type descending neurons can also operate through the distributed control of local motor circuits.

Neurodynamic modeling of the fruit fly Drosophila melanogaster

This manuscript describes neuromechanical modeling of the fruit fly Drosophila melanogaster in the form of a hexapod robot, Drosophibot, and an accompanying dynamic simulation. Drosophibot is a testbed for real-time dynamical neural controllers modeled after the anatomy and function of the insect nervous system. As such, Drosophibot has been designed to capture features of the animal's biomechanics in order to better test the neural controllers. These features include: dynamically scaling the robot to match the fruit fly by designing its joint elasticity and movement speed; a biomimetic actuator control scheme that converts neural activity into motion in the same way as observed in insects; biomimetic sensing, including proprioception from all leg joints and strain sensing from all leg segments; and passively compliant tarsi that mimic the animal's passive compliance to the walking substrate. We incorporated these features into a dynamical simulation of Drosophibot, and demonstrate that its actuators and sensors perform in an animal-like way. We used this simulation to test a neural walking controller based on anatomical and behavioral data from insects. Finally, we describe Drosophibot's hardware and show that the animal-like features of the simulation transfer to the physical robot.

Rules for the Leg Coordination of Dung Beetle Ball Rolling Behaviour

Dung beetles can perform a number of versatile behaviours, including walking and dung ball rolling. While different walking and running gaits of dung beetles have been described in previous literature, little is known about their ball rolling gaits. From behavioural experiments and video recordings of the beetle Scarabaeus (Kheper) lamarcki, we analysed and identified four underlying rules for leg coordination during ball rolling. The rules describe the alternation of the front legs and protraction waves of the middle and hind legs. We found that while rolling a ball backwards, the front legs are decoupled or loosely coupled from the other legs, resulting in a non-standard gait, in contrast to previously described tripod and gallop walking gaits in dung beetles. This provides insight into the principles of leg coordination in dung beetle ball rolling behaviour and its underlying rules. The proposed rules can be used as a basis for further investigation into ball rolling behaviours on more complex terrain (e.g., uneven terrain and slopes). Additionally, the rules can also be used to guide the development of control mechanisms for bio-inspired ball rolling robots.

Decentralized control of insect walking: A simple neural network explains a wide range of behavioral and neurophysiological results

Controlling the six legs of an insect walking in an unpredictable environment is a challenging task, as many degrees of freedom have to be coordinated. Solutions proposed to deal with this task are usually based on the highly influential concept that (sensory-modulated) central pattern generators (CPG) are required to control the rhythmic movements of walking legs. Here, we investigate a different view. To this end, we introduce a sensor based controller operating on artificial neurons, being applied to a (simulated) insectoid robot required to exploit the "loop through the world" allowing for simplification of neural computation. We show that such a decentralized solution leads to adaptive behavior when facing uncertain environments which we demonstrate for a broad range of behaviors never dealt with in a single system by earlier approaches. This includes the ability to produce footfall patterns such as velocity dependent "tripod", "tetrapod", "pentapod" as well as various stable intermediate patterns as observed in stick insects and in Drosophila. These patterns are found to be stable against disturbances and when starting from various leg configurations. Our neuronal architecture easily allows for starting or interrupting a walk, all being difficult for CPG controlled solutions. Furthermore, negotiation of curves and walking on a treadmill with various treatments of individual legs is possible as well as backward walking and performing short steps. This approach can as well account for the neurophysiological results usually interpreted to support the idea that CPGs form the basis of walking, although our approach is not relying on explicit CPG-like structures. Application of CPGs may however be required for very fast walking. Our neuronal structure allows to pinpoint specific neurons known from various insect studies. Interestingly, specific common properties observed in both insects and crustaceans suggest a significance of our controller beyond the realm of insects.

Descending octopaminergic neurons modulate sensory-evoked activity of thoracic motor neurons in stick insects

Neuromodulatory neurons located in the brain can influence activity in locomotor networks residing in the spinal cord or ventral nerve cords of invertebrates. How inputs to and outputs of neuromodulatory descending neurons affect walking activity is largely unknown. With the use of matrix-assisted laser desorption/ionization time-of-flight mass spectrometry and immunohistochemistry, we show that a population of dorsal unpaired median (DUM) neurons descending from the gnathal ganglion to thoracic ganglia of the stick insect Carausius morosus contains the neuromodulatory amine octopamine. These neurons receive excitatory input coupled to the legs’ stance phases during treadmill walking. Inputs did not result from connections with thoracic central pattern-generating networks, but, instead, most are derived from leg load sensors. In excitatory and inhibitory retractor coxae motor neurons, spike activity in the descending DUM (desDUM) neurons increased depolarizing reflexlike responses to stimulation of leg load sensors. In these motor neurons, descending octopaminergic neurons apparently functioned as components of a positive feedback network mainly driven by load-detecting sense organs. Reflexlike responses in excitatory extensor tibiae motor neurons evoked by stimulations of a femur-tibia movement sensor either are increased or decreased or were not affected by the activity of the descending neurons, indicating different functions of desDUM neurons. The increase in motor neuron activity is often accompanied by a reflex reversal, which is characteristic for actively moving animals. Our findings indicate that some descending octopaminergic neurons can facilitate motor activity during walking and support a sensory-motor state necessary for active leg movements.

NEW & NOTEWORTHY We investigated the role of descending octopaminergic neurons in the gnathal ganglion of stick insects. The neurons become active during walking, mainly triggered by input from load sensors in the legs rather than pattern-generating networks. This report provides novel evidence that octopamine released by descending neurons on stimulation of leg sense organs contributes to the modulation of leg sensory-evoked activity in a leg motor control system.

Integrative Biomimetics of Autonomous Hexapedal Locomotion

Despite substantial advances in many different fields of neurorobotics in general, and biomimetic robots in particular, a key challenge is the integration of concepts: to collate and combine research on disparate and conceptually disjunct research areas in the neurosciences and engineering sciences. We claim that the development of suitable robotic integration platforms is of particular relevance to make such integration of concepts work in practice. Here, we provide an example for a hexapod robotic integration platform for autonomous locomotion. In a sequence of six focus sections dealing with aspects of intelligent, embodied motor control in insects and multipedal robots-ranging from compliant actuation, distributed proprioception and control of multiple legs, the formation of internal representations to the use of an internal body model-we introduce the walking robot HECTOR as a research platform for integrative biomimetics of hexapedal locomotion. Owing to its 18 highly sensorized, compliant actuators, light-weight exoskeleton, distributed and expandable hardware architecture, and an appropriate dynamic simulation framework, HECTOR offers many opportunities to integrate research effort across biomimetics research on actuation, sensory-motor feedback, inter-leg coordination, and cognitive abilities such as motion planning and learning of its own body size.

Locomotion of Ants Walking up Slippery Slopes of Granular Materials

Many insects encounter locomotory difficulties in walking up sand inclines. This is masterfully exploited by some species for building traps from which prey are rarely able to escape, as the antlion and its deadly pit. The aim of this work is to tear apart the relative roles of granular material properties and slope steepness on the insect leg kinematics, gait patterns, and locomotory stability. For this, we used factorial manipulative experiments with different granular media inclines and the ant Aphaenogaster subterranea. Our results show that its locomotion is similar on granular and solid media, while for granular inclined slopes we observe a loss of stability followed by a gait pattern transition from tripod to metachronal. This implies that neither the discrete nature nor the roughness properties of sand alone are sufficient to explain the struggling of ants on sandy slopes: the interaction between sand properties and slope is key. We define an abnormality index that allows us to quantify the locomotory difficulties of insects walking up a granular incline. The probability of its occurrence reveals the local slipping of the granular media as a consequence of the pressure exerted by the ant's legs. Our findings can be extended to other models presenting locomotory difficulties for insects, such as slippery walls of urns of pitcher plants. How small arthropods walking on granular and brittle materials solve their unique stability trade-off will require a thorough understanding of the transfer of energy from leg to substrate at the particle level.

Information-based centralization of locomotion in animals and robots

The centralization of locomotor control from weak and local coupling to strong and global is hard to assess outside of particular modeling frameworks. We developed an empirical, model-free measure of centralization that compares information between control signals and both global and local states. A second measure, co-information, quantifies the net redundancy in global and local control. We first validate that our measures predict centralization in simulations of phase-coupled oscillators. We then test how centralization changes with speed in freely running cockroaches. Surprisingly, across all speeds centralization is constant and muscle activity is more informative of the global kinematic state (the averages of all legs) than the local state of that muscle's leg. Finally we use a legged robot to show that mechanical coupling alone can change the centralization of legged locomotion. The results of these systems span a design space of centralization and co-information for biological and robotic systems.

Motor control of an insect leg during level and incline walking

During walking, the leg motor system must continually adjust to changes in mechanical conditions, such as the inclination of the ground. To understand the underlying control, it is important to know how changes in leg muscle activity relate to leg kinematics (movements) and leg dynamics (forces, torques). Here, we studied these parameters in hindlegs of stick insects (Carausius morosus) during level and uphill/downhill (±45 deg) walking, using a combination of electromyography, 3D motion capture and ground reaction force measurements. We find that some kinematic parameters including leg joint angles and body height vary across walking conditions. However, kinematics vary little compared with dynamics: horizontal leg forces and torques at the thorax-coxa joint (leg protraction/retraction) and femur-tibia joint (leg flexion/extension) tend to be stronger during uphill walking and are reversed in sign during downhill walking. At the thorax-coxa joint, the different mechanical demands are met by adjustments in the timing and magnitude of antagonistic muscle activity. Adjustments occur primarily in the first half of stance after the touch-down of the leg. When insects transition from level to incline walking, the characteristic adjustments in muscle activity occur with the first step of the leg on the incline, but not in anticipation. Together, these findings indicate that stick insects adjust leg muscle activity on a step-by-step basis so as to maintain a similar kinematic pattern under different mechanical demands. The underlying control might rely primarily on feedback from leg proprioceptors signaling leg position and movement.

Prediction and expression analysis of G protein-coupled receptors in the laboratory stick insect, Carausius morosus

G protein-coupled receptors (GPCRs) are 7-transmembrane proteins that transduce various extracellular signals into intracellular pathways. They are the major target of neuropeptides, which regulate the development, feeding behavior, mating behavior, circadian rhythm, and many other physiological functions of insects. In the present study, we performed RNA sequencing and de novo transcriptome assembly to uncover the GPCRs expressed in the stick insect Carausius morosus. The transcript assemblies were predicted for the presence of 7-transmembrane GPCR domains. As a result, 430 putative GPCR transcripts were obtained and 43 of these revealed full-length sequences with highly significant similarity to known GPCR sequences in the databases. Thirteen different GPCRs were chosen for tissue expression analysis. Some of these receptors, such as calcitonin, inotocin, and tyramine receptors, showed specific expression in some of the tissues. Additionally, GPCR prediction yielded a novel uncharacterized GPCR sequence, which was specifically expressed in the central nervous system and ganglia. Previously, the only information about the anatomy of the stick insect was on its gastrointestinal system. This study provides complete anatomical information about the adult insect.

Static stability predicts the continuum of interleg coordination patterns in Drosophila

During walking, insects must coordinate the movements of their six legs for efficient locomotion. This interleg coordination is speed dependent: fast walking in insects is associated with tripod coordination patterns, whereas slow walking is associated with more variable, tetrapod-like patterns. To date, however, there has been no comprehensive explanation as to why these speed-dependent shifts in interleg coordination should occur in insects. Tripod coordination would be sufficient at low walking speeds. The fact that insects use a different interleg coordination pattern at lower speeds suggests that it is more optimal or advantageous at these speeds. Furthermore, previous studies focused on discrete tripod and tetrapod coordination patterns. Experimental data, however, suggest that changes observed in interleg coordination are part of a speed-dependent spectrum. Here, we explore these issues in relation to static stability as an important aspect for interleg coordination in Drosophila We created a model that uses basic experimentally measured parameters in fruit flies to find the interleg phase relationships that maximize stability for a given walking speed. The model predicted a continuum of interleg coordination patterns spanning the complete range of walking speeds as well as an anteriorly directed swing phase progression. Furthermore, for low walking speeds, the model predicted tetrapod-like patterns to be most stable, whereas at high walking speeds, tripod coordination emerged as most optimal. Finally, we validated the basic assumption of a continuum of interleg coordination patterns in a large set of experimental data from walking fruit flies and compared these data with the model-based predictions.

Force dynamics and synergist muscle activation in stick insects: the effects of using joint torques as mechanical stimuli

Many sensory systems are tuned to specific parameters of behaviors and have effects that are task-specific. We have studied how force feedback contributes to activation of synergist muscles in serially homologous legs of stick insects. Forces were applied using conventional half-sine or ramp and hold functions. We also utilized waveforms of joint torques calculated from experiments in freely walking animals. In all legs, forces applied to either the tarsus (foot) or proximal leg segment (trochanter) activated synergist muscles that generate substrate grip and support, but coupling of the depressor muscle to tarsal forces was weak in the front legs. Activation of trochanteral receptors using ramp and hold functions generated positive feedback to the depressor muscle in all legs when animals were induced to seek substrate grip. However, discharges of the synergist flexor muscle showed adaptation at moderate force levels. In contrast, application of forces using torque waveforms, which do not have a static hold phase, produced sustained discharges in muscle synergies with little adaptation. Firing frequencies reflected the magnitude of ground reaction forces, were graded to changes in force amplitude, and could also be modulated by transient force perturbations added to the waveforms. Comparison of synergist activation by torques and ramp and hold functions revealed a strong influence of force dynamics (dF/d t). These studies support the idea that force receptors can act to tune muscle synergies synchronously to the range of force magnitudes and dynamics that occur in each leg according to their specific use in behavior. NEW & NOTEWORTHY The effects of force receptors (campaniform sensilla) on leg muscles and synergies were characterized in stick insects using both ramp and hold functions and waveforms of joint torques calculated by inverse dynamics. Motor responses were sustained and showed reduced adaptation to the more "natural" and nonlinear torque stimuli. Calculation of the first derivative (dF/d t) of the torque waveforms demonstrated that this difference was correlated with the dynamic sensitivities of the system.

A load-based mechanism for inter-leg coordination in insects

Animals rely on an adaptive coordination of legs during walking. However, which specific mechanisms underlie coordination during natural locomotion remains largely unknown. One hypothesis is that legs can be coordinated mechanically based on a transfer of body load from one leg to another. To test this hypothesis, we simultaneously recorded leg kinematics, ground reaction forces and muscle activity in freely walking stick insects (Carausius morosus). Based on torque calculations, we show that load sensors (campaniform sensilla) at the proximal leg joints are well suited to encode the unloading of the leg in individual steps. The unloading coincides with a switch from stance to swing muscle activity, consistent with a load reflex promoting the stance-to-swing transition. Moreover, a mechanical simulation reveals that the unloading can be ascribed to the loading of a specific neighbouring leg, making it exploitable for inter-leg coordination. We propose that mechanically mediated load-based coordination is used across insects analogously to mammals.