A neuromechanical simulation of insect walking and transition to turning of the cockroach Blaberus discoidalis

SNS-Toolbox: An Open Source Tool for Designing Synthetic Nervous Systems and Interfacing Them with Cyber-Physical Systems

One developing approach for robotic control is the use of networks of dynamic neurons connected with conductance-based synapses, also known as Synthetic Nervous Systems (SNS). These networks are often developed using cyclic topologies and heterogeneous mixtures of spiking and non-spiking neurons, which is a difficult proposition for existing neural simulation software. Most solutions apply to either one of two extremes, the detailed multi-compartment neural models in small networks, and the large-scale networks of greatly simplified neural models. In this work, we present our open-source Python package SNS-Toolbox, which is capable of simulating hundreds to thousands of spiking and non-spiking neurons in real-time or faster on consumer-grade computer hardware. We describe the neural and synaptic models supported by SNS-Toolbox, and provide performance on multiple software and hardware backends, including GPUs and embedded computing platforms. We also showcase two examples using the software, one for controlling a simulated limb with muscles in the physics simulator Mujoco, and another for a mobile robot using ROS. We hope that the availability of this software will reduce the barrier to entry when designing SNS networks, and will increase the prevalence of SNS networks in the field of robotic control.

The neuromechanics of animal locomotion: From biology to robotics and back

Robotics and neuroscience are sister disciplines that both aim to understand how agile, efficient, and robust locomotion can be achieved in autonomous agents. Robotics has already benefitted from neuromechanical principles discovered by investigating animals. These include the use of high-level commands to control low-level central pattern generator-like controllers, which, in turn, are informed by sensory feedback. Reciprocally, neuroscience has benefited from tools and intuitions in robotics to reveal how embodiment, physical interactions with the environment, and sensory feedback help sculpt animal behavior. We illustrate and discuss exemplar studies of this dialog between robotics and neuroscience. We also reveal how the increasing biorealism of simulations and robots is driving these two disciplines together, forging an integrative science of autonomous behavioral control with many exciting future opportunities.

A virtuous cycle between invertebrate and robotics research: perspective on a decade of Living Machines research

Many invertebrates are ideal model systems on which to base robot design principles due to their success in solving seemingly complex tasks across domains while possessing smaller nervous systems than vertebrates. Three areas are particularly relevant for robot designers: Research on flying and crawling invertebrates has inspired new materials and geometries from which robot bodies (their morphologies) can be constructed, enabling a new generation of softer, smaller, and lighter robots. Research on walking insects has informed the design of new systems for controlling robot bodies (their motion control) and adapting their motion to their environment without costly computational methods. And research combining wet and computational neuroscience with robotic validation methods has revealed the structure and function of core circuits in the insect brain responsible for the navigation and swarming capabilities (their mental faculties) displayed by foraging insects. The last decade has seen significant progress in the application of principles extracted from invertebrates, as well as the application of biomimetic robots to model and better understand how animals function. This Perspectives paper on the past 10 years of the Living Machines conference outlines some of the most exciting recent advances in each of these fields before outlining lessons gleaned and the outlook for the next decade of invertebrate robotic research.

Adaptive behaviors of Drosophila larvae on slippery surfaces

Friction is ubiquitous but an essential force for insects during locomotion. Insects use dedicated bio-mechanical systems such as adhesive pads to modulate the intensity of friction, providing a stable grip with touching substrates for locomotion. However, how to uncover behavioral adaptation and regulatory neural circuits of friction modification is still largely understood. In this study, we devised a novel behavior paradigm to investigate adaptive behavioral alternation of Drosophila larvae under low-friction surfaces. We found a tail looseness phenotype similar to slipping behavior in humans, as a primary indicator to assess the degree of slipping. We found a gradual reduction on slipping level in wild-type larvae after successive larval crawling, coupled with incremental tail contraction, displacement, and speed acceleration. Meanwhile, we also found a strong correlation between tail looseness index and length of contraction, suggesting that lengthening tail contraction may contribute to enlarging the contact area with the tube. Moreover, we found a delayed adaptation in rut mutant larvae, inferring that neural plasticity may participate in slipping adaptation. In conclusion, our paradigm can be easily and reliably replicated, providing a feasible pathway to uncover the behavioral principle and neural mechanism of acclimation of Drosophila larvae to low-friction conditions.

Adaptive load feedback robustly signals force dynamics in robotic model of Carausius morosus stepping

Animals utilize a number of neuronal systems to produce locomotion. One type of sensory organ that contributes in insects is the campaniform sensillum (CS) that measures the load on their legs. Groups of the receptors are found on high stress regions of the leg exoskeleton and they have significant effects in adapting walking behavior. Recording from these sensors in freely moving animals is limited by technical constraints. To better understand the load feedback signaled by CS to the nervous system, we have constructed a dynamically scaled robotic model of the Carausius morosus stick insect middle leg. The leg steps on a treadmill and supports weight during stance to simulate body weight. Strain gauges were mounted in the same positions and orientations as four key CS groups (Groups 3, 4, 6B, and 6A). Continuous data from the strain gauges were processed through a previously published dynamic computational model of CS discharge. Our experiments suggest that under different stepping conditions (e.g., changing "body" weight, phasic load stimuli, slipping foot), the CS sensory discharge robustly signals increases in force, such as at the beginning of stance, and decreases in force, such as at the end of stance or when the foot slips. Such signals would be crucial for an insect or robot to maintain intra- and inter-leg coordination while walking over extreme terrain.

Biomechanical and Sensory Feedback Regularize the Behavior of Different Locomotor Central Pattern Generators

This work presents an in-depth numerical investigation into a hypothesized two-layer central pattern generator (CPG) that controls mammalian walking and how different parameter choices might affect the stepping of a simulated neuromechanical model. Particular attention is paid to the functional role of features that have not received a great deal of attention in previous work: the weak cross-excitatory connectivity within the rhythm generator and the synapse strength between the two layers. Sensitivity evaluations of deafferented CPG models and the combined neuromechanical model are performed. Locomotion frequency is increased in two different ways for both models to investigate whether the model's stability can be predicted by trends in the CPG's phase response curves (PRCs). Our results show that the weak cross-excitatory connection can make the CPG more sensitive to perturbations and that increasing the synaptic strength between the two layers results in a trade-off between forced phase locking and the amount of phase delay that can exist between the two layers. Additionally, although the models exhibit these differences in behavior when disconnected from the biomechanical model, these differences seem to disappear with the full neuromechanical model and result in similar behavior despite a variety of parameter combinations. This indicates that the neural variables do not have to be fixed precisely for stable walking; the biomechanical entrainment and sensory feedback may cancel out the strengths of excitatory connectivity in the neural circuit and play a critical role in shaping locomotor behavior. Our results support the importance of including biomechanical models in the development of computational neuroscience models that control mammalian locomotion.

NeuroMechFly, a neuromechanical model of adult Drosophila melanogaster

Animal behavior emerges from an interaction between neural network dynamics, musculoskeletal properties and the physical environment. Accessing and understanding the interplay between these elements requires the development of integrative and morphologically realistic neuromechanical simulations. Here we present NeuroMechFly, a data-driven model of the widely studied organism, Drosophila melanogaster. NeuroMechFly combines four independent computational modules: a physics-based simulation environment, a biomechanical exoskeleton, muscle models and neural network controllers. To enable use cases, we first define the minimum degrees of freedom of the leg from real three-dimensional kinematic measurements during walking and grooming. Then, we show how, by replaying these behaviors in the simulator, one can predict otherwise unmeasured torques and contact forces. Finally, we leverage NeuroMechFly's full neuromechanical capacity to discover neural networks and muscle parameters that drive locomotor gaits optimized for speed and stability. Thus, NeuroMechFly can increase our understanding of how behaviors emerge from interactions between complex neuromechanical systems and their physical surroundings.

Investigating the role of low level reinforcement reflex loops in insect locomotion

Insects are highly capable walkers, but many questions remain regarding how the insect nervous system controls locomotion. One particular question is how information is communicated between the 'lower level' ventral nerve cord (VNC) and the 'higher level' head ganglia to facilitate control. In this work, we seek to explore this question by investigating how systems traditionally described as 'positive feedback' may initiate and maintain stepping in the VNC with limited information exchanged between lower and higher level centers. We focus on the 'reflex reversal' of the stick insect femur-tibia joint between a resistance reflex (RR) and an active reaction in response to joint flexion, as well as the activation of populations of descending dorsal median unpaired (desDUM) neurons from limb strain as our primary reflex loops. We present the development of a neuromechanical model of the stick insect (Carausius morosus) femur-tibia (FTi) and coxa-trochanter joint control networks 'in-the-loop' with a physical robotic limb. The control network generates motor commands for the robotic limb, whose motion and forces generate sensory feedback for the network. We based our network architecture on the anatomy of the non-spiking interneuron joint control network that controls the FTi joint, extrapolated network connectivity based on known muscle responses, and previously developed mechanisms to produce 'sideways stepping'. Previous studies hypothesized that RR is enacted by selective inhibition of sensory afferents from the femoral chordotonal organ, but no study has tested this hypothesis with a model of an intact limb. We found that inhibiting the network's flexion position and velocity afferents generated a reflex reversal in the robot limb's FTi joint. We also explored the intact network's ability to sustain steady locomotion on our test limb. Our results suggested that the reflex reversal and limb strain reinforcement mechanisms are both necessary but individually insufficient to produce and maintain rhythmic stepping in the limb, which can be initiated or halted by brief, transient descending signals. Removing portions of this feedback loop or creating a large enough disruption can halt stepping independent of the higher-level centers. We conclude by discussing why the nervous system might control motor output in this manner, as well as how to apply these findings to generalized nervous system understanding and improved robotic control.

From Motor-Output to Connectivity: An In-Depth Study of in-vitro Rhythmic Patterns in the Cockroach Periplaneta americana

The cockroach is an established model in the study of locomotion control. While previous work has offered important insights into the interplay among brain commands, thoracic central pattern generators, and the sensory feedback that shapes their motor output, there remains a need for a detailed description of the central pattern generators' motor output and their underlying connectivity scheme. To this end, we monitored pilocarpine-induced activity of levator and depressor motoneurons in two types of novel in-vitro cockroach preparations: isolated thoracic ganglia and a whole-chain preparation comprising the thoracic ganglia and the subesophageal ganglion. Our data analyses focused on the motoneuron firing patterns and the coordination among motoneuron types in the network. The burstiness and rhythmicity of the motoneurons were monitored, and phase relations, coherence, coupling strength, and frequency-dependent variability were analyzed. These parameters were all measured and compared among network units both within each preparation and among the preparations. Here, we report differences among the isolated ganglia, including asymmetries in phase and coupling strength, which indicate that they are wired to serve different functions. We also describe the intrinsic default gait and a frequency-dependent coordination. The depressor motoneurons showed mostly similar characteristics throughout the network regardless of interganglia connectivity; whereas the characteristics of the levator motoneurons activity were mostly ganglion-dependent, and influenced by the presence of interganglia connectivity. Asymmetries were also found between the anterior and posterior homolog parts of the thoracic network, as well as between ascending and descending connections. Our analyses further discover a frequency-dependent inversion of the interganglia coordination from alternations between ipsilateral homolog oscillators to simultaneous activity. We present a detailed scheme of the network couplings, formulate coupling rules, and review a previously suggested model of connectivity in light of our new findings. Our data support the notion that the inter-hemiganglia coordination derives from the levator networks and their coupling with local depressor interneurons. Our findings also support a dominant role of the metathoracic ganglion and its ascending output in governing the anterior ganglia motor output during locomotion in the behaving animal.

Extending the Functional Subnetwork Approach to a Generalized Linear Integrate-and-Fire Neuron Model

Engineering neural networks to perform specific tasks often represents a monumental challenge in determining network architecture and parameter values. In this work, we extend our previously-developed method for tuning networks of non-spiking neurons, the “Functional subnetwork approach” (FSA), to the tuning of networks composed of spiking neurons. This extension enables the direct assembly and tuning of networks of spiking neurons and synapses based on the network's intended function, without the use of global optimization or machine learning. To extend the FSA, we show that the dynamics of a generalized linear integrate and fire (GLIF) neuron model have fundamental similarities to those of a non-spiking leaky integrator neuron model. We derive analytical expressions that show functional parallels between: (1) A spiking neuron's steady-state spiking frequency and a non-spiking neuron's steady-state voltage in response to an applied current; (2) a spiking neuron's transient spiking frequency and a non-spiking neuron's transient voltage in response to an applied current; and (3) a spiking synapse's average conductance during steady spiking and a non-spiking synapse's conductance. The models become more similar as additional spiking neurons are added to each population “node” in the network. We apply the FSA to model a neuromuscular reflex pathway two different ways: Via non-spiking components and then via spiking components. These results provide a concrete example of how a single non-spiking neuron may model the average spiking frequency of a population of spiking neurons. The resulting model also demonstrates that by using the FSA, models can be constructed that incorporate both spiking and non-spiking units. This work facilitates the construction of large networks of spiking neurons and synapses that perform specific functions, for example, those implemented with neuromorphic computing hardware, by providing an analytical method for directly tuning their parameters without time-consuming optimization or learning.

Neurodynamic modeling of the fruit fly Drosophila melanogaster

This manuscript describes neuromechanical modeling of the fruit fly Drosophila melanogaster in the form of a hexapod robot, Drosophibot, and an accompanying dynamic simulation. Drosophibot is a testbed for real-time dynamical neural controllers modeled after the anatomy and function of the insect nervous system. As such, Drosophibot has been designed to capture features of the animal's biomechanics in order to better test the neural controllers. These features include: dynamically scaling the robot to match the fruit fly by designing its joint elasticity and movement speed; a biomimetic actuator control scheme that converts neural activity into motion in the same way as observed in insects; biomimetic sensing, including proprioception from all leg joints and strain sensing from all leg segments; and passively compliant tarsi that mimic the animal's passive compliance to the walking substrate. We incorporated these features into a dynamical simulation of Drosophibot, and demonstrate that its actuators and sensors perform in an animal-like way. We used this simulation to test a neural walking controller based on anatomical and behavioral data from insects. Finally, we describe Drosophibot's hardware and show that the animal-like features of the simulation transfer to the physical robot.

Gradients in mechanotransduction of force and body weight in insects

Posture and walking require support of the body weight, which is thought to be detected by sensory receptors in the legs. Specificity in sensory encoding occurs through the numerical distribution, size and response range of sense organs. We have studied campaniform sensilla, receptors that detect forces as strains in the insect exoskeleton. The sites of mechanotransduction (cuticular caps) were imaged by light and confocal microscopy in four species (stick insects, cockroaches, blow flies and Drosophila). The numbers of receptors and cap diameters were determined in projection images. Similar groups of receptors are present in the legs of each species (flies lack Group 2 on the anterior trochanter). The number of receptors is generally related to the body weight but similar numbers are found in blow flies and Drosophila, despite a 30 fold difference in their weight. Imaging data indicate that the gradient (range) of cap sizes may more closely correlate with the body weight: the range of cap sizes is larger in blow flies than in Drosophila but similar to that found in juvenile cockroaches. These studies support the idea that morphological properties of force-detecting sensory receptors in the legs may be tuned to reflect the body weight.

Decentralized control of insect walking: A simple neural network explains a wide range of behavioral and neurophysiological results

Controlling the six legs of an insect walking in an unpredictable environment is a challenging task, as many degrees of freedom have to be coordinated. Solutions proposed to deal with this task are usually based on the highly influential concept that (sensory-modulated) central pattern generators (CPG) are required to control the rhythmic movements of walking legs. Here, we investigate a different view. To this end, we introduce a sensor based controller operating on artificial neurons, being applied to a (simulated) insectoid robot required to exploit the "loop through the world" allowing for simplification of neural computation. We show that such a decentralized solution leads to adaptive behavior when facing uncertain environments which we demonstrate for a broad range of behaviors never dealt with in a single system by earlier approaches. This includes the ability to produce footfall patterns such as velocity dependent "tripod", "tetrapod", "pentapod" as well as various stable intermediate patterns as observed in stick insects and in Drosophila. These patterns are found to be stable against disturbances and when starting from various leg configurations. Our neuronal architecture easily allows for starting or interrupting a walk, all being difficult for CPG controlled solutions. Furthermore, negotiation of curves and walking on a treadmill with various treatments of individual legs is possible as well as backward walking and performing short steps. This approach can as well account for the neurophysiological results usually interpreted to support the idea that CPGs form the basis of walking, although our approach is not relying on explicit CPG-like structures. Application of CPGs may however be required for very fast walking. Our neuronal structure allows to pinpoint specific neurons known from various insect studies. Interestingly, specific common properties observed in both insects and crustaceans suggest a significance of our controller beyond the realm of insects.

A neuromechanical model exploring the role of the common inhibitor motor neuron in insect locomotion

In this work, we analyze a simplified, dynamical, closed-loop, neuromechanical simulation of insect joint control. We are specifically interested in two elements: (1) how slow muscle fibers may serve as temporal integrators of sensory feedback and (2) the role of common inhibitory (CI) motor neurons in resetting this integration when the commanded position changes, particularly during steady-state walking. Despite the simplicity of the model, we show that slow muscle fibers increase the accuracy of limb positioning, even for motions much shorter than the relaxation time of the fiber; this increase in accuracy is due to the slow dynamics of the fibers; the CI motor neuron plays a critical role in accelerating muscle relaxation when the limb moves to a new position; as in the animal, this architecture enables the control of the stance phase speed, independent of swing phase amplitude or duration, by changing the gain of sensory feedback to the stance phase muscles. We discuss how this relates to other models, and how it could be applied to robotic control.

Integrative Biomimetics of Autonomous Hexapedal Locomotion

Despite substantial advances in many different fields of neurorobotics in general, and biomimetic robots in particular, a key challenge is the integration of concepts: to collate and combine research on disparate and conceptually disjunct research areas in the neurosciences and engineering sciences. We claim that the development of suitable robotic integration platforms is of particular relevance to make such integration of concepts work in practice. Here, we provide an example for a hexapod robotic integration platform for autonomous locomotion. In a sequence of six focus sections dealing with aspects of intelligent, embodied motor control in insects and multipedal robots—ranging from compliant actuation, distributed proprioception and control of multiple legs, the formation of internal representations to the use of an internal body model—we introduce the walking robot HECTOR as a research platform for integrative biomimetics of hexapedal locomotion. Owing to its 18 highly sensorized, compliant actuators, light-weight exoskeleton, distributed and expandable hardware architecture, and an appropriate dynamic simulation framework, HECTOR offers many opportunities to integrate research effort across biomimetics research on actuation, sensory-motor feedback, inter-leg coordination, and cognitive abilities such as motion planning and learning of its own body size.

Leg-local neural mechanisms for searching and learning enhance robotic locomotion

Adapting motor output based on environmental forces is critical for successful locomotion in the real world. Arthropods use at least two neural mechanisms to adjust muscle activation while walking based on detected forces. Mechanism 1 uses negative feedback of leg depressor force to ensure that each stance leg supports an appropriate amount of the body's weight. Mechanism 2 encourages searching for ground contact if the leg supports no body weight. We expand the neural controller for MantisBot, a robot based upon a praying mantis, to include these mechanisms by incorporating leg-local memory and command neurons, as observed in arthropods. We present results from MantisBot transitioning between searching and stepping, mimicking data from animals as reported in the literature.

Simple analytical model reveals the functional role of embodied sensorimotor interaction in hexapod gaits

Insects have various gaits with specific characteristics and can change their gaits smoothly in accordance with their speed. These gaits emerge from the embodied sensorimotor interactions that occur between the insect’s neural control and body dynamic systems through sensory feedback. Sensory feedback plays a critical role in coordinated movements such as locomotion, particularly in stick insects. While many previously developed insect models can generate different insect gaits, the functional role of embodied sensorimotor interactions in the interlimb coordination of insects remains unclear because of their complexity. In this study, we propose a simple physical model that is amenable to mathematical analysis to explain the functional role of these interactions clearly. We focus on a foot contact sensory feedback called phase resetting, which regulates leg retraction timing based on touchdown information. First, we used a hexapod robot to determine whether the distributed decoupled oscillators used for legs with the sensory feedback generate insect-like gaits through embodied sensorimotor interactions. The robot generated two different gaits and one had similar characteristics to insect gaits. Next, we proposed the simple model as a minimal model that allowed us to analyze and explain the gait mechanism through the embodied sensorimotor interactions. The simple model consists of a rigid body with massless springs acting as legs, where the legs are controlled using oscillator phases with phase resetting, and the governed equations are reduced such that they can be explained using only the oscillator phases with some approximations. This simplicity leads to analytical solutions for the hexapod gaits via perturbation analysis, despite the complexity of the embodied sensorimotor interactions. This is the first study to provide an analytical model for insect gaits under these interaction conditions. Our results clarified how this specific foot contact sensory feedback contributes to generation of insect-like ipsilateral interlimb coordination during hexapod locomotion.

A Neuro-Musculo-Skeletal Model for Insects With Data-driven Optimization

Simulating the locomotion of insects is beneficial to many areas such as experimental biology, computer animation and robotics. This work proposes a neuro-musculo-skeletal model, which integrates the biological inspirations from real insects and reproduces the gait pattern on virtual insects. The neural system is a network of spiking neurons, whose spiking patterns are controlled by the input currents. The spiking pattern provides a uniform representation of sensory information, high-level commands and control strategy. The muscle models are designed following the characteristic Hill-type muscle with customized force-length and force-velocity relationships. The model parameters, including both the neural and muscular components, are optimized via an approach of evolutionary optimization, with the data captured from real insects. The results show that the simulated gait pattern, including joint trajectories, matches the experimental data collected from real ants walking in the free mode. The simulated character is capable of moving at different directions and traversing uneven terrains.

A Synthetic Nervous System Controls a Simulated Cockroach

The purpose of this work is to better understand how animals control locomotion. This knowledge can then be applied to neuromechanical design to produce more capable and adaptable robot locomotion. To test hypotheses about animal motor control, we model animals and their nervous systems with dynamical simulations, which we call synthetic nervous systems (SNS). However, one major challenge is picking parameter values that produce the intended dynamics. This paper presents a design process that solves this problem without the need for global optimization. We test this method by selecting parameter values for SimRoach2, a dynamical model of a cockroach. Each leg joint is actuated by an antagonistic pair of Hill muscles. A distributed SNS was designed based on pathways known to exist in insects, as well as hypothetical pathways that produced insect-like motion. Each joint’s controller was designed to function as a proportional-integral (PI) feedback loop and tuned with numerical optimization. Once tuned, SimRoach2 walks through a simulated environment, with several cockroach-like features. A model with such reliable low-level performance is necessary to investigate more sophisticated locomotion patterns in the future.

Six-legged walking in insects: how CPGs, peripheral feedback, and descending signals generate coordinated and adaptive motor rhythms

Walking is a rhythmic locomotor behavior of legged animals, and its underlying mechanisms have been the subject of neurobiological research for more than 100 years. In this article, we review relevant historical aspects and contemporary studies in this field of research with a particular focus on the role of central pattern generating networks (CPGs) and their contribution to the generation of six-legged walking in insects. Aspects of importance are the generation of single-leg stepping, the generation of interleg coordination, and how descending signals influence walking. We first review how CPGs interact with sensory signals from the leg in the generation of leg stepping. Next, we summarize how these interactions are modified in the generation of motor flexibility for forward and backward walking, curve walking, and speed changes. We then review the present state of knowledge with regard to the role of CPGs in intersegmental coordination and how CPGs might be involved in mediating descending influences from the brain for the initiation, maintenance, modification, and cessation of the motor output for walking. Throughout, we aim to specifically address gaps in knowledge, and we describe potential future avenues and approaches, conceptual and methodological, with the latter emphasizing in particular options arising from the advent of neurogenetic approaches to this field of research and its combination with traditional approaches.

Mantisbot is a robotic model of visually guided motion in the praying mantis

Insects use highly distributed nervous systems to process exteroception from head sensors, compare that information with state-based goals, and direct posture or locomotion toward those goals. To study how descending commands from brain centers produce coordinated, goal-directed motion in distributed nervous systems, we have constructed a conductance-based neural system for our robot MantisBot, a 29 degree-of-freedom, 13.3:1 scale praying mantis robot. Using the literature on mantis prey tracking and insect locomotion, we designed a hierarchical, distributed neural controller that establishes the goal, coordinates different joints, and executes prey-tracking motion. In our controller, brain networks perceive the location of prey and predict its future location, store this location in memory, and formulate descending commands for ballistic saccades like those seen in the animal. The descending commands are simple, indicating only 1) whether the robot should walk or stand still, and 2) the intended direction of motion. Each joint's controller uses the descending commands differently to alter sensory-motor interactions, changing the sensory pathways that coordinate the joints' central pattern generators into one cohesive motion. Experiments with one leg of MantisBot show that visual input produces simple descending commands that alter walking kinematics, change the walking direction in a predictable manner, enact reflex reversals when necessary, and can control both static posture and locomotion with the same network.

A Functional Subnetwork Approach to Designing Synthetic Nervous Systems That Control Legged Robot Locomotion

A dynamical model of an animal's nervous system, or synthetic nervous system (SNS), is a potentially transformational control method. Due to increasingly detailed data on the connectivity and dynamics of both mammalian and insect nervous systems, controlling a legged robot with an SNS is largely a problem of parameter tuning. Our approach to this problem is to design functional subnetworks that perform specific operations, and then assemble them into larger models of the nervous system. In this paper, we present networks that perform addition, subtraction, multiplication, division, differentiation, and integration of incoming signals. Parameters are set within each subnetwork to produce the desired output by utilizing the operating range of neural activity, R, the gain of the operation, k, and bounds based on biological values. The assembly of large networks from functional subnetworks underpins our recent results with MantisBot.

Bioinspired magnetic reception and multimodal sensing

Several animals use Earth's magnetic field in concert with other sensor modes to accomplish navigational tasks ranging from local homing to continental scale migration. However, despite extensive research, animal magnetic reception remains poorly understood. Similarly, the Earth's magnetic field offers a signal that engineered systems can leverage to navigate in environments where man-made positioning systems such as GPS are either unavailable or unreliable. This work uses a behavioral strategy inspired by the migratory behavior of sea turtles to locate a magnetic goal and respond to wind when it is present. Sensing is performed using a number of distributed sensors. Based on existing theoretical biology considerations, data processing is performed using combinations of circles and ellipses to exploit the distributed sensing paradigm. Agent-based simulation results indicate that this approach is capable of using two separate magnetic properties to locate a goal from a variety of initial conditions in both noiseless and noisy sensory environments. The system's ability to locate the goal appears robust to noise at the cost of overall path length.

Template for the neural control of directed stepping generalized to all legs of MantisBot

We previously developed a neural controller for one leg of our six-legged robot, MantisBot, that could direct locomotion toward a goal by modulating leg-local reflexes with simple descending commands from a head sensor. In this work, we successfully apply an automated method to tune the control network for all three pairs of legs of our hexapod robot MantisBot in only 90 s with a desktop computer. Each foot's motion changes appropriately as the body's intended direction of travel changes. In addition, several results from studies of walking insects are captured by this model. This paper both demonstrates the broad applicability of this control method for robots, and suggests neural mechanisms underlying observations from walking insects.

Detection of magnetic field properties using distributed sensing: a computational neuroscience approach

Diverse taxa use Earth's magnetic field to aid both short- and long-distance navigation. Study of these behaviors has led to a variety of postulated sensory and processing mechanisms that remain unconfirmed. Although several models have been proposed to explain and understand these mechanisms' underpinnings, they have not necessarily connected a putative sensory signal to the nervous system. Using mathematical software simulation, hardware testing and the computational neuroscience tool of dynamic neural fields, the present work implements a previously developed conceptual model for processing magnetite-based magnetosensory data. Results show that the conceptual model, originally constructed to stimulate thought and generate insights into future physiological experiments, may provide a valid approach to encoding magnetic field information. Specifically, magnetoreceptors that are each individually capable of sensing directional information can, as a population, encode magnetic intensity and direction. The findings hold promise both as a biological magnetoreception concept and for generating engineering innovations in sensing and processing.

Development and Training of a Neural Controller for Hind Leg Walking in a Dog Robot

Animals dynamically adapt to varying terrain and small perturbations with remarkable ease. These adaptations arise from complex interactions between the environment and biomechanical and neural components of the animal's body and nervous system. Research into mammalian locomotion has resulted in several neural and neuro-mechanical models, some of which have been tested in simulation, but few “synthetic nervous systems” have been implemented in physical hardware models of animal systems. One reason is that the implementation into a physical system is not straightforward. For example, it is difficult to make robotic actuators and sensors that model those in the animal. Therefore, even if the sensorimotor circuits were known in great detail, those parameters would not be applicable and new parameter values must be found for the network in the robotic model of the animal. This manuscript demonstrates an automatic method for setting parameter values in a synthetic nervous system composed of non-spiking leaky integrator neuron models. This method works by first using a model of the system to determine required motor neuron activations to produce stable walking. Parameters in the neural system are then tuned systematically such that it produces similar activations to the desired pattern determined using expected sensory feedback. We demonstrate that the developed method successfully produces adaptive locomotion in the rear legs of a dog-like robot actuated by artificial muscles. Furthermore, the results support the validity of current models of mammalian locomotion. This research will serve as a basis for testing more complex locomotion controllers and for testing specific sensory pathways and biomechanical designs. Additionally, the developed method can be used to automatically adapt the neural controller for different mechanical designs such that it could be used to control different robotic systems.

Climbing favours the tripod gait over alternative faster insect gaits

To escape danger or catch prey, running vertebrates rely on dynamic gaits with minimal ground contact. By contrast, most insects use a tripod gait that maintains at least three legs on the ground at any given time. One prevailing hypothesis for this difference in fast locomotor strategies is that tripod locomotion allows insects to rapidly navigate three-dimensional terrain. To test this, we computationally discovered fast locomotor gaits for a model based on Drosophila melanogaster. Indeed, the tripod gait emerges to the exclusion of many other possible gaits when optimizing fast upward climbing with leg adhesion. By contrast, novel two-legged bipod gaits are fastest on flat terrain without adhesion in the model and in a hexapod robot. Intriguingly, when adhesive leg structures in real Drosophila are covered, animals exhibit atypical bipod-like leg coordination. We propose that the requirement to climb vertical terrain may drive the prevalence of the tripod gait over faster alternative gaits with minimal ground contact.

Numerous selective forces shape animal locomotion patterns and as a result, different animals evolved to use different gaits. Here, Ramdya et al. use live and in silico Drosophila, as well as an insect-model robot, to gain insights into the conditions that promote the ubiquitous tripod gait observed in most insects.

Robustness, flexibility, and sensitivity in a multifunctional motor control model

Motor systems must adapt to perturbations and changing conditions both within and outside the body. We refer to the ability of a system to maintain performance despite perturbations as "robustness," and the ability of a system to deploy alternative strategies that improve fitness as "flexibility." Different classes of pattern-generating circuits yield dynamics with differential sensitivities to perturbations and parameter variation. Depending on the task and the type of perturbation, high sensitivity can either facilitate or hinder robustness and flexibility. Here we explore the role of multiple coexisting oscillatory modes and sensory feedback in allowing multiphasic motor pattern generation to be both robust and flexible. As a concrete example, we focus on a nominal neuromechanical model of triphasic motor patterns in the feeding apparatus of the marine mollusk Aplysia californica. We find that the model can operate within two distinct oscillatory modes and that the system exhibits bistability between the two. In the "heteroclinic mode," higher sensitivity makes the system more robust to changing mechanical loads, but less robust to internal parameter variations. In the "limit cycle mode," lower sensitivity makes the system more robust to changes in internal parameter values, but less robust to changes in mechanical load. Finally, we show that overall performance on a variable feeding task is improved when the system can flexibly transition between oscillatory modes in response to the changing demands of the task. Thus, our results suggest that the interplay of sensory feedback and multiple oscillatory modes can allow motor systems to be both robust and flexible in a variable environment.

Design process and tools for dynamic neuromechanical models and robot controllers

We present a serial design process with associated tools to select parameter values for a posture and locomotion controller for simulation of a robot. The controller is constructed from dynamic neuron and synapse models and simulated with the open-source neuromechanical simulator AnimatLab 2. Each joint has a central pattern generator (CPG), whose neurons possess persistent sodium channels. The CPG rhythmically inhibits motor neurons that control the servomotor's velocity. Sensory information coordinates the joints in the leg into a cohesive stepping motion. The parameter value design process is intended to run on a desktop computer, and has three steps. First, our tool FEEDBACKDESIGN uses classical control methods to find neural and synaptic parameter values that stably and robustly control servomotor output. This method is fast, testing over 100 parameter value variations per minute. Next, our tool CPGDESIGN generates bifurcation diagrams and phase response curves for the CPG model. This reveals neural and synaptic parameter values that produce robust oscillation cycles, whose phase can be rapidly entrained to sensory feedback. It also designs the synaptic conductance of inter-joint pathways. Finally, to understand sensitivity to parameters and how descending commands affect a leg's stepping motion, our tool SIMSCAN runs batches of neuromechanical simulations with specified parameter values, which is useful for searching the parameter space of a complicated simulation. These design tools are demonstrated on a simulation of a robot, but may be applied to neuromechanical animal models or physical robots as well.

Validating a model for detecting magnetic field intensity using dynamic neural fields

Several animals use properties of Earth's magnetic field as a part of their navigation toolkit to accomplish tasks ranging from local homing to continental migration. Studying these behaviors has led to the postulation of both a magnetite-based sense, and a chemically based radical-pair mechanism. Several researchers have proposed models aimed at both understanding these mechanisms, and offering insights into future physiological experiments. The present work mathematically implements a previously developed conceptual model for sensing and processing magnetite-based magnetosensory feedback by using dynamic neural fields, a computational neuroscience tool for modeling nervous system dynamics and processing. Results demonstrate the plausibility of the conceptual model's predictions. Specifically, a population of magnetoreceptors in which each individual can only sense directional information can encode magnetic intensity en masse. Multiple populations can encode both magnetic direction, and intensity, two parameters that several animals use in their navigational toolkits. This work can be expanded to test other magnetoreceptor models.

Mechanosensation and Adaptive Motor Control in Insects

The ability of animals to flexibly navigate through complex environments depends on the integration of sensory information with motor commands. The sensory modality most tightly linked to motor control is mechanosensation. Adaptive motor control depends critically on an animal's ability to respond to mechanical forces generated both within and outside the body. The compact neural circuits of insects provide appealing systems to investigate how mechanical cues guide locomotion in rugged environments. Here, we review our current understanding of mechanosensation in insects and its role in adaptive motor control. We first examine the detection and encoding of mechanical forces by primary mechanoreceptor neurons. We then discuss how central circuits integrate and transform mechanosensory information to guide locomotion. Because most studies in this field have been performed in locusts, cockroaches, crickets, and stick insects, the examples we cite here are drawn mainly from these 'big insects'. However, we also pay particular attention to the tiny fruit fly, Drosophila, where new tools are creating new opportunities, particularly for understanding central circuits. Our aim is to show how studies of big insects have yielded fundamental insights relevant to mechanosensation in all animals, and also to point out how the Drosophila toolkit can contribute to future progress in understanding mechanosensory processing.

Endogenous rhythm and pattern-generating circuit interactions in cockroach motor centres

Cockroaches are rapid and stable runners whose gaits emerge from the intricate, and not fully resolved, interplay between endogenous oscillatory pattern-generating networks and sensory feedback that shapes their rhythmic output. Here we studied the endogenous motor output of a brainless, deafferented preparation. We monitored the pilocarpine-induced rhythmic activity of levator and depressor motor neurons in the mesothoracic and metathoracic segments in order to reveal the oscillatory networks’ architecture and interactions. Data analyses included phase relations, latencies between and overlaps of rhythmic bursts, spike frequencies, and the dependence of these parameters on cycle frequency. We found that, overall, ipsilateral connections are stronger than contralateral ones. Our findings revealed asymmetries in connectivity among the different ganglia, in which meta-to-mesothoracic ascending coupling is stronger than meso-to-metathoracic descending coupling. Within-ganglion coupling between the metathoracic hemiganglia is stronger than that in the mesothoracic ganglion. We also report differences in the role and mode of operation of homologue network units (manifested by levator and depressor nerve activity). Many observed characteristics are similar to those exhibited by intact animals, suggesting a dominant role for feedforward control in cockroach locomotion. Based on these data we posit a connectivity scheme among components of the locomotion pattern generating system.

Summary: Detailed analysis of fictive motor patterns unveils endogenous characteristics of the cockroach thoracic locomotion control networks and their interrelations and enables an explanatory connectivity model.

Advantage of straight walk instability in turning maneuver of multilegged locomotion: a robotics approach

Multilegged locomotion improves the mobility of terrestrial animals and artifacts. Using many legs has advantages, such as the ability to avoid falling and to tolerate leg malfunction. However, many intrinsic degrees of freedom make the motion planning and control difficult, and many contact legs can impede the maneuverability during locomotion. The underlying mechanism for generating agile locomotion using many legs remains unclear from biological and engineering viewpoints. The present study used a centipede-like multilegged robot composed of six body segments and twelve legs. The body segments are passively connected through yaw joints with torsional springs. The dynamic stability of the robot walking in a straight line changes through a supercritical Hopf bifurcation due to the body axis flexibility. We focused on a quick turning task of the robot and quantitatively investigated the relationship between stability and maneuverability in multilegged locomotion by using a simple control strategy. Our experimental results show that the straight walk instability does help the turning maneuver. We discuss the importance and relevance of our findings for biological systems and propose a design principle for a simple control scheme to create maneuverable locomotion of multilegged robots.

Body side-specific control of motor activity during turning in a walking animal

Animals and humans need to move deftly and flexibly to adapt to environmental demands. Despite a large body of work on the neural control of walking in invertebrates and vertebrates alike, the mechanisms underlying the motor flexibility that is needed to adjust the motor behavior remain largely unknown. Here, we investigated optomotor-induced turning and the neuronal mechanisms underlying the differences between the leg movements of the two body sides in the stick insect Carausius morosus. We present data to show that the generation of turning kinematics in an insect are the combined result of descending unilateral commands that change the leg motor output via task-specific modifications in the processing of local sensory feedback as well as modification of the activity of local central pattern generating networks in a body-side-specific way. To our knowledge, this is the first study to demonstrate the specificity of such modifications in a defined motor task.

DOI:http://dx.doi.org/10.7554/eLife.13799.001

Walking along a curve or turning is a complex manoeuvre for the nervous system, as it must coordinate different leg movements on each side of the body. Rhythmic processes such as walking are controlled by networks of neurons called central pattern generators. The resulting movements can be adjusted by feedback from sense organs in response to environmental conditions. For example, sensory feedback that provides information about the load placed on each leg, allows the animal to control the duration of a stance. How the nerve cells, or neurons, involved in these processes work together to produce complex, flexible movements such as turning is largely unknown.

Previous work on how the brain negotiates turning movements has been carried out mostly in animals that swim or fly. To understand what happens during walking, Gruhn et al. monitored stick insects that walked in a curve on a slippery surface, and recorded the electrical activity within the animals' nervous system as they turned.

By comparing the activity of the nervous system on each side of the body while the insects walked a curve, Gruhn et al. found that the nervous system uses at least three different mechanisms to produce the different movements on the inside and outside. Firstly, the sensory feedback signals that communicate the load on the leg are processed in the legs on the outside of the curve to support forward steps, while they are processed on the inside legs to support forward, sideward, and backward steps. Secondly, the motor activity produced by the central pattern generator is modulated to be stronger for the muscle that moves the leg backward on the outside of the curve. At the same time, this activity is stronger for the muscle that moves the leg forward on the inside of the curve. Thirdly, signals from a front leg influence the movement of the other legs on the same side of the body. This influence is strong on the inside and weak on the outside of the curve.

Together or separately, these three mechanisms could provide the animal with the means to perform turns in all their different curvatures. Future work will need to work out exactly which local neurons process the signals sent from the brain to control movement.

DOI:http://dx.doi.org/10.7554/eLife.13799.002

Neuromechanical model of praying mantis explores the role of descending commands in pre-strike pivots

Praying mantises hunt by standing on their meso- and metathoracic legs and using them to rotate and translate (together, 'pivot') their bodies toward prey. We have developed a neuromechanical software model of the praying mantis Tenodera sinensis to use as a platform for testing postural controllers that the animal may use while hunting. Previous results showed that a feedforward model was insufficient for capturing the diversity of posture observed in the animal (Szczecinski et al 2014 Biomimetic and Biohybrid Syst. 3 296-307). Therefore we have expanded upon this model to make a flexible controller with feedback that more closely mimics the animal. The controller actuates 24 joints in the legs of a dynamical model to orient the head and translate the thorax toward prey. It is controlled by a simulation of nonspiking neurons assembled as a highly simplified version of networks that may exist in the mantid central complex and thoracic ganglia. Because of the distributed nature of these networks, we hypothesize that descending commands that orient the mantis toward prey may be simple direction-of-intent signals, which are turned into motor commands by the structure of low-level networks in the thoracic ganglia. We verify this through a series of experiments with the model. It captures the speed and range of mantid pivots as reported in other work (Yamawaki et al 2011 J. Insect Physiol. 57 1010-6). It is capable of pivoting toward prey from a variety of initial postures, as seen in the animal. Finally, we compare the model's joint kinematics during pivots to preliminary 3D kinematics collected from Tenodera.

A biologically based neural system coordinates the joints and legs of a tetrapod

A biologically inspired neural control system has been developed that coordinates a tetrapod trotting gait in the sagittal plane. The developed neuromechanical system is used to explore properties of connections in inter-leg and intra-leg coordination. The neural controller is built with biologically based neurons and synapses, and connections are based on data from literature where available. It is applied to a planar biomechanical model of a rat with 14 joints, each actuated by a pair of antagonistic Hill muscle models. The controller generates tension in the muscles through activation of simulated motoneurons. The hind leg and inter-leg control networks are based on pathways discovered in cat research tuned to the kinematic motions of a rat. The foreleg network was developed by extrapolating analogous pathways from the hind legs. The formulated intra-leg and inter-leg networks properly coordinate the joints and produce motions similar to those of a walking rat. Changing the strength of a single inter-leg connection is sufficient to account for differences in phase timing in different trotting rats.

Controlling legs for locomotion-insights from robotics and neurobiology

Walking is the most common terrestrial form of locomotion in animals. Its great versatility and flexibility has led to many attempts at building walking machines with similar capabilities. The control of walking is an active research area both in neurobiology and robotics, with a large and growing body of work. This paper gives an overview of the current knowledge on the control of legged locomotion in animals and machines and attempts to give walking control researchers from biology and robotics an overview of the current knowledge in both fields. We try to summarize the knowledge on the neurobiological basis of walking control in animals, emphasizing common principles seen in different species. In a section on walking robots, we review common approaches to walking controller design with a slight emphasis on biped walking control. We show where parallels between robotic and neurobiological walking controllers exist and how robotics and biology may benefit from each other. Finally, we discuss where research in the two fields diverges and suggest ways to bridge these gaps.

Designing responsive pattern generators: stable heteroclinic channel cycles for modeling and control

A striking feature of biological pattern generators is their ability to respond immediately to multisensory perturbations by modulating the dwell time at a particular phase of oscillation, which can vary force output, range of motion, or other characteristics of a physical system. Stable heteroclinic channels (SHCs) are a dynamical architecture that can provide such responsiveness to artificial devices such as robots. SHCs are composed of sequences of saddle equilibrium points, which yields exquisite sensitivity. The strength of the vector fields in the neighborhood of these equilibria determines the responsiveness to perturbations and how long trajectories dwell in the vicinity of a saddle. For SHC cycles, the addition of stochastic noise results in oscillation with a regular mean period. In this paper, we parameterize noise-driven Lotka-Volterra SHC cycles such that each saddle can be independently designed to have a desired mean sub-period. The first step in the design process is an analytic approximation, which results in mean sub-periods that are within 2% of the specified sub-period for a typical parameter set. Further, after measuring the resultant sub-periods over sufficient numbers of cycles, the magnitude of the noise can be adjusted to control the mean period with accuracy close to that of the integration step size. With these relationships, SHCs can be more easily employed in engineering and modeling applications. For applications that require smooth state transitions, this parameterization permits each state's distribution of periods to be independently specified. Moreover, for modeling context-dependent behaviors, continuously varying inputs in each state dimension can rapidly precipitate transitions to alter frequency and phase.

Encoding wide-field motion and direction in the central complex of the cockroach Blaberus discoidalis

In the arthropod brain, the central complex (CX) receives various forms of sensory signals and is associated with motor functions, but its precise role in behavior is controversial. The optomotor response is a highly conserved turning behavior directed by visual motion. In tethered cockroaches, 20% procaine injected into the CX reversibly blocked this behavior. We then used multichannel extracellular recording to sample unit activity in the CX in response to wide-field visual motion stimuli, moving either horizontally or vertically at various temporal frequencies. For the 401 units we sampled, we identified five stereotyped response patterns: tonically inhibited or excited responses during motion, phasically inhibited or excited responses at the initiation of motion, and phasically excited responses at the termination of motion. Sixty-seven percent of the units responded to horizontal motion, while only 19% responded to vertical motion. Thirty-eight percent of responding units were directionally selective to horizontal motion. Response type and directional selectivity were sometimes conditional with other stimulus parameters, such as temporal frequency. For instance, 16% of the units that responded tonically to low temporal frequencies responded phasically to high temporal frequencies. In addition, we found that 26% of wide-field motion responding units showed a periodic response that was entrained to the temporal frequency of the stimulus. Our results show a diverse population of neurons within the CX that are variably tuned to wide-field motion parameters. Our behavioral data further suggest that such CX activity is required for effective optomotor responses.