Design process and tools for dynamic neuromechanical models and robot controllers

A computational neural model that incorporates both intrinsic dynamics and sensory feedback in the Aplysia feeding network

Studying the nervous system underlying animal motor control can shed light on how animals can adapt flexibly to a changing environment. We focus on the neural basis of feeding control in Aplysia californica. Using the Synthetic Nervous System framework, we developed a model of Aplysia feeding neural circuitry that balances neurophysiological plausibility and computational complexity. The circuitry includes neurons, synapses, and feedback pathways identified in existing literature. We organized the neurons into three layers and five subnetworks according to their functional roles. Simulation results demonstrate that the circuitry model can capture the intrinsic dynamics at neuronal and network levels. When combined with a simplified peripheral biomechanical model, it is sufficient to mediate three animal-like feeding behaviors (biting, swallowing, and rejection). The kinematic, dynamic, and neural responses of the model also share similar features with animal data. These results emphasize the functional roles of sensory feedback during feeding.

SNS-Toolbox: An Open Source Tool for Designing Synthetic Nervous Systems and Interfacing Them with Cyber-Physical Systems

One developing approach for robotic control is the use of networks of dynamic neurons connected with conductance-based synapses, also known as Synthetic Nervous Systems (SNS). These networks are often developed using cyclic topologies and heterogeneous mixtures of spiking and non-spiking neurons, which is a difficult proposition for existing neural simulation software. Most solutions apply to either one of two extremes, the detailed multi-compartment neural models in small networks, and the large-scale networks of greatly simplified neural models. In this work, we present our open-source Python package SNS-Toolbox, which is capable of simulating hundreds to thousands of spiking and non-spiking neurons in real-time or faster on consumer-grade computer hardware. We describe the neural and synaptic models supported by SNS-Toolbox, and provide performance on multiple software and hardware backends, including GPUs and embedded computing platforms. We also showcase two examples using the software, one for controlling a simulated limb with muscles in the physics simulator Mujoco, and another for a mobile robot using ROS. We hope that the availability of this software will reduce the barrier to entry when designing SNS networks, and will increase the prevalence of SNS networks in the field of robotic control.

Biomechanical and Sensory Feedback Regularize the Behavior of Different Locomotor Central Pattern Generators

This work presents an in-depth numerical investigation into a hypothesized two-layer central pattern generator (CPG) that controls mammalian walking and how different parameter choices might affect the stepping of a simulated neuromechanical model. Particular attention is paid to the functional role of features that have not received a great deal of attention in previous work: the weak cross-excitatory connectivity within the rhythm generator and the synapse strength between the two layers. Sensitivity evaluations of deafferented CPG models and the combined neuromechanical model are performed. Locomotion frequency is increased in two different ways for both models to investigate whether the model's stability can be predicted by trends in the CPG's phase response curves (PRCs). Our results show that the weak cross-excitatory connection can make the CPG more sensitive to perturbations and that increasing the synaptic strength between the two layers results in a trade-off between forced phase locking and the amount of phase delay that can exist between the two layers. Additionally, although the models exhibit these differences in behavior when disconnected from the biomechanical model, these differences seem to disappear with the full neuromechanical model and result in similar behavior despite a variety of parameter combinations. This indicates that the neural variables do not have to be fixed precisely for stable walking; the biomechanical entrainment and sensory feedback may cancel out the strengths of excitatory connectivity in the neural circuit and play a critical role in shaping locomotor behavior. Our results support the importance of including biomechanical models in the development of computational neuroscience models that control mammalian locomotion.

Neuromechanical Biomarkers for Robotic Neurorehabilitation

One of the current challenges for translational rehabilitation research is to develop the strategies to deliver accurate evaluation, prediction, patient selection, and decision-making in the clinical practice. In this regard, the robot-assisted interventions have gained popularity as they can provide the objective and quantifiable assessment of the motor performance by taking the kinematics parameters into the account. Neurophysiological parameters have also been proposed for this purpose due to the novel advances in the non-invasive signal processing techniques. In addition, other parameters linked to the motor learning and brain plasticity occurring during the rehabilitation have been explored, looking for a more holistic rehabilitation approach. However, the majority of the research done in this area is still exploratory. These parameters have shown the capability to become the “biomarkers” that are defined as the quantifiable indicators of the physiological/pathological processes and the responses to the therapeutical interventions. In this view, they could be finally used for enhancing the robot-assisted treatments. While the research on the biomarkers has been growing in the last years, there is a current need for a better comprehension and quantification of the neuromechanical processes involved in the rehabilitation. In particular, there is a lack of operationalization of the potential neuromechanical biomarkers into the clinical algorithms. In this scenario, a new framework called the “Rehabilomics” has been proposed to account for the rehabilitation research that exploits the biomarkers in its design. This study provides an overview of the state-of-the-art of the biomarkers related to the robotic neurorehabilitation, focusing on the translational studies, and underlying the need to create the comprehensive approaches that have the potential to take the research on the biomarkers into the clinical practice. We then summarize some promising biomarkers that are being under investigation in the current literature and provide some examples of their current and/or potential applications in the neurorehabilitation. Finally, we outline the main challenges and future directions in the field, briefly discussing their potential evolution and prospective.

Investigating the role of low level reinforcement reflex loops in insect locomotion

Insects are highly capable walkers, but many questions remain regarding how the insect nervous system controls locomotion. One particular question is how information is communicated between the 'lower level' ventral nerve cord (VNC) and the 'higher level' head ganglia to facilitate control. In this work, we seek to explore this question by investigating how systems traditionally described as 'positive feedback' may initiate and maintain stepping in the VNC with limited information exchanged between lower and higher level centers. We focus on the 'reflex reversal' of the stick insect femur-tibia joint between a resistance reflex (RR) and an active reaction in response to joint flexion, as well as the activation of populations of descending dorsal median unpaired (desDUM) neurons from limb strain as our primary reflex loops. We present the development of a neuromechanical model of the stick insect (Carausius morosus) femur-tibia (FTi) and coxa-trochanter joint control networks 'in-the-loop' with a physical robotic limb. The control network generates motor commands for the robotic limb, whose motion and forces generate sensory feedback for the network. We based our network architecture on the anatomy of the non-spiking interneuron joint control network that controls the FTi joint, extrapolated network connectivity based on known muscle responses, and previously developed mechanisms to produce 'sideways stepping'. Previous studies hypothesized that RR is enacted by selective inhibition of sensory afferents from the femoral chordotonal organ, but no study has tested this hypothesis with a model of an intact limb. We found that inhibiting the network's flexion position and velocity afferents generated a reflex reversal in the robot limb's FTi joint. We also explored the intact network's ability to sustain steady locomotion on our test limb. Our results suggested that the reflex reversal and limb strain reinforcement mechanisms are both necessary but individually insufficient to produce and maintain rhythmic stepping in the limb, which can be initiated or halted by brief, transient descending signals. Removing portions of this feedback loop or creating a large enough disruption can halt stepping independent of the higher-level centers. We conclude by discussing why the nervous system might control motor output in this manner, as well as how to apply these findings to generalized nervous system understanding and improved robotic control.

Long-distance transequatorial navigation using sequential measurements of magnetic inclination angle

Diverse taxa use Earth's magnetic field in combination with other sensory modalities to accomplish navigation tasks ranging from local homing to long-distance migration across continents and ocean basins. Several animals have the ability to use the inclination or tilt of magnetic field lines as a component of a magnetic compass sense that can be used to maintain migratory headings. In addition, a few animals are able to distinguish among different inclination angles and, in effect, exploit inclination as a surrogate for latitude. Little is known, however, about the role that magnetic inclination plays in guiding long-distance migrations. In this paper, we use an agent-based modelling approach to investigate whether an artificial agent can successfully execute a series of transequatorial migrations by using sequential measurements of magnetic inclination. The agent was tested with multiple navigation strategies in both present-day and reversed magnetic fields. The findings (i) demonstrate that sequential inclination measurements can enable migrations between the northern and southern hemispheres, and (ii) demonstrate that an inclination-based strategy can tolerate a reversed magnetic field, which could be useful in the development of autonomous engineered systems that must be robust to magnetic field changes. The findings also appear to be consistent with the results of some animal navigation experiments, although whether any animal exploits a strategy of using sequential measurements of inclination remains unknown.

Extending the Functional Subnetwork Approach to a Generalized Linear Integrate-and-Fire Neuron Model

Engineering neural networks to perform specific tasks often represents a monumental challenge in determining network architecture and parameter values. In this work, we extend our previously-developed method for tuning networks of non-spiking neurons, the “Functional subnetwork approach” (FSA), to the tuning of networks composed of spiking neurons. This extension enables the direct assembly and tuning of networks of spiking neurons and synapses based on the network's intended function, without the use of global optimization or machine learning. To extend the FSA, we show that the dynamics of a generalized linear integrate and fire (GLIF) neuron model have fundamental similarities to those of a non-spiking leaky integrator neuron model. We derive analytical expressions that show functional parallels between: (1) A spiking neuron's steady-state spiking frequency and a non-spiking neuron's steady-state voltage in response to an applied current; (2) a spiking neuron's transient spiking frequency and a non-spiking neuron's transient voltage in response to an applied current; and (3) a spiking synapse's average conductance during steady spiking and a non-spiking synapse's conductance. The models become more similar as additional spiking neurons are added to each population “node” in the network. We apply the FSA to model a neuromuscular reflex pathway two different ways: Via non-spiking components and then via spiking components. These results provide a concrete example of how a single non-spiking neuron may model the average spiking frequency of a population of spiking neurons. The resulting model also demonstrates that by using the FSA, models can be constructed that incorporate both spiking and non-spiking units. This work facilitates the construction of large networks of spiking neurons and synapses that perform specific functions, for example, those implemented with neuromorphic computing hardware, by providing an analytical method for directly tuning their parameters without time-consuming optimization or learning.

Neurodynamic modeling of the fruit fly Drosophila melanogaster

This manuscript describes neuromechanical modeling of the fruit fly Drosophila melanogaster in the form of a hexapod robot, Drosophibot, and an accompanying dynamic simulation. Drosophibot is a testbed for real-time dynamical neural controllers modeled after the anatomy and function of the insect nervous system. As such, Drosophibot has been designed to capture features of the animal's biomechanics in order to better test the neural controllers. These features include: dynamically scaling the robot to match the fruit fly by designing its joint elasticity and movement speed; a biomimetic actuator control scheme that converts neural activity into motion in the same way as observed in insects; biomimetic sensing, including proprioception from all leg joints and strain sensing from all leg segments; and passively compliant tarsi that mimic the animal's passive compliance to the walking substrate. We incorporated these features into a dynamical simulation of Drosophibot, and demonstrate that its actuators and sensors perform in an animal-like way. We used this simulation to test a neural walking controller based on anatomical and behavioral data from insects. Finally, we describe Drosophibot's hardware and show that the animal-like features of the simulation transfer to the physical robot.

Gradients in mechanotransduction of force and body weight in insects

Posture and walking require support of the body weight, which is thought to be detected by sensory receptors in the legs. Specificity in sensory encoding occurs through the numerical distribution, size and response range of sense organs. We have studied campaniform sensilla, receptors that detect forces as strains in the insect exoskeleton. The sites of mechanotransduction (cuticular caps) were imaged by light and confocal microscopy in four species (stick insects, cockroaches, blow flies and Drosophila). The numbers of receptors and cap diameters were determined in projection images. Similar groups of receptors are present in the legs of each species (flies lack Group 2 on the anterior trochanter). The number of receptors is generally related to the body weight but similar numbers are found in blow flies and Drosophila, despite a 30 fold difference in their weight. Imaging data indicate that the gradient (range) of cap sizes may more closely correlate with the body weight: the range of cap sizes is larger in blow flies than in Drosophila but similar to that found in juvenile cockroaches. These studies support the idea that morphological properties of force-detecting sensory receptors in the legs may be tuned to reflect the body weight.

A neuromechanical model exploring the role of the common inhibitor motor neuron in insect locomotion

In this work, we analyze a simplified, dynamical, closed-loop, neuromechanical simulation of insect joint control. We are specifically interested in two elements: (1) how slow muscle fibers may serve as temporal integrators of sensory feedback and (2) the role of common inhibitory (CI) motor neurons in resetting this integration when the commanded position changes, particularly during steady-state walking. Despite the simplicity of the model, we show that slow muscle fibers increase the accuracy of limb positioning, even for motions much shorter than the relaxation time of the fiber; this increase in accuracy is due to the slow dynamics of the fibers; the CI motor neuron plays a critical role in accelerating muscle relaxation when the limb moves to a new position; as in the animal, this architecture enables the control of the stance phase speed, independent of swing phase amplitude or duration, by changing the gain of sensory feedback to the stance phase muscles. We discuss how this relates to other models, and how it could be applied to robotic control.

Bioinspired magnetoreception and navigation in nonorthogonal environments using magnetic signatures

Diverse taxa use Earth's magnetic field in conjunction with other sensory modalities to accomplish navigation tasks ranging from local homing to long-distance migration across continents and ocean basins. However, despite extensive research, the mechanisms that underlie animal magnetoreception are not clearly understood, and how animals use Earth's magnetic field to navigate is an active area of investigation. Concurrently, Earth's magnetic field offers a signal that engineered systems can leverage for navigation in environments where man-made systems such as GPS are unavailable or unreliable. Using a proxy for Earth's magnetic field, and inspired by migratory animal behavior, this work implements a behavioral strategy that uses combinations of magnetic field inclination and intensity as rare or unique signatures that mark specific locations. Specifically, to increase the realism of previous work, in this study, a simulated agent uses a magnetic signatures based strategy to migrate in magnetic environments where lines of constant inclination and intensity are not necessarily orthogonal. The results further support existing notions that some animals may use combinations of magnetic properties as navigational markers, and provide insights into features and constraints that could enable navigational success or failure in either a biological or engineered system.

A Robotic Deburring Methodology for Tool Path Planning and Process Parameter Control of a Five-Degree-of-Freedom Robot Manipulator

Industrial robotics is a continuously developing domain, as industrial robots have demonstrated to possess benefits with regard to robotic automation solutions in the industrial automation field. In this article, a new robotic deburring methodology for tool path planning and process parameter control is presented for a newly developed five-degree-of-freedom hybrid robot manipulator. A hybrid robot manipulator with dexterous manipulation and two experimental platforms of robot manipulators are presented. A robotic deburring tool path planning method is proposed for the robotic deburring tool position and orientation planning and the robotic layered deburring planning. Also, a robotic deburring process parameter control method is proposed based on fuzzy control. Furthermore, a dexterous manipulation verification experiment is conducted to demonstrate the dexterous manipulation and the orientation reachability of the robot manipulator. Additionally, two robotic deburring experiments are conducted to verify the effectiveness of the two proposed methods and demonstrate the highly efficient and dexterous manipulation and deburring capacity of the robot manipulator.

Neuromechanical Model of Rat Hindlimb Walking with Two-Layer CPGs

This work demonstrates a neuromechanical model of rat hindlimb locomotion undergoing nominal walking with perturbations. In the animal, two types of responses to perturbations are observed: resetting and non-resetting deletions. This suggests that the animal locomotor system contains a memory-like organization. To model this phenomenon, we built a synthetic nervous system that uses separate rhythm generator and pattern formation layers to activate antagonistic muscle pairs about each joint in the sagittal plane. Our model replicates the resetting and non-resetting deletions observed in the animal. In addition, in the intact (i.e., fully afferented) rat walking simulation, we observe slower recovery after perturbation, which is different from the deafferented animal experiment. These results demonstrate that our model is a biologically feasible description of some of the neural circuits in the mammalian spinal cord that control locomotion, and the difference between our simulation and fictive motion shows the importance of sensory feedback on motor output. This model also demonstrates how the pattern formation network can activate muscle synergies in a coordinated way to produce stable walking, which motivates the use of more complex synergies activating more muscles in the legs for three-dimensional limb motion.

Walking with perturbations: a guide for biped humans and robots

This paper provides an update on the neural control of bipedal walking in relation to bioinspired models and robots. It is argued that most current models or robots are based on the construct of a symmetrical central pattern generator (CPG). However, new evidence suggests that CPG functioning is basically asymmetrical with its flexor half linked more tightly to the rhythm generator. The stability of bipedal gait, which is an important problem for robots and biological systems, is also addressed. While it is not possible to determine how biological biped systems guarantee stability, robot solutions can be useful to propose new hypotheses for biology. In the second part of this review, the focus is on gait perturbations, which is an important topic in robotics in view of the frequent falls of robots when faced with perturbations. From the human physiology it is known that the initial reaction often consists of a brief interruption followed by an adequate response. For instance, the successful recovery from a trip is achieved using some basic reactions (termed elevating and lowering strategies), that depend on the phase of the step cycle of the trip occurrence. Reactions to stepping unexpectedly in a hole depend on comparing expected and real feedback. Implementation of these ideas in models and robotics starts to emerge, with the most advanced robots being able to learn how to fall safely and how to deal with complicated disturbances such as provided by walking on a split-belt.

Bioinspired magnetoreception and navigation using magnetic signatures as waypoints

Diverse taxa use Earth's magnetic field in conjunction with other sensory modalities to accomplish navigation tasks ranging from local homing to long-distance migration across continents and ocean basins. However, despite extensive research, the mechanisms that underlie animal magnetoreception are not clearly understood, and how animals use Earth's magnetic field to navigate is an active area of investigation. Concurrently, Earth's magnetic field offers a signal that engineered systems can leverage for navigation in environments where man-made systems such as GPS are unavailable or unreliable. Using a proxy for Earth's magnetic field, and inspired by migratory animal behavior, this work implements a behavioral strategy that uses combinations of magnetic field properties as rare or unique signatures that mark specific locations. Using a discrete number of these signatures as goal waypoints, the strategy navigates through a closed set of points several times in a variety of environmental conditions, and with various levels of sensor noise. The results from this engineering/quantitative biology approach support existing notions that some animals may use combinations of magnetic properties as navigational markers, and provides insights into features and constraints that would enable navigational success or failure. The findings also offer insights into how autonomous engineered platforms might be designed to leverage the magnetic field as a navigational resource.

Leg-local neural mechanisms for searching and learning enhance robotic locomotion

Adapting motor output based on environmental forces is critical for successful locomotion in the real world. Arthropods use at least two neural mechanisms to adjust muscle activation while walking based on detected forces. Mechanism 1 uses negative feedback of leg depressor force to ensure that each stance leg supports an appropriate amount of the body's weight. Mechanism 2 encourages searching for ground contact if the leg supports no body weight. We expand the neural controller for MantisBot, a robot based upon a praying mantis, to include these mechanisms by incorporating leg-local memory and command neurons, as observed in arthropods. We present results from MantisBot transitioning between searching and stepping, mimicking data from animals as reported in the literature.

A Synthetic Nervous System Controls a Simulated Cockroach

The purpose of this work is to better understand how animals control locomotion. This knowledge can then be applied to neuromechanical design to produce more capable and adaptable robot locomotion. To test hypotheses about animal motor control, we model animals and their nervous systems with dynamical simulations, which we call synthetic nervous systems (SNS). However, one major challenge is picking parameter values that produce the intended dynamics. This paper presents a design process that solves this problem without the need for global optimization. We test this method by selecting parameter values for SimRoach2, a dynamical model of a cockroach. Each leg joint is actuated by an antagonistic pair of Hill muscles. A distributed SNS was designed based on pathways known to exist in insects, as well as hypothetical pathways that produced insect-like motion. Each joint’s controller was designed to function as a proportional-integral (PI) feedback loop and tuned with numerical optimization. Once tuned, SimRoach2 walks through a simulated environment, with several cockroach-like features. A model with such reliable low-level performance is necessary to investigate more sophisticated locomotion patterns in the future.

Mantisbot is a robotic model of visually guided motion in the praying mantis

Insects use highly distributed nervous systems to process exteroception from head sensors, compare that information with state-based goals, and direct posture or locomotion toward those goals. To study how descending commands from brain centers produce coordinated, goal-directed motion in distributed nervous systems, we have constructed a conductance-based neural system for our robot MantisBot, a 29 degree-of-freedom, 13.3:1 scale praying mantis robot. Using the literature on mantis prey tracking and insect locomotion, we designed a hierarchical, distributed neural controller that establishes the goal, coordinates different joints, and executes prey-tracking motion. In our controller, brain networks perceive the location of prey and predict its future location, store this location in memory, and formulate descending commands for ballistic saccades like those seen in the animal. The descending commands are simple, indicating only 1) whether the robot should walk or stand still, and 2) the intended direction of motion. Each joint's controller uses the descending commands differently to alter sensory-motor interactions, changing the sensory pathways that coordinate the joints' central pattern generators into one cohesive motion. Experiments with one leg of MantisBot show that visual input produces simple descending commands that alter walking kinematics, change the walking direction in a predictable manner, enact reflex reversals when necessary, and can control both static posture and locomotion with the same network.

A Functional Subnetwork Approach to Designing Synthetic Nervous Systems That Control Legged Robot Locomotion

A dynamical model of an animal's nervous system, or synthetic nervous system (SNS), is a potentially transformational control method. Due to increasingly detailed data on the connectivity and dynamics of both mammalian and insect nervous systems, controlling a legged robot with an SNS is largely a problem of parameter tuning. Our approach to this problem is to design functional subnetworks that perform specific operations, and then assemble them into larger models of the nervous system. In this paper, we present networks that perform addition, subtraction, multiplication, division, differentiation, and integration of incoming signals. Parameters are set within each subnetwork to produce the desired output by utilizing the operating range of neural activity, R, the gain of the operation, k, and bounds based on biological values. The assembly of large networks from functional subnetworks underpins our recent results with MantisBot.

Development and Training of a Neural Controller for Hind Leg Walking in a Dog Robot

Animals dynamically adapt to varying terrain and small perturbations with remarkable ease. These adaptations arise from complex interactions between the environment and biomechanical and neural components of the animal's body and nervous system. Research into mammalian locomotion has resulted in several neural and neuro-mechanical models, some of which have been tested in simulation, but few “synthetic nervous systems” have been implemented in physical hardware models of animal systems. One reason is that the implementation into a physical system is not straightforward. For example, it is difficult to make robotic actuators and sensors that model those in the animal. Therefore, even if the sensorimotor circuits were known in great detail, those parameters would not be applicable and new parameter values must be found for the network in the robotic model of the animal. This manuscript demonstrates an automatic method for setting parameter values in a synthetic nervous system composed of non-spiking leaky integrator neuron models. This method works by first using a model of the system to determine required motor neuron activations to produce stable walking. Parameters in the neural system are then tuned systematically such that it produces similar activations to the desired pattern determined using expected sensory feedback. We demonstrate that the developed method successfully produces adaptive locomotion in the rear legs of a dog-like robot actuated by artificial muscles. Furthermore, the results support the validity of current models of mammalian locomotion. This research will serve as a basis for testing more complex locomotion controllers and for testing specific sensory pathways and biomechanical designs. Additionally, the developed method can be used to automatically adapt the neural controller for different mechanical designs such that it could be used to control different robotic systems.