Control of swing movement: influences of differently shaped substrate

Flexible locomotion in complex environments: the influence of species, speed and sensory feedback on panarthropod inter-leg coordination

Panarthropods (a clade containing arthropods, tardigrades and onychophorans) can adeptly move across a wide range of challenging terrains and their ability to do so given their relatively simple nervous systems makes them compelling study organisms. Studies of forward walking on flat terrain excitingly point to key features in inter-leg coordination patterns that seem to be 'universally' shared across panarthropods. However, when movement through more complex, naturalistic terrain is considered, variability in coordination patterns - from the intra-individual to inter-species level - becomes more apparent. This variability is likely to be due to the interplay between sensory feedback and local pattern-generating activity, and depends crucially on species, walking speed and behavioral goal. Here, I gather data from the literature of panarthropod walking coordination on both flat ground and across more complex terrain. This Review aims to emphasize the value of: (1) designing experiments with an eye towards studying organisms in natural environments; (2) thoughtfully integrating results from various experimental techniques, such as neurophysiological and biomechanical studies; and (3) ensuring that data is collected and made available from a wider range of species for future comparative analyses.

Effect of Thoracic Connective Lesion on Inter-Leg Coordination in Freely Walking Stick Insects

Multi-legged locomotion requires appropriate coordination of all legs with coincident ground contact. Whereas behaviourally derived coordination rules can adequately describe many aspects of inter-leg coordination, the neural mechanisms underlying these rules are still not entirely clear. The fact that inter-leg coordination is strongly affected by cut thoracic connectives in tethered walking insects, shows that neural information exchange among legs is important. As yet, recent studies have shown that load transfer among legs can contribute to inter-leg coordination through mechanical coupling alone, i.e., without neural information exchange among legs. Since naturalistic load transfer among legs works only in freely walking animals but not in tethered animals, we tested the hypothesis that connective lesions have less strong effects if mechanical coupling through load transfer among legs is possible. To do so, we recorded protraction/retraction angles of all legs in unrestrained walking stick insects that either had one thoracic connective cut or had undergone a corresponding sham operation. In lesioned animals, either a pro-to-mesothorax or a meso-to-metathorax connective was cut. Overall, our results on temporal coordination were similar to published reports on tethered walking animals, in that the phase relationship of the legs immediately adjacent to the lesion was much less precise, although the effect on mean phase was relatively weak or absent. Lesioned animals could walk at the same speed as the control group, though with a significant sideward bias toward the intact side. Detailed comparison of lesion effects in free-walking and supported animals reveal that the strongest differences concern the spatial coordination among legs. In free walking, lesioned animals, touch-down and lift-off positions shifted significantly in almost all legs, including legs of the intact body side. We conclude that insects with disrupted neural information transfer through one connective adjust to this disruption differently if they experience naturalistic load distribution. While mechanical load transfer cannot compensate for lesion-induced effects on temporal inter-leg coordination, several compensatory changes in spatial coordination occur only if animals carry their own weight.

Decentralized control of insect walking: A simple neural network explains a wide range of behavioral and neurophysiological results

Controlling the six legs of an insect walking in an unpredictable environment is a challenging task, as many degrees of freedom have to be coordinated. Solutions proposed to deal with this task are usually based on the highly influential concept that (sensory-modulated) central pattern generators (CPG) are required to control the rhythmic movements of walking legs. Here, we investigate a different view. To this end, we introduce a sensor based controller operating on artificial neurons, being applied to a (simulated) insectoid robot required to exploit the "loop through the world" allowing for simplification of neural computation. We show that such a decentralized solution leads to adaptive behavior when facing uncertain environments which we demonstrate for a broad range of behaviors never dealt with in a single system by earlier approaches. This includes the ability to produce footfall patterns such as velocity dependent "tripod", "tetrapod", "pentapod" as well as various stable intermediate patterns as observed in stick insects and in Drosophila. These patterns are found to be stable against disturbances and when starting from various leg configurations. Our neuronal architecture easily allows for starting or interrupting a walk, all being difficult for CPG controlled solutions. Furthermore, negotiation of curves and walking on a treadmill with various treatments of individual legs is possible as well as backward walking and performing short steps. This approach can as well account for the neurophysiological results usually interpreted to support the idea that CPGs form the basis of walking, although our approach is not relying on explicit CPG-like structures. Application of CPGs may however be required for very fast walking. Our neuronal structure allows to pinpoint specific neurons known from various insect studies. Interestingly, specific common properties observed in both insects and crustaceans suggest a significance of our controller beyond the realm of insects.

Swing Velocity Profiles of Small Limbs Can Arise from Transient Passive Torques of the Antagonist Muscle Alone

In large limbs, changing motor neuron activity typically controls within-movement velocity. For example, sequential agonist-antagonist-agonist motor neuron firing typically underlies the slowing often present at the end of human reaches. In physiological movements of large limbs, antagonistic muscle passive torque is generally negligible. In small limbs, alternatively, passive torques can determine limb rest position, generate restoring movements to it, and decrease agonist-generated movement amplitude and velocity maxima. These observations suggest that, in small limbs, passive forces might also control velocity changes within movements. We investigated this issue in stick insect middle leg femur-tibia (FT) joint. During swing, the FT joint extensor muscle actively shortens and the flexor muscle passively lengthens. As in human reaching, after its initial acceleration, FT joint velocity continuously decreases. We measured flexor passive forces during imposed stretches spanning the ranges of FT joint angles, angular velocities, and movement amplitudes present in leg swings. The viscoelastic "transient" passive force that occurs during and soon after stretch depended on all three variables and could be tens of times larger than the "steady-state" passive force commonly measured long after stretch end. We combined these data, the flexor and extensor moment arms, and an existing extensor model to simulate FT joint swing. To measure only passive (flexor) muscle-dependent effects, we used constant extensor activations in these simulations. In simulations using data from ten flexor muscles, flexor passive torque could always produce swings with, after swing initiation, continuously decreasing velocities. Antagonist muscle passive torques alone can thus control within-movement velocity.

ReaCog, a Minimal Cognitive Controller Based on Recruitment of Reactive Systems

It has often been stated that for a neuronal system to become a cognitive one, it has to be large enough. In contrast, we argue that a basic property of a cognitive system, namely the ability to plan ahead, can already be fulfilled by small neuronal systems. As a proof of concept, we propose an artificial neural network, termed reaCog, that, first, is able to deal with a specific domain of behavior (six-legged-walking). Second, we show how a minor expansion of this system enables the system to plan ahead and deploy existing behavioral elements in novel contexts in order to solve current problems. To this end, the system invents new solutions that are not possible for the reactive network. Rather these solutions result from new combinations of given memory elements. This faculty does not rely on a dedicated system being more or less independent of the reactive basis, but results from exploitation of the reactive basis by recruiting the lower-level control structures in a way that motor planning becomes possible as an internal simulation relying on internal representation being grounded in embodied experiences.

Controlling legs for locomotion-insights from robotics and neurobiology

Walking is the most common terrestrial form of locomotion in animals. Its great versatility and flexibility has led to many attempts at building walking machines with similar capabilities. The control of walking is an active research area both in neurobiology and robotics, with a large and growing body of work. This paper gives an overview of the current knowledge on the control of legged locomotion in animals and machines and attempts to give walking control researchers from biology and robotics an overview of the current knowledge in both fields. We try to summarize the knowledge on the neurobiological basis of walking control in animals, emphasizing common principles seen in different species. In a section on walking robots, we review common approaches to walking controller design with a slight emphasis on biped walking control. We show where parallels between robotic and neurobiological walking controllers exist and how robotics and biology may benefit from each other. Finally, we discuss where research in the two fields diverges and suggest ways to bridge these gaps.

A hexapod walker using a heterarchical architecture for action selection

Moving in a cluttered environment with a six-legged walking machine that has additional body actuators, therefore controlling 22 DoFs, is not a trivial task. Already simple forward walking on a flat plane requires the system to select between different internal states. The orchestration of these states depends on walking velocity and on external disturbances. Such disturbances occur continuously, for example due to irregular up-and-down movements of the body or slipping of the legs, even on flat surfaces, in particular when negotiating tight curves. The number of possible states is further increased when the system is allowed to walk backward or when front legs are used as grippers and cannot contribute to walking. Further states are necessary for expansion that allow for navigation. Here we demonstrate a solution for the selection and sequencing of different (attractor) states required to control different behaviors as are forward walking at different speeds, backward walking, as well as negotiation of tight curves. This selection is made by a recurrent neural network (RNN) of motivation units, controlling a bank of decentralized memory elements in combination with the feedback through the environment. The underlying heterarchical architecture of the network allows to select various combinations of these elements. This modular approach representing an example of neural reuse of a limited number of procedures allows for adaptation to different internal and external conditions. A way is sketched as to how this approach may be expanded to form a cognitive system being able to plan ahead. This architecture is characterized by different types of modules being arranged in layers and columns, but the complete network can also be considered as a holistic system showing emergent properties which cannot be attributed to a specific module.

Walknet, a bio-inspired controller for hexapod walking

Walknet comprises an artificial neural network that allows for the simulation of a considerable amount of behavioral data obtained from walking and standing stick insects. It has been tested by kinematic and dynamic simulations as well as on a number of six-legged robots. Over the years, various different expansions of this network have been provided leading to different versions of Walknet. This review summarizes the most important biological findings described by Walknet and how they can be simulated. Walknet shows how a number of properties observed in insects may emerge from a decentralized architecture. Examples are the continuum of so-called "gaits," coordination of up to 18 leg joints during stance when walking forward or backward over uneven surfaces and negotiation of curves, dealing with leg loss, as well as being able following motion trajectories without explicit precalculation. The different Walknet versions are compared to other approaches describing insect-inspired hexapod walking. Finally, we briefly address the ability of this decentralized reactive controller to form the basis for the simulation of higher-level cognitive faculties exceeding the capabilities of insects.

A neuromechanical model explaining forward and backward stepping in the stick insect

The mechanism underlying the generation of stepping has been the object of intensive studies. Stepping involves the coordinated movement of different leg joints and is, in the case of insects, produced by antagonistic muscle pairs. In the stick insect, the coordinated actions of three such antagonistic muscle pairs produce leg movements and determine the stepping pattern of the limb. The activity of the muscles is controlled by the nervous system as a whole and more specifically by local neuronal networks for each muscle pair. While many basic properties of these control mechanisms have been uncovered, some important details of their interactions in various physiological conditions have so far remained unknown. In this study, we present a neuromechanical model of the coupled protractor-retractor and levator-depressor neuromuscular systems and use it to elucidate details of their coordinated actions during forward and backward walking. The switch from protraction to retraction is evoked at a critical angle of the femur during downward movement. This angle represents a sensory input that integrates load, motion, and ground contact. Using the model, we can make detailed suggestions as to how rhythmic stepping might be generated by the central pattern generators of the local neuronal networks, how this activity might be transmitted to the corresponding motoneurons, and how the latter might control the activity of the related muscles. The entirety of these processes yields the coordinated interaction between neuronal and mechanical parts of the system. Moreover, we put forward a mechanism by which motoneuron activity could be modified by a premotor network and suggest that this mechanism might serve as a basis for fast adaptive behavior, like switches between forward and backward stepping, which occur, for example, during curve walking, and especially sharp turning, of insects.

Deriving neural network controllers from neuro-biological data: implementation of a single-leg stick insect controller

This article presents modular recurrent neural network controllers for single legs of a biomimetic six-legged robot equipped with standard DC motors. Following arguments of Ekeberg et al. (Arthropod Struct Dev 33:287-300, 2004), completely decentralized and sensori-driven neuro-controllers were derived from neuro-biological data of stick-insects. Parameters of the controllers were either hand-tuned or optimized by an evolutionary algorithm. Employing identical controller structures, qualitatively similar behaviors were achieved for robot and for stick insect simulations. For a wide range of perturbing conditions, as for instance changing ground height or up- and downhill walking, swing as well as stance control were shown to be robust. Behavioral adaptations, like varying locomotion speeds, could be achieved by changes in neural parameters as well as by a mechanical coupling to the environment. To a large extent the simulated walking behavior matched biological data. For example, this was the case for body support force profiles and swing trajectories under varying ground heights. The results suggest that the single-leg controllers are suitable as modules for hexapod controllers, and they might therefore bridge morphological- and behavioral-based approaches to stick insect locomotion control.

Detecting substrate engagement: responses of tarsal campaniform sensilla in cockroaches

Sensory signals of contact and engagement with the substrate are important in the control and adaptation of posture and locomotion. We characterized responses of campaniform sensilla, receptors that encode forces as cuticular strains, in the tarsi (feet) of cockroaches using neurophysiological techniques and digital imaging. A campaniform sensillum on the fourth tarsal segment was readily identified by its large action potential in nerve recordings. The receptor discharged to contractions of the retractor unguis muscle, which engages the pretarsus (claws and arolium) with the substrate. We mimicked the effects of muscle contractions by applying displacements to the retractor apodeme (tendon). Sensillum firing did not occur to unopposed movements, but followed engagement of the claws with an object. Vector analysis of forces suggested that resisted muscle contractions produce counterforces that axially compress the tarsal segments. Close joint packing of tarsal segments was clearly observed following claw engagement. Physiological experiments showed that the sensillum responded vigorously to axial forces applied directly to the distal tarsus. Discharges of tarsal campaniform sensilla could effectively signal active substrate engagement when the pretarsal claws and arolium are used to grip the substrate in climbing, traversing irregular terrains or walking on inverted surfaces.

Tight turns in stick insects

We investigated insects Carausius morosus walking whilst hanging upside down along a narrow 3 mm horizontal beam. At the end of the beam, the animal takes a 180 degrees turn. This is a difficult situation because substrate area is small and moves relative to the body during the turn. We investigated how leg movements are organised during this turn. A non-contact of either front leg appears to indicate the end of the beam. However, a turn can only begin if the hind legs stand in an appropriate position relative to each other; the outer hind leg must not be placed posterior to the inner hind leg. When starting the turn, both front legs are lifted and usually held in a relatively stable position and then the inner middle leg performs a swing-and-search movement: The leg begins a swing, which is continued by a searching movement to the side and to the rear, and eventually grasps the beam. At the same time the body is turned usually being supported by the outer middle leg and both hind legs. Then front legs followed by the outer middle leg reach the beam. A scheme describing the turns based on a few simple behavioural elements is proposed.

Walking in Aretaon asperrimus

This article describes basic parameters characterizing walking of the stick insect Aretaon asperrimus to allow a comparative approach with other insects studied. As in many other animals, geometrical parameters such as step amplitude and leg extreme positions do not vary with walking velocity. However, the relation between swing duration and stance duration is quite constant, in contrast to most insects studied. Therefore, velocity profiles during swing vary with walking velocity whereas time course of leg trajectories and leg angle trajectories are independent of walking velocity. Nevertheless, A. asperrimus does not show a classical tripod gait, but performs a metachronal, or tetrapod, gait, showing phase values differing from 0.5 between ipsilateral neighbouring legs. As in Carausius morosus, the detailed shape of the swing trajectory may depend on the form of the substrate. Effects describing coordinating influences between legs have been found that prevent the start of a swing as long as the posterior leg performs a swing. Further, the treading on tarsus reflex can be observed in Aretaon. No hint to the existence of a targeting influence has been found. Control of rearward walking is easiest interpreted by maintaining the basic rules but an anterior-posterior reversal of the information flow.

Insect walking is based on a decentralized architecture revealing a simple and robust controller

Control of walking in rugged terrain requires one to incorporate different issues, such as the mechanical properties of legs and muscles, the neuronal control structures for the single leg, the mechanics and neuronal control structures for the coordination between legs, as well as central decisions that are based on external information and on internal states. Walking in predictable environments and fast running, to a large degree, rely on muscle mechanics. Conversely, slow walking in unpredictable terrain, e.g. climbing in rugged structures, has to rely on neuronal systems that monitor and intelligently react to specific properties of the environment. An arthropod model system that shows the latter abilities is the stick insect, based on which this review will be focused. An insect, when moving its six legs, has to control 18 joints, three per leg, and therefore has to control 18 degrees of freedom (d.f.). As the body position in space is determined by 6 d.f. only, there are 12 d.f. open to be selected. Therefore, a fundamental problem is as to how these extra d.f. are controlled. Based mainly on behavioural experiments and simulation studies, but also including neurophysiological results, the following control structures have been revealed. Legs act as basically independent systems. The quasi-rhythmic movement of the individual leg can be described to result from a structure that exploits mechanical coupling of the legs via the ground and the body. Furthermore, neuronally mediated influences act locally between neighbouring legs, leading to the emergence of insect-type gaits. The underlying controller can be described as a free gait controller. Cooperation of the legs being in stance mode is assumed to be based on mechanical coupling plus local positive feedback controllers. These controllers, acting on individual leg joints, transform a passive displacement of a joint into an active movement, generating synergistic assistance reflexes in all mechanically coupled joints. This architecture is summarized in the form of the artificial neural network, Walknet, that is heavily dependent on sensory feedback at the proprioceptive level. Exteroceptive feedback is exploited for global decisions, such as the walking direction and velocity.