A dynamic model of thoracic differentiation for the control of turning in the stick insect

Descending interneurons of the stick insect connecting brain neuropiles with the prothoracic ganglion

Stick insects respond to visual or tactile stimuli with whole-body turning or directed reach-to-grasp movements. Such sensory-induced turning and reaching behaviour requires interneurons to convey information from sensory neuropils of the head ganglia to motor neuropils of the thoracic ganglia. To date, descending interneurons are largely unknown in stick insects. In particular, it is unclear whether the special role of the front legs in sensory-induced turning and reaching has a neuroanatomical correlate in terms of descending interneuron numbers. Here, we describe the population of descending interneurons with somata in the brain or gnathal ganglion in the stick insect Carausius morosus, providing a first map of soma cluster counts and locations. By comparison of interneuron populations with projections to the pro- and mesothoracic ganglia, we then estimate the fraction of descending interneurons that terminate in the prothoracic ganglion. With regard to short-latency, touch-mediated reach-to-grasp movements, we also locate likely sites of synaptic interactions between antennal proprioceptive afferents to the deutocerebrum and gnathal ganglion with descending or ascending interneuron fibres. To this end, we combine fluorescent dye stainings of thoracic connectives with stainings of antennal hair field sensilla. Backfills of neck connectives revealed up to 410 descending interneuron somata (brain: 205 in 19 clusters; gnathal ganglion: 205). In comparison, backfills of the prothorax-mesothorax connectives stained only up to 173 somata (brain: 83 in 16 clusters; gnathal ganglion: 90), suggesting that up to 60% of all descending interneurons may terminate in the prothoracic ganglion (estimated upper bound). Double stainings of connectives and antennal hair field sensilla revealed that ascending or descending fibres arborise in close proximity of afferent terminals in the deutocerebrum and in the middle part of the gnathal ganglia. We conclude that two cephalothoracic pathways may convey cues about antennal movement and pointing direction to thoracic motor centres via two synapses only.

neuroWalknet, a controller for hexapod walking allowing for context dependent behavior

Decentralized control has been established as a key control principle in insect walking and has been successfully leveraged to account for a wide range of walking behaviors in the proposed neuroWalknet architecture. This controller allows for walking patterns at different velocities in both, forward and backward direction-quite similar to the behavior shown in stick insects-, for negotiation of curves, and for robustly dealing with various disturbances. While these simulations focus on the cooperation of different, decentrally controlled legs, here we consider a set of biological experiments not yet been tested by neuroWalknet, that focus on the function of the individual leg and are context dependent. These intraleg studies deal with four groups of interjoint reflexes. The reflexes are elicited by stimulation of the femoral chordotonal organ (fCO) or groups of campaniform sensilla (CS). Motor output signals are recorded from the alpha-joint, the beta-joint or the gamma-joint of the leg. Furthermore, the influence of these sensory inputs to artificially induced oscillations by application of pilocarpine has been studied. Although these biological data represent results obtained from different local reflexes in different contexts, they fit with and are embedded into the behavior shown by the global structure of neuroWalknet. In particular, a specific and intensively studied behavior, active reaction, has since long been assumed to represent a separate behavioral element, from which it is not clear why it occurs in some situations, but not in others. This question could now be explained as an emergent property of the holistic structure of neuroWalknet which has shown to be able to produce artificially elicited pilocarpine-driven oscillation that can be controlled by sensory input without the need of explicit innate CPG structures. As the simulation data result from a holistic system, further results were obtained that could be used as predictions to be tested in further biological experiments.

Decentralized control of insect walking: A simple neural network explains a wide range of behavioral and neurophysiological results

Controlling the six legs of an insect walking in an unpredictable environment is a challenging task, as many degrees of freedom have to be coordinated. Solutions proposed to deal with this task are usually based on the highly influential concept that (sensory-modulated) central pattern generators (CPG) are required to control the rhythmic movements of walking legs. Here, we investigate a different view. To this end, we introduce a sensor based controller operating on artificial neurons, being applied to a (simulated) insectoid robot required to exploit the "loop through the world" allowing for simplification of neural computation. We show that such a decentralized solution leads to adaptive behavior when facing uncertain environments which we demonstrate for a broad range of behaviors never dealt with in a single system by earlier approaches. This includes the ability to produce footfall patterns such as velocity dependent "tripod", "tetrapod", "pentapod" as well as various stable intermediate patterns as observed in stick insects and in Drosophila. These patterns are found to be stable against disturbances and when starting from various leg configurations. Our neuronal architecture easily allows for starting or interrupting a walk, all being difficult for CPG controlled solutions. Furthermore, negotiation of curves and walking on a treadmill with various treatments of individual legs is possible as well as backward walking and performing short steps. This approach can as well account for the neurophysiological results usually interpreted to support the idea that CPGs form the basis of walking, although our approach is not relying on explicit CPG-like structures. Application of CPGs may however be required for very fast walking. Our neuronal structure allows to pinpoint specific neurons known from various insect studies. Interestingly, specific common properties observed in both insects and crustaceans suggest a significance of our controller beyond the realm of insects.

Integrative Biomimetics of Autonomous Hexapedal Locomotion

Despite substantial advances in many different fields of neurorobotics in general, and biomimetic robots in particular, a key challenge is the integration of concepts: to collate and combine research on disparate and conceptually disjunct research areas in the neurosciences and engineering sciences. We claim that the development of suitable robotic integration platforms is of particular relevance to make such integration of concepts work in practice. Here, we provide an example for a hexapod robotic integration platform for autonomous locomotion. In a sequence of six focus sections dealing with aspects of intelligent, embodied motor control in insects and multipedal robots-ranging from compliant actuation, distributed proprioception and control of multiple legs, the formation of internal representations to the use of an internal body model-we introduce the walking robot HECTOR as a research platform for integrative biomimetics of hexapedal locomotion. Owing to its 18 highly sensorized, compliant actuators, light-weight exoskeleton, distributed and expandable hardware architecture, and an appropriate dynamic simulation framework, HECTOR offers many opportunities to integrate research effort across biomimetics research on actuation, sensory-motor feedback, inter-leg coordination, and cognitive abilities such as motion planning and learning of its own body size.

Insects use two distinct classes of steps during unrestrained locomotion

Background

Adaptive, context-dependent control of locomotion requires modulation of centrally generated rhythmic motor patterns through peripheral control loops and postural reflexes. Thus assuming that the modulation of rhythmic motor patterns accounts for much of the behavioural variability observed in legged locomotion, investigating behavioural variability is a key to the understanding of context-dependent control mechanisms in locomotion. To date, the variability of unrestrained locomotion is poorly understood, and virtually nothing is known about the features that characterise the natural statistics of legged locomotion. In this study, we quantify the natural variability of hexapedal walking and climbing in insects, drawing from a database of several thousand steps recorded over two hours of walking time.

Results

We show that the range of step length used by unrestrained climbing stick insects is large, showing that step length can be changed substantially for adaptive locomotion. Step length distributions were always bimodal, irrespective of leg type and walking condition, suggesting the presence of two distinct classes of steps: short and long steps. Probability density of step length was well-described by a gamma distribution for short steps, and a logistic distribution for long steps. Major coefficients of these distributions remained largely unaffected by walking conditions. Short and long steps differed concerning their spatial occurrence on the walking substrate, their timing within the step sequence, and their prevalent swing direction. Finally, ablation of structures that serve to improve foothold increased the ratio of short to long steps, indicating a corrective function of short steps.

Conclusions

Statistical and functional differences suggest that short and long steps are physiologically distinct classes of leg movements that likely reflect distinct control mechanisms at work.

A hexapod walker using a heterarchical architecture for action selection

Moving in a cluttered environment with a six-legged walking machine that has additional body actuators, therefore controlling 22 DoFs, is not a trivial task. Already simple forward walking on a flat plane requires the system to select between different internal states. The orchestration of these states depends on walking velocity and on external disturbances. Such disturbances occur continuously, for example due to irregular up-and-down movements of the body or slipping of the legs, even on flat surfaces, in particular when negotiating tight curves. The number of possible states is further increased when the system is allowed to walk backward or when front legs are used as grippers and cannot contribute to walking. Further states are necessary for expansion that allow for navigation. Here we demonstrate a solution for the selection and sequencing of different (attractor) states required to control different behaviors as are forward walking at different speeds, backward walking, as well as negotiation of tight curves. This selection is made by a recurrent neural network (RNN) of motivation units, controlling a bank of decentralized memory elements in combination with the feedback through the environment. The underlying heterarchical architecture of the network allows to select various combinations of these elements. This modular approach representing an example of neural reuse of a limited number of procedures allows for adaptation to different internal and external conditions. A way is sketched as to how this approach may be expanded to form a cognitive system being able to plan ahead. This architecture is characterized by different types of modules being arranged in layers and columns, but the complete network can also be considered as a holistic system showing emergent properties which cannot be attributed to a specific module.

Walknet, a bio-inspired controller for hexapod walking

Walknet comprises an artificial neural network that allows for the simulation of a considerable amount of behavioral data obtained from walking and standing stick insects. It has been tested by kinematic and dynamic simulations as well as on a number of six-legged robots. Over the years, various different expansions of this network have been provided leading to different versions of Walknet. This review summarizes the most important biological findings described by Walknet and how they can be simulated. Walknet shows how a number of properties observed in insects may emerge from a decentralized architecture. Examples are the continuum of so-called "gaits," coordination of up to 18 leg joints during stance when walking forward or backward over uneven surfaces and negotiation of curves, dealing with leg loss, as well as being able following motion trajectories without explicit precalculation. The different Walknet versions are compared to other approaches describing insect-inspired hexapod walking. Finally, we briefly address the ability of this decentralized reactive controller to form the basis for the simulation of higher-level cognitive faculties exceeding the capabilities of insects.

A neuromechanical model for the neuronal basis of curve walking in the stick insect

The coordination of the movement of single and multiple limbs is essential for the generation of locomotion. Movement about single joints and the resulting stepping patterns are usually generated by the activity of antagonistic muscle pairs. In the stick insect, the three major muscle pairs of a leg are the protractor and retractor coxae, the levator and depressor trochanteris, and the flexor and extensor tibiae. The protractor and retractor move the coxa, and thereby the leg, forward and backward. The levator and depressor move the femur up and down. The flexor flexes, and the extensor extends the tibia about the femur-tibia joint. The underlying neuronal mechanisms for a forward stepping middle leg have been thoroughly investigated in experimental and theoretical studies. However, the details of the neuronal and mechanical mechanisms driving a stepping single leg in situations other than forward walking remain largely unknown. Here, we present a neuromechanical model of the coupled three joint control system of the stick insect's middle leg. The model can generate forward, backward, or sideward stepping. Switching between them is achieved by changing only a few central signals controlling the neuromechanical model. In kinematic simulations, we are able to generate curve walking with two different mechanisms. In the first, the inner middle leg is switched from forward to sideward and in the second to backward stepping. Both are observed in the behaving animal, and in the model and animal alike, backward stepping of the inner middle leg produces tighter turns than sideward stepping.

Active tactile exploration for adaptive locomotion in the stick insect

Insects carry a pair of actively movable feelers that supply the animal with a range of multimodal information. The antennae of the stick insect Carausius morosus are straight and of nearly the same length as the legs, making them ideal probes for near-range exploration. Indeed, stick insects, like many other insects, use antennal contact information for the adaptive control of locomotion, for example, in climbing. Moreover, the active exploratory movement pattern of the antennae is context-dependent. The first objective of the present study is to reveal the significance of antennal contact information for the efficient initiation of climbing. This is done by means of kinematic analysis of freely walking animals as they undergo a tactually elicited transition from walking to climbing. The main findings are that fast, tactually elicited re-targeting movements may occur during an ongoing swing movement, and that the height of the last antennal contact prior to leg contact largely predicts the height of the first leg contact. The second objective is to understand the context-dependent adaptation of the antennal movement pattern in response to tactile contact. We show that the cycle frequency of both antennal joints increases after obstacle contact. Furthermore, inter-joint coupling switches distinctly upon tactile contact, revealing a simple mechanism for context-dependent adaptation.

Detailed tracking of body and leg movements of a freely walking female cricket during phonotaxis

We describe a semi-automated tracking system for insect motion based on commercially available high-speed video cameras and freely available software. We use it to collect detailed three-dimensional kinematic information from female crickets performing free walking phonotaxis towards a calling song stimulus. We mark the insect's joints with small dots of paint and record the movements from underneath with a pair of cameras following the insect as it walks on the transparent floor of an arena. Tracking is done offline, utilizing a kinematic model to constrain the processing. We can obtain the positions and angles of all joints of all legs and six additional body joints, synchronised with stance-swing transitions and the sound pattern, at a 300 Hz frame rate. This data will be used in the further development of models of neural control of phonotaxis.

Kinematics of phonotactic steering in the walking cricket Gryllus bimaculatus (de Geer)

Female crickets, Gryllus bimaculatus, are attracted by the male calling song and approach singing males; a behaviour known as phonotaxis. Even tethered females walking on a trackball steer towards a computer-generated male song presented from their left or right side. High-speed video analysis showed how this auditory-evoked steering was integrated with walking. Typically all the front and middle legs showed kinematic adjustments during steering, with the trajectories tilted towards the side of acoustic stimulation. Furthermore, the average speed of the tarsi contralateral to song increased relative to the ipsilateral tarsi. Kinematic changes of the hind legs were small and may be a consequence of the front and middle leg adjustments. Although phonotactic steering generally led to stereotyped adjustments there were differences in the specific combination of kinematic changes in leg trajectories. The most reliable kinematic steering response was by the contralateral front leg, such that, during its swing phase the tarsus moved towards the side of acoustic stimulation through an increased forward rotation of the femur and an increased extension of the tibia. Relating the changes in tarsal positioning of each leg to the steering velocity of the animal indicated that typically the front and middle legs contralateral to song generated the turning forces. Phonotactic steering was integrated into forward walking without changes to the walking motor cycle.

A 3D Musculo-Mechanical Model of the Salamander for the Study of Different Gaits and Modes of Locomotion

Computer simulation has been used to investigate several aspects of locomotion in salamanders. Here we introduce a three-dimensional forward dynamics mechanical model of a salamander, with physically realistic weight and size parameters. Movements of the four limbs and of the trunk and tail are generated by sets of linearly modeled skeletal muscles. In this study, activation of these muscles were driven by prescribed neural output patterns. The model was successfully used to mimic locomotion on level ground and in water. We compare the walking gait where a wave of activity in the axial muscles travels between the girdles, with the trotting gait in simulations using the musculo-mechanical model. In a separate experiment, the model is used to compare different strategies for turning while stepping; either by bending the trunk or by using side-stepping in the front legs. We found that for turning, the use of side-stepping alone or in combination with trunk bending, was more effective than the use of trunk bending alone. We conclude that the musculo-mechanical model described here together with a proper neural controller is useful for neuro-physiological experiments in silico.

Computer-assisted 3D kinematic analysis of all leg joints in walking insects

High-speed video can provide fine-scaled analysis of animal behavior. However, extracting behavioral data from video sequences is a time-consuming, tedious, subjective task. These issues are exacerbated where accurate behavioral descriptions require analysis of multiple points in three dimensions. We describe a new computer program written to assist a user in simultaneously extracting three-dimensional kinematics of multiple points on each of an insect's six legs. Digital video of a walking cockroach was collected in grayscale at 500 fps from two synchronized, calibrated cameras. We improved the legs' visibility by painting white dots on the joints, similar to techniques used for digitizing human motion. Compared to manual digitization of 26 points on the legs over a single, 8-second bout of walking (or 106,496 individual 3D points), our software achieved approximately 90% of the accuracy with 10% of the labor. Our experimental design reduced the complexity of the tracking problem by tethering the insect and allowing it to walk in place on a lightly oiled glass surface, but in principle, the algorithms implemented are extensible to free walking. Our software is free and open-source, written in the free language Python and including a graphical user interface for configuration and control. We encourage collaborative enhancements to make this tool both better and widely utilized.

Activity Patterns and Timing of Muscle Activity in the Forward Walking and Backward Walking Stick Insect Carausius morosus

Understanding how animals control locomotion in different behaviors requires understanding both the kinematics of leg movements and the neural activity underlying these movements. Stick insect leg kinematics differ in forward and backward walking. Describing leg muscle activity in these behaviors is a first step toward understanding the neuronal basis for these differences. We report here the phasing of EMG activities and latencies of first spikes relative to precise electrical measurements of middle leg tarsus touchdown and liftoff of three pairs ( protractor/retractor coxae, levator/depressor trochanteris, extensor/flexor tibiae) of stick insect middle leg antagonistic muscles that play central roles in generating leg movements during forward and backward straight walking. Forward walking stance phase muscle (depressor, flexor, and retractor) activities were tightly coupled to touchdown, beginning on average 93 ms prior to and 9 and 35 ms after touchdown, respectively. Forward walking swing phase muscle (levator, extensor, and protractor) activities were less tightly coupled to liftoff, beginning on average 100, 67, and 37 ms before liftoff, respectively. In backward walking the protractor/retractor muscles reversed their phasing compared with forward walking, with the retractor being active during swing and the protractor during stance. Comparison of intact animal and reduced two- and one-middle-leg preparations during forward straight walking showed only small alterations in overall EMG activity but changes in first spike latencies in most muscles. Changing body height, most likely due to changes in leg joint loading, altered the intensity, but not the timing, of depressor muscle activity.

Robot navigation: implications from search strategies in exploring crayfish

Biomimetic applications play an important role in informing the field of robotics. One aspect is navigation – a skill automobile robots require to perform useful tasks. A sub-area of this is search strategies, e.g. for search and rescue, demining, exploring surfaces of other planets or as a default strategy when other navigation mechanisms fail. Despite that, only a few approaches have been made to transfer biological knowledge of search mechanisms on surfaces along the ground into biomimetic applications. To provide insight for robot navigation strategies, this study describes the paths a crayfish used to explore terrain. We tracked movement when different sets of sensory input were available. We then tested this algorithm with a computer model crayfish and concluded that the movement ofC. destructorhas a specialised walking strategy that could provide a suitable baseline algorithm for autonomous mobile robots during navigation.

Control of stepping velocity in the stick insect Carausius morosus

We performed electrophysiological and behavioral experiments in single-leg preparations and intact animals of the stick insect Carausius morosus to understand mechanisms underlying the control of walking speed. At the level of the single leg, we found no significant correlation between stepping velocity and spike frequency of motor neurons (MNs) other than the previously shown modification in flexor (stance) MN activity. However, pauses between stance and swing motoneuron activity at the transition from stance to swing phase and stepping velocity are correlated. Pauses become shorter with increasing speed and completely disappear during fast stepping sequences. By means of extra- and intracellular recordings in single-leg stick insect preparations we found no systematic relationship between the velocity of a stepping front leg and the motoneuronal activity in the ipsi- or contralateral mesothoracic protractor and retractor, as well as flexor and extensor MNs. The observations on the lack of coordination of stepping velocity between legs in single-leg preparations were confirmed in behavioral experiments with intact stick insects tethered above a slippery surface, thereby effectively removing mechanical coupling through the ground. In this situation, there were again no systematic correlations between the stepping velocities of different legs, despite the finding that an increase in stepping velocity in a single front leg is correlated with a general increase in nerve activity in all connectives between the subesophageal and all thoracic ganglia. However, when the tethered animal increased walking speed due to a short tactile stimulus, provoking an escape-like response, stepping velocities of ipsilateral legs were found to be correlated for several steps. These results indicate that there is no permanent coordination of stepping velocities between legs, but that such coordination can be activated under certain circumstances.

Straight walking and turning on a slippery surface

In stick insects, walking is the result of the co-action of different pattern generators for the single legs and coordinating inter-leg influences. We have used a slippery surface setup to understand the role the local neuronal processing in the thoracic ganglia plays in the ability of the animal to show turning movements. To achieve this, we removed the influence of mechanical coupling through the ground by using the slippery surface and removed sensory input by the successive amputation of neighboring legs. We analyzed the walking pattern of the front, middle and hind legs of tethered animals mounted above the surface and compared the kinematics of the straight walking legs with those of the curve walking inside and outside legs. The walking pattern was monitored both electrically through tarsal contact measurement and optically by using synchronized high-speed video. The vectors of leg movement are presented for the intact and a reduced preparation. Animals showed the ability to walk in a coordinated fashion on the slippery surface. Upon change from straight to curve walking, the stride length for the inside legs shortens and the vector of movement of the inner legs changes to pull the animal into the curve, while the outer legs act to pull and push it into the turn. In the reduced two-leg and in the single-leg preparation the behavior of the legs remained largely unchanged in the behavioral contexts of straight walking or turning with only small changes in the extreme positions. This suggests that the single stepping legs perform given motor programs on the slippery surface in a fashion that is highly independent not only of mechanical coupling between but also of the presence of the other legs.

Tight turns in stick insects

We investigated insects Carausius morosus walking whilst hanging upside down along a narrow 3 mm horizontal beam. At the end of the beam, the animal takes a 180 degrees turn. This is a difficult situation because substrate area is small and moves relative to the body during the turn. We investigated how leg movements are organised during this turn. A non-contact of either front leg appears to indicate the end of the beam. However, a turn can only begin if the hind legs stand in an appropriate position relative to each other; the outer hind leg must not be placed posterior to the inner hind leg. When starting the turn, both front legs are lifted and usually held in a relatively stable position and then the inner middle leg performs a swing-and-search movement: The leg begins a swing, which is continued by a searching movement to the side and to the rear, and eventually grasps the beam. At the same time the body is turned usually being supported by the outer middle leg and both hind legs. Then front legs followed by the outer middle leg reach the beam. A scheme describing the turns based on a few simple behavioural elements is proposed.

Place memory in crickets

Certain insect species are known to relocate nest or food sites using landmarks, but the generality of this capability among insects, and whether insect place memory can be used in novel task settings, is not known. We tested the ability of crickets to use surrounding visual cues to relocate an invisible target in an analogue of the Morris water maze, a standard paradigm for spatial memory tests on rodents. Adult female Gryllus bimaculatus were released into an arena with a floor heated to an aversive temperature, with one hidden cool spot. Over 10 trials, the time taken to find the cool spot decreased significantly. The best performance was obtained when a natural scene was provided on the arena walls. Animals can relocate the position from novel starting points. When the scene is rotated, they preferentially approach the fictive target position corresponding to the rotation. We note that this navigational capability does not necessarily imply the animal has an internal spatial representation.

Front leg movements and tibial motoneurons underlying auditory steering in the cricket (Gryllus bimaculatus deGeer)

Front leg movements in the cricket (Gryllus bimaculatus) were measured during phonotactic steering on a trackball together with electromyogram recordings of the tibial extensor and flexor muscles. Up-down leg movements clearly indicated the step cycle and were independent of auditory stimulation. By contrast, left-right movements of the front leg were dependent on sound direction, with crickets performing rapid steering leg movements towards the active speaker. Steering movements were dependent on the phase of sound relative to the step cycle, and were greatest for sounds occurring during the swing phase. During phonotaxis the slow extensor tibiae motoneuron responded to ipsilateral sounds with a latency of 35-40 ms, whereas the fast flexor tibiae motoneurons were excited by contralateral sound. We made intracellular recordings of two tibial extensor and at least eight flexor motoneurons. The fast extensor tibiae, the slow extensor tibiae and one fast flexor tibiae motoneurons were individually identifiable, but a group of at least four fast flexor tibiae as well as at least three slow flexor tibiae motoneurons of highly similar morphology could not be distinguished. Motoneurons received descending inputs from cephalic ganglia and from local prothoracic networks. There was no overlap between the dendritic fields of the tibial motoneurons and the auditory neuropile. They did not respond to auditory stimulation at rest. Neither extracellular stimulation of descending pathways nor pharmacological activation of prothoracic motor networks changed the auditory responsiveness. Therefore, any auditory input to tibial motoneurons is likely to be indirect, possibly via the brain.