Central-complex control of movement in the freely walking cockroach

Design process and tools for dynamic neuromechanical models and robot controllers

We present a serial design process with associated tools to select parameter values for a posture and locomotion controller for simulation of a robot. The controller is constructed from dynamic neuron and synapse models and simulated with the open-source neuromechanical simulator AnimatLab 2. Each joint has a central pattern generator (CPG), whose neurons possess persistent sodium channels. The CPG rhythmically inhibits motor neurons that control the servomotor's velocity. Sensory information coordinates the joints in the leg into a cohesive stepping motion. The parameter value design process is intended to run on a desktop computer, and has three steps. First, our tool FEEDBACKDESIGN uses classical control methods to find neural and synaptic parameter values that stably and robustly control servomotor output. This method is fast, testing over 100 parameter value variations per minute. Next, our tool CPGDESIGN generates bifurcation diagrams and phase response curves for the CPG model. This reveals neural and synaptic parameter values that produce robust oscillation cycles, whose phase can be rapidly entrained to sensory feedback. It also designs the synaptic conductance of inter-joint pathways. Finally, to understand sensitivity to parameters and how descending commands affect a leg's stepping motion, our tool SIMSCAN runs batches of neuromechanical simulations with specified parameter values, which is useful for searching the parameter space of a complicated simulation. These design tools are demonstrated on a simulation of a robot, but may be applied to neuromechanical animal models or physical robots as well.

Spatial Navigation and the Central Complex: Sensory Acquisition, Orientation, and Motor Control

Cockroaches are scavengers that forage through dark, maze-like environments. Like other foraging animals, for instance rats, they must continually asses their situation to keep track of targets and negotiate barriers. While navigating a complex environment, all animals need to integrate sensory information in order to produce appropriate motor commands. The integrated sensory cues can be used to provide the animal with an environmental and contextual reference frame for the behavior. To successfully reach a goal location, navigational cues continuously derived from sensory inputs have to be utilized in the spatial guidance of motor commands. The sensory processes, contextual and spatial mechanisms, and motor outputs contributing to navigation have been heavily studied in rats. In contrast, many insect studies focused on the sensory and/or motor components of navigation, and our knowledge of the abstract representation of environmental context and spatial information in the insect brain is relatively limited. Recent reports from several laboratories have explored the role of the central complex (CX), a sensorimotor region of the insect brain, in navigational processes by recording the activity of CX neurons in freely-moving insects and in more constrained, experimenter-controlled situations. The results of these studies indicate that the CX participates in processing the temporal and spatial components of sensory cues, and utilizes these cues in creating an internal representation of orientation and context, while also directing motor control. Although these studies led to a better understanding of the CX's role in insect navigation, there are still major voids in the literature regarding the underlying mechanisms and brain regions involved in spatial navigation. The main goal of this review is to place the above listed findings in the wider context of animal navigation by providing an overview of the neural mechanisms of navigation in rats and summarizing and comparing our current knowledge on the CX's role in insect navigation to these processes. By doing so, we aimed to highlight some of the missing puzzle pieces in insect navigation and provide a different perspective for future directions.

Rigidity and Flexibility: The Central Basis of Inter-Leg Coordination in the Locust

Many motor behaviors, and specifically locomotion, are the product of an intricate interplay between neuronal oscillators known as central pattern generators (CPGs), descending central commands, and sensory feedback loops. The relative contribution of each of these components to the final behavior determines the trade-off between fixed movements and those that are carefully adapted to the environment. Here we sought to decipher the endogenous, default, motor output of the CPG network controlling the locust legs, in the absence of any sensory or descending influences. We induced rhythmic activity in the leg CPGs in isolated nervous system preparations, using different application procedures of the muscarinic agonist pilocarpine. We found that the three thoracic ganglia, each controlling a pair of legs, have different inherent bilateral coupling. Furthermore, we found that the pharmacological activation of one ganglion is sufficient to induce activity in the other, untreated, ganglia. Each ganglion was thus capable to impart its own bilateral inherent pattern onto the other ganglia via a tight synchrony among the ipsilateral CPGs. By cutting a connective and severing the lateral-longitudinal connections, we were able to uncouple the oscillators’ activity. While the bilateral connections demonstrated a high modularity, the ipsilateral CPGs maintained a strict synchronized activity. These findings suggest that the central infrastructure behind locust walking features both rigid elements, which presumably support the generation of stereotypic orchestrated leg movements, and flexible elements, which might provide the central basis for adaptations to the environment and to higher motor commands.

Angular velocity integration in a fly heading circuit

Many animals maintain an internal representation of their heading as they move through their surroundings. Such a compass representation was recently discovered in a neural population in the Drosophila melanogaster central complex, a brain region implicated in spatial navigation. Here, we use two-photon calcium imaging and electrophysiology in head-fixed walking flies to identify a different neural population that conjunctively encodes heading and angular velocity, and is excited selectively by turns in either the clockwise or counterclockwise direction. We show how these mirror-symmetric turn responses combine with the neurons' connectivity to the compass neurons to create an elegant mechanism for updating the fly's heading representation when the animal turns in darkness. This mechanism, which employs recurrent loops with an angular shift, bears a resemblance to those proposed in theoretical models for rodent head direction cells. Our results provide a striking example of structure matching function for a broadly relevant computation.

Mechanosensation and Adaptive Motor Control in Insects

The ability of animals to flexibly navigate through complex environments depends on the integration of sensory information with motor commands. The sensory modality most tightly linked to motor control is mechanosensation. Adaptive motor control depends critically on an animal's ability to respond to mechanical forces generated both within and outside the body. The compact neural circuits of insects provide appealing systems to investigate how mechanical cues guide locomotion in rugged environments. Here, we review our current understanding of mechanosensation in insects and its role in adaptive motor control. We first examine the detection and encoding of mechanical forces by primary mechanoreceptor neurons. We then discuss how central circuits integrate and transform mechanosensory information to guide locomotion. Because most studies in this field have been performed in locusts, cockroaches, crickets, and stick insects, the examples we cite here are drawn mainly from these 'big insects'. However, we also pay particular attention to the tiny fruit fly, Drosophila, where new tools are creating new opportunities, particularly for understanding central circuits. Our aim is to show how studies of big insects have yielded fundamental insights relevant to mechanosensation in all animals, and also to point out how the Drosophila toolkit can contribute to future progress in understanding mechanosensory processing.

Dopamine- and Tyrosine Hydroxylase-Immunoreactive Neurons in the Brain of the American Cockroach, Periplaneta americana

The catecholamine dopamine plays several vital roles in the central nervous system of many species, but its neural mechanisms remain elusive. Detailed neuroanatomical characterization of dopamine neurons is a prerequisite for elucidating dopamine’s actions in the brain. In the present study, we investigated the distribution of dopaminergic neurons in the brain of the American cockroach, Periplaneta americana, using two antisera: 1) an antiserum against dopamine, and 2) an antiserum against tyrosine hydroxylase (TH, an enzyme required for dopamine synthesis), and identified about 250 putatively dopaminergic neurons. The patterns of dopamine- and TH-immunoreactive neurons were strikingly similar, suggesting that both antisera recognize the same sets of “dopaminergic” neurons. The dopamine and TH antibodies intensively or moderately immunolabeled prominent brain neuropils, e.g. the mushroom body (memory center), antennal lobe (first-order olfactory center) and central complex (motor coordination center). All subdivisions of the mushroom body exhibit both dopamine and TH immunoreactivity. Comparison of immunolabeled neurons with those filled by dye injection revealed that a group of immunolabeled neurons with cell bodies near the calyx projects into a distal region of the vertical lobe, which is a plausible site for olfactory memory formation in insects. In the antennal lobe, ordinary glomeruli as well as macroglomeruli exhibit both dopamine and TH immunoreactivity. It is noteworthy that the dopamine antiserum labeled tiny granular structures inside the glomeruli whereas the TH antiserum labeled processes in the marginal regions of the glomeruli, suggesting a different origin. In the central complex, all subdivisions excluding part of the noduli and protocerebral bridge exhibit both dopamine and TH immunoreactivity. These anatomical findings will accelerate our understanding of dopaminergic systems, specifically in neural circuits underlying aversive memory formation and arousal, in insects.

Cellular Basis of Head Direction and Contextual Cues in the Insect Brain

Animals rely upon integrated sensory information for spatial navigation. A question of wide importance in navigation is how sensory cues get transformed into neural codes that represent the animal's orientation within its proximal environment. Here, we investigated the possibility of head-direction coding in the central complex of the cockroach, Blaberus discoidalis. We used extracellular recordings in restrained animals that were rotated on a platform relative to a fixed landmark. The passive rotations allowed us to test for head-direction coding in the absence of self-generated motion cues. Our results indicate that individual cells in the central complex encode the animal's heading relative to a landmark's position in several ways. In some cells, directional tuning was established even in the absence of visual cues, suggesting that the directional code can be maintained solely based on the internal motion cues derived from the passive rotations. Additionally, some cells in the central complex encoded rotation-direction history, a navigational context cue, by increasing or decreasing the firing rate during the stationary periods following clockwise or counterclockwise rotations. Together, these results unveil head-direction cell-like activity in the insect central complex, which highly resemble similarly functioning cells in the mammalian brain that encode head direction. We predict that the observed head-orientation coding and directionally sensitive cells are essential components of the brain circuitry mediating insect navigation.

Comparative Neuroanatomy of the Lateral Accessory Lobe in the Insect Brain

The lateral accessory lobe (LAL) mediates signals from the central complex to the thoracic motor centers. The results obtained from different insects suggest that the LAL is highly relevant to the locomotion. Perhaps due to its deep location and lack of clear anatomical boundaries, few studies have focused on this brain region. Systematic data of LAL interneurons are available in the silkmoth. We here review individual neurons constituting the LAL by comparing the silkmoth and other insects. The survey through the connectivity and intrinsic organization suggests potential homology in the organization of the LAL among insects.

Neural mechanisms of insect navigation

We know more about the ethology of insect navigation than the neural substrates. Few studies have shown direct effects of brain manipulation on navigational behaviour; or measure brain responses that clearly relate to the animal's current location or spatial target, independently of specific sensory cues. This is partly due to the methodological problems of obtaining neural data in a naturally behaving animal. However, substantial indirect evidence, such as comparative anatomy and knowledge of the neural circuits that provide relevant sensory inputs provide converging arguments for the role of some specific brain areas: the mushroom bodies; and the central complex. Finally, modelling can help bridge the gap by relating the computational requirements of a given navigational task to the type of computation offered by different brain areas.

Body side-specific control of motor activity during turning in a walking animal

Animals and humans need to move deftly and flexibly to adapt to environmental demands. Despite a large body of work on the neural control of walking in invertebrates and vertebrates alike, the mechanisms underlying the motor flexibility that is needed to adjust the motor behavior remain largely unknown. Here, we investigated optomotor-induced turning and the neuronal mechanisms underlying the differences between the leg movements of the two body sides in the stick insect Carausius morosus. We present data to show that the generation of turning kinematics in an insect are the combined result of descending unilateral commands that change the leg motor output via task-specific modifications in the processing of local sensory feedback as well as modification of the activity of local central pattern generating networks in a body-side-specific way. To our knowledge, this is the first study to demonstrate the specificity of such modifications in a defined motor task.

DOI:http://dx.doi.org/10.7554/eLife.13799.001

Walking along a curve or turning is a complex manoeuvre for the nervous system, as it must coordinate different leg movements on each side of the body. Rhythmic processes such as walking are controlled by networks of neurons called central pattern generators. The resulting movements can be adjusted by feedback from sense organs in response to environmental conditions. For example, sensory feedback that provides information about the load placed on each leg, allows the animal to control the duration of a stance. How the nerve cells, or neurons, involved in these processes work together to produce complex, flexible movements such as turning is largely unknown.

Previous work on how the brain negotiates turning movements has been carried out mostly in animals that swim or fly. To understand what happens during walking, Gruhn et al. monitored stick insects that walked in a curve on a slippery surface, and recorded the electrical activity within the animals' nervous system as they turned.

By comparing the activity of the nervous system on each side of the body while the insects walked a curve, Gruhn et al. found that the nervous system uses at least three different mechanisms to produce the different movements on the inside and outside. Firstly, the sensory feedback signals that communicate the load on the leg are processed in the legs on the outside of the curve to support forward steps, while they are processed on the inside legs to support forward, sideward, and backward steps. Secondly, the motor activity produced by the central pattern generator is modulated to be stronger for the muscle that moves the leg backward on the outside of the curve. At the same time, this activity is stronger for the muscle that moves the leg forward on the inside of the curve. Thirdly, signals from a front leg influence the movement of the other legs on the same side of the body. This influence is strong on the inside and weak on the outside of the curve.

Together or separately, these three mechanisms could provide the animal with the means to perform turns in all their different curvatures. Future work will need to work out exactly which local neurons process the signals sent from the brain to control movement.

DOI:http://dx.doi.org/10.7554/eLife.13799.002

Studying small brains to understand the building blocks of cognition

Cognition encompasses a range of higher-order mental processes, such as attention, working memory, and model-based decision-making. These processes are thought to involve the dynamic interaction of multiple central brain regions. A mechanistic understanding of such computations requires not only monitoring and manipulating specific neural populations during behavior, but also knowing the connectivity of the underlying circuitry. These goals are experimentally challenging in mammals, but are feasible in numerically simpler insect brains. In Drosophila melanogaster in particular, genetic tools enable precisely targeted physiology and optogenetics in actively behaving animals. In this article we discuss how these advantages are increasingly being leveraged to study abstract neural representations and sensorimotor computations that may be relevant for cognition in both insects and mammals.