Cycle-to-Cycle Variability of Neuromuscular Activity inAplysiaFeeding Behavior

Modulation by Neuropeptides with Overlapping Targets Results in Functional Overlap in Oscillatory Circuit Activation

Neuromodulation lends flexibility to neural circuit operation but the general notion that different neuromodulators sculpt neural circuit activity into distinct and characteristic patterns is complicated by interindividual variability. In addition, some neuromodulators converge onto the same signaling pathways, with similar effects on neurons and synapses. We compared the effects of three neuropeptides on the rhythmic pyloric circuit in the stomatogastric ganglion of male crabs, Cancer borealis Proctolin (PROC), crustacean cardioactive peptide (CCAP), and red pigment concentrating hormone (RPCH) activate the same modulatory inward current, I MI, and have convergent actions on synapses. However, while PROC targets all four neuron types in the core pyloric circuit, CCAP and RPCH target the same subset of only two neurons. After removal of spontaneous neuromodulator release, none of the neuropeptides restored the control cycle frequency, but all restored the relative timing between neuron types. Consequently, differences between neuropeptide effects were mainly found in the spiking activity of different neuron types. We performed statistical comparisons using the Euclidean distance in the multidimensional space of normalized output attributes to obtain a single measure of difference between modulatory states. Across preparations, the circuit output in PROC was distinguishable from CCAP and RPCH, but CCAP and RPCH were not distinguishable from each other. However, we argue that even between PROC and the other two neuropeptides, population data overlapped enough to prevent reliable identification of individual output patterns as characteristic for a specific neuropeptide. We confirmed this notion by showing that blind classifications by machine learning algorithms were only moderately successful.Significance Statement It is commonly assumed that distinct behaviors or circuit activities can be elicited by different neuromodulators. Yet it is unknown to what extent these characteristic actions remain distinct across individuals. We use a well-studied circuit model of neuromodulation to examine the effects of three neuropeptides, each known to produce a distinct activity pattern in controlled studies. We find that, when compared across individuals, the three peptides elicit activity patterns that are either statistically indistinguishable or show too much overlap to be labeled characteristic. We ascribe this to interindividual variability and overlapping subcellular actions of the modulators. Because both factors are common in all neural circuits, these findings have broad significance for understanding chemical neuromodulatory actions while considering interindividual variability.

A hierarchical model for external electrical control of an insect, accounting for inter-individual variation of muscle force properties

Cyborg control of insect movement is promising for developing miniature, high-mobility, and efficient biohybrid robots. However, considering the inter-individual variation of the insect neuromuscular apparatus and its neural control is challenging. We propose a hierarchical model including inter-individual variation of muscle properties of three leg muscles involved in propulsion (retractor coxae), joint stiffness (pro- and retractor coxae), and stance-swing transition (protractor coxae and levator trochanteris) in the stick insect Carausius morosus. To estimate mechanical effects induced by external muscle stimulation, the model is based on the systematic evaluation of joint torques as functions of electrical stimulation parameters. A nearly linear relationship between the stimulus burst duration and generated torque was observed. This stimulus-torque characteristic holds for burst durations of up to 500ms, corresponding to the stance and swing phase durations of medium to fast walking stick insects. Hierarchical Bayesian modeling revealed that linearity of the stimulus-torque characteristic was invariant, with individually varying slopes. Individual prediction of joint torques provides significant benefits for precise cyborg control.

The brain as a dynamically active organ

Nervous systems are typically described as static networks passively responding to external stimuli (i.e., the 'sensorimotor hypothesis'). However, for more than a century now, evidence has been accumulating that this passive-static perspective is wrong. Instead, evidence suggests that nervous systems dynamically change their connectivity and actively generate behavior so their owners can achieve goals in the world, some of which involve controlling their sensory feedback. This review provides a brief overview of the different historical perspectives on general brain function and details some select modern examples falsifying the sensorimotor hypothesis.

Synaptic mechanisms for motor variability in a feedforward network

Behavioral variability often arises from variable activity in the behavior-generating neural network. The synaptic mechanisms underlying this variability are poorly understood. We show that synaptic noise, in conjunction with weak feedforward excitation, generates variable motor output in the Aplysia feeding system. A command-like neuron (CBI-10) triggers rhythmic motor programs more variable than programs triggered by CBI-2. CBI-10 weakly excites a pivotal pattern-generating interneuron (B34) strongly activated by CBI-2. The activation properties of B34 substantially account for the degree of program variability. CBI-10- and CBI-2-induced EPSPs in B34 vary in amplitude across trials, suggesting that there is synaptic noise. Computational studies show that synaptic noise is required for program variability. Further, at network state transition points when synaptic conductance is low, maximum program variability is promoted by moderate noise levels. Thus, synaptic strength and noise act together in a nonlinear manner to determine the degree of variability within a feedforward network.

Aplysia Locomotion: Network and Behavioral Actions of GdFFD, a D-Amino Acid-Containing Neuropeptide

One emerging principle is that neuromodulators, such as neuropeptides, regulate multiple behaviors, particularly motivated behaviors, e.g., feeding and locomotion. However, how neuromodulators act on multiple neural networks to exert their actions remains poorly understood. These actions depend on the chemical form of the peptide, e.g., an alternation of L- to D- form of an amino acid can endow the peptide with bioactivity, as is the case for the Aplysia peptide GdFFD (where dF indicates D-phenylalanine). GdFFD has been shown to act as an extrinsic neuromodulator in the feeding network, while the all L-amino acid form, GFFD, was not bioactive. Given that both GdFFD/GFFD are also present in pedal neurons that mediate locomotion, we sought to determine whether they impact locomotion. We first examined effects of both peptides on isolated ganglia, and monitored fictive programs using the parapedal commissural nerve (PPCN). Indeed, GdFFD was bioactive and GFFD was not. GdFFD increased the frequency with which neural activity was observed in the PPCN. In part, there was an increase in bursting spiking activity that resembled fictive locomotion. Additionally, there was significant activity between bursts. To determine how the peptide-induced activity in the isolated CNS is translated into behavior, we recorded animal movements, and developed a computer program to automatically track the animal and calculate the path of movement and velocity of locomotion. We found that GdFFD significantly reduced locomotion and induced a foot curl. These data suggest that the increase in PPCN activity observed in the isolated CNS during GdFFD application corresponds to a reduction, rather than an increase, in locomotion. In contrast, GFFD had no effect. Thus, our study suggests that GdFFD may act as an intrinsic neuromodulator in the Aplysia locomotor network. More generally, our study indicates that physiological and behavioral analyses should be combined to evaluate peptide actions.

Sensory-Motor Integration: More Variability Reduces Individuality

Motor neural networks and muscles produce identifiably common outputs, such as a trot or gallop, despite varations in intrinsic properties across individuals. New work shows that sensory input can induce the requisite decrease in across-individual variability even as it increases within-individual variability.

Sensory Feedback Reduces Individuality by Increasing Variability within Subjects

Behavioral variability is ubiquitous [1-6], yet variability is more than just noise. Indeed, humans exploit their individual motor variability to improve tracing and reaching tasks [7]. What controls motor variability? Increasing the variability of sensory input, or applying force perturbations during a task, increases task variability [8, 9]. Sensory feedback may also increase task-irrelevant variability [9, 10]. In contrast, sensory feedback during locust flight or to multiple cortical areas just prior to task performance decreases variability during task-relevant motor behavior [11, 12]. Thus, how sensory feedback affects both task-relevant and task-irrelevant motor outputs must be understood. Furthermore, since motor control is studied in populations, the effects of sensory feedback on variability must also be understood within and across subjects. For example, during locomotion, each step may vary within and across individuals, even when behavior is normalized by step cycle duration [13]. Our previous work demonstrated that motor components that matter for effective behavior show less individuality [14]. Is sensory feedback the mechanism for reducing individuality? We analyzed durations and relative timings of motor pools within swallowing motor patterns in the presence and absence of sensory feedback and related these motor program components to behavior. Here, at the level of identified motor neurons, we show that sensory feedback to motor program components highly correlated with behavioral efficacy reduces variability across subjects but-surprisingly-increases variability within subjects. By controlling intrinsic, individual differences in motor neuronal activity, sensory feedback provides each subject access to a common solution space.

Feedback control of variability in the cycle period of a central pattern generator

We address how feedback to a bursting biological pacemaker with intrinsic variability in cycle length can affect that variability. Specifically, we examine a hybrid circuit constructed of an isolated crab anterior burster (AB)/pyloric dilator (PD) pyloric pacemaker receiving virtual feedback via dynamic clamp. This virtual feedback generates artificial synaptic input to PD with timing determined by adjustable phase response dynamics that mimic average burst intervals generated by the lateral pyloric neuron (LP) in the intact pyloric network. Using this system, we measure network period variability dependence on the feedback element's phase response dynamics and find that a constant response interval confers minimum variability. We further find that these optimal dynamics are characteristic of the biological pyloric network. Building upon our previous theoretical work mapping the firing intervals in one cycle onto the firing intervals in the next cycle, we create a theoretical map of the distribution of all firing intervals in one cycle to the distribution of firing intervals in the next cycle. We then obtain an integral equation for a stationary self-consistent distribution of the network periods of the hybrid circuit, which can be solved numerically given the uncoupled pacemaker's distribution of intrinsic periods, the nature of the network's feedback, and the phase resetting characteristics of the pacemaker. The stationary distributions obtained in this manner are strongly predictive of the experimentally observed distributions of hybrid network period. This theoretical framework can provide insight into optimal feedback schemes for minimizing variability to increase reliability or maximizing variability to increase flexibility in central pattern generators driven by pacemakers with feedback.

Specificity of repetition priming: the role of chemical coding

We investigate stimulus specificity of repetition priming in a tractable model system; the feeding network of Aplysia. Previous studies primarily focused on an aspect of behavior that is altered during ingestive priming, radula opening. Priming of radula opening occurs when two modulatory peptides [feeding circuit activating peptide (FCAP) and cerebral peptide-2 (CP-2)] are released from the cholinergic command-like neuron cerebral buccal interneuron 2. Effects of FCAP/CP-2 on radula opening motor neurons are cAMP mediated. The present experiments sought to determine whether FCAP/CP-2 and cAMP are also involved in the priming of radula opening during an incompatible activity, i.e., during egestive motor programs. Egestive priming is induced when motor programs are triggered by afferents with processes in the esophageal nerve. We demonstrate that egestive priming is not FCAP/CP-2 mediated. Instead, it is induced by an unrelated peptide (small cardioactive peptide), which exerts PKC-mediated effects. Our data, therefore, suggest that different feeding motor programs are primed via actions of different sets of intercellular and intracellular substances. We suggest that this accounts for the stimulus specificity that can be characteristic of repetition priming. Different stimuli activate different central pattern generator inputs. These inputs release different modulators, which induce functionally distinct motor programs.

Motor neuronal activity varies least among individuals when it matters most for behavior

How does motor neuronal variability affect behavior? To explore this question, we quantified activity of multiple individual identified motor neurons mediating biting and swallowing in intact, behaving Aplysia californica by recording from the protractor muscle and the three nerves containing the majority of motor neurons controlling the feeding musculature. We measured multiple motor components: duration of the activity of identified motor neurons as well as their relative timing. At the same time, we measured behavioral efficacy: amplitude of grasping movement during biting and amplitude of net inward food movement during swallowing. We observed that the total duration of the behaviors varied: Within animals, biting duration shortened from the first to the second and third bites; between animals, biting and swallowing durations varied. To study other sources of variation, motor components were divided by behavior duration (i.e., normalized). Even after normalization, distributions of motor component durations could distinguish animals as unique individuals. However, the degree to which a motor component varied among individuals depended on the role of that motor component in a behavior. Motor neuronal activity that was essential for the expression of biting or swallowing was similar among animals, whereas motor neuronal activity that was not essential for that behavior varied more from individual to individual. These results suggest that motor neuronal activity that matters most for the expression of a particular behavior may vary least from individual to individual. Shaping individual variability to ensure behavioral efficacy may be a general principle for the operation of motor systems.

The neuromuscular transform of the lobster cardiac system explains the opposing effects of a neuromodulator on muscle output

Motor neuron activity is transformed into muscle movement through a cascade of complex molecular and biomechanical events. This nonlinear mapping of neural inputs to motor behaviors is called the neuromuscular transform (NMT). We examined the NMT in the cardiac system of the lobster Homarus americanus by stimulating a cardiac motor nerve with rhythmic bursts of action potentials and measuring muscle movements in response to different stimulation patterns. The NMT was similar across preparations, which suggested that it could be used to predict muscle movement from spontaneous neural activity in the intact heart. We assessed this possibility across semi-intact heart preparations in two separate analyses. First, we performed a linear regression analysis across 122 preparations in physiological saline to predict muscle movements from neural activity. Under these conditions, the NMT was predictive of contraction duty cycle but was unable to predict contraction amplitude, likely as a result of uncontrolled interanimal variability. Second, we assessed the ability of the NMT to predict changes in motor output induced by the neuropeptide C-type allatostatin. Wiwatpanit et al. (2012) showed that bath application of C-type allatostatin produced either increases or decreases in the amplitude of the lobster heart contractions. We show that an important component of these preparation-dependent effects can arise from quantifiable differences in the basal state of each preparation and the nonlinear form of the NMT. These results illustrate how properly characterizing the relationships between neural activity and measurable physiological outputs can provide insight into seemingly idiosyncratic effects of neuromodulators across individuals.

Molluscan cells in culture: primary cell cultures and cell lines

In vitro cell culture systems from molluscs have significantly contributed to our basic understanding of complex physiological processes occurring within or between tissue-specific cells, yielding information unattainable using intact animal models. In vitro cultures of neuronal cells from gastropods show how simplified cell models can inform our understanding of complex networks in intact organisms. Primary cell cultures from marine and freshwater bivalve and gastropod species are used as biomonitors for environmental contaminants, as models for gene transfer technologies, and for studies of innate immunity and neoplastic disease. Despite efforts to isolate proliferative cell lines from molluscs, the snail Biomphalaria glabrata Say, 1818 embryonic (Bge) cell line is the only existing cell line originating from any molluscan species. Taking an organ systems approach, this review summarizes efforts to establish molluscan cell cultures and describes the varied applications of primary cell cultures in research. Because of the unique status of the Bge cell line, an account is presented of the establishment of this cell line, and of how these cells have contributed to our understanding of snail host-parasite interactions. Finally, we detail the difficulties commonly encountered in efforts to establish cell lines from molluscs and discuss how these difficulties might be overcome.

Animal-to-animal variability in the phasing of the crustacean cardiac motor pattern: an experimental and computational analysis

The cardiac ganglion (CG) of Homarus americanus is a central pattern generator that consists of two oscillatory groups of neurons: "small cells" (SCs) and "large cells" (LCs). We have shown that SCs and LCs begin their bursts nearly simultaneously but end their bursts at variable phases. This variability contrasts with many other central pattern generator systems in which phase is well maintained. To determine both the consequences of this variability and how CG phasing is controlled, we modeled the CG as a pair of Morris-Lecar oscillators coupled by electrical and excitatory synapses and constructed a database of 15,000 simulated networks using random parameter sets. These simulations, like our experimental results, displayed variable phase relationships, with the bursts beginning together but ending at variable phases. The model suggests that the variable phasing of the pattern has important implications for the functional role of the excitatory synapses. In networks in which the two oscillators had similar duty cycles, the excitatory coupling functioned to increase cycle frequency. In networks with disparate duty cycles, it functioned to decrease network frequency. Overall, we suggest that the phasing of the CG may vary without compromising appropriate motor output and that this variability may critically determine how the network behaves in response to manipulations.

Hill-type muscle model parameters determined from experiments on single muscles show large animal-to-animal variation

Models built using mean data can represent only a very small percentage, or none, of the population being modeled, and produce different activity than any member of it. Overcoming this "averaging" pitfall requires measuring, in single individuals in single experiments, all of the system's defining characteristics. We have developed protocols that allow all the parameters in the curves used in typical Hill-type models (passive and active force-length, series elasticity, force-activation, force-velocity) to be determined from experiments on individual stick insect muscles (Blümel et al. 2012a). A requirement for means to not well represent the population is that the population shows large variation in its defining characteristics. We therefore used these protocols to measure extensor muscle defining parameters in multiple animals. Across-animal variability in these parameters can be very large, ranging from 1.3- to 17-fold. This large variation is consistent with earlier data in which extensor muscle responses to identical motor neuron driving showed large animal-to-animal variability (Hooper et al. 2006), and suggests accurate modeling of extensor muscles requires modeling individual-by-individual. These complete characterizations of individual muscles also allowed us to test for parameter correlations. Two parameter pairs significantly co-varied, suggesting that a simpler model could as well reproduce muscle response.

Cycle-by-cycle assembly of respiratory network activity is dynamic and stochastic

Rhythmically active networks are typically composed of neurons that can be classified as silent, tonic spiking, or rhythmic bursting based on their intrinsic activity patterns. Within these networks, neurons are thought to discharge in distinct phase relationships with their overall network output, and it has been hypothesized that bursting pacemaker neurons may lead and potentially trigger cycle onsets. We used multielectrode recording from 72 experiments to test these ideas in rhythmically active slices containing the pre-Bötzinger complex, a region critical for breathing. Following synaptic blockade, respiratory neurons exhibited a gradient of intrinsic spiking to rhythmic bursting activities and thus defied an easy classification into bursting pacemaker and nonbursting categories. Features of their firing activity within the functional network were analyzed for correlation with subsequent rhythmic bursting in synaptic isolation. Higher firing rates through all phases of fictive respiration statistically predicted bursting pacemaker behavior. However, a cycle-by-cycle analysis indicated that respiratory neurons were stochastically activated with each burst. Intrinsically bursting pacemakers led some population bursts and followed others. This variability was not reproduced in traditional fully interconnected computational models, while sparsely connected network models reproduced these results both qualitatively and quantitatively. We hypothesize that pacemaker neurons do not act as clock-like drivers of the respiratory rhythm but rather play a flexible and dynamic role in the initiation and stabilization of each burst. Thus, at the behavioral level, each breath can be thought of as de novo assembly of a stochastic collaboration of network topology and intrinsic properties.

Functional organization and adaptability of a decision-making network in aplysia

Whereas major insights into the neuronal basis of adaptive behavior have been gained from the study of automatic behaviors, including reflexive and rhythmic motor acts, the neural substrates for goal-directed behaviors in which decision-making about action selection and initiation are crucial, remain poorly understood. However, the mollusk Aplysia is proving to be increasingly relevant to redressing this issue. The functional properties of the central circuits that govern this animal’s goal-directed feeding behavior and particularly the neural processes underlying the selection and initiation of specific feeding actions are becoming understood. In addition to relying on the intrinsic operation of central networks, goal-directed behaviors depend on external sensory inputs that through associative learning are able to shape decision-making strategies. Here, we will review recent findings on the functional design of the central network that generates Aplysia’s feeding-related movements and the sensory-derived plasticity that through learning can modify the selection and initiation of appropriate action. The animal’s feeding behavior and the implications of decision-making will be briefly described. The functional design of the underlying buccal network will then be used to illustrate how cellular diversity and the coordination of neuronal burst activity provide substrates for decision-making. The contribution of specific synaptic and neuronal membrane properties within the buccal circuit will also be discussed in terms of their role in motor pattern selection and initiation. The ability of learning to “rigidify” these synaptic and cellular properties so as to regularize network operation and lead to the expression of stereotyped rhythmic behavior will then be described. Finally, these aspects will be drawn into a conceptual framework of how Aplysia’s goal-directed circuitry compares to the central pattern generating networks for invertebrate rhythmic behaviors.

Variable neuronal participation in stereotypic motor programs

To what extent are motor networks underlying rhythmic behaviors rigidly hard-wired versus fluid and dynamic entities? Do the members of motor networks change from moment-to-moment or from motor program episode-to-episode? These are questions that can only be addressed in systems where it is possible to monitor the spiking activity of networks of neurons during the production of motor programs. We used large-scale voltage-sensitive dye (VSD) imaging followed by Independent Component Analysis spike-sorting to examine the extent to which the neuronal network underlying the escape swim behavior of Tritonia diomedea is hard-wired versus fluid from a moment-to-moment perspective. We found that while most neurons were dedicated to the swim network, a small but significant proportion of neurons participated in a surprisingly variable manner. These neurons joined the swim motor program late, left early, burst only on some cycles or skipped cycles of the motor program. We confirmed that this variable neuronal participation was not due to effects of the VSD by finding such neurons with intracellular recording in dye-free saline. Further, these neurons markedly varied their level of participation in the network from swim episode-to-episode. The generality of such unreliably bursting neurons was confirmed by their presence in the rhythmic escape networks of two other molluscan species, Tritonia festiva and Aplysia californica. Our observations support a view that neuronal networks, even those underlying rhythmic and stereotyped motor programs, may be more variable in structure than widely appreciated.

Molluscan neurons in culture: shedding light on synapse formation and plasticity

From genes to behaviour, the simple model system approach has played many pivotal roles in deciphering nervous system function in both invertebrates and vertebrates. However, with the advent of sophisticated imaging and recording techniques enabling the direct investigation of single vertebrate neurons, the utility of simple invertebrate organisms as model systems has been put to question. To address this subject meaningfully and comprehensively, we first review the contributions made by invertebrates in the field of neuroscience over the years, paving the way for similar breakthroughs in higher animals. In particular, we focus on molluscan (Lymnaea, Aplysia, and Helisoma) and leech (Hirudo) models and the pivotal roles they have played in elucidating mechanisms of synapse formation and plasticity. While the ultimate goal in neuroscience is to understand the workings of the human brain in both its normal and diseased states, the sheer complexity of most vertebrate models still makes it difficult to define the underlying principles of nervous system function. Investigators have thus turned to invertebrate models, which are unique with respect to their simple nervous systems that are endowed with a finite number of large, individually identifiable neurons of known function. We start off by discussing in vivo and semi-intact preparations, regarding their amenability to simple circuit analysis. Despite the 'simplicity' of invertebrate nervous systems however, it is still difficult to study individual synaptic connections in detail. We therefore emphasize in the next section, the utility of studying identified invertebrate neurons in vitro, to directly examine the development, specificity, and plasticity of synaptic connections in a well-defined environment, at a resolution that it is still unapproachable in the intact brain. We conclude with a discussion of the future of invertebrates in neuroscience in elucidating mechanisms of neurological disease and developing neuron-silicon interfaces.

Towards a scientific concept of free will as a biological trait: spontaneous actions and decision-making in invertebrates

Until the advent of modern neuroscience, free will used to be a theological and a metaphysical concept, debated with little reference to brain function. Today, with ever increasing understanding of neurons, circuits and cognition, this concept has become outdated and any metaphysical account of free will is rightfully rejected. The consequence is not, however, that we become mindless automata responding predictably to external stimuli. On the contrary, accumulating evidence also from brains much smaller than ours points towards a general organization of brain function that incorporates flexible decision-making on the basis of complex computations negotiating internal and external processing. The adaptive value of such an organization consists of being unpredictable for competitors, prey or predators, as well as being able to explore the hidden resource deterministic automats would never find. At the same time, this organization allows all animals to respond efficiently with tried-and-tested behaviours to predictable and reliable stimuli. As has been the case so many times in the history of neuroscience, invertebrate model systems are spearheading these research efforts. This comparatively recent evidence indicates that one common ability of most if not all brains is to choose among different behavioural options even in the absence of differences in the environment and perform genuinely novel acts. Therefore, it seems a reasonable effort for any neurobiologist to join and support a rather illustrious list of scholars who are trying to wrestle the term 'free will' from its metaphysical ancestry. The goal is to arrive at a scientific concept of free will, starting from these recently discovered processes with a strong emphasis on the neurobiological mechanisms underlying them.

Neural mechanisms of operant conditioning and learning-induced behavioral plasticity in Aplysia

Associative learning in goal-directed behaviors, in contrast to reflexive behaviors, can alter processes of decision-making in the selection of appropriate action and its initiation, thereby enabling animals, including humans, to gain a predictive understanding of their external environment. In the mollusc Aplysia, recent studies on appetitive operant conditioning in which the animal learns about the positive consequences of its behavior have provided insights into this form of associative learning which, although ubiquitous, remains mechanistically poorly understood. The findings support increasing evidence that central circuit- and cell-wide sites other than chemical synaptic connections, including electrical coupling and membrane conductances controlling intrinsic neuronal excitability and underlying voltage-dependent plateauing or oscillatory mechanisms, may serve as the neural substrates for behavioral plasticity resulting from operant conditioning. Aplysia therefore continues to provide a model system for understanding learning and memory formation that enables establishing the neurobiological links between behavioral, network, and cellular levels of analysis.

Beyond the wiring diagram: signalling through complex neuromodulator networks

During the computations performed by the nervous system, its 'wiring diagram'--the map of its neurons and synaptic connections--is dynamically modified and supplemented by multiple actions of neuromodulators that can be so complex that they can be thought of as constituting a biochemical network that combines with the neuronal network to perform the computation. Thus, the neuronal wiring diagram alone is not sufficient to specify, and permit us to understand, the computation that underlies behaviour. Here I review how such modulatory networks operate, the problems that their existence poses for the experimental study and conceptual understanding of the computations performed by the nervous system, and how these problems may perhaps be solved and the computations understood by considering the structural and functional 'logic' of the modulatory networks.

Motor outputs in a multitasking network: relative contributions of inputs and experience-dependent network states

Network outputs elicited by a specific stimulus may differ radically depending on the momentary network state. One class of networks states-experience-dependent states-is known to operate in numerous networks, yet the fundamental question concerning the relative role that inputs and states play in determining the network outputs remains to be investigated in a behaviorally relevant manner. Because previous work indicated that in the isolated nervous system the motor outputs of the Aplysia feeding network are affected by experience-dependent states, we sought to establish the behavioral relevance of these outputs. We analyzed the phasing of firing of radula opening motoneurons (B44 and B48) relative to other previously characterized motoneurons. We found that the overall pattern of motoneuronal firing corresponds to the phasing of movements during feeding behavior, thus indicating a behavioral relevance of network outputs. Previous studies suggested that network inputs act to trigger a response rather than to shape its characteristics, with the latter function being fulfilled by network states. We show this is an oversimplification. In a rested state, different inputs elicited distinct responses, indicating that inputs not only trigger but also shape the responses. However, depending on the combination of inputs and states, responses were either dramatically altered by the network state or were indistinguishable from those observed in the rested state. We suggest that the relative contributions of inputs and states are dynamically regulated and, rather than being fixed, depend on the specifics of states and inputs.

Neuromechanical tuning of nonlinear postural control dynamics

Postural control may be an ideal physiological motor task for elucidating general questions about the organization, diversity, flexibility, and variability of biological motor behaviors using nonlinear dynamical analysis techniques. Rather than presenting "problems" to the nervous system, the redundancy of biological systems and variability in their behaviors may actually be exploited to allow for the flexible achievement of multiple and concurrent task-level goals associated with movement. Such variability may reflect the constant "tuning" of neuromechanical elements and their interactions for movement control. The problem faced by researchers is that there is no one-to-one mapping between the task goal and the coordination of the underlying elements. We review recent and ongoing research in postural control with the goal of identifying common mechanisms underlying variability in postural control, coordination of multiple postural strategies, and transitions between them. We present a delayed-feedback model used to characterize the variability observed in muscle coordination patterns during postural responses to perturbation. We emphasize the significance of delays in physiological postural systems, requiring the modulation and coordination of both the instantaneous, "passive" response to perturbations as well as the delayed, "active" responses to perturbations. The challenge for future research lies in understanding the mechanisms and principles underlying neuromechanical tuning of and transitions between the diversity of postural behaviors. Here we describe some of our recent and ongoing studies aimed at understanding variability in postural control using physical robotic systems, human experiments, dimensional analysis, and computational models that could be enhanced from a nonlinear dynamics approach.

Predictions of phase-locking in excitatory hybrid networks: excitation does not promote phase-locking in pattern-generating networks as reliably as inhibition

Phase-locked activity is thought to underlie many high-level functions of the nervous system, the simplest of which are produced by central pattern generators (CPGs). It is not known whether we can define a theoretical framework that is sufficiently general to predict phase-locking in actual biological CPGs, nor is it known why the CPGs that have been characterized are dominated by inhibition. Previously, we applied a method based on phase response curves measured using inputs of biologically realistic amplitude and duration to predict the existence and stability of 1:1 phase-locked modes in hybrid networks of one biological and one model bursting neuron reciprocally connected with artificial inhibitory synapses. Here we extend this analysis to excitatory coupling. Using the pyloric dilator neuron from the stomatogastric ganglion of the American lobster as our biological cell, we experimentally prepared 86 networks using five biological neurons, four model neurons, and heterogeneous synapse strengths between 1 and 10,000 nS. In 77% of networks, our method was robust to biological noise and accurately predicted the phasic relationships. In 3%, our method was inaccurate. The remaining 20% were not amenable to analysis because our theoretical assumptions were violated. The high failure rate for excitation compared with inhibition was due to differential effects of noise and feedback on excitatory versus inhibitory coupling and suggests that CPGs dominated by excitatory synapses would require precise tuning to function, which may explain why CPGs rely primarily on inhibitory synapses.

Predicting adaptive behavior in the environment from central nervous system dynamics

To generate adaptive behavior, the nervous system is coupled to the environment. The coupling constrains the dynamical properties that the nervous system and the environment must have relative to each other if adaptive behavior is to be produced. In previous computational studies, such constraints have been used to evolve controllers or artificial agents to perform a behavioral task in a given environment. Often, however, we already know the controller, the real nervous system, and its dynamics. Here we propose that the constraints can also be used to solve the inverse problem--to predict from the dynamics of the nervous system the environment to which they are adapted, and so reconstruct the production of the adaptive behavior by the entire coupled system. We illustrate how this can be done in the feeding system of the sea slug Aplysia. At the core of this system is a central pattern generator (CPG) that, with dynamics on both fast and slow time scales, integrates incoming sensory stimuli to produce ingestive and egestive motor programs. We run models embodying these CPG dynamics--in effect, autonomous Aplysia agents--in various feeding environments and analyze the performance of the entire system in a realistic feeding task. We find that the dynamics of the system are tuned for optimal performance in a narrow range of environments that correspond well to those that Aplysia encounter in the wild. In these environments, the slow CPG dynamics implement efficient ingestion of edible seaweed strips with minimal sensory information about them. The fast dynamics then implement a switch to a different behavioral mode in which the system ignores the sensory information completely and follows an internal "goal," emergent from the dynamics, to egest again a strip that proves to be inedible. Key predictions of this reconstruction are confirmed in real feeding animals.

State dependence of spike timing and neuronal function in a motor pattern generating network

When sustained firing of a neuron is similar in different types of motor programs, its role in the generation of these programs is often similar. We investigated whether this is also the case for neurons involved in phase transition. In the Aplysia feeding central pattern generator (CPG), identified interneuron B64 starts firing at the transition between the protraction and the retraction phases of all types of motor programs, and its firing is sustained during the retraction phase. It was thought that B64 functions as a protraction terminator as it provides strong inhibitory input to protraction interneurons and motoneurons. Furthermore, premature activation of B64 can lead to premature termination of the protraction phase. Indeed, as we show here, B64 can terminate the protraction phase regardless of the type of motor program. However, B64 actually only functions as a protraction terminator in ingestive-like but not in egestive-like programs. This differential role of B64 results from a differential timing of the initiation of B64 spiking in the two types of programs. In turn, this differential timing of the initiation of B64 firing is determined by the internal state of the CPG. Thus, this study indicates the importance of the timing of initiation of firing in determining the functional role of a neuron and demonstrates that this role depends on the activity-dependent state of the network.

Currents contributing to decision making in neurons B31/B32 of Aplysia

Biophysical properties of neurons contributing to the ability of an animal to decide whether or not to respond were examined. B31/B32, two pairs of bilaterally symmetrical Aplysia neurons, are major participants in deciding to initiate a buccal motor program, the neural correlate of a consummatory feeding response. B31/B32 respond to an adequate stimulus after a delay, during which time additional stimuli influence the decision to respond. B31/B32 then respond with a ramp depolarization followed by a sustained soma depolarization and axon spiking that is the expression of a commitment to respond to food. Four currents contributing to decision making in B31/B32 were characterized, and their functional effects were determined, in current- and voltage-clamp experiments and with simulations. Inward currents arising from slow muscarinic transmission were characterized. These currents contribute to the B31/B32 depolarization. Their slow activation kinetics contribute to the delay preceding B31/B32 activity. After the delay, inward currents affect B31/B32 in the context of two endogenous inactivating outward currents: a delayed rectifier K+ current (I(K-V)) and an A-type K+ current (I(K-A)), as well as a high-threshold noninactivating outward current (I(maintained)). Hodgkin-Huxley kinetic analyses were performed on the outward currents. Simulations using equations from these analyses showed that I(K-V) and I(K-A) slow the ramp depolarization preceding the sustained depolarization. The three outward currents contribute to braking the B31/B32 depolarization and keeping the sustained depolarization at a constant voltage. The currents identified are sufficient to explain the properties of B31/B32 that play a role in generating the decision to feed.

Behavioral and in vitro correlates of compulsive-like food seeking induced by operant conditioning in Aplysia

Motivated behaviors comprise appetitive actions whose occurrence results partly from an internally driven incentive to act. Such impulsive behavior can also be regulated by external rewarding stimuli that, through learning processes, can lead to accelerated and seemingly automatic, compulsive-like recurrences of the rewarded act. Here, we explored such behavioral plasticity in Aplysia by analyzing how appetitive reward stimulation in a form of operant conditioning can modify a goal-directed component of the animal's food-seeking behavior. In naive animals, protraction/retraction cycles of the tongue-like radula are expressed sporadically with highly variable interbite intervals. In contrast, animals that were previously given a food-reward stimulus in association with each spontaneous radula bite now expressed movement cycles with an elevated frequency and a stereotyped rhythmic organization. This rate increase and regularization, which was retained for several hours after training, depended on both the reward quality and its contingency because accelerated, stereotyped biting was not induced in animals that had previously received a less-palatable food stimulus or had been subjected to nonassociative reward stimulation. Neuronal correlates of these learning-induced changes were also expressed in the radula motor pattern-generating circuitry of isolated buccal ganglia. In such in vitro preparations, moreover, manipulation of the burst frequency of the bilateral motor pattern-initiating B63 interneurons indicated that the regularization of radula motor pattern generation in contingently trained animals occurred separately from an increase in cycle rate, thereby suggesting independent processes of network plasticity. These data therefore suggest that operant conditioning can induce compulsive-like actions in Aplysia feeding behavior and provide a substrate for a cellular analysis of the underlying mechanisms.

Functional penetration of variability of motor neuron spike timing through a modulated neuromuscular system

Variability of the neuronal spike pattern is usually thought of in terms of the information that the different interspike intervals might be encoding. However, the very presence of the variability can have other kinds of functional significance. Here we consider the example of the B15/B16-ARC neuromuscular system of Aplysia, a model system for the study of neuromuscular modulation and control. We show that variability of motor neuron spike timing at the input to the system penetrates throughout the system, affecting all downstream variables including modulator release, modulator concentrations, modulatory actions, and the contraction of the muscle. Furthermore, not only does the variability penetrate through the system, but it is actually instrumental in maintaining its modulation and contractions at a robust, physiological level.

Endogenous motor neuron properties contribute to a program-specific phase of activity in the multifunctional feeding central pattern generator of Aplysia

Multifunctional central pattern generators (CPGs) are circuits of neurons that can generate manifold actions from a single effector system. This study examined a bilateral pair of pharyngeal motor neurons, designated B67, that participate in the multifunctional feeding network of Aplysia californica. Fictive buccal motor programs (BMPs) were elicited with four distinct stimulus paradigms to assess the activity of B67 during ingestive versus egestive patterns. In both classes of programs, B67 fired during the phase of radula protraction and received a potent inhibitory postsynaptic potential (IPSP) during fictive radula retraction. When programs were ingestive, the retraction phase IPSP exhibited a depolarizing sag and was followed by a postinhibitory rebound (PIR) that could generate a postretraction phase of impulse activity. When programs were egestive, the depolarizing sag potential and PIR were both diminished or were not present. Examination of the membrane properties of B67 disclosed a cesium-sensitive depolarizing sag, a corresponding I(h)-like current, and PIR in its responses to hyperpolarizing pulses. Direct IPSPs originating from the influential CPG retraction phase interneuron B64 were also found to activate the sag potential and PIR of B67. Dopamine, a modulator that can promote ingestive behavior in this system, enhanced the sag potential, I(h)-like current, and PIR of B67. Finally, a pharyngeal muscle contraction followed the radula retraction phase of ingestive, but not egestive motor patterns. It is proposed that regulation of the intrinsic properties of this motor neuron can contribute to generating a program-specific phase of motor activity.

Multiple contributions of an input-representing neuron to the dynamics of the aplysia feeding network

In Aplysia, mutually antagonistic ingestive and egestive behaviors are produced by the same multifunctional central pattern generator (CPG) circuit. Interestingly, higher-order inputs that activate the CPG do not directly specify whether the resulting motor program is ingestive or egestive because the slow dynamics of the network intervene. One input, the commandlike cerebral-buccal interneuron 2 (CBI-2), slowly drives the motor output toward ingestion, whereas another input, the esophageal nerve (EN), drives the motor output toward egestion. When the input is switched from EN to CBI-2, the motor output does not switch immediately and remains egestive. Here, we investigated how these slow dynamics are implemented on the interneuronal level. We found that activity of two CPG interneurons, B20 and B40, tracked the motor output regardless of the input, whereas activity of another CPG interneuron, B65, tracked the input regardless of the motor output. Furthermore, we show that the slow dynamics of the network are implemented, at least in part, in the slow dynamics of the interaction between the input-representing and the output-representing neurons. We conclude that 1) a population of CPG interneurons, recruited during a particular motor program, simultaneously encodes both the input that is used to elicit the motor program and the output elicited by this input; and 2) activity of the input-representing neurons may serve to bias the future motor programs.

Feeding behavior of Aplysia: a model system for comparing cellular mechanisms of classical and operant conditioning

Feeding behavior of Aplysia provides an excellent model system for analyzing and comparing mechanisms underlying appetitive classical conditioning and reward operant conditioning. Behavioral protocols have been developed for both forms of associative learning, both of which increase the occurrence of biting following training. Because the neural circuitry that mediates the behavior is well characterized and amenable to detailed cellular analyses, substantial progress has been made toward a comparative analysis of the cellular mechanisms underlying these two forms of associative learning. Both forms of associative learning use the same reinforcement pathway (the esophageal nerve, En) and the same reinforcement transmitter (dopamine, DA). In addition, at least one cellular locus of plasticity (cell B51) is modified by both forms of associative learning. However, the two forms of associative learning have opposite effects on B51. Classical conditioning decreases the excitability of B51, whereas operant conditioning increases the excitability of B51. Thus, the approach of using two forms of associative learning to modify a single behavior, which is mediated by an analytically tractable neural circuit, is revealing similarities and differences in the mechanisms that underlie classical and operant conditioning.

Modulation of Cellular and Synaptic Variability in the Lamprey Spinal Cord

Variability is increasingly recognized as a characteristic feature of cellular, synaptic, and network properties. While studies have traditionally focused on mean values, significant effects can result from changes in variance. This study has examined cellular and synaptic variability in the lamprey spinal cord and its modulation by the neuropeptide substance P. Cellular and synaptic variability differed in different types of cell and synapse. Substance P reduced the variability of subthreshold locomotor-related depolarizations and spiking in motor neurons during network activity. These effects were associated with a reduction in the variability of spiking in glutamatergic excitatory network interneurons and with a reduction in the variance of excitatory interneuron-evoked excitatory postsynaptic potentials (EPSPs). Substance P also reduced the variance of postsynpatic potentials (PSPs) from crossing inhibitory and excitatory interneurons, but it increased the variance of inhibitory postsynpatic potentials (IPSPs) from ipsilateral inhibitory interneurons. The effects on the variance of different PSPs could occur with or without changes in the PSP amplitude. The reduction in the variance of excitatory interneuron-evoked EPSPs was protein kinase A, calcium, and N-methyl-d-aspartate (NMDA) dependent. The NMDA dependence suggested that substance P was acting postsynaptically. This was supported by the reduced variability of postsynaptic responses to glutamate by substance P. However, ultrastructural analyses suggested that there may also be a presynaptic component to the modulation, because substance P reduced the variability of synaptic vesicle diameters in putative glutamatergic terminals. These results suggest that cellular and synaptic variability can be targeted for modulation, making it an additional source of spinal cord plasticity.

Different motor neuron spike patterns produce contractions with very similar rises in graded slow muscles

Graded muscles produce small twitches in response to individual motor neuron spikes. During the early part of their contractions, contraction amplitude in many such muscles depends primarily on the number of spikes the muscle has received, not the frequency or pattern with which they were delivered. Stick insect (Carausius morosus) extensor muscles are graded and thus would likely show spike-number dependency early in their contractions. Tonic stimulations of the extensor motor nerve showed that the response of the muscles differed from the simplest form of spike-number dependency. However, these differences actually increased the spike-number range over which spike-number dependency was present. When the motor nerve was stimulated with patterns mimicking the motor neuron activity present during walking, amplitude during contraction rises also depended much more on spike number than on spike frequency. A consequence of spike-number dependency is that brief changes in spike frequency do not alter contraction slope and we show here that extensor motor neuron bursts with different spike patterns give rise to contractions with very similar contraction rises. We also examined in detail the early portions of a large number of extensor motor neuron bursts recorded during single-leg walking and show that these portions of the bursts do not appear to have any common spike pattern. Although alternative explanations are possible, the simplest interpretation of these data is that extensor motor neuron firing during leg swing is not tightly controlled.

Leaf mechanical properties modulate feeding movements and ingestive success of the pond snail, Lymnaea stagnalis

We examined the mechanical properties of Butterhead and Iceberg lettuce leaves, and the rate at which they were eaten by the pond snail Lymnaea stagnalis. The outer part of Butterhead leaves were less robust than either the inner Butterhead or outer Iceberg leaves (Young's modulus 2.8, 5.2, 7.7 MPa respectively; ultimate tensile stress 0.18, 0.34 0.51 MPa) which were also thicker. Snails ingested inner Butterhead and Iceberg strips more slowly (36 and 32%) than outer Butterhead. This was not due to differences in latency to first bite or biting rate. Rather, the drop was due to a decrease in the proportion of successful bites (inner Butterhead 84%; Iceberg 86%), to a shorter length ingested per bite (inner Butterhead 55%; Iceberg 45%) and to increased handling time (inner Butterhead 30%). We conclude that sensory input from the mechanically more robust lettuce slows the buccal central pattern generator.

Adult, sex-specific behavior characterized by elevated neuronal functional complexity

Adult, sex-specific behaviors are good models for context-specific behavioral patterns. Here, we focus on a unique example: locust oviposition. The neural network's rhythmic output can be activated at all life stages, including embryonic, in both females and males. All recorded patterns, independent of age and sex, showed similar basic statistics. Activity density plots and spectral analysis, however, revealed that oscillations in burst rates recorded from females show greater variation quantities than those recorded from males. Furthermore, only the neural output recorded from sexually mature females was characterized by significantly elevated functional complexity. Thus, while the neural network has inherent potential to generate motor activities at different levels of complexity, only the proper internal-environmental and behavioral context triggers expression of its full potential of information capacity.

Variability of motor neuron spike timing maintains and shapes contractions of the accessory radula closer muscle of Aplysia

The accessory radula closer (ARC) muscle of Aplysia has long been studied as a typical "slow" muscle, one that would be assumed to respond only to the overall, integrated spike rate of its motor neurons, B15 and B16. The precise timing of the individual spikes should not much matter. However, but real B15 and B16 spike patterns recorded in vivo show great variability that extends down to the timing of individual spikes. By replaying these real as well as artificially constructed spike patterns into ARC muscles in vitro, we examined the consequences of this spike-level variability for contraction. Replaying the same pattern several times reproduces precisely the same contraction shape: the B15/B16-ARC neuromuscular transform is deterministic. However, varying the timing of the spikes produces very different contraction shapes and amplitudes. The transform in fact operates at an interface between "fast" and "slow" regimens. It is fast enough that the timing of individual spikes greatly influences the detailed contraction shape. At the same time, slow integration of the spike pattern through the nonlinear transform allows the variable spike timing to determine also the overall contraction amplitude. Indeed, the variability appears to be necessary to maintain the contraction amplitude at a robust level. This phenomenon is tuned by neuromodulators that tune the speed and nonlinearity of the transform. Thus, the variable timing of individual spikes does matter, in at least two, functionally significant ways, in this "slow" neuromuscular system.

Natural neural output that produces highly variable locomotory movements

We recorded fast extensor tibiae motor neuron activity during single-legged treadmill walking in the stick insect, Carausius morosus. We used this activity to stimulate the extensor muscle motor nerve, observed the resulting extensor muscle contractions under isotonic conditions, and quantified these contractions with a variety of measures. Extensor contractions induced in this manner were highly variable, with contraction measures having SDs of 12 to 51%, and ranges of 82 to 275%, when expressed as percentages of the means, an unexpectedly wide range for a locomotory pattern. Searches for correlations among the contraction measures showed that, in general, this high variability is not reduced by contraction measure covariation. Comparing responses (to identical input) across animals showed that extensor muscles from different animals generally significantly differed from one another. However, correlation analyses on these data suggested that these differences do not indicate that multiple extensor muscle subtypes exist. Extensor muscles instead appear to belong to a single class, albeit one with high animal to animal variability. These data thus provide another well-quantified example (along with Aplysia feeding) of a repetitive but highly variable motor pattern (in contrast to the high rhythmicity and stereotypy present in most other well-quantified repetitive motor patterns). We suggest this high variability could be an adaptive combination of locomotion, active sensing, and crypsis arising from the relatively low demand for locomotion in Carausius behavior, the highly fragmented environment the animal inhabits, and its need to avoid predatory attention.

Cycle-to-cycle variability as an optimal behavioral strategy

Aplysia feeding behavior is highly variable from cycle to cycle. In some cycles, when the variability causes a mismatch between the animal's movements and the requirements of the feeding task, the variability makes the behavior unsuccessful. We propose that the behavior is variable nevertheless because the variability serves a higher-order functional purpose. When the animal is faced with a new and only imperfectly known feeding task in each cycle, the variability implements a trial-and-error search through the space of possible feeding movements. Over many cycles, this may be the animal's optimal strategy in an uncertain and changing feeding environment.

Neuromechanics of coordination during swallowing in Aplysia californica

Bernstein (1967) hypothesized that preparation of the periphery was crucial for correct responses to motor output. To test this hypothesis in a behaving animal, we examined the roles of two identified motor neurons, B7 and B8, which contribute to feeding behavior in the marine mollusk Aplysia californica. Neuron B7 innervates a hinge muscle and has no overt behavioral effect during smaller-amplitude (type A) swallows, because the hinge muscle is too short to exert force. Neuron B8 activates a muscle (I4) that acts solely to grasp material during type A swallows. During larger-amplitude (type B) swallows, the behavioral actions of both motor neurons change, because the larger-amplitude anterior movement of the grasper sets up the periphery to respond differently to motor outputs. The larger anterior movement stretches the hinge muscle, so that activating neuron B7 mediates the initial retraction phase of swallowing. The changed position of the I4 muscle allows neuron B8 not only to induce grasping but also to pull material into the buccal cavity, contributing to retraction. Thus, larger-amplitude swallows are associated with the expression of two new degrees of freedom (use of the hinge to retract and use of the grasper to retract) that are essential for mediating type B swallows. These results provide a direct demonstration of Bernstein's hypothesis that properly positioning the periphery can be crucial for its ability to correctly respond to motor output and also demonstrate that biomechanical context can alter the functions of identified motor neurons.

Identification of a new neuropeptide precursor reveals a novel source of extrinsic modulation in the feeding system of Aplysia

The Aplysia feeding system is advantageous for investigating the role of neuropeptides in behavioral plasticity. One family of Aplysia neuropeptides is the myomodulins (MMs), originally purified from one of the feeding muscles, the accessory radula closer (ARC). However, two MMs, MMc and MMe, are not encoded on the only known MM gene. Here, we identify MM gene 2 (MMG2), which encodes MMc and MMe and four new neuropeptides. We use matrix-assisted laser desorption/ionization time-of-flight mass spectrometry to verify that these novel MMG2-derived peptides (MMG2-DPs), as well as MMc and MMe, are synthesized from the precursor. Using antibodies against the MMG2-DPs, we demonstrate that neuronal processes that stain for MMG2-DPs are found in the buccal ganglion, which contains the feeding network, and in the buccal musculature including the ARC muscle. Surprisingly, however, no immunostaining is observed in buccal neurons including the ARC motoneurons. In situ hybridization reveals only few MMG2-expressing neurons that are mostly located in the pedal ganglion. Using immunohistochemical and electrophysiological techniques, we demonstrate that some of these pedal neurons project to the buccal ganglion and are the likely source of the MMG2-DP innervation of the feeding network and musculature. We show that the MMG2-DPs are bioactive both centrally and peripherally: they bias egestive feeding programs toward ingestive ones, and they modulate ARC muscle contractions. The multiple actions of the MMG2-DPs suggest that these peptides play a broad role in behavioral plasticity and that the pedal-buccal projection neurons that express them are a novel source of extrinsic modulation of the feeding system of Aplysia.

Complexities and uncertainties of neuronal network function

The nervous system generates behaviours through the activity in groups of neurons assembled into networks. Understanding these networks is thus essential to our understanding of nervous system function. Understanding a network requires information on its component cells, their interactions and their functional properties. Few networks come close to providing complete information on these aspects. However, even if complete information were available it would still only provide limited insight into network function. This is because the functional and structural properties of a network are not fixed but are plastic and can change over time. The number of interacting network components, their (variable) functional properties, and various plasticity mechanisms endows networks with considerable flexibility, but these features inevitably complicate network analyses. This review will initially discuss the general approaches and problems of network analyses. It will then examine the success of these analyses in a model spinal cord locomotor network in the lamprey, to determine to what extent in this relatively simple vertebrate system it is possible to claim detailed understanding of network function and plasticity.

Changes of internal state are expressed in coherent shifts of neuromuscular activity in Aplysia feeding behavior

The multitasking central pattern generator (CPG) that drives consummatory feeding behaviors of Aplysia can produce ingestive, egestive, and intermediate motor programs. External stimuli trigger the programs but, remarkably, do not directly specify which type of program is produced. Rather, recent work has proposed, the type of program is determined by the internal network state of the CPG that has developed in response to the previous history of the stimulation. Here we have tested a key prediction of this network-state hypothesis. If the network state has a real existence and governs real functional behavior, changes in the state should be seen as coherent, coordinated changes along many dimensions of interneuron and motor neuron activity, muscle contraction, and ultimately movement, that underlie functional behavior. In reduced neuromuscular preparations, we elicited repetitive motor programs by continued stimulation of the esophageal nerve while recording the firing of motor neurons B8, B15, B16, B4/5, and B48, and contractions of the accessory radula closer and I7-I10 muscles that respectively close and open the animal's food-grasping organ, the radula. Using sonomicrometric techniques, we similarly recorded the movement of the radula in the complete buccal mass. Successive esophageal nerve programs indeed exhibited clear progressive changes in motor neuron firing, muscle contractions, and the phasing of radula movements within each cycle, from an initially intermediate or even ingestive character to a strongly egestive character. We conclude that the Aplysia feeding CPG really has a coherent internal network state whose dynamics are likely to be reflected in the real behavior of the animal.

Variability of swallowing performance in intact, freely feeding aplysia

Variability in nervous systems is often taken to be merely "noise." Yet in some cases it may play a positive, active role in the production of behavior. The central pattern generator (CPG) that drives the consummatory feeding behaviors of Aplysia generates large, quasi-random variability in the parameters of the feeding motor programs from one cycle to the next; the variability then propagates through the firing patterns of the motor neurons to the contractions of the feeding muscles. We have proposed that, when the animal is faced with a new, imperfectly known feeding task in each cycle, the variability implements a trial-and-error search through the space of possible feeding movements. Although this strategy will not be successful in every cycle, over many cycles it may be the optimal strategy for feeding in an uncertain and changing environment. To play this role, however, the variability must actually appear in the feeding movements and, presumably, in the functional performance of the feeding behavior. Here we have tested this critical prediction. We have developed a technique to measure, in intact, freely feeding animals, the performance of Aplysia swallowing behavior, by continuously recording with a length transducer the movement of the seaweed strip being swallowed. Simultaneously, we have recorded with implanted electrodes activity at each of the internal levels, the CPG, motor neurons, and muscles, of the feeding neuromusculature. Statistical analysis of a large data set of these recordings suggests that functional performance is not determined strongly by one or a few parameters of the internal activity, but weakly by many. Most important, the internal variability does emerge in the behavior and its functional performance. Even when the animal is swallowing a long, perfectly regular seaweed strip, remarkably, the length swallowed from cycle to cycle is extremely variable, as variable as the parameters of the activity of the CPG, motor neurons, and muscles.

Temperature compensation of neuromuscular modulation in aplysia

Physiological systems that must operate over a range of temperatures often incorporate temperature-compensatory mechanisms to maintain their output within a relatively narrow, functional range of values. We analyze here an example in the accessory radula closer (ARC) neuromuscular system, a representative part of the feeding neuromusculature of the sea slug Aplysia. The ARC muscle's two motor neurons, B15 and B16, release, in addition to ACh that contracts the muscle, modulatory peptide cotransmitters that, through a complex network of effects in the muscle, shape the ACh-induced contractions. It is believed that this modulation is critical in optimizing the performance of the muscle for successful, efficient feeding behavior. However, previous work has shown that the release of the modulatory peptides from the motor neurons decreases dramatically with increasing temperature. From 15 to 25 degrees C, for example, release decreases 20-fold. Yet Aplysia live and feed successfully not only at 15 degrees C, but at 25 degrees C and probably at higher temperatures. Here, working with reduced B15/B16-ARC preparations in vitro as well as a mathematical model of the system, we have found a resolution of this apparent paradox. Although modulator release decreases 20-fold when the temperature is raised from 15 to 25 degrees C, the observed modulation of contraction shape does not decrease at all. Two mechanisms are responsible. First, further downstream within the modulatory network, the modulatory effects themselves-experimentally dissected by exogenous modulator application-have temperature dependencies opposite to that of modulator release, increasing with temperature. Second, the saturating curvature of the dose-response relations within the network diminishes the downstream impact of the decrease of modulator release. Thus two quite distinct mechanisms, one depending on the characteristics of the individual components of the network and the other emerging from the network's structure, combine to compensate for temperature changes to maintain the output of this physiological system.

Tight or loose coupling between components of the feeding neuromusculature of Aplysia?

Like other complex behaviors, the cyclical, rhythmic consummatory feeding behaviors of Aplysia-biting, swallowing, and rejection of unsuitable food-are produced by a complex neuromuscular system: the animal's buccal mass, with numerous pairs of antagonistic muscles, controlled by the firing of numerous motor neurons, all driven by the motor programs of a central pattern generator (CPG) in the buccal ganglia. In such a complex neuromuscular system, it has always been assumed that the activities of the various components must necessarily be tightly coupled and coordinated if successful functional behavior is to be produced. However, we have recently found that the CPG generates extremely variable motor programs from one cycle to the next, and so very variable motor neuron firing patterns and contractions of individual muscles. Here we show that this variability extends even to higher-level parameters of the operation of the neuromuscular system such as the coordination between entire antagonistic subsystems within the buccal neuromusculature. In motor programs elicited by stimulation of the esophageal nerve, we have studied the relationship between the contractions of the accessory radula closer (ARC) muscle, and the firing patterns of its motor neurons B15 and B16, with those of its antagonist, the radula opener (I7) muscle, and its motor neuron B48. There are two separate B15/B16-ARC subsystems, one on each side of the animal, and these are indeed very tightly coupled. Tight coupling can, therefore, be achieved in this neuromuscular system where required. Yet there is essentially no coupling at all between the contractions of the ARC muscles and those of the antagonistic radula opener muscle. We interpret this result in terms of a hypothesis that ascribes a higher-order benefit to such loose coupling in the neuromusculature. The variability, emerging in the successive feeding movements made by the animal, diversifies the range of movements and thereby implements a trial-and-error search through the space of movements that might be successful, an optimal strategy for the animal in an unknown, rapidly changing feeding environment.

Intersegmental coordination of walking movements in stick insects

Locomotion requires the coordination of movements across body segments, which in walking animals is expressed as gaits. We studied the underlying neural mechanisms of this coordination in a semi-intact walking preparation of the stick insect Carausius morosus. During walking of a single front leg on a treadmill, leg motoneuron (MN) activity tonically increased and became rhythmically modulated in the ipsilateral deafferented and deefferented mesothoracic (middle leg) ganglion. The pattern of modulation was correlated with the front leg cycle and specific for a given MN pool, although it was not consistent with functional leg movements for all MN pools. In an isolated preparation of a pair of ganglia, where one ganglion was made rhythmically active by application of pilocarpine, we found no evidence for coupling between segmental central pattern generators (CPGs) that could account for the modulation of MN activity observed in the semi-intact walking preparation. However, a third preparation provided evidence that signals from the front leg's femoral chordotonal organ (fCO) influenced activity of ipsilateral MNs in the adjacent mesothoracic ganglion. These intersegmental signals could be partially responsible for the observed MN activity modulation during front leg walking. While afferent signals from a single walking front leg modulate the activity of MNs in the adjacent segment, additional afferent signals, local or from contralateral or posterior legs, might be necessary to produce the functional motor pattern observed in freely walking animals.