Variability of swallowing performance in intact, freely feeding aplysia

The role of food odor in invertebrate foraging

Foraging for food is an integral part of animal survival. In small insects and invertebrates, multisensory information and optimized locomotion strategies are used to effectively forage in patchy and complex environments. Here, the importance of olfactory cues for effective invertebrate foraging is discussed in detail. We review how odors are used by foragers to move toward a likely food source and the recent models that describe this sensory-driven behavior. We argue that smell serves a second function by priming an organism for the efficient exploitation of food. By appraising food odors, invertebrates can establish preferences and better adapt to their ecological niches, thereby promoting survival. The smell of food pre-prepares the gastrointestinal system and primes feeding motor programs for more effective ingestion as well. Optimizing resource utilization affects longevity and reproduction as a result, leading to drastic changes in survival. We propose that models of foraging behavior should include odor priming, and illustrate this with a simple toy model based on the marginal value theorem. Lastly, we discuss the novel techniques and assays in invertebrate research that could investigate the interactions between odor sensing and food intake. Overall, the sense of smell is indispensable for efficient foraging and influences not only locomotion, but also organismal physiology, which should be reflected in behavioral modeling.

The brain as a dynamically active organ

Nervous systems are typically described as static networks passively responding to external stimuli (i.e., the 'sensorimotor hypothesis'). However, for more than a century now, evidence has been accumulating that this passive-static perspective is wrong. Instead, evidence suggests that nervous systems dynamically change their connectivity and actively generate behavior so their owners can achieve goals in the world, some of which involve controlling their sensory feedback. This review provides a brief overview of the different historical perspectives on general brain function and details some select modern examples falsifying the sensorimotor hypothesis.

Rapid Adaptation to Changing Mechanical Load by Ordered Recruitment of Identified Motor Neurons

As they interact with their environment and encounter challenges, animals adjust their behavior on a moment-to-moment basis to maintain task fitness. This dynamic process of adaptive motor control occurs in the nervous system, but an understanding of the biomechanics of the body is essential to properly interpret the behavioral outcomes. To study how animals respond to changing task conditions, we used a model system in which the functional roles of identified neurons and the relevant biomechanics are well understood and can be studied in intact behaving animals: feeding in the marine mollusc Aplysia We monitored the motor neuronal output of the feeding circuitry as intact animals fed on uniform food stimuli under unloaded and loaded conditions, and we measured the force of retraction during loaded swallows. We observed a previously undescribed pattern of force generation, which can be explained within the appropriate biomechanical context by the activity of just a few key, identified motor neurons. We show that, when encountering load, animals recruit identified retractor muscle motor neurons for longer and at higher frequency to increase retraction force duration. Our results identify a mode by which animals robustly adjust behavior to their environment, which is experimentally tractable to further mechanistic investigation.

Discovery of leucokinin-like neuropeptides that modulate a specific parameter of feeding motor programs in the molluscan model, Aplysia

A better understanding of neuromodulation in a behavioral system requires identification of active modulatory transmitters. Here, we used identifiable neurons in a neurobiological model system, the mollusc Aplysia, to study neuropeptides, a diverse class of neuromodulators. We took advantage of two types of feeding neurons, B48 and B1/B2, in the Aplysia buccal ganglion that might contain different neuropeptides. We performed a representational difference analysis (RDA) by subtraction of mRNAs in B48 versus mRNAs in B1/B2. The RDA identified an unusually long (2025 amino acids) peptide precursor encoding Aplysia leucokinin-like peptides (ALKs; e.g. ALK-1 and ALK-2). Northern blot analysis revealed that, compared with other ganglia (e.g. the pedal-pleural ganglion), ALK mRNA is predominantly present in the buccal ganglion, which controls feeding behavior. We then used in situ hybridization and immunohistochemistry to localize ALKs to specific neurons, including B48. MALDI-TOF MS on single buccal neurons revealed expression of 40 ALK precursor-derived peptides. Among these, ALK-1 and ALK-2 are active in the feeding network; they shortened the radula protraction phase of feeding motor programs triggered by a command-like neuron. We also found that this effect may be mediated by the ALK-stimulated enhancement of activity of an interneuron, which has previously been shown to terminate protraction. We conclude that our multipronged approach is effective for determining the structure and defining the diverse functions of leucokinin-like peptides. Notably, the ALK precursor is the first verified nonarthropod precursor for leucokinin-like peptides with a novel, marked modulatory effect on a specific parameter (protraction duration) of feeding motor programs.

Aplysia Locomotion: Network and Behavioral Actions of GdFFD, a D-Amino Acid-Containing Neuropeptide

One emerging principle is that neuromodulators, such as neuropeptides, regulate multiple behaviors, particularly motivated behaviors, e.g., feeding and locomotion. However, how neuromodulators act on multiple neural networks to exert their actions remains poorly understood. These actions depend on the chemical form of the peptide, e.g., an alternation of L- to D- form of an amino acid can endow the peptide with bioactivity, as is the case for the Aplysia peptide GdFFD (where dF indicates D-phenylalanine). GdFFD has been shown to act as an extrinsic neuromodulator in the feeding network, while the all L-amino acid form, GFFD, was not bioactive. Given that both GdFFD/GFFD are also present in pedal neurons that mediate locomotion, we sought to determine whether they impact locomotion. We first examined effects of both peptides on isolated ganglia, and monitored fictive programs using the parapedal commissural nerve (PPCN). Indeed, GdFFD was bioactive and GFFD was not. GdFFD increased the frequency with which neural activity was observed in the PPCN. In part, there was an increase in bursting spiking activity that resembled fictive locomotion. Additionally, there was significant activity between bursts. To determine how the peptide-induced activity in the isolated CNS is translated into behavior, we recorded animal movements, and developed a computer program to automatically track the animal and calculate the path of movement and velocity of locomotion. We found that GdFFD significantly reduced locomotion and induced a foot curl. These data suggest that the increase in PPCN activity observed in the isolated CNS during GdFFD application corresponds to a reduction, rather than an increase, in locomotion. In contrast, GFFD had no effect. Thus, our study suggests that GdFFD may act as an intrinsic neuromodulator in the Aplysia locomotor network. More generally, our study indicates that physiological and behavioral analyses should be combined to evaluate peptide actions.

Preparing the periphery for a subsequent behavior: motor neuronal activity during biting generates little force but prepares a retractor muscle to generate larger forces during swallowing in Aplysia

Some behaviors occur in obligatory sequence, such as reaching before grasping an object. Can the earlier behavior serve to prepare the musculature for the later behavior? If it does, what is the underlying neural mechanism of the preparation? To address this question, we examined two feeding behaviors in the marine mollusk Aplysia californica, one of which must precede the second: biting and swallowing. Biting is an attempt to grasp food. When that attempt is successful, the animal immediately switches to swallowing to ingest food. The main muscle responsible for pulling food into the buccal cavity during swallowing is the I3 muscle, whose motor neurons B6, B9, and B3 have been previously identified. By performing recordings from these neurons in vivo in intact, behaving animals or in vitro in a suspended buccal mass preparation, we demonstrated that the frequencies and durations of these motor neurons increased from biting to swallowing. Using the physiological patterns of activation to drive these neurons intracellularly, we further demonstrated that activating them using biting-like frequencies and durations, either alone or in combination, generated little or no force in the I3 muscle. When biting-like patterns preceded swallowing-like patterns, however, the forces during the subsequent swallowing-like patterns were significantly enhanced. Sequences of swallowing-like patterns, either with these neurons alone or in combination, further enhanced forces in the I3 muscle. These results suggest a novel mechanism for enhancing force production in a muscle, and may be relevant to understanding motor control in vertebrates.

Phylogenetic and individual variation in gastropod central pattern generators

Gastropod molluscs provide a unique opportunity to explore the neural basis of rhythmic behaviors because of the accessibility of their nervous systems and the number of species that have been examined. Detailed comparisons of the central pattern generators (CPGs) underlying rhythmic feeding and swimming behaviors highlight the presence and effects of variation in neural circuits both across and within species. The feeding motor pattern of the snail, Lymnaea, is stereotyped, whereas the feeding motor pattern in the sea hare, Aplysia, is variable. However, the Aplysia motor pattern is regularized with operant conditioning or by mimicking learning using the dynamic clamp to change properties of CPG neurons. Swimming evolved repeatedly in marine gastropods. Distinct neural mechanisms underlie dissimilar forms of swimming, with homologous neurons playing different roles. However, even similar swimming behaviors in different species can be produced by distinct neural mechanisms, resulting from different synaptic connectivity of homologous neurons. Within a species, there can be variation in the strength and even valence of synapses, which does not have functional relevance under normal conditions, but can cause some individuals to be more susceptible to lesion of the circuit. This inter- and intra-species variation provides novel insights into CPG function and plasticity.

Designing responsive pattern generators: stable heteroclinic channel cycles for modeling and control

A striking feature of biological pattern generators is their ability to respond immediately to multisensory perturbations by modulating the dwell time at a particular phase of oscillation, which can vary force output, range of motion, or other characteristics of a physical system. Stable heteroclinic channels (SHCs) are a dynamical architecture that can provide such responsiveness to artificial devices such as robots. SHCs are composed of sequences of saddle equilibrium points, which yields exquisite sensitivity. The strength of the vector fields in the neighborhood of these equilibria determines the responsiveness to perturbations and how long trajectories dwell in the vicinity of a saddle. For SHC cycles, the addition of stochastic noise results in oscillation with a regular mean period. In this paper, we parameterize noise-driven Lotka-Volterra SHC cycles such that each saddle can be independently designed to have a desired mean sub-period. The first step in the design process is an analytic approximation, which results in mean sub-periods that are within 2% of the specified sub-period for a typical parameter set. Further, after measuring the resultant sub-periods over sufficient numbers of cycles, the magnitude of the noise can be adjusted to control the mean period with accuracy close to that of the integration step size. With these relationships, SHCs can be more easily employed in engineering and modeling applications. For applications that require smooth state transitions, this parameterization permits each state's distribution of periods to be independently specified. Moreover, for modeling context-dependent behaviors, continuously varying inputs in each state dimension can rapidly precipitate transitions to alter frequency and phase.

Motor neuronal activity varies least among individuals when it matters most for behavior

How does motor neuronal variability affect behavior? To explore this question, we quantified activity of multiple individual identified motor neurons mediating biting and swallowing in intact, behaving Aplysia californica by recording from the protractor muscle and the three nerves containing the majority of motor neurons controlling the feeding musculature. We measured multiple motor components: duration of the activity of identified motor neurons as well as their relative timing. At the same time, we measured behavioral efficacy: amplitude of grasping movement during biting and amplitude of net inward food movement during swallowing. We observed that the total duration of the behaviors varied: Within animals, biting duration shortened from the first to the second and third bites; between animals, biting and swallowing durations varied. To study other sources of variation, motor components were divided by behavior duration (i.e., normalized). Even after normalization, distributions of motor component durations could distinguish animals as unique individuals. However, the degree to which a motor component varied among individuals depended on the role of that motor component in a behavior. Motor neuronal activity that was essential for the expression of biting or swallowing was similar among animals, whereas motor neuronal activity that was not essential for that behavior varied more from individual to individual. These results suggest that motor neuronal activity that matters most for the expression of a particular behavior may vary least from individual to individual. Shaping individual variability to ensure behavioral efficacy may be a general principle for the operation of motor systems.

The neuromuscular transform of the lobster cardiac system explains the opposing effects of a neuromodulator on muscle output

Motor neuron activity is transformed into muscle movement through a cascade of complex molecular and biomechanical events. This nonlinear mapping of neural inputs to motor behaviors is called the neuromuscular transform (NMT). We examined the NMT in the cardiac system of the lobster Homarus americanus by stimulating a cardiac motor nerve with rhythmic bursts of action potentials and measuring muscle movements in response to different stimulation patterns. The NMT was similar across preparations, which suggested that it could be used to predict muscle movement from spontaneous neural activity in the intact heart. We assessed this possibility across semi-intact heart preparations in two separate analyses. First, we performed a linear regression analysis across 122 preparations in physiological saline to predict muscle movements from neural activity. Under these conditions, the NMT was predictive of contraction duty cycle but was unable to predict contraction amplitude, likely as a result of uncontrolled interanimal variability. Second, we assessed the ability of the NMT to predict changes in motor output induced by the neuropeptide C-type allatostatin. Wiwatpanit et al. (2012) showed that bath application of C-type allatostatin produced either increases or decreases in the amplitude of the lobster heart contractions. We show that an important component of these preparation-dependent effects can arise from quantifiable differences in the basal state of each preparation and the nonlinear form of the NMT. These results illustrate how properly characterizing the relationships between neural activity and measurable physiological outputs can provide insight into seemingly idiosyncratic effects of neuromodulators across individuals.

Cycle-by-cycle assembly of respiratory network activity is dynamic and stochastic

Rhythmically active networks are typically composed of neurons that can be classified as silent, tonic spiking, or rhythmic bursting based on their intrinsic activity patterns. Within these networks, neurons are thought to discharge in distinct phase relationships with their overall network output, and it has been hypothesized that bursting pacemaker neurons may lead and potentially trigger cycle onsets. We used multielectrode recording from 72 experiments to test these ideas in rhythmically active slices containing the pre-Bötzinger complex, a region critical for breathing. Following synaptic blockade, respiratory neurons exhibited a gradient of intrinsic spiking to rhythmic bursting activities and thus defied an easy classification into bursting pacemaker and nonbursting categories. Features of their firing activity within the functional network were analyzed for correlation with subsequent rhythmic bursting in synaptic isolation. Higher firing rates through all phases of fictive respiration statistically predicted bursting pacemaker behavior. However, a cycle-by-cycle analysis indicated that respiratory neurons were stochastically activated with each burst. Intrinsically bursting pacemakers led some population bursts and followed others. This variability was not reproduced in traditional fully interconnected computational models, while sparsely connected network models reproduced these results both qualitatively and quantitatively. We hypothesize that pacemaker neurons do not act as clock-like drivers of the respiratory rhythm but rather play a flexible and dynamic role in the initiation and stabilization of each burst. Thus, at the behavioral level, each breath can be thought of as de novo assembly of a stochastic collaboration of network topology and intrinsic properties.

Functional organization and adaptability of a decision-making network in aplysia

Whereas major insights into the neuronal basis of adaptive behavior have been gained from the study of automatic behaviors, including reflexive and rhythmic motor acts, the neural substrates for goal-directed behaviors in which decision-making about action selection and initiation are crucial, remain poorly understood. However, the mollusk Aplysia is proving to be increasingly relevant to redressing this issue. The functional properties of the central circuits that govern this animal’s goal-directed feeding behavior and particularly the neural processes underlying the selection and initiation of specific feeding actions are becoming understood. In addition to relying on the intrinsic operation of central networks, goal-directed behaviors depend on external sensory inputs that through associative learning are able to shape decision-making strategies. Here, we will review recent findings on the functional design of the central network that generates Aplysia’s feeding-related movements and the sensory-derived plasticity that through learning can modify the selection and initiation of appropriate action. The animal’s feeding behavior and the implications of decision-making will be briefly described. The functional design of the underlying buccal network will then be used to illustrate how cellular diversity and the coordination of neuronal burst activity provide substrates for decision-making. The contribution of specific synaptic and neuronal membrane properties within the buccal circuit will also be discussed in terms of their role in motor pattern selection and initiation. The ability of learning to “rigidify” these synaptic and cellular properties so as to regularize network operation and lead to the expression of stereotyped rhythmic behavior will then be described. Finally, these aspects will be drawn into a conceptual framework of how Aplysia’s goal-directed circuitry compares to the central pattern generating networks for invertebrate rhythmic behaviors.

Towards a scientific concept of free will as a biological trait: spontaneous actions and decision-making in invertebrates

Until the advent of modern neuroscience, free will used to be a theological and a metaphysical concept, debated with little reference to brain function. Today, with ever increasing understanding of neurons, circuits and cognition, this concept has become outdated and any metaphysical account of free will is rightfully rejected. The consequence is not, however, that we become mindless automata responding predictably to external stimuli. On the contrary, accumulating evidence also from brains much smaller than ours points towards a general organization of brain function that incorporates flexible decision-making on the basis of complex computations negotiating internal and external processing. The adaptive value of such an organization consists of being unpredictable for competitors, prey or predators, as well as being able to explore the hidden resource deterministic automats would never find. At the same time, this organization allows all animals to respond efficiently with tried-and-tested behaviours to predictable and reliable stimuli. As has been the case so many times in the history of neuroscience, invertebrate model systems are spearheading these research efforts. This comparatively recent evidence indicates that one common ability of most if not all brains is to choose among different behavioural options even in the absence of differences in the environment and perform genuinely novel acts. Therefore, it seems a reasonable effort for any neurobiologist to join and support a rather illustrious list of scholars who are trying to wrestle the term 'free will' from its metaphysical ancestry. The goal is to arrive at a scientific concept of free will, starting from these recently discovered processes with a strong emphasis on the neurobiological mechanisms underlying them.

Repetition priming of motoneuronal activity in a small motor network: intercellular and intracellular signaling

The characteristics of central pattern generator (CPG) outputs are subject to extensive modulation. Previous studies of neuromodulation largely focused on immediate actions of neuromodulators, i.e., actions that were exerted at the time when either neuromodulators were present or neuromodulatory inputs to the CPG were active. However, neuromodulatory actions are known to persist when neuromodulators are no longer present. In Aplysia, stimulation of cerebral-buccal interneuron-2 (CBI-2), which activates the feeding CPG, produces a repetition priming of motor programs. This priming is reflected in an increase of firing of motoneurons. As CBI-2 contains two neuromodulatory peptides, FCAP (feeding circuit-activating peptide) and CP2 (cerebral peptide 2), we hypothesized that repetition priming may involve persistent peptidergic neuromodulation. We find that these peptides produce priming-like effects, i.e., they increase the firing of radula-opening (B48) and radula-closing (B8) motoneurons during motor programs. Proekt et al. (2004, 2007) showed that repetition priming of neuron B8 is implemented by modulatory inputs that B8 receives from the CPG. In contrast, our current findings indicate that priming of B48 may be implemented by a direct peptidergic modulation of its intrinsic characteristics via a pathway that activates cAMP. We suggest that the direct versus indirect, i.e., CPG-dependent, repetition priming may be related to the type of input that individual motoneurons receive from the CPG. We suggest that in motoneurons that are driven by concurrent excitation-inhibition, repetition priming is indirect as it is preferentially implemented via modulation of the output of CPGs. In contrast, in motoneurons that are driven by alternating excitation-inhibition, direct modulation of motoneurons may be preferentially used.

Gross and histologic evaluation of 5 suture materials in the skin and subcutaneous tissue of the California sea hare (Aplysia californica)

Invertebrates are increasing in their importance to both the public and private aquarium trade and play a vital role in biomedical research. Surgical techniques have become an important approach to obtaining data and maintaining good health in both of these areas. However, studies examining tissue reaction to suture material in invertebrates are lacking. The current study evaluated the gross and histologic reaction of Aplysia californica to 5 commonly used suture materials, including polydioxanone, black braided silk, polyglactin 910, monofilament nylon, and monofilament poliglecaprone. Histologic samples were graded on the amount of edema (score, 1 to 4), inflammation (1 to 4), and granuloma formation (1 to 4) present, and a final overall histology score (1 to 6) was assigned to each sample. Compared with untreated control tissue, all suture materials caused significantly increased tissue reaction, but the overall histology score did not differ among the suture materials. Silk was the only suture that did not have a significantly increased granuloma score when compared with the control. Although none of the suture materials evaluated seemed clearly superior for use in Aplysia, we recommend silk because of its less robust granuloma induction, which is favorable in a clinical and research setting.

State dependence of network output: modeling and experiments

Emerging experimental evidence suggests that both networks and their component neurons respond to similar inputs differently, depending on the state of network activity. The network state is determined by the intrinsic dynamical structure of the network and may change as a function of neuromodulation, the balance or stochasticity of synaptic inputs to the network, and the history of network activity. Much of the knowledge on state-dependent effects comes from comparisons of awake and sleep states of the mammalian brain. Yet, the mechanisms underlying these states are difficult to unravel. Several vertebrate and invertebrate studies have elucidated cellular and synaptic mechanisms of state dependence resulting from neuromodulation, sensory input, and experience. Recent studies have combined modeling and experiments to examine the computational principles that emerge when network state is taken into account; these studies are highlighted in this article. We discuss these principles in a variety of systems (mammalian, crustacean, and mollusk) to demonstrate the unifying theme of state dependence of network output.

Behavioral states, network states, and sensory response variability

We review data demonstrating that single-neuron sensory responses change with the states of the neural networks (indexed in terms of spectral properties of local field potentials) in which those neurons are embedded. We start with broad network changes--different levels of anesthesia and sleep--and then move to studies demonstrating that the sensory response plasticity associated with attention and experience can also be conceptualized as functions of network state changes. This leads naturally to the recent data that can be interpreted to suggest that even brief experience can change sensory responses via changes in network states and that trial-to-trial variability in sensory responses is a nonrandom function of network fluctuations, as well. We suggest that the CNS may have evolved specifically to deal with stimulus variability and that the coupling with network states may be central to sensory processing.

Noise in the nervous system

Noise--random disturbances of signals--poses a fundamental problem for information processing and affects all aspects of nervous-system function. However, the nature, amount and impact of noise in the nervous system have only recently been addressed in a quantitative manner. Experimental and computational methods have shown that multiple noise sources contribute to cellular and behavioural trial-to-trial variability. We review the sources of noise in the nervous system, from the molecular to the behavioural level, and show how noise contributes to trial-to-trial variability. We highlight how noise affects neuronal networks and the principles the nervous system applies to counter detrimental effects of noise, and briefly discuss noise's potential benefits.

An input-representing interneuron regulates spike timing and thereby phase switching in a motor network

Despite the importance of spike-timing regulation in network functioning, little is known about this regulation at the cellular level. In the Aplysia feeding network, we show that interneuron B65 regulates the timing of the spike initiation of phase-switch neurons B64 and cerebral-buccal interneuron-5/6 (CBI-5/6), and thereby determines the identity of the neuron that acts as a protraction terminator. Previous work showed that B64 begins to fire before the end of protraction phase and terminates protraction in CBI-2-elicited ingestive, but not in CBI-2-elicited egestive programs, thus indicating that the spike timing and phase-switching function of B64 depend on the type of the central pattern generator (CPG)-elicited response rather than on the input used to activate the CPG. Here, we find that CBI-5/6 is a protraction terminator in egestive programs elicited by the esophageal nerve (EN), but not by CBI-2, thus indicating that, in contrast to B64, the spike timing and protraction-terminating function of CBI-5/6 depends on the input to the CPG rather than the response type. Interestingly, B65 activity also depends on the input in that B65 is highly active in EN-elicited programs, but not in CBI-2-elicited programs independent of whether the programs are ingestive or egestive. Notably, during EN-elicited egestive programs, hyperpolarization of B65 delays the onset of CBI-5/6 firing, whereas in CBI-2-elicited ingestive programs, B65 stimulation simultaneously advances CBI-5/6 firing and delays B64 firing, thereby substituting CBI-5/6 for B64 as the protraction terminator. Thus, we identified a neural mechanism that, in an input-dependent manner, regulates spike timing and thereby the functional role of specific neurons.

Swallowing and dysphagia rehabilitation: translating principles of neural plasticity into clinically oriented evidence

PURPOSE

This review presents the state of swallowing rehabilitation science as it relates to evidence for neural plastic changes in the brain. The case is made for essential collaboration between clinical and basic scientists to expand the positive influences of dysphagia rehabilitation in synergy with growth in technology and knowledge. The intent is to stimulate thought and propose potential research directions.

METHOD

A working group of experts in swallowing and dysphagia reviews 10 principles of neural plasticity and integrates these advancing neural plastic concepts with swallowing and clinical dysphagia literature for translation into treatment paradigms. In this context, dysphagia refers to disordered swallowing associated with central and peripheral sensorimotor deficits associated with stroke, neurodegenerative disease, tumors of the head and neck, infection, or trauma.

RESULTS AND CONCLUSIONS

The optimal treatment parameters emerging from increased understanding of neural plastic principles and concepts will contribute to evidence-based practice. Integrating these principles will improve dysphagia rehabilitation directions, strategies, and outcomes. A strategic plan is discussed, including several experimental paradigms for the translation of these principles and concepts of neural plasticity into the clinical science of rehabilitation for oropharyngeal swallowing disorders, ultimately providing the evidence to substantiate their translation into clinical practice.

Predicting adaptive behavior in the environment from central nervous system dynamics

To generate adaptive behavior, the nervous system is coupled to the environment. The coupling constrains the dynamical properties that the nervous system and the environment must have relative to each other if adaptive behavior is to be produced. In previous computational studies, such constraints have been used to evolve controllers or artificial agents to perform a behavioral task in a given environment. Often, however, we already know the controller, the real nervous system, and its dynamics. Here we propose that the constraints can also be used to solve the inverse problem--to predict from the dynamics of the nervous system the environment to which they are adapted, and so reconstruct the production of the adaptive behavior by the entire coupled system. We illustrate how this can be done in the feeding system of the sea slug Aplysia. At the core of this system is a central pattern generator (CPG) that, with dynamics on both fast and slow time scales, integrates incoming sensory stimuli to produce ingestive and egestive motor programs. We run models embodying these CPG dynamics--in effect, autonomous Aplysia agents--in various feeding environments and analyze the performance of the entire system in a realistic feeding task. We find that the dynamics of the system are tuned for optimal performance in a narrow range of environments that correspond well to those that Aplysia encounter in the wild. In these environments, the slow CPG dynamics implement efficient ingestion of edible seaweed strips with minimal sensory information about them. The fast dynamics then implement a switch to a different behavioral mode in which the system ignores the sensory information completely and follows an internal "goal," emergent from the dynamics, to egest again a strip that proves to be inedible. Key predictions of this reconstruction are confirmed in real feeding animals.

State dependence of spike timing and neuronal function in a motor pattern generating network

When sustained firing of a neuron is similar in different types of motor programs, its role in the generation of these programs is often similar. We investigated whether this is also the case for neurons involved in phase transition. In the Aplysia feeding central pattern generator (CPG), identified interneuron B64 starts firing at the transition between the protraction and the retraction phases of all types of motor programs, and its firing is sustained during the retraction phase. It was thought that B64 functions as a protraction terminator as it provides strong inhibitory input to protraction interneurons and motoneurons. Furthermore, premature activation of B64 can lead to premature termination of the protraction phase. Indeed, as we show here, B64 can terminate the protraction phase regardless of the type of motor program. However, B64 actually only functions as a protraction terminator in ingestive-like but not in egestive-like programs. This differential role of B64 results from a differential timing of the initiation of B64 spiking in the two types of programs. In turn, this differential timing of the initiation of B64 firing is determined by the internal state of the CPG. Thus, this study indicates the importance of the timing of initiation of firing in determining the functional role of a neuron and demonstrates that this role depends on the activity-dependent state of the network.

Currents contributing to decision making in neurons B31/B32 of Aplysia

Biophysical properties of neurons contributing to the ability of an animal to decide whether or not to respond were examined. B31/B32, two pairs of bilaterally symmetrical Aplysia neurons, are major participants in deciding to initiate a buccal motor program, the neural correlate of a consummatory feeding response. B31/B32 respond to an adequate stimulus after a delay, during which time additional stimuli influence the decision to respond. B31/B32 then respond with a ramp depolarization followed by a sustained soma depolarization and axon spiking that is the expression of a commitment to respond to food. Four currents contributing to decision making in B31/B32 were characterized, and their functional effects were determined, in current- and voltage-clamp experiments and with simulations. Inward currents arising from slow muscarinic transmission were characterized. These currents contribute to the B31/B32 depolarization. Their slow activation kinetics contribute to the delay preceding B31/B32 activity. After the delay, inward currents affect B31/B32 in the context of two endogenous inactivating outward currents: a delayed rectifier K+ current (I(K-V)) and an A-type K+ current (I(K-A)), as well as a high-threshold noninactivating outward current (I(maintained)). Hodgkin-Huxley kinetic analyses were performed on the outward currents. Simulations using equations from these analyses showed that I(K-V) and I(K-A) slow the ramp depolarization preceding the sustained depolarization. The three outward currents contribute to braking the B31/B32 depolarization and keeping the sustained depolarization at a constant voltage. The currents identified are sufficient to explain the properties of B31/B32 that play a role in generating the decision to feed.

Behavioral and in vitro correlates of compulsive-like food seeking induced by operant conditioning in Aplysia

Motivated behaviors comprise appetitive actions whose occurrence results partly from an internally driven incentive to act. Such impulsive behavior can also be regulated by external rewarding stimuli that, through learning processes, can lead to accelerated and seemingly automatic, compulsive-like recurrences of the rewarded act. Here, we explored such behavioral plasticity in Aplysia by analyzing how appetitive reward stimulation in a form of operant conditioning can modify a goal-directed component of the animal's food-seeking behavior. In naive animals, protraction/retraction cycles of the tongue-like radula are expressed sporadically with highly variable interbite intervals. In contrast, animals that were previously given a food-reward stimulus in association with each spontaneous radula bite now expressed movement cycles with an elevated frequency and a stereotyped rhythmic organization. This rate increase and regularization, which was retained for several hours after training, depended on both the reward quality and its contingency because accelerated, stereotyped biting was not induced in animals that had previously received a less-palatable food stimulus or had been subjected to nonassociative reward stimulation. Neuronal correlates of these learning-induced changes were also expressed in the radula motor pattern-generating circuitry of isolated buccal ganglia. In such in vitro preparations, moreover, manipulation of the burst frequency of the bilateral motor pattern-initiating B63 interneurons indicated that the regularization of radula motor pattern generation in contingently trained animals occurred separately from an increase in cycle rate, thereby suggesting independent processes of network plasticity. These data therefore suggest that operant conditioning can induce compulsive-like actions in Aplysia feeding behavior and provide a substrate for a cellular analysis of the underlying mechanisms.

Functional penetration of variability of motor neuron spike timing through a modulated neuromuscular system

Variability of the neuronal spike pattern is usually thought of in terms of the information that the different interspike intervals might be encoding. However, the very presence of the variability can have other kinds of functional significance. Here we consider the example of the B15/B16-ARC neuromuscular system of Aplysia, a model system for the study of neuromuscular modulation and control. We show that variability of motor neuron spike timing at the input to the system penetrates throughout the system, affecting all downstream variables including modulator release, modulator concentrations, modulatory actions, and the contraction of the muscle. Furthermore, not only does the variability penetrate through the system, but it is actually instrumental in maintaining its modulation and contractions at a robust, physiological level.

Order in spontaneous behavior

Brains are usually described as input/output systems: they transform sensory input into motor output. However, the motor output of brains (behavior) is notoriously variable, even under identical sensory conditions. The question of whether this behavioral variability merely reflects residual deviations due to extrinsic random noise in such otherwise deterministic systems or an intrinsic, adaptive indeterminacy trait is central for the basic understanding of brain function. Instead of random noise, we find a fractal order (resembling Lévy flights) in the temporal structure of spontaneous flight maneuvers in tethered Drosophila fruit flies. Lévy-like probabilistic behavior patterns are evolutionarily conserved, suggesting a general neural mechanism underlying spontaneous behavior. Drosophila can produce these patterns endogenously, without any external cues. The fly's behavior is controlled by brain circuits which operate as a nonlinear system with unstable dynamics far from equilibrium. These findings suggest that both general models of brain function and autonomous agents ought to include biologically relevant nonlinear, endogenous behavior-initiating mechanisms if they strive to realistically simulate biological brains or out-compete other agents.

Leaf mechanical properties modulate feeding movements and ingestive success of the pond snail, Lymnaea stagnalis

We examined the mechanical properties of Butterhead and Iceberg lettuce leaves, and the rate at which they were eaten by the pond snail Lymnaea stagnalis. The outer part of Butterhead leaves were less robust than either the inner Butterhead or outer Iceberg leaves (Young's modulus 2.8, 5.2, 7.7 MPa respectively; ultimate tensile stress 0.18, 0.34 0.51 MPa) which were also thicker. Snails ingested inner Butterhead and Iceberg strips more slowly (36 and 32%) than outer Butterhead. This was not due to differences in latency to first bite or biting rate. Rather, the drop was due to a decrease in the proportion of successful bites (inner Butterhead 84%; Iceberg 86%), to a shorter length ingested per bite (inner Butterhead 55%; Iceberg 45%) and to increased handling time (inner Butterhead 30%). We conclude that sensory input from the mechanically more robust lettuce slows the buccal central pattern generator.

Variability of motor neuron spike timing maintains and shapes contractions of the accessory radula closer muscle of Aplysia

The accessory radula closer (ARC) muscle of Aplysia has long been studied as a typical "slow" muscle, one that would be assumed to respond only to the overall, integrated spike rate of its motor neurons, B15 and B16. The precise timing of the individual spikes should not much matter. However, but real B15 and B16 spike patterns recorded in vivo show great variability that extends down to the timing of individual spikes. By replaying these real as well as artificially constructed spike patterns into ARC muscles in vitro, we examined the consequences of this spike-level variability for contraction. Replaying the same pattern several times reproduces precisely the same contraction shape: the B15/B16-ARC neuromuscular transform is deterministic. However, varying the timing of the spikes produces very different contraction shapes and amplitudes. The transform in fact operates at an interface between "fast" and "slow" regimens. It is fast enough that the timing of individual spikes greatly influences the detailed contraction shape. At the same time, slow integration of the spike pattern through the nonlinear transform allows the variable spike timing to determine also the overall contraction amplitude. Indeed, the variability appears to be necessary to maintain the contraction amplitude at a robust level. This phenomenon is tuned by neuromodulators that tune the speed and nonlinearity of the transform. Thus, the variable timing of individual spikes does matter, in at least two, functionally significant ways, in this "slow" neuromuscular system.

Cycle-to-cycle variability as an optimal behavioral strategy

Aplysia feeding behavior is highly variable from cycle to cycle. In some cycles, when the variability causes a mismatch between the animal's movements and the requirements of the feeding task, the variability makes the behavior unsuccessful. We propose that the behavior is variable nevertheless because the variability serves a higher-order functional purpose. When the animal is faced with a new and only imperfectly known feeding task in each cycle, the variability implements a trial-and-error search through the space of possible feeding movements. Over many cycles, this may be the animal's optimal strategy in an uncertain and changing feeding environment.

A central pattern generator producing alternative outputs: temporal pattern of premotor activity

The central pattern generator for heartbeat in medicinal leeches constitutes seven identified pairs of segmental heart interneurons. Four identified pairs of heart interneurons make a staggered pattern of inhibitory synaptic connections with segmental heart motor neurons. Using extracellular recording from multiple interneurons in the network in 56 isolated nerve cords, we show that this pattern generator produces a side-to-side asymmetric pattern of intersegmental coordination among ipsilateral premotor interneurons. This pattern corresponds to a similarly asymmetric fictive motor pattern in heart motor neurons and asymmetric constriction pattern of the two tubular hearts, synchronous and peristaltic. We provide a quantitative description of the firing pattern of all the premotor interneurons, including phase, duty cycle, and intraburst frequency of this premotor activity pattern. This analysis identifies two stereotypical coordination modes corresponding to synchronous and peristaltic, which show phase constancy over a broad range of periods as do the fictive motor pattern and the heart constriction pattern. Coordination mode is controlled through one segmental pair of heart interneurons (switch interneurons). Side-to-side switches in coordination mode are a regular feature of this pattern generator and occur with changes in activity state of these switch interneurons. Associated with synchronous coordination of premotor interneurons, the ipsilateral switch interneuron is in an active state, during which it produces rhythmic bursts, whereas associated with peristaltic coordination, the ipsilateral switch interneuron is largely silent. We argue that timing and pattern elaboration are separate functions produced by overlapping subnetworks in the heartbeat central pattern generator.