Contingent-dependent enhancement of rhythmic motor patterns: an in vitro analog of operant conditioning

Combining voltage-sensitive dye, carbon fiber array, and extracellular nerve electrodes using a 3-D printed recording chamber and manipulators

BACKGROUND

The analyses of neuronal circuits require high-throughput technologies for stimulating and recording many neurons simultaneously with single-neuron precision. Voltage-sensitive dyes (VSDs) have enabled the monitoring of membrane potentials of many (10-100 s) neurons simultaneously. Carbon fiber electrode (CFE) arrays allow for stimulation and recording of many neurons simultaneously, including intracellularly.

NEW METHOD

Combining CFE with VSD leverages the advantages of both technologies, allowing for stimulation of single neurons while recording the activity of the entire network. 3-D printing technology was used to develop a chamber to simultaneously perform VSD imaging, CFE array recording, and extracellular recording from individual glass electrodes.

RESULTS

Aplysia buccal ganglia were stained with VSD and imaged while also recording using a CFE array and extracellular nerve electrodes. Coincident spiking activity was recorded by VSD, CFE, and extracellular nerve electrodes. Current injection with CFE electrodes could activate and inhibit individual neurons as detected by VSD and nerve recordings.

COMPARISON TO EXISTING METHODS

The large size of traditional manipulators limits the number of electrodes used and the number of neurons recorded during an experiment. Here we present a method to build a 3-D printed recording chamber that includes a 3-axis micromanipulator to position a CFE array and eight 2-axis manipulators to position eight extracellular electrodes.

CONCLUSIONS

3-D printing technology can be used to build a custom recording chamber and micromanipulators. Combining these technologies allows for the direct modulation of the activity of neurons while recording the activity of 100 s of neurons simultaneously.

Convergent effects of neuropeptides on the feeding central pattern generator of Aplysia californica

Modulators that induce distinct motor programs act divergently on neural networks to specify output. We study a situation where modulators that act divergently also act convergently. We focus on an interneuron (B63) that is part of the feeding central pattern generator (CPG) in Aplysia californica. Previous work has established that B63 is critical for program initiation regardless of the type of evoked activity. B63 receives input from a number of different elements of the feeding circuit. Program initiation occurs reliably when some are activated, but we show it does not occur reliably with activation of others. When program initiation is reliable, modulatory neuropeptides are released. For example, previous work has established that an ingestive input to the feeding CPG, cerebral buccal interneuron 2 (CBI-2), releases feeding circuit activating peptide (FCAP) and cerebral peptide 2 (CP-2). Afferents with processes in the esophageal nerve (EN) that trigger egestive motor programs release small cardioactive peptide (SCP). Previous studies have described divergent effects of FCAP/CP-2 and SCP on the feeding circuit that specify motor activity. Here, we show that FCAP/CP-2 and SCP increase the B63 excitability. Thus, we show that peptides that have well characterized divergent effects on the feeding circuit additionally act convergently at the level of a single neuron. Since convergent effects of neuromodulators are not necessary for specifying network output, we ask why they might be important. Our data suggest that they have an impact during a task switch.

From Biological Synapses to “Intelligent” Robots

This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.

Specific Plasticity Loci and Their Synergism Mediate Operant Conditioning

Despite numerous studies examining the mechanisms of operant conditioning (OC), the diversity of OC plasticity loci and their synergism have not been examined sufficiently. In the well-characterized feeding neural circuit of Aplysia, in vivo and in vitro appetitive OC increases neuronal excitability and electrical coupling among several neurons leading to an increase in expression of ingestive behavior. Here, we used the in vitro analog of OC to investigate whether OC reduces the excitability of a neuron, B4, whose inhibitory connections decrease expression of ingestive behavior. We found OC decreased the excitability of B4. This change appeared intrinsic to B4 because it could be replicated with an analog of OC in isolated cultures of B4 neurons. In addition to changes in B4 excitability, OC decreased the strength of B4's inhibitory connection to a key decision-making neuron, B51. The OC-induced changes were specific without affecting the excitability of another neuron critical for feeding behavior, B8, or the B4-to-B8 inhibitory connection. A conductance-based circuit model indicated that reducing the B4-to-B51 synapse, or increasing B51 excitability, mediated the OC phenotype more effectively than did decreasing B4 excitability. We combined these modifications to examine whether they could act synergistically. Combinations including B51 synergistically enhanced feeding. Taken together, these results suggest modifications of diverse loci work synergistically to mediate OC and that some neurons are well suited to work synergistically with plasticity in other loci.SIGNIFICANCE STATEMENT The ways in which synergism of diverse plasticity loci mediate the change in motor patterns in operant conditioning (OC) are poorly understood. Here, we found that OC was in part mediated by decreasing the intrinsic excitability of a critical neuron of Aplysia feeding behavior, and specifically reducing the strength of one of its inhibitory connections that targets a key decision-making neuron. A conductance-based computational model indicated that the known plasticity loci showed a surprising level of synergism to mediate the behavioral changes associated with OC. These results highlight the importance of understanding the diversity, specificity and synergy among different types of plasticity that encode memory. Also, because OC in Aplysia is mediated by dopamine (DA), the present study provides insights into specific and synergistic mechanisms of DA-mediated reinforcement of behaviors.

Neuronal population activity dynamics reveal a low-dimensional signature of operant learning in Aplysia

Learning engages a high-dimensional neuronal population space spanning multiple brain regions. However, it remains unknown whether it is possible to identify a low-dimensional signature associated with operant conditioning, a ubiquitous form of learning in which animals learn from the consequences of behavior. Using single-neuron resolution voltage imaging, here we identify two low-dimensional motor modules in the neuronal population underlying Aplysia feeding. Our findings point to a temporal shift in module recruitment as the primary signature of operant learning. Our findings can help guide characterization of learning signatures in systems in which only a smaller fraction of the relevant neuronal population can be monitored.

Costa et al. use single-neuron resolution voltage imaging to identify two low-dimensional motor modules in the neuronal population underlying Aplysia feeding. Their findings point to a temporal shift in module recruitment as the primary signature of operant learning.

Organelle calcium-derived voltage oscillations in pacemaker neurons drive the motor program for food-seeking behavior in Aplysia

The expression of motivated behaviors depends on both external and internally arising neural stimuli, yet the intrinsic releasing mechanisms for such variably occurring behaviors remain elusive. In isolated nervous system preparations of Aplysia, we have found that irregularly expressed cycles of motor output underlying food-seeking behavior arise from regular membrane potential oscillations of varying magnitude in an identified pair of interneurons (B63) in the bilateral buccal ganglia. This rhythmic signal, which is specific to the B63 cells, is generated by organelle-derived intracellular calcium fluxes that activate voltage-independent plasma membrane channels. The resulting voltage oscillation spreads throughout a subset of gap junction-coupled buccal network neurons and by triggering plateau potential-mediated bursts in B63, can initiate motor output driving food-seeking action. Thus, an atypical neuronal pacemaker mechanism, based on rhythmic intracellular calcium store release and intercellular propagation, can act as an autonomous intrinsic releaser for the occurrence of a motivated behavior.

The brain as a dynamically active organ

Nervous systems are typically described as static networks passively responding to external stimuli (i.e., the 'sensorimotor hypothesis'). However, for more than a century now, evidence has been accumulating that this passive-static perspective is wrong. Instead, evidence suggests that nervous systems dynamically change their connectivity and actively generate behavior so their owners can achieve goals in the world, some of which involve controlling their sensory feedback. This review provides a brief overview of the different historical perspectives on general brain function and details some select modern examples falsifying the sensorimotor hypothesis.

Dopamine as a Multifunctional Neurotransmitter in Gastropod Molluscs: An Evolutionary Hypothesis

AbstractThe catecholamine 3,4-dihydroxyphenethylamine, or dopamine, acts as a neurotransmitter across a broad phylogenetic spectrum. Functions attributed to dopamine in the mammalian brain include regulation of motor circuits, valuation of sensory stimuli, and mediation of reward or reinforcement signals. Considerable evidence also supports a neurotransmitter role for dopamine in gastropod molluscs, and there is growing appreciation for its potential common functions across phylogeny. This article reviews evidence for dopamine's transmitter role in the nervous systems of gastropods. The functional properties of identified dopaminergic neurons in well-characterized neural circuits suggest a hypothetical incremental sequence by which dopamine accumulated its diverse roles. The successive acquisition of dopamine functions is proposed in the context of gastropod feeding behavior: (1) sensation of potential nutrients, (2) activation of motor circuits, (3) selection of motor patterns from multifunctional circuits, (4) valuation of sensory stimuli with reference to internal state, (5) association of motor programs with their outcomes, and (6) coincidence detection between sensory stimuli and their consequences. At each stage of this sequence, it is proposed that existing functions of dopaminergic neurons favored their recruitment to fulfill additional information processing demands. Common functions of dopamine in other intensively studied groups, ranging from mammals and insects to nematodes, suggest an ancient origin for this progression.

Computational model of the distributed representation of operant reward memory: combinatoric engagement of intrinsic and synaptic plasticity mechanisms

Operant reward learning of feeding behavior in Aplysia increases the frequency and regularity of biting, as well as biases buccal motor patterns (BMPs) toward ingestion-like BMPs (iBMPs). The engram underlying this memory comprises cells that are part of a central pattern generating (CPG) circuit and includes increases in the intrinsic excitability of identified cells B30, B51, B63, and B65, and increases in B63-B30 and B63-B65 electrical synaptic coupling. To examine the ways in which sites of plasticity (individually and in combination) contribute to memory expression, a model of the CPG was developed. The model included conductance-based descriptions of cells CBI-2, B4, B8, B20, B30, B31, B34, B40, B51, B52, B63, B64, and B65, and their synaptic connections. The model generated patterned activity that resembled physiological BMPs, and implementation of the engram reproduced increases in frequency, regularity, and bias. Combined enhancement of B30, B63, and B65 excitabilities increased BMP frequency and regularity, but not bias toward iBMPs. Individually, B30 increased regularity and bias, B51 increased bias, B63 increased frequency, and B65 decreased all three BMP features. Combined synaptic plasticity contributed primarily to regularity, but also to frequency and bias. B63-B30 coupling contributed to regularity and bias, and B63-B65 coupling contributed to all BMP features. Each site of plasticity altered multiple BMP features simultaneously. Moreover, plasticity loci exhibited mutual dependence and synergism. These results indicate that the memory for operant reward learning emerged from the combinatoric engagement of multiple sites of plasticity.

Successful and unsuccessful attempts to swallow in a reduced Aplysia preparation regulate feeding responses and produce memory at different neural sites

Sensory feedback shapes ongoing behavior and may produce learning and memory. Motor responses to edible or inedible food in a reduced Aplysia preparation were examined to test how sensory feedback affects behavior and memory. Feeding patterns were initiated by applying a cholinomimetic onto the cerebral ganglion. Feedback from buccal muscles increased the response variability and response rate. Repeated application of the cholinomimetic caused decreased responses, expressed in part by lengthening protractions. Swallowing strips of "edible" food, which in intact animals induces learning that enhances ingestion, increased the response rate, and shortened the protraction length, reflecting more swallowing. Testing memory by repeating the procedure prevented the decrease in response rate observed with the cholinomimetic alone, and shortened protractions. Training with "inedible" food that in intact animals produces learning expressed by decreased responses caused lengthened protractions. Testing memory by repeating the procedure did not cause decreased responses or lengthened protractions. After training and testing with edible or inedible food, all preparations were exposed to the cholinomimetic alone. Preparations previously trained with edible food displayed memory expressed as decreased protraction length. Preparations previously trained with inedible food showed decreases in many response parameters. Memory for inedible food may arise in part via a postsynaptic decrease in response to acetylcholine released by afferents sensing food. The lack of change in response number, and in the time that responses are maintained during the two training sessions preceding application of the cholinomimetic alone suggests that memory expression may differ from behavioral changes during training.

A role for dopamine in the peripheral sensory processing of a gastropod mollusc

Histological evidence points to the presence of dopamine (DA) in the cephalic sensory organs of multiple gastropod molluscs, suggesting a possible sensory role for the neurotransmitter. We investigated the sensory function of DA in the nudipleuran Pleurobranchaea californica, in which the central neural correlates of sensation and foraging behavior have been well characterized. Tyrosine hydroxylase-like immunoreactivity (THli), a signature of the dopamine synthetic pathway, was similar to that found in two other opisthobranchs and two pulmonates previously studied: 1) relatively few (<100) THli neuronal somata were observed in the central ganglia, with those observed found in locations similar to those documented in the other snails but varying in number, and 2) the vast majority of THli somata were located in the peripheral nervous system, were associated with ciliated, putative primary sensory cells, and were highly concentrated in chemotactile sensory organs, giving rise to afferent axons projecting to the central nervous system. We extended these findings by observing that applying a selective D₂/D₃ receptor antagonist to the chemo- and mechanosensory oral veil-tentacle complex of behaving animals significantly delayed feeding behavior in response to an appetitive stimulus. A D₁ blocker had no effect. Recordings of the two major cephalic sensory nerves, the tentacle and large oral veil nerves, in a deganglionated head preparation revealed a decrease of stimulus-evoked activity in the former nerve following application of the same D₂/D₃ antagonist. Broadly, our results implicate DA in sensation and engender speculation regarding the foraging-based decisions the neurotransmitter may serve in the nervous system of Pleurobranchaea and, by extension, other gastropods.

A novel in vitro analog expressing learning-induced cellular correlates in distinct neural circuits

When presented with noxious stimuli, Aplysia exhibits concurrent sensitization of defensive responses, such as the tail-induced siphon withdrawal reflex (TSWR) and suppression of feeding. At the cellular level, sensitization of the TSWR is accompanied by an increase in the excitability of the tail sensory neurons (TSNs) that elicit the reflex, whereas feeding suppression is accompanied by decreased excitability of B51, a decision-making neuron in the feeding neural circuit. The goal of this study was to develop an in vitro analog coexpressing the above cellular correlates. We used a reduced preparation consisting of buccal, cerebral, and pleural-pedal ganglia, which contain the neural circuits controlling feeding and the TSWR, respectively. Sensitizing stimuli were delivered in vitro by electrical stimulation of afferent nerves. When trained with sensitizing stimuli, the in vitro analog expressed concomitant increased excitability in TSNs and decreased excitability in B51, which are consistent with the occurrence of sensitization and feeding suppression induced by in vivo training. This in vitro analog expressed both short-term (15 min) and long-term (24 h) excitability changes in TSNs and B51, depending on the amount of training administered. Finally, in vitro application of serotonin increased TSN excitability without altering B51 excitability, mirroring the in vivo application of the monoamine that induces sensitization, but not feeding suppression.

Operant Reward Learning in Aplysia

Anticipating the future has a decided evolutionary advantage, and researchers have found many evolutionarily conserved mechanisms by which humans and animals learn to predict future events. Researchers often study such learned behavior using conditioning experiments. The marine snail Aplysia has been at the forefront of research into the cellular and molecular mechanisms of classical conditioning. Recently, Aplysia has also gained a reputation as a valuable model system for operant reward learning. Its feeding behavior can be operantly conditioned in the intact animal as well as in reduced preparations of the nervous system. The reward signal relies on dopamine transmission and acts in conjunction with activity in an identified neuron (B51) to bring about operant memory.

Change in excitability of a putative decision-making neuron in Aplysia serves as a mechanism in the decision not to feed following food satiation

Although decision making is a ubiquitous function, the understanding of its underlying mechanisms remains limited, particularly at the single-cell level. In this study, we used the decision not to feed that follows satiation in the marine mollusk Aplysia to examine the role of putative decision-making neuron B51 in this process. B51 is a neuron in the feeding neural circuit that exhibits decision-making characteristics in vitro, which bias the circuit toward producing the motor programs responsible for biting behavior. Once satiated, Aplysia decided not to bite for a prolonged period of time (≥24h) when presented with a food stimulus that normally elicits feeding in non-satiated animals. Twenty-four hours after satiation, suppressed feeding was accompanied by a significant decrease of B51 excitability compared to the control group of unfed animals. No differences were measured in B51 resting membrane properties or synaptic input to B51 between the satiated and control groups. When B51 properties were measured at a time point in which feeding had recovered from the suppressive effects of satiation (i.e., 96 h after satiation), no difference in B51 excitability was observed between satiated and control groups. These findings indicate that B51 excitability changes in a manner that is coherent with the modifications in biting resulting from food satiation, thus implicating this neuron as a site of plasticity underlying the decision not to bite following food satiation in Aplysia.

Differential activation of an identified motor neuron and neuromodulation provide Aplysia's retractor muscle an additional function

To survive, animals must use the same peripheral structures to perform a variety of tasks. How does a nervous system employ one muscle to perform multiple functions? We addressed this question through work on the I3 jaw muscle of the marine mollusk Aplysia californica's feeding system. This muscle mediates retraction of Aplysia's food grasper in multiple feeding responses and is innervated by a pool of identified neurons that activate different muscle regions. One I3 motor neuron, B38, is active in the protraction phase, rather than the retraction phase, suggesting the muscle has an additional function. We used intracellular, extracellular, and muscle force recordings in several in vitro preparations as well as recordings of nerve and muscle activity from intact, behaving animals to characterize B38's activation of the muscle and its activity in different behavior types. We show that B38 specifically activates the anterior region of I3 and is specifically recruited during one behavior, swallowing. The function of this protraction-phase jaw muscle contraction is to hold food; thus the I3 muscle has an additional function beyond mediating retraction. We additionally show that B38's typical activity during in vivo swallowing is insufficient to generate force in an unmodulated muscle and that intrinsic and extrinsic modulation shift the force-frequency relationship to allow contraction. Using methods that traverse levels from individual neuron to muscle to intact animal, we show how regional muscle activation, differential motor neuron recruitment, and neuromodulation are key components in Aplysia's generation of multifunctionality.

Transient and selective suppression of neural activity with infrared light

Analysis and control of neural circuitry requires the ability to selectively activate or inhibit neurons. Previous work showed that infrared laser light selectively excited neural activity in endogenous unmyelinated and myelinated axons. However, inhibition of neuronal firing with infrared light was only observed in limited cases, is not well understood and was not precisely controlled. Using an experimentally tractable unmyelinated preparation for detailed investigation and a myelinated preparation for validation, we report that it is possible to selectively and transiently inhibit electrically-initiated axonal activation, as well as to both block or enhance the propagation of action potentials of specific motor neurons. Thus, in addition to previously shown excitation, we demonstrate an optical method of suppressing components of the nervous system with functional spatiotemporal precision. We believe this technique is well-suited for non-invasive investigations of diverse excitable tissues and may ultimately be applied for treating neurological disorders.

Implication of dopaminergic modulation in operant reward learning and the induction of compulsive-like feeding behavior in Aplysia

Feeding in Aplysia provides an amenable model system for analyzing the neuronal substrates of motivated behavior and its adaptability by associative reward learning and neuromodulation. Among such learning processes, appetitive operant conditioning that leads to a compulsive-like expression of feeding actions is known to be associated with changes in the membrane properties and electrical coupling of essential action-initiating B63 neurons in the buccal central pattern generator (CPG). Moreover, the food-reward signal for this learning is conveyed in the esophageal nerve (En), an input nerve rich in dopamine-containing fibers. Here, to investigate whether dopamine (DA) is involved in this learning-induced plasticity, we used an in vitro analog of operant conditioning in which electrical stimulation of En substituted the contingent reinforcement of biting movements in vivo. Our data indicate that contingent En stimulation does, indeed, replicate the operant learning-induced changes in CPG output and the underlying membrane and synaptic properties of B63. Significantly, moreover, this network and cellular plasticity was blocked when the input nerve was stimulated in the presence of the DA receptor antagonist cis-flupenthixol. These results therefore suggest that En-derived dopaminergic modulation of CPG circuitry contributes to the operant reward-dependent emergence of a compulsive-like expression of Aplysia's feeding behavior.

Responses of a bursting pacemaker to excitation reveal spatial segregation between bursting and spiking mechanisms

Central pattern generators (CPGs) frequently include bursting neurons that serve as pacemakers for rhythm generation. Phase resetting curves (PRCs) can provide insight into mechanisms underlying phase locking in such circuits. PRCs were constructed for a pacemaker bursting complex in the pyloric circuit in the stomatogastric ganglion of the lobster and crab. This complex is comprised of the Anterior Burster (AB) neuron and two Pyloric Dilator (PD) neurons that are all electrically coupled. Artificial excitatory synaptic conductance pulses of different strengths and durations were injected into one of the AB or PD somata using the Dynamic Clamp. Previously, we characterized the inhibitory PRCs by assuming a single slow process that enabled synaptic inputs to trigger switches between an up state in which spiking occurs and a down state in which it does not. Excitation produced five different PRC shapes, which could not be explained with such a simple model. A separate dendritic compartment was required to separate the mechanism that generates the up and down phases of the bursting envelope (1) from synaptic inputs applied at the soma, (2) from axonal spike generation and (3) from a slow process with a slower time scale than burst generation. This study reveals that due to the nonlinear properties and compartmentalization of ionic channels, the response to excitation is more complex than inhibition.

Towards a scientific concept of free will as a biological trait: spontaneous actions and decision-making in invertebrates

Until the advent of modern neuroscience, free will used to be a theological and a metaphysical concept, debated with little reference to brain function. Today, with ever increasing understanding of neurons, circuits and cognition, this concept has become outdated and any metaphysical account of free will is rightfully rejected. The consequence is not, however, that we become mindless automata responding predictably to external stimuli. On the contrary, accumulating evidence also from brains much smaller than ours points towards a general organization of brain function that incorporates flexible decision-making on the basis of complex computations negotiating internal and external processing. The adaptive value of such an organization consists of being unpredictable for competitors, prey or predators, as well as being able to explore the hidden resource deterministic automats would never find. At the same time, this organization allows all animals to respond efficiently with tried-and-tested behaviours to predictable and reliable stimuli. As has been the case so many times in the history of neuroscience, invertebrate model systems are spearheading these research efforts. This comparatively recent evidence indicates that one common ability of most if not all brains is to choose among different behavioural options even in the absence of differences in the environment and perform genuinely novel acts. Therefore, it seems a reasonable effort for any neurobiologist to join and support a rather illustrious list of scholars who are trying to wrestle the term 'free will' from its metaphysical ancestry. The goal is to arrive at a scientific concept of free will, starting from these recently discovered processes with a strong emphasis on the neurobiological mechanisms underlying them.

Octopamine promotes rhythmicity but not synchrony in a bilateral pair of bursting motor neurons in the feeding circuit of Aplysia

Octopamine-like immunoreactivity was localized to a limited number (<40) of neurons in the Aplysia central nervous system, including three neurons in the paired buccal ganglia (BG) that control feeding movements. Application of octopamine (OA) to the BG circuit produced concentration-dependent (10(-8)-10(-4) mol l(-1)) modulatory actions on the spontaneous burst activity of the bilaterally paired B67 pharyngeal motor neurons (MNs). OA increased B67's burst duration and the number of impulses per burst. These effects reflected actions of OA on the intrinsic tetrodotoxin-resistant driver potential (DP) that underlies B67 bursting. In addition to its effects on B67's burst parameters, OA also increased the rate and regularity of burst timing. Although the bilaterally paired B67 MNs both exhibited rhythmic bursting in the presence of OA, they did not become synchronized. In this respect, the response to OA differed from that of dopamine, another modulator of the feeding motor network, which produces both rhythmicity and synchrony of bursting in the paired B67 neurons. It is proposed that modulators can regulate burst synchrony of MNs by exerting a dual control over their intrinsic rhythmicity and their reciprocal capacity to generate membrane potential perturbations. In this simple system, dopaminergic and octopaminergic modulation could influence whether pharyngeal contractions occur in a bilaterally synchronous or asynchronous fashion.

Composite modulatory feedforward loop contributes to the establishment of a network state

Feedforward loops (FFLs) are one of many network motifs identified in a variety of complex networks, but their functional role in neural networks is not well understood. We provide evidence that combinatorial actions of multiple modulators may be organized as FFLs to promote a specific network state in the Aplysia feeding motor network. The Aplysia feeding central pattern generator (CPG) receives two distinct inputs-a higher-order interneuron cerebral-buccal interneuron-2 (CBI-2) and the esophageal nerve (EN)-that promote ingestive and egestive motor programs, respectively. EN stimulation elicits a persistent egestive network state, which enables the network to temporarily express egestive programs following a switch of input from the EN to CBI-2. Previous work showed that a modulatory CPG element, B65, is specifically activated by the EN and participates in establishing the egestive state by enhancing activity of egestion-promoting B20 interneurons while suppressing activity and synaptic outputs of ingestion-promoting B40 interneurons. Here a peptidergic contribution is mediated by small cardioactive peptide (SCP). Immunostaining and mass spectrometry show that SCP is present in the EN and is released on EN stimulation. Importantly, SCP directly enhances activity and synaptic outputs of B20 and suppresses activity and synaptic outputs of B40. Moreover, SCP promotes B65 activity. Thus the direct and indirect (through B65) pathways to B20 and B40 from SCPergic neurons constitute two FFLs with one functioning to promote egestive output and the other to suppress ingestive output. This composite FFL consisting of the two combined FFLs appears to be an effective means to co-regulate activity of two competing elements that do not inhibit each other, thereby contributing to establish specific network states.

Nitric oxide and histamine signal attempts to swallow: A component of learning that food is inedible in Aplysia

Memory that food is inedible in Aplysia arises from training requiring three contingent events. Nitric oxide (NO) and histamine are released by a neuron responding to one of these events, attempts to swallow food. Since NO release during training is necessary for subsequent memory and NO substitutes for attempts to swallow, it was suggested that NO functions during training as a signal of attempts to swallow. However, it has been shown that NO may also be released in other contexts affecting feeding, raising the possibility that its role in learning is unrelated to signaling attempts to swallow. We confirmed that NO during learning signals attempts to swallow, by showing that a variety of behavioral effects on feeding of blocking or adding NO do not affect learning and memory that a food is inedible. In addition, histamine had effects similar to NO on learning that food is inedible, as expected if the transmitters are released together when animals attempt to swallow. Blocking histamine during training blocked long-term memory, and exogenous histamine substituted for attempts to swallow. NO also substituted for histamine during training. Histamine at concentrations relevant to learning activates neuron metacerebral cell (MCC). However, MCC activity is not a good monitor of attempts to swallow during training, since the neuron responds equally well to other stimuli. These findings support and extend the hypothesis that NO and histamine signal efforts to swallow during learning, acting on targets other than the MCC that specifically respond to attempts to swallow.

Motor outputs in a multitasking network: relative contributions of inputs and experience-dependent network states

Network outputs elicited by a specific stimulus may differ radically depending on the momentary network state. One class of networks states-experience-dependent states-is known to operate in numerous networks, yet the fundamental question concerning the relative role that inputs and states play in determining the network outputs remains to be investigated in a behaviorally relevant manner. Because previous work indicated that in the isolated nervous system the motor outputs of the Aplysia feeding network are affected by experience-dependent states, we sought to establish the behavioral relevance of these outputs. We analyzed the phasing of firing of radula opening motoneurons (B44 and B48) relative to other previously characterized motoneurons. We found that the overall pattern of motoneuronal firing corresponds to the phasing of movements during feeding behavior, thus indicating a behavioral relevance of network outputs. Previous studies suggested that network inputs act to trigger a response rather than to shape its characteristics, with the latter function being fulfilled by network states. We show this is an oversimplification. In a rested state, different inputs elicited distinct responses, indicating that inputs not only trigger but also shape the responses. However, depending on the combination of inputs and states, responses were either dramatically altered by the network state or were indistinguishable from those observed in the rested state. We suggest that the relative contributions of inputs and states are dynamically regulated and, rather than being fixed, depend on the specifics of states and inputs.

Localization of biogenic amines in the foregut of Aplysia californica: catecholaminergic and serotonergic innervation

This study examined the catecholaminergic and serotonergic innervation of the foregut of Aplysia californica, a model system in which the control of feeding behaviors can be investigated at the cellular level. Similar numbers (15-25) of serotonin-like-immunoreactive (5HTli) and tyrosine hydroxylase-like-immunoreactive (THli) fibers were present in each (bilateral) esophageal nerve (En), the major source of pregastric neural innervation in this system. The majority of En 5HTli and THli fibers originated from the anterior branch (En(2)), which innervates the pharynx and the anterior esophagus. Fewer fibers were present in the posterior branch (En(1)), which innervates the majority of the esophagus and the crop. Backfills of the two En branches toward the central nervous system (CNS) labeled a single, centrifugally projecting serotonergic fiber, originating from the metacerebral cell (MCC). The MCC fiber projected only to En(2). No central THli neurons were found to project to the En. Surveys of the pharynx and esophagus revealed major differences between their patterns of catecholaminergic (CA) and serotonergic innervation. Whereas THli fibers and cell bodies were distributed throughout the foregut, 5HTli fibers were present in restricted plexi, and no 5HTli somata were detected. Double-labeling experiments in the periphery revealed THli neurons projecting toward the buccal ganglion via En(2). Other afferents received dense perisomatic serotonergic innervation. Finally, qualitative and quantitative differences were observed between the buccal motor programs (BMPs) produced by stimulation of the two En branches. These observations increase our understanding of aminergic contributions to the pregastric regulation of Aplysia feeding behaviors.

Predictions of phase-locking in excitatory hybrid networks: excitation does not promote phase-locking in pattern-generating networks as reliably as inhibition

Phase-locked activity is thought to underlie many high-level functions of the nervous system, the simplest of which are produced by central pattern generators (CPGs). It is not known whether we can define a theoretical framework that is sufficiently general to predict phase-locking in actual biological CPGs, nor is it known why the CPGs that have been characterized are dominated by inhibition. Previously, we applied a method based on phase response curves measured using inputs of biologically realistic amplitude and duration to predict the existence and stability of 1:1 phase-locked modes in hybrid networks of one biological and one model bursting neuron reciprocally connected with artificial inhibitory synapses. Here we extend this analysis to excitatory coupling. Using the pyloric dilator neuron from the stomatogastric ganglion of the American lobster as our biological cell, we experimentally prepared 86 networks using five biological neurons, four model neurons, and heterogeneous synapse strengths between 1 and 10,000 nS. In 77% of networks, our method was robust to biological noise and accurately predicted the phasic relationships. In 3%, our method was inaccurate. The remaining 20% were not amenable to analysis because our theoretical assumptions were violated. The high failure rate for excitation compared with inhibition was due to differential effects of noise and feedback on excitatory versus inhibitory coupling and suggests that CPGs dominated by excitatory synapses would require precise tuning to function, which may explain why CPGs rely primarily on inhibitory synapses.

Molecular mechanisms underlying a cellular analog of operant reward learning

Operant conditioning is a ubiquitous but mechanistically poorly understood form of associative learning in which an animal learns the consequences of its behavior. Using a single-cell analog of operant conditioning in neuron B51 of Aplysia, we examined second-messenger pathways engaged by activity and reward and how they may provide a biochemical association underlying operant learning. Conditioning was blocked by Rp-cAMP, a peptide inhibitor of PKA, a PKC inhibitor, and by expressing a dominant-negative isoform of Ca2+-dependent PKC (apl-I). Thus, both PKA and PKC were necessary for operant conditioning. Injection of cAMP into B51 mimicked the effects of operant conditioning. Activation of PKC also mimicked conditioning but was dependent on both cAMP and PKA, suggesting that PKC acted at some point upstream of PKA activation. Our results demonstrate how these molecules can interact to mediate operant conditioning in an individual neuron important for the expression of the conditioned behavior.

Changes in neuronal excitability serve as a mechanism of long-term memory for operant conditioning

Learning can lead to changes in the intrinsic excitability of neurons. However, it is unclear to what extent these changes persist and what role they play in the expression of memory. Here, we report that in vitro analogues of operant conditioning produce a long-term (24 h) increase in the excitability of an identified neuron (B51) critical for the expression of feeding in Aplysia. This increase in excitability, which is cAMP dependent, contributes to the associative modification of the feeding circuitry, providing a mechanism for long-term memory storage.

Endogenous motor neuron properties contribute to a program-specific phase of activity in the multifunctional feeding central pattern generator of Aplysia

Multifunctional central pattern generators (CPGs) are circuits of neurons that can generate manifold actions from a single effector system. This study examined a bilateral pair of pharyngeal motor neurons, designated B67, that participate in the multifunctional feeding network of Aplysia californica. Fictive buccal motor programs (BMPs) were elicited with four distinct stimulus paradigms to assess the activity of B67 during ingestive versus egestive patterns. In both classes of programs, B67 fired during the phase of radula protraction and received a potent inhibitory postsynaptic potential (IPSP) during fictive radula retraction. When programs were ingestive, the retraction phase IPSP exhibited a depolarizing sag and was followed by a postinhibitory rebound (PIR) that could generate a postretraction phase of impulse activity. When programs were egestive, the depolarizing sag potential and PIR were both diminished or were not present. Examination of the membrane properties of B67 disclosed a cesium-sensitive depolarizing sag, a corresponding I(h)-like current, and PIR in its responses to hyperpolarizing pulses. Direct IPSPs originating from the influential CPG retraction phase interneuron B64 were also found to activate the sag potential and PIR of B67. Dopamine, a modulator that can promote ingestive behavior in this system, enhanced the sag potential, I(h)-like current, and PIR of B67. Finally, a pharyngeal muscle contraction followed the radula retraction phase of ingestive, but not egestive motor patterns. It is proposed that regulation of the intrinsic properties of this motor neuron can contribute to generating a program-specific phase of motor activity.

Feeding behavior of Aplysia: a model system for comparing cellular mechanisms of classical and operant conditioning

Feeding behavior of Aplysia provides an excellent model system for analyzing and comparing mechanisms underlying appetitive classical conditioning and reward operant conditioning. Behavioral protocols have been developed for both forms of associative learning, both of which increase the occurrence of biting following training. Because the neural circuitry that mediates the behavior is well characterized and amenable to detailed cellular analyses, substantial progress has been made toward a comparative analysis of the cellular mechanisms underlying these two forms of associative learning. Both forms of associative learning use the same reinforcement pathway (the esophageal nerve, En) and the same reinforcement transmitter (dopamine, DA). In addition, at least one cellular locus of plasticity (cell B51) is modified by both forms of associative learning. However, the two forms of associative learning have opposite effects on B51. Classical conditioning decreases the excitability of B51, whereas operant conditioning increases the excitability of B51. Thus, the approach of using two forms of associative learning to modify a single behavior, which is mediated by an analytically tractable neural circuit, is revealing similarities and differences in the mechanisms that underlie classical and operant conditioning.

Activity-dependent peptidergic modulation of the plateau-generating neuron B64 in the feeding network of Aplysia

Many behaviors display various forms of activity-dependent plasticity. An example of such plasticity is the progressive shortening of the duration of protraction phase of feeding responses of Aplysia that occurs when feeding responses are repeatedly elicited. A similar protraction-duration shortening is observed in isolated ganglia of Aplysia when feeding-like motor programs are elicited through a prolonged stimulation of the command-like neuron CBI-2. Here, we investigate a cellular mechanism that may underlie this activity-dependent shortening of protraction duration of feeding motor programs. CBI-2 contains two neuropeptides, CP2 and FCAP. Previous work showed that CP2 shortens protraction duration of CBI-2 elicited programs. We show here that the same is true for FCAP. We also show that both CP2 and FCAP modulated the biophysical properties of a plateau-generating neuron, B64, that plays an important role in terminating the protraction phase of feeding motor programs. We find that prestimulation of CBI-2, as well as superfusion of CP2 and FCAP, lowered the threshold for activation of the plateau potential in B64. The threshold-lowering actions of CBI-2 prestimulation were occluded by superfusion of FCAP and CP2. Furthermore, at elevated temperature, conditions under which peptide release is prevented in Aplysia, prestimulation of CBI-2 does not lower the plateau-potential threshold, whereas superfusion of CP2 and FCAP does. Our findings are consistent with the hypothesis that peptides released from CBI-2 lower the threshold for activation of plateau potential in B64, thereby contributing to the shortening of protraction duration when CBI-2 is repeatedly activated.

In Vitro Odor-Aversion Conditioning in a Terrestrial Mollusk

We developed an in vitro odor-aversion conditioning system in the terrestrial mollusk, Limax, and found a behavioral correlate of network oscillation in the olfactory CNS. We first examined the odor-induced behavior of Limax, after odor-aversion conditioning in vivo. Shortening of mantle muscles was specifically observed in response to aversively conditioned odors. We previously identified that parietal nerves, which project to the mantle muscle in Limax, regulate shortening of the mantle muscle. We therefore isolated whole brains containing noses (sensory organs) and parietal nerves (motor output), and applied an odor-aversion conditioning paradigm to these in vitro preparations. Before the in vitro conditioning, application of attractive odors to the noses did not elicit any discharge in the parietal nerves. However, after odor-aversion conditioning, discharges in the parietal nerves were observed in response to the natively attractive but aversively conditioned odors. We also found that network oscillation frequency in the procerebrum (PC), the olfactory CNS of Limax, increased specifically in response to the aversively conditioned odors that elicited avoidance behavior. In naive (nonconditioned) preparations, increases in the PC oscillation frequency were observed specifically in response to innately aversive odors. These results indicate that the isolated brains have an ability of odor learning. They also suggest that changes in PC network oscillation are associated with aversively conditioned and innately aversive odors, both of which elicit avoidance behavior. This in vitro conditioning system would be an effective approach for exploring the neural mechanism to determine the aversion to odors.

Target-specific regulation of synaptic efficacy in the feeding central pattern generator of Aplysia: potential substrates for behavioral plasticity?

The contributions to this symposium are unified by their focus on the role of synaptic plasticity in sensorimotor learning. Synaptic plasticities are also known to operate within the central pattern generator (CPG) circuits that produce repetitive motor programs, where their relation to adaptive behavior is less well understood. This study examined divergent synaptic plasticity in the signaling of an influential interneuron, B20, located within the CPG that controls consummatory feeding-related behaviors in Aplysia. Previously, B20 was shown to contain markers for catecholamines and GABA (Díaz-Ríos et al., 2002), and its rapid synaptic signaling to two follower motor neurons, B16 and B8, was found to be mediated by dopamine (Díaz-Ríos and Miller, 2005). In this investigation, two incremental forms of increased synaptic efficacy, facilitation and summation, were both greater in the signaling from B20 to B8 than in the signaling from B20 to B16. Manipulation of the membrane potentials of the two postsynaptic motor neurons did not affect facilitation of excitatory postsynaptic potentials (EPSPs) to either follower cell. Striking levels of summation in B8, however, were eliminated at hyperpolarized membrane potentials and could be attributed to distinctive membrane properties of this postsynaptic cell. GABA and the GABAB agonist baclofen increased facilitation and summation of EPSPs from B20 to B8, but not to B16. The enhanced facilitation was not affected when the membrane potential of B8 was pre-set to hyperpolarized levels, but GABAergic effects on summation were eliminated by this manipulation. These observations demonstrate a target-specific amplification of synaptic efficacy that can contribute to channeling the flow of divergent information from an intrinsic interneuron within the buccal CPG. They further suggest that GABA, acting as a cotransmitter in B20, could induce coordinated and target-specific pre- and postsynaptic modulation of these signals. Finally, we speculate that target-specific plasticity and its modulation could be efficient, specific, and flexible substrates for learning-related modifications of CPG function.

Reinforcement in an in vitro analog of appetitive classical conditioning of feeding behavior in Aplysia: blockade by a dopamine antagonist

In a recently developed in vitro analog of appetitive classical conditioning of feeding in Aplysia, the unconditioned stimulus (US) was electrical stimulation of the esophageal nerve (En). This nerve is rich in dopamine (DA)-containing processes, which suggests that DA mediates reinforcement during appetitive conditioning. To test this possibility, methylergonovine was used to antagonize DA receptors. Methylergonovine (1 nM) blocked the pairing-specific increase in fictive feeding that is usually induced by in vitro classical conditioning. The present results and previous observation that methylergonovine also blocks the effects of contingent reinforcement in an in vitro analog of appetitive operant conditioning suggest that DA mediates reinforcement for appetitive associative conditioning of feeding in Aplysia.

Variability of swallowing performance in intact, freely feeding aplysia

Variability in nervous systems is often taken to be merely "noise." Yet in some cases it may play a positive, active role in the production of behavior. The central pattern generator (CPG) that drives the consummatory feeding behaviors of Aplysia generates large, quasi-random variability in the parameters of the feeding motor programs from one cycle to the next; the variability then propagates through the firing patterns of the motor neurons to the contractions of the feeding muscles. We have proposed that, when the animal is faced with a new, imperfectly known feeding task in each cycle, the variability implements a trial-and-error search through the space of possible feeding movements. Although this strategy will not be successful in every cycle, over many cycles it may be the optimal strategy for feeding in an uncertain and changing environment. To play this role, however, the variability must actually appear in the feeding movements and, presumably, in the functional performance of the feeding behavior. Here we have tested this critical prediction. We have developed a technique to measure, in intact, freely feeding animals, the performance of Aplysia swallowing behavior, by continuously recording with a length transducer the movement of the seaweed strip being swallowed. Simultaneously, we have recorded with implanted electrodes activity at each of the internal levels, the CPG, motor neurons, and muscles, of the feeding neuromusculature. Statistical analysis of a large data set of these recordings suggests that functional performance is not determined strongly by one or a few parameters of the internal activity, but weakly by many. Most important, the internal variability does emerge in the behavior and its functional performance. Even when the animal is swallowing a long, perfectly regular seaweed strip, remarkably, the length swallowed from cycle to cycle is extremely variable, as variable as the parameters of the activity of the CPG, motor neurons, and muscles.

Tight or loose coupling between components of the feeding neuromusculature of Aplysia?

Like other complex behaviors, the cyclical, rhythmic consummatory feeding behaviors of Aplysia-biting, swallowing, and rejection of unsuitable food-are produced by a complex neuromuscular system: the animal's buccal mass, with numerous pairs of antagonistic muscles, controlled by the firing of numerous motor neurons, all driven by the motor programs of a central pattern generator (CPG) in the buccal ganglia. In such a complex neuromuscular system, it has always been assumed that the activities of the various components must necessarily be tightly coupled and coordinated if successful functional behavior is to be produced. However, we have recently found that the CPG generates extremely variable motor programs from one cycle to the next, and so very variable motor neuron firing patterns and contractions of individual muscles. Here we show that this variability extends even to higher-level parameters of the operation of the neuromuscular system such as the coordination between entire antagonistic subsystems within the buccal neuromusculature. In motor programs elicited by stimulation of the esophageal nerve, we have studied the relationship between the contractions of the accessory radula closer (ARC) muscle, and the firing patterns of its motor neurons B15 and B16, with those of its antagonist, the radula opener (I7) muscle, and its motor neuron B48. There are two separate B15/B16-ARC subsystems, one on each side of the animal, and these are indeed very tightly coupled. Tight coupling can, therefore, be achieved in this neuromuscular system where required. Yet there is essentially no coupling at all between the contractions of the ARC muscles and those of the antagonistic radula opener muscle. We interpret this result in terms of a hypothesis that ascribes a higher-order benefit to such loose coupling in the neuromusculature. The variability, emerging in the successive feeding movements made by the animal, diversifies the range of movements and thereby implements a trial-and-error search through the space of movements that might be successful, an optimal strategy for the animal in an unknown, rapidly changing feeding environment.

Rapid Dopaminergic Signaling by Interneurons That Contain Markers for Catecholamines and GABA in the Feeding Circuitry of Aplysia

Consummatory feeding behaviors in Aplysia californica are controlled by a polymorphic central pattern generator (CPG) circuit. Previous investigations have demonstrated colocalization of markers for GABA and catecholamines within two interneurons, B20 and B65, that participate in configuring the functional output of this CPG. This study examined the contributions of GABA and dopamine (DA) to rapid synaptic signaling from B20 and B65 to follower cells that implement their specification of motor programs. Pharmacological tests did not substantiate the participation of GABA in the mediation of the excitatory postsynaptic potentials (EPSPs) from either B20 or B65. However, GABA and the GABAB receptor agonist baclofen were found to modify these signals in a target-specific manner. Several observations indicated that DA acts as the neurotransmitter mediating fast EPSPs from B20 to two radula closer motor neurons B8 and B16. In both motor neurons, application of DA produced depolarizing responses associated with decreased input resistance and increased excitation. B20-evoked EPSPs in both follower cells were occluded by exogenous dopamine and blocked by the DA antagonist sulpiride. While dopamine occlusion and sulpiride block of convergent signaling to B8 from B65 resembled that of B20, both of these actions were less potent on the rapid signaling from B65 to the multifunctional and widely acting interneuron B4/5. These findings indicate that dopamine mediates divergent (B20 to B16 and B8) and convergent (B20 and B65 to B8) rapid EPSPs from two influential CPG interneurons in which it is colocalized with GABA-like immunoreactivity.

Extending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparation

Operant and classical conditioning are major processes shaping behavioral responses in all animals. Although the understanding of the mechanisms of classical conditioning has expanded significantly, the understanding of the mechanisms of operant conditioning is more limited. Recent developments in Aplysia are helping to narrow the gap in the level of understanding between operant and classical conditioning, and have raised the possibility of studying the neuronal processes underlying the interaction of operant and classical components in a relatively complex learning task. In the present study, we describe a first step toward realizing this goal, by developing a single in vitro preparation in which both operant and classical conditioning can be studied concurrently. The new paradigm reproduced previously published results, even under more conservative and homogenous selection criteria and tonic stimulation regime. Moreover, the observed learning was resistant to delay, shortening, and signaling of reinforcement.

Cycle-to-Cycle Variability of Neuromuscular Activity inAplysiaFeeding Behavior

Aplysia consummatory feeding behavior, a rhythmic cycling of biting, swallowing, and rejection movements, is often said to be stereotyped. Yet closer examination shows that cycles of the behavior are very variable. Here we have quantified and analyzed the variability at several complementary levels in the neuromuscular system. In reduced preparations, we recorded the motor programs produced by the central pattern generator, firing of the motor neurons B15 and B16, and contractions of the accessory radula closer (ARC) muscle while repetitive programs were elicited by stimulation of the esophageal nerve. In other similar experiments, we recorded firing of motor neuron B48 and contractions of the radula opener muscle. In intact animals, we implanted electrodes to record nerve or ARC muscle activity while the animals swallowed controlled strips of seaweed or fed freely. In all cases, we found large variability in all parameters examined. Some of this variability reflected systematic, slow, history-dependent changes in the character of the central motor programs. Even when these trends were factored out, however, by focusing only on the differences between successive cycles, considerable variability remained. This variability was apparently random. Nevertheless, it too was the product of central history dependency because regularizing merely the high-level timing of the programs also regularized many of the downstream neuromuscular parameters. Central motor program variability thus appears directly in the behavior. With regard to the production of functional behavior in any one cycle, the large variability may indicate broad tolerances in the operation of the neuromuscular system. Alternatively, some cycles of the behavior may be dysfunctional. Overall, the variability may be part of an optimal strategy of trial, error, and stabilization that the CNS adopts in an uncertain environment.

Involvement of the Ryanodine Receptor in Morphologic Modification ofHermissendaType B Photoreceptors After In Vitro Conditioning

We examined whether Ca2+induced Ca2+release through ryanodine receptors is involved in the conditioning of specific morphologic changes at the axon terminals of type B photoreceptors in the isolated circumesophageal ganglion of Hermissenda. Calcium chelation by bis(2-aminophenoxy) ethane- N,N,N′, N′-tetraacetic acid prevented the conformational change at the terminals after five paired presentations of light and vibration, which produce terminal branch contraction of B photoreceptors. Two ryanodine receptor blockers, dantrolene and micromolar concentrations of ryanodine, depressed the increase in excitability due to in vitro conditioning and the increase in intracellular Ca2+in response to membrane depolarization. Although the ability to increase intracellular Ca2+was depressed, synaptic transmission was preserved in the normal state from hair cells under dantrolene and ryanodine incubation. Ryanodine receptor blockers also prevented contraction at the B photoreceptor axon terminals. These results suggest that the ryanodine receptor has a crucial role in inducing the in vitro conditioning specific changes both physiologically and morphologically, including “focusing” at the B photoreceptor axon terminal.

In vitro analog of classical conditioning of feeding behavior in aplysia

The feeding behavior of Aplysia californica can be classically conditioned using tactile stimulation of the lips as a conditioned stimulus (CS) and food as an unconditioned stimulus (US). Moreover, several neural correlates of classical conditioning have been identified. The present study extended previous work by developing an in vitro analog of classical conditioning and by investigating pairing-specific changes in neuronal and synaptic properties. The preparation consisted of the isolated cerebral and buccal ganglia. Electrical stimulation of a lip nerve (AT4) and a branch of the esophageal nerve (En2) served as the CS and US, respectively. Three protocols were used: paired, unpaired, and US alone. Only the paired protocol produced a significant increase in CS-evoked fictive feeding. At the cellular level, classical conditioning enhanced the magnitude of the CS-evoked synaptic input to pattern-initiating neuron B31/32. In addition, paired training enhanced both the magnitude of the CS-evoked synaptic input and the CS-evoked spike activity in command-like neuron CBI-2. The in vitro analog of classical conditioning reproduced all of the cellular changes that previously were identified following behavioral conditioning and has led to the identification of several new learning-related neural changes. In addition, the pairing-specific enhancement of the CS response in CBI-2 indicates that some aspects of associative plasticity may occur at the level of the cerebral sensory neurons.

Operant conditioning in invertebrates

Learning to anticipate future events on the basis of past experience with the consequences of one's own behavior (operant conditioning) is a simple form of learning that humans share with most other animals, including invertebrates. Three model organisms have recently made significant contributions towards a mechanistic model of operant conditioning, because of their special technical advantages. Research using the fruit fly Drosophila melanogaster implicated the ignorant gene in operant conditioning in the heat-box, research on the sea slug Aplysia californica contributed a cellular mechanism of behavior selection at a convergence point of operant behavior and reward, and research on the pond snail Lymnaea stagnalis elucidated the role of a behavior-initiating neuron in operant conditioning. These insights demonstrate the usefulness of a variety of invertebrate model systems to complement and stimulate research in vertebrates.

A newly identified buccal interneuron initiates and modulates feeding motor programs in aplysia

Despite considerable progress in characterizing the feeding central pattern generator (CPG) in Aplysia, the full complement of neurons that generate feeding motor programs has not yet been identified. The distribution of neuropeptide-containing neurons in the buccal and cerebral ganglia can be used as a tool to identify additional elements of the feeding circuitry by providing distinctions between otherwise morphologically indistinct neurons. For example, our recent study revealed a unique and potentially interesting unpaired PRQFVamide (PRQFVa)-containing neuron in the buccal ganglion. In this study, we describe the morphological and electrophysiological characterization of this novel neuron, which we designate as B50. We found that activation of B50 is capable of producing organized rhythmic output of the feeding CPG. The motor programs elicited by B50 exhibit some similarities as well as differences to motor programs elicited by the command-like cerebral-to-buccal interneuron CBI-2. In addition to activating the feeding CPG, B50 may act as a program modulator.

Dissociation of visual associative and motor learning in Drosophila at the flight simulator

Ever since operant conditioning was studied experimentally, the relationship between associative learning and possible motor learning has become controversial. Although motor learning and its underlying neural substrates have been extensively studied in mammals, it is still poorly understood in invertebrates. The visual discriminative avoidance paradigm of Drosophila at the flight simulator has been widely used to study the flies' visual associative learning and related functions, but it has not been used to study the motor learning process. In this study, newly-designed data analysis was employed to examine the flies' solitary behavioural variable that was recorded at the flight simulator-yaw torque. Analysis was conducted to explore torque distributions of both wild-type and mutant flies in conditioning, with the following results: (1) Wild-type Canton-S flies had motor learning performance in conditioning, which was proved by modifications of the animal's behavioural mode in conditioning. (2) Repetition of training improved the motor learning performance of wild-type Canton-S flies. (3) Although mutant dunce(1) flies were defective in visual associative learning, they showed essentially normal motor learning performance in terms of yaw torque distribution in conditioning. Finally, we tentatively proposed that both visual associative learning and motor learning were involved in the visual operant conditioning of Drosophila at the flight simulator, that the two learning forms could be dissociated and they might have different neural bases.

Fast synaptic connections from CBIs to pattern-generating neurons in Aplysia: initiation and modification of motor programs

Consummatory feeding movements in Aplysia californica are organized by a central pattern generator (CPG) in the buccal ganglia. Buccal motor programs similar to those organized by the CPG are also initiated and controlled by the cerebro-buccal interneurons (CBIs), interneurons projecting from the cerebral to the buccal ganglia. To examine the mechanisms by which CBIs affect buccal motor programs, we have explored systematically the synaptic connections from three of the CBIs (CBI-1, CBI-2, CBI-3) to key buccal ganglia CPG neurons (B31/B32, B34, and B63). The CBIs were found to produce monosynaptic excitatory postsynaptic potentials (EPSPs) with both fast and slow components. In this report, we have characterized only the fast component. CBI-2 monosynaptically excites neurons B31/B32, B34, and B63, all of which can initiate motor programs when they are sufficiently stimulated. However, the ability of CBI-2 to initiate a program stems primarily from the excitation of B63. In B31/B32, the size of the EPSPs was relatively small and the threshold for excitation was very high. In addition, preventing firing in either B34 or B63 showed that only a block in B63 firing prevented CBI-2 from initiating programs in response to a brief stimulus. The connections from CBI-2 to the buccal ganglia neurons showed a prominent facilitation. The facilitation contributed to the ability of CBI-2 to initiate a BMP and also led to a change in the form of the BMP. The cholinergic blocker hexamethonium blocked the fast EPSPs induced by CBI-2 in buccal ganglia neurons and also blocked the EPSPs between a number of key CPG neurons within the buccal ganglia. CBI-2 and B63 were able to initiate motor patterns in hexamethonium, although the form of a motor pattern was changed, indicating that non-hexamethonium-sensitive receptors contribute to the ability of these cells to initiate bursts. By contrast to CBI-2, CBI-1 excited B63 but inhibited B34. CBI-3 excited B34 and not B63. The data indicate that CBI-1, -2, and -3 are components of a system that initiates and selects between buccal motor programs. Their behavioral function is likely to depend on which combination of CBIs and CPG elements are activated.

Nitric oxide is necessary for multiple memory processes after learning that a food is inedible in aplysia

Nitric oxide (NO) signaling was inhibited via N(omega)-nitro-L-arginine methyl ester (L-NAME) during and after training Aplysia that a food is inedible. Treating animals with L-NAME 10 min before the start of training blocked the formation of three separable memory processes: (1) short-term, (2) intermediate-term, and (3) long-term memory. The treatment also attenuated, but did not block, a fourth memory process, very short-term memory. L-NAME had little or no effect on feeding behavior per se or on most aspects of the animals' behavior while they were being trained, indicating that the substance did not cause a pervasive modulation or poisoning of many aspects of feeding and other behaviors. Application of L-NAME within 1 min after the training had no effect on short- or long-term memory, indicating that NO signaling was not needed during memory consolidation. Treating animals with the NO scavenger 2-phenyl-4,4,5,5-tetramethyl-imidazdine-1-oxy-3-oxide before training also blocked long-term memory. Memory was not blocked by D-NAME, or by the simultaneous treatment with L-NAME and the NO donor S-nitroso-N-acetyl-penicillamine, confirming that the effect of L-NAME is attributable to its effect as a competitive inhibitor of L-arginine for NO synthase in the production of NO rather than to possible effects at other sites. These data indicate that NO signaling during training plays a critical role in the formation of multiple memory processes.

Correlation between activity in neuron B52 and two features of fictive feeding in Aplysia

The present study examined the correlation between the level of activity neuron B52 and the transition from protraction to retraction phases of buccal motor patterns (BMPs) and the termination of the BMPs. The level of activity in B52 during the protraction phase was positively correlated with the duration of that phase. A second burst of activity in B52 was associated with the termination of the retraction phase. An apparent monosynaptic inhibitory connection from B52 to B64, may mediate the effects of B52. The first burst of activity in B52 delays the onset of activity in B64, thereby prolonging the protraction phase, and the second burst inhibits activity in B64, thereby terminating the retraction phase. These results suggest that activity in B52 may contribute to switching between ingestion-like and rejection-like BMPs by regulating both phase transition and termination of BMPs.

In vitro conditioning induces morphological changes in Hermissenda type B photoreceptor

Short- and long-term synaptic plasticity are considered to be cellular substrates of learning and memory. The mechanisms underlying synaptic plasticity especially with respect to morphology, however, are not known. In vitro conditioning in molluscan preparations is a well established form of short-term synaptic plasticity. Five paired presentations of light and vestibular stimulation to the isolated nervous system of Hermissenda results in an increase in excitability of the identified neuron, the type B photoreceptor, indicated by 2 measures, an increase in the input resistance and a cumulative depolarization after the cessation of light stimulus recorded from the cell soma. The terminal branches of type B photoreceptors iontophoretically injected with fluorescent dye were analyzed using computer-aided 3-dimensional reconstruction of images obtained using a confocal microscope under 'blind' conditions. The terminal branches contracted along the centro-lateral axis within an hour after conditioning, paralleling the increase in neuronal excitability. These data suggest that in vitro conditioning in Hermissenda is a form of short-term synaptic plasticity that involves changes in macromolecular synthesis.

Operant reward learning in Aplysia: neuronal correlates and mechanisms

Operant conditioning is a form of associative learning through which an animal learns about the consequences of its behavior. Here, we report an appetitive operant conditioning procedure in Aplysia that induces long-term memory. Biophysical changes that accompanied the memory were found in an identified neuron (cell B51) that is considered critical for the expression of behavior that was rewarded. Similar cellular changes in B51 were produced by contingent reinforcement of B51 with dopamine in a single-cell analog of the operant procedure. These findings allow for the detailed analysis of the cellular and molecular processes underlying operant conditioning.