Behavioral and in vitro correlates of compulsive-like food seeking induced by operant conditioning in Aplysia

Convergent effects of neuropeptides on the feeding central pattern generator of Aplysia californica

Modulators that induce distinct motor programs act divergently on neural networks to specify output. We study a situation where modulators that act divergently also act convergently. We focus on an interneuron (B63) that is part of the feeding central pattern generator (CPG) in Aplysia californica. Previous work has established that B63 is critical for program initiation regardless of the type of evoked activity. B63 receives input from a number of different elements of the feeding circuit. Program initiation occurs reliably when some are activated, but we show it does not occur reliably with activation of others. When program initiation is reliable, modulatory neuropeptides are released. For example, previous work has established that an ingestive input to the feeding CPG, cerebral buccal interneuron 2 (CBI-2), releases feeding circuit activating peptide (FCAP) and cerebral peptide 2 (CP-2). Afferents with processes in the esophageal nerve (EN) that trigger egestive motor programs release small cardioactive peptide (SCP). Previous studies have described divergent effects of FCAP/CP-2 and SCP on the feeding circuit that specify motor activity. Here, we show that FCAP/CP-2 and SCP increase the B63 excitability. Thus, we show that peptides that have well characterized divergent effects on the feeding circuit additionally act convergently at the level of a single neuron. Since convergent effects of neuromodulators are not necessary for specifying network output, we ask why they might be important. Our data suggest that they have an impact during a task switch.

Specific Plasticity Loci and Their Synergism Mediate Operant Conditioning

Despite numerous studies examining the mechanisms of operant conditioning (OC), the diversity of OC plasticity loci and their synergism have not been examined sufficiently. In the well-characterized feeding neural circuit of Aplysia, in vivo and in vitro appetitive OC increases neuronal excitability and electrical coupling among several neurons leading to an increase in expression of ingestive behavior. Here, we used the in vitro analog of OC to investigate whether OC reduces the excitability of a neuron, B4, whose inhibitory connections decrease expression of ingestive behavior. We found OC decreased the excitability of B4. This change appeared intrinsic to B4 because it could be replicated with an analog of OC in isolated cultures of B4 neurons. In addition to changes in B4 excitability, OC decreased the strength of B4's inhibitory connection to a key decision-making neuron, B51. The OC-induced changes were specific without affecting the excitability of another neuron critical for feeding behavior, B8, or the B4-to-B8 inhibitory connection. A conductance-based circuit model indicated that reducing the B4-to-B51 synapse, or increasing B51 excitability, mediated the OC phenotype more effectively than did decreasing B4 excitability. We combined these modifications to examine whether they could act synergistically. Combinations including B51 synergistically enhanced feeding. Taken together, these results suggest modifications of diverse loci work synergistically to mediate OC and that some neurons are well suited to work synergistically with plasticity in other loci.SIGNIFICANCE STATEMENT The ways in which synergism of diverse plasticity loci mediate the change in motor patterns in operant conditioning (OC) are poorly understood. Here, we found that OC was in part mediated by decreasing the intrinsic excitability of a critical neuron of Aplysia feeding behavior, and specifically reducing the strength of one of its inhibitory connections that targets a key decision-making neuron. A conductance-based computational model indicated that the known plasticity loci showed a surprising level of synergism to mediate the behavioral changes associated with OC. These results highlight the importance of understanding the diversity, specificity and synergy among different types of plasticity that encode memory. Also, because OC in Aplysia is mediated by dopamine (DA), the present study provides insights into specific and synergistic mechanisms of DA-mediated reinforcement of behaviors.

Neuronal population activity dynamics reveal a low-dimensional signature of operant learning in Aplysia

Learning engages a high-dimensional neuronal population space spanning multiple brain regions. However, it remains unknown whether it is possible to identify a low-dimensional signature associated with operant conditioning, a ubiquitous form of learning in which animals learn from the consequences of behavior. Using single-neuron resolution voltage imaging, here we identify two low-dimensional motor modules in the neuronal population underlying Aplysia feeding. Our findings point to a temporal shift in module recruitment as the primary signature of operant learning. Our findings can help guide characterization of learning signatures in systems in which only a smaller fraction of the relevant neuronal population can be monitored.

Costa et al. use single-neuron resolution voltage imaging to identify two low-dimensional motor modules in the neuronal population underlying Aplysia feeding. Their findings point to a temporal shift in module recruitment as the primary signature of operant learning.

Organelle calcium-derived voltage oscillations in pacemaker neurons drive the motor program for food-seeking behavior in Aplysia

The expression of motivated behaviors depends on both external and internally arising neural stimuli, yet the intrinsic releasing mechanisms for such variably occurring behaviors remain elusive. In isolated nervous system preparations of Aplysia, we have found that irregularly expressed cycles of motor output underlying food-seeking behavior arise from regular membrane potential oscillations of varying magnitude in an identified pair of interneurons (B63) in the bilateral buccal ganglia. This rhythmic signal, which is specific to the B63 cells, is generated by organelle-derived intracellular calcium fluxes that activate voltage-independent plasma membrane channels. The resulting voltage oscillation spreads throughout a subset of gap junction-coupled buccal network neurons and by triggering plateau potential-mediated bursts in B63, can initiate motor output driving food-seeking action. Thus, an atypical neuronal pacemaker mechanism, based on rhythmic intracellular calcium store release and intercellular propagation, can act as an autonomous intrinsic releaser for the occurrence of a motivated behavior.

Dopamine as a Multifunctional Neurotransmitter in Gastropod Molluscs: An Evolutionary Hypothesis

AbstractThe catecholamine 3,4-dihydroxyphenethylamine, or dopamine, acts as a neurotransmitter across a broad phylogenetic spectrum. Functions attributed to dopamine in the mammalian brain include regulation of motor circuits, valuation of sensory stimuli, and mediation of reward or reinforcement signals. Considerable evidence also supports a neurotransmitter role for dopamine in gastropod molluscs, and there is growing appreciation for its potential common functions across phylogeny. This article reviews evidence for dopamine's transmitter role in the nervous systems of gastropods. The functional properties of identified dopaminergic neurons in well-characterized neural circuits suggest a hypothetical incremental sequence by which dopamine accumulated its diverse roles. The successive acquisition of dopamine functions is proposed in the context of gastropod feeding behavior: (1) sensation of potential nutrients, (2) activation of motor circuits, (3) selection of motor patterns from multifunctional circuits, (4) valuation of sensory stimuli with reference to internal state, (5) association of motor programs with their outcomes, and (6) coincidence detection between sensory stimuli and their consequences. At each stage of this sequence, it is proposed that existing functions of dopaminergic neurons favored their recruitment to fulfill additional information processing demands. Common functions of dopamine in other intensively studied groups, ranging from mammals and insects to nematodes, suggest an ancient origin for this progression.

Computational model of the distributed representation of operant reward memory: combinatoric engagement of intrinsic and synaptic plasticity mechanisms

Operant reward learning of feeding behavior in Aplysia increases the frequency and regularity of biting, as well as biases buccal motor patterns (BMPs) toward ingestion-like BMPs (iBMPs). The engram underlying this memory comprises cells that are part of a central pattern generating (CPG) circuit and includes increases in the intrinsic excitability of identified cells B30, B51, B63, and B65, and increases in B63-B30 and B63-B65 electrical synaptic coupling. To examine the ways in which sites of plasticity (individually and in combination) contribute to memory expression, a model of the CPG was developed. The model included conductance-based descriptions of cells CBI-2, B4, B8, B20, B30, B31, B34, B40, B51, B52, B63, B64, and B65, and their synaptic connections. The model generated patterned activity that resembled physiological BMPs, and implementation of the engram reproduced increases in frequency, regularity, and bias. Combined enhancement of B30, B63, and B65 excitabilities increased BMP frequency and regularity, but not bias toward iBMPs. Individually, B30 increased regularity and bias, B51 increased bias, B63 increased frequency, and B65 decreased all three BMP features. Combined synaptic plasticity contributed primarily to regularity, but also to frequency and bias. B63-B30 coupling contributed to regularity and bias, and B63-B65 coupling contributed to all BMP features. Each site of plasticity altered multiple BMP features simultaneously. Moreover, plasticity loci exhibited mutual dependence and synergism. These results indicate that the memory for operant reward learning emerged from the combinatoric engagement of multiple sites of plasticity.

Successful and unsuccessful attempts to swallow in a reduced Aplysia preparation regulate feeding responses and produce memory at different neural sites

Sensory feedback shapes ongoing behavior and may produce learning and memory. Motor responses to edible or inedible food in a reduced Aplysia preparation were examined to test how sensory feedback affects behavior and memory. Feeding patterns were initiated by applying a cholinomimetic onto the cerebral ganglion. Feedback from buccal muscles increased the response variability and response rate. Repeated application of the cholinomimetic caused decreased responses, expressed in part by lengthening protractions. Swallowing strips of "edible" food, which in intact animals induces learning that enhances ingestion, increased the response rate, and shortened the protraction length, reflecting more swallowing. Testing memory by repeating the procedure prevented the decrease in response rate observed with the cholinomimetic alone, and shortened protractions. Training with "inedible" food that in intact animals produces learning expressed by decreased responses caused lengthened protractions. Testing memory by repeating the procedure did not cause decreased responses or lengthened protractions. After training and testing with edible or inedible food, all preparations were exposed to the cholinomimetic alone. Preparations previously trained with edible food displayed memory expressed as decreased protraction length. Preparations previously trained with inedible food showed decreases in many response parameters. Memory for inedible food may arise in part via a postsynaptic decrease in response to acetylcholine released by afferents sensing food. The lack of change in response number, and in the time that responses are maintained during the two training sessions preceding application of the cholinomimetic alone suggests that memory expression may differ from behavioral changes during training.

Use of the Aplysia feeding network to study repetition priming of an episodic behavior

Many central pattern generator (CPG)-mediated behaviors are episodic, meaning that they are not continuously ongoing; instead, there are pauses between bouts of activity. This raises an interesting possibility, that the neural networks that mediate these behaviors are not operating under "steady-state" conditions; i.e., there could be dynamic changes in motor activity as it stops and starts. Research in the feeding system of the mollusk Aplysia californica has demonstrated that this can be the case. After a pause, initial food grasping responses are relatively weak. With repetition, however, responses strengthen. In this review we describe experiments that have characterized cellular/molecular mechanisms that produce these changes in motor activity. In particular, we focus on cumulative effects of modulatory neuropeptides. Furthermore, we relate Aplysia research to work in other systems and species, and develop a hypothesis that postulates that changes in response magnitude are a reflection of an efficient feeding strategy.

Robustness, flexibility, and sensitivity in a multifunctional motor control model

Motor systems must adapt to perturbations and changing conditions both within and outside the body. We refer to the ability of a system to maintain performance despite perturbations as "robustness," and the ability of a system to deploy alternative strategies that improve fitness as "flexibility." Different classes of pattern-generating circuits yield dynamics with differential sensitivities to perturbations and parameter variation. Depending on the task and the type of perturbation, high sensitivity can either facilitate or hinder robustness and flexibility. Here we explore the role of multiple coexisting oscillatory modes and sensory feedback in allowing multiphasic motor pattern generation to be both robust and flexible. As a concrete example, we focus on a nominal neuromechanical model of triphasic motor patterns in the feeding apparatus of the marine mollusk Aplysia californica. We find that the model can operate within two distinct oscillatory modes and that the system exhibits bistability between the two. In the "heteroclinic mode," higher sensitivity makes the system more robust to changing mechanical loads, but less robust to internal parameter variations. In the "limit cycle mode," lower sensitivity makes the system more robust to changes in internal parameter values, but less robust to changes in mechanical load. Finally, we show that overall performance on a variable feeding task is improved when the system can flexibly transition between oscillatory modes in response to the changing demands of the task. Thus, our results suggest that the interplay of sensory feedback and multiple oscillatory modes can allow motor systems to be both robust and flexible in a variable environment.

Synergistic plasticity of intrinsic conductance and electrical coupling restores synchrony in an intact motor network

Motor neurons of the crustacean cardiac ganglion generate virtually identical, synchronized output despite the fact that each neuron uses distinct conductance magnitudes. As a result of this variability, manipulations that target ionic conductances have distinct effects on neurons within the same ganglion, disrupting synchronized motor neuron output that is necessary for proper cardiac function. We hypothesized that robustness in network output is accomplished via plasticity that counters such destabilizing influences. By blocking high-threshold K⁺ conductances in motor neurons within the ongoing cardiac network, we discovered that compensation both resynchronized the network and helped restore excitability. Using model findings to guide experimentation, we determined that compensatory increases of both G_A and electrical coupling restored function in the network. This is one of the first direct demonstrations of the physiological regulation of coupling conductance in a compensatory context, and of synergistic plasticity across cell- and network-level mechanisms in the restoration of output.

DOI:http://dx.doi.org/10.7554/eLife.16879.001

Neurons can communicate with each other by releasing chemicals called neurotransmitters, or by forming direct connections with each other known as gap junctions. These direct connections allow electrical impulses to flow from one neuron to another via pores in the membranes between the cells. Unlike communication via neurotransmitters, gap junctions are usually thought to be hard-wired and unchanging over the life of the animal.

Lane et al. recorded electrical activity in a network of neurons that generates rhythmic heart contractions in the Jonah crab. Neurons in this network usually all fire an electrical impulse at the same time, which is crucial to make sure that the whole heart contracts at the same time. The experiments show that drugs that block potassium channel pores in the membrane cause the neurons to fire too much and at different times to each other.

However, the network of neurons soon adapted to the changes caused by the drugs and returned to working as normal. Mimicking these changes in a computer model of the neuron network, together with experimental data, showed that changes to the gap junctions play a major role in restoring normal activity to the network.

The next step following on from this research is to understand how a network of neurons ‘senses’ that it is not working normally and changes its electrical activity.

DOI:http://dx.doi.org/10.7554/eLife.16879.002

PKC in motorneurons underlies self-learning, a form of motor learning in Drosophila

Tethering a fly for stationary flight allows for exquisite control of its sensory input, such as visual or olfactory stimuli or a punishing infrared laser beam. A torque meter measures the turning attempts of the tethered fly around its vertical body axis. By punishing, say, left turning attempts (in a homogeneous environment), one can train a fly to restrict its behaviour to right turning attempts. It was recently discovered that this form of operant conditioning (called operant self-learning), may constitute a form of motor learning in Drosophila. Previous work had shown that Protein Kinase C (PKC) and the transcription factor dFoxP were specifically involved in self-learning, but not in other forms of learning. These molecules are specifically involved in various forms of motor learning in other animals, such as compulsive biting in Aplysia, song-learning in birds, procedural learning in mice or language acquisition in humans. Here we describe our efforts to decipher which PKC gene is involved in self-learning in Drosophila. We also provide evidence that motorneurons may be one part of the neuronal network modified during self-learning experiments. The collected evidence is reminiscent of one of the simplest, clinically relevant forms of motor learning in humans, operant reflex conditioning, which also relies on motorneuron plasticity.

Functional magnetic resonance microscopy at single-cell resolution in Aplysia californica

In this work, we show the feasibility of performing functional MRI studies with single-cell resolution. At ultrahigh magnetic field, manganese-enhanced magnetic resonance microscopy allows the identification of most motor neurons in the buccal network of Aplysia at low, nontoxic Mn(2+) concentrations. We establish that Mn(2+) accumulates intracellularly on injection into the living Aplysia and that its concentration increases when the animals are presented with a sensory stimulus. We also show that we can distinguish between neuronal activities elicited by different types of stimuli. This method opens up a new avenue into probing the functional organization and plasticity of neuronal networks involved in goal-directed behaviors with single-cell resolution.

Differential roles of nonsynaptic and synaptic plasticity in operant reward learning-induced compulsive behavior

BACKGROUND

Rewarding stimuli in associative learning can transform the irregularly and infrequently generated motor patterns underlying motivated behaviors into output for accelerated and stereotyped repetitive action. This transition to compulsive behavioral expression is associated with modified synaptic and membrane properties of central neurons, but establishing the causal relationships between cellular plasticity and motor adaptation has remained a challenge.

RESULTS

We found previously that changes in the intrinsic excitability and electrical synapses of identified neurons in Aplysia's central pattern-generating network for feeding are correlated with a switch to compulsive-like motor output expression induced by in vivo operant conditioning. Here, we used specific computer-simulated ionic currents in vitro to selectively replicate or suppress the membrane and synaptic plasticity resulting from this learning. In naive in vitro preparations, such experimental manipulation of neuronal membrane properties alone increased the frequency but not the regularity of feeding motor output found in preparations from operantly trained animals. On the other hand, changes in synaptic strength alone switched the regularity but not the frequency of feeding output from naive to trained states. However, simultaneously imposed changes in both membrane and synaptic properties reproduced both major aspects of the motor plasticity. Conversely, in preparations from trained animals, experimental suppression of the membrane and synaptic plasticity abolished the increase in frequency and regularity of the learned motor output expression.

CONCLUSIONS

These data establish direct causality for the contributions of distinct synaptic and nonsynaptic adaptive processes to complementary facets of a compulsive behavior resulting from operant reward learning.

Implication of dopaminergic modulation in operant reward learning and the induction of compulsive-like feeding behavior in Aplysia

Feeding in Aplysia provides an amenable model system for analyzing the neuronal substrates of motivated behavior and its adaptability by associative reward learning and neuromodulation. Among such learning processes, appetitive operant conditioning that leads to a compulsive-like expression of feeding actions is known to be associated with changes in the membrane properties and electrical coupling of essential action-initiating B63 neurons in the buccal central pattern generator (CPG). Moreover, the food-reward signal for this learning is conveyed in the esophageal nerve (En), an input nerve rich in dopamine-containing fibers. Here, to investigate whether dopamine (DA) is involved in this learning-induced plasticity, we used an in vitro analog of operant conditioning in which electrical stimulation of En substituted the contingent reinforcement of biting movements in vivo. Our data indicate that contingent En stimulation does, indeed, replicate the operant learning-induced changes in CPG output and the underlying membrane and synaptic properties of B63. Significantly, moreover, this network and cellular plasticity was blocked when the input nerve was stimulated in the presence of the DA receptor antagonist cis-flupenthixol. These results therefore suggest that En-derived dopaminergic modulation of CPG circuitry contributes to the operant reward-dependent emergence of a compulsive-like expression of Aplysia's feeding behavior.

Functional organization and adaptability of a decision-making network in aplysia

Whereas major insights into the neuronal basis of adaptive behavior have been gained from the study of automatic behaviors, including reflexive and rhythmic motor acts, the neural substrates for goal-directed behaviors in which decision-making about action selection and initiation are crucial, remain poorly understood. However, the mollusk Aplysia is proving to be increasingly relevant to redressing this issue. The functional properties of the central circuits that govern this animal’s goal-directed feeding behavior and particularly the neural processes underlying the selection and initiation of specific feeding actions are becoming understood. In addition to relying on the intrinsic operation of central networks, goal-directed behaviors depend on external sensory inputs that through associative learning are able to shape decision-making strategies. Here, we will review recent findings on the functional design of the central network that generates Aplysia’s feeding-related movements and the sensory-derived plasticity that through learning can modify the selection and initiation of appropriate action. The animal’s feeding behavior and the implications of decision-making will be briefly described. The functional design of the underlying buccal network will then be used to illustrate how cellular diversity and the coordination of neuronal burst activity provide substrates for decision-making. The contribution of specific synaptic and neuronal membrane properties within the buccal circuit will also be discussed in terms of their role in motor pattern selection and initiation. The ability of learning to “rigidify” these synaptic and cellular properties so as to regularize network operation and lead to the expression of stereotyped rhythmic behavior will then be described. Finally, these aspects will be drawn into a conceptual framework of how Aplysia’s goal-directed circuitry compares to the central pattern generating networks for invertebrate rhythmic behaviors.

Nitric oxide as a regulator of behavior: new ideas from Aplysia feeding

Nitric oxide (NO) regulates Aplysia feeding by novel mechanisms, suggesting new roles for NO in controlling the behavior of higher animals. In Aplysia, (1) NO helps maintain arousal when produced by neurons responding to attempts to swallow food; (2) NO biases the motor system to reject and reposition food that resists swallowing; (3) if mechanically resistant food is not successfully swallowed, NO mediates the formation and expression of memories of food inedibility; (4) NO production at rest inhibits feeding, countering the effects of food stimuli exciting feeding. At a cellular level, NO-dependent channels contribute to the resting potential of neurons controlling food finding and food consumption. Increases in L-arginine after animals eat act as a post-feeding inhibitory signal, presumably by modulating NO production at rest. NO also signals non-feeding behaviors that are associated with feeding inhibition. Thus, depending on context, NO may enhance or inhibit feeding behavior. The different functions of NO may reflect the evolution of NO signaling from a response to tissue damage that was then elaborated and used for additional functions. These results suggest that in higher animals (1) elicited and background transmitter release may have similar effects; (2) NO may be produced by neurons without firing, influencing adjacent neurons; (3) background NO production may contribute to a neuron's resting potential; (4) circulating factors affecting background NO production may regulate spatially separated neurons; (5) L-arginine can be used to regulate neural activity; (6) L-arginine may be an effective post-ingestion metabolic signal to regulate feeding.

Classical conditioning analog enhanced acetylcholine responses but reduced excitability of an identified neuron

Although classical and operant conditioning are operationally distinct, it is unclear whether these two forms of learning are mechanistically distinct or similar. Feeding behavior of Aplysia provides a useful model system for addressing this issue. Both classical and operant appetitive behavioral training enhance feeding, and neuronal correlates have been identified. Behavioral training was replicated by in vitro analogs that use isolated ganglia. Moreover, a single-cell analog of operant conditioning was developed using neuron B51, a cell important for the expression of the conditioned behavior. Here, a single-cell analog of classical conditioning was developed. Acetylcholine (ACh) mediated the conditioned stimulus (CS)-elicited excitation of B51 in ganglia and mimicked the CS in the single-cell analog of classical conditioning. Pairing ACh with dopamine, which mediates the unconditioned stimulus in ganglia, decreased the excitability of B51, and increased the CS-elicited excitation of B51, similar to results following both in vivo and in vitro classical training. Finally, a D1 dopamine receptor (D1R) agonist failed to support classical conditioning in the cellular analog, whereas D1R mediates reinforcement in operant conditioning.

Responses of a bursting pacemaker to excitation reveal spatial segregation between bursting and spiking mechanisms

Central pattern generators (CPGs) frequently include bursting neurons that serve as pacemakers for rhythm generation. Phase resetting curves (PRCs) can provide insight into mechanisms underlying phase locking in such circuits. PRCs were constructed for a pacemaker bursting complex in the pyloric circuit in the stomatogastric ganglion of the lobster and crab. This complex is comprised of the Anterior Burster (AB) neuron and two Pyloric Dilator (PD) neurons that are all electrically coupled. Artificial excitatory synaptic conductance pulses of different strengths and durations were injected into one of the AB or PD somata using the Dynamic Clamp. Previously, we characterized the inhibitory PRCs by assuming a single slow process that enabled synaptic inputs to trigger switches between an up state in which spiking occurs and a down state in which it does not. Excitation produced five different PRC shapes, which could not be explained with such a simple model. A separate dendritic compartment was required to separate the mechanism that generates the up and down phases of the bursting envelope (1) from synaptic inputs applied at the soma, (2) from axonal spike generation and (3) from a slow process with a slower time scale than burst generation. This study reveals that due to the nonlinear properties and compartmentalization of ionic channels, the response to excitation is more complex than inhibition.

Power fluctuations in beta and gamma frequencies in rat globus pallidus: association with specific phases of slow oscillations and differential modulation by dopamine D1 and D2 receptors

Modulation of oscillatory activity through basal ganglia-cortical loops in specific frequency bands is thought to reflect specific functional states of neural networks. A specific negative correlation between beta and gamma sub-bands has been demonstrated in human basal ganglia and may be key for normal basal ganglia function. However, these studies were limited to Parkinson's disease patients. To confirm that this interaction is a feature of normal basal ganglia, we recorded local field potential (LFP) from electrodes in globus pallidus (GP) of intact rats. We found significant negative correlation between specific frequencies within gamma (≈ 60 Hz) and beta (≈ 14 Hz) bands. Furthermore, we show that fluctuations in power at these frequencies are differentially nested within slow (≈ 3 Hz) oscillations in the delta band, showing maximum power at distinct and different phases of delta. These results suggest a hierarchical organization of LFP frequencies in the rat GP, in which a low-frequency signal in the basal ganglia can predict the timing and interaction of power fluctuations across higher frequencies. Finally, we found that dopamine D(1) and D(2) receptor antagonists differentially affected power in gamma and beta bands and also had different effects on correlation between them and the nesting within delta, indicating an important role for endogenous dopamine acting on direct and indirect pathway neurons in the maintenance of the hierarchical organization of frequency bands. Disruption of this hierarchical organization and subsequent disordered beta-gamma balance in basal ganglia disorders such as Parkinson's disease may be important in the pathogenesis of their symptoms.

Towards a scientific concept of free will as a biological trait: spontaneous actions and decision-making in invertebrates

Until the advent of modern neuroscience, free will used to be a theological and a metaphysical concept, debated with little reference to brain function. Today, with ever increasing understanding of neurons, circuits and cognition, this concept has become outdated and any metaphysical account of free will is rightfully rejected. The consequence is not, however, that we become mindless automata responding predictably to external stimuli. On the contrary, accumulating evidence also from brains much smaller than ours points towards a general organization of brain function that incorporates flexible decision-making on the basis of complex computations negotiating internal and external processing. The adaptive value of such an organization consists of being unpredictable for competitors, prey or predators, as well as being able to explore the hidden resource deterministic automats would never find. At the same time, this organization allows all animals to respond efficiently with tried-and-tested behaviours to predictable and reliable stimuli. As has been the case so many times in the history of neuroscience, invertebrate model systems are spearheading these research efforts. This comparatively recent evidence indicates that one common ability of most if not all brains is to choose among different behavioural options even in the absence of differences in the environment and perform genuinely novel acts. Therefore, it seems a reasonable effort for any neurobiologist to join and support a rather illustrious list of scholars who are trying to wrestle the term 'free will' from its metaphysical ancestry. The goal is to arrive at a scientific concept of free will, starting from these recently discovered processes with a strong emphasis on the neurobiological mechanisms underlying them.

Neural mechanisms of operant conditioning and learning-induced behavioral plasticity in Aplysia

Associative learning in goal-directed behaviors, in contrast to reflexive behaviors, can alter processes of decision-making in the selection of appropriate action and its initiation, thereby enabling animals, including humans, to gain a predictive understanding of their external environment. In the mollusc Aplysia, recent studies on appetitive operant conditioning in which the animal learns about the positive consequences of its behavior have provided insights into this form of associative learning which, although ubiquitous, remains mechanistically poorly understood. The findings support increasing evidence that central circuit- and cell-wide sites other than chemical synaptic connections, including electrical coupling and membrane conductances controlling intrinsic neuronal excitability and underlying voltage-dependent plateauing or oscillatory mechanisms, may serve as the neural substrates for behavioral plasticity resulting from operant conditioning. Aplysia therefore continues to provide a model system for understanding learning and memory formation that enables establishing the neurobiological links between behavioral, network, and cellular levels of analysis.

Nitric oxide and histamine signal attempts to swallow: A component of learning that food is inedible in Aplysia

Memory that food is inedible in Aplysia arises from training requiring three contingent events. Nitric oxide (NO) and histamine are released by a neuron responding to one of these events, attempts to swallow food. Since NO release during training is necessary for subsequent memory and NO substitutes for attempts to swallow, it was suggested that NO functions during training as a signal of attempts to swallow. However, it has been shown that NO may also be released in other contexts affecting feeding, raising the possibility that its role in learning is unrelated to signaling attempts to swallow. We confirmed that NO during learning signals attempts to swallow, by showing that a variety of behavioral effects on feeding of blocking or adding NO do not affect learning and memory that a food is inedible. In addition, histamine had effects similar to NO on learning that food is inedible, as expected if the transmitters are released together when animals attempt to swallow. Blocking histamine during training blocked long-term memory, and exogenous histamine substituted for attempts to swallow. NO also substituted for histamine during training. Histamine at concentrations relevant to learning activates neuron metacerebral cell (MCC). However, MCC activity is not a good monitor of attempts to swallow during training, since the neuron responds equally well to other stimuli. These findings support and extend the hypothesis that NO and histamine signal efforts to swallow during learning, acting on targets other than the MCC that specifically respond to attempts to swallow.

Predictions of phase-locking in excitatory hybrid networks: excitation does not promote phase-locking in pattern-generating networks as reliably as inhibition

Phase-locked activity is thought to underlie many high-level functions of the nervous system, the simplest of which are produced by central pattern generators (CPGs). It is not known whether we can define a theoretical framework that is sufficiently general to predict phase-locking in actual biological CPGs, nor is it known why the CPGs that have been characterized are dominated by inhibition. Previously, we applied a method based on phase response curves measured using inputs of biologically realistic amplitude and duration to predict the existence and stability of 1:1 phase-locked modes in hybrid networks of one biological and one model bursting neuron reciprocally connected with artificial inhibitory synapses. Here we extend this analysis to excitatory coupling. Using the pyloric dilator neuron from the stomatogastric ganglion of the American lobster as our biological cell, we experimentally prepared 86 networks using five biological neurons, four model neurons, and heterogeneous synapse strengths between 1 and 10,000 nS. In 77% of networks, our method was robust to biological noise and accurately predicted the phasic relationships. In 3%, our method was inaccurate. The remaining 20% were not amenable to analysis because our theoretical assumptions were violated. The high failure rate for excitation compared with inhibition was due to differential effects of noise and feedback on excitatory versus inhibitory coupling and suggests that CPGs dominated by excitatory synapses would require precise tuning to function, which may explain why CPGs rely primarily on inhibitory synapses.

State dependence of spike timing and neuronal function in a motor pattern generating network

When sustained firing of a neuron is similar in different types of motor programs, its role in the generation of these programs is often similar. We investigated whether this is also the case for neurons involved in phase transition. In the Aplysia feeding central pattern generator (CPG), identified interneuron B64 starts firing at the transition between the protraction and the retraction phases of all types of motor programs, and its firing is sustained during the retraction phase. It was thought that B64 functions as a protraction terminator as it provides strong inhibitory input to protraction interneurons and motoneurons. Furthermore, premature activation of B64 can lead to premature termination of the protraction phase. Indeed, as we show here, B64 can terminate the protraction phase regardless of the type of motor program. However, B64 actually only functions as a protraction terminator in ingestive-like but not in egestive-like programs. This differential role of B64 results from a differential timing of the initiation of B64 spiking in the two types of programs. In turn, this differential timing of the initiation of B64 firing is determined by the internal state of the CPG. Thus, this study indicates the importance of the timing of initiation of firing in determining the functional role of a neuron and demonstrates that this role depends on the activity-dependent state of the network.