Implication of dopaminergic modulation in operant reward learning and the induction of compulsive-like feeding behavior in Aplysia

Dopamine as a Multifunctional Neurotransmitter in Gastropod Molluscs: An Evolutionary Hypothesis

AbstractThe catecholamine 3,4-dihydroxyphenethylamine, or dopamine, acts as a neurotransmitter across a broad phylogenetic spectrum. Functions attributed to dopamine in the mammalian brain include regulation of motor circuits, valuation of sensory stimuli, and mediation of reward or reinforcement signals. Considerable evidence also supports a neurotransmitter role for dopamine in gastropod molluscs, and there is growing appreciation for its potential common functions across phylogeny. This article reviews evidence for dopamine's transmitter role in the nervous systems of gastropods. The functional properties of identified dopaminergic neurons in well-characterized neural circuits suggest a hypothetical incremental sequence by which dopamine accumulated its diverse roles. The successive acquisition of dopamine functions is proposed in the context of gastropod feeding behavior: (1) sensation of potential nutrients, (2) activation of motor circuits, (3) selection of motor patterns from multifunctional circuits, (4) valuation of sensory stimuli with reference to internal state, (5) association of motor programs with their outcomes, and (6) coincidence detection between sensory stimuli and their consequences. At each stage of this sequence, it is proposed that existing functions of dopaminergic neurons favored their recruitment to fulfill additional information processing demands. Common functions of dopamine in other intensively studied groups, ranging from mammals and insects to nematodes, suggest an ancient origin for this progression.

Decreased 14-3-3 expression correlates with age-related regional reductions in CNS dopamine and motor function in the pond snail, Lymnaea

Ageing is associated in many organisms with a reduction in motor movements. We have previously shown that the rate of feeding movements of the pond snail, Lymnaea, decreased with age but the underlying cause is not fully understood. Here, we show that dopamine in the cerebro-buccal complex is an important signalling molecule regulating feeding frequency in Lymnaea and that ageing is associated with a decrease in CNS dopamine. A proteomic screen of young and old CNSs highlighted a group of proteins that regulate stress responses. One of the proteins identified was 14-3-3, which can enhance the synthesis of dopamine. We show that the Lymnaea 14-3-3 family exists as three distinct isoforms. The expression of the 29 kDa isoform (14-3-3Lym3) in the cerebro-buccal complex decreased with age and correlated with feeding rate. Using a 14-3-3 antagonist (R18) we were able to reduce the synthesis of L-DOPA and dopamine in ex vivo cerebro-buccal complexes. Together these data suggest that an age-related reduction in 14-3-3 can decrease CNS dopamine leading to a consequential reduction in feeding rate.

Unique Configurations of Compression and Truncation of Neuronal Activity Underlie l-DOPA-Induced Selection of Motor Patterns in Aplysia

A key issue in neuroscience is understanding the ways in which neuromodulators such as dopamine modify neuronal activity to mediate selection of distinct motor patterns. We addressed this issue by applying either low or high concentrations of l-DOPA (40 or 250 μM) and then monitoring activity of up to 130 neurons simultaneously in the feeding circuitry of Aplysia using a voltage-sensitive dye (RH-155). l-DOPA selected one of two distinct buccal motor patterns (BMPs): intermediate (low l-DOPA) or bite (high l-DOPA) patterns. The selection of intermediate BMPs was associated with shortening of the second phase of the BMP (retraction), whereas the selection of bite BMPs was associated with shortening of both phases of the BMP (protraction and retraction). Selection of intermediate BMPs was also associated with truncation of individual neuron spike activity (decreased burst duration but no change in spike frequency or burst latency) in neurons active during retraction. In contrast, selection of bite BMPs was associated with compression of spike activity (decreased burst latency and duration and increased spike frequency) in neurons projecting through specific nerves, as well as increased spike frequency of protraction neurons. Finally, large-scale voltage-sensitive dye recordings delineated the spatial distribution of neurons active during BMPs and the modification of that distribution by the two concentrations of l-DOPA.

PKC in motorneurons underlies self-learning, a form of motor learning in Drosophila

Tethering a fly for stationary flight allows for exquisite control of its sensory input, such as visual or olfactory stimuli or a punishing infrared laser beam. A torque meter measures the turning attempts of the tethered fly around its vertical body axis. By punishing, say, left turning attempts (in a homogeneous environment), one can train a fly to restrict its behaviour to right turning attempts. It was recently discovered that this form of operant conditioning (called operant self-learning), may constitute a form of motor learning in Drosophila. Previous work had shown that Protein Kinase C (PKC) and the transcription factor dFoxP were specifically involved in self-learning, but not in other forms of learning. These molecules are specifically involved in various forms of motor learning in other animals, such as compulsive biting in Aplysia, song-learning in birds, procedural learning in mice or language acquisition in humans. Here we describe our efforts to decipher which PKC gene is involved in self-learning in Drosophila. We also provide evidence that motorneurons may be one part of the neuronal network modified during self-learning experiments. The collected evidence is reminiscent of one of the simplest, clinically relevant forms of motor learning in humans, operant reflex conditioning, which also relies on motorneuron plasticity.

The Sea Slug, Pleurobranchaea californica: A Signpost Species in the Evolution of Complex Nervous Systems and Behavior

How and why did complex brain and behavior evolve? Clues emerge from comparative studies of animals with simpler morphology, nervous system, and behavioral economics. The brains of vertebrates, arthropods, and some annelids have highly derived executive structures and function that control downstream, central pattern generators (CPGs) for locomotion, behavioral choice, and reproduction. For the vertebrates, these structures-cortex, basal ganglia, and hypothalamus-integrate topographically mapped sensory inputs with motivation and memory to transmit complex motor commands to relay stations controlling CPG outputs. Similar computations occur in the central complex and mushroom bodies of the arthropods, and in mammals these interactions structure subjective thought and socially based valuations. The simplest model systems available for comparison are opisthobranch molluscs, which have avoided selective pressure for complex bodies, brain, and behavior through potent chemical defenses. In particular, in the sea-slug Pleurobranchaea californica the functions of vertebrates' olfactory bulb and pallium are performed in the peripheral nervous system (PNS) of the chemotactile oral veil. Functions of hypothalamus and basal ganglia are combined in Pleurobranchaea's feeding motor network. The actions of basal ganglia on downstream locomotor regions and spinal CPGs are analogous to Pleurobranchaea's feeding network actions on CPGs for agonist and antagonist behaviors. The nervous systems of opisthobranch and pulmonate gastropods may conserve or reflect relations of the ancestral urbilaterian. Parallels and contrasts in neuronal circuits for action selection in Pleurobranchaea and vertebrates suggest how a basic set of decision circuitry was built upon in evolving segmentation, articulated skeletons, sociality, and highly invested reproductive strategies. They suggest (1) an origin of olfactory bulb and pallium from head-region PNS; (2) modularization of an ancestral feeding network into discrete but interacting executive modules for incentive comparison and decision (basal ganglia), and homeostatic functions (hypothalamus); (3) modification of a multifunctional premotor network for turns and locomotion, and its downstream targets for mid-brain and hind-brain motor areas and spinal CPGs; (4) condensation of a distributed serotonergic network for arousal into the raphe nuclei, with superimposed control by a peptidergic hypothalamic network mediating appetite and arousal; (5) centralization and condensation of the dopaminergic sensory afferents of the PNS, and/or the disperse dopaminergic elements of central CPGs, into the brain nuclei mediating valuation, reward, and motor arousal; and (6) the urbilaterian possessed the basic circuit relations integrating sensation, internal state, and learning for cost-benefit approach-avoidance decisions.

Phylogenetic and individual variation in gastropod central pattern generators

Gastropod molluscs provide a unique opportunity to explore the neural basis of rhythmic behaviors because of the accessibility of their nervous systems and the number of species that have been examined. Detailed comparisons of the central pattern generators (CPGs) underlying rhythmic feeding and swimming behaviors highlight the presence and effects of variation in neural circuits both across and within species. The feeding motor pattern of the snail, Lymnaea, is stereotyped, whereas the feeding motor pattern in the sea hare, Aplysia, is variable. However, the Aplysia motor pattern is regularized with operant conditioning or by mimicking learning using the dynamic clamp to change properties of CPG neurons. Swimming evolved repeatedly in marine gastropods. Distinct neural mechanisms underlie dissimilar forms of swimming, with homologous neurons playing different roles. However, even similar swimming behaviors in different species can be produced by distinct neural mechanisms, resulting from different synaptic connectivity of homologous neurons. Within a species, there can be variation in the strength and even valence of synapses, which does not have functional relevance under normal conditions, but can cause some individuals to be more susceptible to lesion of the circuit. This inter- and intra-species variation provides novel insights into CPG function and plasticity.

Operant conditioning: a minimal components requirement in artificial spiking neurons designed for bio-inspired robot's controller

In this paper, we investigate the operant conditioning (OC) learning process within a bio-inspired paradigm, using artificial spiking neural networks (ASNN) to act as robot brain controllers. In biological agents, OC results in behavioral changes learned from the consequences of previous actions, based on progressive prediction adjustment from rewarding or punishing signals. In a neurorobotics context, virtual and physical autonomous robots may benefit from a similar learning skill when facing unknown and unsupervised environments. In this work, we demonstrate that a simple invariant micro-circuit can sustain OC in multiple learning scenarios. The motivation for this new OC implementation model stems from the relatively complex alternatives that have been described in the computational literature and recent advances in neurobiology. Our elementary kernel includes only a few crucial neurons, synaptic links and originally from the integration of habituation and spike-timing dependent plasticity as learning rules. Using several tasks of incremental complexity, our results show that a minimal neural component set is sufficient to realize many OC procedures. Hence, with the proposed OC module, designing learning tasks with an ASNN and a bio-inspired robot context leads to simpler neural architectures for achieving complex behaviors.

Localization of tyrosine hydroxylase-like immunoreactivity in the nervous systems of Biomphalaria glabrata and Biomphalaria alexandrina, intermediate hosts for schistosomiasis

Planorbid snails of the genus Biomphalaria are major intermediate hosts for the digenetic trematode parasite Schistosoma mansoni. Evidence suggests that levels of the neurotransmitter dopamine (DA) are reduced during the course of S. mansoni multiplication and transformation within the snail. This investigation used immunohistochemical methods to localize tyrosine hydroxylase (TH), the rate-limiting enzyme in the biosynthesis of catecholamines, in the nervous system of Biomphalaria. The two species examined, Biomphalaria glabrata and Biomphalaria alexandrina, are the major intermediate hosts for S. mansoni in sub-Saharan Africa, where more than 90% of global cases of human intestinal schistosomiasis occur. TH-like immunoreactive (THli) neurons were distributed throughout the central nervous system (CNS) and labeled fibers were present in all commissures, connectives, and nerves. Some asymmetries were observed, including a large distinctive neuron (LPeD1) in the pedal ganglion described previously in several pulmonates. The majority of TH-like immunoreactive neurons were detected in the peripheral nervous system (PNS), especially in lip and foot regions of the anterior integument. Independent observations supporting the dopaminergic phenotype of THli neurons included 1) block of LPeD1 synaptic signaling by the D2/3 antagonist sulpiride, and 2) the similar localization of aqueous aldehyde (FaGlu)-induced fluorescence. The distribution of THli neurons indicates that, as in other gastropods, dopamine functions as a sensory neurotransmitter and in the regulation of feeding and reproductive behaviors in Biomphalaria. It is hypothesized that infection could stimulate transmitter release from dopaminergic sensory neurons and that dopaminergic signaling could contribute to modifications of both host and parasite behavior.

Frank Beach Award Winner: Steroids as neuromodulators of brain circuits and behavior

Neurons communicate primarily via action potentials that transmit information on the timescale of milliseconds. Neurons also integrate information via alterations in gene transcription and protein translation that are sustained for hours to days after initiation. Positioned between these two signaling timescales are the minute-by-minute actions of neuromodulators. Over the course of minutes, the classical neuromodulators (such as serotonin, dopamine, octopamine, and norepinephrine) can alter and/or stabilize neural circuit patterning as well as behavioral states. Neuromodulators allow many flexible outputs from neural circuits and can encode information content into the firing state of neural networks. The idea that steroid molecules can operate as genuine behavioral neuromodulators - synthesized by and acting within brain circuits on a minute-by-minute timescale - has gained traction in recent years. Evidence for brain steroid synthesis at synaptic terminals has converged with evidence for the rapid actions of brain-derived steroids on neural circuits and behavior. The general principle emerging from this work is that the production of steroid hormones within brain circuits can alter their functional connectivity and shift sensory representations by enhancing their information coding. Steroids produced in the brain can therefore change the information content of neuronal networks to rapidly modulate sensory experience and sensorimotor functions.

Endocrinology: advances through omics and related technologies

The rapid development of new omics technologies to measure changes at genetic, transcriptomic, proteomic, and metabolomics levels together with the evolution of methods to analyze and integrate the data at a systems level are revolutionizing the study of biological processes. Here we discuss how new approaches using omics technologies have expanded our knowledge especially in nontraditional models. Our increasing knowledge of these interactions and evolutionary pathway conservation facilitates the use of nontraditional species, both invertebrate and vertebrate, as new model species for biological and endocrinology research. The increasing availability of technology to create organisms overexpressing key genes in endocrine function allows manipulation of complex regulatory networks such as growth hormone (GH) in transgenic fish where disregulation of GH production to produce larger fish has also permitted exploration of the role that GH plays in testis development, suggesting that it does so through interactions with insulin-like growth factors. The availability of omics tools to monitor changes at nearly any level in any organism, manipulate gene expression and behavior, and integrate data across biological levels, provides novel opportunities to explore endocrine function across many species and understand the complex roles that key genes play in different aspects of the endocrine function.

Reconciling the deep homology of neuromodulation with the evolution of behavior

The evolution of behavior seems inconsistent with the deep homology of neuromodulatory signaling. G protein coupled receptors (GPCRs) evolved slowly from a common ancestor through a process involving gene duplication, neofunctionalization, and loss. Neuropeptides co-evolved with their receptors and exhibit many conserved functions. Furthermore, brain areas are highly conserved with suggestions of deep anatomical homology between arthropods and vertebrates. Yet, behavior evolved more rapidly; even members of the same genus or species can differ in heritable behavior. The solution to the paradox involves changes in the compartmentalization, or subfunctionalization, of neuromodulation; neurons shift their expression of GPCRs and the content of monoamines and neuropeptides. Furthermore, parallel evolution of neuromodulatory signaling systems suggests a route for repeated evolution of similar behaviors.

Differential roles of nonsynaptic and synaptic plasticity in operant reward learning-induced compulsive behavior

BACKGROUND

Rewarding stimuli in associative learning can transform the irregularly and infrequently generated motor patterns underlying motivated behaviors into output for accelerated and stereotyped repetitive action. This transition to compulsive behavioral expression is associated with modified synaptic and membrane properties of central neurons, but establishing the causal relationships between cellular plasticity and motor adaptation has remained a challenge.

RESULTS

We found previously that changes in the intrinsic excitability and electrical synapses of identified neurons in Aplysia's central pattern-generating network for feeding are correlated with a switch to compulsive-like motor output expression induced by in vivo operant conditioning. Here, we used specific computer-simulated ionic currents in vitro to selectively replicate or suppress the membrane and synaptic plasticity resulting from this learning. In naive in vitro preparations, such experimental manipulation of neuronal membrane properties alone increased the frequency but not the regularity of feeding motor output found in preparations from operantly trained animals. On the other hand, changes in synaptic strength alone switched the regularity but not the frequency of feeding output from naive to trained states. However, simultaneously imposed changes in both membrane and synaptic properties reproduced both major aspects of the motor plasticity. Conversely, in preparations from trained animals, experimental suppression of the membrane and synaptic plasticity abolished the increase in frequency and regularity of the learned motor output expression.

CONCLUSIONS

These data establish direct causality for the contributions of distinct synaptic and nonsynaptic adaptive processes to complementary facets of a compulsive behavior resulting from operant reward learning.