Learning in Aplysia: looking at synaptic plasticity from both sides

Multiple changes in connectivity between buccal ganglia mechanoafferents and motor neurons with different functions after learning that food is inedible in Aplysia

Changes caused by learning that a food is inedible in Aplysia were examined for fast and slow synaptic connections from the buccal ganglia S1 cluster of mechanoafferents to five followers, in response to repeated stimulus trains. Learning affected only fast connections. For these, unique patterns of change were present in each follower, indicating that learning differentially affects the different branches of the mechanoafferents to their followers. In some followers, there were increases in either excitatory or inhibitory connections, and in others, there were decreases. Changes in connectivity resulted from changes in the amplitude of excitation or inhibition, or as a result of the number of connections, or of both. Some followers also exhibited changes in either within or between stimulus train plasticity as a result of learning. In one follower, changes differed from the different areas of the S1 cluster. The patterns of changes in connectivity were consistent with the behavioral changes produced by learning, in that they would produce an increase in the bias to reject or to release food, and a decrease in the likelihood to respond to food.

Untangling the Gordian Knot of Aplysia sea hare egg masses: An integrated open-hardware system for standardized egg strand sizing and packaging for cryopreservation research and application

The California sea hare (Aplysia californica) provides a powerful biomedical model system for studying aspects of neurological development and damage, behavior, aging, and hypoxia. Aplysia encapsulate their zygotes within strands that result in tangled egg masses that greatly complicate culture and experimentation. The historical and current importance of Aplysia for biomedical research and the mounting climate crisis necessitates protection of Aplysia genetic resources. The goal of this work was to prototype open-hardware sizing, processing, and packaging devices for A. californica early life stages suitable for integration into a cryopreservation pathway. The Strand Centi-Sizer was a low-cost, fused filament fabrication 3-D printable device that increased experiment preparation efficiency and standardized the cutting of egg strands customizable to user needs. A downstream system of 3-D printed devices was also prototyped to address inefficiencies in handling of egg strand sections for processing and packaging into existing cryopreservation straw platforms. Time studies were conducted comparing manual methods (i.e., no specialized equipment) with open hardware to demonstrate utility of the devices and to encourage community members to design and prototype new devices to address recurrent and novel problems in other aquatic animals that produce egg strands. Improvements in design could further increase efficiency, standardization, and reproducibility, and extend the application of these devices to other research communities, such as shrimp or salamander spermatophores, sea anemone body part (e.g., pedal lacerate) cryopreservation, or study areas such as vitrification.

Improvements in operant memory of Aplysia are correlated with age and specific gene expression

The transcription factor Aplysia CCAAT/enhancer binding protein (ApC/EBP) is expressed as an immediate early gene in the cAMP responsive element binding protein (CREB) mediated gene cascade, and it has essential functions in the synaptic consolidation of memory following a learning event. Synaptic consolidation primarily involves morphological changes at neuronal synapses, which are facilitated through the reorganization of the actin and microtubular cytoarchitecture of the cell. During early nervous system development, the transmembrane synaptic protein teneurin acts directly upon neuronal presynaptic microtubules and postsynaptic spectrin-based cytoskeletons to facilitate the creation of new synapses. It is reasonable to hypothesize that teneurin may also be linked to learning-induced synaptic changes and is a potential candidate to be a later gene expressed in the CREB-mediated gene cascade downstream of ApC/EBP. To assess the role of ApC/EBP and teneurin in learning and memory in the marine snail Aplysia californica, young (age 7-8 months) and aged (age 13-15 months; aging stage AII) siblings of Aplysia were trained in an operant conditioning paradigm-learning food is inedible (LFI)-over 2 days, during which they learned to modify the feeding reflex. Aged Aplysia had enhanced performance of the LFI task on the second day than younger siblings although far more aged animals were excluded from the analysis because of the initial failure in learning to recognize the inedible probe. After 2 days of training, ApC/EBP isoform X1 mRNA and teneurin mRNA were quantified in selected neurons of the buccal ganglia, the locus of neural circuits in LFI. Teneurin expression was elevated in aged Aplysia compared to young siblings regardless of training. ApC/EBP isoform X1 expression was significantly higher in untrained aged animals than in untrained young siblings but decreased in trained aged animals compared to untrained aged animals. Elevated levels of ApC/EBP isoform X1 and teneurin mRNA before training may have contributed to the enhancement of LFI performance in the aged animals that successfully learned.

Molecular insights from the crab Neohelice memory model

Memory acquisition, formation and maintenance depend on synaptic post-translational machinery and regulation of gene expression triggered by several transduction pathways. In turns, these processes lead to stabilization of synaptic modifications in neurons in the activated circuits. In order to study the molecular mechanisms involved in acquisition and memory, we have taken advantage of the context-signal associative learning and, more recently, the place preference task, of the crab Neohelice granulata. In this model organism, we studied several molecular processes, including activation of extracellular signal-regulated kinase (ERK) and the nuclear factor kappa light chain enhancer of activated B cells (NF-κB) transcription factor, involvement of synaptic proteins such as NMDA receptors and neuroepigenetic regulation of gene expression. All these studies allowed description of key plasticity mechanisms involved in memory, including consolidation, reconsolidation and extinction. This article is aimed at review the most salient findings obtained over decades of research in this memory model.

Flow cytometric characterization of the hemocytes of sea hares from tidal pools in Jeju Island off the south coast of Korea

The members in the family Aplysidae known as sea hares play a crucial role as a grazer in small tidal pools or shallow subtidal hard bottoms. Like other marine gastropods, hemocyte types and functions of sea hares are limitedly known. This study identified and characterized the hemocytes of common Aplysia species Aplysia kurodai, A. juliana, and A. oculifera in rocky tidal pools in Jeju Island off the south coast of Korea using flow cytometry and light microscopy. The flow cytometry identified three different hemocytes in the hemolymph of the three sea hare species: granulocytes, hyalinocytes, and blast-like cells. The granulocytes exhibited pseudopodia on the cell surface and granules in the cytoplasm. Morphology of the hyalinocyte was similar to that of the granulocytes, while they lack cytoplasmic granules. The blast-like cells were small and round, with very thin cytoplasm. The hyalinocytes were the most abundant in the hemolymph, accounting for 89.8-92.6% of the total hemocytes. Flow cytometry indicated that the granulocytes and blast-like cells were less than 5.6% and 5.4% of the total hemocyte populations. Flow cytometry also revealed that the granulocytes and hyalinocytes are engaged in cellular defensive activities such as intra-cellular lysosomal content, phagocytosis, and ROS production. The mean lysosomal contents of the granulocytes (0.4 × 10⁵-0.2 × 10⁵ A U.) were 2-3 times higher than that of hyalinocytes (0.2 × 10⁵-0.6 × 10⁵ A U.). In addition, the ROS production of the granulocytes (0.98 × 10⁶-1.95 × 10⁶ A U.) was about twice higher than that of the hyalinocytes (0.62 × 10⁶-1.14 × 10⁶ A U.). Of the three species of sea hares, the granulocytes showed comparatively higher phagocytosis capacity (70.4-92.3%) than that of the hyalinocytes (34.8-46.0%). Flow cytometry and microscopy indicated that the hemocyte types and their functions were identical, regardless of the species.

From Biological Synapses to “Intelligent” Robots

This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.

Neurons learn by predicting future activity

Understanding how the brain learns may lead to machines with human-like intellectual capacities. It was previously proposed that the brain may operate on the principle of predictive coding. However, it is still not well understood how a predictive system could be implemented in the brain. Here we demonstrate that the ability of a single neuron to predict its future activity may provide an effective learning mechanism. Interestingly, this predictive learning rule can be derived from a metabolic principle, where neurons need to minimize their own synaptic activity (cost), while maximizing their impact on local blood supply by recruiting other neurons. We show how this mathematically derived learning rule can provide a theoretical connection between diverse types of brain-inspired algorithms, thus, offering a step toward development of a general theory of neuronal learning. We tested this predictive learning rule in neural network simulations and in data recorded from awake animals. Our results also suggest that spontaneous brain activity provides “training data” for neurons to learn to predict cortical dynamics. Thus, the ability of a single neuron to minimize surprise: i.e. the difference between actual and expected activity, could be an important missing element to understand computation in the brain.

Predictive Neuronal Adaptation as a Basis for Consciousness

Being able to correctly predict the future and to adjust own actions accordingly can offer a great survival advantage. In fact, this could be the main reason why brains evolved. Consciousness, the most mysterious feature of brain activity, also seems to be related to predicting the future and detecting surprise: a mismatch between actual and predicted situation. Similarly at a single neuron level, predicting future activity and adapting synaptic inputs accordingly was shown to be the best strategy to maximize the metabolic energy for a neuron. Following on these ideas, here we examined if surprise minimization by single neurons could be a basis for consciousness. First, we showed in simulations that as a neural network learns a new task, then the surprise within neurons (defined as the difference between actual and expected activity) changes similarly to the consciousness of skills in humans. Moreover, implementing adaptation of neuronal activity to minimize surprise at fast time scales (tens of milliseconds) resulted in improved network performance. This improvement is likely because adapting activity based on the internal predictive model allows each neuron to make a more "educated" response to stimuli. Based on those results, we propose that the neuronal predictive adaptation to minimize surprise could be a basic building block of conscious processing. Such adaptation allows neurons to exchange information about own predictions and thus to build more complex predictive models. To be precise, we provide an equation to quantify consciousness as the amount of surprise minus the size of the adaptation error. Since neuronal adaptation can be studied experimentally, this can allow testing directly our hypothesis. Specifically, we postulate that any substance affecting neuronal adaptation will also affect consciousness. Interestingly, our predictive adaptation hypothesis is consistent with multiple ideas presented previously in diverse theories of consciousness, such as global workspace theory, integrated information, attention schema theory, and predictive processing framework. In summary, we present a theoretical, computational, and experimental support for the hypothesis that neuronal adaptation is a possible biological mechanism of conscious processing, and we discuss how this could provide a step toward a unified theory of consciousness.

Sensitized by a sea slug: site-specific short-term and general long-term sensitization in Aplysia following Navanax attack

Neurobiological studies of the model species, Aplysia californica (Mollusca, Gastropoda, Euopisthobranchia), have helped advance our knowledge of the neural bases of different forms of learning, including sensitization, a non-associative increase in withdrawal behaviors in response to mild innocuous stimuli However, our understanding of the natural context for this learning has lagged behind the mechanistic studies. Because previous studies of sensitization used electric shock, or other artificial stimulus to produce sensitization, they left unaddressed the question of what stimuli in nature might cause sensitization, until our laboratory demonstrated short and long-term sensitization after predatory attack by spiny lobsters. In the present study, we tested for sensitization after attack by a very different predator, the predacious sea-slug, Navanax inermis (Mollusca, Gastropoda, Euopisthobranchia). Unlike the biting and prodding action of lobster attack, Navanax uses a rapid strike that sucks and squeezes its prey in an attempt to swallow it whole. We found that Navanax attack to the head of Aplysia caused strong immediate sensitization of head withdrawal, and weaker, delayed, sensitization of tail-mantle withdrawal. By contrast, attack to the tail of Aplysia resulted in no sensitization of either reflex. We also developed an artificial attack stimulus that allowed us to mimick a more consistently strong attack. This artificial attack produced stronger but qualitatively similar sensitization: Strong immediate sensitization of head withdrawal and weaker sensitization of tail-mantle withdrawal after head attack, immediate sensitization in tail-mantle withdrawal, but no sensitization of head withdrawal after tail attack. We conclude that Navanax attack causes robust site-specific sensitization (enhanced sensitization near the site of attack), and weaker general sensitization (sensitization of responses to stimuli distal to the attack site). We also tested for long-term sensitization (lasting longer than 24 hours) after temporally-spaced delivery of four natural Navanax attacks to the head of subject Aplysia. Surprisingly, these head attacks, any one of which strongly sensitizes head withdrawal in the short term, failed to sensitize head-withdrawal in the long term. Paradoxically, these repeated head attacks produced long-term sensitization in tail-mantle withdrawal. These experiments and observations confirm that Navanax attack causes short, and long-term sensitization of withdrawal reflexes of Aplysia. Together with the observation of sensitization after lobster attack, they strongly support the premise that sensitization in Aplysia is an adaptive response to sub-lethal predator attack. They also add site-specific sensitization to the list of naturally induced learning phenotypes, as well as paradoxical long-term sensitization of tail-mantle withdrawal (but not head withdrawal) after multiple head attacks.

Metazoan evolution and diversity of glutamate receptors and their auxiliary subunits

Glutamate is the major excitatory neurotransmitter in vertebrate and invertebrate nervous systems. Proteins involved in glutamatergic neurotransmission, and chiefly glutamate receptors and their auxiliary subunits, play key roles in nervous system function. Thus, understanding their evolution and uncovering their diversity is essential to comprehend how nervous systems evolved, shaping cognitive function. Comprehensive phylogenetic analysis of these proteins across metazoans have revealed that their evolution is much more complex than what can be anticipated from vertebrate genomes. This is particularly true for ionotropic glutamate receptors (iGluRs), as their current classification into 6 classes (AMPA, Kainate, Delta, NMDA1, NMDA2 and NMDA3) would be largely incomplete. New work proposes a classification of iGluRs into 4 subfamilies that encompass 10 classes. Vertebrate AMPA, Kainate and Delta receptors would belong to one of these subfamilies, named AKDF, the NMDA subunits would constitute another subfamily and non-vertebrate iGluRs would be organised into the previously unreported Epsilon and Lambda subfamilies. Similarly, the animal evolution of metabotropic glutamate receptors has resulted in the formation of four classes of these receptors, instead of the three currently recognised. Here we review our current knowledge on the animal evolution of glutamate receptors and their auxiliary subunits. This article is part of the special issue on 'Glutamate Receptors - Orphan iGluRs'.

WITHDRAWN: Utilizing comparative models in biomedical research

The Publisher regrets that this article is an accidental duplication of an article that has already been published in Comparative Biochemistry and Physiology Part B: Biochemistry and Molecular Biology, Volume 255, 2021, 110593, https://doi.org/10.1016/j.cbpb.2021.110593. The duplicate article has therefore been withdrawn. The full Elsevier Policy on Article Withdrawal can be found at https://www.elsevier.com/about/our-business/policies/article-withdrawal.

Utilizing comparative models in biomedical research

This review serves as an introduction to a Special Issue of Comparative Biochemistry and Physiology, focused on using non-human models to study biomedical physiology. The concept of a model differs across disciplines. For example, several models are used primarily to gain an understanding of specific human pathologies and disease states, whereas other models may be focused on gaining insight into developmental or evolutionary mechanisms. It is often the case that animals initially used to gain knowledge of some unique biochemical or physiological process finds foothold in the biomedical community and becomes an established model. The choice of a particular model for biomedical research is an ongoing process and model validation must keep pace with existing and emerging technologies. While the importance of non-mammalian models, such as Caenorhabditis elegans, Drosophila melanogaster, Danio rerio and Xenopus laevis, is well known, we also seek to bring attention to emerging alternative models of both invertebrates and vertebrates, which are less established but of interest to the comparative biochemistry and physiology community.

Exploring Neuromodulation for Dynamic Learning

A continual learning system requires the ability to dynamically adapt and generalize to new tasks with access to only a few samples. In the central nervous system, across species, it is observed that continual and dynamic behavior in learning is an active result of a mechanism known as neuromodulation. Therefore, in this work, neuromodulatory plasticity is embedded with dynamic learning architectures as a first step toward realizing power and area efficient few shot learning systems. An inbuilt modulatory unit regulates learning based on the context and internal state of the system. This renders the system an ability to self modify its weights. In one of the proposed architectures, ModNet, a modulatory layer is introduced in a random projection framework. ModNet's learning capabilities are enhanced by integrating attention along with compartmentalized plasticity mechanisms. Moreover, to explore modulatory mechanisms in conjunction with backpropagation in deeper networks, a modulatory trace learning rule is introduced. The proposed learning rule, uses a time dependent trace to modify the synaptic connections as a function of ongoing states and activations. The trace itself is updated via simple plasticity rules thus reducing the demand on resources. The proposed ModNet and learning rules demonstrate the ability to learn from few samples, train quickly, and perform few-shot image classification in a computationally efficient manner. The simple ModNet and the compartmentalized ModNet architecture learn benchmark image classification tasks in just 2 epochs. The network with modulatory trace achieves an average accuracy of 98.8%±1.16 on the omniglot dataset for five-way one-shot image classification task while requiring 20x fewer trainable parameters in comparison to other state of the art models.

Dopaminergic signaling of uncertainty and the aetiology of gambling addiction

Although there is increasing clinical recognition of behavioral addictions, of which gambling disorder is the prototype example, there is a limited understanding of the psychological properties of (non-substance-related) behaviors that enable them to become 'addictive' in a way that is comparable to drugs of abuse. According to an influential application of reinforcement learning to substance addictions, the direct effects of drugs to release dopamine can create a perpetual escalation of incentive salience. This article focusses on reward uncertainty, which is proposed to be the core feature of gambling that creates the capacity for addiction. We describe the neuro-dynamics of the dopamine response to uncertainty that may allow a similar escalation of incentive salience, and its relevance to behavioral addictions. We review translational evidence from both preclinical animal models and human clinical research, including studies in people with gambling disorder. Further, we describe the evidence for 1) the effects of the omission of expected reward as a stressor and to promote sensitization, 2) the effect of the resolution of reward uncertainty as a source of value, 3) structural characteristics of modern Electronic Gaming Machines (EGMs) in leveraging these mechanisms, 4) analogies to the aberrant salience hypothesis of psychosis for creating and maintaining gambling-related cognitive distortions. This neurobiologically-inspired model has implications for harm profiling of other putative behavioral addictions, as well as offering avenues for enhancing neurological, pharmacological and psychological treatments for gambling disorder, and harm reduction strategies for EGM design.

Lymnaea stagnalis as model for translational neuroscience research: From pond to bench

The purpose of this review is to illustrate how a reductionistic, but sophisticated, approach based on the use of a simple model system such as the pond snail Lymnaea stagnalis (L. stagnalis), might be useful to address fundamental questions in learning and memory. L. stagnalis, as a model, provides an interesting platform to investigate the dialog between the synapse and the nucleus and vice versa during memory and learning. More importantly, the "molecular actors" of the memory dialogue are well-conserved both across phylogenetic groups and learning paradigms, involving single- or multi-trials, aversion or reward, operant or classical conditioning. At the same time, this model could help to study how, where and when the memory dialog is impaired in stressful conditions and during aging and neurodegeneration in humans and thus offers new insights and targets in order to develop innovative therapies and technology for the treatment of a range of neurological and neurodegenerative disorders.

Is plasticity of synapses the mechanism of long-term memory storage?

It has been 70 years since Donald Hebb published his formalized theory of synaptic adaptation during learning. Hebb's seminal work foreshadowed some of the great neuroscientific discoveries of the following decades, including the discovery of long-term potentiation and other lasting forms of synaptic plasticity, and more recently the residence of memories in synaptically connected neuronal assemblies. Our understanding of the processes underlying learning and memory has been dominated by the view that synapses are the principal site of information storage in the brain. This view has received substantial support from research in several model systems, with the vast majority of studies on the topic corroborating a role for synapses in memory storage. Yet, despite the neuroscience community's best efforts, we are still without conclusive proof that memories reside at synapses. Furthermore, an increasing number of non-synaptic mechanisms have emerged that are also capable of acting as memory substrates. In this review, we address the key findings from the synaptic plasticity literature that make these phenomena such attractive memory mechanisms. We then turn our attention to evidence that questions the reliance of memory exclusively on changes at the synapse and attempt to integrate these opposing views.

LTP suppression by protein synthesis inhibitors is NO-dependent

For several decades, the ability of protein synthesis inhibitors (PSI) to suppress the long-term potentiation (LTP) of hippocampal responses is known. It is considered that mechanisms of such impairment are related to a cessation of translation and a delayed depletion of the protein pool required for maintenance of synaptic plasticity. The present study demonstrates that cycloheximide or anisomycin applications reduce amplitudes of the field excitatory postsynaptic potentials as well as the presynaptically mediated form of plasticity, the paired-pulse facilitation after LTP induction in neurons of the CA1 area of hippocampus. We showed that nitric oxide signaling could be one of the pathways that cause the LTP decrease induced by cycloheximide or anisomycin. Inhibitor of the NO synthase, L-NNA or the NO scavenger, PTIO, rescued the late-phase LTP and restored the paired-pulse facilitation up to the control levels. For the first time we have directly measured the nitric oxide production induced by application of the translation blockers in hippocampal neurons using the NO-sensitive dye DAF-FM. Inhibitory analysis demonstrated that changes during protein synthesis blockade downstream the NO signaling cascade are cGMP-independent and apparently are implemented through degradation of target proteins. Prolonged application of the NO donor SNAP impaired the LTP maintenance in the same manner as PSI.

Surface expression of NMDA receptor changes during memory consolidation in the crab Neohelice granulata

The aim of the present study was to analyze the surface expression of the NMDA-like receptors during the consolidation of contextual learning in the crab Neohelice granulata Memory storage is based on alterations in the strength of synaptic connections between neurons. The glutamatergic synapses undergo various forms of N-methyl-D aspartate receptor (NMDAR)-dependent changes in strength, a process that affects the abundance of other receptors at the synapse and underlies some forms of learning and memory. Here we propose a direct regulation of the NMDAR. Changes in NMDAR's functionality might be induced by the modification of the subunit's expression or cellular trafficking. This trafficking does not only include NMDAR's movement between synaptic and extra-synaptic localizations but also the cycling between intracellular compartments and the plasma membrane, a process called surface expression. Consolidation of contextual learning affects the surface expression of the receptor without affecting its general expression. The surface expression of the GluN1 subunit of the NMDAR is down-regulated immediately after training, up-regulated 3 h after training and returns to naïve and control levels 24 h after training. The changes in NMDAR surface expression observed in the central brain are not seen in the thoracic ganglion. A similar increment in surface expression of GluN1 in the central brain is observed 3 h after administration of the competitive GABAA receptor antagonist, bicuculline. These consolidation changes are part of a plasticity event that first, during the down-regulation, stabilizes the trace and later, at 3-h post-training, changes the threshold for synapse activation.

Neural correlates of expression-independent memories in the crab Neohelice

The neural correlates of memory have been usually examined considering that memory retrieval and memory expression are interchangeable concepts. However, our studies in the crab Neohelice (Chasmagnathus) granulata and in other memory models have shown that memory expression is not necessary for memory to be re-activated and become labile. In order to examine putative neural correlates of memory in the crab Neohelice, we contrast changes induced by training in both animal's behavior and neuronal responses in the medulla terminalis using in vivo Ca(2+) imaging. Disruption of long-term memory by the amnesic agents MK-801 or scopolamine (5μg/g) blocks the learning-induced changes in the Ca(2+) responses in the medulla terminalis. Conversely, treatments that lead to an unexpressed but persistent memory (weak training protocol or scopolamine 0.1μg/g) do not block these learning-induced neural changes. The present results reveal a set of changes in the neural activity induced by training that correlates with memory persistence but not with the probability of this memory to be expressed in the long-term. In addition, the study constitutes the first in vivo evidence in favor of a role of the medulla terminalis in learning and memory in crustaceans, and provides a physiological evidence indicating that memory persistence and the probability of memory to be expressed might involve separate components of memory traces.

Memory-Relevant Mushroom Body Output Synapses Are Cholinergic

Memories are stored in the fan-out fan-in neural architectures of the mammalian cerebellum and hippocampus and the insect mushroom bodies. However, whereas key plasticity occurs at glutamatergic synapses in mammals, the neurochemistry of the memory-storing mushroom body Kenyon cell output synapses is unknown. Here we demonstrate a role for acetylcholine (ACh) in Drosophila. Kenyon cells express the ACh-processing proteins ChAT and VAChT, and reducing their expression impairs learned olfactory-driven behavior. Local ACh application, or direct Kenyon cell activation, evokes activity in mushroom body output neurons (MBONs). MBON activation depends on VAChT expression in Kenyon cells and is blocked by ACh receptor antagonism. Furthermore, reducing nicotinic ACh receptor subunit expression in MBONs compromises odor-evoked activation and redirects odor-driven behavior. Lastly, peptidergic corelease enhances ACh-evoked responses in MBONs, suggesting an interaction between the fast- and slow-acting transmitters. Therefore, olfactory memories in Drosophila are likely stored as plasticity of cholinergic synapses.

•

Mushroom body Kenyon cell function requires ChAT and VAChT expression

•

Kenyon cell-released acetylcholine drives mushroom body output neurons

•

Blocking nicotinic receptors impairs mushroom body output neuron activation

•

Acetylcholine interacts with coreleased neuropeptide

Protein degradation by ubiquitin-proteasome system in formation and labilization of contextual conditioning memory

The ubiquitin–proteasome system (UPS) of protein degradation has been evaluated in different forms of neural plasticity and memory. The role of UPS in such processes is controversial. Several results support the idea that the activation of this system in memory consolidation is necessary to overcome negative constrains for plasticity. In this case, the inhibition of the UPS during consolidation impairs memory. Similar results were reported for memory reconsolidation. However, in other cases, the inhibition of UPS had no effect on memory consolidation and reconsolidation but impedes the amnesic action of protein synthesis inhibition after retrieval. The last finding suggests a specific action of the UPS inhibitor on memory labilization. However, another interpretation is possible in terms of the synthesis/degradation balance of positive and negative elements in neural plasticity, as was found in the case of long-term potentiation. To evaluate these alternative interpretations, other reconsolidation-interfering drugs than translation inhibitors should be tested. Here we analyzed initially the UPS inhibitor effect in contextual conditioning in crabs. We found that UPS inhibition during consolidation impaired long-term memory. In contrast, UPS inhibition did not affect memory reconsolidation after contextual retrieval but, in fact, impeded memory labilization, blocking the action of drugs that does not affect directly the protein synthesis. To extend these finding to vertebrates, we performed similar experiments in contextual fear memory in mice. We found that the UPS inhibitor in hippocampus affected memory consolidation and blocked memory labilization after retrieval. These findings exclude alternative interpretations to the requirement of UPS in memory labilization and give evidence of this mechanism in both vertebrates and invertebrates.

Harnessing the power of neuroplasticity for intervention

A fundamental property of the brain is its capacity to change with a wide variety of experiences, including injury. Although there are spontaneous reparative changes following injury, these changes are rarely sufficient to support significant functional recovery. Research on the basic principles of brain plasticity is leading to new approaches to treating the injured brain. We review factors that affect synaptic organization in the normal brain, evidence of spontaneous neuroplasticity after injury, and the evidence that factors including postinjury experience, pharmacotherapy, and cell-based therapies, can form the basis of rehabilitation strategies after brain injuries early in life and in adulthood.

PKC-mediated GABAergic enhancement of dopaminergic responses: implication for short-term potentiation at a dual-transmitter synapse

Transmitter-mediated homosynaptic potentiation is generally implemented by the same transmitter that mediates the excitatory postsynaptic potentials (EPSPs), e.g., glutamate. When a presynaptic neuron contains more than one transmitter, however, potentiation can in principle be implemented by a transmitter different from that which elicits the EPSPs. Neuron B20 in Aplysia contains both dopamine and GABA. Although only dopamine acts as the fast excitatory transmitter at the B20-to-B8 synapse, GABA increases the size of these dopaminergic EPSPs. We now provide evidence that repeated stimulation of B20 potentiates B20-evoked dopaminergic EPSPs in B8 apparently via a postsynaptic mechanism, and short-term potentiation of this synapse is critical for the establishment and maintenance of an egestive network state. We show that GABA can act postsynaptically to increase dopamine currents that are elicited by direct applications of dopamine to B8 and that dopamine is acting on a 5-HT3-like receptor. This potentiation is mediated by GABAB-like receptors as GABAB-receptor agonists and antagonists, respectively, mimicked and blocked the potentiating actions of GABA. The postsynaptic actions of GABA rely on a G protein-mediated activation of PKC. Our results suggest that the postsynaptic action of cotransmitter-mediated potentiation may contribute to the maintenance of the egestive state of Aplysia feeding network and, in more general terms, may participate in the plasticity of networks that mediate complex behaviors.

Rescue of tau-induced synaptic transmission pathology by paclitaxel

Behavioral and electrophysiological studies of Alzheimer’s disease (AD) and other tauopathies have revealed that the onset of cognitive decline correlates better with synaptic dysfunctions than with hallmark pathologies such as extracellular amyloid-β plaques, intracellular hyperphosphorylated tau or neuronal loss. Recent experiments have also demonstrated that anti-cancer microtubule (MT)-stabilizing drugs can rescue tau-induced behavioral decline and hallmark neuron pathologies. Nevertheless, the mechanisms underlying tau-induced synaptic dysfunction as well as those involved in the rescue of cognitive decline by MTs-stabilizing drugs remain unclear. Here we began to study these mechanisms using the glutaminergic sensory-motoneuron synapse derived from Aplysia ganglia, electrophysiological methods, the expression of mutant-human tau (mt-htau) either pre or postsynaptically and the antimitotic drug paclitaxel. Expression of mt-htau in the presynaptic neurons led to reduced excitatory postsynaptic potential (EPSP) amplitude generated by rested synapses within 3 days of mt-htau expression, and to deeper levels of homosynaptic depression. mt-htau-induced synaptic weakening correlated with reduced releasable presynaptic vesicle pools as revealed by the induction of asynchronous neurotransmitter release by hypertonic sucrose solution. Paclitaxel totally rescued tau-induced synaptic weakening by maintaining the availability of the presynaptic vesicle stores. Postsynaptic expression of mt-htau did not impair the above described synaptic-transmission parameters for up to 5 days. Along with earlier confocal microscope observations from our laboratory, these findings suggest that tau-induced synaptic dysfunction is the outcome of impaired axoplasmic transport and the ensuing reduction in the releasable presynaptic vesicle stores rather than the direct effects of mt-htau or paclitaxel on the synaptic release mechanisms.

Learning and memory in zebrafish larvae

Larval zebrafish possess several experimental advantages for investigating the molecular and neural bases of learning and memory. Despite this, neuroscientists have only recently begun to use these animals to study memory. However, in a relatively short period of time a number of forms of learning have been described in zebrafish larvae, and significant progress has been made toward their understanding. Here we provide a comprehensive review of this progress; we also describe several promising new experimental technologies currently being used in larval zebrafish that are likely to contribute major insights into the processes that underlie learning and memory.

Cellular, molecular, and epigenetic mechanisms in non-associative conditioning: implications for pain and memory

Sensitization is a form of non-associative conditioning in which amplification of behavioral responses can occur following presentation of an aversive or noxious stimulus. Understanding the cellular and molecular underpinnings of sensitization has been an overarching theme spanning the field of learning and memory as well as that of pain research. In this review we examine how sensitization, both in the context of learning as well as pain processing, shares evolutionarily conserved behavioral, cellular/synaptic, and epigenetic mechanisms across phyla. First, we characterize the behavioral phenomenon of sensitization both in invertebrates and vertebrates. Particular emphasis is placed on long-term sensitization (LTS) of withdrawal reflexes in Aplysia following aversive stimulation or injury, although additional invertebrate models are also covered. In the context of vertebrates, sensitization of mammalian hyperarousal in a model of post-traumatic stress disorder (PTSD), as well as mammalian models of inflammatory and neuropathic pain is characterized. Second, we investigate the cellular and synaptic mechanisms underlying these behaviors. We focus our discussion on serotonin-mediated long-term facilitation (LTF) and axotomy-mediated long-term hyperexcitability (LTH) in reduced Aplysia systems, as well as mammalian spinal plasticity mechanisms of central sensitization. Third, we explore recent evidence implicating epigenetic mechanisms in learning- and pain-related sensitization. This review illustrates the fundamental and functional overlay of the learning and memory field with the pain field which argues for homologous persistent plasticity mechanisms in response to sensitizing stimuli or injury across phyla.

Serotonin-induced cleavage of the atypical protein kinase C Apl III in Aplysia

A constitutively active kinase, known as protein kinase Mζ (PKMζ), is proposed to act as a long-lasting molecular memory trace. While PKMζ is formed in rodents through translation of a transcript initiating in an intron of the protein kinase Cζ (PKCζ) gene, this transcript does not exist in Aplysia californica despite the fact that inhibitors of PKMζ erase memory in Aplysia in a fashion similar to rodents. We have previously shown that, in Aplysia, the ortholog of PKCζ, PKC Apl III, is cleaved by calpain to form a PKM after overexpression of PKC Apl III. We now show that kinase activity is required for this cleavage. We further use a FRET reporter to measure cleavage of PKC Apl III into PKM Apl III in live neurons using a stimulus that induces plasticity. Our results show that a 10 min application of serotonin induces cleavage of PKC Apl III in motor neuron processes in a calpain- and protein synthesis-dependent manner, but does not induce cleavage of PKC Apl III in sensory neuron processes. Furthermore, a dominant-negative PKM Apl III expressed in the motor neuron blocked the late phase of intermediate-term facilitation in sensory-motor neuron cocultures induced by 10 min of serotonin. In summary, we provide evidence that PKC Apl III is cleaved into PKM Apl III during memory formation, that the requirements for cleavage are the same as the requirements for the plasticity, and that PKM in the motor neuron is required for intermediate-term facilitation.

Protein kinase M maintains long-term sensitization and long-term facilitation in aplysia

How the brain maintains long-term memories is one of the major outstanding questions in modern neuroscience. Evidence from mammalian studies indicates that activity of a protein kinase C (PKC) isoform, protein kinase Mζ (PKMζ), plays a critical role in the maintenance of long-term memory. But the range of memories whose persistence depends on PKMζ, and the mechanisms that underlie the effect of PKMζ on long-term memory, remain obscure. Recently, a PKM isoform, known as PKM Apl III, was cloned from the nervous system of Aplysia. Here, we tested whether PKM Apl III plays a critical role in long-term memory maintenance in Aplysia. Intrahemocoel injections of the pseudosubstrate inhibitory peptide ZIP (ζ inhibitory peptide) or the PKC inhibitor chelerythrine erased the memory for long-term sensitization (LTS) of the siphon-withdrawal reflex (SWR) as late as 7 d after training. In addition, both PKM inhibitors disrupted the maintenance of long-term (≥ 24 h) facilitation (LTF) of the sensorimotor synapse, a form of synaptic plasticity previously shown to mediate LTS of the SWR. Together with previous results (Bougie et al., 2009), our results support the idea that long-term memory in Aplysia is maintained via a positive-feedback loop involving PKM Apl III-dependent protein phosphorylation. The present data extend the known role of PKM in memory maintenance to a simple and well studied type of long-term learning. Furthermore, the demonstration that PKM activity underlies the persistence of LTF of the Aplysia sensorimotor synapse, a form of synaptic plasticity amenable to rigorous cellular and molecular analyses, should facilitate efforts to understand how PKM activity maintains memory.

Associative cortex features in the first olfactory brain relay station

Synchronized firing of mitral cells (MCs) in the olfactory bulb (OB) has been hypothesized to help bind information together in olfactory cortex (OC). In this survey of synchronized firing by suspected MCs in awake, behaving vertebrates, we find the surprising result that synchronized firing conveys information on odor value ("Is it rewarded?") rather than odor identity ("What is the odor?"). We observed that as mice learned to discriminate between odors, synchronous firing responses to the rewarded and unrewarded odors became divergent. Furthermore, adrenergic blockage decreases the magnitude of odor divergence of synchronous trains, suggesting that MCs contribute to decision-making through adrenergic-modulated synchronized firing. Thus, in the olfactory system information on stimulus reward is found in MCs one synapse away from the sensory neuron.

The NO-cGMP-PKG signaling pathway coordinately regulates ERK and ERK-driven gene expression at pre- and postsynaptic sites following LTP-inducing stimulation of thalamo-amygdala synapses

Long-term potentiation (LTP) at thalamic input synapses to the lateral nucleus of the amygdala (LA) has been proposed as a cellular mechanism of the formation of auditory fear memories. We have previously shown that signaling via ERK/MAPK in both the LA and the medial division of the medial geniculate nucleus/posterior intralaminar nucleus (MGm/PIN) is critical for LTP at thalamo-LA synapses. Here, we show that LTP-inducing stimulation of thalamo-LA inputs regulates the activation of ERK and the expression of ERK-driven immediate early genes (IEGs) in both the LA and MGm/PIN. Further, we show that pharmacological blockade of NMDAR-driven synaptic plasticity, NOS activation, or PKG signaling in the LA significantly impairs high-frequency stimulation-(HFS-) induced ERK activation and IEG expression in both regions, while blockade of extracellular NO signaling in the LA impairs HFS-induced ERK activation and IEG expression exclusively in the MGm/PIN. These findings suggest that NMDAR-driven synaptic plasticity and NO-cGMP-PKG signaling within the LA coordinately regulate ERK-driven gene expression in both the LA and the MGm/PIN following LTP induction at thalamo-LA synapses, and that synaptic plasticity in the LA promotes ERK-driven transcription in MGm/PIN neurons via NO-driven “retrograde signaling”.

Roles of aminergic neurons in formation and recall of associative memory in crickets

We review recent progress in the study of roles of octopaminergic (OA-ergic) and dopaminergic (DA-ergic) signaling in insect classical conditioning, focusing on our studies on crickets. Studies on olfactory learning in honey bees and fruit-flies have suggested that OA-ergic and DA-ergic neurons convey reinforcing signals of appetitive unconditioned stimulus (US) and aversive US, respectively. Our work suggested that this is applicable to olfactory, visual pattern, and color learning in crickets, indicating that this feature is ubiquitous in learning of various sensory stimuli. We also showed that aversive memory decayed much faster than did appetitive memory, and we proposed that this feature is common in insects and humans. Our study also suggested that activation of OA- or DA-ergic neurons is needed for appetitive or aversive memory recall, respectively. To account for this finding, we proposed a model in which it is assumed that two types of synaptic connections are strengthened by conditioning and are activated during memory recall, one type being connections from neurons representing conditioned stimulus (CS) to neurons inducing conditioned response and the other being connections from neurons representing CS to OA- or DA-ergic neurons representing appetitive or aversive US, respectively. The former is called stimulus–response (S–R) connection and the latter is called stimulus–stimulus (S–S) connection by theorists studying classical conditioning in vertebrates. Results of our studies using a second-order conditioning procedure supported our model. We propose that insect classical conditioning involves the formation of S–S connection and its activation for memory recall, which are often called cognitive processes.

Acute disruption of the NMDA receptor subunit NR1 in the honeybee brain selectively impairs memory formation

Memory formation is a continuous process composed of multiple phases that can develop independently from each other. These phases depend on signaling pathways initiated after the activation of receptors in different brain regions. The NMDA receptor acts as a sensor of coincident activity between neural inputs, and, as such, its activation during learning is thought to be crucial for various forms of memory. In this study, we inhibited the expression of the NR1 subunit of the NMDA receptor in the honeybee brain using RNA interference. We show that the disruption of the subunit expression in the mushroom body region of the honeybee brain during and shortly after appetitive learning selectively impaired memory. Although the formation of mid-term memory and early long-term memory was impaired, late long-term memory was left intact. This indicates that late long-term memory formation differs in its dependence on NMDA receptor activity from earlier memory phases.

AMPA receptor trafficking and learning

In the last few years it has become clear that AMPA-type glutamate neurotransmitter receptors are rapidly transported into and out of synapses to strengthen or weaken their function. The remarkable dynamics of AMPA receptor (AMPAR) synaptic localization provides a compelling mechanism for understanding the cellular basis of learning and memory, as well as disease states involving cognitive dysfunction. Here, we summarize the evidence for AMPAR trafficking as a mechanism underlying a variety of learned responses derived from both behavioral and cellular studies. Evidence is also reviewed supporting synaptic dysfunction related to impaired AMPAR trafficking as a mechanism underlying learning and memory deficits in Alzheimer's disease. We conclude that emerging data support the concept of multistage AMPAR trafficking during learning and that a broad approach to include examination of all of the AMPAR subunits will provide a more complete view of the mechanisms underlying multiple forms of learning.

Synaptic plasticity and NO-cGMP-PKG signaling regulate pre- and postsynaptic alterations at rat lateral amygdala synapses following fear conditioning

In vertebrate models of synaptic plasticity, signaling via the putative "retrograde messenger" nitric oxide (NO) has been hypothesized to serve as a critical link between functional and structural alterations at pre- and postsynaptic sites. In the present study, we show that auditory Pavlovian fear conditioning is associated with significant and long-lasting increases in the expression of the postsynaptically-localized protein GluR1 and the presynaptically-localized proteins synaptophysin and synapsin in the lateral amygdala (LA) within 24 hrs following training. Further, we show that rats given intra-LA infusion of either the NR2B-selective antagonist Ifenprodil, the NOS inhibitor 7-Ni, or the PKG inhibitor Rp-8-Br-PET-cGMPS exhibit significant decreases in training-induced expression of GluR1, synaptophysin, and synapsin immunoreactivity in the LA, while those rats infused with the PKG activator 8-Br-cGMP exhibit a significant increase in these proteins in the LA. In contrast, rats given intra-LA infusion of the NO scavenger c-PTIO exhibit a significant decrease in synapsin and synaptophysin expression in the LA, but no significant impairment in the expression of GluR1. Finally, we show that intra-LA infusions of the ROCK inhibitor Y-27632 or the CaMKII inhibitor KN-93 impair training-induced expression of GluR1, synapsin, and synaptophysin in the LA. These findings suggest that the NO-cGMP-PKG, Rho/ROCK, and CaMKII signaling pathways regulate fear memory consolidation, in part, by promoting both pre- and post-synaptic alterations at LA synapses. They further suggest that synaptic plasticity in the LA during auditory fear conditioning promotes alterations at presynaptic sites via NO-driven "retrograde signaling".

Presynaptic and postsynaptic mechanisms of synaptic plasticity and metaplasticity during intermediate-term memory formation in Aplysia

Synaptic plasticity and learning involve different mechanisms depending on the following: (1) the stage of plasticity and (2) the history of plasticity, or metaplasticity. However, little is known about how these two factors are related. We have addressed that question by examining mechanisms of synaptic plasticity during short-term and intermediate-term behavioral sensitization and dishabituation in a semi-intact preparation of the Aplysia siphon-withdrawal reflex. Dishabituation differs from sensitization in that it is preceded by habituation, and is thus a paradigm for metaplasticity. We find that whereas facilitation during short-term sensitization by one tail shock involves presynaptic covalent modifications by protein kinase A (PKA) and CamKII, facilitation during intermediate-term sensitization by four shocks involves both presynaptic (PKA, CaMKII) and postsynaptic (Ca(2+), CaMKII) covalent modifications, as well as both presynaptic and postsynaptic protein synthesis. The facilitation also involves presynaptic spike broadening 2.5 min after either one or four shocks, but not at later times. Dishabituation by four shocks differs from sensitization in several ways. First, it does not involve PKA or CaMKII, but rather involves presynaptic PKC. In addition, unlike sensitization with the same shock, dishabituation by four shocks does not involve protein synthesis or presynaptic spike broadening, and it also does not involve postsynaptic Ca(2+). These results demonstrate that not only the mechanisms but also the site of plasticity depend on both the stage of plasticity and metaplasticity during memory formation.

Synaptic plasticity and NO-cGMP-PKG signaling coordinately regulate ERK-driven gene expression in the lateral amygdala and in the auditory thalamus following Pavlovian fear conditioning

We have recently hypothesized that NO-cGMP-PKG signaling in the lateral nucleus of the amygdala (LA) during auditory fear conditioning coordinately regulates ERK-driven transcriptional changes in both auditory thalamic (MGm/PIN) and LA neurons that serve to promote pre- and postsynaptic alterations at thalamo-LA synapses, respectively. In the present series of experiments, we show that N-methyl-D-aspartate receptor (NMDAR)-driven synaptic plasticity and NO-cGMP-PKG signaling in the LA regulate the training-induced expression of ERK and the ERK-driven immediate early genes (IEGs) Arc/Arg3.1, c-Fos, and EGR-1 in the LA and the MGm/PIN. Rats receiving intra-LA infusion of the NR2B selective antagonist Ifenprodil, the NOS inhibitor 7-Ni, or the PKG inhibitor Rp-8-Br-PET-cGMPS exhibited significant decreases in ERK activation and in the training-induced expression of all three IEGs in the LA and MGm/PIN while intra-LA infusion of the PKG activator 8-Br-cGMP had the opposite effect. Remarkably, those rats given intra-LA infusion of the membrane impermeable NO scavenger c-PTIO exhibited significant decreases in ERK activation and ERK-driven IEG expression in the MGm/PIN, but not in the LA. Together with our previous experiments, these results suggest that synaptic plasticity and the NO-cGMP-PKG signaling pathway promote fear memory consolidation, in part, by regulating ERK-driven transcription in both the LA and the MGm/PIN. They further suggest that synaptic plasticity in the LA during fear conditioning promotes ERK-driven transcription in MGm/PIN neurons via NO-driven "retrograde signaling."

Imaging and analysis of evoked excitatory-postsynaptic-calcium-transients by individual presynaptic-boutons of cultured Aplysia sensorimotor synapse

The use of the sensory-motor (SN-MN) synapse of the Aplysia gill withdrawal reflex has contributed immensely to the understanding of synaptic transmission, learning and memory acquisition processes. Whereas the majority of the studies focused on analysis of the presynaptic mechanisms, recent studies indicated that as in mammalian synapses, long term potentiation (LTP) formed by Aplysia SN-MN synapse depends on elevation of the postsynaptic free intracellular calcium concentration ([Ca2+](i)). Consistently, injection of the fast calcium chelator BAPTA to the MN prevents the formation of serotonin-induced LTP. Nevertheless, currently there are no published reports that directly examine and document whether evoked synaptic transmission is associated with transient increase in the postsynaptic [Ca2+](i). In the present study we imaged, for the first time, alterations in the postsynaptic [Ca2+](i) in response to presynaptic stimulation and analyzed the underlying mechanisms. Using live imaging of the postsynaptic [Ca2+](i) while monitoring the EPSP, we found that evoked transmitter release generates excitatory postsynaptic calcium concentration transients (EPSCaTs) by two mechanisms: (a) activation of DNQX-sensitive postsynaptic receptors-gated calcium influx and (b) calcium influx through nitrendipine-sensitive voltage-gated calcium channels (VGCCs). Concomitant confocal imaging of presynaptic boutons and EPSCaTs revealed that approximately 86% of the presynaptic boutons are associated with functional synapses.

Spinal NMDA receptor activation is necessary for de novo, but not the maintenance of, A2a receptor-mediated phrenic motor facilitation

Adenosine 2a (A2a) receptor agonists elicit persistent increases in phrenic nerve activity by transactivating the neurotrophin receptor, TrkB, near phrenic motoneurons. Our working model proposes that A2a receptor-mediated TrkB receptor activation strengthens glutamatergic synapses onto phrenic motoneurons. Activation of glutamate N-methyl d-aspartate (NMDA) receptors has been implicated in other models of phrenic motor plasticity. Thus we hypothesized that NMDA receptor activation also would contribute to A2a receptor-mediated phrenic motor facilitation. Adult male Sprague-Dawley rats were anesthetized with urethane, mechanically ventilated, neuromuscularly paralyzed, and bilaterally vagotomized. The A2a receptor agonist CGS-21680 and the NMDA receptor-channel blocker MK-801 were administered intrathecally over the C4 spinal segment. Phrenic nerve activity was recorded before, during, and after drug administration. MK-801 (concentration range 0.1, 1.0, 10.0, and 100 microM) was administered 30 min before CGS-21680 (50 microM). MK-801 dose-dependently blocked A2a receptor-mediated phrenic motor facilitation. When administered at 60 min post-CGS-21680, MK-801 prevented further increases in phrenic nerve activity compared with the CGS-21680 alone (CGS-21680 alone at 120 min: 114 +/- 19%; CGS-21680 and MK-801 at 60 min post-CGS-21680: 61 +/- 11%, above baseline, P < 0.05) but did not return phrenic motor output to baseline values. Our data suggest that NMDA receptor activation is necessary for de novo A2a receptor-mediated phrenic motor facilitation and that the maintenance of preexisting phrenic motor facilitation does not involve NMDA receptor-dependent mechanisms.