1
|
Bédécarrats A, Simmers J, Nargeot R. Sodium-mediated plateau potentials in an identified decisional neuron contribute to feeding-related motor pattern genesis in Aplysia. Front Neural Circuits 2023; 17:1200902. [PMID: 37361713 PMCID: PMC10288323 DOI: 10.3389/fncir.2023.1200902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Accepted: 05/23/2023] [Indexed: 06/28/2023] Open
Abstract
Motivated behaviors such as feeding depend on the functional properties of decision neurons to provide the flexibility required for behavioral adaptation. Here, we analyzed the ionic basis of the endogenous membrane properties of an identified decision neuron (B63) that drive radula biting cycles underlying food-seeking behavior in Aplysia. Each spontaneous bite cycle arises from the irregular triggering of a plateau-like potential and resultant bursting by rhythmic subthreshold oscillations in B63's membrane potential. In isolated buccal ganglion preparations, and after synaptic isolation, the expression of B63's plateau potentials persisted after removal of extracellular calcium, but was completely suppressed in a tetrodotoxin (TTX)- containing bath solution, thereby indicating the contribution of a transmembrane Na+ influx. Potassium outward efflux through tetraethylammonium (TEA)- and calcium-sensitive channels was found to contribute to each plateau's active termination. This intrinsic plateauing capability, in contrast to B63's membrane potential oscillation, was blocked by the calcium-activated non-specific cationic current (ICAN) blocker flufenamic acid (FFA). Conversely, the SERCA blocker cyclopianozic acid (CPA), which abolished the neuron's oscillation, did not prevent the expression of experimentally evoked plateau potentials. These results therefore indicate that the dynamic properties of the decision neuron B63 rely on two distinct mechanisms involving different sub-populations of ionic conductances.
Collapse
|
2
|
Sun J, Wang Y, Liu P, Wang Y. Memristor Neural Network Circuit Based on Operant Conditioning With Immediacy and Satiety. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2022; 16:1095-1105. [PMID: 36264735 DOI: 10.1109/tbcas.2022.3216112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Most of the operant conditioning only consider the basic theory, but the influencing factors such as immediacy and satiety are ignored. In this paper, a memristor neural network circuit based on operant conditioning with immediacy and satiety is proposed. The designed circuit is mainly composed of voltage control modules, synapse modules and promotion-suppression modules. The various processes of operant conditioning theory are realized. The relationship between positive reward and negative punishment is implemented through promotion-suppression modules and synapse modules. The influence of immediacy on operant conditioning is achieved through voltage control module. The effect of satiety on operant conditioning is discussed using memristive non-volatility. The study of operant conditioning may provide a reference for smarter brain-like nerves.
Collapse
|
3
|
Abstract
This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.
Collapse
|
4
|
Momohara Y, Neveu CL, Chen HM, Baxter DA, Byrne JH. Specific Plasticity Loci and Their Synergism Mediate Operant Conditioning. J Neurosci 2022; 42:1211-1223. [PMID: 34992131 PMCID: PMC8883845 DOI: 10.1523/jneurosci.1722-21.2021] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 09/26/2021] [Accepted: 12/03/2021] [Indexed: 11/21/2022] Open
Abstract
Despite numerous studies examining the mechanisms of operant conditioning (OC), the diversity of OC plasticity loci and their synergism have not been examined sufficiently. In the well-characterized feeding neural circuit of Aplysia, in vivo and in vitro appetitive OC increases neuronal excitability and electrical coupling among several neurons leading to an increase in expression of ingestive behavior. Here, we used the in vitro analog of OC to investigate whether OC reduces the excitability of a neuron, B4, whose inhibitory connections decrease expression of ingestive behavior. We found OC decreased the excitability of B4. This change appeared intrinsic to B4 because it could be replicated with an analog of OC in isolated cultures of B4 neurons. In addition to changes in B4 excitability, OC decreased the strength of B4's inhibitory connection to a key decision-making neuron, B51. The OC-induced changes were specific without affecting the excitability of another neuron critical for feeding behavior, B8, or the B4-to-B8 inhibitory connection. A conductance-based circuit model indicated that reducing the B4-to-B51 synapse, or increasing B51 excitability, mediated the OC phenotype more effectively than did decreasing B4 excitability. We combined these modifications to examine whether they could act synergistically. Combinations including B51 synergistically enhanced feeding. Taken together, these results suggest modifications of diverse loci work synergistically to mediate OC and that some neurons are well suited to work synergistically with plasticity in other loci.SIGNIFICANCE STATEMENT The ways in which synergism of diverse plasticity loci mediate the change in motor patterns in operant conditioning (OC) are poorly understood. Here, we found that OC was in part mediated by decreasing the intrinsic excitability of a critical neuron of Aplysia feeding behavior, and specifically reducing the strength of one of its inhibitory connections that targets a key decision-making neuron. A conductance-based computational model indicated that the known plasticity loci showed a surprising level of synergism to mediate the behavioral changes associated with OC. These results highlight the importance of understanding the diversity, specificity and synergy among different types of plasticity that encode memory. Also, because OC in Aplysia is mediated by dopamine (DA), the present study provides insights into specific and synergistic mechanisms of DA-mediated reinforcement of behaviors.
Collapse
Affiliation(s)
- Yuto Momohara
- Department of Neurobiology and Anatomy, W.M. Keck Center for the Neurobiology of Learning and Memory, McGovern Medical School at the, University of Texas Health Science Center, Houston, Texas 77030
| | - Curtis L Neveu
- Department of Neurobiology and Anatomy, W.M. Keck Center for the Neurobiology of Learning and Memory, McGovern Medical School at the, University of Texas Health Science Center, Houston, Texas 77030
| | - Hsin-Mei Chen
- Department of Neurobiology and Anatomy, W.M. Keck Center for the Neurobiology of Learning and Memory, McGovern Medical School at the, University of Texas Health Science Center, Houston, Texas 77030
- Center for Nursing Research, Education and Practice, Houston Methodist Academic Institute, Houston, Texas 77030
| | - Douglas A Baxter
- Department of Neurobiology and Anatomy, W.M. Keck Center for the Neurobiology of Learning and Memory, McGovern Medical School at the, University of Texas Health Science Center, Houston, Texas 77030
- Engineering Medicine (ENMED), Texas A&M University College of Medicine, Houston, Texas 77030
| | - John H Byrne
- Department of Neurobiology and Anatomy, W.M. Keck Center for the Neurobiology of Learning and Memory, McGovern Medical School at the, University of Texas Health Science Center, Houston, Texas 77030
| |
Collapse
|
5
|
Costa RM, Baxter DA, Byrne JH. Neuronal population activity dynamics reveal a low-dimensional signature of operant learning in Aplysia. Commun Biol 2022; 5:90. [PMID: 35075264 PMCID: PMC8786933 DOI: 10.1038/s42003-022-03044-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Accepted: 01/07/2022] [Indexed: 11/24/2022] Open
Abstract
Learning engages a high-dimensional neuronal population space spanning multiple brain regions. However, it remains unknown whether it is possible to identify a low-dimensional signature associated with operant conditioning, a ubiquitous form of learning in which animals learn from the consequences of behavior. Using single-neuron resolution voltage imaging, here we identify two low-dimensional motor modules in the neuronal population underlying Aplysia feeding. Our findings point to a temporal shift in module recruitment as the primary signature of operant learning. Our findings can help guide characterization of learning signatures in systems in which only a smaller fraction of the relevant neuronal population can be monitored. Costa et al. use single-neuron resolution voltage imaging to identify two low-dimensional motor modules in the neuronal population underlying Aplysia feeding. Their findings point to a temporal shift in module recruitment as the primary signature of operant learning.
Collapse
|
6
|
Wiggin TD, Hsiao Y, Liu JB, Huber R, Griffith LC. Rest Is Required to Learn an Appetitively-Reinforced Operant Task in Drosophila. Front Behav Neurosci 2021; 15:681593. [PMID: 34220464 PMCID: PMC8250850 DOI: 10.3389/fnbeh.2021.681593] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Accepted: 05/21/2021] [Indexed: 11/13/2022] Open
Abstract
Maladaptive operant conditioning contributes to development of neuropsychiatric disorders. Candidate genes have been identified that contribute to this maladaptive plasticity, but the neural basis of operant conditioning in genetic model organisms remains poorly understood. The fruit fly Drosophila melanogaster is a versatile genetic model organism that readily forms operant associations with punishment stimuli. However, operant conditioning with a food reward has not been demonstrated in flies, limiting the types of neural circuits that can be studied. Here we present the first sucrose-reinforced operant conditioning paradigm for flies. In the paradigm, flies walk along a Y-shaped track with reward locations at the terminus of each hallway. When flies turn in the reinforced direction at the center of the track, they receive a sucrose reward at the end of the hallway. Only flies that rest early in training learn the reward contingency normally. Flies rewarded independently of their behavior do not form a learned association but have the same amount of rest as trained flies, showing that rest is not driven by learning. Optogenetically-induced sleep does not promote learning, indicating that sleep itself is not sufficient for learning the operant task. We validated the sensitivity of this assay to detect the effect of genetic manipulations by testing the classic learning mutant dunce. Dunce flies are learning-impaired in the Y-Track task, indicating a likely role for cAMP in the operant coincidence detector. This novel training paradigm will provide valuable insight into the molecular mechanisms of disease and the link between sleep and learning.
Collapse
Affiliation(s)
- Timothy D. Wiggin
- Department of Biology, National Center for Behavioral Genomics and Volen Center for Complex Systems, Brandeis University, Waltham, MA, United States
| | - Yungyi Hsiao
- Department of Biology, National Center for Behavioral Genomics and Volen Center for Complex Systems, Brandeis University, Waltham, MA, United States
| | - Jeffrey B. Liu
- Department of Biology, National Center for Behavioral Genomics and Volen Center for Complex Systems, Brandeis University, Waltham, MA, United States
| | - Robert Huber
- Radcliffe Institute for Advanced Studies, Harvard University, Cambridge, MA, United States
- Juvatech, Toledo, MA, United States
| | - Leslie C. Griffith
- Department of Biology, National Center for Behavioral Genomics and Volen Center for Complex Systems, Brandeis University, Waltham, MA, United States
| |
Collapse
|
7
|
Miller MW. Dopamine as a Multifunctional Neurotransmitter in Gastropod Molluscs: An Evolutionary Hypothesis. THE BIOLOGICAL BULLETIN 2020; 239:189-208. [PMID: 33347799 PMCID: PMC8016498 DOI: 10.1086/711293] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
AbstractThe catecholamine 3,4-dihydroxyphenethylamine, or dopamine, acts as a neurotransmitter across a broad phylogenetic spectrum. Functions attributed to dopamine in the mammalian brain include regulation of motor circuits, valuation of sensory stimuli, and mediation of reward or reinforcement signals. Considerable evidence also supports a neurotransmitter role for dopamine in gastropod molluscs, and there is growing appreciation for its potential common functions across phylogeny. This article reviews evidence for dopamine's transmitter role in the nervous systems of gastropods. The functional properties of identified dopaminergic neurons in well-characterized neural circuits suggest a hypothetical incremental sequence by which dopamine accumulated its diverse roles. The successive acquisition of dopamine functions is proposed in the context of gastropod feeding behavior: (1) sensation of potential nutrients, (2) activation of motor circuits, (3) selection of motor patterns from multifunctional circuits, (4) valuation of sensory stimuli with reference to internal state, (5) association of motor programs with their outcomes, and (6) coincidence detection between sensory stimuli and their consequences. At each stage of this sequence, it is proposed that existing functions of dopaminergic neurons favored their recruitment to fulfill additional information processing demands. Common functions of dopamine in other intensively studied groups, ranging from mammals and insects to nematodes, suggest an ancient origin for this progression.
Collapse
|
8
|
Gassen J, Mengelkoch S, Bradshaw HK, Hill SE. Does the Punishment Fit the Crime (and Immune System)? A Potential Role for the Immune System in Regulating Punishment Sensitivity. Front Psychol 2020; 11:1263. [PMID: 32655448 PMCID: PMC7323590 DOI: 10.3389/fpsyg.2020.01263] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2019] [Accepted: 05/14/2020] [Indexed: 12/23/2022] Open
Abstract
Although the criminal justice system is designed around the idea that individuals are invariant in their responses to punishment, research indicates that individuals exhibit a tremendous amount of variability in their punishment sensitivity. This raises the question of why; what are the individual- and situation-level variables that impact a person’s sensitivity to punishment? In the current research, we synthesize theory and research on inflammation, learning, and evolutionary biology to examine the relationship between inflammatory activity and sensitivity to punishment. These theories combine to predict that inflammatory activity – which is metabolically costly and reflects a context in which the net payoff associated with future oriented behaviors is diminished – will decrease sensitivity to punishment, but not rewards. Consistent with this hypothesis, Study 1 found that in U.S. states with a higher infectious disease burden (a proxy for average levels of inflammatory activity) exhibit harsher sentencing in their criminal justice systems. Studies 2 and 3 experimentally manipulated variables known to impact bodily inflammatory activity and measured subsequent punishment and reward sensitivity using a probabilistic selection task. Results revealed that (a) increasing inflammation (i.e., completing the study in a dirty vs. clean room) diminished punishment sensitivity (Study 2), whereby (b) administering a non-steroidal anti-inflammatory drug, suppressing inflammatory activity, enhanced it. No such changes were found for reward sensitivity. Together, these results provide evidence of a link between the activities of the immune system and punishment sensitivity, which may have implications for criminal justice outcomes.
Collapse
Affiliation(s)
- Jeffrey Gassen
- Department of Psychology, Texas Christian University, Fort Worth, TX, United States
| | - Summer Mengelkoch
- Department of Psychology, Texas Christian University, Fort Worth, TX, United States
| | - Hannah K Bradshaw
- Department of Psychology, Texas Christian University, Fort Worth, TX, United States
| | - Sarah E Hill
- Department of Psychology, Texas Christian University, Fort Worth, TX, United States
| |
Collapse
|
9
|
Costa RM, Baxter DA, Byrne JH. Computational model of the distributed representation of operant reward memory: combinatoric engagement of intrinsic and synaptic plasticity mechanisms. ACTA ACUST UNITED AC 2020; 27:236-249. [PMID: 32414941 PMCID: PMC7233148 DOI: 10.1101/lm.051367.120] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2020] [Accepted: 02/13/2020] [Indexed: 01/15/2023]
Abstract
Operant reward learning of feeding behavior in Aplysia increases the frequency and regularity of biting, as well as biases buccal motor patterns (BMPs) toward ingestion-like BMPs (iBMPs). The engram underlying this memory comprises cells that are part of a central pattern generating (CPG) circuit and includes increases in the intrinsic excitability of identified cells B30, B51, B63, and B65, and increases in B63-B30 and B63-B65 electrical synaptic coupling. To examine the ways in which sites of plasticity (individually and in combination) contribute to memory expression, a model of the CPG was developed. The model included conductance-based descriptions of cells CBI-2, B4, B8, B20, B30, B31, B34, B40, B51, B52, B63, B64, and B65, and their synaptic connections. The model generated patterned activity that resembled physiological BMPs, and implementation of the engram reproduced increases in frequency, regularity, and bias. Combined enhancement of B30, B63, and B65 excitabilities increased BMP frequency and regularity, but not bias toward iBMPs. Individually, B30 increased regularity and bias, B51 increased bias, B63 increased frequency, and B65 decreased all three BMP features. Combined synaptic plasticity contributed primarily to regularity, but also to frequency and bias. B63-B30 coupling contributed to regularity and bias, and B63-B65 coupling contributed to all BMP features. Each site of plasticity altered multiple BMP features simultaneously. Moreover, plasticity loci exhibited mutual dependence and synergism. These results indicate that the memory for operant reward learning emerged from the combinatoric engagement of multiple sites of plasticity.
Collapse
Affiliation(s)
- Renan M Costa
- Keck Center for the Neurobiology of Learning and Memory, Department of Neurobiology and Anatomy, McGovern Medical School at The University of Texas Health Science Center at Houston, Houston, Texas 77030, USA.,MD Anderson UTHealth Graduate School of Biomedical Sciences, Houston, Texas 77030, USA
| | - Douglas A Baxter
- Keck Center for the Neurobiology of Learning and Memory, Department of Neurobiology and Anatomy, McGovern Medical School at The University of Texas Health Science Center at Houston, Houston, Texas 77030, USA.,Engineering in Medicine (EnMed), Texas A&M Health Science Center-Houston, Houston, Texas 77030, USA
| | - John H Byrne
- Keck Center for the Neurobiology of Learning and Memory, Department of Neurobiology and Anatomy, McGovern Medical School at The University of Texas Health Science Center at Houston, Houston, Texas 77030, USA.,MD Anderson UTHealth Graduate School of Biomedical Sciences, Houston, Texas 77030, USA
| |
Collapse
|
10
|
Yang W, Meng Y, Li D, Wen Q. Visual Contrast Modulates Operant Learning Responses in Larval Zebrafish. Front Behav Neurosci 2019; 13:4. [PMID: 30733672 PMCID: PMC6353835 DOI: 10.3389/fnbeh.2019.00004] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2018] [Accepted: 01/07/2019] [Indexed: 12/24/2022] Open
Abstract
The larval zebrafish is a promising vertebrate model organism to study neural mechanisms underlying learning and memory due to its small brain and rich behavioral repertoire. Here, we report on a high-throughput operant conditioning system for zebrafish larvae, which can simultaneously train 12 fish to associate a visual conditioned pattern with electroshocks. We find that the learning responses can be enhanced by the visual contrast, not the spatial features of the conditioned patterns, highlighted by several behavioral metrics. By further characterizing the learning curves as well as memory extinction, we demonstrate that the percentage of learners and the memory length increase as the conditioned pattern becomes darker. Finally, little difference in operant learning responses was found between AB wild-type fish and elavl3:H2B-GCaMP6f transgenic fish.
Collapse
Affiliation(s)
- Wenbin Yang
- Hefei National Laboratory for Physical Sciences at the Microscale, Center for Integrative Imaging, School of Life Sciences, University of Science and Technology of China, Hefei, China
- Chinese Academy of Sciences Key Laboratory of Brain Function and Disease, Hefei, China
| | - Yutong Meng
- Hefei National Laboratory for Physical Sciences at the Microscale, Center for Integrative Imaging, School of Life Sciences, University of Science and Technology of China, Hefei, China
- Chinese Academy of Sciences Key Laboratory of Brain Function and Disease, Hefei, China
| | - Danyang Li
- Hefei National Laboratory for Physical Sciences at the Microscale, Center for Integrative Imaging, School of Life Sciences, University of Science and Technology of China, Hefei, China
- Chinese Academy of Sciences Key Laboratory of Brain Function and Disease, Hefei, China
| | - Quan Wen
- Hefei National Laboratory for Physical Sciences at the Microscale, Center for Integrative Imaging, School of Life Sciences, University of Science and Technology of China, Hefei, China
- Chinese Academy of Sciences Key Laboratory of Brain Function and Disease, Hefei, China
- Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| |
Collapse
|
11
|
Wei T, Webb B. A model of operant learning based on chaotically varying synaptic strength. Neural Netw 2018; 108:114-127. [PMID: 30176514 DOI: 10.1016/j.neunet.2018.08.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2018] [Revised: 07/12/2018] [Accepted: 08/02/2018] [Indexed: 11/17/2022]
Abstract
Operant learning is learning based on reinforcement of behaviours. We propose a new hypothesis for operant learning at the single neuron level based on spontaneous fluctuations of synaptic strength caused by receptor dynamics. These fluctuations allow the neural system to explore a space of outputs. If the receptor dynamics are altered by a reinforcement signal the neural system settles to better states, i.e., to match the environmental dynamics that determine reward. Simulations show that this mechanism can support operant learning in a feed-forward neural circuit, a recurrent neural circuit, and a spiking neural circuit controlling an agent learning in a dynamic reward and punishment situation. We discuss how the new principle relates to existing learning rules and observed phenomena of short and long-term potentiation.
Collapse
Affiliation(s)
- Tianqi Wei
- School of Informatics, University of Edinburgh, 10 Crichton Street, Edinburgh, EH8 9AB, United Kingdom; School of Engineering, University of Edinburgh, King's Buildings, Alexander Crum Brown Road, Edinburgh, EH9 3FF, United Kingdom.
| | - Barbara Webb
- School of Informatics, University of Edinburgh, 10 Crichton Street, Edinburgh, EH8 9AB, United Kingdom
| |
Collapse
|
12
|
Nishijima S, Maruyama IN. Appetitive Olfactory Learning and Long-Term Associative Memory in Caenorhabditis elegans. Front Behav Neurosci 2017; 11:80. [PMID: 28507513 PMCID: PMC5410607 DOI: 10.3389/fnbeh.2017.00080] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2016] [Accepted: 04/13/2017] [Indexed: 01/06/2023] Open
Abstract
Because of the relative simplicity of its nervous system, Caenorhabditis elegans is a useful model organism to study learning and memory at cellular and molecular levels. For appetitive conditioning in C. elegans, food has exclusively been used as an unconditioned stimulus (US). It may be difficult to analyze neuronal circuits for associative memory since food is a multimodal combination of olfactory, gustatory, and mechanical stimuli. Here, we report classical appetitive conditioning and associative memory in C. elegans, using 1-nonanol as a conditioned stimulus (CS), and potassium chloride (KCl) as a US. Before conditioning, C. elegans innately avoided 1-nonanol, an aversive olfactory stimulus, and was attracted by KCl, an appetitive gustatory stimulus, on assay agar plates. Both massed training without an intertrial interval (ITI) and spaced training with a 10-min ITI induced significant levels of memory of association regarding the two chemicals. Memory induced by massed training decayed within 6 h, while that induced by spaced training was retained for more than 6 h. Animals treated with inhibitors of transcription or translation formed the memory induced by spaced training less efficiently than untreated animals, whereas the memory induced by massed training was not significantly affected by such treatments. By definition, therefore, memories induced by massed training and spaced training are classified as short-term memory (STM) and long-term memory (LTM), respectively. When animals conditioned by spaced training were exposed to 1-nonanol alone, their learning index was lower than that of untreated animals, suggesting that extinction learning occurs in C. elegans. In support of these results, C. elegans mutants defective in nmr-1, encoding an NMDA receptor subunit, formed both STM and LTM less efficiently than wild-type animals, while mutations in crh-1, encoding a ubiquitous transcription factor CREB required for memory consolidation, affected LTM, but not STM. The paradigm established in the present study should allow us to elucidate neuronal circuit plasticity for appetitive learning and memory in C. elegans.
Collapse
Affiliation(s)
| | - Ichiro N. Maruyama
- Information Processing Biology Unit, Okinawa Institute of Science and Technology Graduate UniversityOkinawa, Japan
| |
Collapse
|
13
|
Vandepas LE, Warren KJ, Amemiya CT, Browne WE. Establishing and maintaining primary cell cultures derived from the ctenophore Mnemiopsis leidyi. ACTA ACUST UNITED AC 2017; 220:1197-1201. [PMID: 28137975 DOI: 10.1242/jeb.152371] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2016] [Accepted: 01/24/2017] [Indexed: 01/20/2023]
Abstract
We have developed an efficient method for the preparation and maintenance of primary cell cultures isolated from adult Mnemiopsis leidyi, a lobate ctenophore. Our primary cell cultures are derived from tissue explants or enzymatically dissociated cells, and maintained in a complex undefined ctenophore mesogleal serum. These methods can be used to isolate, maintain and visually monitor ctenophore cells to assess proliferation, cellular morphology and cell differentiation in future studies. Exemplar cell types that can be easily isolated from primary cultures include proliferative ectodermal and endodermal cells, motile amebocyte-like cells, and giant smooth muscle cells that exhibit inducible contractile properties. We have also derived 'tissue envelopes' containing sections of endodermal canal surrounded by mesoglea and ectoderm that can be used to monitor targeted cell types in an in vivo context. Access to efficient and reliably generated primary cell cultures will facilitate the analysis of ctenophore development, physiology and morphology from a cell biological perspective.
Collapse
Affiliation(s)
- Lauren E Vandepas
- Department of Biology, University of Washington, Seattle, WA 98195, USA
| | - Kaitlyn J Warren
- Department of Biology, University of Miami, Coral Gables, FL 33146, USA
| | - Chris T Amemiya
- Department of Biology, University of Washington, Seattle, WA 98195, USA.,Benaroya Research Institute at Virginia Mason, Seattle, WA 98101, USA
| | - William E Browne
- Department of Biology, University of Miami, Coral Gables, FL 33146, USA
| |
Collapse
|
14
|
Differential role of calpain-dependent protein cleavage in intermediate and long-term operant memory in Aplysia. Neurobiol Learn Mem 2016; 137:134-141. [PMID: 27913293 DOI: 10.1016/j.nlm.2016.11.018] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2016] [Revised: 11/28/2016] [Accepted: 11/29/2016] [Indexed: 01/06/2023]
Abstract
In addition to protein synthesis, protein degradation or protein cleavage may be necessary for intermediate (ITM) and long-term memory (LTM) to remove molecular constraints, facilitate persistent kinase activity and modulate synaptic plasticity. Calpains, a family of conserved calcium dependent cysteine proteases, modulate synaptic function through protein cleavage. We used the marine mollusk Aplysia californica to investigate the in vivo role of calpains during intermediate and long-term operant memory formation using the learning that food is inedible (LFI) paradigm. A single LFI training session, in which the animal associates a specific netted seaweed with the failure to swallow, generates short (30min), intermediate (4-6h) and long-term (24h) memory. Using the calpain inhibitors calpeptin and MDL-28170, we found that ITM requires calpain activity for induction and consolidation similar to the previously reported requirements for persistent protein kinase C activity in intermediate-term LFI memory. The induction of LTM also required calpain activity. In contrast to ITM, calpain activity was not necessary for the molecular consolidation of LTM. Surprisingly, six hours after LFI training we found that calpain activity was necessary for LTM, although this is a time at which neither persistent PKC activity nor protein synthesis is required for the maintenance of long-term LFI memory. These results demonstrate that calpains function in multiple roles in vivo during associative memory formation.
Collapse
|
15
|
Lane BJ, Samarth P, Ransdell JL, Nair SS, Schulz DJ. Synergistic plasticity of intrinsic conductance and electrical coupling restores synchrony in an intact motor network. eLife 2016; 5. [PMID: 27552052 PMCID: PMC5026470 DOI: 10.7554/elife.16879] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2016] [Accepted: 08/22/2016] [Indexed: 01/12/2023] Open
Abstract
Motor neurons of the crustacean cardiac ganglion generate virtually identical, synchronized output despite the fact that each neuron uses distinct conductance magnitudes. As a result of this variability, manipulations that target ionic conductances have distinct effects on neurons within the same ganglion, disrupting synchronized motor neuron output that is necessary for proper cardiac function. We hypothesized that robustness in network output is accomplished via plasticity that counters such destabilizing influences. By blocking high-threshold K+ conductances in motor neurons within the ongoing cardiac network, we discovered that compensation both resynchronized the network and helped restore excitability. Using model findings to guide experimentation, we determined that compensatory increases of both GA and electrical coupling restored function in the network. This is one of the first direct demonstrations of the physiological regulation of coupling conductance in a compensatory context, and of synergistic plasticity across cell- and network-level mechanisms in the restoration of output. DOI:http://dx.doi.org/10.7554/eLife.16879.001 Neurons can communicate with each other by releasing chemicals called neurotransmitters, or by forming direct connections with each other known as gap junctions. These direct connections allow electrical impulses to flow from one neuron to another via pores in the membranes between the cells. Unlike communication via neurotransmitters, gap junctions are usually thought to be hard-wired and unchanging over the life of the animal. Lane et al. recorded electrical activity in a network of neurons that generates rhythmic heart contractions in the Jonah crab. Neurons in this network usually all fire an electrical impulse at the same time, which is crucial to make sure that the whole heart contracts at the same time. The experiments show that drugs that block potassium channel pores in the membrane cause the neurons to fire too much and at different times to each other. However, the network of neurons soon adapted to the changes caused by the drugs and returned to working as normal. Mimicking these changes in a computer model of the neuron network, together with experimental data, showed that changes to the gap junctions play a major role in restoring normal activity to the network. The next step following on from this research is to understand how a network of neurons ‘senses’ that it is not working normally and changes its electrical activity. DOI:http://dx.doi.org/10.7554/eLife.16879.002
Collapse
Affiliation(s)
- Brian J Lane
- Division of Biological Sciences, University of Missouri-Columbia, Columbia, United States
| | - Pranit Samarth
- Department of Electrical and Computer Engineering, University of Missouri-Columbia, Columbia, United States
| | - Joseph L Ransdell
- Division of Biological Sciences, University of Missouri-Columbia, Columbia, United States
| | - Satish S Nair
- Department of Electrical and Computer Engineering, University of Missouri-Columbia, Columbia, United States
| | - David J Schulz
- Division of Biological Sciences, University of Missouri-Columbia, Columbia, United States
| |
Collapse
|
16
|
Carrigan ID, Croll RP, Wyeth RC. Morphology, innervation, and peripheral sensory cells of the siphon ofaplysia californica. J Comp Neurol 2015; 523:2409-25. [DOI: 10.1002/cne.23795] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2014] [Revised: 04/05/2015] [Accepted: 04/14/2015] [Indexed: 11/11/2022]
Affiliation(s)
- Ian D. Carrigan
- Department of Biology; St. Francis Xavier University; Antigonish Nova Scotia B2G 2W5 Canada
| | - Roger P. Croll
- Department of Physiology and Biophysics; Dalhousie University; Halifax NS B3H 4R2 Canada
| | - Russell C. Wyeth
- Department of Biology; St. Francis Xavier University; Antigonish Nova Scotia B2G 2W5 Canada
| |
Collapse
|
17
|
Phylogenetic and individual variation in gastropod central pattern generators. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 2015; 201:829-39. [PMID: 25837447 DOI: 10.1007/s00359-015-1007-6] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2014] [Revised: 02/28/2015] [Accepted: 03/24/2015] [Indexed: 10/23/2022]
Abstract
Gastropod molluscs provide a unique opportunity to explore the neural basis of rhythmic behaviors because of the accessibility of their nervous systems and the number of species that have been examined. Detailed comparisons of the central pattern generators (CPGs) underlying rhythmic feeding and swimming behaviors highlight the presence and effects of variation in neural circuits both across and within species. The feeding motor pattern of the snail, Lymnaea, is stereotyped, whereas the feeding motor pattern in the sea hare, Aplysia, is variable. However, the Aplysia motor pattern is regularized with operant conditioning or by mimicking learning using the dynamic clamp to change properties of CPG neurons. Swimming evolved repeatedly in marine gastropods. Distinct neural mechanisms underlie dissimilar forms of swimming, with homologous neurons playing different roles. However, even similar swimming behaviors in different species can be produced by distinct neural mechanisms, resulting from different synaptic connectivity of homologous neurons. Within a species, there can be variation in the strength and even valence of synapses, which does not have functional relevance under normal conditions, but can cause some individuals to be more susceptible to lesion of the circuit. This inter- and intra-species variation provides novel insights into CPG function and plasticity.
Collapse
|
18
|
Cyr A, Boukadoum M, Thériault F. Operant conditioning: a minimal components requirement in artificial spiking neurons designed for bio-inspired robot's controller. Front Neurorobot 2014; 8:21. [PMID: 25120464 PMCID: PMC4110879 DOI: 10.3389/fnbot.2014.00021] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2013] [Accepted: 07/02/2014] [Indexed: 01/03/2023] Open
Abstract
In this paper, we investigate the operant conditioning (OC) learning process within a bio-inspired paradigm, using artificial spiking neural networks (ASNN) to act as robot brain controllers. In biological agents, OC results in behavioral changes learned from the consequences of previous actions, based on progressive prediction adjustment from rewarding or punishing signals. In a neurorobotics context, virtual and physical autonomous robots may benefit from a similar learning skill when facing unknown and unsupervised environments. In this work, we demonstrate that a simple invariant micro-circuit can sustain OC in multiple learning scenarios. The motivation for this new OC implementation model stems from the relatively complex alternatives that have been described in the computational literature and recent advances in neurobiology. Our elementary kernel includes only a few crucial neurons, synaptic links and originally from the integration of habituation and spike-timing dependent plasticity as learning rules. Using several tasks of incremental complexity, our results show that a minimal neural component set is sufficient to realize many OC procedures. Hence, with the proposed OC module, designing learning tasks with an ASNN and a bio-inspired robot context leads to simpler neural architectures for achieving complex behaviors.
Collapse
Affiliation(s)
- André Cyr
- Computer Science Department, Cognitive and Computer science, Université du Québec à Montréal Montréal, QC, Canada
| | - Mounir Boukadoum
- Computer Science Department, Cognitive and Computer science, Université du Québec à Montréal Montréal, QC, Canada
| | - Frédéric Thériault
- Computer Science Department, Cognitive and Computer science, Université du Québec à Montréal Montréal, QC, Canada
| |
Collapse
|
19
|
Abstract
In vitro cell culture systems from molluscs have significantly contributed to our basic understanding of complex physiological processes occurring within or between tissue-specific cells, yielding information unattainable using intact animal models. In vitro cultures of neuronal cells from gastropods show how simplified cell models can inform our understanding of complex networks in intact organisms. Primary cell cultures from marine and freshwater bivalve and gastropod species are used as biomonitors for environmental contaminants, as models for gene transfer technologies, and for studies of innate immunity and neoplastic disease. Despite efforts to isolate proliferative cell lines from molluscs, the snail Biomphalaria glabrata Say, 1818 embryonic (Bge) cell line is the only existing cell line originating from any molluscan species. Taking an organ systems approach, this review summarizes efforts to establish molluscan cell cultures and describes the varied applications of primary cell cultures in research. Because of the unique status of the Bge cell line, an account is presented of the establishment of this cell line, and of how these cells have contributed to our understanding of snail host-parasite interactions. Finally, we detail the difficulties commonly encountered in efforts to establish cell lines from molluscs and discuss how these difficulties might be overcome.
Collapse
Affiliation(s)
- T P Yoshino
- Department of Pathobiological Sciences, University of Wisconsin, School of Veterinary Medicine, Madison, WI 53706
| | | | | |
Collapse
|
20
|
Shields-Johnson ME, Hernandez JS, Torno C, Adams KM, Wainwright ML, Mozzachiodi R. Effects of aversive stimuli beyond defensive neural circuits: reduced excitability in an identified neuron critical for feeding in Aplysia. Learn Mem 2012; 20:1-5. [PMID: 23242417 DOI: 10.1101/lm.028084.112] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
In Aplysia, repeated trials of aversive stimuli produce long-term sensitization (LTS) of defensive reflexes and suppression of feeding. Whereas the cellular underpinnings of LTS have been characterized, the mechanisms of feeding suppression remained unknown. Here, we report that LTS training induced a long-term decrease in the excitability of B51 (a decision-making neuron in the feeding circuit) that recovered at a time point in which LTS is no longer observed (72 h post-treatment). These findings indicate B51 as a locus of plasticity underlying feeding suppression. Finally, treatment with serotonin to induce LTS failed to alter feeding and B51 excitability, suggesting that serotonin does not mediate the effects of LTS training on the feeding circuit.
Collapse
Affiliation(s)
- Maria E Shields-Johnson
- Department of Life Sciences, Texas A&M University-Corpus Christi, Corpus Christi, Texas 78412, USA
| | | | | | | | | | | |
Collapse
|
21
|
Nargeot R, Simmers J. Functional organization and adaptability of a decision-making network in aplysia. Front Neurosci 2012; 6:113. [PMID: 22855670 PMCID: PMC3405415 DOI: 10.3389/fnins.2012.00113] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2012] [Accepted: 07/08/2012] [Indexed: 12/31/2022] Open
Abstract
Whereas major insights into the neuronal basis of adaptive behavior have been gained from the study of automatic behaviors, including reflexive and rhythmic motor acts, the neural substrates for goal-directed behaviors in which decision-making about action selection and initiation are crucial, remain poorly understood. However, the mollusk Aplysia is proving to be increasingly relevant to redressing this issue. The functional properties of the central circuits that govern this animal’s goal-directed feeding behavior and particularly the neural processes underlying the selection and initiation of specific feeding actions are becoming understood. In addition to relying on the intrinsic operation of central networks, goal-directed behaviors depend on external sensory inputs that through associative learning are able to shape decision-making strategies. Here, we will review recent findings on the functional design of the central network that generates Aplysia’s feeding-related movements and the sensory-derived plasticity that through learning can modify the selection and initiation of appropriate action. The animal’s feeding behavior and the implications of decision-making will be briefly described. The functional design of the underlying buccal network will then be used to illustrate how cellular diversity and the coordination of neuronal burst activity provide substrates for decision-making. The contribution of specific synaptic and neuronal membrane properties within the buccal circuit will also be discussed in terms of their role in motor pattern selection and initiation. The ability of learning to “rigidify” these synaptic and cellular properties so as to regularize network operation and lead to the expression of stereotyped rhythmic behavior will then be described. Finally, these aspects will be drawn into a conceptual framework of how Aplysia’s goal-directed circuitry compares to the central pattern generating networks for invertebrate rhythmic behaviors.
Collapse
Affiliation(s)
- Romuald Nargeot
- Institut de Neurosciences Cognitives et Intégratives d'Aquitaine, Université Bordeaux, UMR 5287 Bordeaux, France
| | | |
Collapse
|
22
|
Rapid and persistent suppression of feeding behavior induced by sensitization training in Aplysia. Learn Mem 2012; 19:159-63. [PMID: 22419814 DOI: 10.1101/lm.024638.111] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
In Aplysia, noxious stimuli induce sensitization of defensive responses. However, it remains largely unknown whether such stimuli also alter nondefensive behaviors. In this study, we examined the effects of noxious stimuli on feeding. Strong electric shocks, capable of inducing sensitization, also led to the suppression of feeding. The use of multiple training protocols revealed that the time course of the suppression of feeding was analogous to that of sensitization. In addition, the suppression of feeding was present only at the time points in which sensitization was expressed. These results suggest that, in Aplysia, noxious stimuli may produce concurrent changes in neural circuits controlling both defensive and nondefensive behaviors.
Collapse
|
23
|
Classical conditioning analog enhanced acetylcholine responses but reduced excitability of an identified neuron. J Neurosci 2011; 31:14789-93. [PMID: 21994395 DOI: 10.1523/jneurosci.1256-11.2011] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Although classical and operant conditioning are operationally distinct, it is unclear whether these two forms of learning are mechanistically distinct or similar. Feeding behavior of Aplysia provides a useful model system for addressing this issue. Both classical and operant appetitive behavioral training enhance feeding, and neuronal correlates have been identified. Behavioral training was replicated by in vitro analogs that use isolated ganglia. Moreover, a single-cell analog of operant conditioning was developed using neuron B51, a cell important for the expression of the conditioned behavior. Here, a single-cell analog of classical conditioning was developed. Acetylcholine (ACh) mediated the conditioned stimulus (CS)-elicited excitation of B51 in ganglia and mimicked the CS in the single-cell analog of classical conditioning. Pairing ACh with dopamine, which mediates the unconditioned stimulus in ganglia, decreased the excitability of B51, and increased the CS-elicited excitation of B51, similar to results following both in vivo and in vitro classical training. Finally, a D1 dopamine receptor (D1R) agonist failed to support classical conditioning in the cellular analog, whereas D1R mediates reinforcement in operant conditioning.
Collapse
|
24
|
Cohen MX, Wilmes KA, van de Vijver I. Cortical electrophysiological network dynamics of feedback learning. Trends Cogn Sci 2011; 15:558-66. [DOI: 10.1016/j.tics.2011.10.004] [Citation(s) in RCA: 99] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2011] [Revised: 10/19/2011] [Accepted: 10/20/2011] [Indexed: 10/15/2022]
|