Associative learning in invertebrates

Repeated stimulation of feeding mechanoafferents in Aplysia generates responses consistent with the release of food

How does repeated stimulation of mechanoafferents affect feeding motor neurons? Monosynaptic connections from a mechanoafferent population in the Aplysia buccal ganglia to five motor followers with different functions were examined during repeated stimulus trains. The mechanoafferents produced both fast and slow synaptic outputs, which could be excitatory or inhibitory. In contrast, other Aplysia mechanoafferents produce only fast excitation on their followers. In addition, patterns of synaptic connections were different to the different motor followers. Some followers received both fast excitation and fast inhibition, whereas others received exclusively fast excitation. All followers showed strong decreases in fast postsynaptic potential (PSP) amplitude within a stimulus train. Fast and slow synaptic connections were of net opposite signs in some followers but not in others. For one follower, synaptic contacts were not uniform from all subareas of the mechanoafferent cluster. Differences in properties of the buccal ganglia mechanoafferents and other Aplysia mechanoafferents may arise because the buccal ganglia neurons innervate the interior of the feeding apparatus, rather than an external surface, and connect to motor neurons for muscles with different motor functions. Fast connection patterns suggest that these synapses may be activated when food slips, biasing the musculature to release food. The largest slow inhibitory synaptic PSPs may contribute to a delay in the onset of the next behavior. Additional functions are also possible.

Division of labor for defensive retaliation and preemption by the peripheral and central nervous systems in the nudibranch Berghia

Relatively little is known about how peripheral nervous systems (PNSs) contribute to the patterning of behavior in which their role transcends the simple execution of central motor commands or mediation of reflexes. We sought to draw inferences to this end in the aeolid nudibranch Berghia stephanieae, which generates a rapid, dramatic defense behavior, "bristling." This behavior involves the coordinated movement of cerata, dozens of venomous appendages emerging from the animal's mantle. Our investigations revealed that bristling constitutes a stereotyped but non-reflexive two-stage behavior: an initial adduction of proximate cerata to sting the offending stimulus (stage 1) followed by a coordinated radial extension of remaining cerata to create a pincushion-like defensive screen around the animal (stage 2). In decerebrated specimens, stage 1 bristling was preserved, while stage 2 bristling was replaced by slower, uncoordinated ceratal movements. We conclude from these observations that, first, the animal's PNS and central nervous system (CNS) mediate stages 1 and 2 of bristling, respectively; second, the behavior propagates through the body utilizing both peripheral- and central-origin nerve networks that support different signaling kinetics; and third, the former network inhibits the latter in the body region being stimulated. These findings extend our understanding of the PNS' computational capacity and provide insight into a neuroethological scheme in which the CNS and PNS both independently and interactively pattern different aspects of non-reflexive behavior.

The slow emergence of gaze- and point-following: A longitudinal study of infants from 4 to 12 months

Acquisition of visual attention-following skills, notably gaze- and point-following, contributes to infants' ability to share attention with caregivers, which in turn contributes to social learning and communication. However, the development of gaze- and point-following in the first 18 months remains controversial, in part because of different testing protocols and standards. To address this, we longitudinally tested N = 43 low-risk, North American middle-class infants' tendency to follow gaze direction, pointing gestures, and gaze-and-point combinations. Infants were tested monthly from 4 to 12 months of age. To control motivational differences, infants were taught to expect contingent reward videos in the target locations. No-cue trials were included to estimate spontaneous target fixation rates. A comparison sample (N = 23) was tested at 9 and 12 months to estimate practice effects. Results showed gradual increases in both gaze- and point-following starting around 7 months, and modest month-to-month individual stability from 8 to 12 months. However, attention-following did not exceed chance levels until after 6 months. Infants rarely followed cues to locations behind them, even at 12 months. Infants followed combined gaze-and-point cues more than gaze alone, and followed points at intermediate levels (not reliably different from the other cues). The comparison group's results showed that practice effects did not explain the age-related increase in attention-following. The results corroborate and extend previous findings that North American middle-class infants' attention-following in controlled laboratory settings increases slowly and incrementally between 6 and 12 months of age. RESEARCH HIGHLIGHTS: A longitudinal experimental study documented the emergence and developmental trajectories of North American middle-class infants' visual attention-following skills, including gaze-following, point-following, and gaze-and-point-following. A new paradigm controlled for factors including motivation, attentiveness, and visual-search baserates. Motor development was ruled out as a predictor or limiter of the emergence of attention-following. Infants did not follow attention reliably until after 6 months, and following increased slowly from 7 to 12 months. Infants' individual trajectories showed modest month-to-month stability from 8 to 12 months of age.

Zebrafish and nematodes as whole organism models to measure developmental neurotoxicity

Despite the growing epidemiological evidence of an association between toxin exposure and developmental neurotoxicity (DNT), systematic testing of DNT is not mandatory in international regulations for admission of pharmaceuticals or industrial chemicals. However, to date around 200 compounds, ranging from pesticides, pharmaceuticals and industrial chemicals, have been tested for DNT in the current OECD test guidelines (TG-443 or TG-426). There are calls for the development of new approach methodologies (NAMs) for DNT, which has resulted in a DNT testing battery using in vitro human cell-based assays. These assays provide a means to elucidate the molecular mechanisms of toxicity in humans which is lacking in animal-based toxicity tests. However, cell-based assays do not represent all steps of the complex process leading to DNT. Validated models with a multi-organ network of pathways that interact at the molecular, cellular and tissue level at very specific timepoints in a life cycle are currently missing. Consequently, whole model organisms are being developed to screen for, and causally link, new molecular targets of DNT compounds and how they affect whole brain development and neurobehavioral endpoints. Given the practical and ethical restraints associated with vertebrate testing, lower animal models that qualify as 3 R (reduce, refine and replace) models, including the nematode (Caenorhabditis elegans) and the zebrafish (Danio rerio) will prove particularly valuable for unravelling toxicity pathways leading to DNT. Although not as complex as the human brain, these 3 R-models develop a complete functioning brain with numerous neurodevelopmental processes overlapping with human brain development. Importantly, the main signalling pathways relating to (neuro)development, metabolism and growth are highly conserved in these models. We propose the use of whole model organisms specifically zebrafish and C. elegans for DNT relevant endpoints.

Behavioral Tests for Associative Learning in Caenorhabditis elegans

Learning is critical for survival as it provides the capacity to adapt to a changing environment. At the molecular and cellular level, learning leads to alterations within neural circuits that include synaptic rewiring, synaptic plasticity, and protein level/gene expression changes. There has been substantial progress in recent years on dissecting how learning and memory is regulated at the molecular and cellular level, including the use of compact invertebrate nervous systems as experimental models. This progress has been facilitated by the establishment of robust behavioral assays that generate a quantifiable readout of the extent to which animals learn and remember. This chapter will focus on protocols of behavioral tests for associative learning using the nematode Caenorhabditis elegans, with its unparalleled genetic tractability, compact nervous system of ~300 neurons, high level of conservation with mammalian systems, and amenability to a suite of behavioral tools and analyses. Specifically, we will provide a detailed description of the methods for two behavioral assays that model associative learning, one measuring appetitive olfactory learning and the other assaying aversive gustatory learning.

Exaptation and Evolutionary Adaptation in Nociceptor Mechanisms Driving Persistent Pain

BACKGROUND

Several evolutionary explanations have been proposed for why chronic pain is a major clinical problem. One is that some mechanisms important for driving chronic pain, while maladaptive for modern humans, were adaptive because they enhanced survival. Evidence is reviewed for persistent nociceptor hyperactivity (PNH), known to promote chronic pain in rodents and humans, being an evolutionarily adaptive response to significant bodily injury, and primitive molecular mechanisms related to cellular injury and stress being exapted (co-opted or repurposed) to drive PNH and consequent pain.

SUMMARY

PNH in a snail (Aplysia californica), squid (Doryteuthis pealeii), fruit fly (Drosophila melanogaster), mice, rats, and humans has been documented as long-lasting enhancement of action potential discharge evoked by peripheral stimuli, and in some of these species as persistent extrinsically driven ongoing activity and/or intrinsic spontaneous activity (OA and SA, respectively). In mammals, OA and SA are often initiated within the protected nociceptor soma long after an inducing injury. Generation of OA or SA in nociceptor somata may be very rare in invertebrates, but prolonged afterdischarge in nociceptor somata readily occurs in sensitized Aplysia. Evidence for the adaptiveness of injury-induced PNH has come from observations of decreased survival of injured squid exposed to predators when PNH is blocked, from plausible survival benefits of chronic sensitization after severe injuries such as amputation, and from the functional coherence and intricacy of mammalian PNH mechanisms. Major contributions of cAMP-PKA signaling (with associated calcium signaling) to the maintenance of PNH both in mammals and molluscs suggest that this ancient stress signaling system was exapted early during the evolution of nociceptors to drive hyperactivity following bodily injury. Vertebrates have retained core cAMP-PKA signaling modules for PNH while adding new extracellular modulators (e.g., opioids) and cAMP-regulated ion channels (e.g., TRPV1 and Nav1.8 channels).

KEY MESSAGES

Evidence from multiple phyla indicates that PNH is a physiological adaptation that decreases the risk of attacks on injured animals. Core cAMP-PKA signaling modules make major contributions to the maintenance of PNH in molluscs and mammals. This conserved signaling has been linked to ancient cellular responses to stress, which may have been exapted in early nociceptors to drive protective hyperactivity that can persist while bodily functions recover after significant injury.

Optogenetic induction of appetitive and aversive taste memories in Drosophila

Tastes typically evoke innate behavioral responses that can be broadly categorized as acceptance or rejection. However, research in Drosophila melanogaster indicates that taste responses also exhibit plasticity through experience-dependent changes in mushroom body circuits. In this study, we develop a novel taste learning paradigm using closed-loop optogenetics. We find that appetitive and aversive taste memories can be formed by pairing gustatory stimuli with optogenetic activation of sensory neurons or dopaminergic neurons encoding reward or punishment. As with olfactory memories, distinct dopaminergic subpopulations drive the parallel formation of short- and long-term appetitive memories. Long-term memories are protein synthesis-dependent and have energetic requirements that are satisfied by a variety of caloric food sources or by direct stimulation of MB-MP1 dopaminergic neurons. Our paradigm affords new opportunities to probe plasticity mechanisms within the taste system and understand the extent to which taste responses depend on experience.

Courtship suppression in Drosophila melanogaster: The role of mating failure

Drosophila melanogaster is a popular model organism in the study of memory due to a wide arsenal of methods used to analyze neuronal activity. The most commonly used tests in research of behavioral plasticity are shock avoidance associated with chemosensory cues and courtship suppression after mating failure. Many authors emphasize the value of courtship suppression as a model of behavior most appropriate to natural conditions. However, researchers often investigate courtship suppression using immobilized and decapitated females as targets of courtship by males, which makes the data obtained from such flies less valuable. In our study, we evaluate courtship suppression towards immature mobile non-receptive females after training with mated or immature females combined with an aversive stimulus (quinine). We have shown that the previously described mechanisms of courtship suppression, as a result of the association of the courtship object with the repellent, as well as due to increased sensitivity to the anti-aphrodisiac cVA after mating failure, are not confirmed when immature mobile females are used. We discuss the reasons for the discrepancies between our results and literature data, define the conditions to be met in the courtship suppression test if the aim is to analyze the natural forms of behavioral plasticity, and present data on the test modifications to approximate conditions to natural ones.

Neural division of labor: the gastropod Berghia defends against attack using its PNS to retaliate and its CNS to erect a defensive screen

Relatively little is known about how the peripheral nervous system (PNS) contributes to the patterning of behavior, in which its role transcends the simple execution of central motor commands or mediation of reflexes. We sought to draw inferences to this end in the aeolid nudibranch Berghia stephanieae, which generates a rapid, dramatic defense behavior, "bristling." This behavior involves the coordinated movement of cerata, dozens of venomous appendages emerging from the animal's mantle. Our investigations revealed that bristling constitutes a stereotyped but non-reflexive two-stage behavior: an initial adduction of proximate cerata to sting the offending stimulus (Stage 1), followed by a coordinated radial extension of remaining cerata to create a pincushion-like defensive screen around the animal (Stage 2). In decerebrated specimens, Stage 1 bristling was preserved, while Stage 2 bristling was replaced by slower, uncoordinated, and ultimately maladaptive ceratal movements. We conclude from these observations that 1) the PNS and central nervous system (CNS) mediate Stages 1 and 2 of bristling, respectively; 2) the behavior propagates through the body utilizing both peripheral- and central-origin nerve networks that support different signaling kinetics; and 3) the former network inhibits the latter in the body region being stimulated. These findings extend our understanding of the PNS's computational capacity and provide insight into a neuroethological scheme that may generalize across cephalized animals, in which the CNS and PNS both independently and interactively pattern different aspects of non-reflexive behavior.

Handling and Training of Wild Animals: Evidence and Ethics-Based Approaches and Best Practices in the Modern Zoo

There is an ethical responsibility to provide all animals living in human care with optimal and positive well-being. As animals living in zoos and aquariums frequently interact with their human caregivers as part of their daily care routines, it is both relevant and essential to consider the impact of these interactions on animal well-being. Allowing animals to have choice and control in multiple areas of their lives, such as by providing opportunities for them to voluntarily participate in their own care through, for example, positive reinforcement training, is an essential component of good animal well-being programs. This review aims to describe evidence-based approaches, ethics, and best practices in the handling and training of the many taxa held in zoos and aquariums worldwide, drawing from work in related animal care fields such as laboratories, farms, rescue, and sanctuaries. The importance of ongoing animal well-being assessments is discussed, with a particular focus on the need for continued review and refinement of processes and procedures pertaining to animal training and handling specifically. Review, enquiry, assessment, evaluation, and refinement will aim to dynamically support positive well-being for all animals.

Molecular insights from the crab Neohelice memory model

Memory acquisition, formation and maintenance depend on synaptic post-translational machinery and regulation of gene expression triggered by several transduction pathways. In turns, these processes lead to stabilization of synaptic modifications in neurons in the activated circuits. In order to study the molecular mechanisms involved in acquisition and memory, we have taken advantage of the context-signal associative learning and, more recently, the place preference task, of the crab Neohelice granulata. In this model organism, we studied several molecular processes, including activation of extracellular signal-regulated kinase (ERK) and the nuclear factor kappa light chain enhancer of activated B cells (NF-κB) transcription factor, involvement of synaptic proteins such as NMDA receptors and neuroepigenetic regulation of gene expression. All these studies allowed description of key plasticity mechanisms involved in memory, including consolidation, reconsolidation and extinction. This article is aimed at review the most salient findings obtained over decades of research in this memory model.

Physiological and pathological consequences of exosomes at the blood-brain-barrier interface

Blood-brain barrier (BBB) interface with multicellular structure controls strictly the entry of varied circulating macromolecules from the blood-facing surface into the brain parenchyma. Under several pathological conditions within the central nervous system, the integrity of the BBB interface is disrupted due to the abnormal crosstalk between the cellular constituents and the recruitment of inflammatory cells. Exosomes (Exos) are nano-sized extracellular vesicles with diverse therapeutic outcomes. These particles transfer a plethora of signaling molecules with the potential to modulate target cell behavior in a paracrine manner. Here, in the current review article, the therapeutic properties of Exos and their potential in the alleviation of compromised BBB structure were discussed. Video Abstract.

Identification of three elevenin receptors and roles of elevenin disulfide bond and residues in receptor activation in Aplysia californica

Neuropeptides are ubiquitous intercellular signaling molecules in the CNS and play diverse roles in modulating physiological functions by acting on specific G-protein coupled receptors (GPCRs). Among them, the elevenin signaling system is now believed to be present primarily in protostomes. Although elevenin was first identified from the L11 neuron of the abdominal ganglion in mollusc Aplysia californica, no receptors have been described in Aplysia, nor in any other molluscs. Here, using two elevenin receptors in annelid Platynereis dumerilii, we found three putative elevenin GPCRs in Aplysia. We cloned the three receptors and tentatively named them apElevR1, apElevR2, and apElevR3. Using an inositol monophosphate (IP1) accumulation assay, we demonstrated that Aplysia elevenin with the disulfide bond activated the three putative receptors with low EC50 values (ranging from 1.2 to 25 nM), supporting that they are true receptors for elevenin. In contrast, elevenin without the disulfide bond could not activate the receptors, indicating that the disulfide bond is required for receptor activity. Using alanine substitution of individual conserved residues other than the two cysteines, we showed that these residues appear to be critical to receptor activity, and the three different receptors had different sensitivities to the single residue substitution. Finally, we examined the roles of those residues outside the disulfide bond ring by removing these residues and found that they also appeared to be important to receptor activity. Thus, our study provides an important basis for further study of the functions of elevenin and its receptors in Aplysia and other molluscs.

Research on epidemic spread model based on cold chain input

In recent years, the new type of coronary pneumonia (COVID-19) has become a highly contagious disease worldwide, posing a serious threat to the public health. This paper is based on the SEIR model of the new coronavirus pneumonia, considering the impact of cold chain input and re-positive on the spread of the virus in the COVID-19. In the process of model design, the food cold chain and re-positive are used as parameters, and its stability is analyzed and simulated. The experimental results show that taking into account the cold chain input and re-positive can effectively simulate the spread of the epidemic. The research results have important research value and practical significance for the prevention and control of the COVID-19 and the prediction of important time nodes.

Molecular mechanisms underlying hyperglycemia associated cognitive decline

Diabetes mellitus (DM) is a metabolic disease characterized by chronic hyperglycemia. DM can lead to a number of secondary complications affecting multiple organs in the body including the eyes, kidney, heart, and brain. The most common effect of hyperglycemia on the brain is cognitive decline. It has been estimated that 20-70% of people with DM have cognitive deficits. High blood sugar affects key brain areas involved in learning, memory, and spatial navigation, and the structural complexity of the brain has made it prone to a variety of pathological disorders, including T2DM. Studies have reported that cognitive decline can occur in people with diabetes, which could go undetected for several years. Moreover, studies on brain imaging suggest extensive effects on different brain regions in patients with T2D. It remains unclear whether diabetes-associated cognitive decline is a consequence of hyperglycemia or a complication that co-occurs with T2D. The exact mechanism underlying cognitive impairment in diabetes is complex; however, impaired glucose metabolism and abnormal insulin function are thought to play important roles. In this review, we have tried to summarize the effect of hyperglycemia on the brain structure and functions, along with the potential mechanisms underlying T2DM-associated cognitive decline.

Regulation of thymidylate synthase: an approach to overcome 5-FU resistance in colorectal cancer

Thymidylate synthase is the rate-limiting enzyme required for DNA synthesis and overexpression of this enzyme causes resistance to cancer cells. Long treatments with 5-FU cause resistance to Thymidylate synthase targeting drugs. We have also compiled different mechanisms of drug resistance including autophagy and apoptosis, drug detoxification and ABC transporters, drug efflux, signaling pathways (AKT/PI3K, RAS-MAPK, WNT/β catenin, mTOR, NFKB, and Notch1 and FOXM1) and different genes associated with resistance in colorectal cancer. We can overcome 5-FU resistance in cancer cells by regulating thymidylate synthase by natural products (Coptidis rhizoma), HDAC inhibitors, mTOR inhibitors, Folate antagonists, and several other drugs which have been used in combination with TS inhibitors. This review is a compilation of different approaches reported for the regulation of thymidylate synthase to overcome resistance in colorectal cancer cells.

Implication of Nanoparticles to Combat Chronic Liver andKidney Diseases: Progress and Perspectives

Liver and kidney diseases are the most frequently encountered problems around the globe. Damage to the liver and kidney may occur as a result of exposure to various drugs, chemicals, toxins, and pathogens, leading to severe disease conditions such as cirrhosis, fibrosis, hepatitis, acute kidney injury, and liver and renal failure. In this regard, the use of nanoparticles (NPs) such as silver nanoparticles (AgNPs), gold nanoparticles (AuNPs), and zinc oxide nanoparticles (ZnONPs) has emerged as a rapidly developing field of study in terms of safe delivery of various medications to target organs with minimal side effects. Due to their physical characteristics, NPs have inherent pharmacological effects, and an accidental buildup can have a significant impact on the structure and function of the liver and kidney. By suppressing the expression of the proinflammatory cytokines iNOS and COX-2, NPs are known to possess anti-inflammatory effects. Additionally, NPs have demonstrated their ability to operate as an antioxidant, squelching the generation of ROS caused by substances that cause oxidative stress. Finally, because of their pro-oxidant properties, they are also known to increase the level of ROS, which causes malignant liver and kidney cells to undergo apoptosis. As a result, NPs can be regarded as a double-edged sword whose inherent therapeutic benefits can be refined as we work to comprehend them in terms of their toxicity.

The evolution of synaptic and cognitive capacity: Insights from the nervous system transcriptome of Aplysia

The gastropod mollusk Aplysia is an important model for cellular and molecular neurobiological studies, particularly for investigations of molecular mechanisms of learning and memory. We developed an optimized assembly pipeline to generate an improved Aplysia nervous system transcriptome. This improved transcriptome enabled us to explore the evolution of cognitive capacity at the molecular level. Were there evolutionary expansions of neuronal genes between this relatively simple gastropod Aplysia (20,000 neurons) and Octopus (500 million neurons), the invertebrate with the most elaborate neuronal circuitry and greatest behavioral complexity? Are the tremendous advances in cognitive power in vertebrates explained by expansion of the synaptic proteome that resulted from multiple rounds of whole genome duplication in this clade? Overall, the complement of genes linked to neuronal function is similar between Octopus and Aplysia. As expected, a number of synaptic scaffold proteins have more isoforms in humans than in Aplysia or Octopus. However, several scaffold families present in mollusks and other protostomes are absent in vertebrates, including the Fifes, Lev10s, SOLs, and a NETO family. Thus, whereas vertebrates have more scaffold isoforms from select families, invertebrates have additional scaffold protein families not found in vertebrates. This analysis provides insights into the evolution of the synaptic proteome. Both synaptic proteins and synaptic plasticity evolved gradually, yet the last deuterostome-protostome common ancestor already possessed an elaborate suite of genes associated with synaptic function, and critical for synaptic plasticity.

High-throughput automated methods for classical and operant conditioning of Drosophila larvae

Learning which stimuli (classical conditioning) or which actions (operant conditioning) predict rewards or punishments can improve chances of survival. However, the circuit mechanisms that underlie distinct types of associative learning are still not fully understood. Automated, high-throughput paradigms for studying different types of associative learning, combined with manipulation of specific neurons in freely behaving animals, can help advance this field. The Drosophila melanogaster larva is a tractable model system for studying the circuit basis of behaviour, but many forms of associative learning have not yet been demonstrated in this animal. Here, we developed a high-throughput (i.e. multi-larva) training system that combines real-time behaviour detection of freely moving larvae with targeted opto- and thermogenetic stimulation of tracked animals. Both stimuli are controlled in either open- or closed-loop, and delivered with high temporal and spatial precision. Using this tracker, we show for the first time that Drosophila larvae can perform classical conditioning with no overlap between sensory stimuli (i.e. trace conditioning). We also demonstrate that larvae are capable of operant conditioning by inducing a bend direction preference through optogenetic activation of reward-encoding serotonergic neurons. Our results extend the known associative learning capacities of Drosophila larvae. Our automated training rig will facilitate the study of many different forms of associative learning and the identification of the neural circuits that underpin them.

Investigating the molecular mechanisms of learning and memory using Caenorhabditis elegans

Learning is an essential biological process for survival since it facilitates behavioural plasticity in response to environmental changes. This process is mediated by a wide variety of genes, mostly expressed in the nervous system. Many studies have extensively explored the molecular and cellular mechanisms underlying learning and memory. This review will focus on the advances gained through the study of the nematode Caenorhabditis elegans. C. elegans provides an excellent system to study learning because of its genetic tractability, in addition to its invariant, compact nervous system (~300 neurons) that is well-characterised at the structural level. Importantly, despite its compact nature, the nematode nervous system possesses a high level of conservation with mammalian systems. These features allow the study of genes within specific sensory-, inter- and motor neurons, facilitating the interrogation of signalling pathways that mediate learning via defined neural circuits. This review will detail how learning and memory can be studied in C. elegans through behavioural paradigms that target distinct sensory modalities. We will also summarise recent studies describing mechanisms through which key molecular and cellular pathways are proposed to affect associative and non-associative forms of learning.

Sleep and conditioning of the siphon withdrawal reflex in Aplysia

Sleep is essential for memory consolidation after learning as shown in mammals and invertebrates such as bees and flies. Aplysia californica displays sleep, and sleep in this mollusk was also found to support memory for an operant conditioning task. Here, we investigated whether sleep in Aplysia is also required for memory consolidation in a simpler type of learning, i.e. the conditioning of the siphon withdrawal reflex. Two groups of animals (Wake, Sleep, each n=11) were conditioned on the siphon withdrawal reflex, with the training following a classical conditioning procedure where an electrical tail shock served as the unconditioned stimulus (US) and a tactile stimulus to the siphon as the conditioned stimulus (CS). Responses to the CS were tested before (pre-test), and 24 and 48 h after training. While Wake animals remained awake for 6 h after training, Sleep animals had undisturbed sleep. The 24 h test in both groups was combined with extinction training, i.e. the extended presentation of the CS alone over two blocks. At the 24 h test, siphon withdrawal duration in response to the CS was distinctly enhanced in both Sleep and Wake groups with no significant difference between groups, consistent with the view that consolidation of a simple conditioned reflex response does not require post-training sleep. Surprisingly, extinction training did not reverse the enhancement of responses to the CS. On the contrary, at the 48 h test, withdrawal duration in response to the CS was even further enhanced across both groups. This suggests that processes of sensitization, an even simpler non-associative type of learning, contributed to the withdrawal responses. Our study provides evidence for the hypothesis that sleep preferentially benefits consolidation of more complex learning paradigms than conditioning of simple reflexes.

Five Breakthroughs: A First Approximation of Brain Evolution From Early Bilaterians to Humans

Retracing the evolutionary steps by which human brains evolved can offer insights into the underlying mechanisms of human brain function as well as the phylogenetic origin of various features of human behavior. To this end, this article presents a model for interpreting the physical and behavioral modifications throughout major milestones in human brain evolution. This model introduces the concept of a "breakthrough" as a useful tool for interpreting suites of brain modifications and the various adaptive behaviors these modifications enabled. This offers a unique view into the ordered steps by which human brains evolved and suggests several unique hypotheses on the mechanisms of human brain function.

What Behavioral Abilities Emerged at Key Milestones in Human Brain Evolution? 13 Hypotheses on the 600-Million-Year Phylogenetic History of Human Intelligence

This paper presents 13 hypotheses regarding the specific behavioral abilities that emerged at key milestones during the 600-million-year phylogenetic history from early bilaterians to extant humans. The behavioral, intellectual, and cognitive faculties of humans are complex and varied: we have abilities as diverse as map-based navigation, theory of mind, counterfactual learning, episodic memory, and language. But these faculties, which emerge from the complex human brain, are likely to have evolved from simpler prototypes in the simpler brains of our ancestors. Understanding the order in which behavioral abilities evolved can shed light on how and why our brains evolved. To propose these hypotheses, I review the available data from comparative psychology and evolutionary neuroscience.

Associative Conditioning Is a Robust Systemic Behavior in Unicellular Organisms: An Interspecies Comparison

The capacity to learn new efficient systemic behavior is a fundamental issue of contemporary biology. We have recently observed, in a preliminary analysis, the emergence of conditioned behavior in some individual amoebae cells. In these experiments, cells were able to acquire new migratory patterns and remember them for long periods of their cellular cycle, forgetting them later on. Here, following a similar conceptual framework of Pavlov's experiments, we have exhaustively studied the migration trajectories of more than 2000 individual cells belonging to three different species: Amoeba proteus, Metamoeba leningradensis, and Amoeba borokensis. Fundamentally, we have analyzed several relevant properties of conditioned cells, such as the intensity of the responses, the directionality persistence, the total distance traveled, the directionality ratio, the average speed, and the persistence times. We have observed that cells belonging to these three species can modify the systemic response to a specific stimulus by associative conditioning. Our main analysis shows that such new behavior is very robust and presents a similar structure of migration patterns in the three species, which was characterized by the presence of conditioning for long periods, remarkable straightness in their trajectories and strong directional persistence. Our experimental and quantitative results, compared with other studies on complex cellular responses in bacteria, protozoa, fungus-like organisms and metazoans that we discus here, allow us to conclude that cellular associative conditioning might be a widespread characteristic of unicellular organisms. This new systemic behavior could be essential to understand some key principles involved in increasing the cellular adaptive fitness to microenvironments.

Role of a Heat Shock Transcription Factor and the Major Heat Shock Protein Hsp70 in Memory Formation and Neuroprotection

Heat shock proteins (Hsps) represent the most evolutionarily ancient, conserved, and universal system for protecting cells and the whole body from various types of stress. Among Hsps, the group of proteins with a molecular weight of 70 kDa (Hsp70) plays a particularly important role. These proteins are molecular chaperones that restore the native conformation of partially denatured proteins after exposure to proteotoxic forms of stress and are critical for the folding and intracellular trafficking of de novo synthesized proteins under normal conditions. Hsp70s are expressed at high levels in the central nervous system (CNS) of various animals and protect neurons from various types of stress, including heat shock, hypoxia, and toxins. Numerous molecular and behavioral studies have indicated that Hsp70s expressed in the CNS are important for memory formation. These proteins contribute to the folding and transport of synaptic proteins, modulate signaling cascades associated with synaptic activation, and participate in mechanisms of neurotransmitter release. In addition, HSF1, a transcription factor that is activated under stress conditions and mediates Hsps transcription, is also involved in the transcription of genes encoding many synaptic proteins, whose levels are increased in neurons under stress and during memory formation. Thus, stress activates the molecular mechanisms of memory formation, thereby allowing animals to better remember and later avoid potentially dangerous stimuli. Finally, Hsp70 has significant protective potential in neurodegenerative diseases. Increasing the level of endogenous Hsp70 synthesis or injecting exogenous Hsp70 reduces neurodegeneration, stimulates neurogenesis, and restores memory in animal models of ischemia and Alzheimer’s disease. These findings allow us to consider recombinant Hsp70 and/or Hsp70 pharmacological inducers as potential drugs for use in the treatment of ischemic injury and neurodegenerative disorders.

Applications of advanced neuro-behavioral analysis strategies in aquatic ecotoxicology

Despite mounting evidence of pleiotropic ecological risks, the understanding of the eco-neurotoxic impact of most industrially relevant chemicals is still very limited. In particularly the acute and chronic exposures to industrial pollutants on nervous systems and thus potential alterations in ecological fitness remain profoundly understudied. Since the behavioral phenotype is the highest-level and functional manifestation of integrated neurological functions, the alterations in neuro-behavioral traits have been postulated as very sensitive and physiologically integrative endpoints to assess eco-neurotoxicological risks associated with industrial pollutants. Due to a considerable backlog of risk assessments of existing and new production chemicals there is a need for a paradigm shift from high cost, low throughput ecotoxicity test models to next generation systems amenable to higher throughput. In this review we concentrate on emerging aspects of laboratory-based neuro-behavioral phenotyping approaches that can be amenable for rapid prioritizing pipelines. We outline the importance of development and applications of innovative neuro-behavioral assays utilizing small aquatic biological indicators and demonstrate emerging concepts of high-throughput chemo-behavioral phenotyping. We also discuss new analytical approaches to effectively and rapidly evaluate the impact of pollutants on higher behavioral functions such as sensory-motor assays, decision-making and cognitive behaviors using innovative model organisms. Finally, we provide a snapshot of most recent analytical approaches that can be applied to elucidate mechanistic rationale that underlie the observed neuro-behavioral alterations upon exposure to pollutants. This review is intended to outline the emerging opportunities for innovative multidisciplinary research and highlight the existing challenges as well barriers to future development.

The central importance of nuclear mechanisms in the storage of memory

The neurobiological nature of the memory trace (engram) remains controversial. The most widely accepted hypothesis at present is that long-term memory is stored as stable, learning-induced changes in synaptic connections. This hypothesis, the synaptic plasticity hypothesis of memory, is supported by extensive experimental data gathered from over 50 years of research. Nonetheless, there are important mnemonic phenomena that the synaptic plasticity hypothesis cannot, or cannot readily, account for. Furthermore, recent work indicates that epigenetic and genomic mechanisms play heretofore underappreciated roles in memory. Here, we critically assess the evidence that supports the synaptic plasticity hypothesis and discuss alternative non-synaptic, nuclear mechanisms of memory storage, including DNA methylation and retrotransposition. We argue that long-term encoding of memory is mediated by nuclear processes; synaptic plasticity, by contrast, represents a means of relatively temporary memory storage. In addition, we propose that memories are evaluated for their mnemonic significance during an initial period of synaptic storage; if assessed as sufficiently important, the memories then undergo nuclear encoding.

Neuromodulatory pathways in learning and memory: Lessons from invertebrates

In an ever-changing environment, animals have to continuously adapt their behaviour. The ability to learn from experience is crucial for animals to increase their chances of survival. It is therefore not surprising that learning and memory evolved early in evolution and are mediated by conserved molecular mechanisms. A broad range of neuromodulators, in particular monoamines and neuropeptides, have been found to influence learning and memory, although our knowledge on their modulatory functions in learning circuits remains fragmentary. Many neuromodulatory systems are evolutionarily ancient and well-conserved between vertebrates and invertebrates. Here, we highlight general principles and mechanistic insights concerning the actions of monoamines and neuropeptides in learning circuits that have emerged from invertebrate studies. Diverse neuromodulators have been shown to influence learning and memory in invertebrates, which can have divergent or convergent actions at different spatiotemporal scales. In addition, neuromodulators can regulate learning dependent on internal and external states, such as food and social context. The strong conservation of neuromodulatory systems, the extensive toolkit and the compact learning circuits in invertebrate models make these powerful systems to further deepen our understanding of neuromodulatory pathways involved in learning and memory.

Comparing Theories for the Maintenance of Late LTP and Long-Term Memory: Computational Analysis of the Roles of Kinase Feedback Pathways and Synaptic Reactivation

A fundamental neuroscience question is how memories are maintained from days to a lifetime, given turnover of proteins that underlie expression of long-term synaptic potentiation (LTP) or “tag” synapses as eligible for LTP. A likely solution relies on synaptic positive feedback loops, prominently including persistent activation of Ca²⁺/calmodulin kinase II (CaMKII) and self-activated synthesis of protein kinase M ζ (PKMζ). Data also suggest positive feedback based on recurrent synaptic reactivation within neuron assemblies, or engrams, is necessary to maintain memories. The relative importance of these mechanisms is controversial. To explore the likelihood that each mechanism is necessary or sufficient to maintain memory, we simulated maintenance of LTP with a simplified model incorporating persistent kinase activation, synaptic tagging, and preferential reactivation of strong synapses, and analyzed implications of recent data. We simulated three model variants, each maintaining LTP with one feedback loop: autonomous, self-activated PKMζ synthesis (model variant I); self-activated CamKII (model variant II); and recurrent reactivation of strengthened synapses (model variant III). Variant I predicts that, for successful maintenance of LTP, either 1) PKMζ contributes to synaptic tagging, or 2) a low constitutive tag level persists during maintenance independent of PKMζ, or 3) maintenance of LTP is independent of tagging. Variant II maintains LTP and suggests persistent CaMKII activation could maintain PKMζ activity, a feedforward interaction not previously considered. However, we note data challenging the CaMKII feedback loop. In Variant III synaptic reactivation drives, and thus predicts, recurrent or persistent activation of CamKII and other necessary kinases, plausibly contributing to persistent elevation of PKMζ levels. Reactivation is thus predicted to sustain recurrent rounds of synaptic tagging and incorporation of plasticity-related proteins. We also suggest (model variant IV) that synaptic reactivation and autonomous kinase activation could synergistically maintain LTP. We propose experiments that could discriminate these maintenance mechanisms.

Dopamine as a Multifunctional Neurotransmitter in Gastropod Molluscs: An Evolutionary Hypothesis

AbstractThe catecholamine 3,4-dihydroxyphenethylamine, or dopamine, acts as a neurotransmitter across a broad phylogenetic spectrum. Functions attributed to dopamine in the mammalian brain include regulation of motor circuits, valuation of sensory stimuli, and mediation of reward or reinforcement signals. Considerable evidence also supports a neurotransmitter role for dopamine in gastropod molluscs, and there is growing appreciation for its potential common functions across phylogeny. This article reviews evidence for dopamine's transmitter role in the nervous systems of gastropods. The functional properties of identified dopaminergic neurons in well-characterized neural circuits suggest a hypothetical incremental sequence by which dopamine accumulated its diverse roles. The successive acquisition of dopamine functions is proposed in the context of gastropod feeding behavior: (1) sensation of potential nutrients, (2) activation of motor circuits, (3) selection of motor patterns from multifunctional circuits, (4) valuation of sensory stimuli with reference to internal state, (5) association of motor programs with their outcomes, and (6) coincidence detection between sensory stimuli and their consequences. At each stage of this sequence, it is proposed that existing functions of dopaminergic neurons favored their recruitment to fulfill additional information processing demands. Common functions of dopamine in other intensively studied groups, ranging from mammals and insects to nematodes, suggest an ancient origin for this progression.

Using internal memory representations in associative learning to study hallucination-like phenomenon

Studies of Pavlovian conditioning have enriched our understanding of how relations among events can adaptively guide behavior through the formation and use of internal mental representations. In this review, we illustrate how internal representations flexibly integrate new updated information in reinforcer revaluation to influence relationships to impact actions and outcomes. We highlight representation-mediated learning to show the similarities in properties and functions between internally generated and directly activated representations, and how normal perception of internal representations could contribute to hallucinations. Converging evidence emerges from recent behavioral and neural activation studies using animal models of schizophrenia as well as clinical studies in patients to support increased tendencies in these populations to evoke internal representations from prior associative experience that approximate hallucination-like percepts. The heightened propensity is dependent on dopaminergic activation which is known to be sensitive to hippocampal overexcitability, a condition that has been observed in patients with psychosis. This presents a network that overlaps with cognitive neural circuits and offers a fresh approach for the development of therapeutic interventions targeting psychosis.

Multiple Local Synaptic Modifications at Specific Sensorimotor Connections after Learning Are Associated with Behavioral Adaptations That Are Components of a Global Response Change

Learning causes local changes in synaptic connectivity and coordinated, global changes affecting many aspects of behavior. How do local synaptic changes produce global behavioral changes? In the hermaphroditic mollusc Aplysia, after learning that food is inedible, memory is expressed as bias to reject a food and to reduce responses to that food. We now show that memory is also expressed as an increased bias to reject even a nonfood object. The increased bias to rejection is partially explained by changes in synaptic connections from primary mechanoafferents to five follower neurons with well defined roles in producing different feeding behaviors. Previously, these mechanoafferents had been shown to play a role in memory consolidation. Connectivity changes differed for each follower neuron: the probability that cells were connected changed; excitation changed to inhibition and vice versa; and connection amplitude changed. Thus, multiple neural changes at different sites underlie specific aspects of a coordinated behavioral change. Changes in the connectivity between mechanoafferents and their followers cannot account for all of the behavioral changes expressed after learning, indicating that additional synaptic sites are also changed. Access to the circuit controlling feeding can help determine the logic and cellular mechanisms by which multiple local synaptic changes produce an integrated, global change in behavior.SIGNIFICANCE STATEMENT How do local changes in synapses affect global behavior? Studies on invertebrate preparations usually examine synaptic changes at specific neural sites, producing a specific behavioral change. However, memory may be expressed by multiple behavioral changes. We report that a change in behavior after learning in Aplysia is accomplished, in part, by regulating connections between mechanoafferents and their synaptic followers. For some followers, the connection probabilities change; for others, the connection signs are reversed; in others, the connection strength is modified. Thus, learning produces changes in connectivity at multiple sites, via multiple synaptic mechanisms that are consistent with the observed behavioral change.

Specificity of synapse formation in Aplysia: paracrine and autocrine signaling regulates bidirectional molecular interactions between sensory and non-target motor neurons

The formation of appropriate neural connections during development is critical for the proper wiring and functioning of the brain. Although considerable research suggests that the specificity of synapse formation is supported by complex intercellular signaling between potential presynaptic and postsynaptic partners, the extracellular factors and the intracellular signal transduction pathways engaged in this process remain largely unknown. Using the sensory-motor neural circuit that contributes to learning in defensive withdrawal reflexes in Aplysia californica, we investigated the molecular processes governing the interactions between sensory neurons and both target and non-target motor neurons during synapse formation in culture. We found that evolutionarily-conserved intercellular and intracellular signaling mechanisms critical for learning-related plasticity are also engaged during synaptogenesis in this in vitro model system. Our results reveal a surprising bidirectional regulation of molecular signaling between sensory neurons and non-target motor neurons. This regulation is mediated by signaling via both paracrine and autocrine diffusible factors that induce differential effects on transcription and on protein expression/activation in sensory neurons and in target and non-target motor neurons. Collectively, our data reveal novel molecular mechanisms that could underlie the repression of inappropriate synapse formation, and suggest mechanistic similarities between developmental and learning-related plasticity.

Comparison of the ionic currents modulated during activity-dependent and normal presynaptic facilitation

One of the major questions in psychology is whether associative and nonassociative learning are fundamentally different or whether they involve similar processes and mechanisms. We have addressed this question by comparing mechanisms of a nonassociative form of learning, sensitization, and an associative form of learning, classical conditioning of the siphon-withdrawal reflex of hermaphroditic Aplysia. In an analog of differential conditioning, action potentials in one siphon sensory neuron (SN) were paired with shock to the pedal nerves, producing activity-dependent presynaptic facilitation, and action potentials in another SN were unpaired with the shock as a control. The difference between paired and unpaired training is a measure of associative plasticity. Before and after this training, we voltage clamped each SN and measured the outward current during depolarizing pulses. There was a significantly greater decrease in the net outward current in the paired SN than in the unpaired SN. We obtained similar results when we substituted the depolarizing voltage clamp pulse for action potentials during training. We then bathed the ganglion in serotonin as a measure of nonassociative plasticity. The current that was modulated differentially (paired−unpaired) had time and voltage dependencies similar to the current that was modulated by serotonin (I_s). These results suggest that an associative form of plasticity, activity-dependent presynaptic facilitation underlying conditioning, involves enhanced modulation of the same ionic current as a nonassociative form, normal presynaptic facilitation underlying sensitization.

Evidence of conditioned behavior in amoebae

Associative memory is the main type of learning by which complex organisms endowed with evolved nervous systems respond efficiently to certain environmental stimuli. It has been found in different multicellular species, from cephalopods to humans, but never in individual cells. Here we describe a motility pattern consistent with associative conditioned behavior in the microorganism Amoeba proteus. We use a controlled direct-current electric field as the conditioned stimulus, and a specific chemotactic peptide as the unconditioned stimulus. The amoebae are capable of linking two independent past events, generating persistent locomotion movements that can prevail for 44 min on average. We confirm a similar behavior in a related species, Metamoeba leningradensis. Thus, our results indicate that unicellular organisms can modify their behavior during migration by associative conditioning.

Proteins or RNA synthesis inhibitors suppressed induction of amnesia developing under impairment of memory reconsolidation by serotonin receptors antagonist

Studies have shown that retrieval of long-term memory can cause memory reconsolidation, and impaired reconsolidation leads to amnesia development. However, the mechanisms of amnesia induction due to impaired memory reconsolidation remains poorly described. Using experiments involving grape snails trained to conditioned food aversion, we studied the role of translation and transcription processes and the role of serotonin receptors in the mechanisms of amnesia induction. We found that administration of a serotonin receptor antagonist or a protein synthesis inhibitor before the administration of a reminder using a conditioned food stimulus induced amnesia development, whereas injections of mRNA synthesis inhibitor did not affect memory safety. Moreover, combined injections of an antagonist of serotonin receptor and inhibitors of protein or mRNA synthesis before reminder administration completely prevented amnesia development. In addition, inhibitors of protein or mRNA synthesis prevented amnesia development 3 h but not 9 h after the administration of a serotonin receptor antagonist/reminder. We hypothesize that the mechanisms of amnesia induction caused by impaired memory reconsolidation depend on protein and mRNA syntheses within a certain time window, similar to the mechanisms of induction of other long-term plastic brain rearrangements.

The contributions and mechanisms of changes in excitability during simple forms of learning in Aplysia

Learning and memory have long been thought to involve changes in synaptic connections between neurons. However, in many cases learning-related plasticity also involves changes in the excitability of neurons. These findings have raised questions about the relative importance of these two types of mechanisms to behavioral learning, and also about the extent to which they involve shared or unique molecular mechanisms. We have taken a reductionist approach to these questions by addressing them in a simple model organism, Aplysia californica. Studies of a semi-intact Aplysia siphon withdrawal preparation suggest that classical conditioning involves an increase in the evoked firing of sensory neurons (SNs) as well as facilitation of the monosynaptic PSP to motor neurons (MNs). Furthermore, these two mechanisms may act cooperatively at the cellular level: increased SN firing produces more PSPs, each of which is facilitated, leading to a multiplicative increase in depolarization of the MN and siphon withdrawal. The changes in SN firing and the monosynaptic PSP also share several mechanisms at the molecular level, suggesting that they may both be due in part to a decrease in K⁺ current that causes an increase in SN excitability as well as an increase in SN spike width and thus increased transmitter release. However, changes in the monosynaptic PSP also involve additional mechanisms that are not shared and may affect different aspects of synaptic transmission as well. Studies of operant conditioning of feeding suggest that it involves similar mechanisms as classical conditioning of siphon withdrawal. In particular, for both types of associative learning adenylyl cyclase appears to serve as a molecular coincidence detector that leads to increased activation of PKA and changes in excitability of key neurons in the neural circuit. Furthermore, in both cases those changes in excitability make an important contribution to the behavioral learning.

Learning and Its Neural Correlates in a Virtual Environment for Honeybees

The search for neural correlates of operant and observational learning requires a combination of two (experimental) conditions that are very difficult to combine: stable recording from high order neurons and free movement of the animal in a rather natural environment. We developed a virtual environment (VE) that simulates a simplified 3D world for honeybees walking stationary on an air-supported spherical treadmill. We show that honeybees perceive the stimuli in the VE as meaningful by transferring learned information from free flight to the virtual world. In search for neural correlates of learning in the VE, mushroom body extrinsic neurons were recorded over days during learning. We found changes in the neural activity specific to the rewarded and unrewarded visual stimuli. Our results suggest an involvement of the mushroom body extrinsic neurons in operant learning in the honeybee (Apis mellifera).

Application of a Prediction Error Theory to Pavlovian Conditioning in an Insect

Elucidation of the conditions in which associative learning occurs is a critical issue in neuroscience and comparative psychology. In Pavlovian conditioning in mammals, it is thought that the discrepancy, or error, between the actual reward and the predicted reward determines whether learning occurs. This theory stems from the finding of Kamin’s blocking effect, in which after pairing of a stimulus with an unconditioned stimulus (US), conditioning of a second stimulus is blocked when the two stimuli are presented in compound and paired with the same US. Whether this theory is applicable to any species of invertebrates, however, has remained unknown. We first showed blocking and one-trial blocking of Pavlovian conditioning in the cricket Gryllus bimaculatus, which supported the Rescorla–Wagner model but not attentional theories, the major competitive error-correction learning theories to account for blocking. To match the prediction error theory, a neural circuit model was proposed, and prediction from the model was tested: the results were consistent with the Rescorla–Wagner model but not with the retrieval theory, another competitive theory to account for blocking. The findings suggest that the Rescorla–Wagner model best accounts for Pavlovian conditioning in crickets and that the basic computation rule underlying Pavlovian conditioning in crickets is the same to those suggested in mammals. Moreover, results of pharmacological studies in crickets suggested that octopamine and dopamine mediate prediction error signals in appetitive and aversive conditioning, respectively. This was in contrast to the notion that dopamine mediates appetitive prediction error signals in mammals. The functional significance and evolutionary implications of these findings are discussed.

Effect of reward type on object discrimination learning in socially monogamous coppery titi monkeys (Callicebus cupreus)

Highly valued food items are often used as rewards to reinforce an animal's behavior. For social species, social interaction is rewarding and can drive an individual's behavior as well. In the currently study, we wanted to compare the efficacy of a food reward and a social reward on object discrimination learning in socially monogamous titi monkeys. We hypothesized that titi monkeys would perform more accurately for a social reward (their pair mate) than for a food reward (a highly desired food item). Eleven adult titi monkeys were tested with a two-object visual discrimination task for both types of reward. The colors and shapes of the objects in the two-object discrimination task were counterbalanced across subjects. During each trial, subjects were shown two objects, and the trial ended when the subject touched the reinforced shape (S+) or after 5 min. A correct trial was defined as one when the subject touched S+ first. We found that 45.5% of subjects were able to learn the task with a social reward, and 83.3% were able to learn the task with a food reward. We found that subjects balked more often and had fewer correct trials for the social reward. Finally, subjects took longer to approach the shapes for a social reward, possibly indicating lower motivation to engage in the task when a social reward is used compared to a food reward. Although significantly fewer subjects met criteria of success with the social reward than with the food reward, our results show that titi monkeys can learn a visual discrimination task with either type of reward.

Surviving threats: neural circuit and computational implications of a new taxonomy of defensive behaviour

Research on defensive behaviour in mammals has in recent years focused on elicited reactions; however, organisms also make active choices when responding to danger. We propose a hierarchical taxonomy of defensive behaviour on the basis of known psychological processes. Included are three categories of reactions (reflexes, fixed reactions and habits) and three categories of goal-directed actions (direct action-outcome behaviours and actions based on implicit or explicit forecasting of outcomes). We then use this taxonomy to guide a summary of findings regarding the underlying neural circuits.

Evolution of highly diverse forms of behavior in molluscs

Members of the phylum Mollusca demonstrate the animal kingdom's tremendous diversity of body morphology, size and complexity of the nervous system, as well as diversity of behavioral repertoires, ranging from very simple to highly flexible. Molluscs include Solenogastres, with their worm-like bodies and behavior (see phylogenetic tree; Figure 1); Bivalvia (mussels and clams), protected by shells and practically immobile; and the cephalopods, such as the octopus, cuttlefish and squid. The latter are strange-looking animals with nervous systems comprising up to half a billion neurons, which mediate the complex behaviors that characterize these freely moving, highly visual predators. Molluscs are undoubtedly special - their extraordinary evolutionary advance somehow managed to sidestep the acquisition of the rigid skeleton that appears essential to the evolution of other 'successful' phyla: the exoskeleton in ecdysozoan invertebrates and the internal skeleton in Deuterostomia, including vertebrates.

Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets

Revealing neural systems that mediate appetite and aversive signals in associative learning is critical for understanding the brain mechanisms controlling adaptive behavior in animals. In mammals, it has been shown that some classes of dopamine neurons in the midbrain mediate prediction error signals that govern the learning process, whereas other classes of dopamine neurons control execution of learned actions. In this review, based on the results of our studies on Pavlovian conditioning in the cricket Gryllus bimaculatus and by referring to the findings in honey bees and fruit-flies, we argue that comparable aminergic systems exist in the insect brain. We found that administrations of octopamine (the invertebrate counterpart of noradrenaline) and dopamine receptor antagonists impair conditioning to associate an olfactory or visual conditioned stimulus (CS) with water or sodium chloride solution (appetitive or aversive unconditioned stimulus, US), respectively, suggesting that specific octopamine and dopamine neurons mediate appetitive and aversive signals, respectively, in conditioning in crickets. These findings differ from findings in fruit-flies. In fruit-flies, appetitive and aversive signals are mediated by different dopamine neuron subsets, suggesting diversity in neurotransmitters mediating appetitive signals in insects. We also found evidences of “blocking” and “auto-blocking” phenomena, which suggested that the prediction error, the discrepancy between actual US and predicted US, governs the conditioning in crickets and that octopamine neurons mediate prediction error signals for appetitive US. Our studies also showed that activations of octopamine and dopamine neurons are needed for the execution of an appetitive conditioned response (CR) and an aversive CR, respectively, and we, thus, proposed that these neurons mediate US prediction signals that drive appetitive and aversive CRs. Our findings suggest that the basic principles of functioning of aminergic systems in associative learning, i.e., to transmit prediction error signals for conditioning and to convey US prediction signals for execution of CR, are conserved among insects and mammals, on account of the fact that the organization of the insect brain is much simpler than that of the mammalian brain. Further investigation of aminergic systems that govern associative learning in insects should lead to a better understanding of commonalities and diversities of computational rules underlying associative learning in animals.

What can tiny mushrooms in fruit flies tell us about learning and memory?

Nervous systems have evolved to translate external stimuli into appropriate behavioral responses. In an ever-changing environment, flexible adjustment of behavioral choice by experience-dependent learning is essential for the animal's survival. Associative learning is a simple form of learning that is widely observed from worms to humans. To understand the whole process of learning, we need to know how sensory information is represented and transformed in the brain, how it is changed by experience, and how the changes are reflected on motor output. To tackle these questions, studying numerically simple invertebrate nervous systems has a great advantage. In this review, I will feature the Pavlovian olfactory learning in the fruit fly, Drosophila melanogaster. The mushroom body is a key brain area for the olfactory learning in this organism. Recently, comprehensive anatomical information and the genetic tool sets were made available for the mushroom body circuit. This greatly accelerated the physiological understanding of the learning process. One of the key findings was dopamine-induced long-term synaptic plasticity that can alter the representations of stimulus valence. I will mostly focus on the new studies within these few years and discuss what we can possibly learn about the vertebrate systems from this model organism.

Animal welfare aspects in respect of the slaughter or killing of pregnant livestock animals (cattle, pigs, sheep, goats, horses)

This scientific opinion addresses animal welfare aspects of slaughtering of livestock pregnant animals. Term of Reference (ToR) 1 requested assessment of the prevalence of animals slaughtered in a critical developmental stage of gestation when the livestock fetuses might experience negative affect. Limited data on European prevalence and related uncertainties necessitated a structured expert knowledge elicitation (EKE) exercise. Estimated median percentages of animals slaughtered in the last third of gestation are 3%, 1.5%, 0.5%, 0.8% and 0.2% (dairy cows, beef cattle, pigs, sheep and goats, respectively). Pregnant animals may be sent for slaughter for health, welfare, management and economic reasons (ToR2); there are also reasons for farmers not knowing that animals sent for slaughter are pregnant. Measures to reduce the incidence are listed. ToR3 asked whether livestock fetuses can experience pain and other negative affect. The available literature was reviewed and, at a second multidisciplinary EKE meeting, judgements and uncertainty were elicited. It is concluded that livestock fetuses in the last third of gestation have the anatomical and neurophysiological structures required to experience negative affect (with 90-100% likelihood). However, there are two different possibilities whether they perceive negative affect. It is more probable that the neurophysiological situation does not allow for conscious perception (with 66-99% likelihood) because of brain inhibitory mechanisms. There is also a less probable situation that livestock fetuses can experience negative affect (with 1-33% likelihood) arising from differences in the interpretation of the fetal electroencephalogram, observed responses to external stimuli and the possibility of fetal learning. Regarding methods to stun and kill livestock fetuses at slaughter (ToR4), sets of scenarios and respective actions take account of both the probable and less probable situation regarding fetal ability for conscious perception. Finally, information was collated on methods to establish the dam's gestational stage based on physical features of livestock fetuses (ToR5).

The Transition to Minimal Consciousness through the Evolution of Associative Learning

The minimal state of consciousness is sentience. This includes any phenomenal sensory experience - exteroceptive, such as vision and olfaction; interoceptive, such as pain and hunger; or proprioceptive, such as the sense of bodily position and movement. We propose unlimited associative learning (UAL) as the marker of the evolutionary transition to minimal consciousness (or sentience), its phylogenetically earliest sustainable manifestation and the driver of its evolution. We define and describe UAL at the behavioral and functional level and argue that the structural-anatomical implementations of this mode of learning in different taxa entail subjective feelings (sentience). We end with a discussion of the implications of our proposal for the distribution of consciousness in the animal kingdom, suggesting testable predictions, and revisiting the ongoing debate about the function of minimal consciousness in light of our approach.