Roles of OA1 octopamine receptor and Dop1 dopamine receptor in mediating appetitive and aversive reinforcement revealed by RNAi studies

Aversive social learning with a dead conspecific is achieved by Pavlovian conditioning in crickets

Social learning, learning from other individuals, has been demonstrated in many animals, including insects, but its detailed neural mechanisms remain virtually unknown. We showed that crickets (Gryllus bimaculatus) exhibit aversive social learning with a dead conspecific. When a learner cricket was trained to observe a dead cricket on a drinking apparatus, the learner avoided the odor of that apparatus thereafter. Here we investigated the hypothesis that this social learning is achieved by first-order Pavlovian conditioning of an odor (conditioned stimulus) and a dead conspecific (unconditioned stimulus, US). Injection of a dopamine receptor antagonist (flupentixol) before training or testing impaired the learning or execution of the response to the learned odor, as we reported in aversive non-social Pavlovian conditioning in crickets. Moreover, crickets that were trained with a dead conspecific and then received revaluation of the dead conspecific by pairing it with water reward exhibited an appetitive conditioned response (CR) to the odor paired with the dead conspecific. This suggests that execution of the CR is governed by the current value of the US as in non-social Pavlovian conditioning. In addition, we previously suggested that appetitive social learning with a living conspecific is based on second-order conditioning (SOC), and here we showed that SOC is achieved when crickets experienced pairing of a dead conspecific with water reward before experiencing social learning training with a dead conspecific. We conclude that social learning with a dead conspecific is based on Pavlovian conditioning and that this learning can be extended to second-order social learning.

Tyramine-Mediated Hyperactivity Modulates the Dietary Habits in Helicoverpa armigera

Helicoverpa armigera exhibits extensive variability in feeding habits and food selection. Neuronal regulation of H. armigera feeding behavior is primarily influenced by biogenic amines such as Tyramine (TA) and Octopamine (OA). The molecular responses of H. armigera to dietary challenges in the presence of TA or OA have yet to be studied. This investigation dissects the impact of OA and TA on H. armigera feeding choices and behaviors under non-host nutritional stress. It has been observed that feeding behavior remains unaltered during the exogenous administration of OA and TA through an artificial diet (AD). Ingestion of higher OA or TA concentrations leads to increased mortality. OA and TA treatment in combination with host and non-host diets results in the induction of feeding and higher locomotion toward food, particularly in the case of TA treatment. Increased expression of markers, prominin-like, and tachykinin-related peptide receptor-like transcripts further assessed increased locomotion activity. Insects subjected to a non-host diet with TA treatment exhibited increased feeding and overexpression of the feeding indicator, the Neuropeptide F receptor, and the feeding regulator, Sulfakinin, compared with other conditions. Expression of sensation and biogenic amine synthesis genesis elevated in insects fed a non-host diet in combination with OA or TA. Metabolomics analysis revealed a decreased concentration of the feeding behavior elicitor, dopamine, in insects fed a non-host diet containing TA. This work highlights the complex interplay between biogenic amine functions during dietary stress and suggests the role of tyramine in feeding promotion under stressed conditions.

Independent operations of appetitive and aversive conditioning systems lead to simultaneous production of conflicting memories in an insect

Pavlovian conditioning is a ubiquitous form of associative learning that enables animals to remember appetitive and aversive experiences. Animals possess appetitive and aversive conditioning systems that memorize and retrieve appetitive and aversive experiences. Here, we addressed a question of whether integration of competing appetitive and aversive information takes place during the encoding of the experience or during memory retrieval. We developed novel experimental procedures to address this question using crickets (Gryllus bimaculatus), which allowed selective blockade of the expression of appetitive and aversive memories by injecting octopamine and dopamine receptor antagonists. We conditioned an odour (conditioned stimulus 1, CS1) with water and then with sodium chloride solution. At 24 h after conditioning, crickets retained both appetitive and aversive memories, and the memories were integrated to produce a conditioned response (CR). Importantly, when a visual pattern (CS2) was conditioned with CS1, appetitive and aversive memories formed simultaneously. This indicates that appetitive and aversive second-order conditionings are achieved at the same time. The memories were integrated for producing a conditioned response. We conclude that appetitive and aversive conditioning systems operate independently to form parallel appetitive and aversive memories, which compete to produce learned behaviour in crickets.

Critical roles of nicotinic acetylcholine receptors in olfactory memory formation and retrieval in crickets

Acetylcholine (ACh) is a major excitatory neurotransmitter in the insect central nervous system, and insect neurons express several types of ACh receptors (AChRs). AChRs are classified into two subgroups, muscarinic AChRs and nicotinic AChRs (nAChRs). nAChRs are also divided into two subgroups by sensitivity to α-bungarotoxin (α-BGT). The cricket Gryllus bimaculatus is one of the useful insects for studying the molecular mechanisms in olfactory learning and memory. However, the roles of nAChRs in olfactory learning and memory of the cricket are still unknown. In the present study, to investigate whether nAChRs are involved in cricket olfactory learning and memory, we tested the effects of two different AChR antagonists on long-term memory (LTM) formation and retrieval in a behavioral assay. The two AChR antagonists that we used are mecamylamine (MEC), an α-BGT-insensitive nAChR antagonist, and methyllycaconitine (MLA), an α-BGT-sensitive nAChR antagonist. In crickets, multiple-trial olfactory conditioning induced 1-day memory (LTM), whereas single-trial olfactory conditioning induced 1-h memory (mid-term memory, MTM) but not 1-day memory. Crickets injected with MEC 20 min before the retention test at 1 day after the multiple-trial conditioning exhibited no memory retrieval. This indicates that α-BGT-insensitive nAChRs participate in memory retrieval. In addition, crickets injected with MLA before the multiple-trial conditioning exhibited MTM but not LTM, indicating that α-BGT-sensitive nAChRs participate in the formation of LTM. Moreover, injection of nicotine (an nAChR agonist) before the single-trial conditioning induced LTM. Finally, the nitric oxide (NO)-cGMP signaling pathway is known to participate in the formation of LTM in crickets, and we conducted co-injection experiments with an agonist or inhibitor of the nAChR and an activator or inhibitor of the NO-cGMP signaling pathway. The results suggest that nAChR works upstream of the NO-cGMP signaling system in the LTM formation process.

Characterization and Localization of Sol g 2.1 Protein from Solenopsis geminata Fire Ant Venom in the Central Nervous System of Injected Crickets (Acheta domestica)

Solenopsis geminata is recognized for containing the allergenic proteins Sol g 1, 2, 3, and 4 in its venom. Remarkably, Sol g 2.1 exhibits hydrophobic binding and has a high sequence identity (83.05%) with Sol i 2 from S. invicta. Notably, Sol g 2.1 acts as a mediator, causing paralysis in crickets. Given its structural resemblance and biological function, Sol g 2.1 may play a key role in transporting hydrophobic potent compounds, which induce paralysis by releasing the compounds through the insect's nervous system. To investigate this further, we constructed and characterized the recombinant Sol g 2.1 protein (rSol g 2.1), identified with LC-MS/MS. Circular dichroism spectroscopy was performed to reveal the structural features of the rSol g 2.1 protein. Furthermore, after treating crickets with S. geminata venom, immunofluorescence and immunoblotting results revealed that the Sol g 2.1 protein primarily localizes to the neuronal cell membrane of the brain and thoracic ganglia, with distribution areas related to octopaminergic neuron cell patterns. Based on protein-protein interaction predictions, we found that the Sol g 2.1 protein can interact with octopamine receptors (OctRs) in neuronal cell membranes, potentially mediating Sol g 2.1's localization within cricket central nervous systems. Here, we suggest that Sol g 2.1 may enhance paralysis in crickets by acting as carriers of active molecules and releasing them onto target cells through pH gradients. Future research should explore the binding properties of Sol g 2.1 with ligands, considering its potential as a transporter for active molecules targeting pest nervous systems, offering innovative pest control prospects.

Characterization and functional analysis of an α-adrenergic-like octopamine receptor in the small brown planthopper Laodelphax striatellus

As an important biogenic amine in invertebrates and corresponding to the neurotransmitter norepinephrine in vertebrates, octopamine (OA) regulates diverse physiological and behavioral processes by binding to specific octopamine receptors (OARs) in invertebrates. At present, OARs have been identified and characterized in several insects. However, less is known about the OARs of Laodelphax striatellus, one of the most destructive pests in East Asian rice fields. In the present study, an α1-adrenergic-like OAR (LsOA1) from L. striatellus was cloned. LsOA1 has the typical characteristics of G-protein coupled receptors and is clustered with other insect homologs. The transcript level of LsOA1 varied in various stages and tissues, and was highly expressed at the egg stage and in the brain. Silencing of LsOA1 causes a reduction in vitellogenin (LsVg) and vitellogenin receptor (LsVgR) expression. Although LsOA1 interference did not affect the fecundity and survival of L. striatellus, the hatching rate of L. striatellus was significantly reduced, and the hatching period was prolonged. The decrease in the amount of honeydew excreted after silencing LsOA1 indicates that LsOA1 may be involved in regulating the feeding behavior of L. striatellus. In addition, the interference of LsOA1 significantly reduced the expression of capsid protein (CP) and viral RNA3 segment (RNA3) in rice stripe virus (RSV)-viruliferous L. striatellus, but did not affect the vertical transmission rate of RSV. The present study demonstrated that LsOA1 played a crucial role in the physiological and behavioral processes of L. striatellus, which will provide the basis for developing a new target gene for pest control.

Roles of octopamine neurons in the vertical lobe of the mushroom body for the execution of a conditioned response in cockroaches

Aminergic neurons mediate reward signals in mammals and insects. In crickets, we showed that blockade of synaptic transmission from octopamine neurons (OANs) impairs conditioning of an odor (conditioned stimulus, CS) with water or sucrose (unconditioned stimulus, US) and execution of a conditioned response (CR) to the CS. It has not yet been established, however, whether findings in crickets can be applied to other species of insects. In this study, we investigated the roles of OANs in conditioning of salivation, monitored by activities of salivary neurons, and in execution of the CR in cockroaches (Periplaneta americana). We showed that injection of epinastine (an OA receptor antagonist) into the head hemolymph impaired both conditioning and execution of the CR, in accordance with findings in crickets. Moreover, local injection of epinastine into the vertical lobes of the mushroom body (MB), the center for associative learning and control of the CR, impaired execution of the CR, whereas injection of epinastine into the calyces of the MB or the antennal lobes (primary olfactory centers) did not. We propose that OANs in the MB vertical lobes play critical roles in the execution of the CR in cockroaches. This is analogous to the fact that midbrain dopamine neurons govern execution of learned actions in mammals.

Octopamine neurons mediate reward signals in social learning in an insect

Social learning is found in many animals, but its mechanisms are not understood. We previously showed that a cricket that was trained to observe a conspecific staying at a drinking apparatus exhibited an increased preference for the odor of that drinking apparatus. Here we investigated a hypothesis that this learning is achieved by second-order conditioning (SOC), i.e., by associating conspecifics at a drinking bottle with water reward during group drinking in the rearing stage and then associating an odor with a conspecific in training. Injection of an octopamine receptor antagonist before training or testing impaired the learning or response to the learned odor, as we reported for SOC, thereby supporting the hypothesis. Notably, the SOC hypothesis predicts that octopamine neurons that respond to water in the group-rearing stage also respond to a conspecific in training, without the learner itself drinking water, and such mirror-like activities mediate social learning. This awaits future investigation.

Octopaminergic neurons function in appetitive but not aversive olfactory learning and memory in Bactrocera dorsalis

The biogenic amine octopamine (OA, invertebrate counterpart of noradrenaline) plays critical roles in the regulation of olfactory behavior. Historically, OA has been thought to mediate appetitive but not aversive learning in honeybees, fruit flies (Drosophila), and crickets. However, this viewpoint has recently been challenged because OA activity through a β-adrenergic-like receptor drives both appetitive and aversive learning. Here, we explored the roles of OA neurons in olfactory learning and memory retrieval in Bactrocera dorsalis. We trained flies to associate an orange odor with a sucrose reward or to associate methyl eugenol, a male lure, with N,N-diethyl-3-methyl benzoyl amide (DEET) punishment. We then treated flies with OA receptor antagonists before appetitive or aversive conditioning and a memory retention test. Injection of OA receptor antagonist mianserin or epinastine into the abdomen of flies led to impaired of appetitive learning and memory retention with a sucrose reward, while aversive learning and memory retention with DEET punishment remained intact. Our results suggest that the OA signaling participates in appetitive but not aversive learning and memory retrieval in B. dorsalis through OA receptors.

A Comparison of RNA Interference via Injection and Feeding in Honey Bees

RNA interference (RNAi) has been used successfully to reduce target gene expression and induce specific phenotypes in several species. It has proved useful as a tool to investigate gene function and has the potential to manage pest populations and reduce disease pathogens. However, it is not known whether different administration methods are equally effective at interfering with genes in bees. Therefore, we compared the effects of feeding and injection of small interfering RNA (siRNA) on the messenger RNA (mRNA) levels of alpha-aminoadipic semialdehyde dehydrogenase (ALDH7A1), 4-coumarate-CoA ligase (4CL), and heat shock protein 70 (HSP70). Both feeding and injection of siRNA successfully knocked down the gene but feeding required more siRNA than the injection. Our results suggest that both feeding and injection of siRNA effectively interfere with brain genes in bees. The appropriateness of each method would depend on the situation.

Spontaneous recovery from overexpectation in an insect

In associative learning in mammals, it is widely accepted that learning is determined by the prediction error, i.e., the error between the actual reward and the reward predicted by the animal. However, it is unclear whether error-based learning theories are applicable to the learning occurring in other non-mammalian species. Here, we examined whether overexpectation, a phenomenon that supports error-based learning theories, occurs in crickets. Crickets were independently trained with two different conditioned stimuli (CSs), an odour and a visual pattern, that were followed by an appetitive unconditioned stimulus (US). Then the two CSs were presented simultaneously as a compound, followed by the same US. This treatment resulted in a reduced conditioned response to the odour CS when tested immediately after training. However, the response to the CS was partially recovered after 1 day. These results are the first to show overexpectation and its spontaneous recovery in an invertebrate species. While the results showing overexpectation are in agreement with the prediction by the Rescorla-Wagner model, a major form of error-based learning theories, the ones showing spontaneous recovery are not. Our results suggest that conventional error-based learning models account for some, but not for all essential features of Pavlovian conditioning in crickets.

Conditioned taste aversion in the cricket Gryllus bimaculatus

Conditioned taste aversion (CTA) is a form of classical conditioning in which animals associate the taste of a food with illness caused by toxin contained in the food. CTA in mammals is achieved with a long interval of up to several hours between food ingestion and illness induced by LiCl injection. Insects also exhibit CTA, but not much is known about its features. We investigated whether the cricket Gryllus bimaculatus exhibits CTA when ingestion of a sugar solution is followed by LiCl injection. Crickets that ingested sucrose solution 5–10 min before LiCl injection exhibited reduction of sucrose consumption tested 24 or 48 h after injection compared to that tested 24 h before injection. In contrast, crickets that ingested sucrose solution 5–10 min after LiCl injection or 1 h or 8 h before or after injection did not exhibit reduction of sucrose consumption, indicating that reduction of sucrose consumption by CTA training is pairing-specific. We conclude that CTA in crickets is similar to that in mammals in that one-trial pairing is sufficient to achieve memory retention for days, but it differs in that it is achieved with a relatively short interval (< 1 h) between food ingestion and toxin injection.

What Is Learned in Pavlovian Conditioning in Crickets? Revisiting the S-S and S-R Learning Theories

In Pavlovian conditioning in mammals, two theories have been proposed for associations underlying conditioned responses (CRs). One theory, called S-S theory, assumes an association between a conditioned stimulus (CS) and internal representation of an unconditioned stimulus (US), allowing the animal to adjust the CR depending on the current value of the US. The other theory, called S-R theory, assumes an association or connection between the CS center and the CR center, allowing the CS to elicit the CR. Whether these theories account for Pavlovian conditioning in invertebrates has remained unclear. In this article, results of our studies in the cricket Gryllus bimaculatus are reviewed. We showed that after a standard amount of Pavlovian training, crickets exhibited no response to odor CS when water US was devalued by providing it until satiation, whereas after extended training, they exhibited a CR after US devaluation. An increase of behavioral automaticity by extended training has not been reported in Pavlovian conditioning in any other animals, but it has been documented in instrumental conditioning in mammals. Our pharmacological analysis suggested that octopamine neurons mediate US (water) value signals and control execution of the CR after standard training. The control, however, diminishes with extension of training and hence the CR becomes insensitive to the US value. We also found that the nature of the habitual response after extended Pavlovian training in crickets is not the same as that after extended instrumental training in mammals concerning the context specificity. Adaptive significance and evolutionary implications for our findings are discussed.

Characterization and functional analysis of a β-adrenergic-like octopamine receptor from the oriental armyworm (Mythimna separata Walker)

The β-adrenergic-like octopamine receptor (OA2B2), which binds the biogenic amine octopamine, belongs to the class of G-protein coupled receptors and significantly regulates many physiological and behavioral processes in insects. In this study, the putative open reading frame sequence of the MsOA2B2 gene in Mythimna separata was cloned, the full-length complementary DNA was 1191 bp and it encoded a 396-amino acid protein (GenBank accession number MN822800). Orthologous sequence alignment, phylogenetic tree analysis, and protein sequence analysis all showed that the cloned receptor belongs to the OA2B2 protein family. Real-time quantitative polymerase chain reaction of spatial and temporal expression analysis revealed that the MsOAB2 gene was expressed in all developmental stages of M. separata and was most abundant in egg stages and second and fourth instars compared with other developmental stages, while the expression level during the pupal stage was much lower than that at the other stages. Further analysis with sixth instar M. separata larvae showed that the MsOA2B2 gene was expressed 1.81 times higher in the head than in integument and gut tissues. Dietary ingestion of dsMsOA2B2 significantly reduced the messenger RNA level of MsOA2B2 and decreased mortality following amitraz treatment. This study provides both a pharmacological characterization and the gene expression patterns of OA2B2 in M. separata, facilitating further research for insecticides using MsOA2B2 as a target.

Appetitive and aversive social learning with living and dead conspecifics in crickets

Many animals acquire biologically important information from conspecifics. Social learning has been demonstrated in many animals, but there are few experimental paradigms that are suitable for detailed analysis of its associative processes. We established procedures for appetitive and aversive social learning with living and dead conspecifics in well-controlled stimulus arrangements in crickets, Gryllus bimaculatus. A thirsty demonstrator cricket was released in a demonstrator room and allowed to visit two drinking apparatuses that contained water or saltwater and emitted apple or banana odour, and a thirsty learner was allowed to observe the demonstrator room through a net. In the post-training test, the learner preferred the odour of the water-containing apparatus at which the demonstrator stayed. When a dead cricket was placed on one of the two apparatuses, the learner avoided the odour of that apparatus. Further experiments suggested that a living conspecific can be recognized by either visual or olfactory cues for appetitive social learning, whereas olfactory cues are needed to recognize a dead conspecific for aversive social learning, and that different associative processes underlie social learning with living and dead conspecifics. The experimental paradigms described here will pave the way for detailed research on the neural basis of social learning.

Development of behavioural automaticity by extended Pavlovian training in an insect

The effect of repetitive training on learned actions has been a major subject in behavioural neuroscience. Many studies of instrumental conditioning in mammals, including humans, suggested that learned actions early in training are goal-driven and controlled by outcome expectancy, but they become more automatic and insensitive to reduction in the value of the outcome after extended training. It was unknown, however, whether the development of value-insensitive behaviour also occurs by extended training of Pavlovian conditioning in any animals. Here we show that crickets Gryllus bimaculatus that had received minimal training to associate an odour with water (unconditioned stimulus, US) did not exhibit conditioned response (CR) to the odour when they were given water until satiation before the test, but those that had received extended training exhibited CR even when they were satiated with water. Further pharmacological experiments suggested that octopamine neurons, the invertebrate counterparts of noradrenaline neurons, mediate US value signals and control execution of CR after minimal training, but the control diminishes with the progress of training and hence the CR becomes insensitive to US devaluation. The results suggest that repetitive sensory experiences can lead to a change from a goal-driven response to a more automatic one in crickets.

Progress in the use of genetic methods to study insect behavior outside Drosophila

In the span of a decade we have seen a rapid progress in the application of genetic tools and genome editing approaches in 'non-model' insects. It is now possible to target sensory receptor genes and neurons, explore their functional roles and manipulate behavioral responses in these insects. In this review, we focus on the latest examples from Diptera, Lepidoptera and Hymenoptera of how applications of genetic tools advanced our understanding of diverse behavioral phenomena. We further discuss genetic methods that could be applied to study insect behavior in the future.

Tandem-running and scouting behaviour are characterized by up-regulation of learning and memory formation genes within the ant brain

Tandem-running is a recruitment behaviour in ants that has been described as a form of teaching, where spatial information possessed by a leader is conveyed to following nestmates. Within Temnothorax ants, tandem-running is used within a variety of contexts, from foraging and nest relocation to-in the case of slavemaking species-slave raiding. Here, we elucidate the transcriptomic basis of scouting, tandem-leading and tandem-following behaviours across two species with divergent lifestyles: the slavemaking Temnothorax americanus and its primary, nonparasitic host T. longispinosus. Analysis of gene expression data from brains revealed that only a small number of unique differentially expressed genes are responsible for scouting and tandem-running. Comparison of orthologous genes between T. americanus and T. longispinosus suggests that tandem-running is characterized by species-specific patterns of gene usage. However, within both species, tandem-leaders showed gene expression patterns median to those of scouts and tandem-followers, which was expected, as leaders can be recruited from either of the other two behavioural states. Most importantly, a number of differentially expressed behavioural genes were found, with functions relating to learning and memory formation in other social and nonsocial insects. This includes a number of up-regulated receptor genes such as a glutamate and dopamine receptor, as well as serine/threonine-protein phosphatases and kinases. Learning and memory genes were specifically up-regulated within scouts and tandem-followers, not only reinforcing previous behavioural studies into how Temnothorax navigate novel environments and share information, but also providing insight into the molecular underpinnings of teaching and learning within social insects.

A critical role for Dop1-mediated dopaminergic signaling in the plasticity of behavioral and neuronal responses to sex pheromone in a moth

Most animal species, including insects, are able to modulate their responses to sexual chemosignals and this flexibility originates from the remodeling of olfactory areas under the influence of dopaminergic system. In the moth Agrotis ipsilon, the behavioral response of males to the female-emitted sex pheromone increases throughout adult life and after a prior exposure to pheromone signal and this change is accompanied by an increase in neuronal sensitivity within the primary olfactory centers, the antennal lobes (ALs). To identify the underlying neuromodulatory mechanisms, we examined whether this age- and experience-dependent olfactory plasticity is mediated by dopamine (DA) through the Dop1 receptor, an ortholog of the vertebrate D1-type dopamine receptors, which is positively coupled to adenylyl cyclase. We cloned A. ipsilon Dop1 (AiDop1) which is expressed predominantly in brain and especially in ALs and its knockdown induced decreased AL cAMP amounts and altered sex pheromone-orientated flight. The levels of DA, AiDop1 expression and cAMP in ALs increased from the third day of adult life and at 24h and 48h following pre-exposure to sex pheromone and the dynamic of these changes correlated with the increased responsiveness to sex pheromone. These results demonstrate that Dop1 is required for the display of male sexual behavior and that age- and experience-related neuronal and behavioral changes are sustained by DA-Dop1 signaling that operates within ALs probably through cAMP-dependent mechanisms in A. ipsilon. Thus, this study expands our understanding of the neuromodulatory mechanisms underlying olfactory plasticity, mechanisms that appear to be highly conserved between insects and mammals.

Tyrosine hydroxylase-immunoreactive neurons in the mushroom body of the field cricket, Gryllus bimaculatus

The mushroom body of the insect brain participates in processing and integrating multimodal sensory information and in various forms of learning. In the field cricket, Gryllus bimaculatus, dopamine plays a crucial role in aversive memory formation. However, the morphologies of dopamine neurons projecting to the mushroom body and their potential target neurons, the Kenyon cells, have not been characterized. Golgi impregnations revealed two classes of Kenyon cells (types I and II) and five different types of extrinsic fibers in the mushroom body. Type I cells, which are further divided into two subtypes (types I core and I surface), extend their dendrites into the anterior calyx, whereas type II cells extend many bushy dendritic branches into the posterior calyx. Axons of the two classes bifurcate between the pedunculus and lobes to form the vertical, medial and γ lobes. Immunocytochemistry to tyrosine hydroxylase (TH), a rate-limiting enzyme in dopamine biosynthesis, revealed the following four distinct classes of neurons: (1) TH-SLP projecting to the distal vertical lobe; (2) TH-IP1 extending to the medial and γ lobes; (3) TH-IP2 projecting to the basal vertical lobe; and (4) a multiglomerular projection neuron invading the anterior calyx and the lateral horn (TH-MPN). We previously proposed a model in the field cricket in which the efficiency of synapses from Kenyon cells transmitting a relevant sensory stimulus to output neurons commanding an appropriate behavioral reaction can be modified by dopaminergic neurons mediating aversive signals and here, we provide putative neural substrates for the cricket's aversive learning. These will be instrumental in understanding the principle of aversive memory formation in this model species.

Application of a Prediction Error Theory to Pavlovian Conditioning in an Insect

Elucidation of the conditions in which associative learning occurs is a critical issue in neuroscience and comparative psychology. In Pavlovian conditioning in mammals, it is thought that the discrepancy, or error, between the actual reward and the predicted reward determines whether learning occurs. This theory stems from the finding of Kamin’s blocking effect, in which after pairing of a stimulus with an unconditioned stimulus (US), conditioning of a second stimulus is blocked when the two stimuli are presented in compound and paired with the same US. Whether this theory is applicable to any species of invertebrates, however, has remained unknown. We first showed blocking and one-trial blocking of Pavlovian conditioning in the cricket Gryllus bimaculatus, which supported the Rescorla–Wagner model but not attentional theories, the major competitive error-correction learning theories to account for blocking. To match the prediction error theory, a neural circuit model was proposed, and prediction from the model was tested: the results were consistent with the Rescorla–Wagner model but not with the retrieval theory, another competitive theory to account for blocking. The findings suggest that the Rescorla–Wagner model best accounts for Pavlovian conditioning in crickets and that the basic computation rule underlying Pavlovian conditioning in crickets is the same to those suggested in mammals. Moreover, results of pharmacological studies in crickets suggested that octopamine and dopamine mediate prediction error signals in appetitive and aversive conditioning, respectively. This was in contrast to the notion that dopamine mediates appetitive prediction error signals in mammals. The functional significance and evolutionary implications of these findings are discussed.

Signaling Pathways for Long-Term Memory Formation in the Cricket

Unraveling the molecular mechanisms underlying memory formation in insects and a comparison with those of mammals will contribute to a further understanding of the evolution of higher-brain functions. As it is for mammals, insect memory can be divided into at least two distinct phases: protein-independent short-term memory and protein-dependent long-term memory (LTM). We have been investigating the signaling pathway of LTM formation by behavioral-pharmacological experiments using the cricket Gryllus bimaculatus, whose olfactory learning and memory abilities are among the highest in insect species. Our studies revealed that the NO-cGMP signaling pathway, CaMKII and PKA play crucial roles in LTM formation in crickets. These LTM formation signaling pathways in crickets share a number of attributes with those of mammals, and thus we conclude that insects, with relatively simple brain structures and neural circuitry, will also be beneficial in exploratory experiments to predict the molecular mechanisms underlying memory formation in mammals.

Dopamine signalling in locusts and other insects

Dopamine is an important catecholamine neurotransmitter in invertebrates and vertebrates. It is biochemically derived from tyrosine via L-DOPA. It is most abundant in the central nervous system, but can also be produced in e.g. epidermal cells. Dopamine has conserved roles in the control of movement, pleasure, motivation, arousal and memory between invertebrate and vertebrate animals. It is crucial for melanisation and sclerotisation, important processes for the formation of the exoskeleton of insects and immune function. In this brief review I will discuss some general aspects of insect dopamine biosynthesis and breakdown, dopamine receptors and their pharmacology. In addition, I will provide a glance on the multitude of biological functions of dopamine in insects. More detail is provided concerning the putative roles of dopamine in phase related phenomena in locusts. Finally, molecular and pharmacological adjustments of insect dopamine signalling are discussed in the light of possible approaches towards insect pest management.

The Post-mating Switch in the Pheromone Response of Nasonia Females Is Mediated by Dopamine and Can Be Reversed by Appetitive Learning

The olfactory sense is of crucial importance for animals, but their response to chemical stimuli is plastic and depends on their physiological state and prior experience. In many insect species, mating status influences the response to sex pheromones, but the underlying neuromodulatory mechanisms are poorly understood. After mating, females of the parasitic wasp Nasonia vitripennis are no longer attracted to the male sex pheromone. Here we show that this post-mating behavioral switch is mediated by dopamine (DA). Females fed a DA-receptor antagonist prior to mating maintained their attraction to the male pheromone after mating while virgin females injected with DA became unresponsive. However, the switch is reversible as mated females regained their pheromone preference after appetitive learning. Feeding mated N. vitripennis females with antagonists of either octopamine- (OA) or DA-receptors prevented relearning of the pheromone preference suggesting that both receptors are involved in appetitive learning. Moreover, DA injection into mated females was sufficient to mimic the oviposition reward during odor conditioning with the male pheromone. Our data indicate that DA plays a key role in the plastic pheromone response of N. vitripennis females and reveal some striking parallels between insects and mammals in the neuromodulatory mechanisms underlying olfactory plasticity.

Aversive gustatory learning and perception in honey bees

Taste perception allows discriminating edible from non-edible items and is crucial for survival. In the honey bee, the gustatory sense has remained largely unexplored, as tastants have been traditionally used as reinforcements rather than as stimuli to be learned and discriminated. Here we provide the first characterization of antennal gustatory perception in this insect using a novel conditioning protocol in which tastants are dissociated from their traditional food-reinforcement role to be learned as predictors of punishment. We found that bees have a limited gustatory repertoire via their antennae: they discriminate between broad gustatory modalities but not within modalities, and are unable to differentiate bitter substances from water. Coupling gustatory conditioning with blockade of aminergic pathways in the bee brain revealed that these pathways are not restricted to encode reinforcements but may also encode conditioned stimuli. Our results reveal unknown aspects of honey bee gustation, and bring new elements for comparative analyses of gustatory perception in animals.

Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets

Revealing neural systems that mediate appetite and aversive signals in associative learning is critical for understanding the brain mechanisms controlling adaptive behavior in animals. In mammals, it has been shown that some classes of dopamine neurons in the midbrain mediate prediction error signals that govern the learning process, whereas other classes of dopamine neurons control execution of learned actions. In this review, based on the results of our studies on Pavlovian conditioning in the cricket Gryllus bimaculatus and by referring to the findings in honey bees and fruit-flies, we argue that comparable aminergic systems exist in the insect brain. We found that administrations of octopamine (the invertebrate counterpart of noradrenaline) and dopamine receptor antagonists impair conditioning to associate an olfactory or visual conditioned stimulus (CS) with water or sodium chloride solution (appetitive or aversive unconditioned stimulus, US), respectively, suggesting that specific octopamine and dopamine neurons mediate appetitive and aversive signals, respectively, in conditioning in crickets. These findings differ from findings in fruit-flies. In fruit-flies, appetitive and aversive signals are mediated by different dopamine neuron subsets, suggesting diversity in neurotransmitters mediating appetitive signals in insects. We also found evidences of “blocking” and “auto-blocking” phenomena, which suggested that the prediction error, the discrepancy between actual US and predicted US, governs the conditioning in crickets and that octopamine neurons mediate prediction error signals for appetitive US. Our studies also showed that activations of octopamine and dopamine neurons are needed for the execution of an appetitive conditioned response (CR) and an aversive CR, respectively, and we, thus, proposed that these neurons mediate US prediction signals that drive appetitive and aversive CRs. Our findings suggest that the basic principles of functioning of aminergic systems in associative learning, i.e., to transmit prediction error signals for conditioning and to convey US prediction signals for execution of CR, are conserved among insects and mammals, on account of the fact that the organization of the insect brain is much simpler than that of the mammalian brain. Further investigation of aminergic systems that govern associative learning in insects should lead to a better understanding of commonalities and diversities of computational rules underlying associative learning in animals.

Roles of dopamine neurons in mediating the prediction error in aversive learning in insects

In associative learning in mammals, it is widely accepted that the discrepancy, or error, between actual and predicted reward determines whether learning occurs. The prediction error theory has been proposed to account for the finding of a blocking phenomenon, in which pairing of a stimulus X with an unconditioned stimulus (US) could block subsequent association of a second stimulus Y to the US when the two stimuli were paired in compound with the same US. Evidence for this theory, however, has been imperfect since blocking can also be accounted for by competitive theories. We recently reported blocking in classical conditioning of an odor with water reward in crickets. We also reported an "auto-blocking" phenomenon in appetitive learning, which supported the prediction error theory and rejected alternative theories. The presence of auto-blocking also suggested that octopamine neurons mediate reward prediction error signals. Here we show that blocking and auto-blocking occur in aversive learning to associate an odor with salt water (US) in crickets, and our results suggest that dopamine neurons mediate aversive prediction error signals. We conclude that the prediction error theory is applicable to both appetitive learning and aversive learning in insects.

Parallel memory traces are built after an experience containing aversive and appetitive components in the crab Neohelice

The neurobiology of learning and memory has been mainly studied by focusing on pure aversive or appetitive experiences. Here, we challenged this approach considering that real-life stimuli come normally associated with competing aversive and appetitive consequences and that interaction between conflicting information must be intrinsic part of the memory processes. We used Neohelice crabs, taking advantage of two well-described appetitive and aversive learning paradigms and combining them in a single training session to evaluate how this affects memory. We found that crabs build separate appetitive and aversive memories that compete during retrieval but not during acquisition. Which memory prevails depends on the balance between the strength of the unconditioned stimuli and on the motivational state of the animals. The results indicate that after a mix experience with appetitive and aversive consequences, parallel memories are established in a way that appetitive and aversive information is stored to be retrieved in an opportunistic manner.

A decision underlies phototaxis in an insect

Like a moth into the flame-phototaxis is an iconic example for innate preferences. Such preferences probably reflect evolutionary adaptations to predictable situations and have traditionally been conceptualized as hard-wired stimulus-response links. Perhaps for that reason, the century-old discovery of flexibility in Drosophila phototaxis has received little attention. Here, we report that across several different behavioural tests, light/dark preference tested in walking is dependent on various aspects of flight. If we temporarily compromise flying ability, walking photopreference reverses concomitantly. Neuronal activity in circuits expressing dopamine and octopamine, respectively, plays a differential role in photopreference, suggesting a potential involvement of these biogenic amines in this case of behavioural flexibility. We conclude that flies monitor their ability to fly, and that flying ability exerts a fundamental effect on action selection in Drosophila This work suggests that even behaviours which appear simple and hard-wired comprise a value-driven decision-making stage, negotiating the external situation with the animal's internal state, before an action is selected.

Interaction of inhibitory and facilitatory effects of conditioning trials on long-term memory formation

Animals learn through experience and consolidate the memories into long-time storage. Conditioning parameters to induce protein synthesis-dependent long-term memory (LTM) have been the subject of extensive studies in many animals. Here we found a case in which a conditioning trial inhibits or facilitates LTM formation depending on the intervals from preceding trials. We studied the effects of conditioning parameters on LTM formation in olfactory conditioning of maxillary-palpi extension response with sucrose reward in the cockroach Periplaneta americana. We found, at first, that translation- and transcription-dependent LTM forms 1 h after training, the fastest so far reported in insects. Second, we observed that multiple-trial training with an intertrial interval (ITI) of 20 or 30 sec, often called massed training, is more effective than spaced training for LTM formation, an observation that differs from the results of most studies in other animals. Third, we found that a conditioning trial inhibits LTM formation when the intervals from preceding trials were in the range of 10–16 min. This inhibitory effect is pairing-specific and is not due to decreased motivation for learning (overtraining effect). To our knowledge, no similar inhibition of LTM formation by a conditioning trial has been reported in any animals. We propose a model to account for the effects of trial number and ITIs on LTM formation. Olfactory conditioning in cockroaches should provide pertinent materials in which to study neuronal and molecular mechanisms underlying the inhibitory and facilitatory processes for LTM formation.