Context-dependent olfactory learning in an insect

Critical roles of nicotinic acetylcholine receptors in olfactory memory formation and retrieval in crickets

Acetylcholine (ACh) is a major excitatory neurotransmitter in the insect central nervous system, and insect neurons express several types of ACh receptors (AChRs). AChRs are classified into two subgroups, muscarinic AChRs and nicotinic AChRs (nAChRs). nAChRs are also divided into two subgroups by sensitivity to α-bungarotoxin (α-BGT). The cricket Gryllus bimaculatus is one of the useful insects for studying the molecular mechanisms in olfactory learning and memory. However, the roles of nAChRs in olfactory learning and memory of the cricket are still unknown. In the present study, to investigate whether nAChRs are involved in cricket olfactory learning and memory, we tested the effects of two different AChR antagonists on long-term memory (LTM) formation and retrieval in a behavioral assay. The two AChR antagonists that we used are mecamylamine (MEC), an α-BGT-insensitive nAChR antagonist, and methyllycaconitine (MLA), an α-BGT-sensitive nAChR antagonist. In crickets, multiple-trial olfactory conditioning induced 1-day memory (LTM), whereas single-trial olfactory conditioning induced 1-h memory (mid-term memory, MTM) but not 1-day memory. Crickets injected with MEC 20 min before the retention test at 1 day after the multiple-trial conditioning exhibited no memory retrieval. This indicates that α-BGT-insensitive nAChRs participate in memory retrieval. In addition, crickets injected with MLA before the multiple-trial conditioning exhibited MTM but not LTM, indicating that α-BGT-sensitive nAChRs participate in the formation of LTM. Moreover, injection of nicotine (an nAChR agonist) before the single-trial conditioning induced LTM. Finally, the nitric oxide (NO)-cGMP signaling pathway is known to participate in the formation of LTM in crickets, and we conducted co-injection experiments with an agonist or inhibitor of the nAChR and an activator or inhibitor of the NO-cGMP signaling pathway. The results suggest that nAChR works upstream of the NO-cGMP signaling system in the LTM formation process.

The Relationship between Cognition and Brain Size or Neuron Number

The comparative approach is a powerful way to explore the relationship between brain structure and cognitive function. Thus far, the field has been dominated by the assumption that a bigger brain somehow means better cognition. Correlations between differences in brain size or neuron number between species and differences in specific cognitive abilities exist, but these correlations are very noisy. Extreme differences exist between clades in the relationship between either brain size or neuron number and specific cognitive abilities. This means that correlations become weaker, not stronger, as the taxonomic diversity of sampled groups increases. Cognition is the outcome of neural networks. Here we propose that considering plausible neural network models will advance our understanding of the complex relationships between neuron number and different aspects of cognition. Computational modelling of networks suggests that adding pathways, or layers, or changing patterns of connectivity in a network can all have different specific consequences for cognition. Consequently, models of computational architecture can help us hypothesise how and why differences in neuron number might be related to differences in cognition. As methods in connectomics continue to improve and more structural information on animal brains becomes available, we are learning more about natural network structures in brains, and we can develop more biologically plausible models of cognitive architecture. Natural animal diversity then becomes a powerful resource to both test the assumptions of these models and explore hypotheses for how neural network structure and network size might delimit cognitive function.

oskar acts with the transcription factor Creb to regulate long-term memory in crickets

Novel genes have the potential to drive the evolution of new biological mechanisms, or to integrate into preexisting regulatory circuits and contribute to the regulation of older, conserved biological functions. One such gene, the novel insect-specific gene oskar, was first identified based on its role in establishing the Drosophila melanogaster germ line. We previously showed that this gene likely arose through an unusual domain transfer event involving bacterial endosymbionts and played a somatic role before evolving its well-known germ line function. Here, we provide empirical support for this hypothesis in the form of evidence for a neural role for oskar. We show that oskar is expressed in the adult neural stem cells of a hemimetabolous insect, the cricket Gryllus bimaculatus. In these stem cells, called neuroblasts, oskar is required together with the ancient animal transcription factor Creb to regulate long-term (but not short-term) olfactory memory. We provide evidence that oskar positively regulates Creb, which plays a conserved role in long-term memory across animals, and that oskar in turn may be a direct target of Creb. Together with previous reports of a role for oskar in nervous system development and function in crickets and flies, our results are consistent with the hypothesis that oskar's original somatic role may have been in the insect nervous system. Moreover, its colocalization and functional cooperation with the conserved pluripotency gene piwi in the nervous system may have facilitated oskar's later co-option to the germ line in holometabolous insects.

Cricket: The third domesticated insect

Many researchers are using crickets to conduct research on various topics related to development and regeneration in addition to brain function, behavior, and biological clocks, using advanced functional and perturbational technologies such as genome editing. Recently, crickets have also been attracting attention as a food source for the next generation of humans. In addition, crickets are increasingly being used as disease models and biological factories for pharmaceuticals. Cricket research has thus evolved over the last century from use primarily in highly important basic research, to use in a variety of applications and practical uses. These insects are now a state-of-the-art model animal that can be obtained and maintained in large quantities at low cost. We therefore suggest that crickets are useful as a third domesticated insect for scientific research, after honeybees and silkworms, contributing to the achievement of global sustainable development goals.

The adverse effects of injected functionalized multi-walled carbon nanotube (f-MWCNT) on in vivo neurosecretory brain cells of Jamaican field cricket, Gryllus assimilis

Carbon nanotubes (CNTs) have been increasingly more prevalent due to their use in product technology owing to their exceptional electrical and thermal conductivity and tensile strength because of their nanostructure and strength of the bonds among carbon atoms. The potential increase of CNTs in the environment is a concern, and studies to assess the toxic effects of these nanomaterials (NMs) are needed. However, so far, most of the studies are focused on aquatic species and much less is understood about the effects of NM in terrestrial organisms. This investigation used a functionalized multi-walled carbon nanotube (f-MWCNT) and the Jamaican cricket Gryllus assimilis to assess the effects of this NM. Cricket nymphs were injected with f-MWCNT suspension-at three different concentrations. The insecticide Fipronil was used as a positive control. Survival was monitored, and histological analysis was made in the brains. Pyknotic cells were quantified in two brain regions, a neurosecretory called Pars intercerebralis (PI), and an associative region called mushroom body (MB). No mortality was observed in any f-MWCNT concentration tested. A significant increase in pyknotic cells was observed as sub-lethal effect for the intermediate concentration of f-MWCNT, at PI, while any significant change was observed at the Kenyon cells of the MB. These results are discussed in the context of agglomeration and dispersion of the f-MWCNT at different concentrations, and availability of the f-MWCNT on the circulatory system, as well as the natural decay of pyknotic cells with time and different patterns of adult cricket neurogenesis. Our results showed that f-MWCNT had negative effects in the neurosecretory region of the brain.

Recovery-from-extinction effects in an anuran amphibian: renewal effect, but no reinstatement

Recovery-from-extinction effects in which a conditioned response returns after extinction have been shown in mammals, birds and fish. Thus, these effects appear to be conserved among vertebrates; however, they have yet to be investigated in amphibians. Using prey catching conditioning in the fire-bellied toad (Bombina orientalis), we tested if renewal and reinstatement occurred after extinction when subjects were respectively re-exposed to the context or reinforcer used during conditioning. For renewal, a different context was used during extinction and thus renewal tests assessed if external contextual cues associated during conditioning stimulated prey catching performance. For reinstatement, the reinforcer withheld during extinction was simply delivered again prior to a test assessing if internal cues associated with recent prey consumption stimulated prey catching performance. Conditioning followed a fixed ratio 5 schedule of reinforcement, where five attempts to capture a cricket stimulus displayed on a computer screen were reinforced by delivery of a single live cricket. Performance was measured as the time to reach five prey catching attempts. A significant improvement in prey catching performance during conditioning followed by deterioration with extinction was seen in the experiments. Upon return to the context used for conditioning after extinction, toads showed a renewal effect whereby they displayed faster performance during testing compared to the end of extinction. Conversely, toads showed no reinstatement effect because pre-feeding of a cricket did not influence performance during the test that followed extinction. Reinstatement could have been lost in amphibian phylogeny due to secondary simplification of the nervous system.

Reduction of contextual control of conditioned responses by extended Pavlovian training in an insect

The effect of repetitive training on learned behavior has been an important subject in neuroscience. In instrumental conditioning in mammals, learned action early in training is often goal-driven and controlled by outcome expectancy, but as training progresses, it becomes more habitual and insensitive to outcome devaluation. Similarly, we recently showed in Pavlovian conditioning in crickets (Gryllus bimaculatus) that a conditioned response (CR) is initially sensitive to devaluation of the unconditioned stimulus but becomes insensitive to it after extended training. It is known that habitual responses after extended instrumental training are characterized by a higher context specificity than are initial goal-directed actions in mammals. In this study, we investigated whether this is applicable to Pavlovian conditioning in crickets. In crickets that received a standard amount of training to associate an odor with water reward under illumination, CR under illumination was stronger than that in the dark. In crickets that received extended training under illumination, on the other hand, the level of CR did not differ in different light conditions. Further experiments confirmed that context specificity decreases with the development of behavioral automaticity by extended training, as opposed to findings in instrumental training in mammals. We conclude that the nature of habitual behaviors after extended training differs in different learning systems of animals.

Fruit flies can learn non-elemental olfactory discriminations

Associative learning allows animals to establish links between stimuli based on their concomitance. In the case of Pavlovian conditioning, a single stimulus A (the conditional stimulus, CS) is reinforced unambiguously with an unconditional stimulus (US) eliciting an innate response. This conditioning constitutes an 'elemental' association to elicit a learnt response from A+ without US presentation after learning. However, associative learning may involve a 'complex' CS composed of several components. In that case, the compound may predict a different outcome than the components taken separately, leading to ambiguity and requiring the animal to perform so-called non-elemental discrimination. Here, we focus on such a non-elemental task, the negative patterning (NP) problem, and provide the first evidence of NP solving in Drosophila. We show that Drosophila learn to discriminate a simple component (A or B) associated with electric shocks (+) from an odour mixture composed either partly (called 'feature-negative discrimination' A+ versus AB-) or entirely (called 'NP' A+B+ versus AB-) of the shock-associated components. Furthermore, we show that conditioning repetition results in a transition from an elemental to a configural representation of the mixture required to solve the NP task, highlighting the cognitive flexibility of Drosophila.

Signaling Pathways for Long-Term Memory Formation in the Cricket

Unraveling the molecular mechanisms underlying memory formation in insects and a comparison with those of mammals will contribute to a further understanding of the evolution of higher-brain functions. As it is for mammals, insect memory can be divided into at least two distinct phases: protein-independent short-term memory and protein-dependent long-term memory (LTM). We have been investigating the signaling pathway of LTM formation by behavioral-pharmacological experiments using the cricket Gryllus bimaculatus, whose olfactory learning and memory abilities are among the highest in insect species. Our studies revealed that the NO-cGMP signaling pathway, CaMKII and PKA play crucial roles in LTM formation in crickets. These LTM formation signaling pathways in crickets share a number of attributes with those of mammals, and thus we conclude that insects, with relatively simple brain structures and neural circuitry, will also be beneficial in exploratory experiments to predict the molecular mechanisms underlying memory formation in mammals.

Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets

Revealing neural systems that mediate appetite and aversive signals in associative learning is critical for understanding the brain mechanisms controlling adaptive behavior in animals. In mammals, it has been shown that some classes of dopamine neurons in the midbrain mediate prediction error signals that govern the learning process, whereas other classes of dopamine neurons control execution of learned actions. In this review, based on the results of our studies on Pavlovian conditioning in the cricket Gryllus bimaculatus and by referring to the findings in honey bees and fruit-flies, we argue that comparable aminergic systems exist in the insect brain. We found that administrations of octopamine (the invertebrate counterpart of noradrenaline) and dopamine receptor antagonists impair conditioning to associate an olfactory or visual conditioned stimulus (CS) with water or sodium chloride solution (appetitive or aversive unconditioned stimulus, US), respectively, suggesting that specific octopamine and dopamine neurons mediate appetitive and aversive signals, respectively, in conditioning in crickets. These findings differ from findings in fruit-flies. In fruit-flies, appetitive and aversive signals are mediated by different dopamine neuron subsets, suggesting diversity in neurotransmitters mediating appetitive signals in insects. We also found evidences of “blocking” and “auto-blocking” phenomena, which suggested that the prediction error, the discrepancy between actual US and predicted US, governs the conditioning in crickets and that octopamine neurons mediate prediction error signals for appetitive US. Our studies also showed that activations of octopamine and dopamine neurons are needed for the execution of an appetitive conditioned response (CR) and an aversive CR, respectively, and we, thus, proposed that these neurons mediate US prediction signals that drive appetitive and aversive CRs. Our findings suggest that the basic principles of functioning of aminergic systems in associative learning, i.e., to transmit prediction error signals for conditioning and to convey US prediction signals for execution of CR, are conserved among insects and mammals, on account of the fact that the organization of the insect brain is much simpler than that of the mammalian brain. Further investigation of aminergic systems that govern associative learning in insects should lead to a better understanding of commonalities and diversities of computational rules underlying associative learning in animals.

Development rate rather than social environment influences cognitive performance in Australian black field crickets, Teleogryllus commodus

Cognitive functioning is vital for enabling animals of all taxa to optimise their chances of survival and reproductive success. Learning and memory in particular are drivers of many evolutionary processes. In this study, we examine how developmental plasticity can affect cognitive ability by exploring the role the early social environment has on problem solving ability and learning of female black field crickets, Teleogryllus commodus. We used two learning paradigms, an analog of the Morris water maze and a novel linear maze, to examine cognitive differences between individuals reared in two acoustic treatments: silence or calling. Although there was no evidence of learning or memory, individuals that took longer to mature solved the Morris water maze more quickly. Our results suggest that increased investment into cognitive development is likely associated with increased development time during immature stages. Inconsistent individual performance and motivation during the novel linear maze task highlights the difficulties of designing ecologically relevant learning tasks within a lab setting. The role of experimental design in understanding cognitive ability and learning in more natural circumstances is discussed.

Olfactory learning without the mushroom bodies: Spiking neural network models of the honeybee lateral antennal lobe tract reveal its capacities in odour memory tasks of varied complexities

The honeybee olfactory system is a well-established model for understanding functional mechanisms of learning and memory. Olfactory stimuli are first processed in the antennal lobe, and then transferred to the mushroom body and lateral horn through dual pathways termed medial and lateral antennal lobe tracts (m-ALT and l-ALT). Recent studies reported that honeybees can perform elemental learning by associating an odour with a reward signal even after lesions in m-ALT or blocking the mushroom bodies. To test the hypothesis that the lateral pathway (l-ALT) is sufficient for elemental learning, we modelled local computation within glomeruli in antennal lobes with axons of projection neurons connecting to a decision neuron (LHN) in the lateral horn. We show that inhibitory spike-timing dependent plasticity (modelling non-associative plasticity by exposure to different stimuli) in the synapses from local neurons to projection neurons decorrelates the projection neurons' outputs. The strength of the decorrelations is regulated by global inhibitory feedback within antennal lobes to the projection neurons. By additionally modelling octopaminergic modification of synaptic plasticity among local neurons in the antennal lobes and projection neurons to LHN connections, the model can discriminate and generalize olfactory stimuli. Although positive patterning can be accounted for by the l-ALT model, negative patterning requires further processing and mushroom body circuits. Thus, our model explains several-but not all-types of associative olfactory learning and generalization by a few neural layers of odour processing in the l-ALT. As an outcome of the combination between non-associative and associative learning, the modelling approach allows us to link changes in structural organization of honeybees' antennal lobes with their behavioural performances over the course of their life.

Activation of NO-cGMP Signaling Rescues Age-Related Memory Impairment in Crickets

Age-related memory impairment (AMI) is a common feature and a debilitating phenotype of brain aging in many animals. However, the molecular mechanisms underlying AMI are still largely unknown. The cricket Gryllus bimaculatus is a useful experimental animal for studying age-related changes in learning and memory capability; because the cricket has relatively short life-cycle and a high capability of olfactory learning and memory. Moreover, the molecular mechanisms underlying memory formation in crickets have been examined in detail. In the present study, we trained male crickets of different ages by multiple-trial olfactory conditioning to determine whether AMI occurs in crickets. Crickets 3 weeks after the final molt (3-week-old crickets) exhibited levels of retention similar to those of 1-week-old crickets at 30 min or 2 h after training; however they showed significantly decreased levels of 1-day retention, indicating AMI in long-term memory (LTM) but not in anesthesia-resistant memory (ARM) in olfactory learning of crickets. Furthermore, 3-week-old crickets injected with a nitric oxide (NO) donor, a cyclic GMP (cGMP) analog or a cyclic AMP (cAMP) analog into the hemolymph before conditioning exhibited a normal level of LTM, the same level as that in 1-week-old crickets. The rescue effect by NO donor or cGMP analog injection was absent when the crickets were injected after the conditioning. For the first time, an NO donor and a cGMP analog were found to antagonize the age-related impairment of LTM formation, suggesting that deterioration of NO synthase (NOS) or molecules upstream of NOS activation is involved in brain-aging processes.

Timing of Environmental Enrichment Affects Memory in the House Cricket, Acheta domesticus

Learning appears to be ubiquitous among animals, as it plays a key role in many behaviors including foraging and reproduction. Although there is some genetic basis for differences in learning ability and memory retention, environment also plays an important role, as it does for any other trait. For example, adult animals maintained in enriched housing conditions learn faster and remember tasks for longer than animals maintained in impoverished conditions. Such plasticity in adult learning ability has often been linked to plasticity in the brain, and studies aimed at understanding the mechanisms, stimuli, and consequences of adult behavioral and brain plasticity are numerous. However, the role of experiences during post-embryonic development in shaping plasticity in adult learning ability and memory retention remain relatively unexplored. Using the house cricket (Acheta domesticus) as a model organism, we developed a protocol to allow the odor preference of a large number of crickets to be tested in a short period of time. We then used this new protocol to examine how enrichment or impoverishment at two developmental stages (either the last nymphal instar or young adult) affected adult memory. Our results show that regardless of nymphal rearing conditions, crickets that experienced an enriched rearing condition as young adults performed better on a memory task than individuals that experienced an impoverished condition. Older adult crickets (more than 1 week post adult molt) did not demonstrate differences in memory of the odor task, regardless of rearing condition as a young adult. Our results suggest that environmentally-induced plasticity in memory may be restricted to the young adult stage.

Context odor presentation during sleep enhances memory in honeybees

Sleep plays an important role in stabilizing new memory traces after learning [1-3]. Here we investigate whether sleep's role in memory processing is similar in evolutionarily distant species and demonstrate that a context trigger during deep-sleep phases improves memory in invertebrates, as it does in humans. We show that in honeybees (Apis mellifera), exposure to an odor during deep sleep that has been present during learning improves memory performance the following day. Presentation of the context odor during wake phases or novel odors during sleep does not enhance memory. In humans, memory consolidation can be triggered by presentation of a context odor during slow-wave sleep that had been present during learning [3-5]. Our results reveal that deep-sleep phases in honeybees have the potential to prompt memory consolidation, just as they do in humans. This study provides strong evidence for a conserved role of sleep-and how it affects memory processes-from insects to mammals.

Mushroom body extrinsic neurons in the honeybee (Apis mellifera) brain integrate context and cue values upon attentional stimulus selection

Multimodal GABA-immunoreactive feedback neurons in the honeybee brain connecting the output region of the mushroom body with its input are expected to tune the input to the mushroom body in an experience-dependent way. These neurons are known to change their rate responses to learned olfactory stimuli. In this work we ask whether these neurons also transmit learned attentional effects during multisensory integration. We find that a visual context and an olfactory cue change the rate responses of these neurons after learning according to the associated values of both context and cue. The learned visual context promotes attentional response selection by enhancing olfactory stimulus valuation at both the behavioral and the neural level. During a rewarded visual context, bees reacted faster and more reliably to a rewarded odor. We interpreted this as the result of the observed enhanced neural discharge toward the odor. An unrewarded context reduced already low rate responses to the unrewarded odor. In addition to stimulus valuation, these feedback neurons generate a neural error signal after an incorrect behavioral response. This might act as a learning signal in feedback neurons. All of these effects were exclusively found in trials in which the animal prepares for a motor response that happens during attentional stimulus selection. We discuss possible implications of the results for the feedback connections of the mushroom body.

Toward elucidating diversity of neural mechanisms underlying insect learning

Insects are widely used as models to study neural mechanisms of learning and memory. Our recent studies on crickets, together with reports on other insect species, suggest that some fundamental differences exist in neural and molecular mechanisms of learning and memory among different species of insects, particularly between crickets and fruit flies. First, we suggested that in crickets octopamine (OA) and dopamine (DA) neurons convey reward and punishment signals, respectively, in associated learning. On the other hand, it has been reported that in fruit flies different sets of DA neurons convey reward or punishment signals. Secondly, we have suggested that in crickets OA and DA neurons participate in the retrieval of appetitive and aversive memories, respectively, while this is not the case in fruit flies. Thirdly, cyclic AMP signaling is critical for short-term memory formation in fruit flies, but not in crickets. Finally, nitric oxide-cyclic GMP signaling and calcium-calmodulin signaling are critical for long-term memory (LTM) formation in crickets, but such roles have not been reported in fruit flies. Not all of these differences can be ascribed to different experimental methods used in studies. We thus suggest that there are unexpected diversities in basic mechanisms of learning and memory among different insect species, especially between crickets and fruit flies. Studies on a larger number of insect species will help clarify the diversity of learning and memory mechanisms in relation to functional adaptation to the environment and evolutionary history.

Neural correlates of water reward in thirsty Drosophila

Drinking water is innately rewarding to thirsty animals. In addition, the consumed value can be assigned to behavioral actions and predictive sensory cues by associative learning. Here we show that thirst converts water avoidance into water-seeking in naive Drosophila melanogaster. Thirst also permitted flies to learn olfactory cues paired with water reward. Water learning required water taste and <40 water-responsive dopaminergic neurons that innervate a restricted zone of the mushroom body γ lobe. These water learning neurons are different from those that are critical for conveying the reinforcing effects of sugar. Naive water-seeking behavior in thirsty flies did not require water taste but relied on another subset of water-responsive dopaminergic neurons that target the mushroom body β' lobe. Furthermore, these naive water-approach neurons were not required for learned water-seeking. Our results therefore demonstrate that naive water-seeking, learned water-seeking and water learning use separable neural circuitry in the brain of thirsty flies.

Ionic channel mechanisms mediating the intrinsic excitability of Kenyon cells in the mushroom body of the cricket brain

Intrinsic neurons within the mushroom body of the insect brain, called Kenyon cells, play an important role in olfactory associative learning. In this study, we examined the ionic mechanisms mediating the intrinsic excitability of Kenyon cells in the cricket Gryllus bimaculatus. A perforated whole-cell clamp study using β-escin indicated the existence of several inward and outward currents. Three types of inward currents (INaf, INaP, and ICa) were identified. The transient sodium current (INaf) activated at -40 mV, peaked at -26 mV, and half-inactivated at -46.7 mV. The persistent sodium current (INaP) activated at -51 mV, peaked at -23 mV, and half-inactivated at -30.7 mV. Tetrodotoxin (TTX; 1 μM) completely blocked both INaf and INaP, but 10nM TTX blocked INaf more potently than INaP. Cd(2+) (50 μM) potently blocked INaP with little effect on INaf. Riluzole (>20 μM) nonselectively blocked both INaP and INaf. The voltage-dependent calcium current (ICa) activated at -30 mV, peaked at -11.3 mV, and half-inactivated at -34 mV. The Ca(2+) channel blocker verapamil (100 μM) blocked ICa in a use-dependent manner. Cell-attached patch-clamp recordings showed the presence of a large-conductance Ca(2+)-activated K(+) (BK) channel, and the activity of this channel was decreased by removing the extracellular Ca(2+) or adding verapamil or nifedipine, and increased by adding the Ca(2+) agonist Bay K8644, indicating that Ca(2+) entry via the L-type Ca(2+) channel regulates BK channel activity. Under the current-clamp condition, membrane depolarization generated membrane oscillations in the presence of 10nM TTX or 100 μM riluzole in the bath solution. These membrane oscillations disappeared with 1 μM TTX, 50 μM Cd(2+), replacement of external Na(+) with choline, and blockage of Na(+)-activated K(+) current (IKNa) with 50 μM quinidine, indicating that membrane oscillations are primarily mediated by INaP in cooperation with IKNa. The plateau potentials observed either in Ca(2+)-free medium or in the presence of verapamil were eliminated by blocking INaP with 50 μM Cd(2+). Taken together, these results indicate that INaP and IKNa participate in the generation of membrane oscillations and that INaP additionally participates in the generation of plateau potentials and initiation of spontaneous action potentials. ICa, through L-type Ca(2+) channels, was also found to play a role in the rapid membrane repolarization of action potentials by functional coupling with BK channels.

Invertebrate learning and cognition: relating phenomena to neural substrate

Diverse invertebrate species have been used for studies of learning and comparative cognition. Although we have gained invaluable information from this, in this study we argue that our approach to comparative learning research is rather deficient. Generally invertebrate learning research has focused mainly on arthropods, and most of that within the Hymenoptera and Diptera. Any true comparative analysis of the distribution of comparative cognitive abilities across phyla is hampered by this bias, and more fundamentally by a reporting bias toward positive results. To understand the limits of learning and cognition for a species, knowing what animals cannot do is at least as important as reporting what they can. Finally, much more effort needs to be focused on the neurobiological analysis of different types of learning to truly understand the differences and similarities of learning types. In this review, we first give a brief overview of the various forms of learning in invertebrates. We also suggest areas where further study is needed for a more comparative understanding of learning. Finally, using what is known of learning in honeybees and the well-studied honeybee brain, we present a model of how various complex forms of learning may be accounted for with the same neural circuitry required for so-called simple learning types. At the neurobiological level, different learning phenomena are unlikely to be independent, and without considering this it is very difficult to correctly interpret the phylogenetic distribution of learning and cognitive abilities. WIREs Cogn Sci 2013, 4:561-582. doi: 10.1002/wcs.1248 For further resources related to this article, please visit the WIREs website.

Mushroom body extrinsic neurons in the honeybee brain encode cues and contexts differently

Free-flying honeybees (Apis mellifera carnica) are known to learn the context to solve discrimination tasks. Here we apply classical conditioning of the proboscis extension response in restrained bees in combination with single-unit extracellular recordings from mushroom body (MB) extrinsic neurons elucidating the neural correlates of context-dependent olfactory discrimination. The contexts were light, colors, and temperatures, either alone or in combination. We found that bees learn context rules quickly and use them for better discrimination. They also solved a transwitching and a cue/context reversal task. Neurons extrinsic to the α lobe of the MB reduced the responses to the rewarded odor, whereas they increased their responses to the context. These results indicate that MB extrinsic neurons encode cues and contexts differently. Data are discussed with reference to MB function.

A novel GABAergic action mediated by functional coupling between GABAB-like receptor and two different high-conductance K+ channels in cricket Kenyon cells

The γ-aminobutyric acid type B (GABA(B)) receptor has been shown to attenuate high-voltage-activated Ca(2+) currents and enhance voltage-dependent or inwardly rectifying K(+) currents in a variety of neurons. In this study, we report a novel coupling of GABA(B)-like receptor with two different high-conductance K(+) channels, Na(+)-activated K(+) (K(Na)) channel and Ca(2+)-activated K(+) (K(Ca)) channel, in Kenyon cells isolated from the mushroom body of the cricket brain. Single-channel activities of K(Na) and K(Ca) channels in response to bath applications of GABA and the GABA(B)-specific agonist SKF97541 were recorded with the cell-attached patch configuration. The open probability (P(o)) of both K(Na) and K(Ca) channels was found to be increased by bath application of GABA, and this increase in Po was antagonized by coapplication of the GABAB antagonist CGP54626, suggesting that GABA(B)-like receptors mediate these actions. Similarly, GABA(B)-specific agonist SKF97541 increased the Po of both K(Na) and K(Ca) channels. Perforated-patch recordings using β-escin further revealed that SKF97541 increased the amplitude of the outward currents elicited by step depolarizations. Under current-clamp conditions, SKF97541 decreased the firing frequency of spontaneous action potential (AP) and changed the AP waveform. The amplitude and duration of AP were decreased, whereas the afterhyperpolarization of AP was increased. Resting membrane potential, however, was not significantly altered by SKF97541. Taken together, these results suggest that GABA(B)-like receptor is functionally coupled with both K(Na) and K(Ca) channels and this coupling mechanism may serve to prevent AP formation and limit excitatory synaptic input.

Elemental and non-elemental olfactory learning in Drosophila

Brain complexity varies across many orders of magnitude between animals, and it is often assumed that complexity underpins cognition. It is thus important to explore the cognitive capacity of widely used model organisms such as Drosophila. We systematically investigated the fly's ability to learn discriminations involving compound olfactory stimuli associated with shock. Flies could distinguish binary mixtures (AB+ CD-), including overlapping mixtures (AB+ BC-). They could learn positive patterning (AB+A- B-) but could not learn negative patterning (A+ B+ AB-) or solve a biconditional discrimination task (AB+ CD+ AC- BD-). Learning about the elements of a compound (AB+) was not affected by prior conditioning of one of the elements (A+ AB+): flies do not exhibit blocking in this task. We compare these results with the predictions from simulation of several well-known theoretical models of learning, and find none are fully consistent with the overall pattern of observed behaviour.

Roles of aminergic neurons in formation and recall of associative memory in crickets

We review recent progress in the study of roles of octopaminergic (OA-ergic) and dopaminergic (DA-ergic) signaling in insect classical conditioning, focusing on our studies on crickets. Studies on olfactory learning in honey bees and fruit-flies have suggested that OA-ergic and DA-ergic neurons convey reinforcing signals of appetitive unconditioned stimulus (US) and aversive US, respectively. Our work suggested that this is applicable to olfactory, visual pattern, and color learning in crickets, indicating that this feature is ubiquitous in learning of various sensory stimuli. We also showed that aversive memory decayed much faster than did appetitive memory, and we proposed that this feature is common in insects and humans. Our study also suggested that activation of OA- or DA-ergic neurons is needed for appetitive or aversive memory recall, respectively. To account for this finding, we proposed a model in which it is assumed that two types of synaptic connections are strengthened by conditioning and are activated during memory recall, one type being connections from neurons representing conditioned stimulus (CS) to neurons inducing conditioned response and the other being connections from neurons representing CS to OA- or DA-ergic neurons representing appetitive or aversive US, respectively. The former is called stimulus–response (S–R) connection and the latter is called stimulus–stimulus (S–S) connection by theorists studying classical conditioning in vertebrates. Results of our studies using a second-order conditioning procedure supported our model. We propose that insect classical conditioning involves the formation of S–S connection and its activation for memory recall, which are often called cognitive processes.

The early bee catches the flower - circadian rhythmicity influences learning performance in honey bees, Apis mellifera

Circadian rhythmicity plays an important role for many aspects of honey bees’ lives. However, the question whether it also affects learning and memory remained unanswered. To address this question, we studied the effect of circadian timing on olfactory learning and memory in honey bees Apis mellifera using the olfactory conditioning of the proboscis extension reflex paradigm. Bees were differentially conditioned to odours and tested for their odour learning at four different “Zeitgeber” time points. We show that learning behaviour is influenced by circadian timing. Honey bees perform best in the morning compared to the other times of day. Additionally, we found influences of the light condition bees were trained at on the olfactory learning. This circadian-mediated learning is independent from feeding times bees were entrained to, indicating an inherited and not acquired mechanism. We hypothesise that a co-evolutionary mechanism between the honey bee as a pollinator and plants might be the driving force for the evolution of the time-dependent learning abilities of bees.

Stimulation of the cAMP system by the nitric oxide-cGMP system underlying the formation of long-term memory in an insect

The nitric oxide (NO)-cGMP signaling system and cAMP system play critical roles in the formation of multiple-trial induced, protein synthesis-dependent long-term memory (LTM) in many vertebrates and invertebrates. The relationship between the NO-cGMP system and cAMP system, however, remains controversial. In honey bees, the two systems have been suggested to converge on protein kinase A (PKA), based on the finding in vitro that cGMP activates PKA when sub-optimal dose of cAMP is present. In crickets, however, we have suggested that NO-cGMP pathway operates on PKA via activation of adenylyl cyclase and production of cAMP for LTM formation. To resolve this issue, we compared the effect of multiple-trial conditioning against the effect of an externally applied cGMP analog for LTM formation in crickets, in the presence of sub-optimal dose of cAMP analog and in condition in which adenylyl cyclase was inhibited. The obtained results suggest that an externally applied cGMP analog activates PKA when sub-optimal dose of cAMP analog is present, as is suggested in honey bees, but cGMP produced by multiple-trial conditioning cannot activate PKA even when sub-optimal dose of cAMP analog is present, thus indicating that cGMP produced by multiple-trial conditioning is not accessible to PKA. We conclude that the NO-cGMP system stimulates the cAMP system for LTM formation. We propose that LTM is formed by an interplay of two classes of neurons, namely, NO-producing neurons regulating LTM formation and NO-receptive neurons that are more directly involved in the formation of long-term synaptic plasticity underlying LTM formation.

Octopaminergic modulation of the single Ca2+ channel currents in Kenyon cells isolated from the mushroom body of the cricket brain

Octopamine plays an important role in mediating reward signals in olfactory learning and memory formation in insect. However, its target molecules and signaling pathways are still unknown. In this study, we investigated the effects of octopamine on the voltage-activated Ca2+ channels expressed in native Kenyon cells isolated from the mushroom body of the cricket (Gryllus bimaculatus) brain. The cell-attached patch clamp recordings with 100 mM Ba2+ outside showed the presence of dihydropyridine (DHP) sensitive L-type Ca2+ channels with a single channel conductance of approximately 21+/-2 pS (n=12). The open probability (NPo) of single Ca2+ channel currents decreased by about 29+/-7% (n=6) by bath application of 10 microM octopamine. Octopamine-induced decrease in Po was imitated by bath application of 8-Br-cAMP, a membrane-permeable cAMP analog. Pre-treatment of Kenyon cells with the octopamine receptor antagonist phentolamine blocked the inhibitory effect of octopamine on Ca2+ channels. Pre-treatment of Kenyon cells with H-89, a selective inhibitor of cAMP-dependent protein kinase (PKA) attenuated the inhibitory effect of bath applied octopamine on Ca2+ channels. These results indicate that DHP-sensitive L-type Ca2+ channel is a target protein for octopamine and its modulation is mediated via cAMP and PKA-dependent signaling pathways in freshly isolated Kenyon cell in the cricket G. bimaculatus.

The Two-Spotted Cricket Gryllus bimaculatus: An Emerging Model for Developmental and Regeneration Studies

INTRODUCTIONThe two-spotted cricket Gryllus bimaculatus De Geer (Orthoptera: Gryllidae), which is one of the most abundant cricket species, inhabits the tropical and subtropical regions of Asia, Africa, and Europe. G. bimaculatus can be easily bred in the laboratory and has been widely used to study insect physiology and neurobiology. Recently, this species has become established as a model animal for studies on molecular mechanisms of development and regeneration because its mode of development is more typical of arthropods than that of Drosophila melanogaster, and the cricket is probably ancestral for this phylum. Moreover, the cricket is a hemimetabolous insect, in which nymphs possess functional legs with a remarkable capacity for regeneration after damage. Because RNA interference (RNAi) works effectively in this species, the elucidation of mechanisms of development and regeneration has been expedited through loss-of-function analyses of genes. Furthermore, because RNAi-based techniques for analyzing gene functions can be combined with assay systems in other research areas (such as behavioral analyses), G. bimaculatus is expected to become a model organism in various fields of biology. Thus, it may be possible to establish the cricket as a simple model system for exploring more complex organisms such as humans.

Monoaminergic modulation of the Na+-activated K+ channel in Kenyon cells isolated from the mushroom body of the cricket (Gryllus bimaculatus) brain

Recent studies have suggested that octopamine (OA) and dopamine (DA) play important roles in mediating the reward and punishment signals, respectively, in olfactory learning in insect. However, their target molecules and the signaling mechanisms are not fully understood. In this study, we showed for the first time that OA and DA modulate the Na+-activated K+ (KNa) channels in an opposite way in Kenyon cells isolated from the mushroom body of the cricket, Gryllus bimaculatus. Patch-clamp recordings showed that the single-channel conductance of the KNa channel was about 122 pS with high K+ in the patch pipettes. The channel was found to be activated by intracellular Na+ but less activated by Li+. K+ channel blockers TEA and quinidine reduced the open probability (Po) of this channel. Bath application of OA and DA respectively increased and decreased the Po of KNa channel currents. An increase and a decrease in Po of KNa channels were also observed by applying the membrane-permeable analogs 8-Br-cyclic-AMP and 8-Br-cGMP, respectively. Furthermore, it was revealed that cAMP-induced increase and cGMP-induced decrease in Po were attenuated by the specific protein kinase A (PKA) inhibitor H-89 and protein kinase G (PKG) inhibitor KT5823, respectively. These results indicate that the KNa channel is a target molecule for OA and DA and that cAMP/PKA and cGMP/PKG signaling pathways are also involved in the modulation of KNa channels.

No evidence for visual context-dependency of olfactory learning in Drosophila

How is behaviour organised across sensory modalities? Specifically, we ask concerning the fruit fly Drosophila melanogaster how visual context affects olfactory learning and recall and whether information about visual context is getting integrated into olfactory memory. We find that changing visual context between training and test does not deteriorate olfactory memory scores, suggesting that these olfactory memories can drive behaviour despite a mismatch of visual context between training and test. Rather, both the establishment and the recall of olfactory memory are generally facilitated by light. In a follow-up experiment, we find no evidence for learning about combinations of odours and visual context as predictors for reinforcement even after explicit training in a so-called biconditional discrimination task. Thus, a ‘true’ interaction between visual and olfactory modalities is not evident; instead, light seems to influence olfactory learning and recall unspecifically, for example by altering motor activity, alertness or olfactory acuity.

Context and occasion setting in Drosophila visual learning

In a permanently changing environment, it is by no means an easy task to distinguish potentially important events from negligible ones. Yet, to survive, every animal has to continuously face that challenge. How does the brain accomplish this feat? Building on previous work in Drosophila melanogaster visual learning, we have developed an experimental methodology in which combinations of visual stimuli (colors and patterns) can be arranged such that the same stimuli can either be directly predictive, indirectly predictive, or nonpredictive of punishment. Varying this relationship, we found that wild-type flies can establish different memory templates for the same contextual color cues. The colors can either leave no trace in the pattern memory template, leading to context-independent pattern memory (context generalization), or be learned as a higher-order cue indicating the nature of the pattern-heat contingency leading to context-dependent memory (occasion setting) or serve as a conditioned stimulus predicting the punishment directly (simple conditioning). In transgenic flies with compromised mushroom-body function, the sensitivity to these subtle variations is altered. Our methodology constitutes a new concept for designing learning experiments. Our findings suggest that the insect mushroom bodies stabilize visual memories against context changes and are not required for cognition-like higher-order learning.

Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning

Insects, like vertebrates, have considerable ability to associate visual, olfactory or other sensory signals with reward or punishment. Previous studies in crickets, honey bees and fruit-flies have suggested that octopamine (OA, invertebrate counterpart of noradrenaline) and dopamine (DA) mediate various kinds of reward and punishment signals in olfactory learning. However, whether the roles of OA and DA in mediating positive and negative reinforcing signals can be generalized to learning of sensory signals other than odors remained unknown. Here we first established a visual learning paradigm in which to associate a visual pattern with water reward or saline punishment for crickets and found that memory after aversive conditioning decayed much faster than that after appetitive conditioning. Then, we pharmacologically studied the roles of OA and DA in appetitive and aversive forms of visual learning. Crickets injected with epinastine or mianserin, OA receptor antagonists, into the hemolymph exhibited a complete impairment of appetitive learning to associate a visual pattern with water reward, but aversive learning with saline punishment was unaffected. By contrast, fluphenazine, chlorpromazine or spiperone, DA receptor antagonists, completely impaired aversive learning without affecting appetitive learning. The results demonstrate that OA and DA participate in reward and punishment conditioning in visual learning. This finding, together with results of previous studies on the roles of OA and DA in olfactory learning, suggests ubiquitous roles of the octopaminergic reward system and dopaminergic punishment system in insect learning.

Olfactory learning and behaviour are ‘insulated’ against visual processing in larval Drosophila

We investigate the organization of behaviour across sensory modalities, using larval Drosophila melanogaster. We ask whether olfactory learning and behaviour are affected by visual processing. We find that: (1) Visual choice does not affect concomitant odour choice. (2) Visual context does not influence odour learning, nor do changes of visual context between training and test affect retrieval of odour memory. (3) Larvae cannot solve a biconditional discrimination task, despite generally permissive conditions. In this task, larvae are required to establish conditional associations: in light, one odour is rewarded and the other one is not, whereas in dark the opposite contingency is established. After such training, choice between the two odours is equal under light and dark testing conditions, suggesting that larvae do not establish odour memories specifically for one visual context only. Together, these data suggest that, in larval Drosophila, olfactory learning and behaviour are 'insulated' against visual processing.

Critical role of nitric oxide-cGMP cascade in the formation of cAMP-dependent long-term memory

Cyclic AMP pathway plays an essential role in formation of long-term memory (LTM). In some species, the nitric oxide (NO)-cyclic GMP pathway has been found to act in parallel and complementary to the cAMP pathway for LTM formation. Here we describe a new role of the NO-cGMP pathway, namely, stimulation of the cAMP pathway to induce LTM. We have studied the signaling cascade underlying LTM formation by systematically coinjecting various "LTM-inducing" and "LTM-blocking" drugs in crickets. Multiple-trial olfactory conditioning led to LTM that lasted for several days, while memory induced by single-trial conditioning decayed away within several hours. Injection of inhibitors of the enzyme forming NO, cGMP, or cAMP into the hemolymph prior to multiple-trial conditioning blocked LTM, whereas injection of an NO donor, cGMP analog, or cAMP analog prior to single-trial conditioning induced LTM. Induction of LTM by injection of an NO donor or cGMP analog paired with single-trial conditioning was blocked by inhibitors of the cAMP pathway, but induction of LTM by a cAMP analog was unaffected by inhibitors of the NO-cGMP pathway. Inhibitors of cyclic nucleotide-gated channel (CNG channel) or calmodulin-blocked induction of LTM by cGMP analog paired with single-trial conditioning, but they did not affect induction of LTM by cAMP analog. Our findings suggest that the cAMP pathway is a downstream target of the NO-cGMP pathway for the formation of LTM, and that the CNG channel and calcium-calmodulin intervene between the NO-cGMP pathway and the cAMP pathway.

Contextual olfactory learning in cockroaches

We investigated the capability of context-dependent olfactory learning in cockroaches. One group of cockroaches received training to associate peppermint odor (conditioning stimulus) with sucrose solution (appetitive unconditioned stimulus) and vanilla odor with saline solution under illumination and to associate peppermint with aversive unconditioned stimulus and vanilla with appetitive unconditioned stimulus in the dark. Another group received training with the opposite stimulus arrangement. Before training, both groups exhibited preference for vanilla over peppermint. After training, the former group preferred peppermint over vanilla under illumination but preferred vanilla over peppermint in the dark, and the latter group exhibited the opposite odor preference. We conclude that cockroaches are capable of disambiguating the meaning of conditioning stimuli according to visual context.

Classical conditioning of activities of salivary neurones in the cockroach

Secretion of saliva to aid swallowing and digestion is a basic physiological function found in many vertebrates and invertebrates. For mammals, classical conditioning of salivation in dogs was reported by Pavlov a century ago. However, conditioning of salivation or of related neural activities in non-mammalian species has not been reported. In many species of insects, salivation is regulated by salivary neurones. In this study, we found that salivary neurones of the cockroach Periplaneta americanaexhibited a strong response to sucrose solution applied to the mouth and a weak response to odours applied to an antenna, and we studied the effect of conditioning on the activities of salivary neurones. After three sets of differential conditioning trials in which an odour was presented just before the presentation of sucrose solution and the other odour was presented alone,the response of salivary neurones to sucrose-associated odour significantly increased but that to the odour presented alone was unchanged. Backward pairing trials in which an odour was presented after the presentation of sucrose solution were not effective in achieving conditioning. Our study of the change in the level of saliva secretion in response to electrical stimulation of salivary neurones suggested that the magnitude of increase in odour response of salivary neurones by conditioning is sufficient to lead to an increased level of salivation. This study suggests classical conditioning of salivation in an insect.

Further exploration into the adaptive design of the arthropod "microbrain": I. Sensory and memory-processing systems

Arthropods have small but sophisticated brains that have enabled them to adapt their behavior to a diverse range of environments. In this review, we first discuss some of general characteristics of the arthropod "microbrain" in comparison with the mammalian "megalobrain". Then we discuss about recent progress in the study of sensory and memory-processing systems of the arthropod "microbrain". Results of recent studies have shown that (1) insects have excellent capability for elemental and context-dependent forms of olfactory learning, (2) mushroom bodies, higher olfactory and associative centers of arthropods, have much more elaborated internal structures than previously thought, (3) many genes involved in the formation of basic brain structures are common among arthropods and vertebrates, suggesting that common ancestors of arthropods and vertebrates already had organized head ganglia, and (4) the basic organization of sensori-motor pathways of the insect brain has features common to that of the mammalian brain. These findings provide a starting point for the study of brain mechanisms of elaborated behaviors of arthropods, many of which remain unexplored.