Differential mechanisms underlie trace and delay conditioning in Drosophila

Diverse memory paradigms in Drosophila reveal diverse neural mechanisms

In this review, we aggregated the different types of learning and memory paradigms developed in adult Drosophila and attempted to assess the similarities and differences in the neural mechanisms supporting diverse types of memory. The simplest association memory assays are conditioning paradigms (olfactory, visual, and gustatory). A great deal of work has been done on these memories, revealing hundreds of genes and neural circuits supporting this memory. Variations of conditioning assays (reversal learning, trace conditioning, latent inhibition, and extinction) also reveal interesting memory mechanisms, whereas mechanisms supporting spatial memory (thermal maze, orientation memory, and heat box) and the conditioned suppression of innate behaviors (phototaxis, negative geotaxis, anemotaxis, and locomotion) remain largely unexplored. In recent years, there has been an increased interest in multisensory and multicomponent memories (context-dependent and cross-modal memory) and higher-order memory (sensory preconditioning and second-order conditioning). Some of this work has revealed how the intricate mushroom body (MB) neural circuitry can support more complex memories. Finally, the most complex memories are arguably those involving social memory: courtship conditioning and social learning (mate-copying and egg-laying behaviors). Currently, very little is known about the mechanisms supporting social memories. Overall, the MBs are important for association memories of multiple sensory modalities and multisensory integration, whereas the central complex is important for place, orientation, and navigation memories. Interestingly, several different types of memory appear to use similar or variants of the olfactory conditioning neural circuitry, which are repurposed in different ways.

The emergence of identity, agency and consciousness from the temporal dynamics of neural elaboration

Identity-differentiating self from external reality-and agency-being the author of one's acts-are generally considered intrinsic properties of awareness and looked at as mental constructs generated by consciousness. Here a different view is proposed. All physiological systems display complex time-dependent regulations to adapt or anticipate external changes. To interact with rapid changes, an animal needs a nervous system capable of modelling and predicting (not simply representing) it. Different algorithms must be employed to predict the momentary location of an object based on sensory information (received with a delay), or to design in advance and direct the trajectory of movement. Thus, the temporal dynamics of external events and action must be handled in differential ways, thereby generating the distinction between self and non-self ("identity") as an intrinsic computational construct in neuronal elaboration. Handling time is not what neurons are designed for. Neuronal circuits are based on parallel processing: each bit of information diverges on many neurons, each of which combines it with many other data. Spike firing reports the likelihood that the specific pattern the neuron is designed to respond to is present in the incoming data. This organization seems designed to process synchronous datasets. However, since neural networks can introduce delays in processing, time sequences can be transformed into simultaneous patterns and analysed as such. This way predictive algorithms can be implemented, and continually improved through neuronal plasticity. To successfully interact with the external reality, the nervous system must model and predict, but also differentially handle perceptual functions or motor activity, by putting in register information that becomes available at different time moments. Also, to learn through positive/negative reinforcement, modelling must establish a causal relation between motor control and its consequences: the contrast between phase lag in perception and phase lead (and control) in motor programming produces the emergence of identity (discerning self from surrounding) and agency (control on actions) as necessary computational constructs to model reality. This does not require any form of awareness. In a brain, capable of producing awareness, these constructs may evolve from mere computational requirements into mental (conscious) constructs.

Extrapolating animal consciousness

I argue that the question of animal consciousness is an extrapolation problem and, as such, is best tackled by deploying currently accepted methodology for validating experimental models of a phenomenon of interest. This methodology relies on an assessment of similarities and dissimilarities between experimental models, the partial replication of findings across complementary models, and evidence from the successes and failures of explanations, technologies and medical applications developed by extrapolating and aggregating findings from multiple models. Crucially important, this methodology does not require a commitment to any particular theory or construct of consciousness, thus avoiding theory-biased reinterpretations of empirical findings rampant in the literature.

Wind Gates Search States in Free Flight

For any organism tracking a chemical cue to its source, the motion of its surrounding fluid provides crucial information for success. For both swimming and flying animals engaged in olfaction driven search, turning into the direction of oncoming wind or water current is often a critical first step 1, 2 . However, in nature, wind and water currents may not always provide a reliable directional cue 3, 4, 5 . It is unclear how organisms adjust their search strategies accordingly due to the challenges of separately controlling flow and chemical encounters. Here, we use the genetic toolkit of Drosophila melanogaster , a model organism for olfaction 6 , to develop an optogenetic paradigm to deliver temporally precise "virtual" olfactory experiences in free-flying animals while independently manipulating the wind conditions. We show that in free flight, Drosophila melanogaster adopt distinct search routines that are gated by whether they are flying in laminar wind or in still air. We first confirm that in laminar wind flies turn upwind, and further, we show that they achieve this using a rapid turn. In still air, flies adopt remarkably stereotyped "sink and circle" search state characterized by ∼60°turns at 3-4 Hz, biased in a consistent direction. In both laminar wind and still air, immediately after odor onset, flies decelerate and often perform a rapid turn. Both maneuvers are consistent with predictions from recent control theoretic analyses for how insects may estimate properties of wind while in flight 7, 8 . We suggest that flies may use their deceleration and "anemometric" turn as active sensing maneuvers to rapidly gauge properties of their wind environment before initiating a proximal or upwind search routine.

Cross species review of the physiological role of D-serine in translationally relevant behaviors

Bridging the gap between preclinical models of neurological and psychiatric disorders with their human manifestations is necessary to understand their underlying mechanisms, identify biomarkers, and develop novel therapeutics. Cognitive and social impairments underlie multiple neuropsychiatric and neurological disorders and are often comorbid with sleep disturbances, which can exacerbate poor outcomes. Importantly, many symptoms are conserved between vertebrates and invertebrates, although they may have subtle differences. Therefore, it is essential to determine the molecular mechanisms underlying these behaviors across different species and their translatability to humans. Genome-wide association studies have indicated an association between glutamatergic gene variants and both the risk and frequency of psychiatric disorders such as schizophrenia, bipolar disorder, and autism spectrum disorder. For example, changes in glutamatergic neurotransmission, such as glutamate receptor subtype N-methyl-D-aspartate receptor (NMDAR) hypofunction, have been shown to contribute to the pathophysiology of schizophrenia. Furthermore, in neurological disorders, such as traumatic brain injury and Alzheimer's disease, hyperactivation of NMDARs leads to synaptic damage. In addition to glutamate binding, NMDARs require the binding of a co-agonist D-serine or glycine to the GluN1 subunit to open. D-serine, which is racemized from L-serine by the neuronal enzyme serine racemase (SRR), and both SRR and D-serine are enriched in cortico-limbic brain regions. D-serine is critical for complex behaviors, such as cognition and social behavior, where dysregulation of its synthesis and release has been implicated in many pathological conditions. In this review, we explore the role of D-serine in behaviors that are translationally relevant to multiple psychiatric and neurological disorders in different models across species.

The evolutionary origins of the Global Neuronal Workspace in vertebrates

The Global Neuronal Workspace theory of consciousness offers an explicit functional architecture that relates consciousness to cognitive abilities such as perception, attention, memory, and evaluation. We show that the functional architecture of the Global Neuronal Workspace, which is based mainly on human studies, corresponds to the cognitive-affective architecture proposed by the Unlimited Associative Learning theory that describes minimal consciousness. However, we suggest that when applied to basal vertebrates, both models require important modifications to accommodate what has been learned about the evolution of the vertebrate brain. Most importantly, comparative studies suggest that in basal vertebrates, the Global Neuronal Workspace is instantiated by the event memory system found in the hippocampal homolog. This proposal has testable predictions and implications for understanding hippocampal and cortical functions, the evolutionary relations between memory and consciousness, and the evolution of unified perception.

Neural Networks for Navigation: From Connections to Computations

Many animals can navigate toward a goal they cannot see based on an internal representation of that goal in the brain's spatial maps. These maps are organized around networks with stable fixed-point dynamics (attractors), anchored to landmarks, and reciprocally connected to motor control. This review summarizes recent progress in understanding these networks, focusing on studies in arthropods. One factor driving recent progress is the availability of the Drosophila connectome; however, it is increasingly clear that navigation depends on ongoing synaptic plasticity in these networks. Functional synapses appear to be continually reselected from the set of anatomical potential synapses based on the interaction of Hebbian learning rules, sensory feedback, attractor dynamics, and neuromodulation. This can explain how the brain's maps of space are rapidly updated; it may also explain how the brain can initialize goals as stable fixed points for navigation.

A cognitive account of trace conditioning in insects

Trace conditioning is a form of Pavlovian learning in which the conditioned stimulus (CS) and the unconditioned stimulus (US) are separated by a temporal gap. Insects learn trace associations of variable nature (appetitive, aversive) and involving CSs of different sensory modalities (olfactory, visual). The accessibility of the insect neural system in behaving animals allowed identifying neural processes driving trace conditioning: the existence of prolonged neural responses to the CS after stimulus offset and the anticipation of US responses during the free-stimulus gap. Specific brain structures, such as the mushroom bodies seem to be allocated to this learning form. Here, we posit that a further component facilitating trace conditioning in insects relates to neuromodulatory mechanisms underlying enhanced attention. We thus propose a model based on different types of mushroom-body neurons, which provides a cognitive account of trace conditioning in insects.

Local 5-HT signaling bi-directionally regulates the coincidence time window for associative learning

The coincidence between conditioned stimulus (CS) and unconditioned stimulus (US) is essential for associative learning; however, the mechanism regulating the duration of this temporal window remains unclear. Here, we found that serotonin (5-HT) bi-directionally regulates the coincidence time window of olfactory learning in Drosophila and affects synaptic plasticity of Kenyon cells (KCs) in the mushroom body (MB). Utilizing GPCR-activation-based (GRAB) neurotransmitter sensors, we found that KC-released acetylcholine (ACh) activates a serotonergic dorsal paired medial (DPM) neuron, which in turn provides inhibitory feedback to KCs. Physiological stimuli induce spatially heterogeneous 5-HT signals, which proportionally gate the intrinsic coincidence time windows of different MB compartments. Artificially reducing or increasing the DPM neuron-released 5-HT shortens or prolongs the coincidence window, respectively. In a sequential trace conditioning paradigm, this serotonergic neuromodulation helps to bridge the CS-US temporal gap. Altogether, we report a model circuitry for perceiving the temporal coincidence and determining the causal relationship between environmental events.

Lineages to circuits: the developmental and evolutionary architecture of information channels into the central complex

The representation and integration of internal and external cues is crucial for any organism to execute appropriate behaviors. In insects, a highly conserved region of the brain, the central complex (CX), functions in the representation of spatial information and behavioral states, as well as the transformation of this information into desired navigational commands. How does this relatively invariant structure enable the incorporation of information from the diversity of anatomical, behavioral, and ecological niches occupied by insects? Here, we examine the input channels to the CX in the context of their development and evolution. Insect brains develop from ~ 100 neuroblasts per hemisphere that divide systematically to form "lineages" of sister neurons, that project to their target neuropils along anatomically characteristic tracts. Overlaying this developmental tract information onto the recently generated Drosophila "hemibrain" connectome and integrating this information with the anatomical and physiological recording of neurons in other species, we observe neuropil and lineage-specific innervation, connectivity, and activity profiles in CX input channels. We posit that the proliferative potential of neuroblasts and the lineage-based architecture of information channels enable the modification of neural networks across existing, novel, and deprecated modalities in a species-specific manner, thus forming the substrate for the evolution and diversification of insect navigational circuits.

The neuronal building blocks of the navigational toolkit in the central complex of insects

The central complex in the brain of insects is a group of midline-spanning neuropils at the interface between sensory and premotor tasks of the brain. It is involved in sleep control, decision-making and most prominently in goal-directed locomotion behaviors. The recently published connectome of the central complex of Drosophila melanogaster is a milestone in understanding the intricacies of the central-complex circuits and will provide inspiration for testable hypotheses for the coming years. Here, I provide a basic neuroanatomical description of the central complex of Drosophila and other species and discuss some recent advancements, some of which, such as the discovery of coordinate transformation through vector math, have been predicted from connectomics data.

Multilevel development of cognitive abilities in an artificial neural network

Several neuronal mechanisms have been proposed to account for the formation of cognitive abilities through postnatal interactions with the physical and sociocultural environment. Here, we introduce a three-level computational model of information processing and acquisition of cognitive abilities. We propose minimal architectural requirements to build these levels, and how the parameters affect their performance and relationships. The first sensorimotor level handles local nonconscious processing, here during a visual classification task. The second level or cognitive level globally integrates the information from multiple local processors via long-ranged connections and synthesizes it in a global, but still nonconscious, manner. The third and cognitively highest level handles the information globally and consciously. It is based on the global neuronal workspace (GNW) theory and is referred to as the conscious level. We use the trace and delay conditioning tasks to, respectively, challenge the second and third levels. Results first highlight the necessity of epigenesis through the selection and stabilization of synapses at both local and global scales to allow the network to solve the first two tasks. At the global scale, dopamine appears necessary to properly provide credit assignment despite the temporal delay between perception and reward. At the third level, the presence of interneurons becomes necessary to maintain a self-sustained representation within the GNW in the absence of sensory input. Finally, while balanced spontaneous intrinsic activity facilitates epigenesis at both local and global scales, the balanced excitatory/inhibitory ratio increases performance. We discuss the plausibility of the model in both neurodevelopmental and artificial intelligence terms.

Neuroscience: Mechanisms for bridging stimuli in Pavlovian trace conditioning in flies

A recent study revealed neural mechanisms underlying visual trace conditioning in flies. To associate visual stimuli with heat punishment, the activity of visual- and heat-processing circuits was extended into the gap between them. Distractors delivered during the gap disrupted learning, raising the question of the cognitive processes at play.

Dopamine promotes head direction plasticity during orienting movements

In neural networks that store information in their connection weights, there is a tradeoff between sensitivity and stability^1,2. Connections must be plastic to incorporate new information, but if they are too plastic, stored information can be corrupted. A potential solution is to allow plasticity only during epochs when task-specific information is rich, on the basis of a 'when-to-learn' signal³. We reasoned that dopamine provides a when-to-learn signal that allows the brain's spatial maps to update when new spatial information is available-that is, when an animal is moving. Here we show that the dopamine neurons innervating the Drosophila head direction network are specifically active when the fly turns to change its head direction. Moreover, their activity scales with moment-to-moment fluctuations in rotational speed. Pairing dopamine release with a visual cue persistently strengthens the cue's influence on head direction cells. Conversely, inhibiting these dopamine neurons decreases the influence of the cue. This mechanism should accelerate learning during moments when orienting movements are providing a rich stream of head direction information, allowing learning rates to be low at other times to protect stored information. Our results show how spatial learning in the brain can be compressed into discrete epochs in which high learning rates are matched to high rates of information intake.