Multisensory learning binds neurons into a cross-modal memory engram

Theory of morphodynamic information processing: Linking sensing to behaviour

The traditional understanding of brain function has predominantly focused on chemical and electrical processes. However, new research in fruit fly (Drosophila) binocular vision reveals ultrafast photomechanical photoreceptor movements significantly enhance information processing, thereby impacting a fly's perception of its environment and behaviour. The coding advantages resulting from these mechanical processes suggest that similar physical motion-based coding strategies may affect neural communication ubiquitously. The theory of neural morphodynamics proposes that rapid biomechanical movements and microstructural changes at the level of neurons and synapses enhance the speed and efficiency of sensory information processing, intrinsic thoughts, and actions by regulating neural information in a phasic manner. We propose that morphodynamic information processing evolved to drive predictive coding, synchronising cognitive processes across neural networks to match the behavioural demands at hand effectively.

Neuronal circuit mechanisms of competitive interaction between action-based and coincidence learning

How information is integrated across different forms of learning is crucial to understanding higher cognitive functions. Animals form classic or operant associations between cues and their outcomes. It is believed that a prerequisite for operant conditioning is the formation of a classical association. Thus, both memories coexist and are additive. However, the two memories can result in opposing behavioral responses, which can be disadvantageous. We show that Drosophila classical and operant olfactory conditioning rely on distinct neuronal pathways leading to different behavioral responses. Plasticity in both pathways cannot be formed simultaneously. If plasticity occurs at both pathways, interference between them occurs and learning is disrupted. Activity of the navigation center is required to prevent plasticity in the classical pathway and enable it in the operant pathway. These findings fundamentally challenge hierarchical views of operant and classical learning and show that active processes prevent coexistence of the two memories.

Study of a precise treatment protocol for patients with consciousness disorders based on the brain network analysis of functional magnetic resonance imaging

Objective

How to conduct objective and accurate individualized assessments of patients with disorders of consciousness (DOC) and carry out precision rehabilitation treatment technology is a major rehabilitation problem that needs to be solved urgently.

Methods

In this study, a multi-layer brain network was constructed based on functional magnetic resonance imaging (fMRI) to analyze the structural and functional brain networks of patients with DOC at different levels and to find regulatory targets (imaging markers) with recovery potential for DOC. Then repeated transcranial magnetic stimulation (rTMS) was performed in DOC patients to clinically validate.

Results

The brain network connectivity of DOC patients with different consciousness states is different, and the most obvious brain regions appeared in the olfactory cortex and precuneus. rTMS stimulation could effectively improve the consciousness level of DOC patients and stimulate the occipital lobe (specific regions found in this study) and the dorsolateral prefrontal cortex (DLPFC), and both parts had a good consciousness recovery effect.

Conclusion

In clinical work, personalized stimulation regimen treatment combined with the brain network characteristics of DOC patients can improve the treatment effect.

Diversity of visual inputs to Kenyon cells of the Drosophila mushroom body

The arthropod mushroom body is well-studied as an expansion layer representing olfactory stimuli and linking them to contingent events. However, 8% of mushroom body Kenyon cells in Drosophila melanogaster receive predominantly visual input, and their function remains unclear. Here, we identify inputs to visual Kenyon cells using the FlyWire adult whole-brain connectome. Input repertoires are similar across hemispheres and connectomes with certain inputs highly overrepresented. Many visual neurons presynaptic to Kenyon cells have large receptive fields, while interneuron inputs receive spatially restricted signals that may be tuned to specific visual features. Individual visual Kenyon cells randomly sample sparse inputs from combinations of visual channels, including multiple optic lobe neuropils. These connectivity patterns suggest that visual coding in the mushroom body, like olfactory coding, is sparse, distributed, and combinatorial. However, the specific input repertoire to the smaller population of visual Kenyon cells suggests a constrained encoding of visual stimuli.

Common principles for odour coding across vertebrates and invertebrates

The olfactory system is an ideal and tractable system for exploring how the brain transforms sensory inputs into behaviour. The basic tasks of any olfactory system include odour detection, discrimination and categorization. The challenge for the olfactory system is to transform the high-dimensional space of olfactory stimuli into the much smaller space of perceived objects and valence that endows odours with meaning. Our current understanding of how neural circuits address this challenge has come primarily from observations of the mechanisms of the brain for processing other sensory modalities, such as vision and hearing, in which optimized deep hierarchical circuits are used to extract sensory features that vary along continuous physical dimensions. The olfactory system, by contrast, contends with an ill-defined, high-dimensional stimulus space and discrete stimuli using a circuit architecture that is shallow and parallelized. Here, we present recent observations in vertebrate and invertebrate systems that relate the statistical structure and state-dependent modulation of olfactory codes to mechanisms of perception and odour-guided behaviour.

Diverse memory paradigms in Drosophila reveal diverse neural mechanisms

In this review, we aggregated the different types of learning and memory paradigms developed in adult Drosophila and attempted to assess the similarities and differences in the neural mechanisms supporting diverse types of memory. The simplest association memory assays are conditioning paradigms (olfactory, visual, and gustatory). A great deal of work has been done on these memories, revealing hundreds of genes and neural circuits supporting this memory. Variations of conditioning assays (reversal learning, trace conditioning, latent inhibition, and extinction) also reveal interesting memory mechanisms, whereas mechanisms supporting spatial memory (thermal maze, orientation memory, and heat box) and the conditioned suppression of innate behaviors (phototaxis, negative geotaxis, anemotaxis, and locomotion) remain largely unexplored. In recent years, there has been an increased interest in multisensory and multicomponent memories (context-dependent and cross-modal memory) and higher-order memory (sensory preconditioning and second-order conditioning). Some of this work has revealed how the intricate mushroom body (MB) neural circuitry can support more complex memories. Finally, the most complex memories are arguably those involving social memory: courtship conditioning and social learning (mate-copying and egg-laying behaviors). Currently, very little is known about the mechanisms supporting social memories. Overall, the MBs are important for association memories of multiple sensory modalities and multisensory integration, whereas the central complex is important for place, orientation, and navigation memories. Interestingly, several different types of memory appear to use similar or variants of the olfactory conditioning neural circuitry, which are repurposed in different ways.

Skewing information flow through pre- and postsynaptic plasticity in the mushroom bodies of Drosophila

Animal brains need to store information to construct a representation of their environment. Knowledge of what happened in the past allows both vertebrates and invertebrates to predict future outcomes by recalling previous experience. Although invertebrate and vertebrate brains share common principles at the molecular, cellular, and circuit-architectural levels, there are also obvious differences as exemplified by the use of acetylcholine versus glutamate as the considered main excitatory neurotransmitters in the respective central nervous systems. Nonetheless, across central nervous systems, synaptic plasticity is thought to be a main substrate for memory storage. Therefore, how brain circuits and synaptic contacts change following learning is of fundamental interest for understanding brain computations tied to behavior in any animal. Recent progress has been made in understanding such plastic changes following olfactory associative learning in the mushroom bodies (MBs) of Drosophila A current framework of memory-guided behavioral selection is based on the MB skew model, in which antagonistic synaptic pathways are selectively changed in strength. Here, we review insights into plasticity at dedicated Drosophila MB output pathways and update what is known about the plasticity of both pre- and postsynaptic compartments of Drosophila MB neurons.

Unravelling the multisensory learning advantage: Different patterns of within and across frequency-specific interactions drive uni- and multisensory neuroplasticity

In the field of learning theory and practice, the superior efficacy of multisensory learning over uni-sensory is well-accepted. However, the underlying neural mechanisms at the macro-level of the human brain remain largely unexplored. This study addresses this gap by providing novel empirical evidence and a theoretical framework for understanding the superiority of multisensory learning. Through a cognitive, behavioral, and electroencephalographic assessment of carefully controlled uni-sensory and multisensory training interventions, our study uncovers a fundamental distinction in their neuroplastic patterns. A multilayered network analysis of pre- and post- training EEG data allowed us to model connectivity within and across different frequency bands at the cortical level. Pre-training EEG analysis unveils a complex network of distributed sources communicating through cross-frequency coupling, while comparison of pre- and post-training EEG data demonstrates significant differences in the reorganizational patterns of uni-sensory and multisensory learning. Uni-sensory training primarily modifies cross-frequency coupling between lower and higher frequencies, whereas multisensory training induces changes within the beta band in a more focused network, implying the development of a unified representation of audiovisual stimuli. In combination with behavioural and cognitive findings this suggests that, multisensory learning benefits from an automatic top-down transfer of training, while uni-sensory training relies mainly on limited bottom-up generalization. Our findings offer a compelling theoretical framework for understanding the advantage of multisensory learning.

An integrative sensor of body states: how the mushroom body modulates behavior depending on physiological context

The brain constantly compares past and present experiences to predict the future, thereby enabling instantaneous and future behavioral adjustments. Integration of external information with the animal's current internal needs and behavioral state represents a key challenge of the nervous system. Recent advancements in dissecting the function of the Drosophila mushroom body (MB) at the single-cell level have uncovered its three-layered logic and parallel systems conveying positive and negative values during associative learning. This review explores a lesser-known role of the MB in detecting and integrating body states such as hunger, thirst, and sleep, ultimately modulating motivation and sensory-driven decisions based on the physiological state of the fly. State-dependent signals predominantly affect the activity of modulatory MB input neurons (dopaminergic, serotoninergic, and octopaminergic), but also induce plastic changes directly at the level of the MB intrinsic and output neurons. Thus, the MB emerges as a tightly regulated relay station in the insect brain, orchestrating neuroadaptations due to current internal and behavioral states leading to short- but also long-lasting changes in behavior. While these adaptations are crucial to ensure fitness and survival, recent findings also underscore how circuit motifs in the MB may reflect fundamental design principles that contribute to maladaptive behaviors such as addiction or depression-like symptoms.

Sensory encoding and memory in the mushroom body: signals, noise, and variability

To survive in changing environments, animals need to learn to associate specific sensory stimuli with positive or negative valence. How do they form stimulus-specific memories to distinguish between positively/negatively associated stimuli and other irrelevant stimuli? Solving this task is one of the functions of the mushroom body, the associative memory center in insect brains. Here we summarize recent work on sensory encoding and memory in the Drosophila mushroom body, highlighting general principles such as pattern separation, sparse coding, noise and variability, coincidence detection, and spatially localized neuromodulation, and placing the mushroom body in comparative perspective with mammalian memory systems.

Cognitive limits of larval Drosophila: testing for conditioned inhibition, sensory preconditioning, and second-order conditioning

Drosophila larvae are an established model system for studying the mechanisms of innate and simple forms of learned behavior. They have about 10 times fewer neurons than adult flies, and it was the low total number of their neurons that allowed for an electron microscopic reconstruction of their brain at synaptic resolution. Regarding the mushroom body, a central brain structure for many forms of associative learning in insects, it turned out that more than half of the classes of synaptic connection had previously escaped attention. Understanding the function of these circuit motifs, subsequently confirmed in adult flies, is an important current research topic. In this context, we test larval Drosophila for their cognitive abilities in three tasks that are characteristically more complex than those previously studied. Our data provide evidence for (i) conditioned inhibition, as has previously been reported for adult flies and honeybees. Unlike what is described for adult flies and honeybees, however, our data do not provide evidence for (ii) sensory preconditioning or (iii) second-order conditioning in Drosophila larvae. We discuss the methodological features of our experiments as well as four specific aspects of the organization of the larval brain that may explain why these two forms of learning are observed in adult flies and honeybees, but not in larval Drosophila.

Use-Dependent, Untapped Dual Kinase Signaling Localized in Brain Learning Circuitry

Imaging brain learning and memory circuit kinase signaling is a monumental challenge. The separation of phases-based activity reporter of kinase (SPARK) biosensors allow circuit-localized studies of multiple interactive kinases in vivo, including protein kinase A (PKA) and extracellular signal-regulated kinase (ERK) signaling. In the precisely-mapped Drosophila brain learning/memory circuit, we find PKA and ERK signaling differentially enriched in distinct Kenyon cell connectivity nodes. We discover that potentiating normal circuit activity induces circuit-localized PKA and ERK signaling, expanding kinase function within new presynaptic and postsynaptic domains. Activity-induced PKA signaling shows extensive overlap with previously selective ERK signaling nodes, while activity-induced ERK signaling arises in new connectivity nodes. We find targeted synaptic transmission blockade in Kenyon cells elevates circuit-localized ERK induction in Kenyon cells with normally high baseline ERK signaling, suggesting lateral and feedback inhibition. We discover overexpression of the pathway-linking Meng-Po (human SBK1) serine/threonine kinase to improve learning acquisition and memory consolidation results in dramatically heightened PKA and ERK signaling in separable Kenyon cell circuit connectivity nodes, revealing both synchronized and untapped signaling potential. Finally, we find that a mechanically-induced epileptic seizure model (easily shocked "bang-sensitive" mutants) has strongly elevated, circuit-localized PKA and ERK signaling. Both sexes were used in all experiments, except for the hemizygous male-only seizure model. Hyperexcitable, learning-enhanced, and epileptic seizure models have comparably elevated interactive kinase signaling, suggesting a common basis of use-dependent induction. We conclude that PKA and ERK signaling modulation is locally coordinated in use-dependent spatial circuit dynamics underlying seizure susceptibility linked to learning/memory potential.

Exploring the memory: existing activity-dependent tools to tag and manipulate engram cells

The theory of engrams, proposed several years ago, is highly crucial to understanding the progress of memory. Although it significantly contributes to identifying new treatments for cognitive disorders, it is limited by a lack of technology. Several scientists have attempted to validate this theory but failed. With the increasing availability of activity-dependent tools, several researchers have found traces of engram cells. Activity-dependent tools are based on the mechanisms underlying neuronal activity and use a combination of emerging molecular biological and genetic technology. Scientists have used these tools to tag and manipulate engram neurons and identified numerous internal connections between engram neurons and memory. In this review, we provide the background, principles, and selected examples of applications of existing activity-dependent tools. Using a combination of traditional definitions and concepts of engram cells, we discuss the applications and limitations of these tools and propose certain developmental directions to further explore the functions of engram cells.

Combinatory Actions of Co-transmitters in Dopaminergic Systems Modulate Drosophila Olfactory Memories

Dopamine neurons (DANs) are extensively studied in the context of associative learning, in both vertebrates and invertebrates. In the acquisition of male and female Drosophila olfactory memory, the PAM cluster of DANs provides the reward signal, and the PPL1 cluster of DANs sends the punishment signal to the Kenyon cells (KCs) of mushroom bodies, the center for memory formation. However, thermo-genetical activation of the PPL1 DANs after memory acquisition impaired aversive memory, and that of the PAM DANs impaired appetitive memory. We demonstrate that the knockdown of glutamate decarboxylase, which catalyzes glutamate conversion to GABA in PAM DANs, potentiated the appetitive memory. In addition, the knockdown of glutamate transporter in PPL1 DANs potentiated aversive memory, suggesting that GABA and glutamate co-transmitters act in an inhibitory manner in olfactory memory formation. We also found that, in γKCs, the Rdl receptor for GABA and the mGluR DmGluRA mediate the inhibition. Although multiple-spaced training is required to form long-term aversive memory, a single cycle of training was sufficient to develop long-term memory when the glutamate transporter was knocked down, in even a single subset of PPL1 DANs. Our results suggest that the mGluR signaling pathway may set a threshold for memory acquisition to allow the organisms' behaviors to adapt to changing physiological conditions and environments.SIGNIFICANCE STATEMENT In the acquisition of olfactory memory in Drosophila, the PAM cluster of dopamine neurons (DANs) mediates the reward signal, while the PPL1 cluster of DANs conveys the punishment signal to the Kenyon cells of the mushroom bodies, which serve as the center for memory formation. We found that GABA co-transmitters in the PAM DANs and glutamate co-transmitters in the PPL1 DANs inhibit olfactory memory formation. Our findings demonstrate that long-term memory acquisition, which typically necessitates multiple-spaced training sessions to establish aversive memory, can be triggered with a single training cycle in cases where the glutamate co-transmission is inhibited, even within a single subset of PPL1 DANs, suggesting that the glutamate co-transmission may modulate the threshold for memory acquisition.

A New Behavioral Paradigm for Visual Classical Conditioning in Drosophila

Visual learning in animals is a remarkable cognitive ability that plays a crucial role in their survival and adaptation. Therefore, the ability to learn is highly conserved among animals. Despite lacking a centralized nervous system like vertebrates, invertebrates have demonstrated remarkable learning abilities. Here, we describe a simple behavioral assay that allows the analysis of visual associative learning in individually traceable freely walking adult fruit flies. The setup is based on the simple and widely used behavioral assay to study orientation behavior in flies. A single wing-clipped fly that has been starved for 21 h is placed on a platform where two unreachable opposite visual sets are displayed. This visual learning protocol was initially developed to study the cognitive ability of fruit flies to process numerical information. Through the application of the protocol, flies are able to associate a specific visual set with an appetitive reward. This association is revealed 2 h later during the testing session where we observed a change in their preference upon learning (i.e., change in their spontaneous preference). Moreover, this protocol could potentially be used to associate any other visual object/property to the reward, expanding the opportunities of studying visual learning in freely walking fruit flies at individual level.

Diversity of visual inputs to Kenyon cells of the Drosophila mushroom body

The arthropod mushroom body is well-studied as an expansion layer that represents olfactory stimuli and links them to contingent events. However, 8% of mushroom body Kenyon cells in Drosophila melanogaster receive predominantly visual input, and their tuning and function are poorly understood. Here, we use the FlyWire adult whole-brain connectome to identify inputs to visual Kenyon cells. The types of visual neurons we identify are similar across hemispheres and connectomes with certain inputs highly overrepresented. Many visual projection neurons presynaptic to Kenyon cells receive input from large swathes of visual space, while local visual interneurons, providing smaller fractions of input, receive more spatially restricted signals that may be tuned to specific features of the visual scene. Like olfactory Kenyon cells, visual Kenyon cells receive sparse inputs from different combinations of visual channels, including inputs from multiple optic lobe neuropils. The sets of inputs to individual visual Kenyon cells are consistent with random sampling of available inputs. These connectivity patterns suggest that visual coding in the mushroom body, like olfactory coding, is sparse, distributed, and combinatorial. However, the expansion coding properties appear different, with a specific repertoire of visual inputs projecting onto a relatively small number of visual Kenyon cells.

Neuroscience: Merging multisensory memories

How animals form and retain memories across multiple sensory modalities and how multisensory learning can enhance memory is largely unknown. A recent study sheds light on the neural mechanism underlying multisensory memory convergence in the Drosophila melanogaster brain.

Crossmodal association between visual and acoustic cues in a tortoise (Testudo hermanni)

Humans spontaneously match information coming from different senses, in what we call crossmodal associations. For instance, high-pitched sounds are preferentially associated with small objects, and low-pitched sounds with larger ones. Although previous studies reported crossmodal associations in mammalian species, evidence for other taxa is scarce, hindering an evolutionary understanding of this phenomenon. Here, we provide evidence of pitch-size correspondence in a reptile, the tortoise Testudo hermanni. Tortoises showed a spontaneous preference to associate a small disc (i.e. visual information about size) with a high-pitch sound (i.e. auditory information) and a larger disc to a low-pitched sound. These results suggest that crossmodal associations may be an evolutionary ancient phenomenon, potentially an organizing principle of the vertebrate brain.

Aversive Bimodal Associations Differently Impact Visual and Olfactory Memory Performance in Drosophila

Animals form sensory associations and store them as memories to guide behavioral decisions. Although unimodal learning has been studied extensively in insects, it is important to explore sensory cues in combination because most behaviors require multimodal inputs. In our study, we optimized the T-maze to employ both visual and olfactory cues in a classical aversive learning paradigm in Drosophila melanogaster. In contrast to unimodal training, bimodal training evoked a significant short-term visual memory after a single training trial. Interestingly, the same protocol did not enhance short-term olfactory memory and even had a negative impact. However, compromised long-lasting olfactory memory significantly improved after bimodal training. Our study demonstrates that the effect of bimodal integration on learning is not always beneficial and is conditional upon the formed memory strengths. We postulate that flies utilize information on a need-to basis: bimodal training augments weakly formed memories while stronger associations are impacted differently.