CaMKII Measures the Passage of Time to Coordinate Behavior and Motivational State

Dopamine biases decisions by limiting temporal integration

Motivations bias our responses to stimuli, producing behavioural outcomes that match our needs and goals. Here we describe a mechanism behind this phenomenon: adjusting the time over which stimulus-derived information is permitted to accumulate towards a decision. As a Drosophila copulation progresses, the male becomes less likely to continue mating through challenges1-3. We show that a set of copulation decision neurons (CDNs) flexibly integrates information about competing drives to mediate this decision. Early in mating, dopamine signalling restricts CDN integration time by potentiating Ca2+/calmodulin-dependent protein kinase II (CaMKII) activation in response to stimulatory inputs, imposing a high threshold for changing behaviours. Later into mating, the timescale over which the CDNs integrate termination-promoting information expands, increasing the likelihood of switching behaviours. We suggest scalable windows of temporal integration at dedicated circuit nodes as a key but underappreciated variable in state-based decision-making.

Neural activity ramps in frontal cortex signal extended motivation during learning

Learning requires the ability to link actions to outcomes. How motivation facilitates learning is not well understood. We designed a behavioral task in which mice self-initiate trials to learn cue-reward contingencies and found that the anterior cingulate region of the prefrontal cortex (ACC) contains motivation-related signals to maximize rewards. In particular, we found that ACC neural activity was consistently tied to trial initiations where mice seek to leave unrewarded cues to reach reward-associated cues. Notably, this neural signal persisted over consecutive unrewarded cues until reward-associated cues were reached, and was required for learning. To determine how ACC inherits this motivational signal we performed projection-specific photometry recordings from several inputs to ACC during learning. In doing so, we identified a ramp in bulk neural activity in orbitofrontal cortex (OFC)-to-ACC projections as mice received unrewarded cues, which continued ramping across consecutive unrewarded cues, and finally peaked upon reaching a reward-associated cue, thus maintaining an extended motivational state. Cellular resolution imaging of OFC confirmed these neural correlates of motivation, and further delineated separate ensembles of neurons that sequentially tiled the ramp. Together, these results identify a mechanism by which OFC maps out task structure to convey an extended motivational state to ACC to facilitate goal-directed learning.

Molecular control of temporal integration matches decision-making to motivational state

Motivations bias our responses to stimuli, producing behavioral outcomes that match our needs and goals. We describe a mechanism behind this phenomenon: adjusting the time over which stimulus-derived information is permitted to accumulate toward a decision. As a Drosophila copulation progresses, the male becomes less likely to continue mating through challenges. We show that a set of Copulation Decision Neurons (CDNs) flexibly integrates information about competing drives to mediate this decision. Early in mating, dopamine signaling restricts CDN integration time by potentiating CaMKII activation in response to stimulatory inputs, imposing a high threshold for changing behaviors. Later into mating, the timescale over which the CDNs integrate termination-promoting information expands, increasing the likelihood of switching behaviors. We suggest scalable windows of temporal integration at dedicated circuit nodes as a key but underappreciated variable in state-based decision-making.

Protocol to investigate the neural basis for copulation posture of Drosophila using a closed-loop real-time optogenetic system

In internal fertilization animals, maintaining a copulation posture facilitates the process of transporting gametes from male to female. Here, we present a protocol to investigate the neural basis for copulation posture of fruit flies using a closed-loop real-time optogenetic system. We describe steps for using deep learning analysis to enable optogenetic manipulation of neural activity only during copulation with high efficiency. This system can be applied to various animal behaviors other than copulation. For complete details on the use and execution of this protocol, please refer to Yamanouchi et al. (2023).1.

Neuronal calcium spikes enable vector inversion in the Drosophila brain

A typical neuron signals to downstream cells when it is depolarized and firing sodium spikes. Some neurons, however, also fire calcium spikes when hyperpolarized. The function of such bidirectional signaling remains unclear in most circuits. Here we show how a neuron class that participates in vector computation in the fly central complex employs hyperpolarization-elicited calcium spikes to invert two-dimensional mathematical vectors. When cells switch from firing sodium to calcium spikes, this leads to a ~180° realignment between the vector encoded in the neuronal population and the fly's internal heading signal, thus inverting the vector. We show that the calcium spikes rely on the T-type calcium channel Ca-α1T, and argue, via analytical and experimental approaches, that these spikes enable vector computations in portions of angular space that would otherwise be inaccessible. These results reveal a seamless interaction between molecular, cellular and circuit properties for implementing vector math in the brain.

Synaptic BMAL1 phosphorylation controls circadian hippocampal plasticity

The time of day strongly influences adaptive behaviors like long-term memory, but the correlating synaptic and molecular mechanisms remain unclear. The circadian clock comprises a canonical transcription-translation feedback loop (TTFL) strictly dependent on the BMAL1 transcription factor. We report that BMAL1 rhythmically localizes to hippocampal synapses in a manner dependent on its phosphorylation at Ser42 [pBMAL1(S42)]. pBMAL1(S42) regulates the autophosphorylation of synaptic CaMKIIα and circadian rhythms of CaMKIIα-dependent molecular interactions and LTP but not global rest/activity behavior. Therefore, our results suggest a model in which repurposing of the clock protein BMAL1 to synapses locally gates the circadian timing of plasticity.

Lost in time: Relocating the perception of duration outside the brain

It is well-accepted in neuroscience that animals process time internally to estimate the duration of intervals lasting between one and several seconds. More than 100 years ago, Henri Bergson nevertheless remarked that, because animals have memory, their inner experience of time is ever-changing, making duration impossible to measure internally and time a source of change. Bergson proposed that quantifying the inner experience of time requires its externalization in movements (observed or self-generated), as their unfolding leaves measurable traces in space. Here, studies across species are reviewed and collectively suggest that, in line with Bergson's ideas, animals spontaneously solve time estimation tasks through a movement-based spatialization of time. Moreover, the well-known scalable anticipatory responses of animals to regularly spaced rewards can be explained by the variable pressure of time on reward-oriented actions. Finally, the brain regions linked with time perception overlap with those implicated in motor control, spatial navigation and motivation. Thus, instead of considering time as static information processed by the brain, it might be fruitful to conceptualize it as a kind of force to which animals are more or less sensitive depending on their internal state and environment.

The role of calcium and CaMKII in sleep

Sleep is an evolutionarily conserved phenotype shared by most of the animals on the planet. Prolonged wakefulness will result in increased sleep need or sleep pressure. However, its mechanisms remain elusive. Recent findings indicate that Ca²⁺ signaling, known to control diverse physiological functions, also regulates sleep. This review intends to summarize research advances in Ca²⁺ and Ca²⁺/calmodulin-dependent protein kinase II (CaMKII) in sleep regulation. Significant changes in sleep phenotype have been observed through calcium-related channels, receptors, and pumps. Mathematical modeling for neuronal firing patterns during NREM sleep suggests that these molecules compose a Ca²⁺-dependent hyperpolarization mechanism. The intracellular Ca²⁺ may then trigger sleep induction and maintenance through the activation of CaMKII, one of the sleep-promoting kinases. CaMKII and its multisite phosphorylation status may provide a link between transient calcium dynamics typically observed in neurons and sleep-wake dynamics observed on the long-time scale.

Flexibility of neural circuits regulating mating behaviors in mice and flies

Mating is essential for the reproduction of animal species. As mating behaviors are high-risk and energy-consuming processes, it is critical for animals to make adaptive mating decisions. This includes not only finding a suitable mate, but also adapting mating behaviors to the animal's needs and environmental conditions. Internal needs include physical states (e.g., hunger) and emotional states (e.g., fear), while external conditions include both social cues (e.g., the existence of predators or rivals) and non-social factors (e.g., food availability). With recent advances in behavioral neuroscience, we are now beginning to understand the neural basis of mating behaviors, particularly in genetic model organisms such as mice and flies. However, how internal and external factors are integrated by the nervous system to enable adaptive mating-related decision-making in a state- and context-dependent manner is less well understood. In this article, we review recent knowledge regarding the neural basis of flexible mating behaviors from studies of flies and mice. By contrasting the knowledge derived from these two evolutionarily distant model organisms, we discuss potential conserved and divergent neural mechanisms involved in the control of flexible mating behaviors in invertebrate and vertebrate brains.

“Jing-Ning Granules” Can Alleviate Attention Deficit Hyperactivity Disorder in Rats by Modulating Dopaminergic D2/D1-Like Receptor-Mediated Signaling Pathways

Background

Attention deficit hyperactivity disorder (ADHD) is a neurodevelopmental disorder characterized by attention deficit, hyperactivity, and impulsivity. Jing-Ning Granules (JNG) is a traditional Chinese medicine (TCM) that can alleviate ADHD. Although JNG is commonly used for the effective treatment of ADHD and has obtained the national invention patent, the exact mechanism of action remains unclear.

Objective

In this study, we examined the effect and mechanism of JNG in spontaneously hypertensive rats (SHRs). We hypothesized that JNG affects dopaminergic D2/D1-like receptors and related pathways.

Materials and Methods

Six rat groups were used in the experiment: Wistar-Kyoto rats (WKY, control group) and five SHR groups, including a model group; atomoxetine (ATX, positive control) group; and low, medium, and high-dose JNG groups. The corresponding treatments were daily administered to each group for 6 weeks. A behavioral test, including a step-down test and open field test (OFT), was carried out at the end of treatment. After the behavioral test, all animals were sacrificed, and the brain tissue was collected and analyzed ex vivo; histopathological analysis was performed to assess the pathological changes of the hippocampus; expression of D1-like and D2-like receptors, sensor protein calmodulin (CaM), protein kinase A (PKA), and calcium/calmodulin-dependent serine/threonine protein kinase (CaMKII) in the striatum and hippocampus was measured by western blot and real-time quantitative PCR (RT-PCR); cyclic adenosine monophosphate (cAMP) levels in the striatum were analyzed using an enzyme-linked immunosorbent assay (ELISA), while the level of Ca²⁺ in the striatum was analyzed by a calcium kit.

Results

Our results showed that ATX or JNG could ameliorate the hyperactive/impulsive behavior and cognitive function of ADHD by promoting neuroprotection. Mechanistically, ATX or JNG could prompt the expressions of Dl-like and D2-like receptors and improve the mRNA and protein levels of cAMP/PKA and Ca²⁺/CAM/CAMKII signaling pathways.

Conclusion

These results indicate that JNG can produce therapeutic effects by regulating the balance of D2/D1-like receptor-mediated cAMP/PKA and Ca²⁺/CaM/CaMKII signaling pathways.

Distinct phosphorylation states of mammalian CaMKIIβ control the induction and maintenance of sleep

The reduced sleep duration previously observed in Camk2b knockout mice revealed a role for Ca2+/calmodulin-dependent protein kinase II (CaMKII)β as a sleep-promoting kinase. However, the underlying mechanism by which CaMKIIβ supports sleep regulation is largely unknown. Here, we demonstrate that activation or inhibition of CaMKIIβ can increase or decrease sleep duration in mice by almost 2-fold, supporting the role of CaMKIIβ as a core sleep regulator in mammals. Importantly, we show that this sleep regulation depends on the kinase activity of CaMKIIβ. A CaMKIIβ mutant mimicking the constitutive-active (auto)phosphorylation state promotes the transition from awake state to sleep state, while mutants mimicking subsequent multisite (auto)phosphorylation states suppress the transition from sleep state to awake state. These results suggest that the phosphorylation states of CaMKIIβ differently control sleep induction and maintenance processes, leading us to propose a "phosphorylation hypothesis of sleep" for the molecular control of sleep in mammals.

How do real animals account for the passage of time during associative learning?

Animals routinely learn to associate environmental stimuli and self-generated actions with their outcomes such as rewards. One of the most popular theoretical models of such learning is the reinforcement learning (RL) framework. The simplest form of RL, model-free RL, is widely applied to explain animal behavior in numerous neuroscientific studies. More complex RL versions assume that animals build and store an explicit model of the world in memory. To apply these approaches to explain animal behavior, typical neuroscientific RL models make implicit assumptions about how real animals represent the passage of time. In this perspective, I explicitly list these assumptions and show that they have several problematic implications. I hope that the explicit discussion of these problems encourages the field to seriously examine the assumptions underlying timing and reinforcement learning. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

CaMKII: a central molecular organizer of synaptic plasticity, learning and memory

Calcium-calmodulin (CaM)-dependent protein kinase II (CaMKII) is the most abundant protein in excitatory synapses and is central to synaptic plasticity, learning and memory. It is activated by intracellular increases in calcium ion levels and triggers molecular processes necessary for synaptic plasticity. CaMKII phosphorylates numerous synaptic proteins, thereby regulating their structure and functions. This leads to molecular events crucial for synaptic plasticity, such as receptor trafficking, localization and activity; actin cytoskeletal dynamics; translation; and even transcription through synapse-nucleus shuttling. Several new tools affording increasingly greater spatiotemporal resolution have revealed the link between CaMKII activity and downstream signalling processes in dendritic spines during synaptic and behavioural plasticity. These technologies have provided insights into the function of CaMKII in learning and memory.

The emergence and influence of internal states

Animal behavior is shaped by a variety of "internal states"-partially hidden variables that profoundly shape perception, cognition, and action. The neural basis of internal states, such as fear, arousal, hunger, motivation, aggression, and many others, is a prominent focus of research efforts across animal phyla. Internal states can be inferred from changes in behavior, physiology, and neural dynamics and are characterized by properties such as pleiotropy, persistence, scalability, generalizability, and valence. To date, it remains unclear how internal states and their properties are generated by nervous systems. Here, we review recent progress, which has been driven by advances in behavioral quantification, cellular manipulations, and neural population recordings. We synthesize research implicating defined subsets of state-inducing cell types, widespread changes in neural activity, and neuromodulation in the formation and updating of internal states. In addition to highlighting the significance of these findings, our review advocates for new approaches to clarify the underpinnings of internal brain states across the animal kingdom.

Calcium signaling in neurodevelopment and pathophysiology of autism spectrum disorders

BACKGROUND

Autism spectrum disorder (ASD) covers a group of neurodevelopmental disorders with complex genetic background. Several genetic mutations, epigenetic alterations, copy number variations and single nucleotide polymorphisms have been reported that cause ASD or modify its phenotype. Among signaling pathways that influence pathogenesis of ASD, calcium signaling has a prominent effect.

METHODS

We searched PubMed and Google Scholar databases with key words "Calcium signaling" and "Autism spectrum disorder".

CONCLUSION

This type of signaling has essential roles in the cell physiology. Endoplasmic reticulum and mitochondria are the key organelles involved in this signaling. It is vastly accepted that organellar disorders intensely influence the central nervous system (CNS). Several lines of evidence indicate alterations in the function of calcium channels in polygenic disorders affecting CNS. In the current review, we describe the role of calcium signaling in normal function of CNS and pathophysiology of ASD.

A connectome of the Drosophila central complex reveals network motifs suitable for flexible navigation and context-dependent action selection

Flexible behaviors over long timescales are thought to engage recurrent neural networks in deep brain regions, which are experimentally challenging to study. In insects, recurrent circuit dynamics in a brain region called the central complex (CX) enable directed locomotion, sleep, and context- and experience-dependent spatial navigation. We describe the first complete electron-microscopy-based connectome of the Drosophila CX, including all its neurons and circuits at synaptic resolution. We identified new CX neuron types, novel sensory and motor pathways, and network motifs that likely enable the CX to extract the fly's head-direction, maintain it with attractor dynamics, and combine it with other sensorimotor information to perform vector-based navigational computations. We also identified numerous pathways that may facilitate the selection of CX-driven behavioral patterns by context and internal state. The CX connectome provides a comprehensive blueprint necessary for a detailed understanding of network dynamics underlying sleep, flexible navigation, and state-dependent action selection.

Drosophila Corazonin Neurons as a Hub for Regulating Growth, Stress Responses, Ethanol-Related Behaviors, Copulation Persistence and Sexually Dimorphic Reward Pathways

The neuronal mechanisms by which complex behaviors are coordinated and timed often involve neuropeptidergic regulation of stress and reward pathways. Recent studies of the neuropeptide Corazonin (Crz), a homolog of the mammalian Gonadotrophin Releasing Hormone (GnRH), have suggested its crucial role in the regulation of growth, internal states and behavioral decision making. We focus this review on Crz neurons with the goal to (1) highlight the diverse roles of Crz neuron function, including mechanisms that may be independent of the Crz peptide, (2) emphasize current gaps in knowledge about Crz neuron functions, and (3) propose exciting ideas of novel research directions involving the use of Crz neurons. We describe the different developmental fates of distinct subsets of Crz neurons, including recent findings elucidating the molecular regulation of apoptosis. Crz regulates systemic growth, food intake, stress responses and homeostasis by interacting with the short Neuropeptide F (sNPF) and the steroid hormone ecdysone. Additionally, activation of Crz neurons is shown to be pleasurable by interacting with the Neuropeptide F (NPF) and regulates reward processes such as ejaculation and ethanol-related behaviors in a sexually dimorphic manner. Crz neurons are proposed to be a motivational switch regulating copulation duration using a CaMKII-dependent mechanism described as the first neuronal interval timer lasting longer than a few seconds. Lastly, we propose ideas to use Crz neuron-induced ejaculation to study the effects of fictive mating and sex addiction in flies, as well as to elucidate dimorphic molecular mechanisms underlying reward behaviors and feeding disorders.

Transcriptome Analysis of NPFR Neurons Reveals a Connection Between Proteome Diversity and Social Behavior

Social behaviors are mediated by the activity of highly complex neuronal networks, the function of which is shaped by their transcriptomic and proteomic content. Contemporary advances in neurogenetics, genomics, and tools for automated behavior analysis make it possible to functionally connect the transcriptome profile of candidate neurons to their role in regulating behavior. In this study we used Drosophila melanogaster to explore the molecular signature of neurons expressing receptor for neuropeptide F (NPF), the fly homolog of neuropeptide Y (NPY). By comparing the transcription profile of NPFR neurons to those of nine other populations of neurons, we discovered that NPFR neurons exhibit a unique transcriptome, enriched with receptors for various neuropeptides and neuromodulators, as well as with genes known to regulate behavioral processes, such as learning and memory. By manipulating RNA editing and protein ubiquitination programs specifically in NPFR neurons, we demonstrate that the proper expression of their unique transcriptome and proteome is required to suppress male courtship and certain features of social group interaction. Our results highlight the importance of transcriptome and proteome diversity in the regulation of complex behaviors and pave the path for future dissection of the spatiotemporal regulation of genes within highly complex tissues, such as the brain.

Biochemical evidence accumulates across neurons to drive a network-level eruption

Neural network computations are usually assumed to emerge from patterns of fast electrical activity. Challenging this view, we show that a male fly's decision to persist in mating hinges on a biochemical computation that enables processing over minutes to hours. Each neuron in a recurrent network contains slightly different internal molecular estimates of mating progress. Protein kinase A (PKA) activity contrasts this internal measurement with input from the other neurons to represent accumulated evidence that the goal of the network has been achieved. When consensus is reached, PKA pushes the network toward a large-scale and synchronized burst of calcium influx that we call an eruption. Eruptions transform continuous deliberation within the network into an all-or-nothing output, after which the male will no longer sacrifice his life to continue mating. Here, biochemical activity, invisible to most large-scale recording techniques, is the key computational currency directing behavior and motivational state.

Reconsidering the evidence for learning in single cells

The question of whether single cells can learn led to much debate in the early 20th century. The view prevailed that they were capable of non-associative learning but not of associative learning, such as Pavlovian conditioning. Experiments indicating the contrary were considered either non-reproducible or subject to more acceptable interpretations. Recent developments suggest that the time is right to reconsider this consensus. We exhume the experiments of Beatrice Gelber on Pavlovian conditioning in the ciliate Paramecium aurelia, and suggest that criticisms of her findings can now be reinterpreted. Gelber was a remarkable scientist whose absence from the historical record testifies to the prevailing orthodoxy that single cells cannot learn. Her work, and more recent studies, suggest that such learning may be evolutionarily more widespread and fundamental to life than previously thought and we discuss the implications for different aspects of biology.

Keeping track of time: The fundamentals of cellular clocks

Biological timekeeping enables the coordination and execution of complex cellular processes such as developmental programs, day/night organismal changes, intercellular signaling, and proliferative safeguards. While these systems are often considered separately owing to a wide variety of mechanisms, time frames, and outputs, all clocks are built by calibrating or delaying the rate of biochemical reactions and processes. In this review, we explore the common themes and core design principles of cellular clocks, giving special consideration to the challenges associated with building timers from biochemical components. We also outline how evolution has coopted time to increase the reliability of a diverse range of biological systems.

Neural circuit mechanisms encoding motivational states in Drosophila

Animals engage in motivated behaviors, such as feeding and mating behaviors, to ensure their own survival and the survival of their species. However, the neural circuits mediating the generation and persistence of these motivational drives remain poorly understood. Here we review recent studies on the circuit mechanisms underlying motivational states in Drosophila, with a focus on feeding, courtship, and aggression. These studies shed light on the molecular and cellular mechanisms by, which key drive neurons receive relevant input signals, integrate information, and decide on a specific behavioral output. We also discuss conceptual models for integrating these circuit mechanisms, distinguishing between those for homeostatically-regulated versus non-homeostatically-regulated motivated behaviors. We suggest that the ability to trigger persistence of a motivated behavior may be a feature of integrator or apex/command neurons.