A role for the lateral dorsal tegmentum in memory and decision neural circuitry

The mesopontine tegmentum in reward and aversion: From cellular heterogeneity to behaviour

The mesopontine tegmentum, comprising the pedunculopontine tegmentum (PPN) and the laterodorsal tegmentum (LDT), is intricately connected to various regions of the basal ganglia, motor systems, and limbic systems. The PPN and LDT can regulate the activity of different brain regions of these target systems, and in this way are in a privileged position to modulate motivated behaviours. Despite recent findings, the PPN and LDT have been largely overlooked in discussions about the neural circuits associated with reward and aversion. This review aims to provide a timely and comprehensive resource on past and current research, highlighting the PPN and LDT's connectivity and influence on basal ganglia and limbic, and motor systems. Seminal studies, including lesion, pharmacological, and optogenetic/chemogenetic approaches, demonstrate their critical roles in modulating reward/aversive behaviours. The review emphasizes the need for further investigation into the associated cellular mechanisms, in order to clarify their role in behaviour and contribution for different neuropsychiatric disorders.

Zebrafish-A Suitable Model for Rapid Translation of Effective Therapies for Pediatric Cancers

Pediatric cancers are the leading cause of disease-related deaths in children and adolescents. Most of these tumors are difficult to treat and have poor overall survival. Concerns have also been raised about drug toxicity and long-term detrimental side effects of therapies. In this review, we discuss the advantages and unique attributes of zebrafish as pediatric cancer models and their importance in targeted drug discovery and toxicity assays. We have also placed a special focus on zebrafish models of pediatric brain cancers-the most common and difficult solid tumor to treat.

Dopamine release and negative valence gated by inhibitory neurons in the laterodorsal tegmental nucleus

GABAergic neurons in the laterodorsal tegmental nucleus (LDTGABA) encode aversion by directly inhibiting mesolimbic dopamine (DA). Yet, the detailed cellular and circuit mechanisms by which these cells relay unpleasant stimuli to DA neurons and regulate behavioral output remain largely unclear. Here, we show that LDTGABA neurons bidirectionally respond to rewarding and aversive stimuli in mice. Activation of LDTGABA neurons promotes aversion and reduces DA release in the lateral nucleus accumbens. Furthermore, we identified two molecularly distinct LDTGABA cell populations. Somatostatin-expressing (Sst+) LDTGABA neurons indirectly regulate the mesolimbic DA system by disinhibiting excitatory hypothalamic neurons. In contrast, Reelin-expressing LDTGABA neurons directly inhibit downstream DA neurons. The identification of separate GABAergic subpopulations in a single brainstem nucleus that relay unpleasant stimuli to the mesolimbic DA system through direct and indirect projections is critical for establishing a circuit-level understanding of how negative valence is encoded in the mammalian brain.

Response Flexibility: The Role of the Lateral Habenula

The ability to make appropriate decisions that result in an optimal outcome is critical for survival. This process involves assessing the environment as well as integrating prior knowledge about the environment with information about one’s current internal state. There are many neural structures that play critical roles in mediating these processes, but it is not yet known how such information coalesces to influence behavioral output. The lateral habenula (LHb) has often been cited as a structure critical for adaptive and flexible responding when environmental contexts and internal state changes. A challenge, however, has been understanding how LHb promotes response flexibility. In this review, we hypothesize that the LHb enables flexible responding following the integration of context memory and internal state information by signaling downstream brainstem structures known to drive hippocampal theta. In this way, animals respond more flexibly in a task situation not because the LHb selects a particular action, but rather because LHb enhances a hippocampal neural state that is often associated with greater attention, arousal, and exploration. In freely navigating animals, these are essential conditions that are needed to discover and implement appropriate alternative choices and behaviors. As a corollary to our hypothesis, we describe short- and intermediate-term functions of the LHb. Finally, we discuss the effects on the behavior of LHb dysfunction in short- and intermediate-timescales, and then suggest that new therapies may act on the LHb to alleviate the behavioral impairments following long-term LHb disruption.

Laterodorsal tegmentum-ventral tegmental area projections encode positive reinforcement signals

The laterodorsal tegmentum (LDT) is a brainstem nucleus classically involved in REM sleep and attention, and that has recently been associated with reward‐related behaviors, as it controls the activity of ventral tegmental area (VTA) dopaminergic neurons, modulating dopamine release in the nucleus accumbens. To further understand the role of LDT–VTA inputs in reinforcement, we optogenetically manipulated these inputs during different behavioral paradigms in male rats. We found that in a two‐choice instrumental task, optical activation of LDT–VTA projections shifts and amplifies preference to the laser‐paired reward in comparison to an otherwise equal reward; the opposite was observed with inhibition experiments. In a progressive ratio task, LDT–VTA activation boosts motivation, that is, enhances the willingness to work to get the reward associated with LDT–VTA stimulation; and the reverse occurs when inhibiting these inputs. Animals abolished preference if the reward was omitted, suggesting that LDT–VTA stimulation adds/decreases value to the stimulation‐paired reward. In addition, we show that LDT–VTA optical activation induces robust preference in the conditioned and real‐time place preference tests, while optical inhibition induces aversion. The behavioral findings are supported by electrophysiological recordings and c‐fos immunofluorescence correlates in downstream target regions. In LDT–VTA ChR2 animals, we observed an increase in the recruitment of lateral VTA dopamine neurons and D1 neurons from nucleus accumbens core and shell; whereas in LDT–VTA NpHR animals, D2 neurons appear to be preferentially recruited. Collectively, these data show that the LDT–VTA inputs encode positive reinforcement signals and are important for different dimensions of reward‐related behaviors.

Lateral septum as a nexus for mood, motivation, and movement

The lateral septum (LS) has been implicated in a wide variety of functions, including emotional, motivational, and spatial behavior, and the LS may regulate interactions between the hippocampus and other regions that mediate goal directed behavior. In this review, we suggest that the lateral septum incorporates movement into the evaluation of environmental context with respect to motivation, anxiety, and reward to output an 'integrated movement value signal'. Specifically, hippocampally-derived contextual information may be combined with reinforcement or motivational information in the LS to inform task-relevant decisions. We will discuss how movement is represented in the LS and the literature on the LS's involvement in mood and motivation. We will then connect these results to LS movement-related literature and hypotheses about the role of the lateral septum. We suggest that the LS may communicate a movement-scaled reward signal via changes in place-, movement-, and reward-related firing, and that the LS should be considered a fundamental node of affect and locomotor pathways in the brain.

A systems-neuroscience model of phasic dopamine

We describe a neurobiologically informed computational model of phasic dopamine signaling to account for a wide range of findings, including many considered inconsistent with the simple reward prediction error (RPE) formalism. The central feature of this PVLV framework is a distinction between a primary value (PV) system for anticipating primary rewards (Unconditioned Stimuli [USs]), and a learned value (LV) system for learning about stimuli associated with such rewards (CSs). The LV system represents the amygdala, which drives phasic bursting in midbrain dopamine areas, while the PV system represents the ventral striatum, which drives shunting inhibition of dopamine for expected USs (via direct inhibitory projections) and phasic pausing for expected USs (via the lateral habenula). Our model accounts for data supporting the separability of these systems, including individual differences in CS-based (sign-tracking) versus US-based learning (goal-tracking). Both systems use competing opponent-processing pathways representing evidence for and against specific USs, which can explain data dissociating the processes involved in acquisition versus extinction conditioning. Further, opponent processing proved critical in accounting for the full range of conditioned inhibition phenomena, and the closely related paradigm of second-order conditioning. Finally, we show how additional separable pathways representing aversive USs, largely mirroring those for appetitive USs, also have important differences from the positive valence case, allowing the model to account for several important phenomena in aversive conditioning. Overall, accounting for all of these phenomena strongly constrains the model, thus providing a well-validated framework for understanding phasic dopamine signaling. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Zebrafish Models of Neurodevelopmental Disorders: Limitations and Benefits of Current Tools and Techniques

For the past few years there has been an exponential increase in the use of animal models to confirm the pathogenicity of candidate disease-causing genetic variants found in patients. One such animal model is the zebrafish. Despite being a non-mammalian animal, the zebrafish model has proven its potential in recapitulating the phenotypes of many different human genetic disorders. This review will focus on recent advances in the modeling of neurodevelopmental disorders in zebrafish, covering aspects from early brain development to techniques used for modulating gene expression, as well as how to best characterize the resulting phenotypes. We also review other existing models of neurodevelopmental disorders, and the current efforts in developing and testing compounds with potential therapeutic value.

The storage and recall of memories in the hippocampo-cortical system

A quantitative computational theory of the operation of the hippocampus as an episodic memory system is described. The CA3 system operates as a single attractor or autoassociation network (1) to enable rapid one-trial associations between any spatial location (place in rodents or spatial view in primates) and an object or reward and (2) to provide for completion of the whole memory during recall from any part. The theory is extended to associations between time and object or reward to implement temporal order memory, which is also important in episodic memory. The dentate gyrus performs pattern separation by competitive learning to create sparse representations producing, for example, neurons with place-like fields from entorhinal cortex grid cells. The dentate granule cells generate, by the very small number of mossy fibre connections to CA3, a randomizing pattern separation effect that is important during learning but not recall and that separates out the patterns represented by CA3 firing as being very different from each other. This is optimal for an unstructured episodic memory system in which each memory must be kept distinct from other memories. The direct perforant path input to CA3 is quantitatively appropriate for providing the cue for recall in CA3 but not for learning. The CA1 recodes information from CA3 to set up associatively learned backprojections to the neocortex to allow the subsequent retrieval of information to the neocortex, giving a quantitative account of the large number of hippocampo-neocortical and neocortical-neocortical backprojections. Tests of the theory including hippocampal subregion analyses and hippocampal NMDA receptor knockouts are described and support the theory.

A Novel Role for the Periaqueductal Gray in Consummatory Behavior

The periaqueductal gray (PAG) has a well-established role in pain processing, autonomic function and behavioral responses to fear. Anatomical work suggests the PAG may mediate food intake and reward processing as it has extensive reciprocal connections within brain circuits that mediate appetitive processes and consummatory behaviors such as prefrontal cortex, hypothalamus, amygdala, parabrachial nucleus (PBN) and ventral tegmental area (Kelley et al., 2005). Therefore, we investigated if the PAG of hungry rats has a functional role in appetitive and consummatory behaviors. To address this, PAG was pharmacologically inactivated during a spatial working memory task with muscimol (0.1-0.3 μg), a GABAA agonist via intracranial infusion. Inactivation of PAG led to reduced intake of food rewards and increased errors on this task. To focus on the specific effects PAG inactivation had on food consumption, PAG was inactivated during two separate food intake tasks in a separate group of rats. Again, PAG inactivation resulted in a significant decrease in food consumption, as well as an increased latency to consume food. We next investigated PAG neural responses to reward encounters. A different group of rats performed the same task used in Experiment 1 while the in vivo activity of PAG neurons was recorded. In a subset of PAG neurons, reward encounters elicited phasic excitation. A separate subset of PAG neurons were inhibited during reward encounters. These responses scaled with the size of the reward, with sustained excitation or inhibition in response to large rewards compared to small. Our data also show that separate groups of PAG neurons in awake behaving animals display either increased and decreased neural responses to reward encounters. Additionally, a proportion of neurons were modulated by the animals' velocity. This study is the first to show that PAG neurons process reward-related information, perhaps to mediate consummatory behaviors related to food consumption.

Stereological Estimates of Glutamatergic, GABAergic, and Cholinergic Neurons in the Pedunculopontine and Laterodorsal Tegmental Nuclei in the Rat

The pedunculopontine tegmental nucleus (PPN) and laterodorsal tegmental nucleus (LDT) are functionally associated brainstem structures implicated in behavioral state control and sensorimotor integration. The PPN is also involved in gait and posture, while the LDT plays a role in reward. Both nuclei comprise characteristic cholinergic neurons intermingled with glutamatergic and GABAergic cells whose absolute numbers in the rat have been only partly established. Here we sought to determine the complete phenotypical profile of each nucleus to investigate potential differences between them. Counts were obtained using stereological methods after the simultaneous visualization of cholinergic and either glutamatergic or GABAergic cells. The two isoforms of glutamic acid decarboxylase (GAD), GAD65 and GAD67, were separately analyzed. Dual in situ hybridization revealed coexpression of GAD65 and GAD67 mRNAs in ∼90% of GAD-positive cells in both nuclei; thus, the estimated mean numbers of (1) cholinergic, (2) glutamatergic, and (3) GABAergic cells in PPN and LDT, respectively, were (1) 3,360 and 3,650; (2) 5,910 and 5,190; and (3) 4,439 and 7,599. These data reveal significant differences between PPN and LDT in their relative phenotypical composition, which may underlie some of the functional differences observed between them. The estimation of glutamatergic cells was significantly higher in the caudal PPN, supporting the reported functional rostrocaudal segregation in this nucleus. Finally, a small subset of cholinergic neurons (8% in PPN and 5% in LDT) also expressed the glutamatergic marker Vglut2, providing anatomical evidence for a potential corelease of transmitters at specific target areas.

The Cellular Diversity of the Pedunculopontine Nucleus: Relevance to Behavior in Health and Aspects of Parkinson's Disease

The pedunculopontine nucleus (PPN) is a rostral brainstem structure that has extensive connections with basal ganglia nuclei and the thalamus. Through these the PPN contributes to neural circuits that effect cortical and hippocampal activity. The PPN also has descending connections to nuclei of the pontine and medullary reticular formations, deep cerebellar nuclei, and the spinal cord. Interest in the PPN has increased dramatically since it was first suggested to be a novel target for treating patients with Parkinson's disease who are refractory to medication. However, application of frequency-specific electrical stimulation of the PPN has produced inconsistent results. A central reason for this is that the PPN is not a heterogeneous structure. In this article, we review current knowledge of the neurochemical identity and topographical distribution of neurons within the PPN of both humans and experimental animals, focusing on studies that used neuronally selective targeting strategies to ascertain how the neurochemical heterogeneity of the PPN relates to its diverse functions in relation to movement and cognitive processes. If the therapeutic potential of the PPN is to be realized, it is critical to understand the complex structure-function relationships that exist here.

Ongoing behavioral state information signaled in the lateral habenula guides choice flexibility in freely moving rats

The lateral habenula (LHb) plays a role in a wide variety of behaviors ranging from maternal care, to sleep, to various forms of cognition. One prominent theory with ample supporting evidence is that the LHb serves to relay basal ganglia and limbic signals about negative outcomes to midbrain monoaminergic systems. This makes it likely that the LHb is critically involved in behavioral flexibility as all of these systems have been shown to contribute when flexible behavior is required. Behavioral flexibility is commonly examined across species and is impaired in various neuropsychiatric conditions including autism, depression, addiction, and schizophrenia; conditions in which the LHb is thought to play a role. Therefore, a thorough examination of the role of the LHb in behavioral flexibility serves multiple functions including understanding possible connections with neuropsychiatric illnesses and additional insight into its role in cognition in general. Here, we assess the LHb’s role in behavioral flexibility through comparisons of the roles its afferent and efferent pathways are known to play. Additionally, we provide new evidence supporting the LHb contributions to behavioral flexibility through organization of specific goal directed actions under cognitively demanding conditions. Specifically, in the first experiment, a majority of neurons recorded from the LHb were found to correlate with velocity on a spatial navigation task and did not change significantly when reward outcomes were manipulated. Additionally, measurements of local field potential (LFP) in the theta band revealed significant changes in power relative to velocity and reward location. In a second set of experiments, inactivation of the LHb with the gamma-aminobutyric acid (GABA) agonists baclofen and muscimol led to an impairment in a spatial/response based repeated probabilistic reversal learning task. Control experiments revealed that this impairment was likely due to the demands of repeated switching behaviors as rats were unimpaired on initial discrimination acquisition or retention of probabilistic learning. Taken together, these novel findings compliment other work discussed supporting a role for the LHb in action selection when cognitive or emotional demands are increased. Finally, we discuss future mechanisms by which a superior understanding of the LHb can be obtained through additional examination of behavioral flexibility tasks.

Diversity and development of local inhibitory and excitatory neurons associated with dopaminergic nuclei

For regulation of voluntary movement and motivation the midbrain dopaminergic system receives input from a variety of brain regions. Often this input is mediated by local non-dopaminergic neurons within or closely associated with the dopaminergic nuclei. In addition to the dopaminergic neurons, some of these non-dopaminergic neurons also send functionally important output from the ventral midbrain to forebrain targets. The aim of this review is to introduce subtypes of GABAergic and glutamatergic neurons, which are located in the dopaminergic nuclei or the adjacent brainstem and are important for the regulation of the dopaminergic pathways. In addition, we discuss recent studies beginning to reveal mechanisms for their development, which may hold the key to understanding the diversity of these neurons.

Brainstem system of hippocampal theta induction: The role of the ventral tegmental area

This article summarizes the results of studies concerning the influence of the ventral tegmental area (VTA) on the hippocampal theta rhythm. Temporary VTA inactivation resulted in transient loss of the hippocampal theta. Permanent destruction of the VTA caused a long-lasting depression of the power of the theta and it also had some influence on the frequency of the rhythm. Activation of glutamate (GLU) receptors or decrease of GABAergic tonus in the VTA led to enhancement of dopamine release and increased hippocampal theta power. High time and frequency cross-correlation was detected for the theta band between the VTA and hippocampus during paradoxical sleep and active waking. Thus, the VTA may belong to the broad network involved in theta rhythm regulation. This article also presents a model of brainstem-VTA-hippocampal interactions in the induction of the hippocampal theta rhythm. The projections from the VTA which enhance theta rhythm are incorporated into the main theta generation pathway, in which the septum acts as the central node. The neuronal activity that may be responsible for the ability of the VTA to regulate theta probably derives from the structures associated with rapid eye movement (sleep) (REM) sleep or with sensorimotor activity (i.e., mainly from the pedunculopontine and laterodorsal tegmental nuclei and also from the raphe).

An integrative role for the superior colliculus in selecting targets for movements

A fundamental goal of systems neuroscience is to understand the neural mechanisms underlying decision making. The midbrain superior colliculus (SC) is known to be central to the selection of one among many potential spatial targets for movements, which represents an important form of decision making that is tractable to rigorous experimental investigation. In this review, we first discuss data from mammalian models-including primates, cats, and rodents-that inform our understanding of how neural activity in the SC underlies the selection of targets for movements. We then examine the anatomy and physiology of inputs to the SC from three key regions that are themselves implicated in motor decisions-the basal ganglia, parabrachial region, and neocortex-and discuss how they may influence SC activity related to target selection. Finally, we discuss the potential for methodological advances to further our understanding of the neural bases of target selection. Our overarching goal is to synthesize what is known about how the SC and its inputs act together to mediate the selection of targets for movements, to highlight open questions about this process, and to spur future studies addressing these questions.

Integrative hippocampal and decision-making neurocircuitry during goal-relevant predictions and encoding

It has become clear that the hippocampus plays a critical role in the identification of new contexts and for the detection of changes in familiar contexts. The hippocampus accomplishes these goals through a continual process of comparing predicted features of a context or situation to those actually experienced. A mismatch between expected and experienced context expectations is thought to lead to the generation of a context prediction error (Mizumori, 2013) that functionally alerts connected brain areas to alter subsequent decision making and response selection. Little is understood about how hippocampal context analyses impact downstream decision processes. This issue is evaluated here first by comparing the nature of the information represented in hippocampus and decision-related midbrain-striatal structures, while rats perform a hippocampal-dependent spatial memory task in which rewards of different value are found at different locations. In contrast to place-specific and egocentric neural representations, neural representations of goal information are broadly distributed in hippocampal and decision neural circuitry, but they appear in different forms for different brain structures. It is suggested that further researching on how goal information processing occurs in hippocampus and decision neural circuitry may reveal insights into the nature of the interaction between memory and decision systems. The second part of this review describes neural pathways by which hippocampal context information might arrive within the decision circuit. The third section presents a hypothesis that the nature of the interactions between hippocampal and midbrain-striatal circuitry is regulated by the prefrontal cortex.