Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems

Neural correlates of object identity and reward outcome in the sensory cortical-hippocampal hierarchy: coding of motivational information in perirhinal cortex

Neural circuits support behavioral adaptations by integrating sensory and motor information with reward and error-driven learning signals, but it remains poorly understood how these signals are distributed across different levels of the corticohippocampal hierarchy. We trained rats on a multisensory object-recognition task and compared visual and tactile responses of simultaneously recorded neuronal ensembles in somatosensory cortex, secondary visual cortex, perirhinal cortex, and hippocampus. The sensory regions primarily represented unisensory information, whereas hippocampus was modulated by both vision and touch. Surprisingly, the sensory cortices and the hippocampus coded object-specific information, whereas the perirhinal cortex did not. Instead, perirhinal cortical neurons signaled trial outcome upon reward-based feedback. A majority of outcome-related perirhinal cells responded to a negative outcome (reward omission), whereas a minority of other cells coded positive outcome (reward delivery). Our results highlight a distributed neural coding of multisensory variables in the cortico-hippocampal hierarchy. Notably, the perirhinal cortex emerges as a crucial region for conveying motivational outcomes, whereas distinct functions related to object identity are observed in the sensory cortices and hippocampus.

Prefrontal Dopamine in Flexible Adaptation to Environmental Changes: A Game for Two Players

Deficits in cognitive flexibility have been characterized in affective, anxiety, and neurodegenerative disorders. This paper reviews data, mainly from studies on animal models, that support the existence of a cortical-striatal brain circuit modulated by dopamine (DA), playing a major role in cognitive/behavioral flexibility. Moreover, we reviewed clinical findings supporting misfunctioning of this circuit in Parkinson's disease that could be responsible for some important non-motoric symptoms. The reviewed findings point to a role of catecholaminergic transmission in the medial prefrontal cortex (mpFC) in modulating DA's availability in the nucleus accumbens (NAc), as well as a role of NAc DA in modulating the motivational value of natural and conditioned stimuli. The review section is accompanied by a preliminary experiment aimed at testing weather the extinction of a simple Pavlovian association fosters increased DA transmission in the mpFC and inhibition of DA transmission in the NAc.

Learning without contingencies: A loss of synergy between memory and reward circuits in schizophrenia

Motivational deficits in schizophrenia may interact with foundational cognitive processes including learning and memory to induce impaired cognitive proficiency. If such a loss of synergy exists, it is likely to be underpinned by a loss of synchrony between the brains learning and reward sub-networks. Moreover, this loss should be observed even during tasks devoid of explicit reward contingencies given that such tasks are better models of real world performance than those with artificial contingencies. Here we applied undirected functional connectivity (uFC) analyses to fMRI data acquired while participants engaged in an associative learning task without contingencies or feedback. uFC was estimated and inter-group differences (between schizophrenia patients and controls, n = 54 total, n = 28 patients) were assessed within and between reward (VTA and NAcc) and learning/memory (Basal Ganglia, DPFC, Hippocampus, Parahippocampus, Occipital Lobe) sub-networks. The task paradigm itself alternated between Encoding, Consolidation, and Retrieval conditions, and uFC differences were quantified for each of the conditions. Significantly reduced uFC dominated the connectivity profiles of patients across all conditions. More pertinent to our motivations, these reductions were observed within and across classes of sub-networks (reward-related and learning/memory related). We suggest that disrupted functional connectivity between reward and learning sub-networks may drive many of the performance deficits that characterize schizophrenia. Thus, cognitive deficits in schizophrenia may in fact be underpinned by a loss of synergy between reward-sensitivity and cognitive processes.

Effects of early life overnutrition and hyperandrogenism on spatial learning and memory in a rat model of polycystic ovary syndrome

Polycystic ovary syndrome (PCOS) is a complex disorder characterized by endocrine and metabolic abnormalities such as obesity and insulin resistance. PCOS is also associated with psychiatric disorders and cognitive impairment. The animal model of PCOS was induced by treating rats with 5α-dihydrotestosterone (5α-DHT) and additionally modified to induce adiposity by litter size reduction (LSR). Spatial learning and memory were assessed using the Barnes Maze test, and striatal markers of synaptic plasticity were analyzed. Striatal insulin signaling was estimated by the levels of insulin receptor substrate 1 (IRS1), its inhibitory phosphorylation at Ser307, and glycogen synthase kinase-3α/β (GSK3α/β) activity. Both LSR and DHT treatment significantly decreased striatal protein levels of IRS1, followed by increased GSK3α/β activity in small litters. Results of the behavioral study showed that LSR had a negative effect on learning rate and memory retention, whereas DHT treatment did not induce impairment in memory formation. While protein levels of synaptophysin, GAP43, and postsynaptic density protein 95 (PSD-95) were not altered by the treatments, DHT treatment induced an increase in phosphorylation of PSD-95 at Ser295 in both normal and small litters. This study revealed that LSR and DHT treatment suppressed insulin signaling by downregulating IRS1 in the striatum. However, DHT treatment did not have an adverse effect on learning and memory, probably due to compensatory elevation in pPSD-95-Ser295, which had a positive effect on synaptic strength. This implies that hyperandrogenemia in this setting does not represent a threat to spatial learning and memory, opposite to the effect of overnutrition-related adiposity.

The contribution of the basal ganglia and cerebellum to motor learning: A neuro-computational approach

Motor learning involves a widespread brain network including the basal ganglia, cerebellum, motor cortex, and brainstem. Despite its importance, little is known about how this network learns motor tasks and which role different parts of this network take. We designed a systems-level computational model of motor learning, including a cortex-basal ganglia motor loop and the cerebellum that both determine the response of central pattern generators in the brainstem. First, we demonstrate its ability to learn arm movements toward different motor goals. Second, we test the model in a motor adaptation task with cognitive control, where the model replicates human data. We conclude that the cortex-basal ganglia loop learns via a novelty-based motor prediction error to determine concrete actions given a desired outcome, and that the cerebellum minimizes the remaining aiming error.

Trauma and Remembering: From Neuronal Circuits to Molecules

Individuals with posttraumatic stress disorder (PTSD) experience intrusions of vivid traumatic memories, heightened arousal, and display avoidance behavior. Disorders in identity, emotion regulation, and interpersonal relationships are also common. The cornerstone of PTSD is altered learning, memory, and remembering, regulated by a complex neuronal and molecular network. We propose that the essential feature of successful treatment is the modification of engrams in their unstable state during retrieval. During psychedelic psychotherapy, engrams may show a pronounced instability, which enhances modification. In this narrative review, we outline the clinical characteristics of PTSD, its multifaceted neuroanatomy, and the molecular pathways that regulate memory destabilization and reconsolidation. We propose that psychedelics, acting by serotonin-glutamate interactions, destabilize trauma-related engrams and open the door to change them during psychotherapy.

What is neurorepresentationalism? From neural activity and predictive processing to multi-level representations and consciousness

This review provides an update on Neurorepresentationalism, a theoretical framework that defines conscious experience as multimodal, situational survey and explains its neural basis from brain systems constructing best-guess representations of sensations originating in our environment and body [1]. It posits that conscious experience is characterized by five essential hallmarks: (i) multimodal richness, (ii) situatedness and immersion, (iii) unity and integration, (iv) dynamics and stability, and (v) intentionality. Consciousness is furthermore proposed to have a biological function, framed by the contrast between reflexes and habits (not requiring consciousness) versus goal-directed, planned behavior (requiring multimodal, situational survey). Conscious experience is therefore understood as a sensorily rich, spatially encompassing representation of body and environment, while we nevertheless have the impression of experiencing external reality directly. Contributions to understanding neural mechanisms underlying consciousness are derived from models for predictive processing, which are trained in an unsupervised manner, do not necessarily require overt action, and have been extended to deep neural networks. Even with predictive processing in place, however, the question remains why this type of neural network activity would give rise to phenomenal experience. Here, I propose to tackle the Hard Problem with the concept of multi-level representations which emergently give rise to multimodal, spatially wide superinferences corresponding to phenomenal experiences. Finally, Neurorepresentationalism is compared to other neural theories of consciousness, and its implications for defining indicators of consciousness in animals, artificial intelligence devices and immobile or unresponsive patients with disorders of consciousness are discussed.

Context coding in the mouse nucleus accumbens modulates motivationally relevant information

Neural activity in the nucleus accumbens (NAc) is thought to track fundamentally value-centric quantities linked to reward and effort. However, the NAc also contributes to flexible behavior in ways that are difficult to explain based on value signals alone, raising the question of if and how nonvalue signals are encoded in NAc. We recorded NAc neural ensembles while head-fixed mice performed an odor-based biconditional discrimination task where an initial discrete cue modulated the behavioral significance of a subsequently presented reward-predictive cue. We extracted single-unit and population-level correlates related to the cues and found value-independent coding for the initial, context-setting cue. This context signal occupied a population-level coding space orthogonal to outcome-related representations and was predictive of subsequent behaviorally relevant responses to the reward-predictive cues. Together, these findings support a gating model for how the NAc contributes to behavioral flexibility and provide a novel population-level perspective from which to view NAc computations.

Indicators and criteria of consciousness: ethical implications for the care of behaviourally unresponsive patients

Background

Assessing consciousness in other subjects, particularly in non-verbal and behaviourally disabled subjects (e.g., patients with disorders of consciousness), is notoriously challenging but increasingly urgent. The high rate of misdiagnosis among disorders of consciousness raises the need for new perspectives in order to inspire new technical and clinical approaches.

Main body

We take as a starting point a recently introduced list of operational indicators of consciousness that facilitates its recognition in challenging cases like non-human animals and Artificial Intelligence to explore their relevance to disorders of consciousness and their potential ethical impact on the diagnosis and healthcare of relevant patients. Indicators of consciousness mean particular capacities that can be deduced from observing the behaviour or cognitive performance of the subject in question (or from neural correlates of such performance) and that do not define a hard threshold in deciding about the presence of consciousness, but can be used to infer a graded measure based on the consistency amongst the different indicators. The indicators of consciousness under consideration offer a potential useful strategy for identifying and assessing residual consciousness in patients with disorders of consciousness, setting the theoretical stage for an operationalization and quantification of relevant brain activity.

Conclusions

Our heuristic analysis supports the conclusion that the application of the identified indicators of consciousness to its disorders will likely inspire new strategies for assessing three very urgent issues: the misdiagnosis of disorders of consciousness; the need for a gold standard in detecting consciousness and diagnosing its disorders; and the need for a refined taxonomy of disorders of consciousness.

Model-based learning retrospectively updates model-free values

Reinforcement learning (RL) is widely regarded as divisible into two distinct computational strategies. Model-free learning is a simple RL process in which a value is associated with actions, whereas model-based learning relies on the formation of internal models of the environment to maximise reward. Recently, theoretical and animal work has suggested that such models might be used to train model-free behaviour, reducing the burden of costly forward planning. Here we devised a way to probe this possibility in human behaviour. We adapted a two-stage decision task and found evidence that model-based processes at the time of learning can alter model-free valuation in healthy individuals. We asked people to rate subjective value of an irrelevant feature that was seen at the time a model-based decision would have been made. These irrelevant feature value ratings were updated by rewards, but in a way that accounted for whether the selected action retrospectively ought to have been taken. This model-based influence on model-free value ratings was best accounted for by a reward prediction error that was calculated relative to the decision path that would most likely have led to the reward. This effect occurred independently of attention and was not present when participants were not explicitly told about the structure of the environment. These findings suggest that current conceptions of model-based and model-free learning require updating in favour of a more integrated approach. Our task provides an empirical handle for further study of the dialogue between these two learning systems in the future.

Enhanced habit formation in Tourette patients explained by shortcut modulation in a hierarchical cortico-basal ganglia model

Devaluation protocols reveal that Tourette patients show an increased propensity to habitual behaviors as they continue to respond to devalued outcomes in a cognitive stimulus-response-outcome association task. We use a neuro-computational model of hierarchically organized cortico-basal ganglia-thalamo-cortical loops to shed more light on habit formation and its alteration in Tourette patients. In our model, habitual behavior emerges from cortico-thalamic shortcut connections, where enhanced habit formation can be linked to faster plasticity in the shortcut or to a stronger feedback from the shortcut to the basal ganglia. We explore two major hypotheses of Tourette pathophysiology-local striatal disinhibition and increased dopaminergic modulation of striatal medium spiny neurons-as causes for altered shortcut activation. Both model changes altered shortcut functioning and resulted in higher rates of responses towards devalued outcomes, similar to what is observed in Tourette patients. We recommend future experimental neuroscientific studies to locate shortcuts between cortico-basal ganglia-thalamo-cortical loops in the human brain and study their potential role in health and disease.

A New Paradigm for the Study of Cognitive Flexibility in Children and Adolescents: The "Virtual House Locomotor Maze" (VHLM)

Classical neuropsychological assessments are designed to explore cognitive brain functions using paper-and-pencil or digital tests. The purpose of this study was to design and to test a new protocol named the "Virtual House Locomotor Maze" (VHLM) for studying inhibitory control as well as mental flexibility using a visuo-spatial locomotor memory test. The VHLM is a simple maze including six houses using the technology of the Virtual Carpet Paradigm™. Ten typical development children (TD) were enrolled in this study. The participants were instructed to reach a target house as quickly as possible and to bear in mind the experimental instructions. We examined their planning and replanning abilities to take the shortest path to reach a target house. In order to study the cognitive processes during navigation, we implemented a spatio-temporal index based on the measure of kinematics behaviors (i.e., trajectories, tangential velocity and head direction). Replanning was tested by first repeating a path chosen by the subject to reach a given house. After learning this path, it was blocked imposing that the subject inhibited the learned trajectory and designed a new trajectory to reach the same house. We measured the latency of the departure after the presentation of each house and the initial direction of the trajectory. The results suggest that several strategies are used by the subjects for replanning and our measures could be used as an index of impulsivity.

Reconciling the object and spatial processing views of the perirhinal cortex through task-relevant unitization

The perirhinal cortex is situated on the border between sensory association cortex and the hippocampal formation. It serves an important function as a transition area between the sensory neocortex and the medial temporal lobe. While the perirhinal cortex has traditionally been associated with object coding and the "what" pathway of the temporal lobe, current evidence suggests a broader function of the perirhinal cortex in solving feature ambiguity and processing complex stimuli. Besides fulfilling functions in object coding, recent neurophysiological findings in freely moving rodents indicate that the perirhinal cortex also contributes to spatial and contextual processing beyond individual sensory modalities. Here, we address how these two opposing views on perirhinal cortex-the object-centered and spatial-contextual processing hypotheses-may be reconciled. The perirhinal cortex is consistently recruited when different features can be merged perceptually or conceptually into a single entity. Features that are unitized in these entities include object information from multiple sensory domains, reward associations, semantic features and spatial/contextual associations. We propose that the same perirhinal network circuits can be flexibly deployed for multiple cognitive functions, such that the perirhinal cortex performs similar unitization operations on different types of information, depending on behavioral demands and ranging from the object-related domain to spatial, contextual and semantic information.

A possible evolutionary function of phenomenal conscious experience of pain

Evolutionary accounts of feelings, and in particular of negative affect and of pain, assume that creatures that feel and care about the outcomes of their behavior outperform those that do not in terms of their evolutionary fitness. Such accounts, however, can only work if feelings can be shown to contribute to fitness-influencing outcomes. Simply assuming that a learner that feels and cares about outcomes is more strongly motivated than one that does is not enough, if only because motivation can be tied directly to outcomes by incorporating an appropriate reward function, without leaving any apparent role to feelings (as it is done in state-of-the-art engineered systems based on reinforcement learning). Here, we propose a possible mechanism whereby pain contributes to fitness: an actor-critic functional architecture for reinforcement learning, in which pain reflects the costs imposed on actors in their bidding for control, so as to promote honest signaling and ultimately help the system optimize learning and future behavior.

Hippocampal regenerative medicine: neurogenic implications for addiction and mental disorders

Psychiatric illness is a prevalent and highly debilitating disorder, and more than 50% of the general population in both middle- and high-income countries experience at least one psychiatric disorder at some point in their lives. As we continue to learn how pervasive psychiatric episodes are in society, we must acknowledge that psychiatric disorders are not solely relegated to a small group of predisposed individuals but rather occur in significant portions of all societal groups. Several distinct brain regions have been implicated in neuropsychiatric disease. These brain regions include corticolimbic structures, which regulate executive function and decision making (e.g., the prefrontal cortex), as well as striatal subregions known to control motivated behavior under normal and stressful conditions. Importantly, the corticolimbic neural circuitry includes the hippocampus, a critical brain structure that sends projections to both the cortex and striatum to coordinate learning, memory, and mood. In this review, we will discuss past and recent discoveries of how neurobiological processes in the hippocampus and corticolimbic structures work in concert to control executive function, memory, and mood in the context of mental disorders.

A region of the brain called the hippocampus and its connections to other parts of the brain via what are called cortico-limbic structures are implicated in a variety of mental health disorders. These disorders can be accompanied by reduced hippocampal volume. Mi-Hyeon Jang, Doo-Sup Choi and colleagues at the Mayo Clinic College of Medicine and Science, Rochester, USA, review the role of hippocampal and cortico-limbic neurobiology in memory and mood in mental disorders. They focus particular attention on the role of neurogenesis, the production and growth of new nerve cells and connections. Disrupted neurogenesis in the adult hippocampus is implicated in conditions including addiction, depression, schizophrenia and related psychotic disorders. Learning more about neural regeneration in the hippocampus could yield insights into mental health conditions and open new avenues toward developing drug-based treatments.

Reinforcement learning approaches to hippocampus-dependent flexible spatial navigation

Humans and non-human animals show great flexibility in spatial navigation, including the ability to return to specific locations based on as few as one single experience. To study spatial navigation in the laboratory, watermaze tasks, in which rats have to find a hidden platform in a pool of cloudy water surrounded by spatial cues, have long been used. Analogous tasks have been developed for human participants using virtual environments. Spatial learning in the watermaze is facilitated by the hippocampus. In particular, rapid, one-trial, allocentric place learning, as measured in the delayed-matching-to-place variant of the watermaze task, which requires rodents to learn repeatedly new locations in a familiar environment, is hippocampal dependent. In this article, we review some computational principles, embedded within a reinforcement learning framework, that utilise hippocampal spatial representations for navigation in watermaze tasks. We consider which key elements underlie their efficacy, and discuss their limitations in accounting for hippocampus-dependent navigation, both in terms of behavioural performance (i.e. how well do they reproduce behavioural measures of rapid place learning) and neurobiological realism (i.e. how well do they map to neurobiological substrates involved in rapid place learning). We discuss how an actor-critic architecture, enabling simultaneous assessment of the value of the current location and of the optimal direction to follow, can reproduce one-trial place learning performance as shown on watermaze and virtual delayed-matching-to-place tasks by rats and humans, respectively, if complemented with map-like place representations. The contribution of actor-critic mechanisms to delayed-matching-to-place performance is consistent with neurobiological findings implicating the striatum and hippocampo-striatal interaction in delayed-matching-to-place performance, given that the striatum has been associated with actor-critic mechanisms. Moreover, we illustrate that hierarchical computations embedded within an actor-critic architecture may help to account for aspects of flexible spatial navigation. The hierarchical reinforcement learning approach separates trajectory control via a temporal-difference error from goal selection via a goal prediction error and may account for flexible, trial-specific, navigation to familiar goal locations, as required in some arm-maze place memory tasks, although it does not capture one-trial learning of new goal locations, as observed in open field, including watermaze and virtual, delayed-matching-to-place tasks. Future models of one-shot learning of new goal locations, as observed on delayed-matching-to-place tasks, should incorporate hippocampal plasticity mechanisms that integrate new goal information with allocentric place representation, as such mechanisms are supported by substantial empirical evidence.

Fast spiking interneuron activity in primate striatum tracks learning of attention cues

Cognitive flexibility depends on a fast neural learning mechanism for enhancing momentary relevant over irrelevant information. A possible neural mechanism realizing this enhancement uses fast spiking interneurons (FSIs) in the striatum to train striatal projection neurons to gate relevant and suppress distracting cortical inputs. We found support for such a mechanism in nonhuman primates during the flexible adjustment of visual attention in a reversal learning task. FSI activity was modulated by visual attention cues during feature-based learning. One FSI subpopulation showed stronger activation during learning, while another FSI subpopulation showed response suppression after learning, which could indicate a disinhibitory effect on the local circuit. Additionally, FSIs that showed response suppression to learned attention cues were activated by salient distractor events, suggesting they contribute to suppressing bottom-up distraction. These findings suggest that striatal fast spiking interneurons play an important role when cues are learned that redirect attention away from previously relevant to newly relevant visual information. This cue-specific activity was independent of motor-related activity and thus tracked specifically the learning of reward predictive visual features.

Disordered directional brain network interactions during learning dynamics in schizophrenia revealed by multivariate autoregressive models

Directional network interactions underpin normative brain function in key domains including associative learning. Schizophrenia (SCZ) is characterized by altered learning dynamics, yet dysfunctional directional functional connectivity (dFC) evoked during learning is rarely assessed. Here, nonlinear learning dynamics were induced using a paradigm alternating between conditions (Encoding and Retrieval). Evoked fMRI time series data were modeled using multivariate autoregressive (MVAR) models, to discover dysfunctional direction interactions between brain network constituents during learning stages (Early vs. Late), and conditions. A functionally derived subnetwork of coactivated (healthy controls [HC] ∩ SCZ] nodes was identified. MVAR models quantified directional interactions between pairs of nodes, and coefficients were evaluated for intergroup differences (HC ≠ SCZ). In exploratory analyses, we quantified statistical effects of neuroleptic dosage on performance and MVAR measures. During Early Encoding, SCZ showed reduced dFC within a frontal–hippocampal–fusiform network, though during Late Encoding reduced dFC was associated with pathways toward the dorsolateral prefrontal cortex (dlPFC). During Early Retrieval, SCZ showed increased dFC in pathways to and from the dorsal anterior cingulate cortex, though during Late Retrieval, patients showed increased dFC in pathways toward the dlPFC, but decreased dFC in pathways from the dlPFC. These discoveries constitute novel extensions of our understanding of task‐evoked dysconnection in schizophrenia and motivate understanding of the directional aspect of the dysconnection in schizophrenia. Disordered directionality should be investigated using computational psychiatric approaches that complement the MVAR method used in our work.

Striatal and hippocampal contributions to flexible navigation in rats and humans

The hippocampus has been firmly established as playing a crucial role in flexible navigation. Recent evidence suggests that dorsal striatum may also play an important role in such goal-directed behaviour in both rodents and humans. Across recent studies, activity in the caudate nucleus has been linked to forward planning and adaptation to changes in the environment. In particular, several human neuroimaging studies have found the caudate nucleus tracks information traditionally associated with that by the hippocampus. In this brief review, we examine this evidence and argue the dorsal striatum encodes the transition structure of the environment during flexible, goal-directed behaviour. We highlight that future research should explore the following: (1) Investigate neural responses during spatial navigation via a biophysically plausible framework explained by reinforcement learning models and (2) Observe the interaction between cortical areas and both the dorsal striatum and hippocampus during flexible navigation.

Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems

This article aims to provide a synthesis on the question how brain structures cooperate to accomplish hierarchically organized behaviors, characterized by low‐level, habitual routines nested in larger sequences of planned, goal‐directed behavior. The functioning of a connected set of brain structures—prefrontal cortex, hippocampus, striatum, and dopaminergic mesencephalon—is reviewed in relation to two important distinctions: (a) goal‐directed as opposed to habitual behavior and (b) model‐based and model‐free learning. Recent evidence indicates that the orbitomedial prefrontal cortices not only subserve goal‐directed behavior and model‐based learning, but also code the “landscape” (task space) of behaviorally relevant variables. While the hippocampus stands out for its role in coding and memorizing world state representations, it is argued to function in model‐based learning but is not required for coding of action–outcome contingencies, illustrating that goal‐directed behavior is not congruent with model‐based learning. While the dorsolateral and dorsomedial striatum largely conform to the dichotomy between habitual versus goal‐directed behavior, ventral striatal functions go beyond this distinction. Next, we contextualize findings on coding of reward‐prediction errors by ventral tegmental dopamine neurons to suggest a broader role of mesencephalic dopamine cells, viz. in behavioral reactivity and signaling unexpected sensory changes. We hypothesize that goal‐directed behavior is hierarchically organized in interconnected cortico‐basal ganglia loops, where a limbic‐affective prefrontal‐ventral striatal loop controls action selection in a dorsomedial prefrontal–striatal loop, which in turn regulates activity in sensorimotor‐dorsolateral striatal circuits. This structure for behavioral organization requires alignment with mechanisms for memory formation and consolidation. We propose that frontal corticothalamic circuits form a high‐level loop for memory processing that initiates and temporally organizes nested activities in lower‐level loops, including the hippocampus and the ripple‐associated replay it generates. The evidence on hierarchically organized behavior converges with that on consolidation mechanisms in suggesting a frontal‐to‐caudal directionality in processing control.