Habit formation

Food choice and neural reward systems in adolescents with anorexia nervosa and atypical anorexia nervosa

BACKGROUND

Adolescence is a critical developmental period for the study of anorexia nervosa (AN), an illness characterized by extreme restriction of food intake. The maturation of the reward system during adolescence combined with recent neurobiological models of AN led to the hypothesis that early on in illness, restrictive food choices would be associated with activity in nucleus accumbens reward regions, rather than caudate regions identified among adults with AN.

METHODS

Healthy adolescents (HC, n = 41) and adolescents with AN or atypical AN (atypAN, n = 76) completed a Food Choice Task during fMRI scanning. Selection of high-fat foods and choice-related activation in nucleus accumbens and anterior caudate regions-of-interest (ROIs) were compared between individuals with AN/atypAN and HC. Associations were examined between choice-related activation and choice preferences among the AN group. Exploratory analyses examined associations between choice-related activation and psychological assessments among the patient group.

RESULTS

Adolescents with AN or atypAN selected fewer high-fat foods than HC (t = -5.92, p < .001). Counter to predictions, there were no significant group differences in choice-related activation in the ROIs. Among individuals with AN or atypAN, choice-related neural activity in the anterior caudate was significantly negatively associated with high-fat food selections in the task (r = -.32, p = .024). In exploratory analyses, choice-related anterior caudate activation was positively associated with psychological measures of illness severity among patients (p's < .05, uncorrected).

CONCLUSIONS

In this large cohort of adolescents with AN/atypAN, there was no evidence of altered reward system engagement during food choice. While there was no group difference in choice-related caudate activation, the associations with choices and psychological measures continue to suggest that this neural region is implicated in illness. Longitudinal analyses will clarify whether neural variability relates to longer-term course.

Effects of sex and estrous cycle on action-outcome contingencies

Goal-directed and habitual-like behaviors are both necessary to efficiently and effectively navigate the environment. A dysregulation between these behaviors can lead to an overreliance on habitual-like behaviors and may contribute to symptoms experienced in some neuropsychiatric disorders such as substance use disorder. One behavioral task used to evaluate goal-directed and habitual-like behavior is an action-outcome task, contingency degradation, where an action (i.e., lever press) is degraded by decoupling the receipt of a reward from the action. However, little is known about how male and female rats and females across the estrous cycle respond during contingency degradation training and extinction testing. Here, we investigated how the variable of sex and estrous cycle influences contingency degradation training and extinction testing and the correlation between baseline anxiety-like behaviors and performance on contingency degradation extinction testing in adult male and female Long-Evans rats. We found that both males and females learned the contingency degradation task. However, during extinction testing, males respond more to the contingent lever than the non-contingent lever while females do not differ in their responses on the non-contingent and contingent levers. Lower baseline anxiety-like behavior predicted better performance on the contingency degradation test in males, but not females. Next, when we examined performance during extinction testing in females based on their estrous cycle stage on test day, we found that females in the proestrus and estrus stages of the estrous cycle do not differ in their responses on the non-contingent and contingent levers, while females in the metestrus and diestrus stages of the estrous cycle respond more on the contingent lever than the non-contingent lever on the extinction test day, similar to male rats. Our findings indicate that the estrous cycle influences how female rats respond during contingency degradation extinction testing that is dependent on their estrous cycle stage.

Striatal cell-type specific stability and reorganization underlying agency and habit

Adaptive decision making requires agency, knowledge that actions produce particular outcomes. For well-practiced routines, agency is relinquished in favor of habit. Here, we asked how dorsomedial striatum D1+ and D2/A2A+ neurons contribute to agency and habit. We imaged calcium activity of these neurons as mice learned to lever press with agency and formed habits with overtraining. Whereas many D1+ neurons stably encoded actions throughout learning and developed encoding of reward outcomes, A2A+ neurons reorganized their encoding of actions from initial action-outcome learning to habit formation. Chemogenetic manipulations indicated that both D1+ and A2A+ neurons support action-outcome learning, but only D1+ neurons enable the use of such agency for adaptive, goal-directed decision making. These data reveal coordinated dorsomedial striatum D1+ and A2A+ function for the development of agency, cell-type specific stability and reorganization underlying agency and habit, and important insights into the neuronal circuits of how we learn and decide.

The Incentive-Sensitization Theory of Addiction 30 Years On

The incentive-sensitization theory (IST) of addiction was first published in 1993, proposing that (a) brain mesolimbic dopamine systems mediate incentive motivation ("wanting") for addictive drugs and other rewards, but not their hedonic impact (liking) when consumed; and (b) some individuals are vulnerable to drug-induced long-lasting sensitization of mesolimbic systems, which selectively amplifies their "wanting" for drugs without increasing their liking of the same drugs. Here we describe the origins of IST and evaluate its status 30 years on. We compare IST to other theories of addiction, including opponent-process theories, habit theories of addiction, and prefrontal cortical dysfunction theories of impaired impulse control. We also address critiques of IST that have been raised over the years, such as whether craving is important in addiction and whether addiction can ever be characterized as compulsive. Finally, we discuss several contemporary phenomena, including the potential role of incentive sensitization in behavioral addictions, the emergence of addiction-like dopamine dysregulation syndrome in medicated Parkinson's patients, the role of attentional capture and approach tendencies, and the role of uncertainty in incentive motivation.

Contextualizing predictive minds

The structure of human memory seems to be optimized for efficient prediction, planning, and behavior. We propose that these capacities rely on a tripartite structure of memory that includes concepts, events, and contexts-three layers that constitute the mental world model. We suggest that the mechanism that critically increases adaptivity and flexibility is the tendency to contextualize. This tendency promotes local, context-encoding abstractions, which focus event- and concept-based planning and inference processes on the task and situation at hand. As a result, cognitive contextualization offers a solution to the frame problem-the need to select relevant features of the environment from the rich stream of sensorimotor signals. We draw evidence for our proposal from developmental psychology and neuroscience. Adopting a computational stance, we present evidence from cognitive modeling research which suggests that context sensitivity is a feature that is critical for maximizing the efficiency of cognitive processes. Finally, we turn to recent deep-learning architectures which independently demonstrate how context-sensitive memory can emerge in a self-organized learning system constrained by cognitively-inspired inductive biases.

Touchscreen response precision is sensitive to the explore/exploit tradeoff

The explore/exploit tradeoff is a fundamental property of choice selection during reward-guided decision making. In perceptual decision making, higher certainty decisions are more motorically precise, even when the decision does not require motor accuracy. However, while we can parametrically control uncertainty in perceptual tasks, we do not know what variables - if any - shape motor precision and reflect subjective certainty during reward-guided decision making. Touchscreens are increasingly used across species to measure choice, but provide no tactile feedback on whether an action is precise or not, and therefore provide a valuable opportunity to determine whether actions differ in precision due to explore/exploit state, reward, or individual variables. We find all three of these factors exert independent drives towards increased precision. During exploit states, successive touches to the same choice are closer together than those made in an explore state, consistent with exploit states reflecting higher certainty and/or motor stereotypy in responding. However, exploit decisions might be expected to be rewarded more frequently than explore decisions. We find that exploit choice precision is increased independently of a separate increase in precision due to immediate past reward, suggesting multiple mechanisms regulating choice precision. Finally, we see evidence that male mice in general are less precise in their interactions with the touchscreen than females, even when exploiting a choice. These results suggest that as exploit behavior emerges in reward-guided decision making, individuals become more motorically precise reflecting increased certainty, even when decision choice does not require additional motor accuracy, but this is influenced by individual differences and prior reward. These data uncover the hidden potential for touchscreen tasks in any species to uncover the latent neural states that unite cognition and movement.

A dual-pathway architecture enables chronic stress to disrupt agency and promote habit formation

Chronic stress can change how we learn and, thus, how we make decisions. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted systems neuroscience approach in male and female mice, we reveal a dual pathway, amygdala-striatal neuronal circuit architecture by which a recent history of chronic stress disrupts the action-outcome learning underlying adaptive agency and promotes the formation of inflexible habits. We found that the basolateral amygdala projection to the dorsomedial striatum is activated by rewarding events to support the action-outcome learning needed for flexible, goal-directed decision making. Chronic stress attenuates this to disrupt action-outcome learning and, therefore, agency. Conversely, the central amygdala projection to the dorsomedial striatum mediates habit formation. Following stress this pathway is progressively recruited to learning to promote the premature formation of inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to disrupt agency and promote habit. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and mental health conditions.

Body Checking in Anorexia Nervosa: from Inquiry to Habit

Body checking, characterized by the repeated visual or physical inspection of particular parts of one’s own body (e.g. thighs, waist, or upper arms) is one of the most prominent behaviors associated with eating disorders, particularly Anorexia Nervosa (AN). In this paper, we explore the explanatory potential of the Recalcitrant Fear Model of AN (RFM) in relation to body checking. We argue that RFM, when combined with certain plausible auxiliary hypotheses about the cognitive and epistemic roles of emotions, is able to explain key characteristics of body checking, including how body checking behavior becomes habitual and compulsive.

Assessing the influence of dopamine and mindfulness on the formation of routines in visual search

Given experience in cluttered but stable visual environments, our eye-movements form stereotyped routines that sample task-relevant locations, while not mixing-up routines between similar task-settings. Both dopamine signaling and mindfulness have been posited as factors that influence the formation of such routines, yet quantification of their impact remains to be tested in healthy humans. Over two sessions, participants searched through grids of doors to find hidden targets, using a gaze-contingent display. Within each session, door scenes appeared in either one of two colors, with each color signaling a differing set of likely target locations. We derived measures for how well target locations were learned (target-accuracy), how routine were sets of eye-movements (stereotypy), and the extent of interference between the two scenes (setting-accuracy). Participants completed two sessions, where they were administered either levodopa (dopamine precursor) or placebo (vitamin C), under double-blind counterbalanced conditions. Dopamine and trait mindfulness (assessed by questionnaire) interacted to influence both target-accuracy and stereotypy. Increasing dopamine improved accuracy and reduced stereotypy for high mindfulness scorers, but induced the opposite pattern for low mindfulness scorers. Dopamine also disrupted setting-accuracy invariant to mindfulness. Our findings show that mindfulness modulates the impact of dopamine on the target-accuracy and stereotypy of eye-movement routines, whereas increasing dopamine promotes interference between task-settings, regardless of mindfulness. These findings provide a link between non-human and human models regarding the influence of dopamine on the formation of task-relevant eye-movement routines and provide novel insights into behavior-trait factors that modulate the use of experience when building adaptive repertoires.

The well-worn route revisited: Striatal and hippocampal system contributions to familiar route navigation

Classic research has shown a division in the neuroanatomical structures that support flexible (e.g., short-cutting) and habitual (e.g., familiar route following) navigational behavior, with hippocampal-caudate systems associated with the former and putamen systems with the latter. There is, however, disagreement about whether the neural structures involved in navigation process particular forms of spatial information, such as associations between constellations of cues forming a cognitive map, versus single landmark-action associations, or alternatively, perform particular reinforcement learning algorithms that allow the use of different spatial strategies, so-called model-based (flexible) or model-free (habitual) forms of learning. We sought to test these theories by asking participants (N = 24) to navigate within a virtual environment through a previously learned, 9-junction route with distinctive landmarks at each junction while undergoing functional magnetic resonance imaging (fMRI). In a series of probe trials, we distinguished knowledge of individual landmark-action associations along the route versus knowledge of the correct sequence of landmark-action associations, either by having absent landmarks, or "out-of-sequence" landmarks. Under a map-based perspective, sequence knowledge would not require hippocampal systems, because there are no constellations of cues available for cognitive map formation. Within a learning-based model, however, responding based on knowledge of sequence would require hippocampal systems because prior context has to be utilized. We found that hippocampal-caudate systems were more active in probes requiring sequence knowledge, supporting the learning-based model. However, we also found greater putamen activation in probes where navigation based purely on sequence memory could be planned, supporting models of putamen function that emphasize its role in action sequencing.

Action sequence learning, habits, and automaticity in obsessive-compulsive disorder

This study investigates the goal/habit imbalance theory of compulsion in obsessive-compulsive disorder (OCD), which postulates enhanced habit formation, increased automaticity, and impaired goal/habit arbitration. It directly tests these hypotheses using newly developed behavioral tasks. First, OCD patients and healthy participants were trained daily for a month using a smartphone app to perform chunked action sequences. Despite similar procedural learning and attainment of habitual performance (measured by an objective automaticity criterion) by both groups, OCD patients self-reported higher subjective habitual tendencies via a recently developed questionnaire. Subsequently, in a re-evaluation task assessing choices between established automatic and novel goal-directed actions, both groups were sensitive to re-evaluation based on monetary feedback. However, OCD patients, especially those with higher compulsive symptoms and habitual tendencies, showed a clear preference for trained/habitual sequences when choices were based on physical effort, possibly due to their higher attributed intrinsic value. These patients also used the habit-training app more extensively and reported symptom relief post-study. The tendency to attribute higher intrinsic value to familiar actions may be a potential mechanism leading to compulsions and an important addition to the goal/habit imbalance hypothesis in OCD. We also highlight the potential of smartphone app training as a habit reversal therapeutic tool.

Motion Tracking of Daily Living and Physical Activities in Health Care: Systematic Review From Designers' Perspective

BACKGROUND

Motion tracking technologies serve as crucial links between physical activities and health care insights, facilitating data acquisition essential for analyzing and intervening in physical activity. Yet, systematic methodologies for evaluating motion tracking data, especially concerning user activity recognition in health care applications, remain underreported.

OBJECTIVE

This study aims to systematically review motion tracking in daily living and physical activities, emphasizing the critical interaction among devices, users, and environments from a design perspective, and to analyze the process involved in health care application research. It intends to delineate the design and application intricacies in health care contexts, focusing on enhancing motion tracking data's accuracy and applicability for health monitoring and intervention strategies.

METHODS

Using a systematic review, this research scrutinized motion tracking data and their application in health care and wellness, examining studies from Scopus, Web of Science, EBSCO, and PubMed databases. The review used actor network theory and data-enabled design to understand the complex interplay between humans, devices, and environments within these applications.

RESULTS

Out of 1501 initially identified studies, 54 (3.66%) were included for in-depth analysis. These articles predominantly used accelerometer and gyroscope sensors (n=43, 80%) to monitor and analyze motion, demonstrating a strong preference for these technologies in capturing both dynamic and static activities. While incorporating portable devices (n=11, 20%) and multisensor configurations (n=16, 30%), the application of sensors across the body (n=15, 28%) and within physical spaces (n=17, 31%) highlights the diverse applications of motion tracking technologies in health care research. This diversity reflects the application's alignment with activity types ranging from daily movements to specialized scenarios. The results also reveal a diverse participant pool, including the general public, athletes, and specialized groups, with a focus on healthy individuals (n=31, 57%) and athletes (n=14, 26%). Despite this extensive application range, the focus primarily on laboratory-based studies (n=39, 72%) aimed at professional uses, such as precise activity identification and joint functionality assessment, emphasizes a significant challenge in translating findings from controlled environments to the dynamic conditions of everyday physical activities.

CONCLUSIONS

This study's comprehensive investigation of motion tracking technology in health care research reveals a significant gap between the methods used for data collection and their practical application in real-world scenarios. It proposes an innovative approach that includes designers in the research process, emphasizing the importance of incorporating data-enabled design framework. This ensures that motion data collection is aligned with the dynamic and varied nature of daily living and physical activities. Such integration is crucial for developing health applications that are accessible, intuitive, and tailored to meet diverse user needs. By leveraging a multidisciplinary approach that combines design, engineering, and health sciences, the research opens new pathways for enhancing the usability and effectiveness of health technologies.

SB-258585 reduces food motivation while blocking 5-HT6 receptors in the non-human primate striatum

The interest in new 5-HT₆ agents stems from their ability to modulate cognition processing, food motivation and anxiety-like behaviors. While these findings come primarily from rodent studies, no studies on primates have been published. Furthermore, our understanding of where and how they act in the brain remains limited. Although the striatum is involved in all of these processes and expresses the highest levels of 5-HT₆ receptors, few studies have focused on it. We thus hypothesized that 5-HT6 receptor blockade would influence food motivation and modulate behavioral expression in non-human primates through striatal 5-HT6 receptors. This study thus aimed to determine the effects of acute administration of the SB-258585 selective 5-HT6 receptor antagonist on the feeding motivation and behaviors of six male macaques. Additionally, we investigated potential 5-HT6 targets using PET imaging to measure 5-HT6 receptor occupancy throughout the brain and striatal subregions. We used a food-choice task paired with spontaneous behavioral observations, checking 5-HT6 receptor occupancy with the specific PET imaging [18F]2FNQ1P radioligand. We demonstrated, for the first time in non-human primates, that modulation of 5-HT6 transmission, most likely through the striatum (the putamen and caudate nucleus), significantly reduces food motivation while exhibiting variable, weaker effects on behavior. While these results are consistent with the literature showing a decrease in food intake in rodents and proposing that 5-HT6 receptor antagonists can be used in obesity treatment, they question the antagonists' anxiolytic potential.

Opening new vistas on obsessive-compulsive disorder with the observing response task

Obsessive-compulsive disorder (OCD), a highly prevalent and debilitating disorder, is incompletely understood in terms of underpinning behavioural, psychological, and neural mechanisms. This is attributable to high symptomatic heterogeneity; cardinal features comprise obsessions and compulsions, including clinical subcategories. While obsessive and intrusive thoughts are arguably unique to humans, dysfunctional behaviours analogous to those seen in clinical OCD have been examined in nonhuman animals. Genetic, ethological, pharmacological, and neurobehavioural approaches all contribute to understanding the emergence and persistence of compulsive behaviour. One behaviour of particular interest is maladaptive checking, whereby human patients excessively perform checking rituals despite these serving no purpose. Dysfunctional and excessive checking is the most common symptom associated with OCD and can be readily operationalised in rodents. This review considers animal models of OCD, the neural circuitries associated with impairments in habit-based and goal-directed behaviour, and how these may link to the compulsions observed in OCD. We further review the Observing Response Task (ORT), an appetitive instrumental learning procedure that distinguishes between functional and dysfunctional checking, with translational application in humans and rodents. By shedding light on the psychological and neural bases of compulsive-like checking, the ORT has potential to offer translational insights into the underlying mechanisms of OCD, in addition to being a platform for testing psychological and neurochemical treatment approaches.

Acute stress facilitates habitual behavior in female rats

Instrumental behavior can reflect the influence of goal-directed and habitual systems. Contemporary research suggests that stress may facilitate control by the habitual system under conditions where the behavior would otherwise reflect control by the goal-directed system. However, it is unclear how stress modulates the influence of these systems on instrumental responding to achieve this effect, particularly in females. Here, we examine whether a mild psychogenic stressor experienced before acquisition training (Experiment 1), or prior to the test of expression (Experiment 2) would influence goal-directed and habitual control of instrumental responding in female rats. In both experiments, rats acquired an instrumental nose-poke response for a sucrose reward. This was followed by a reinforcer devaluation phase in which half the rats in Stressed and Non-Stressed conditions received pairings of the sucrose pellet with illness induced by lithium chloride until they rejected the pellet when offered. The remaining rats received a control treatment consisting of pellets and illness on separate days (Unpaired). Control by goal-directed and habitual systems was evaluated in a subsequent nonreinforced test of nose poking. The results of Experiment 1 indicated that the Non-Stressed Paired group reduced nose-poking compared to the Unpaired controls, identifying the response as goal directed, whereas the Stressed Paired and Unpaired groups made a similar number of nose pokes identifying the response as habitual despite a similar amount of training. Results from Experiment 2 indicated habitual control of nose-poke responding was present when stress was experienced just prior to the test. Collectively, these data suggest that stress may facilitate habitual control by altering the relative influence of goal-directed and habitual processes underpinning instrumental behavior. These results may be clinically relevant for understanding the contributions of stress to dysregulated instrumental behavior in compulsive pathologies.

Goal-directed learning in adolescence: neurocognitive development and contextual influences

Adolescence is a time during which we transition to independence, explore new activities and begin pursuit of major life goals. Goal-directed learning, in which we learn to perform actions that enable us to obtain desired outcomes, is central to many of these processes. Currently, our understanding of goal-directed learning in adolescence is itself in a state of transition, with the scientific community grappling with inconsistent results. When we examine metrics of goal-directed learning through the second decade of life, we find that many studies agree there are steady gains in performance in the teenage years, but others report that adolescent goal-directed learning is already adult-like, and some find adolescents can outperform adults. To explain the current variability in results, sophisticated experimental designs are being applied to test learning in different contexts. There is also increasing recognition that individuals of different ages and in different states will draw on different neurocognitive systems to support goal-directed learning. Through adoption of more nuanced approaches, we can be better prepared to recognize and harness adolescent strengths and to decipher the purpose (or goals) of adolescence itself.

Role of the basal ganglia in innate and learned behavioural sequences

Integrating individual actions into coherent, organised behavioural units, a process called chunking, is a fundamental, evolutionarily conserved process that renders actions automatic. In vertebrates, evidence points to the basal ganglia - a complex network believed to be involved in action selection - as a key component of action sequence encoding, although the underlying mechanisms are only just beginning to be understood. Central pattern generators control many innate automatic behavioural sequences that form some of the most basic behaviours in an animal's repertoire, and in vertebrates, brainstem and spinal pattern generators are under the control of higher order structures such as the basal ganglia. Evidence suggests that the basal ganglia play a crucial role in the concatenation of simpler behaviours into more complex chunks, in the context of innate behavioural sequences such as chain grooming in rats, as well as sequences in which innate capabilities and learning interact such as birdsong, and sequences that are learned from scratch, such as lever press sequences in operant behaviour. It has been proposed that the role of the striatum, the largest input structure of the basal ganglia, might lie in selecting and allowing the relevant central pattern generators to gain access to the motor system in the correct order, while inhibiting other behaviours. As behaviours become more complex and flexible, the pattern generators seem to become more dependent on descending signals. Indeed, during learning, the striatum itself may adopt the functional characteristics of a higher order pattern generator, facilitated at the microcircuit level by striatal neuropeptides.

Transcranial Direct Current Stimulation (tDCS) Ameliorates Stress-Induced Sleep Disruption via Activating Infralimbic-Ventrolateral Preoptic Projections

Transcranial direct current stimulation (tDCS) is acknowledged for its non-invasive modulation of neuronal activity in psychiatric disorders. However, its application in insomnia research yields varied outcomes depending on different tDCS types and patient conditions. Our primary objective is to elucidate its efficiency and uncover the underlying mechanisms in insomnia treatment. We hypothesized that anodal prefrontal cortex stimulation activates glutamatergic projections from the infralimbic cortex (IL) to the ventrolateral preoptic area (VLPO) to promote sleep. After administering 0.06 mA of electrical currents for 8 min, our results indicate significant non-rapid eye movement (NREM) enhancement in naïve mice within the initial 3 h post-stimulation, persisting up to 16-24 h. In the insomnia group, tDCS enhanced NREM sleep bout numbers during acute stress response and improved NREM and REM sleep duration in subsequent acute insomnia. Sleep quality, assessed through NREM delta powers, remains unaffected. Interference of the IL-VLPO pathway, utilizing designer receptors exclusively activated by designer drugs (DREADDs) with the cre-DIO system, partially blocked tDCS's sleep improvement in stress-induced insomnia. This study elucidated that the activation of the IL-VLPO pathway mediates tDCS's effect on stress-induced insomnia. These findings support the understanding of tDCS effects on sleep disturbances, providing valuable insights for future research and clinical applications in sleep therapy.

Timing Patterns in the Extended Basal Ganglia System

The human brain is a constructive organ. It generates predictions to modulate its functioning and continuously adapts to a dynamic environment. Increasingly, the temporal dimension of motor and non-motor behaviour is recognised as a key component of this predictive bias. Nevertheless, the intricate interplay of the neural mechanisms that encode, decode and evaluate temporal information to give rise to a sense of time and control over sensorimotor timing remains largely elusive. Among several brain systems, the basal ganglia have been consistently linked to interval- and beat-based timing operations. Considering the tight embedding of the basal ganglia into multiple complex neurofunctional networks, it is clear that they have to interact with other proximate and distal brain systems. While the primary target of basal ganglia output is the thalamus, many regions connect to the striatum of the basal ganglia, their main input relay. This establishes widespread connectivity, forming the basis for first- and second-order interactions with other systems implicated in timing such as the cerebellum and supplementary motor areas. However, next to this structural interconnectivity, additional functions need to be considered to better understand their contribution to temporally predictive adaptation. To this end, we develop the concept of interval-based patterning, conceived as a temporally explicit hierarchical sequencing operation that underlies motor and non-motor behaviour as a common interpretation of basal ganglia function.

Positive correlation between measures of habitual responding and motivated responding in mice

Habit and motivation are thought to be separate processes, with motivated behavior often considered to be goal directed, whereas habits are defined by the absence of goal-directed control over behavior. However, there has been increasing interrogation of the binary nature of habitual versus goal-directed behavior. Furthermore, although drug and alcohol exposure can promote the formation of habits, drug seeking itself can also be highly flexible, pointing toward the need for complex consideration of the parallel processes that drive behavior. The goal of the current study was to determine whether there was a relation between motivation-as measured by progressive ratio-and habit-as measured by contingency degradation-and whether this relation was affected by ethanol exposure history and sex. The results showed that these measures were positively correlated such that greater contingency insensitivity was associated with achieving higher break points on the progressive-ratio task. However, this relation depended on reinforcement schedule history, ethanol exposure history, and sex. These point to potential relations between measures of habit and motivation and stress the importance of carefully parsing behavioral findings and assays. These findings are also expected to inform future substance use research, as drug history may affect these relations.

Subregion specific neuroadaptations in the female rat striatum during acute and protracted withdrawal from nicotine

Epidemiological studies and clinical observations suggest that nicotine, a major contributor of the global burden of disease, acts in a partially sex specific manner. Still, preclinical research has primarily been conducted in males. More research is thus required to define the effects displayed by nicotine on the female brain. To this end, female rats received 15 injections of either nicotine (0.36mg/kg) or saline, over a 3-week period and were then followed for up to 3 months. Behavioral effects of nicotine were assessed using locomotor activity measurements and elevated plus maze, while neurophysiological changes were monitored using ex vivo electrophysiological field potential recordings conducted in subregions of the dorsal and ventral striatum. Behavioral assessments demonstrated a robust sensitization to the locomotor stimulatory properties of nicotine, but monitored behaviors on the elevated plus maze were not affected during acute (24 h) or protracted (3 months) withdrawal. Electrophysiological recordings revealed a selective increase in excitatory neurotransmission in the nucleus accumbens shell and dorsomedial striatum during acute withdrawal. Importantly, accumbal neuroadaptations in nicotine-treated rats correlated with locomotor behavior, supporting a role for the nucleus accumbens in behavioral sensitization. While no sustained neuroadaptations were observed following 3 months withdrawal, there was an overall trend towards reduced inhibitory tone. Together, these findings suggest that nicotine produces selective transformations of striatal brain circuits that may drive specific behaviors associated with nicotine exposure. Furthermore, our observations suggest that sex-specificity should be considered when evaluating long-term effects by nicotine on the brain.

Elevated prefrontal dopamine interferes with the stress-buffering properties of behavioral control in female rats

Stress-linked disorders are more prevalent in women than in men and differ in their clinical presentation. Thus, investigating sex differences in factors that promote susceptibility or resilience to stress outcomes, and the circuit elements that mediate their effects, is important. In male rats, instrumental control over stressors engages a corticostriatal system involving the prelimbic cortex (PL) and dorsomedial striatum (DMS) that prevent many of the sequelae of stress exposure. Interestingly, control does not buffer against stress outcomes in females, and here, we provide evidence that the instrumental controlling response in females is supported instead by the dorsolateral striatum (DLS). Additionally, we used in vivo microdialysis, fluorescent in situ hybridization, and receptor subtype pharmacology to examine the contribution of prefrontal dopamine (DA) to the differential impact of behavioral control. Although both sexes preferentially expressed D1 receptor mRNA in PL GABAergic neurons, there were robust sex differences in the dynamic properties of prefrontal DA during controllable stress. Behavioral control potently attenuated stress-induced DA efflux in males, but not females, who showed a sustained DA increase throughout the entire stress session. Importantly, PL D1 receptor blockade (SCH 23390) shifted the proportion of striatal activity from the DLS to the DMS in females and produced the protective effects of behavioral control. These findings suggest a sex-selective mechanism in which elevated DA in the PL biases instrumental responding towards prefrontal-independent striatal circuitry, thereby eliminating the protective impact of coping with stress.

Lack of action monitoring as a prerequisite for habitual and chunked behavior: Behavioral and neural correlates

We previously reported the rapid development of habitual behavior in a discrete-trials instrumental task in which lever insertion and retraction act as reward-predictive cues delineating sequence execution. Here we asked whether lever cues or performance variables reflective of skill and automaticity might account for habitual behavior in male rats. Behavior in the discrete-trials habit-promoting task was compared with two task variants lacking the sequence-delineating cues of lever extension and retraction. We find that behavior is under goal-directed control in absence of sequence-delineating cues but not in their presence, and that skilled performance does not predict goal-directed vs. habitual behavior. Neural activity recordings revealed an engagement of dorsolateral striatum and a disengagement of dorsomedial striatum during the sequence execution of the habit-promoting task, specifically. Together, these results indicate that sequence delineation cues promote habit and differential engagement of striatal subregions during instrumental responding, a pattern that may reflect cue-elicited behavioral chunking.

Embodied and embedded ecological rationality: A common vertebrate mechanism for action selection underlies cognition and heuristic decision-making in humans

The last common ancestor shared by humans and other vertebrates lived over half a billion years ago. In the time since that ancestral line diverged, evolution by natural selection has produced an impressive diversity—from fish to birds to elephants—of vertebrate morphology; yet despite the great species-level differences that otherwise exist across the brains of many animals, the neural circuitry that underlies motor control features a functional architecture that is virtually unchanged in every living species of vertebrate. In this article, we review how that circuitry facilitates motor control, trial-and-error-based procedural learning, and habit formation; we then develop a model that describes how this circuitry (embodied in an agent) works to build and refine sequences of goal-directed actions that are molded to fit the structure of the environment (in which the agent is embedded). We subsequently review evidence suggesting that this same functional circuitry became further adapted to regulate cognitive control in humans as well as motor control; then, using examples of heuristic decision-making from the ecological rationality tradition, we show how the model can be used to understand how that circuitry operates analogously in both cognitive and motor domains. We conclude with a discussion of how the model encourages a shift in perspective regarding ecological rationality’s “adaptive toolbox”—namely, to one that views heuristic processes and other forms of goal-directed cognition as likely being implemented by the same neural circuitry (and in the same fashion) as goal-directed action in the motor domain—and how this change of perspective can be useful.

Prefrontal Cortical to Mediodorsal Thalamus Projection Neurons Regulate Posterror Adaptive Control of Behavior

Adaptive control is the online adjustment of behavior to guide and optimize responses after errors or conflict. The neural circuits involved in monitoring and adapting behavioral performance following error are poorly understood. The prefrontal cortex (PFC) plays a critical role in this form of control. However, these brain areas are densely connected with many other regions, and it is unknown which projections are critical for adaptive behavior. Here, we tested the involvement of four distinct dorsal and ventral prefrontal cortical projections to striatal and thalamic target areas in adaptive control. We re-analyzed data from published experiments, using trial-by-trial analyses of behavior in an operant task for attention and impulsivity. We find that male rats slow their responses and perform worse following errors. Moreover, by combining retrograde labeling and chemogenetic silencing, we find that dorsomedial prefrontal pyramidal neurons that project to the lateral nucleus of the mediodorsal thalamus (MDL) are involved in posterror performance and timing of responses, specifically with unpredictable delays until stimulus presentation. Together, these data show that dorsal medial PFC (mPFC) projection neurons targeting the lateral MDT regulate adaptive control to flexibly optimize behavioral responses in goal-directed behavior.

Cocaine falls into oblivion during volitional initiation of choice trials

When facing a choice, most animals quit drugs in favour of a variety of nondrug alternatives. We recently found, rather unexpectedly, that choice of the nondrug alternative is in fact inflexible and habitual. One possible contributing factor to habitual choice is the intermittency and uncontrollability of choice trials in previous studies. Here, we asked whether and to what extent volitional control over the occurrence of choice trials could change animals' preference by preventing habitual choice. To do so, rats were trained to nosepoke in a hole to trigger the presentation of two operant levers: one associated with cocaine, the other with saccharin. Rats were then free to choose among the two levers to obtain the corresponding reward, after which both levers retracted until rats self-initiated the next choice trial. Overall, we found that volitional control over choice trials did not change preference. Most rats preferred saccharin over cocaine and selected this option almost exclusively. Intriguingly, after repeated choice and consumption of saccharin, rats transiently lost interest in this option (i.e., due to sensory-specific satiety), but they did not switch to cocaine, preferring instead to pause during long periods of time before reinitiating a choice trial for saccharin. This finding suggests that during volitional initiation of a choice trial, rats fail to consider cocaine as an option. We discuss a possible associative mechanism to explain this perplexing behaviour.

Medial septum activation improves strategy switching once strategies are well-learned via bidirectional regulation of dopamine neuron population activity

Strategy switching is a form of cognitive flexibility that requires inhibiting a previously successful strategy and switching to a new strategy of a different categorical modality. It is dependent on dopamine (DA) receptor activation and release in ventral striatum and prefrontal cortex, two primary targets of ventral tegmental area (VTA) DA projections. Although the circuitry that underlies strategy switching early in learning has been studied, few studies have examined it after extended discrimination training. This may be important as DA activity and release patterns change across learning, with several studies demonstrating a critical role for substantia nigra pars compacta (SNc) DA activity and release once behaviors are well-learned. We have demonstrated that medial septum (MS) activation simultaneously increased VTA and decreased SNc DA population activity, as well as improved reversal learning via these actions on DA activity. We hypothesized that MS activation would improve strategy switching both early in learning and after extended training through its ability to increase VTA DA population activity and decrease SNc DA population activity, respectively. We chemogenetically activated the MS of male and female rats and measured their performance on an operant-based strategy switching task following 1, 10, or 15 days of discrimination training. Contrary to our hypothesis, MS activation did not affect strategy switching after 1 day of discrimination training. MS activation improved strategy switching after 10 days of training, but only in females. MS activation improved strategy switching in both sexes after 15 days of training. Infusion of bicuculline into the ventral subiculum (vSub) inhibited the MS-mediated decrease in SNc DA population activity and attenuated the improvement in strategy switching. Intra-vSub infusion of scopolamine inhibited the MS-mediated increase in VTA DA population activity but did not affect the improvement in strategy switching. Intra-vSub infusion of both bicuculline and scopolamine inhibited the MS-mediated effects on DA population activity in both the SNc and VTA and completely prevented the improvement in strategy switching. These data indicate that MS activation improves strategy switching once the original strategy has been sufficiently well-learned, and that this may occur via the MS's regulation of DA neuron responsivity.

An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits

The dorsolateral striatum plays a critical role in the acquisition and expression of stimulus-response habits that are learned in experimental laboratories. Here, we use meta-analytic procedures to contrast the neural circuits activated by laboratory-acquired habits with those activated by stimulus-response behaviours acquired in everyday-life. We confirmed that newly learned habits rely more on the anterior putamen with activation extending into caudate and nucleus accumbens. Motor and associative components of everyday-life habits were identified. We found that motor-dominant stimulus-response associations developed outside the laboratory primarily engaged posterior dorsal putamen, supplementary motor area (SMA) and cerebellum. Importantly, associative components were also represented in the posterior putamen. Thus, common neural representations for both naturalistic and laboratory-based habits were found in the left posterior and right anterior putamen. These findings suggest a partial common striatal substrate for habitual actions that are performed predominantly by stimulus-response associations represented in the posterior striatum. The overlapping neural substrates for laboratory and everyday-life habits supports the use of both methods for the analysis of habitual behaviour.

Hierarchical Reinforcement Learning, Sequential Behavior, and the Dorsal Frontostriatal System

To effectively behave within ever-changing environments, biological agents must learn and act at varying hierarchical levels such that a complex task may be broken down into more tractable subtasks. Hierarchical reinforcement learning (HRL) is a computational framework that provides an understanding of this process by combining sequential actions into one temporally extended unit called an option. However, there are still open questions within the HRL framework, including how options are formed and how HRL mechanisms might be realized within the brain. In this review, we propose that the existing human motor sequence literature can aid in understanding both of these questions. We give specific emphasis to visuomotor sequence learning tasks such as the discrete sequence production task and the M × N (M steps × N sets) task to understand how hierarchical learning and behavior manifest across sequential action tasks as well as how the dorsal cortical-subcortical circuitry could support this kind of behavior. This review highlights how motor chunks within a motor sequence can function as HRL options. Furthermore, we aim to merge findings from motor sequence literature with reinforcement learning perspectives to inform experimental design in each respective subfield.

Structure-Functional Selectivity Relationship Studies on A-86929 Analogs and Small Aryl Fragments toward the Discovery of Biased Dopamine D1 Receptor Agonists

Dopamine regulates normal functions such as movement, reinforcement learning, and cognition, and its dysfunction has been implicated in multiple psychiatric and neurological disorders. Dopamine acts through D1- (D1R and D5R) and D2-class (D2R, D3R, and D4R) receptors and activates both G protein- and β-arrestin-dependent signaling pathways. Current dopamine receptor-based therapies are used to ameliorate motor deficits in Parkinson's disease or as antipsychotic medications for schizophrenia. These drugs show efficacy for ameliorating only some symptoms caused by dopamine dysfunction and are plagued by debilitating side effects. Studies in primates and rodents have shown that shifting the balance of dopamine receptor signaling toward the arrestin pathway can be beneficial for inducing normal movement, while reducing motor side effects such as dyskinesias, and can be efficacious at enhancing cognitive function compared to balanced agonists. Several structure-activity relationship (SAR) studies have embarked on discovering β-arrestin-biased dopamine agonists, focused on D2 partial agonists, noncatechol D1 agonists, and mixed D1/D2R dopamine receptor agonists. Here, we describe an SAR study to identify novel D1R β-arrestin-biased ligands using A-86929, a high-affinity D1R catechol agonist, as a core scaffold to identify chemical motifs responsible for β-arrestin-biased activity at both D1 and D2Rs. Most of the A-86929 analogs screened were G protein-biased, but none of them were exclusively arrestin-biased. Additionally, various small-fragment molecular probes displayed weak bias toward the β-arrestin pathway. Continued in-depth SFSR (structure-functional selectivity relationship) studies informed by structure determination, molecular modeling, and mutagenesis studies will facilitate the discovery of potent and efficacious arrestin-biased dopamine receptor ligands.

Cyclic estrogen and progesterone during instrumental acquisition contributes to habit formation in female rats

Habit formation is thought to involve two parallel processes that are mediated by distinct neural substates: one that suppresses goal-directed behavior, and one that facilitates stimulus-response (S-R) learning, which underscores habitual behavior. In previous studies we showed that habitual responding emerges early during instrumental training in gonadally-intact female, compared to male, rats. The present study aimed to determine the role of ovarian hormones during instrumental acquisition in the transition from goal-directed to habitual behavior in female rats. Ovariectomized (OVX) female rats were given subcutaneous silastic capsules that released low levels of 17-β estradiol (E2) to maintain estrogen receptor availability. Rats were assigned to one of three hormone treatment conditions: no additional hormone replacement (Control group), replacement with high E2 (High E2 group), or replacement with high E2 followed by progesterone (High E2 + P4 group). Hormone replacement occurred twice during acquisition to mimic natural hormone fluctuations. At test, the Control and High E2 groups demonstrated responding that was sensitive to devaluation by lithium chloride-induced illness, indicating goal-directed behavior. In contrast, the High E2 + P4 group exhibited a pattern of devaluation-insensitive, habitual responding, that suggested the suppression of goal-directed processes. In a follow-up experiment, similar procedures were conducted, however during acquisition, OVX rats were given cyclic high E2 plus medroxy-progesterone (MPA), a form of progesterone that does not metabolize to neuroactive metabolites. In this group, goal-directed behavior was observed. These data indicate that habit formation is not facilitated in low estrogen states, nor in the presence of cyclic high E2. However, cyclic high E2, together with progesterone during acquisition, appears to facilitate the early emergence of habitual responding. Furthermore, these data suggest that a neuroactive progesterone metabolite, like allopregnanolone, in combination with high cyclic E2, supports this phenomenon.

Simultaneous Measurement of Striatal Dopamine and Hydrogen Peroxide Transients Associated with L-DOPA Induced Rotation in Hemiparkinsonian Rats

Parkinson's disease (PD) is a neurodegenerative disorder commonly treated with levodopa (L-DOPA), which eventually induces abnormal involuntary movements (AIMs). The neurochemical contributors to these dyskinesias are unknown; however, several lines of evidence indicate an interplay of dopamine (DA) and oxidative stress. Here, DA and hydrogen peroxide (H2O2) were simultaneously monitored at discrete recording sites in the dorsal striata of hemiparkinsonian rats using fast-scan cyclic voltammetry. Mass spectrometry imaging validated the lesions. Hemiparkinsonian rats exhibited classic L-DOPA-induced AIMs and rotations as well as increased DA and H2O2 tone over saline controls after 1 week of treatment. By week 3, DA tone remained elevated beyond that of controls, but H2O2 tone was largely normalized. At this time point, rapid chemical transients were time-locked with spontaneous bouts of rotation. Striatal H2O2 rapidly increased with the initiation of contraversive rotational behaviors in lesioned L-DOPA animals, in both hemispheres. DA signals simultaneously decreased with rotation onset. The results support a role for these striatal neuromodulators in the adaptive changes that occur with L-DOPA treatment in PD and reveal a precise interplay between DA and H2O2 in the initiation of involuntary locomotion.

Multiplexed action-outcome representation by striatal striosome-matrix compartments detected with a mouse cost-benefit foraging task

Learning about positive and negative outcomes of actions is crucial for survival and underpinned by conserved circuits including the striatum. How associations between actions and outcomes are formed is not fully understood, particularly when the outcomes have mixed positive and negative features. We developed a novel foraging (‘bandit’) task requiring mice to maximize rewards while minimizing punishments. By 2-photon Ca⁺⁺ imaging, we monitored activity of visually identified anterodorsal striatal striosomal and matrix neurons. We found that action-outcome associations for reward and punishment were encoded in parallel in partially overlapping populations. Single neurons could, for one action, encode outcomes of opposing valence. Striosome compartments consistently exhibited stronger representations of reinforcement outcomes than matrix, especially for high reward or punishment prediction errors. These findings demonstrate multiplexing of action-outcome contingencies by single identified striatal neurons and suggest that striosomal neurons are particularly important in action-outcome learning.

The role that the striatum plays in tracking the association between actions and combinations of rewarding and aversive outcomes remains unclear. Here, by using both calcium imaging in mice and reinforcement learning models, the authors find that individual striatal neurons can encode associations between actions and multiple, sometimes conflicting, outcomes.

Opposing Roles of the Dorsolateral and Dorsomedial Striatum in the Acquisition of Skilled Action Sequencing in Rats

The shift in control from dorsomedial to dorsolateral striatum during skill and habit formation has been well established, but whether striatal subregions orchestrate this shift cooperatively or competitively remains unclear. Cortical inputs have also been implicated in the shift toward automaticity, but it is unknown whether they mirror their downstream striatal targets across this transition. We addressed these questions using a five step heterogeneous action sequencing task in male rats that is optimally performed by automated chains of actions. By optimizing automatic habitual responding, we discovered that loss of function in the dorsomedial striatum accelerated sequence acquisition. In contrast, loss of function in the dorsolateral striatum impeded acquisition of sequencing, demonstrating functional opposition within the striatum. Unexpectedly, the mPFC was not involved; however, the lateral orbitofrontal cortex was critical. These results shift current theories about striatal control of behavior to a model of competitive opposition, where the dorsomedial striatum interferes with the development of dorsolateral-striatum dependent behavior.SIGNIFICANCE STATEMENT We provide the most direct evidence to date that the dorsomedial and dorsolateral striatum compete for control in the acquisition of habitual action sequences. The dorsolateral striatum was critical for sequencing behavior, but loss of dorsomedial striatum function enhanced acquisition. In addition, we found that the mPFC was not required for the formation of automated actions. Using a task that optimizes habitual responding, we demonstrate that the arbitration of dorsomedial and dorsolateral control is not modulated by medial prefrontal cortical activity. However, we find evidence for the role of the lateral orbitofrontal cortex in action sequencing. These results have implications for our understanding of how habits and skills form.

Infralimbic cortex functioning across motivated behaviors: Can the differences be reconciled?

The rodent infralimbic cortex (IL) is implicated in higher order executive functions such as reward seeking and flexible decision making. However, the precise nature of its role in these processes is unclear. Early evidence indicated that the IL promotes the extinction and ongoing inhibition of fear conditioning and cocaine seeking. However, evidence spanning other behavioral domains, such as natural reward seeking and habit-based learning, suggests a more nuanced understanding of IL function. As techniques have advanced and more studies have examined IL function, identifying a unifying explanation for its behavioral function has become increasingly difficult. Here, we discuss evidence of IL function across motivated behaviors, including associative learning, drug seeking, natural reward seeking, and goal-directed versus habit-based behaviors, and emphasize how context-specific encoding and heterogeneous IL neuronal populations may underlie seemingly conflicting findings in the literature. Together, the evidence suggests that a major IL function is to facilitate the encoding and updating of contingencies between cues and behaviors to guide subsequent behaviors.

The Role of Regulation and Emotional Eating Behaviour in the Early Development of Obesity

The purpose of our research was to explore the role of both parents’ use of behavioural regulation with food and children’s emotional self-regulation in young children with and without overweight/obesity. For this purpose, 123 participants (n = 62 boys and n = 61 girls) were recruited and classified into two groups by their Body Mass Index (BMI, non-overweight vs. overweight/obese) and into two age groups (four years and seven years). The children’s parents/primary caregivers completed two scales of the Childhood Obesogenic Behaviours’ Questionnaire (COBQ). The participants were measured and weighed to calculate their BMI to identify overweight, obesity, and non-overweight. The results showed that the means for children who were obese/overweight were significantly higher than those of children who were non-overweight for both the parents’ behavioural regulation scale (non-overweight: M = 1.80, SD = 0.69; overweight/obesity: M = 2.94, SD = 0.85) and the child’s emotional overeating scale (non-overweight: M = 1.47, SD = 0.56; overweight/obesity: M = 2.65, SD = 0.87). No statistically significant differences were found related to age (4 and 7 years), indicating that the potential impact of obesogenic behaviours starts early in development. Similarly, no differences by gender were found. Due to the implications of obesity for physical and mental health, and the high probability of maintaining this overweight status in the long term, family-based interventions to prevent obesity are highly advisable from birth.

Parallel and hierarchical neural mechanisms for adaptive and predictive behavioral control

Our brain can be recognized as a network of largely hierarchically organized neural circuits that operate to control specific functions, but when acting in parallel, enable the performance of complex and simultaneous behaviors. Indeed, many of our daily actions require concurrent information processing in sensorimotor, associative, and limbic circuits that are dynamically and hierarchically modulated by sensory information and previous learning. This organization of information processing in biological organisms has served as a major inspiration for artificial intelligence and has helped to create in silico systems capable of matching or even outperforming humans in several specific tasks, including visual recognition and strategy-based games. However, the development of human-like robots that are able to move as quickly as humans and respond flexibly in various situations remains a major challenge and indicates an area where further use of parallel and hierarchical architectures may hold promise. In this article we review several important neural and behavioral mechanisms organizing hierarchical and predictive processing for the acquisition and realization of flexible behavioral control. Then, inspired by the organizational features of brain circuits, we introduce a multi-timescale parallel and hierarchical learning framework for the realization of versatile and agile movement in humanoid robots.

Applying the Science of Habit Formation to Evidence-Based Psychological Treatments for Mental Illness

Habits affect nearly every aspect of our physical and mental health. Although the science of habit formation has long been of interest to psychological scientists across disciplines, we propose that applications to clinical psychological science have been insufficiently explored. In particular, evidence-based psychological treatments (EBPTs) are interventions targeting psychological processes that cause and/or maintain mental illness and that have been developed and evaluated scientifically. An implicit goal of EBPTs is to disrupt unwanted habits and develop desired habits. However, there has been insufficient attention given to habit-formation principles, theories, and measures in the development and delivery of EBTPs. Herein we consider whether outcomes following an EBPT would greatly improve if the basic science of habit formation were more fully leveraged. We distill six ingredients that are central to habit formation and demonstrate how these ingredients are relevant to EBPTs. We highlight practice points and an agenda for future research. We propose that there is an urgent need for research to guide the application of the science of habit formation and disruption to the complex "real-life" habits that are the essence of EBPTs.

Striatal Astrocytes Shape Behavioral Flexibility via Regulation of the Glutamate Transporter EAAT2

BACKGROUND

Striatal circuits must be modulated for behavioral flexibility, the ability to adapt to environmental changes. Striatal astrocytes contribute to circuit neuromodulation by controlling the activity of ambient neurotransmitters. In particular, extracellular glutamate levels are tightly controlled by the astrocytic glutamate transporter EAAT2, influencing synaptic functioning and neural network activity. However, it remains unclear if EAAT2 responds to environmental cues to specifically shape action control.

METHODS

To investigate the relationship between behavioral flexibility and experience-dependent regulation of EAAT2 expression in the dorsal striatum, mice were trained on an instrumental task. We manipulated EAAT2 expression using chemogenetic activation of astrocytic Gq signaling or in vivo morpholinos and determined the ability to adapt to novel environmental contingencies.

RESULTS

The loss of behavioral flexibility with task overtraining is associated with the upregulation of EAAT2, which results in enhanced glutamate clearance and altered modulation of glutamatergic neurotransmission in the lateral part of the dorsal striatum. Interfering with EAAT2 upregulation in this striatal area preserves behavioral flexibility.

CONCLUSIONS

Astrocytes are emerging as critical regulators of striatal functions. This work demonstrates that plasticity of EAAT2 expression in the lateral part of the dorsal striatum shapes behavior, thus providing novel mechanistic insights into how flexibility in action control is regulated.

Clinical Neuroscience of Addiction: What Clinical Psychologists Need to Know and Why

The last three decades in psychological research have been marked by interdisciplinary science. Addiction represents a prime example of a disorder marked by a complex interaction among psychosocial and biological factors. This review highlights critical findings in the basic neuroscience of addiction and translates them into clinical language that can inform clinical psychologists in their research, teaching, and practice. From mechanisms of reward processing, learning and memory, allostasis, incentive-sensitization, withdrawal, tolerance, goal-directed decision making, habit learning, genetics, inflammation, and the microbiome, the common theme of this review is to illustrate the clinical utility of basic neuroscience research and to identify opportunities for clinical science. The thoughtful integration of basic and clinical science provides a powerful tool to fulfill the scientific mission of improving health care. Clinical psychologists have a crucial role to play in the translational science of addiction.

Emotional Regulation and Overeating Behaviors in Children and Adolescents: A Systematic Review

The worldwide prevalence of obesity has dramatically increased, mostly in children and adolescents. The Emotional Eating theoretical model has proposed that the failure in emotional regulation could represent a risk factor for establishing maladaptive overeating behavior that represents an inadequate response to negative emotions and allows increasing body-weight. This systematic review investigates the relationship between overeating and both emotional regulation and emotional intelligence in childhood and adolescence, considering both cross-sectional and longitudinal studies. Moreover, another goal of the review is evaluating whether emotional regulation and emotional intelligence can cause overeating behaviors. The systematic search was conducted according to the PRISMA-statement in the databases Medline, PsychArtcles, PsychInfo, PubMed, Scopus, and Web of Sciences, and allows 484 records to be extracted. Twenty-six studies were selected according to inclusion (e.g., studies focused on children and adolescents without clinical conditions; groups of participants overweight or with obesity) and exclusion (e.g., studies that adopted qualitative assessment or cognitive-affective tasks to measure emotional variables; reviews, commentary, or brief reports) criteria detailed in the methods. Cross-sectional studies showed a negative association between emotional regulation and overeating behavior that was confirmed by longitudinal studies. These findings highlighted the role of maladaptive emotion regulation on overeating and being overweight. The relationship between these constructs in children and adolescents was consistent. The results indicated the complexity of this association, which would be influenced by many physiological, psychological, and social factors. These findings underline the need for further studies focused on emotion regulation in the development of overeating. They should analyze the mediation role of other variables (e.g., attachment style, peer pressure) and identify interventions to prevent and reduce worldwide overweight prevalence.

Distinct temporal difference error signals in dopamine axons in three regions of the striatum in a decision-making task

Different regions of the striatum regulate different types of behavior. However, how dopamine signals differ across striatal regions and how dopamine regulates different behaviors remain unclear. Here, we compared dopamine axon activity in the ventral, dorsomedial, and dorsolateral striatum, while mice performed a perceptual and value-based decision task. Surprisingly, dopamine axon activity was similar across all three areas. At a glance, the activity multiplexed different variables such as stimulus-associated values, confidence, and reward feedback at different phases of the task. Our modeling demonstrates, however, that these modulations can be inclusively explained by moment-by-moment changes in the expected reward, that is the temporal difference error. A major difference between areas was the overall activity level of reward responses: reward responses in dorsolateral striatum were positively shifted, lacking inhibitory responses to negative prediction errors. The differences in dopamine signals put specific constraints on the properties of behaviors controlled by dopamine in these regions.

Identifying Persuasive Design Principles and Behavior Change Techniques Supporting End User Values and Needs in eHealth Interventions for Long-Term Weight Loss Maintenance: Qualitative Study

BACKGROUND

An increasing number of eHealth interventions aim to support healthy behaviors that facilitate weight loss. However, there is limited evidence of the effectiveness of the interventions and little focus on weight loss maintenance. Knowledge about end user values and needs is essential to create meaningful and effective eHealth interventions, and to identify persuasive system design (PSD) principles and behavior change techniques (BCTs) that may contribute to the behavior change required for successful long-term weight loss maintenance.

OBJECTIVE

This study aimed to provide insight into the design of eHealth interventions supporting behavior change for long-term weight maintenance. The study sought to identify the values and needs of people with obesity aiming to maintain weight after weight loss, and to identify PSD principles, BCTs, and design requirements that potentially enable an eHealth intervention to meet end user values and needs.

METHODS

This study presents the concept of integrating PSD principles and BCTs into the design process of eHealth interventions to meet user values and needs. In this study, individual interviews and focus groups were conducted with people with obesity (n=23) and other key stakeholders (n=27) to explore end user values and needs related to weight loss maintenance. Design thinking methods were applied during the focus group sessions to identify design elements and to explore how eHealth solutions can support the needs to achieve sustainable weight loss maintenance. The PSD model and behavior change taxonomy by Michie were used to identify PSD principles and BCT clusters to meet end user values and needs.

RESULTS

A total of 8 key end user values were identified, reflecting user needs for weight loss maintenance support: self-management, personalized care, autonomy, feel supported, positive self-image, motivation, happiness, and health. Goals and planning, feedback and monitoring, repetition and substitution, shaping knowledge, social support, identity, and self-belief were some of the BCT clusters identified to address these concepts, together with PSD principles such as personalization, tailoring, self-monitoring, praise, and suggestions.

CONCLUSIONS

The process of translating end user values and needs into design elements or features of eHealth technologies is an important part of the design process. To our knowledge, this is the first study to explore how PSD principles and BCTs can be integrated when designing eHealth self-management interventions for long-term weight loss maintenance. End users and other key stakeholders highlighted important factors to be considered in the design of eHealth interventions supporting sustained behavior change. The PSD principles and BCTs identified provide insights and suggestions about design elements and features to include for supporting weight loss maintenance. The findings indicate that a combination of BCTs and PSD principles may be needed in evidence-based eHealth interventions to stimulate motivation and adherence to support healthy behaviors and sustained weight loss maintenance.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04537988; https://clinicaltrials.gov/ct2/show/NCT04537988.

A transdiagnostic perspective of constructs underlying obsessive-compulsive and related disorders: An international Delphi consensus study

BACKGROUND

The Research Domain Criteria seeks to bridge knowledge from neuroscience with clinical practice by promoting research into valid neurocognitive phenotypes and dimensions, irrespective of symptoms and diagnoses as currently conceptualized. While the Research Domain Criteria offers a vision of future research and practice, its 39 functional constructs need refinement to better target new phenotyping efforts. This study aimed to determine which Research Domain Criteria constructs are most relevant to understanding obsessive-compulsive and related disorders, based on a consensus between experts in the field of obsessive-compulsive and related disorders.

METHODS

Based on a modified Delphi method, 46 experts were recruited from Australia, Africa, Asia, Europe and the Americas. Over three rounds, experts had the opportunity to review their opinion in light of feedback from the previous round, which included how their response compared to other experts and a summary of comments given.

RESULTS

Thirty-four experts completed round one, of whom 28 (82%) completed round two and 24 (71%) completed round three. At the final round, four constructs were endorsed by ⩾75% of experts as 'primary constructs' and therefore central to understanding obsessive-compulsive and related disorders. Of these constructs, one came from the Positive Valence System (Habit), two from the Cognitive Control System (Response Selection/Inhibition and Performance Monitoring) and the final construct was an additional item suggested by experts (Compulsivity).

CONCLUSION

This study identified four Research Domain Criteria constructs that, according to experts, cut across different obsessive-compulsive and related disorders. These constructs represent key areas for future investigation, and may have potential implications for clinical practice in terms of diagnostic processes and therapeutic management of obsessive-compulsive and related disorders.

Cognitive biases and excessive use of social media: The facebook implicit associations test (FIAT)

Many theoretical accounts of addictive behaviors, including models of Internet use disorders, implicate cognitive biases in the formation and maintenance of excessive behaviors. Yet, little empirical evidence regarding the role of such biases, including implicit attitude, in the development and maintenance of excessive use of social media exists. We seek to bridge this gap in this study. To this end, we present the development of the Facebook Implicit Association Test (FIAT) and employ it in a sample of 220 Facebook users. The results (1) confirm the validity of the concept of implicit attitude and its measure in the context of social media, (2) demonstrate that implicit attitude is significantly positively associated with excessive use scores, in a magnitude similar to that observed for associations with substance use, and (3) show that implicit attitude is sheltered against social desirability bias, unlike self-reported and explicit measures, such as excessive use. Overall, this study builds theoretical and methodological foundations for further inquiries into the role of implicit attitude in research on the excessive use of social media.

Pilot Outcomes of a Multicomponent Fall Risk Program Integrated Into Daily Lives of Community-Dwelling Older Adults

Objectives: To evaluate whether a fall prevention intervention reduces fall risk in older adults who have previously fallen. Design: Randomized controlled pilot trial. Setting: Participants' homes. Intervention: LIVE-LiFE, adapted from Lifestyle-Intervention Functional Exercise (LiFE) integrates strength and balance training into daily habits in eight visits over 12 weeks. The adaptations to LiFE were to also provide (a) US$500 in home safety changes, (b) vision contrast screening and referral, and (c) medication recommendations. Control condition consisted of fall prevention materials and individualized fall risk summary. Measurement: Timed Up and Go (TUG) and Tandem stand. Falls efficacy, feasibility, and acceptability of the intervention. Results: Sample (N = 37) was 65% female, 65% White, and average 77 years. Compared with the control group, each outcome improved in the intervention. The LIVE-LiFE intervention had a large effect (1.1) for tandem stand, moderate (0.5) in falls efficacy, and small (0.1) in the TUG. Conclusion: Simultaneously addressing preventable fall risk factors is feasible.