Lower Levels of Directed Exploration and Reflective Thinking Are Associated With Greater Anxiety and Depression

Computational Mechanisms Underlying Multi-Step Planning Deficits in Methamphetamine Use Disorder

Current theories suggest individuals with methamphetamine use disorder (iMUDs) have difficulty considering long-term outcomes in decision-making, which could contribute to risk of relapse. Aversive interoceptive states (e.g., stress, withdrawal) are also known to increase this risk. The present study analyzed computational mechanisms of planning in iMUDs, and examined the potential impact of an aversive interoceptive state induction. A group of 40 iMUDs and 49 healthy participants completed two runs of a multi-step planning task, with and without an anxiogenic breathing resistance manipulation. Computational modeling revealed that iMUDs had selective difficulty identifying the best overall plan when this required enduring negative short-term outcomes - a mechanism referred to as aversive pruning. Increases in reported craving before and after the induction also predicted greater aversive pruning in iMUDs. These results highlight a novel mechanism that could promote poor choice in recovering iMUDs and create vulnerability to relapse.

Directed exploration is elevated in affective disorders but reduced by an aversive interoceptive state induction

Elevated anxiety and uncertainty avoidance are known to exacerbate maladaptive choice in individuals with affective disorders. However, the differential roles of state vs. trait anxiety remain unclear, and underlying computational mechanisms have not been thoroughly characterized. In the present study, we investigated how a somatic (interoceptive) state anxiety induction influences learning and decision-making under uncertainty in individuals with clinically significant levels of trait anxiety. A sample of 58 healthy comparisons (HCs) and 61 individuals with affective disorders (iADs; i.e., depression and/or anxiety) completed a previously validated explore-exploit decision task, with and without an added breathing resistance manipulation designed to induce state anxiety. Computational modeling revealed a pattern in which iADs showed greater information-seeking (i.e., directed exploration; Cohen's d=.39, p=.039) in resting conditions, but that this was reduced by the anxiety induction. The affective disorders group also showed slower learning rates across conditions (Cohen's d=.52, p=.003), suggesting more persistent uncertainty. These findings highlight a complex interplay between trait anxiety and state anxiety. Specifically, while elevated trait anxiety is associated with persistent uncertainty, acute somatic anxiety can paradoxically curtail exploratory behaviors, potentially reinforcing maladaptive decision-making patterns in affective disorders.

Individual differences in uncertainty evaluation explain opposing exploratory behaviors in anxiety and apathy

Navigating uncertain environments is a fundamental challenge for adaptive behavior, and affective states such as anxiety and apathy can profoundly influence an individual's response to uncertainty. Uncertainty encompasses both volatility and stochasticity, where volatility refers to how rapidly the environment changes and stochasticity describes outcomes resulting from random chance. This study investigates how anxiety and apathy modulate perceptions of environmental volatility and stochasticity and how these perceptions impact exploratory behavior. In a large online sample (N = 1001), participants completed a restless three-armed bandit task, and their choices were analyzed using latent state models to quantify the computational processes. We found that anxious individuals attributed uncertainty more to environmental volatility than stochasticity, leading to increased exploration, particularly after reward omission. Conversely, apathetic individuals perceived uncertainty as more stochastic than volatile, resulting in decreased exploration. The ratio of perceived volatility to stochasticity mediated the relationship between anxiety and exploratory behavior following adverse outcomes. These findings reveal distinct computational mechanisms underlying anxiety and apathy in uncertain environments. Our results provide a novel framework for understanding the cognitive and affective processes driving adaptive and potentially maladaptive behaviors under uncertainty, with implications for the characterization and treatment of neuropsychiatric disorders.

Individuals with Methamphetamine Use Disorder Show Reduced Directed Exploration and Learning Rates Independent of an Aversive Interoceptive State Induction

Methamphetamine Use Disorder (MUD) is associated with substantially reduced quality of life. Yet, decisions to use persist, due in part to avoidance of anticipated withdrawal states. However, the specific cognitive mechanisms underlying this decision process, and possible modulatory effects of aversive states, remain unclear. Here, 56 individuals with MUD and 58 healthy comparisons (HCs) performed a decision task, both with and without an aversive interoceptive state induction. Computational modeling measured the tendency to test beliefs about uncertain outcomes (directed exploration) and the ability to update beliefs in response to outcomes (learning rates). Compared to HCs, those with MUD exhibited less directed exploration and slower learning rates, but these differences were not affected by aversive state induction. These results suggest novel, state-independent computational mechanisms whereby individuals with MUD may have difficulties in testing beliefs about the tolerability of abstinence and in adjusting behavior in response to consequences of continued use.

The explore/exploit trade-off: An ecologically valid and translational framework that can advance mechanistic understanding of eating disorders

The explore/exploit trade-off is a decision-making process that is conserved across species and balances exploring unfamiliar choices of unknown value with choosing familiar options of known value to maximize reward. This framework is rooted in behavioral ecology and has traditionally been used to study maladaptive versus adaptive non-human animal foraging behavior. Researchers have begun to recognize the potential utility of understanding human decision-making and psychopathology through the explore/exploit trade-off. In this article, we propose that explore/exploit trade-off holds promise for advancing our mechanistic understanding of decision-making processes that confer vulnerability for and maintain eating pathology due to its neurodevelopmental bases, conservation across species, and ability to be mathematically modeled. We present a model for how suboptimal explore/exploit decision-making can promote disordered eating and present recommendations for future research applying this framework to eating pathology. Taken together, the explore/exploit trade-off provides a translational framework for expanding etiologic and maintenance models of eating pathology, given developmental changes in explore/exploit decision-making that coincide in time with the emergence of eating pathology and evidence of biased explore/exploit decision-making in psychopathology. Additionally, understanding explore/exploit decision-making in eating disorders may improve knowledge of their underlying pathophysiology, informing targeted clinical interventions such as neuromodulation and pharmacotherapy. PUBLIC SIGNIFICANCE STATEMENT: The explore/exploit trade-off is a cross-species decision-making process whereby organisms choose between a known option with a known reward or sampling unfamiliar options. We hypothesize that imbalanced explore/exploit decision-making can promote disordered eating and present preliminary data. We propose that explore/exploit trade-off has significant potential to advance understanding of the neurocognitive and neurodevelopmental mechanisms of eating pathology, which could ultimately guide revisions of etiologic models and inform novel interventions.

Reviewing explore/exploit decision-making as a transdiagnostic target for psychosis, depression, and anxiety

In many everyday decisions, individuals choose between trialling something novel or something they know well. Deciding when to try a new option or stick with an option that is already known to you, known as the "explore/exploit" dilemma, is an important feature of cognition that characterises a range of decision-making contexts encountered by humans. Recent evidence has suggested preferences in explore/exploit biases are associated with psychopathology, although this has typically been examined within individual disorders. The current review examined whether explore/exploit decision-making represents a promising transdiagnostic target for psychosis, depression, and anxiety. A systematic search of academic databases was conducted, yielding a total of 29 studies. Studies examining psychosis were mostly consistent in showing that individuals with psychosis explored more compared with individuals without psychosis. The literature on anxiety and depression was more heterogenous; some studies found that anxiety and depression were associated with more exploration, whereas other studies demonstrated reduced exploration in anxiety and depression. However, examining a subset of studies that employed case-control methods, there was some evidence that both anxiety and depression also were associated with increased exploration. Due to the heterogeneity across the literature, we suggest that there is insufficient evidence to conclude whether explore/exploit decision-making is a transdiagnostic target for psychosis, depression, and anxiety. However, alongside our advisory groups of lived experience advisors, we suggest that this context of decision-making is a promising candidate that merits further investigation using well-powered, longitudinal designs. Such work also should examine whether biases in explore/exploit choices are amenable to intervention.

Meta-Analysis Reveals That Explore-Exploit Decisions are Dissociable by Activation in the Dorsal Lateral Prefrontal Cortex and the Anterior Cingulate Cortex

Explore-exploit research has challenges in generalizability due to a limited theoretical basis of exploration and exploitation. Neuroimaging can help identify whether explore-exploit decisions use an opponent processing system to address this issue. Thus, we conducted a coordinate-based meta-analysis (N=23 studies) where we found activation in the dorsal lateral prefrontal cortex and anterior cingulate cortex during exploration versus exploitation, providing some evidence for opponent processing. However, the conjunction of explore-exploit decisions was associated with activation in the dorsal anterior cingulate cortex, dorsal medial prefrontal cortex, and anterior insula, suggesting that these brain regions do not engage in opponent processing. Further, exploratory analyses revealed heterogeneity in brain responses between task types during exploration and exploitation respectively. Coupled with results suggesting that activation in exploration and exploitation decisions is generally more similar than it is different suggests there remain significant challenges toward characterizing explore-exploit decision making. Nonetheless, dlPFC and ACC activation differentiate explore and exploit decisions and identifying these responses can help in targeted interventions aimed at manipulating these decisions.

Motivation as a Lens for Understanding Information-seeking Behaviors

Most prior research characterizes information-seeking behaviors as serving utilitarian purposes, such as whether the obtained information can help solve practical problems. However, information-seeking behaviors are sensitive to different contexts (i.e., threat vs. curiosity), despite having equivalent utility. Furthermore, these search behaviors can be modulated by individuals' life history and personality traits. Yet the emphasis on utilitarian utility has precluded the development of a unified model, which explains when and how individuals actively seek information. To account for this variability and flexibility, we propose a unified information-seeking framework that examines information-seeking through the lens of motivation. This unified model accounts for integration across individuals' internal goal states and the salient features of the environment to influence information-seeking behavior. We propose that information-seeking is determined by motivation for information, invigorated either by instrumental utility or hedonic utility, wherein one's personal or environmental context moderates this relationship. Furthermore, we speculate that the final common denominator in guiding information-seeking is the engagement of different neuromodulatory circuits centered on dopaminergic and noradrenergic tone. Our framework provides a unified framework for information-seeking behaviors and generates several testable predictions for future studies.

Mental Gravity: Depression as Spacetime Curvature of the Self, Mind, and Brain

The principle of mental gravity contends that the mind uses physical gravity as a mental model or simulacrum to express the relation between the inner self and the outer world in terms of "UP"-ness and "DOWN"-ness. The simulation of increased gravity characterises a continuum of mental gravity which states includes depression as the paradigmatic example of being down, low, heavy, and slow. The physics of gravity can also be used to model spacetime curvature in depression, particularly gravitational time dilation as a property of MG analogous to subjective time dilation (i.e., the slowing of temporal flow in conscious experience). The principle has profound implications for the Temporo-spatial Theory of Consciousness (TTC) with regard to temporo-spatial alignment that establishes a "world-brain relation" that is centred on embodiment and the socialisation of conscious states. The principle of mental gravity provides the TTC with a way to incorporate the structure of the world into the structure of the brain, conscious experience, and thought. In concert with other theories of cognitive and neurobiological spacetime, the TTC can also work towards the "common currency" approach that also potentially connects the TTC to predictive processing frameworks such as free energy, neuronal gauge theories, and active inference accounts of depression. It gives the up/down dimension of space, as defined by the gravitational field, a unique status that is connected to both our embodied interaction with the physical world, and also the inverse, reflective, emotional but still embodied experience of ourselves.

Thyroid hormone rewires cortical circuits to coordinate body-wide metabolism and exploratory drive

Animals adapt to varying environmental conditions by modifying the function of their internal organs, including the brain. To be adaptive, alterations in behavior must be coordinated with the functional state of organs throughout the body. Here we find that thyroid hormone- a prominent regulator of metabolism in many peripheral organs- activates cell-type specific transcriptional programs in anterior regions of cortex of adult mice via direct activation of thyroid hormone receptors. These programs are enriched for axon-guidance genes in glutamatergic projection neurons, synaptic regulators across both astrocytes and neurons, and pro-myelination factors in oligodendrocytes, suggesting widespread remodeling of cortical circuits. Indeed, whole-cell electrophysiology recordings revealed that thyroid hormone induces local transcriptional programs that rewire cortical neural circuits via pre-synaptic mechanisms, resulting in increased excitatory drive with a concomitant sensitization of recruited inhibition. We find that thyroid hormone bidirectionally regulates innate exploratory behaviors and that the transcriptionally mediated circuit changes in anterior cortex causally promote exploratory decision-making. Thus, thyroid hormone acts directly on adult cerebral cortex to coordinate exploratory behaviors with whole-body metabolic state.

Barriers and solutions to the adoption of translational tools for computational psychiatry

Computational psychiatry is a field aimed at developing formal models of information processing in the human brain, and how alterations in this processing can lead to clinical phenomena. There has been significant progress in the development of tasks and how to model them, presenting an opportunity to incorporate computational psychiatry methodologies into large- scale research projects or into clinical practice. In this viewpoint, we explore some of the barriers to incorporation of computational psychiatry tasks and models into wider mainstream research directions. These barriers include the time required for participants to complete tasks, test-retest reliability, limited ecological validity, as well as practical concerns, such as lack of computational expertise and the expense and large sample sizes traditionally required to validate tasks and models. We then discuss solutions, such as the redesigning of tasks with a view toward feasibility, and the integration of tasks into more ecologically valid and standardized game platforms that can be more easily disseminated. Finally, we provide an example of how one task, the conditioned hallucinations task, might be translated into such a game. It is our hope that interest in the creation of more accessible and feasible computational tasks will help computational methods make more positive impacts on research as well as, eventually, clinical practice.

The effects of time horizon and guided choices on explore-exploit decisions in rodents

Humans and animals have to balance the need for exploring new options with exploiting known options that yield good outcomes. This tradeoff is known as the explore-exploit dilemma. To better understand the neural mechanisms underlying how humans and animals address the explore-exploit dilemma, a good animal behavioral model is critical. Most previous rodents explore-exploit studies used ethologically unrealistic operant boxes and reversal learning paradigms in which the decision to abandon a bad option is confounded by the need for exploring a novel option for information collection, making it difficult to separate different drives and heuristics for exploration. In this study, we investigated how rodents make explore-exploit decisions using a spatial navigation horizon task (Wilson et al., 2014) adapted to rats to address the above limitations. We compared the rats' performance to that of humans using identical measures. We showed that rats use prior information to effectively guide exploration. In addition, rats use information-driven directed exploration like humans, but the extent to which they explore has the opposite dependance on time horizon than humans. Moreover, we found that free choices and guided choices have different influences on exploration in rodents, a finding that has not yet been tested in humans. This study reveals that the explore-exploit spatial behavior of rats is more complex than previously thought. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Trait somatic anxiety is associated with reduced directed exploration and underestimation of uncertainty

Anxiety has been related to decreased physical exploration, but past findings on the interaction between anxiety and exploration during decision making were inconclusive. Here we examined how latent factors of trait anxiety relate to different exploration strategies when facing volatility-induced uncertainty. Across two studies (total N = 985), we demonstrated that people used a hybrid of directed, random and undirected exploration strategies, which were respectively sensitive to relative uncertainty, total uncertainty and value difference. Trait somatic anxiety, that is, the propensity to experience physical symptoms of anxiety, was inversely correlated with directed exploration and undirected exploration, manifesting as a lesser likelihood for choosing the uncertain option and reducing choice stochasticity regardless of uncertainty. Somatic anxiety is also associated with underestimation of relative uncertainty. Together, these results reveal the selective role of trait somatic anxiety in modulating both uncertainty-driven and value-driven exploration strategies.

Atranorin, a Secondary Metabolite of Lichens, Exhibited Anxiolytic/Antidepressant Activity in Wistar Rats

Atranorin (ATR) is one of lichens' many known secondary metabolites. Most current studies have investigated the various effects of ATR in vitro and only sporadically in vivo. The latest data indicate that ATR may have anxiolytic/antidepressive effects. This study aimed to analyze the potential of ATR in a depression-like state in male Wistar rats. Pregnant females were stressed by restricting their mobility in the final week of pregnancy three times a day for 45 min each, for three following days. After birth, progeny aged 60 days was stressed repeatedly. The male progeny was divided into three groups as follows: CTR group as a healthy control (n = 10), DEP group as a progeny of restricted mothers (n = 10), and ATR group as a progeny of restricted mothers, treated daily for one month with ATR (n = 10; 10 mg/kg of body weight, p.o.). Our results show that ATR acts as an antioxidant and markedly changes animal behavior. Concomitantly, hippocampal neurogenesis increases in the hilus and subgranular zone, together with the number of NeuN mature neurons in the hilus and CA1 regions. Our results indicate a potential antidepressant/anxiolytic effect of ATR. However, further studies in this area are needed.

Biochemical Properties of Atranorin-Induced Behavioral and Systematic Changes of Laboratory Rats

Atranorin (ATR) is a secondary metabolite of lichens. While previous studies investigated the effects of this substance predominantly in an in vitro environment, in our study we investigated the basic physicochemical properties, the binding affinity to human serum albumin (HSA), basic pharmacokinetics, and, mainly, on the systematic effects of ATR in vivo. Sporadic studies describe its effects during, predominantly, cancer. This project is original in terms of testing the efficacy of ATR on a healthy organism, where we can possibly attribute negative effects directly to ATR and not to the disease. For the experiment, 24 Sprague Dawley rats (Velaz, Únetice, Czech Republic) were used. The animals were divided into four groups. The first group (n = 6) included healthy males as control intact rats (♂INT) and the second group (n = 6) included healthy females as control intact rats (♀INT). Groups three and four (♂ATR/n = 6 and ♀ATR/n = 6) consisted of animals with daily administered ATR (10mg/kg body weight) in an ethanol-water solution per os for a one-month period. Our results demonstrate that ATR binds to HSA near the binding site TRP214 and acts on a systemic level. ATR caused mild anemia during the treatment. However, based on the levels of hepatic enzymes in the blood (ALT, ALP, or bilirubin levels), thiobarbituric acid reactive substances (TBARS), or liver histology, no impact on liver was recorded. Significantly increased creatinine and lactate dehydrogenase levels together with increased defecation activity during behavioral testing may indicate the anabolic effect of ATR in skeletal muscles. Interestingly, ATR changed some forms of behavior. ATR at a dose of 10 mg/kg body weight is non-toxic and, therefore, could be used in further research.