Neuromodulation of reward-based learning and decision making in human aging

Association between willingness to exercise and incident disability in older adults: a prospective longitudinal cohort study

PURPOSE

To investigate whether the willingness to exercise (WTE) and exercise habits affect the incidence of disability among older adults.

METHODS

This study included 8,354 individuals (72.5 ± 6.2 years, 55.9% female). The participants were divided into three categories based on their WTE: unwillingness to exercise, willingness to exercise (but without exercise habits), and exercise habits. The incidence of disability was prospectively determined within 24 months of the follow-up. Cox regression analysis was used to examine the relationship between WTE and the incidence of disability.

RESULTS

Overall, 600 (7.2%), 4,703 (56.3%), and 3,051 (36.5%) participants were classified as unwillingness to exercise, willingness to exercise, and exercise habits, respectively. Compared with the unwillingness to exercise group, the willingness to exercise group (hazard ratio [HR] 0.71, 95%Confidence Interval [CI] 0.52-0.96) and the exercise habits group (HR 0.65, 95%CI 0.46-0.92) had a lower risk of disability incidence.

CONCLUSIONS

These results suggest that WTE reduces the risk of disability in older adults. Therefore, the importance of increasing WTE to prevent the occurrence of disabilities is clear. Our results suggest that even though physical activity declines with age, it is important to have the desire to exercise and develop exercise habits.

Older adults are relatively more susceptible to impulsive social influence than young adults

People differ in their levels of impulsivity and patience, and these preferences are heavily influenced by others. Previous research suggests that susceptibility to social influence may vary with age, but the mechanisms and whether people are more influenced by patience or impulsivity remain unknown. Here, using a delegated inter-temporal choice task and Bayesian computational models, we tested susceptibility to social influence in young (aged 18-36, N = 76) and older (aged 60-80, N = 78) adults. Participants completed a temporal discounting task and then learnt the preferences of two other people (one more impulsive and one more patient) before making their choices again. We used the signed Kullback-Leibler divergence to quantify the magnitude and direction of social influence. We found that, compared to young adults, older adults were relatively more susceptible to impulsive social influence. Factor analyses showed that older adults with higher self-reported levels of affective empathy and emotional motivation were particularly susceptible to impulsive influence. Importantly, older and young adults showed similar learning accuracy about others' preferences, and their baseline impulsivity did not differ. Together, these findings suggest highly affectively empathetic and emotionally motivated older adults may be at higher risk for impulsive decisions, due to their susceptibility to social influence.

Aged mice exhibit faster acquisition of intravenous opioid self-administration with variable effects on intake

Although opioid abuse is more prevalent in young individuals, opioid use, overdose, and use disorders continue to climb at a rapid rate among the elderly. Little is known about abuse potential in a healthy aged population, in part due to technical and logistical difficulties testing intravenous self-administration in aged rodents. The goal of this study was to address the critical gap in the literature regarding age-dependent differences in opioid (remifentanil and fentanyl) self-administration between old and young mice. Male and female mice were grouped into young (mean: 19 weeks) and old (mean: 101 weeks), and were trained to self-administer intravenous fentanyl or remifentanil in daily sessions. In both old and young mice, acquisition, intake, and cue-responding after forced abstinence were measured for both drugs, and a dose-response curve (remifentanil) and dose-escalation (fentanyl) were conducted. Surprisingly, old mice learned to self-administer both remifentanil and fentanyl faster and more accurately than young mice. Baseline intake of remifentanil was also substantially greater in old mice compared to their young counterparts; however, we did not see increased intake of fentanyl with age at either dose tested. Further, compared to young mice, the old mice showed a greater incubation of responding for cues previously associated with remifentanil after a forced abstinence, but again this was not observed with fentanyl. Together these data suggest that an aged population may have an increased drug-abuse vulnerability for opioids compared to young counterparts and underscore the importance of future work on mechanisms responsible for this increased vulnerability.

Influence of surprise on reinforcement learning in younger and older adults

Surprise is a key component of many learning experiences, and yet its precise computational role, and how it changes with age, remain debated. One major challenge is that surprise often occurs jointly with other variables, such as uncertainty and outcome probability. To assess how humans learn from surprising events, and whether aging affects this process, we studied choices while participants learned from bandits with either Gaussian or bi-modal outcome distributions, which decoupled outcome probability, uncertainty, and surprise. A total of 102 participants (51 older, aged 50-73; 51 younger, 19-30 years) chose between three bandits, one of which had a bimodal outcome distribution. Behavioral analyses showed that both age-groups learned the average of the bimodal bandit less well. A trial-by-trial analysis indicated that participants performed choice reversals immediately following large absolute prediction errors, consistent with heightened sensitivity to surprise. This effect was stronger in older adults. Computational models indicated that learning rates in younger as well as older adults were influenced by surprise, rather than uncertainty, but also suggested large interindividual variability in the process underlying learning in our task. Our work bridges between behavioral economics research that has focused on how outcomes with low probability affect choice in older adults, and reinforcement learning work that has investigated age differences in the effects of uncertainty and suggests that older adults overly adapt to surprising events, even when accounting for probability and uncertainty effects.

Age-Related Differences in Framing Selective Memory in Terms of Gains and Losses

We examined whether framing younger and older adults learning goals in terms of maximizing gains or minimizing losses impacts their ability to selectively remember high-value information. Specifically, we presented younger and older adults with lists of words paired with point values and participants were either told that they would receive the value associated with each word if they recalled it on a test or that they would lose the points associated with each word if they failed to recall it on the test. We also asked participants to predict the likelihood of recalling each word to determine if younger and older adults were metacognitively aware of any potential framing effects. Results revealed that older adults expected to be more selective when their goals were framed in terms of losses, but younger adults expected to be more selective when their goals were framed in terms of gains. However, this was not the case as both younger and older adults were more selective for high-value information when their goals were framed in terms of maximizing gains compared with minimizing losses. Thus, the framing of learning goals can impact metacognitive decisions and subsequent memory in both younger and older adults.

Less spatial exploration is associated with poorer spatial memory in midlife adults

Introduction

Despite its importance for navigation, very little is known about how the normal aging process affects spatial exploration behavior. We aimed to investigate: (1) how spatial exploration behavior may be altered early in the aging process, (2) the relationship between exploration behavior and subsequent spatial memory, and (3) whether exploration behavior can classify participants according to age.

Methods

Fifty healthy young (aged 18-28) and 87 healthy midlife adults (aged 43-61) freely explored a desktop virtual maze, learning the locations of nine target objects. Various exploration behaviors (object visits, distance traveled, turns made, etc.) were measured. In the test phase, participants navigated from one target object to another without feedback, and their wayfinding success (% correct trials) was measured.

Results

In the exploration phase, midlife adults exhibited less exploration overall compared to young adults, and prioritized learning target object locations over maze layout. In the test phase, midlife adults exhibited less wayfinding success when compared to the young adults. Furthermore, following principal components analysis (PCA), regression analyses indicated that both exploration quantity and quality components were associated with wayfinding success in the midlife group, but not the young adults. Finally, we could classify participants according to age with similar accuracy using either their exploration behavior or wayfinding success scores.

Discussion

Our results aid in the understanding of how aging impacts spatial exploration, and encourages future investigations into how pathological aging may affect spatial exploration behavior.

Slowing of Movements in Healthy Aging as a Rational Economic Response to an Elevated Effort Landscape

Why do we move slower as we grow older? The reward circuits of the brain, which tend to invigorate movements, decline with aging, raising the possibility that reduced vigor is due to the diminishing value that our brain assigns to movements. However, as we grow older, it also becomes more effortful to make movements. Is age-related slowing principally a consequence of increased effort costs from the muscles, or reduced valuation of reward by the brain? Here, we first quantified the cost of reaching via metabolic energy expenditure in human participants (male and female), and found that older adults consumed more energy than the young at a given speed. Thus, movements are objectively more costly for older adults. Next, we observed that when reward increased, older adults, like the young, responded by initiating their movements earlier. Yet, unlike the young, they were unwilling to increase their movement speed. Was their reluctance to reach quicker for rewards due to the increased effort costs, or because they ascribed less value to the movement? Motivated by a mathematical model, we next made the young experience a component of aging by making their movements more effortful. Now the young responded to reward by reacting faster but chose not to increase their movement speed. This suggests that slower movements in older adults are partly driven by an adaptive response to an elevated effort landscape. Moving slower may be a rational economic response the brain is making to mitigate the elevated effort costs that accompany aging.

Cognitive performance in aged rats is associated with differences in distinctive neuronal populations in the ventral tegmental area and altered synaptic plasticity in the hippocampus

Introduction

Deterioration of cognitive functions is commonly associated with aging, although there is wide variation in the onset and manifestation. Albeit heterogeneity in age-related cognitive decline has been studied at the cellular and molecular level, there is poor evidence for electrophysiological correlates. The aim of the current study was to address the electrophysiological basis of heterogeneity of cognitive functions in cognitively Inferior and Superior old (19-20 months) rats in the ventral tegmental area (VTA) and the hippocampus, having Young (12 weeks) rats as a control. The midbrain VTA operates as a hub amidst affective and cognitive facets, processing sensory inputs related to motivated behaviours and hippocampal memory. Increasing evidence shows direct dopaminergic and non-dopaminergic input from the VTA to the hippocampus.

Methods

Aged Superior and Inferior male rats were selected from a cohort of 88 animals based on their performance in a spatial learning and memory task. Using in vivo single-cell recording in the VTA, we examined the electrical activity of different neuronal populations (putative dopaminergic, glutamatergic and GABAergic neurons). In the same animals, basal synaptic transmission and synaptic plasticity were examined in hippocampal slices.

Results

Electrophysiological recordings from the VTA and hippocampus showed alterations associated with aging per se, together with differences specifically linked to the cognitive status of aged animals. In particular, the bursting activity of dopamine neurons was lower, while the firing frequency of glutamatergic neurons was higher in VTA of Inferior old rats. The response to high-frequency stimulation in hippocampal slices also discriminated between Superior and Inferior aged animals.

Discussion

This study provides new insight into electrophysiological information underlying compromised cerebral ageing. Further understanding of brain senescence, possibly related to neurocognitive decline, will help develop new strategies towards the preservation of a high quality of life.

Adult age differences in value-based decision making

A better understanding of age-related differences in judgment and decision making is important from both theoretical and applied perspectives. In this review, we focus on value-based decisions across adulthood and specifically on how loss aversion (a relatively stronger weight of losses than gains on decisions) and the relative motivational impact of gains and losses may change with aging. In doing so, we will also cover recent findings about the effects of gain or loss incentives on performance in cognitive tasks that involve attention, learning, and remembering. We point out open questions and critical moderating variables for future theorizing and research.

Differential impacts of healthy cognitive aging on directed and random exploration

Deciding whether to explore unknown opportunities or exploit well-known options is a ubiquitous part of our everyday lives. Extensive work in college students suggests that young people make explore-exploit decisions using a mixture of information seeking and random behavioral variability. Whether, and to what extent, older adults use the same strategies is unknown. To address this question, 51 older adults (ages 65-74) and 32 younger adults (ages 18-25) completed the Horizon Task, a gambling task that quantifies information seeking and behavioral variability as well as how these strategies are controlled for the purposes of exploration. Qualitatively, we found that older adults performed similar to younger adults on this task, increasing both their information seeking and behavioral variability when it was adaptive to explore. Quantitively, however, there were substantial differences between the age groups, with older adults showing less information seeking overall and less reliance on variability as a means to explore. In addition, we found a subset of approximately 26% of older adults whose information seeking was close to zero, avoiding informative options even when they were clearly the better choice. Unsurprisingly, these "information avoiders" performed worse on the task. In contrast, task performance in the remaining "information seeking" older adults was comparable to that of younger adults suggesting that age-related differences in explore-exploit decision making may be adaptive except when they are taken to extremes. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Iron content affects age group differences in associative learning-related fMRI activity

Brain regions accumulate different amounts of iron with age, with older adults having higher iron in the basal ganglia (globus pallidus, putamen, caudate) relative to the hippocampus. This has important implications for functional magnetic resonance imaging (fMRI) studies in aging as the presence of iron may influence both neuronal functioning as well as the measured fMRI (BOLD) signal, and these effects will vary across age groups and brain regions. To test this hypothesis, the current study examined the effect of iron on age group differences in task-related activity within each basal nuclei and the hippocampus. Twenty-eight younger and 22 older adults completed an associative learning task during fMRI acquisition. Iron content (QSM, R2*) was estimated from a multi-echo gradient echo sequence. As previously reported, older adults learned significantly less than younger adults and age group differences in iron content were largest in the basal ganglia (putamen, caudate). In the hippocampus (early task stage) and globus pallidus (late task stage), older adults had significantly higher learning-related activity than younger adults both before and after controlling for iron. In the putamen (late task stage), however, younger adults had significantly higher learning-related activity than older adults that was only seen after controlling for iron. These findings support the notion that age-related differences in iron influence both neuronal functioning and the measured fMRI signal in select basal nuclei. Moreover, previous fMRI studies in aging populations may have under-reported age group differences in task-related activity by not accounting for iron within these regions.

Diminished State Space Theory of Human Aging

Many new technologies, such as smartphones, computers, or public-access systems (like ticket-vending machines), are a challenge for older adults. One feature that these technologies have in common is that they involve underlying, partially observable, structures (state spaces) that determine the actions that are necessary to reach a certain goal (e.g., to move from one menu to another, to change a function, or to activate a new service). In this work we provide a theoretical, neurocomputational account to explain these behavioral difficulties in older adults. Based on recent findings from age-comparative computational- and cognitive-neuroscience studies, we propose that age-related impairments in complex goal-directed behavior result from an underlying deficit in the representation of state spaces of cognitive tasks. Furthermore, we suggest that these age-related deficits in adaptive decision-making are due to impoverished neural representations in the orbitofrontal cortex and hippocampus.

Parietal stimulation reverses age-related decline in exploration, learning, and decision-making

Aging can compromise decision-making and learning, potentially due to reduced exploratory behaviors crucial for novel problem-solving. We posit that invigorating exploration could mitigate these declines. Supporting this hypothesis, we found that older mice mirrored human aging, displaying less exploration and learning during decision-making, but optogenetic stimulation of their posterior parietal cortex boosted initial exploration, subsequently improving learning. Thus, enhancing exploration-driven learning could be a key to countering cognitive aging.

Positive valence system function and anhedonia in middle-aged and older adults at high suicide risk

Positive valence systems are disrupted in late-life depression and in individuals at risk for suicide. The reward positivity (RewP) is an event-related potential measure of positive valence system function that relates to depression and anhedonia in children and young adults. However, it is unclear whether a reliable RewP signal can be elicited in middle-aged and older adults at high risk for suicide and, if so, whether this signal is similarly associated with clinical symptoms. In the current study, a RewP was elicited with a standard gambling task in middle-aged and older adults (N = 31) at discharge from a hospitalization for suicidal thought or behaviors. The resulting electrocortical response differed significantly for monetary wins compared to losses. Internal reliability of the RewP and the feedback negativity (FN) to monetary loss was good to excellent. Internal reliability of difference measures was lower but still largely acceptable, with residualized differences scores demonstrating stronger reliability than subtraction-based scores. A smaller residualized RewP, after accounting for the influence of the FN, was associated with greater severity of lassitude, an index of appetitive anhedonia. These findings set the groundwork for future studies of positive valence system function and depression in middle-aged and older adults at high risk for suicide.

Effort cost of reaching prompts vigor reduction in older adults

As people age, they move slower. Is age-related reduction in vigor a reflection of a reduced valuation of reward by the brain, or a consequence of increased effort costs by the muscles? Here, we quantified cost of movements objectively via the metabolic energy that young and old participants consumed during reaching and found that in order reach at a given speed, older adults expended more energy than the young. We next quantified how reward modulated movements in the same populations and found that like the young, older adults responded to increased reward by initiating their movements earlier. Yet, their movements were less sensitive to increased reward, resulting in little or no modulation of reach speed. Lastly, we quantified the effect of increased effort on how reward modulated movements in young adults. Like the effects of aging, when faced with increased effort the young adults responded to reward primarily by reacting faster, with little change in movement speed. Therefore, reaching required greater energetic expenditure in the elderly, suggesting that the slower movements and reactions exhibited in aging are partly driven by an adaptive response to an elevation in the energetic landscape of effort. That is, moving slower appears to be a rational economic consequence of aging.

Significance statement

Healthy aging coincides with a reduction in speed, or vigor, of walking, reaching, and eye movements. Here we focused on disentangling two opposing sources of aging-related movement slowing: reduced reward sensitivity due to loss of dopaminergic tone, or increased energy expenditure movements related to mitochondrial or muscular inefficiencies. Through a series of three experiments and construction of a computational model, here we demonstrate that transient changes in reaction time and movement speed together offer a quantifiable metric to differentiate between reward- and effort-based alterations in movement vigor. Further, we suggest that objective increases in the metabolic cost of moving, not reductions in reward valuation, are driving much of the movement slowing occurring alongside healthy aging.

Aging, uncertainty, and decision making-A review

There is a great deal of uncertainty in the world. One common source of uncertainty results from incomplete or missing information about probabilistic outcomes (i.e., outcomes that may occur), which influences how people make decisions. The impact of this type of uncertainty may particularly pronounced for older adults, who, as the primary leaders around the world, make highly impactful decisions with lasting outcomes. This review examines the ways in which uncertainty about probabilistic outcomes is perceived, handled, and represented in the aging brain, with an emphasis on how uncertainty may specifically affect decision making in later life. We describe the role of uncertainty in decision making and aging from four perspectives, including 1) theoretical, 2) self-report, 3) behavioral, and 4) neuroscientific. We report evidence of any age-related differences in uncertainty among these contexts and describe how these changes may affect decision making. We then integrate the findings across the distinct perspectives, followed by a discussion of important future directions for research on aging and uncertainty, including prospection, domain-specificity in risk-taking behaviors, and choice overload.

Multivariate associations between dopamine receptor availability and risky investment decision-making across adulthood

Enhancing dopamine increases financial risk taking across adulthood but it is unclear whether baseline individual differences in dopamine function are related to risky financial decisions. Here, thirty-five healthy adults completed an incentive-compatible risky investment decision task and a PET scan at rest using [11C]FLB457 to assess dopamine D2-like receptor availability. Participants made choices between a safe asset (bond) and a risky asset (stock) with either an expected value less than the bond ("bad stock") or expected value greater than the bond ("good stock"). Five measures of behavior (choice inflexibility, risk seeking, suboptimal investment) and beliefs (absolute error, optimism) were computed and D2-like binding potential was extracted from four brain regions of interest (midbrain, amygdala, anterior cingulate, insula). We used canonical correlation analysis to evaluate multivariate associations between decision-making and dopamine function controlling for age. Decomposition of the first dimension (r = 0.76) revealed that the strongest associations were between measures of choice inflexibility, incorrect choice, optimism, amygdala binding potential, and age. Follow-up univariate analyses revealed that amygdala binding potential and age were both independently associated with choice inflexibility. The findings suggest that individual differences in dopamine function may be associated with financial risk taking in healthy adults.

Influence of game features on attention in adults

Introduction

The incorporation of game features into cognitive tasks can inform us about the influence of reward and motivation on attention. Continuous performance tasks (CPTs), designed to assess attention abilities, are examples of cognitive tasks that have been targeted for the addition of game features. However, previous results have been mixed regarding how game elements affect attention abilities and task performance.

Methods

Here, we studied if there were factors that predict which individuals exhibit changes in attention from game features added to a CPT. Participants (N = 94, aged 21-71) played a traditional CPT and a game CPT with identical mechanics, but featured engaging game elements (aesthetics, storyline, competition, feedback, and reward).

Results

We first found corroborating evidence that game features have mixed effects on attention performance: most attention metrics of interest exhibited no overall difference between the traditional and game CPT, while game elements reduced performance for a few metrics. Importantly, we also found that specific behavioral and demographic profiles predicted individual differences in performance on the game CPT compared to the traditional CPT. Those with more attention difficulties (ADHD symptoms), more reward responsiveness, and younger adults performed better on the game CPT while, conversely, those with fewer ADHD symptoms, less reward responsiveness, and older adults performed better on the traditional CPT.

Discussion

These findings provide insights into how game features can influence attention in different individuals and have important implications for the use of game elements in cognitive tasks and training interventions.

Restoring the youthful state of striatal plasticity in aged mice re-enables cognitive control of action

Multidisciplinary evidence suggests that the control of voluntary action arbitrates between two major forms of behavioral processing: cognitively guided (or goal directed) and autonomously guided (or habitual). Brain-state irregularities affecting the striatum-such as aging-commonly shift control toward the latter, although the responsible neural mechanisms remain unknown. Combining instrumental conditioning with cell-specific mapping and chemogenetics in striatal neurons, we explored strategies that invigorate goal-directed capacity in aged mice. We found that, under conditions favoring goal-directed control, aged animals resiliently expressed autonomously guided behavior, a response that was underpinned by a characteristic one-to-one functional engagement of the two main neuronal populations in the striatum-D1- and D2-dopamine receptor-expressing spiny projection neurons (SPNs). Chemogenetically induced desensitization of D2-SPN signaling in aged transgenic mice recapitulated the striatal plasticity state observed in young mice, an effect that shifted behavior toward vigorous, goal-directed action. Our findings contribute to the understanding of the neural bases of behavioral control and propose neural system interventions that enhance cognitive functioning in habit-prone brains.

Modulation of Motor Vigor by Expectation of Reward Probability Trial-by-Trial Is Preserved in Healthy Ageing and Parkinson's Disease Patients

Motor improvements, such as faster movement times or increased velocity, have been associated with reward magnitude in deterministic contexts. Yet whether individual inferences on reward probability influence motor vigor dynamically remains undetermined. We investigated how dynamically inferring volatile action-reward contingencies modulated motor performance trial-by-trial. We conducted three studies that coupled a reversal learning paradigm with a motor sequence task and used a validated hierarchical Bayesian model to fit trial-by-trial data. In Study 1, we tested healthy younger [HYA; 37 (24 females)] and older adults [HOA; 37 (17 females)], and medicated Parkinson's disease (PD) patients [20 (7 females)]. We showed that stronger predictions about the tendency of the action-reward contingency led to faster performance tempo, commensurate with movement time, on a trial-by-trial basis without robustly modulating reaction time (RT). Using Bayesian linear mixed models, we demonstrated a similar invigoration effect on performance tempo in HYA, HOA, and PD, despite HOA and PD being slower than HYA. In Study 2 [HYA, 39 (29 females)], we additionally showed that retrospective subjective inference about credit assignment did not contribute to differences in motor vigor effects. Last, Study 3 [HYA, 33 (27 females)] revealed that explicit beliefs about the reward tendency (confidence ratings) modulated performance tempo trial-by-trial. Our study is the first to reveal that the dynamic updating of beliefs about volatile action-reward contingencies positively biases motor performance through faster tempo. We also provide robust evidence for a preserved sensitivity of motor vigor to inferences about the action-reward mapping in aging and medicated PD.SIGNIFICANCE STATEMENT Navigating a world rich in uncertainty relies on updating beliefs about the probability that our actions lead to reward. Here, we investigated how inferring the action-reward contingencies in a volatile environment modulated motor vigor trial-by-trial in healthy younger and older adults, and in Parkinson's disease (PD) patients on medication. We found an association between trial-by-trial predictions about the tendency of the action-reward contingency and performance tempo, with stronger expectations speeding the movement. We additionally provided evidence for a similar sensitivity of performance tempo to the strength of these predictions in all groups. Thus, dynamic beliefs about the changing relationship between actions and their outcome enhanced motor vigor. This positive bias was not compromised by age or Parkinson's disease.

Human ageing is associated with more rigid concept spaces

Prevalence-induced concept change describes a cognitive mechanism by which someone's definition of a concept shifts as the prevalence of instances of that concept changes. While this phenomenon has been established in young adults, it is unclear how it affects older adults. In this study, we explore how prevalence-induced concept change affects older adults' lower-level, perceptual, and higher-order, ethical judgements. We find that older adults are less sensitive to prevalence-induced concept change than younger adults across both domains. Using computational modeling, we demonstrate that these age-related changes in judgements reflect more cautious and deliberate responding in older adults. Based on these findings, we argue that while overly cautious responding by older adults may be maladaptive in some cognitive domains, in the case of prevalence-induced concept change, it might be protective against biased judgements.

Brain Neural Underpinnings of Interoception and Decision-Making in Alzheimer's Disease: A Narrative Review

This study reviews recent literature on interoception directing decision-making in Alzheimer's disease (AD). According to the somatic marker hypothesis, signals from the internal body direct decision-making and involve the ventromedial prefrontal cortex (vmPFC). After reviewing relevant studies, we summarize the brain areas related to interoception and decision-making (e.g., vmPFC, hippocampus, amygdala, hypothalamus, anterior cingulate cortex, and insular cortex) and their roles in and relationships with AD pathology. Moreover, we outline the relationship among interoception, the autonomic nervous system, endocrine system, and AD pathology. We discuss that impaired interoception leads to decreased decision-making ability in people with AD from the perspective of brain neural underpinning. Additionally, we emphasize that anosognosia or reduced self-awareness and metacognition in AD are remarkably congruent with the malfunction of the autonomic nervous system regulating the interoceptive network. Furthermore, we propose that impaired interoception may contribute to a loss in the decision-making ability of patients with AD. However, there still exist empirical challenges in confirming this proposal. First, there has been no standardization for measuring or improving interoception to enhance decision-making ability in patients with AD. Future studies are required to better understand how AD pathology induces impairments in interoception and decision-making.

Older adults process the probability of winning sooner but weigh it less during lottery decisions

Empirical evidence has shown that visually enhancing the saliency of reward probabilities can ease the cognitive demands of value comparisons and improve value-based decisions in old age. In the present study, we used a time-varying drift diffusion model that includes starting time parameters to better understand (1) how increasing the saliency of reward probabilities may affect the dynamics of value-based decision-making and (2) how these effects may interact with age. We examined choices made by younger and older adults in a mixed lottery choice task. On a subset of trials, we used a color-coding scheme to highlight the saliency of reward probabilities, which served as a decision-aid. The results showed that, in control trials, older adults started to consider probability relative to magnitude information sooner than younger adults, but that their evidence accumulation processes were less sensitive to reward probabilities than that of younger adults. This may indicate a noisier and more stochastic information accumulation process during value-based decisions in old age. The decision-aid increased the influence of probability information on evidence accumulation rates in both age groups, but did not alter the relative timing of accumulation for probability versus magnitude in either group.

A neurobiological perspective on social influence: Serotonin and social adaptation

Humans are inherently social beings. Being suggestible to each other's expectations enables pro-social skills that are crucial for social learning and adaptation. Despite its high relevance for psychiatry, the neurobiological mechanisms underlying social adaptation are still not well understood. This review therefore provides a conceptual framework covering various distinct mechanisms underlying social adaptation and explores the neuropharmacology - in particular the role of the serotonin (5-HT) system - modulating these mechanisms. This article therefore reviews empirical results on social influence processing and reconciles them with recent findings from psychedelic research on social processing to elucidate neurobiological and neuropharmacological underpinnings of social adaptation. Various computational, neurobiological, and neurochemical processes are involved in distinct mechanisms underlying social adaptation such as the multisensory process of social information integration that is crucial for the forming of self-representation and representations of social norms. This is again associated with self- and other-perception during social interactions as well as value-based decision making that guides our behaviour in daily interactions. We highlight the critical role of 5-HT in these processes and suggest that 5-HT can facilitate social learning and may represent an important target for treating psychiatric disorders characterized by impairments in social functioning. This framework also has important implications for psychedelic-assisted therapy as well as for the development of novel treatment approaches and future research directions.

Rapid detection of neutral faces associated with emotional value among older adults

OBJECTIVES

Previous studies using visual search paradigms have provided inconsistent results regarding rapid detection of emotional faces among older adults. Furthermore, it is uncertain whether the emotional significance of the faces contributes to efficient searches for emotional faces due to the possible confounding effects of visual saliency. We addressed this issue by excluding the influence of visual factors and examined older adults' ability to detect faces with emotional meaning.

METHOD

We used an associative learning procedure in which neutral faces were paired with monetary reward or punishment, such that the neutral faces acquired positive or negative emotional value. Older participants completed the associative learning task and then engaged in a visual search task, in which previously learned neutral faces were presented as discrepant faces among newly presented neutral distractor faces. Data of young adults from a previous study that used identical experimental procedures were also analyzed.

RESULTS

Older participants exhibited lower learning ability than young participants. However, older adults who were successful at learning were able to detect neutral faces associated with reward or punishment more rapidly than those without monetary outcomes, similar to the pattern observed for young adults.

DISCUSSION

The results suggest that acquired emotional value promotes the detection of value-associated neutral faces among older adults who succeed at learning. It is therefore possible that the ability to detect faces that evoke emotions is preserved in older adults.

Influences of dopaminergic system dysfunction on late-life depression

Deficits in cognition, reward processing, and motor function are clinical features relevant to both aging and depression. Individuals with late-life depression often show impairment across these domains, all of which are moderated by the functioning of dopaminergic circuits. As dopaminergic function declines with normal aging and increased inflammatory burden, the role of dopamine may be particularly salient for late-life depression. We review the literature examining the role of dopamine in the pathogenesis of depression, as well as how dopamine function changes with aging and is influenced by inflammation. Applying a Research Domain Criteria (RDoC) Initiative perspective, we then review work examining how dopaminergic signaling affects these domains, specifically focusing on Cognitive, Positive Valence, and Sensorimotor Systems. We propose a unified model incorporating the effects of aging and low-grade inflammation on dopaminergic functioning, with a resulting negative effect on cognition, reward processing, and motor function. Interplay between these systems may influence development of a depressive phenotype, with an initial deficit in one domain reinforcing decline in others. This model extends RDoC concepts into late-life depression while also providing opportunities for novel and personalized interventions.

Decision-Making Support for People With Alzheimer's Disease: A Narrative Review

The proportion of people with dementia has been increasing yearly, and the decision-making capacity of these people has become a major concern in fields such as the financial industry and in medical settings. In this narrative review, we discuss decision-making in people with Alzheimer’s disease (AD), and we propose the support for decision-making in people with AD, especially financial and medical decision-making. We summarize several hypotheses and theories on the decision-making capacity of people with AD. These include the frontal lobe hypothesis, physiological theory, dysfunction of the hypothalamic-pituitary-adrenal (HPA) axis, and the Person-Task-Fit (PTF) framework. Both internal and external factors can affect decision-making by people with AD. Internal factors are affected by changes in the brain and neurotransmitters, as well as alterations in cognitive ability and emotion. External factors include task characters, task contents, and situation influence. Since feedback has a significant effect on decision-making capacity, a series of suggestions may be helpful to improve this capacity, such as explicit advice, simple options, pleasant rewards, the Talking Mats approach, memory and organizational aid, support by caregivers, cognitive training and feedback. Thus, in providing decision-making support for people with AD, it is important to identify the internal and external factors that impair this process and to deal with these factors.

Neural regions associated with gain-loss frequency and average reward in older and younger adults

Research on the biological basis of reinforcement-learning has focused on how brain regions track expected value based on average reward. However, recent work suggests that humans are more attuned to reward frequency. Furthermore, older adults are less likely to use expected values to guide choice than younger adults. This raises the question of whether brain regions assumed to be sensitive to average reward, like the medial and lateral PFC, also track reward frequency, and whether there are age-based differences. Older (60-81 years) and younger (18-30 years) adults performed the Soochow Gambling task, which separates reward frequency from average reward, while undergoing fMRI. Overall, participants preferred options that provided negative net payoffs, but frequent gains. Older adults improved less over time, were more reactive to recent negative outcomes, and showed greater frequency-related activation in several regions, including DLPFC. We also found broader recruitment of prefrontal and parietal regions associated with frequency value and reward prediction errors in older adults, which may indicate compensation. The results suggest greater reliance on average reward for younger adults than older adults.

Adult age differences in remembering gain- and loss-related intentions

Motivational and emotional changes across adulthood have a profound impact on cognition. In this registered report, we conducted an experimental investigation of motivational influence on remembering intentions after a delay (prospective memory; PM) in younger, middle-aged, and older adults, using gain- and loss-framing manipulations. The present study examined for the first time whether motivational framing in a PM task has different effects on younger and older adults' PM performance (N = 180; age range: 18-85 years) in a controlled laboratory setting. Based on lifespan theories of motivation, we assumed that the prevention of losses becomes more relevant with increasing age: We expected that older adults show relatively higher PM performance in a task with loss-related consequences following PM failure than in a task in which successful PM leads to gains. The opposite pattern of performance was expected for younger adults. The findings suggest that the relevance of reward and positive gain-related consequences for successful remembering appears to decrease with age. As hypothesised, a motivational framing × age interaction indicated that age differences in memory performance were smaller with loss-related than gain-related consequences, supporting a loss-prevention view on motivated cognition.

Exploring reward-related attention selectivity deficits in Parkinson's disease

An important aspect of managing a limited cognitive resource like attention is to use the reward value of stimuli to prioritize the allocation of attention to higher-value over lower-value stimuli. Recent evidence suggests this depends on dopaminergic signaling of reward. In Parkinson's disease, both reward sensitivity and attention are impaired, but whether these deficits are directly related to one another is unknown. We tested whether Parkinson's patients use reward information when automatically allocating their attention and whether this is modulated by dopamine replacement. We compared patients, tested both ON and OFF dopamine replacement medication, to older controls using a standard attention capture task. First, participants learned the different reward values of stimuli. Then, these reward-associated stimuli were used as distractors in a visual search task. We found that patients were generally distracted by the presence of the distractors but that the degree of distraction caused by the high-value and low-value distractors was similar. Furthermore, we found no evidence to support the possibility that dopamine replacement modulates the effect of reward on automatic attention allocation. Our results suggest a possible inability in Parkinson's patients to use the reward value of stimuli when automatically allocating their attention, and raise the possibility that reward-driven allocation of resources may affect the adaptive modulation of other cognitive processes.

Comparing the streamlined psychotherapy "Engage" with problem-solving therapy in late-life major depression. A randomized clinical trial

Effective psychotherapies for late-life depression are underutilized, mainly because of their complexity. "Engage" is a novel, streamlined psychotherapy that relies on neurobiology to identify core behavioral pathology of late-life depression and targets it with simple interventions, co-designed with community therapists so that they can be delivered in community settings. Consecutively recruited adults (≥60 years) with major depression (n = 249) were randomly assigned to 9 weekly sessions of "Engage" or to the evidence-based Problem-Solving Therapy (PST) offered by 35 trained community social workers and assessed by blind raters. "Engage" therapists required an average of 30% less training time to achieve fidelity to treatment than PST therapists and had one-third of the PST therapists' skill drift. Both treatments led to reduction of HAM-D scores over 9 weeks. The mixed effects model-estimated HAM-D ratings were not significantly different between the two treatments at any assessment point of the trial. The one-sided 95% CI for treatment-end difference was (-∞, 0.07) HAM-D points, indicating a non-inferiority margin of 1.3 HAM-D points or greater; this margin is lower than the pre-determined 2.2-point margin. The two treatment arms had similar response (HR = 1.08, 95% CI (0.76, 1.52), p = 0.67) and remission rates (HR = 0.89, 95% CI (0.57, 1.39), p = 0.61). We conclude that "Engage" is non-inferior to PST. If disseminated, "Engage" will increase the number of therapists who can reliably treat late-life depression and make effective psychotherapy available to large numbers of depressed older adults.

Imagining a Personalized Scenario Selectively Increases Perceived Risk of Viral Transmission for Older Adults

The COVID-19 pandemic has created a serious and prolonged public-health emergency. Older adults have been at substantially greater risk of hospitalization, ICU admission, and death due to COVID-19; as of February 2021, over 81% of COVID-19-related deaths in the U.S. occurred for people over the age of 651,2. Converging evidence from around the world suggests that age is the greatest risk factor for severe COVID-19 illness and for the experience of adverse health outcomes3,4. Therefore, effectively communicating health-related risk information requires tailoring interventions to older adults' needs5. Using a novel informational intervention with a nationally-representative sample of 546 U.S. residents, we found that older adults reported increased perceived risk of COVID-19 transmission after imagining a personalized scenario with social consequences. Although older adults tended to forget numerical information over time, the personalized simulations elicited increases in perceived risk that persisted over a 1-3 week delay. Overall, our results bear broad implications for communicating information about health risks to older adults, and they suggest new strategies to combat annual influenza outbreaks.

A Developmental Framework for Embodiment Research: The Next Step Toward Integrating Concepts and Methods

Embodiment research is at a turning point. There is an increasing amount of data and studies investigating embodiment phenomena and their role in mental processing and functions from across a wide range of disciplines and theoretical schools within the life sciences. However, the integration of behavioral data with data from different biological levels is challenging for the involved research fields such as movement psychology, social and developmental neuroscience, computational psychosomatics, social and behavioral epigenetics, human-centered robotics, and many more. This highlights the need for an interdisciplinary framework of embodiment research. In addition, there is a growing need for a cross-disciplinary consensus on level-specific criteria of embodiment. We propose that a developmental perspective on embodiment is able to provide a framework for overcoming such pressing issues, providing analytical tools to link timescales and levels of embodiment specific to the function under study, uncovering the underlying developmental processes, clarifying level-specific embodiment criteria, and providing a matrix and platform to bridge disciplinary boundaries among the involved research fields.

The Effects of Cannabis Use on Cognitive Function in Healthy Aging: A Systematic Scoping Review

BACKGROUND

Older adults (≥50 years) represent the fastest-growing population of people who use cannabis, potentially due to the increasing promotion of cannabis as medicine by dispensaries and cannabis websites. Given healthy aging and cannabis use are both associated with cognitive decline, it is important to establish the effects of cannabis on cognition in healthy aging.

OBJECTIVE

This systematic scoping review used preferred reporting items for systematic reviews and meta-analyses guidelines to critically examine the extent of literature on this topic and highlight areas for future research.

METHOD

A search of six databases (PubMed, EMBASE, PsycINFO, Web of Science, Family and Society Studies Worldwide, and CINAHL) for articles published by September 2019, yielded 1,014 unique results.

RESULTS

Six articles reported findings for older populations (three human and three rodent studies), highlighting the paucity of research in this area. Human studies revealed largely null results, likely due to several methodological limitations. Better-controlled rodent studies indicate that the relationship between ∆9-tetrahydrocannabinol (THC) and cognitive function in healthy aging depends on age and level of THC exposure. Extremely low doses of THC improved cognition in very old rodents. Somewhat higher chronic doses improved cognition in moderately aged rodents. No studies examined the effects of cannabidiol (CBD) or high-CBD cannabis on cognition.

CONCLUSIONS

This systematic scoping review provides crucial, timely direction for future research on this emerging issue. Future research that combines neuroimaging and cognitive assessment would serve to advance understanding of the effects of age and quantity of THC and CBD on cognition in healthy aging.

Ageing is associated with disrupted reinforcement learning whilst learning to help others is preserved

Reinforcement learning is a fundamental mechanism displayed by many species. However, adaptive behaviour depends not only on learning about actions and outcomes that affect ourselves, but also those that affect others. Using computational reinforcement learning models, we tested whether young (age 18-36) and older (age 60-80, total n = 152) adults learn to gain rewards for themselves, another person (prosocial), or neither individual (control). Detailed model comparison showed that a model with separate learning rates for each recipient best explained behaviour. Young adults learned faster when their actions benefitted themselves, compared to others. Compared to young adults, older adults showed reduced self-relevant learning rates but preserved prosocial learning. Moreover, levels of subclinical self-reported psychopathic traits (including lack of concern for others) were lower in older adults and the core affective-interpersonal component of this measure negatively correlated with prosocial learning. These findings suggest learning to benefit others is preserved across the lifespan with implications for reinforcement learning and theories of healthy ageing.

Target value and prevalence influence visual foraging in younger and older age

The prevalence and reward-value of targets have an influence on visual search. The strength of the effect of an item's reward-value on attentional selection varies substantially between individuals and is potentially sensitive to aging. We investigated individual and age differences in a hybrid foraging task, in which the prevalence and value of multiple target types was varied. Using optimal foraging theory measures, foraging was more efficient overall in younger than older observers. However, the influence of prevalence and value on target selections was similar across age groups, suggesting that the underlying cognitive mechanisms are preserved in older age. When prevalence was varied but target value was balanced, younger and older observers preferably selected the most frequent target type and were biased to select another instance of the previously selected target type. When value was varied, younger and older observers showed a tendency to select high-value targets, but preferences were more diverse between individuals. When value and prevalence were inversely related, some observers showed particularly strong preferences for high-valued target types, while others showed a preference for high-prevalent, albeit low-value, target types. In younger adults, individual differences in the selection choices correlated with a personality index, suggesting that avoiding selections of low-value targets may be related to reward-seeking behaviour.

Evidence for deficits in behavioural and physiological responses in aged mice relevant to the psychiatric symptom of apathy

Apathy is widely reported in patients with neurological disorders or post viral infection but is also seen in otherwise-healthy aged individuals. This study investigated whether aged male mice express behavioural and physiological changes relevant to an apathy phenotype. Using measures of motivation to work for reward, we found deficits in the progressive ratio task related to rate of responding. In an effort-related decision-making task, aged mice were less willing to exert effort for high value reward. Aged mice exhibited reduced reward sensitivity but also lower measures of anxiety in the novelty supressed feeding test and an attenuated response to restraint stress with lower corticosterone and reduced paraventricular nucleus c-fos activation. This profile of affective changes did not align with those observed in models of depression but suggested emotional blunting. In a test of cognition (novel object recognition), aged mice showed no impairments, but activity was lower in a measure of exploration in a novel environment. Together, these data suggest aged mice show changes across the domains of motivated behaviour, reward sensitivity and emotional reactivity and may be a suitable model for the pre-clinical study of the psychiatric symptom of apathy.

Cognitive and Motor Perseveration Are Associated in Older Adults

Aging causes perseveration (difficulty to switch between actions) in motor and cognitive tasks, suggesting that the same neural processes could govern these abilities in older adults. To test this, we evaluated the relation between independently measured motor and cognitive perseveration in young (21.4 ± 3.7 y/o) and older participants (76.5 ± 2.9 y/o). Motor perseveration was measured with a locomotor task in which participants had to transition between distinct walking patterns. Cognitive perseveration was measured with a card matching task in which participants had to switch between distinct matching rules. We found that perseveration in the cognitive and motor domains were positively related in older, but not younger individuals, such that participants exhibiting greater perseveration in the motor task also perseverated more in the cognitive task. Additionally, exposure reduces motor perseveration: older adults who had practiced the motor task could transition between walking patterns as proficiently as naïve, young individuals. Our results suggest an overlap in neural processes governing cognitive and motor perseveration with aging and that exposure can counteract the age-related motor perseveration.

Diminished Feedback Evaluation and Knowledge Updating Underlying Age-Related Differences in Choice Behavior During Feedback Learning

In our daily lives, we continuously evaluate feedback information, update our knowledge, and adapt our behavior in order to reach desired goals. This ability to learn from feedback information, however, declines with age. Previous research has indicated that certain higher-level learning processes, such as feedback evaluation, integration of feedback information, and updating of knowledge, seem to be affected by age, and recent studies have shown how the adaption of choice behavior following feedback can differ with age. The neural mechanisms underlying this age-related change in choice behavior during learning, however, remain unclear. The aim of this study is therefore to investigate the relation between learning-related neural processes and choice behavior during feedback learning in two age groups. Behavioral and fMRI data were collected, while a group of young (age 18–30) and older (age 60–75) adults performed a probabilistic learning task consisting of 10 blocks of 20 trials each. On each trial, the participants chose between a house and a face, after which they received visual feedback (loss vs. gain). In each block, either the house or the face image had a higher probability of yielding a reward (62.5 vs. 37.5%). Participants were instructed to try to maximize their gains. Our results showed that less successful learning in older adults, as indicated by a lower learning rate, corresponded with a higher tendency to switch to the other stimulus option, and with a reduced adaptation of this switch choice behavior following positive feedback. At the neural level, activation following positive and negative feedback was found to be less distinctive in the older adults, due to a smaller feedback-evaluation response to positive feedback in this group. Furthermore, whereas young adults displayed increased levels of knowledge updating prior to adapting choice behavior, we did not find this effect in older adults. Together, our results suggest that diminished learning performance with age corresponds with diminished evaluation of positive feedback and reduced knowledge updating related to changes in choice behavior, indicating how such differences in feedback processing at the trial level in older adults might lead to reduced learning performance across trials.

A Search Advantage for Horizontal Targets in Dynamic Displays

Several lines of evidence point to the existence of a visual processing advantage for horizontal over vertical orientations. We investigated whether such a horizontal advantage exists in the context of top-down visual search. Inspired by change detection studies, we created displays where a dynamic target -- a horizontal or a vertical group of five dots that changed contrast synchronously -- was embedded within a randomly flickering grid of dots. The display size (total dots) varied across trials, and the orientation of the target was constant within interleaved blocks. As expected, search was slow and inefficient. Importantly, participants were almost a second faster finding horizontal compared to vertical targets. They were also more efficient and more accurate during horizontal search. Such findings establish that the attentional templates thought to guide search for known targets can exhibit strong orientation anisotropies. We discuss possible underlying mechanisms and how these might be explored in future studies.

Neural bases of risky decisions involving nicotine vapor versus monetary reward

•

• Most studies of addiction with fMRI use only money reward.

•

• Little is known about the neural basis of real-time drug use decisions.

•

• Subjects gambled for either money or immediate nicotine vape reward in scanner.

•

• The neural response to immediate drug reward is different from monetary reward.

•

• Money reward has limitations as a proxy for studying addiction.

Substantial effort has gone into neuroimaging studies of neural mechanisms underlying addiction. Human studies of smoking typically either give monetary reward during an fMRI task or else allow subjects to smoke outside the scanner, after the session. This raises a fundamental issue of construct validity, as it is unclear whether the same neural mechanisms process decisions about nicotine that process decisions about money. To address this, we developed a novel MR-compatible nicotine vaping device, such that access to nicotine vapor could be controlled and monitored. We recruited heavy smokers (Money: 45 subjects, 13 females and 32 males; Nicotine: 21 subjects, 4 females and 17 males) to perform a gambling task with nicotine and monetary reward on separate days. We collected BOLD fMRI data while they performed the task inside the scanner and analyzed it using general linear modeling, with inference based on cluster-size correction. This allowed a direct comparison between the neural mechanisms of choosing and receiving immediate drug vs. monetary reward. We found substantial differences in the neural mechanisms that underlie risky choices about money vs. drug reward, including a reversal of the well-known error effects in the medial prefrontal cortex.

Striosomes Mediate Value-Based Learning Vulnerable in Age and a Huntington's Disease Model

Learning valence-based responses to favorable and unfavorable options requires judgments of the relative value of the options, a process necessary for species survival. We found, using engineered mice, that circuit connectivity and function of the striosome compartment of the striatum are critical for this type of learning. Calcium imaging during valence-based learning exhibited a selective correlation between learning and striosomal but not matrix signals. This striosomal activity encoded discrimination learning and was correlated with task engagement, which, in turn, could be regulated by chemogenetic excitation and inhibition. Striosomal function during discrimination learning was disturbed with aging and severely so in a mouse model of Huntington's disease. Anatomical and functional connectivity of parvalbumin-positive, putative fast-spiking interneurons (FSIs) to striatal projection neurons was enhanced in striosomes compared with matrix in mice that learned. Computational modeling of these findings suggests that FSIs can modulate the striosomal signal-to-noise ratio, crucial for discrimination and learning.

Salience and default-mode network connectivity during threat and safety processing in older adults

The appropriate assessment of threat and safety is important for decision‐making but might be altered in old age due to neurobiological changes. The literature on threat and safety processing in older adults is sparse and it is unclear how healthy ageing affects the brain's functional networks associated with affective processing. We measured skin conductance responses as an indicator of sympathetic arousal and used functional magnetic resonance imaging and independent component analysis to compare young and older adults' functional connectivity in the default mode (DMN) and salience networks (SN) during a threat conditioning and extinction task. While our results provided evidence for differential threat processing in both groups, they also showed that functional connectivity within the SN – but not the DMN – was weaker during threat processing in older compared to young adults. This reduction of within‐network connectivity was accompanied by an age‐related decrease in low frequency spectral power in the SN and a reduction in inter‐network connectivity between the SN and DMN during threat and safety processing. Similarly, we found that skin conductance responses were generally lower in older compared to young adults. Our results are the first to demonstrate age‐related changes in brain activation during aversive conditioning and suggest that the ability to adaptively filter affective information is reduced in older adults.

Motivation and sensitivity to monetary reward in late-life insomnia: moderating role of sex and the inflammatory marker CRP

Insomnia is a well-established risk factor for late-life depression, yet the intermediary mechanisms are not known. One plausible mechanism is dysregulation of the reward system, a common feature of depression. The main objective of the current study was to determine whether late-life insomnia is associated with reduced motivation and reduced sensitivity for monetary reward. Secondary exploratory objectives were to test for sex-specific effects and whether elevated inflammation potentiated these associations. Nondepressed community dwelling older adults (n = 104; aged 60-80) who either met (n = 31) or did not meet (n = 73) criteria for insomnia disorder as assessed by the Structured Clinical Interview for DSM-5 completed the Effort Expenditure for Rewards Task and provided blood samples for the assessment of C-reactive protein (CRP). Older adults with late-life insomnia showed reduced reward motivation 95% CI [-0.955, -0.569] and reduced reward sensitivity 95% CI [-0.430, -0.075] relative to comparison controls. In secondary exploratory analyses, late-life insomnia was associated with reduced motivation to a greater degree in males than in females 95% CI [0.072, 0.775], particularly when CRP was also elevated 95% CI [0.672, 1.551]. Late-life insomnia is associated with reduced motivation and sensitivity for monetary reward, which suggests insomnia may confer risk for late-life depression by dysregulation of reward mechanisms. Exploratory analyses suggest that older males with insomnia and elevated CRP may be particularly vulnerable to deficits in reward motivation. Although in need of replication and further study, results suggest that interventions that target insomnia or deficits in reward processing may mitigate the risk of depression in nondepressed older adults, especially older males with insomnia.

Relevance of working memory for reinforcement learning in older adults varies with timescale of learning

In young adults, individual differences in working memory (WM) contribute to reinforcement learning (RL). Age-related RL changes, however, are mostly attributed to decreased reward prediction-error (RPE) signaling. Here, we investigated the contribution of WM to RL in young (18-35) and older (≥65) adults. Because WM supports maintenance across a limited timescale, we only expected a relation between RL and WM with short delays between stimulus repetitions. Our results demonstrated better learning with short than long delays. A week later, however, long-delay associations were remembered better. Computational modeling corroborated that during learning, WM was more engaged by young adults in the short-delay condition than in any other age-condition combination. Crucially, both model-derived and neuropsychological assessments of WM predicted short-delay learning in older adults, who further benefitted from using self-conceived learning strategies. Thus, depending on the timescale of learning, age-related RL changes may not only reflect decreased RPE signaling but also WM decline.

Influence of Reward Motivation on Directed Forgetting in Younger and Older Adults

An important feature of the memory system is the ability to forget, but aging is associated with declines in the ability to intentionally forget potentially due to declines in cognitive control. Despite cognitive deficits, older adults are sensitive to affective manipulations, such as reward motivation, and reward anticipation can improve older adults' memory performance. The goal of the current studies was to examine the effect of reward motivation on directed remembering and forgetting. Participants were healthy CloudResearch/Turk Prime workers aged 18-35 and 60-85. In Experiment 1, we conducted a typical item-method directed forgetting task using neutral words presented one at a time followed by a to-be-remembered (TBR) or to-be-forgotten (TBF) cue. A recognition memory test followed that included all words from the encoding task, as well as new words. We replicated prior findings of better memory for TBR compared to TBF items, but not typical age-related differences in recognition of TBF items. In Experiments 2-4, we repeated this paradigm except that in the second block of trials, each word was presented with a high ($0.75) or low ($0.01) reward cue indicating the value that could be earned if the item was successfully Remembered or Forgotten (depending on cue). During recognition, correct responses to target items (both TBR and TBF) resulted in the associated reward, but incorrect "old" responses resulted in a loss of $0.50. In three experiments, high rewards led to better memory for younger and older adults compared to low rewards, regardless of the directed cue to remember or forget the word. In Experiments 3 and 4, older adults showed typical deficits in directed forgetting, but this was across reward conditions. For older adults, there was no evidence that including reward motivation improved cognitive control abilities as high value reward anticipation did not improve directed forgetting. Instead, in line with hypotheses, high compared to low value reward anticipation leads to engagement of processes that result in better memory regardless of the TBR or TBF cue, and reward anticipation bolsters memory in a relatively automatic, rather than strategic, fashion that overrides one's ability to cognitively control encoding processes.

Large-Scale Structural Covariance Networks Predict Age in Middle-to-Late Adulthood: A Novel Brain Aging Biomarker

The aging process is accompanied by changes in the brain's cortex at many levels. There is growing interest in summarizing these complex brain-aging profiles into a single, quantitative index that could serve as a biomarker both for characterizing individual brain health and for identifying neurodegenerative and neuropsychiatric diseases. Using a large-scale structural covariance network (SCN)-based framework with machine learning algorithms, we demonstrate this framework's ability to predict individual brain age in a large sample of middle-to-late age adults, and highlight its clinical specificity for several disease populations from a network perspective. A proposed estimator with 40 SCNs could predict individual brain age, balancing between model complexity and prediction accuracy. Notably, we found that the most significant SCN for predicting brain age included the caudate nucleus, putamen, hippocampus, amygdala, and cerebellar regions. Furthermore, our data indicate a larger brain age disparity in patients with schizophrenia and Alzheimer's disease than in healthy controls, while this metric did not differ significantly in patients with major depressive disorder. These findings provide empirical evidence supporting the estimation of brain age from a brain network perspective, and demonstrate the clinical feasibility of evaluating neurological diseases hypothesized to be associated with accelerated brain aging.

Age-related variability in decision-making: Insights from neurochemistry

Despite dopamine's significant role in models of value-based decision-making and findings demonstrating loss of dopamine function in aging, evidence of systematic changes in decision-making over the life span remains elusive. Previous studies attempting to resolve the neural basis of age-related alteration in decision-making have typically focused on physical age, which can be a poor proxy for age-related effects on neural systems. There is growing appreciation that aging has heterogeneous effects on distinct components of the dopamine system within subject in addition to substantial variability between subjects. We propose that some of the conflicting findings in age-related effects on decision-making may be reconciled if we can observe the underlying dopamine components within individuals. This can be achieved by incorporating in vivo imaging techniques including positron emission tomography (PET) and neuromelanin-sensitive MR. Further, we discuss how affective factors may contribute to individual differences in decision-making performance among older adults. Specifically, we propose that age-related shifts in affective attention ("positivity effect") can, in some cases, counteract the impact of altered dopamine function on specific decision-making processes, contributing to variability in findings. In an effort to provide clarity to the field and advance productive hypothesis testing, we propose ways in which in vivo dopamine imaging can be leveraged to disambiguate dopaminergic influences on decision-making, and suggest strategies for assessing individual differences in the contribution of affective attentional focus.