Exploratory decision-making as a function of lifelong experience, not cognitive decline

Meta-Analysis Reveals That Explore-Exploit Decisions are Dissociable by Activation in the Dorsal Lateral Prefrontal Cortex and the Anterior Cingulate Cortex

Explore-exploit research has challenges in generalizability due to a limited theoretical basis of exploration and exploitation. Neuroimaging can help identify whether explore-exploit decisions use an opponent processing system to address this issue. Thus, we conducted a coordinate-based meta-analysis (N=23 studies) where we found activation in the dorsal lateral prefrontal cortex and anterior cingulate cortex during exploration versus exploitation, providing some evidence for opponent processing. However, the conjunction of explore-exploit decisions was associated with activation in the dorsal anterior cingulate cortex, dorsal medial prefrontal cortex, and anterior insula, suggesting that these brain regions do not engage in opponent processing. Further, exploratory analyses revealed heterogeneity in brain responses between task types during exploration and exploitation respectively. Coupled with results suggesting that activation in exploration and exploitation decisions is generally more similar than it is different suggests there remain significant challenges toward characterizing explore-exploit decision making. Nonetheless, dlPFC and ACC activation differentiate explore and exploit decisions and identifying these responses can help in targeted interventions aimed at manipulating these decisions.

Developmental changes in exploration resemble stochastic optimization

Human development is often described as a 'cooling off' process, analogous to stochastic optimization algorithms that implement a gradual reduction in randomness over time. Yet there is ambiguity in how to interpret this analogy, due to a lack of concrete empirical comparisons. Using data from n = 281 participants ages 5 to 55, we show that cooling off does not only apply to the single dimension of randomness. Rather, human development resembles an optimization process of multiple learning parameters, for example, reward generalization, uncertainty-directed exploration and random temperature. Rapid changes in parameters occur during childhood, but these changes plateau and converge to efficient values in adulthood. We show that while the developmental trajectory of human parameters is strikingly similar to several stochastic optimization algorithms, there are important differences in convergence. None of the optimization algorithms tested were able to discover reliably better regions of the strategy space than adult participants on this task.

Autobiographical event memory and aging: older adults get the gist

We propose that older adults' ability to retrieve episodic autobiographical events, although often viewed through a lens of decline, reveals much about what is preserved and prioritized in cognitive aging. Central to our proposal is the idea that the so-called gist of an autobiographical event is not only spared with normal aging but also well adapted to serve memory-guided behavior in older age. To support our proposal, we review cognitive and brain evidence indicating an age-related shift toward gist memory. We then discuss why this shift likely arises from more than age-related decline and instead partly reflects a natural, arguably adaptive, outcome of experience, motivation, and mode-of-thinking factors. Our proposal reveals an upside of age-related memory changes and identifies important research questions.

From exploration to exploitation: a shifting mental mode in late life development

Changes in cognition, affect, and brain function combine to promote a shift in the nature of mentation in older adulthood, favoring exploitation of prior knowledge over exploratory search as the starting point for thought and action. Age-related exploitation biases result from the accumulation of prior knowledge, reduced cognitive control, and a shift toward affective goals. These are accompanied by changes in cortical networks, as well as attention and reward circuits. By incorporating these factors into a unified account, the exploration-to-exploitation shift offers an integrative model of cognitive, affective, and brain aging. Here, we review evidence for this model, identify determinants and consequences, and survey the challenges and opportunities posed by an exploitation-biased mental mode in later life.

Risk Perception and Coping Behavior of Construction Workers on Occupational Health Risks-A Case Study of Nanjing, China

To reduce harm caused by occupational health risks of construction workers exposed to working environments, especially those for interior decoration, it is crucial for them to actively recognize and prevent these risks. Therefore, how to improve their occupational health risks perception and regulate their coping behaviors should be of great concern. However, most prior studies target construction worker safety, and little research focuses on risk analysis from the psychological level of workers. Hence, construction workers' occupational health risk perception level and coping behavior level in Nanjing and the influencing factors were analyzed through statistical analysis with 341 valid questionnaires. Bootstrapping was applied to test the mediating effects of risk perception on the proposed factors and coping behaviors. This study revealed that construction workers have a high-level of occupational health risk perception, yet low-level coping behavior. Gender, age, education level, and unit qualification cause differences in individual risk perception level. Personal knowledge and group effects significantly affect the level of risk perception, which subsequently affect coping behavior. Education level, monthly income, and personal knowledge influence the coping behavior through risk perception. Recommendations were put forward for risk perception and coping behavior improvement from the perspectives of construction workers themselves, enterprises, and governments. This study sheds new light for research areas of occupational health and risk management and provides beneficial practice for improving construction workers' responses to occupational health risks.

Development of directed and random exploration in children

Are young children just random explorers who learn serendipitously? Or are even young children guided by uncertainty-directed sampling, seeking to explore in a systematic fashion? We study how children between the ages of 4 and 9 search in an explore-exploit task with spatially correlated rewards, where exhaustive exploration is infeasible and not all options can be experienced. By combining behavioral data with a computational model that decomposes search into similarity-based generalization, uncertainty-directed exploration, and random exploration, we map out developmental trajectories of generalization and exploration. The behavioral data show strong developmental differences in children's capability to exploit environmental structure, with performance and adaptiveness of sampling decisions increasing with age. Through model-based analyses, we disentangle different forms of exploration, finding signature of both uncertainty-directed and random exploration. The amount of random exploration strongly decreases as children get older, supporting the notion of a developmental "cooling off" process that modulates the randomness in sampling. However, even at the youngest age range, children do not solely rely on random exploration. Even as random exploration begins to taper off, children are actively seeking out options with high uncertainty in a goal-directed fashion, and using inductive inferences to generalize their experience to novel options. Our findings provide critical insights into the behavioral and computational principles underlying the developmental trajectory of learning and exploration.

Neural Correlates of Enhanced Memory for Meaningful Associations with Age

Evidence suggests that age differences in associative memory are attenuated for associations that are consistent with prior knowledge. Such knowledge structures have traditionally been associated with the default network (DN), which also shows reduced modulation with age. In the present study, we investigated whether DN activity and connectivity patterns could account for this age-related effect. Younger and older adults underwent functional magnetic resonance imaging as they learned realistic and unrealistic prices of common grocery items. Both groups showed greater activity in the DN during the encoding of realistic, relative to unrealistic, prices. Moreover, DN activity at encoding and retrieval and its connectivity with an attention control network at encoding were associated with enhanced memory for realistic prices. Finally, older adults showed overactivation of control regions during retrieval of realistic prices relative to younger adults. Our findings suggest that DN activity and connectivity patterns (traditionally viewed as indicators of cognitive failure with age), and additional recruitment of control regions, might underlie older adults' enhanced memory for meaningful associations.

Results of Beer Game Trials Played by Natural Resource Managers Versus Students: Does Age Influence Ordering Decisions?

Systems involving agriculture and natural resources (AGNR) management and representing integrations of biologic, geologic, socio-economic, and climatic characteristics are incredibly complex. AGNR managers purport using a systems-oriented mental model while many observed management and policy strategies remain linear or symptom-driven. To improve AGNR professionals’ systems thinking abilities, two programs, the King Ranch® Institute for Ranch Management at Texas A&M University-Kingsville (KRIRM) and the Honors College at South Dakota State University (SDSUHC), implemented the famous Production Distribution Simulation Game (a.k.a. the Beer Game) into their programs beginning in 2003 and 2011. A Beer Game database consisting of 10 years of trials or over 270 individual players was compared to seminal work in the literature as well as to one another. We found that AGNR managers and students performed worse than players in a seminal Beer Game study. More interestingly, we found that younger players adapted more readily to inventory surpluses by reducing the order rates and effective inventories significantly when compared to older players (p < 0.10 for retailer and distributors, and p < 0.05 for wholesales and factories). We substantiated our results to those in more recent studies of age-related decision-making and in the context of common learning disabilities. Lastly, we discuss some implications of such decision-making on 21st century AGNR problems and encourage AGNR disciplines to better integrate system dynamics-based education and collaboration in order to better prepare for such complex issues.

Semantic diversity in paired-associate learning: Further evidence for the information accumulation perspective of cognitive aging

Normal aging is often associated with a performance decline on various cognitive tests, including paired associate learning (PAL), where participants are asked to learn and recall arbitrary word pairs. While many studies have taken this as evidence to support the notion of age-related deficits in cognitive processing, Ramscar, Hendrix, Shaoul, Milin, and Baayen (Topics in Cognitive Science, 6(1), 5-42) and Ramscar, Sun, Hendrix, and Baayen (Psychological Science, 28(8), 1171-1179, 2017) posit that the decline in performance on various cognitive tasks can be explained by the accumulation of linguistic knowledge over time. To demonstrate this, Ramscar et al. (2017) found that older bilingual participants outperformed monolingual counterparts on a verbal PAL task, proposed to be due to bilinguals having accumulated less information about the words used in the study. However, comparing bilinguals to monolinguals introduces confounding factors. For example, bilingual's better performance may be due to superior executive functioning. To minimize these between-subject confounds, the current study used a within-subject design in order to examine the influence of linguistic experience on paired associate learning in younger and older adults. Linguistic experience was modeled using a semantic diversity measure of word strength (Jones, Johns, & Recchia, 2012). When frequency is controlled for, high semantic diversity words are associated to a greater number of words and have a higher average strength of association. In the current study, PAL performance of older adults was significantly lower for word pairs involving high semantic diversity words, while their performance did not differ for low semantic diversity words, consistent with the information accumulation perspective of aging.

Age-related differences in decision-making process in the context of healthy aging

During aging cognitive functions change differently from others. Unlike most of the body systems, there is no clear decline pattern in cognitive processes. One of the most significant cognitive processes is decision-making, which defines social interactions, economical relationships, and risky behavior. Among factors influence decisionmaking process, individual lifelong experience is considered to be an important one. Obviously, older adults have more life experience, than the younger groups. However, the former often do not tend to rational choices and beneficial strategies. In this case it is important to assess how aging processes in brain contribute into searching for the most beneficial option during decision-making. On the basis of today’s studies about risky behavior, judgement of fairness, financial games, and modern neuroimaging data this review will observe and discuss age-related differences in decision-making. Thus, a correct cognitive profile of older adult in decision-making context can be determined.

Effects of Normative Aging on Eye Movements during Reading

Substantial progress has been made in understanding the mostly detrimental effects of normative aging on eye movements during reading. This article provides a review of research on aging effects on eye movements during reading for different writing systems (i.e., alphabetic systems like English compared to non-alphabetic systems like Chinese), focused on appraising the importance of visual and cognitive factors, considering key methodological issues, and identifying vital questions that need to be addressed and topics for further investigation.

Searching for Rewards Like a Child Means Less Generalization and More Directed Exploration

How do children and adults differ in their search for rewards? We considered three different hypotheses that attribute developmental differences to (a) children's increased random sampling, (b) more directed exploration toward uncertain options, or (c) narrower generalization. Using a search task in which noisy rewards were spatially correlated on a grid, we compared the ability of 55 younger children (ages 7 and 8 years), 55 older children (ages 9-11 years), and 50 adults (ages 19-55 years) to successfully generalize about unobserved outcomes and balance the exploration-exploitation dilemma. Our results show that children explore more eagerly than adults but obtain lower rewards. We built a predictive model of search to disentangle the unique contributions of the three hypotheses of developmental differences and found robust and recoverable parameter estimates indicating that children generalize less and rely on directed exploration more than adults. We did not, however, find reliable differences in terms of random sampling.

The Shifting Architecture of Cognition and Brain Function in Older Adulthood

Cognitive aging is often described in the context of loss or decline. Emerging research suggests that the story is more complex, with older adults showing both losses and gains in cognitive ability. With increasing age, declines in controlled, or fluid, cognition occur in the context of gains in crystallized knowledge of oneself and the world. This inversion in cognitive capacities, from greater reliance on fluid abilities in young adulthood to increasingly crystallized or semanticized cognition in older adulthood, has profound implications for cognitive and real-world functioning in later life. The shift in cognitive architecture parallels changes in the functional network architecture of the brain. Observations of greater functional connectivity between lateral prefrontal brain regions, implicated in cognitive control, and the default network, implicated in memory and semantic processing, led us to propose the default-executive coupling hypothesis of aging. In this review we provide evidence that these changes in the functional architecture of the brain serve as a neural mechanism underlying the shifting cognitive architecture from younger to older adulthood. We incorporate findings spanning cognitive aging and cognitive neuroscience to present an integrative model of cognitive and brain aging, describing its antecedents, determinants, and implications for real-world functioning.

Emotional arousal may increase susceptibility to fraud in older and younger adults

Financial fraud is a societal problem for adults of all ages, but financial losses are especially damaging to older adults who typically live on fixed incomes and have less time to recoup losses. Persuasion tactics used by fraud perpetrators often elicit high levels of emotional arousal; thus, studying emotional arousal may help to identify the conditions under which individuals are particularly susceptible to fraud. We examined whether inducing high-arousal positive (HAP) and high-arousal negative (HAN) emotions increased susceptibility to fraud. Older (ages 65 to 85) and younger (ages 30 to 40) adults were randomly assigned to 1 of 3 emotional arousal conditions in a laboratory task: HAP, HAN, or low arousal (LA). Fraud susceptibility was assessed through participants' responses to misleading advertisements. Both HAP and HAN emotions were successfully induced in older and younger participants. For participants who exhibited the intended induced emotional arousal, both the HAP and HAN conditions, relative to the LA condition, significantly increased participants' reported intention to purchase falsely advertised items. These effects did not differ significantly between older and younger adults and were mitigated in participants who did not exhibit the intended emotional arousal. However, irrespective of the emotional arousal condition to which older adults were assigned (HAP, HAN, or LA), they reported greater purchase intention than did younger adults. These results inform the literature on fraud susceptibility and aging. Educating consumers to postpone financial decisions until they are in calm emotional states may protect against this common persuasion tactic. (PsycINFO Database Record

The Mismeasurement of Mind: Life-Span Changes in Paired-Associate-Learning Scores Reflect the "Cost" of Learning, Not Cognitive Decline

The age-related declines observed in scores on paired-associate-learning (PAL) tests are widely taken as support for the idea that human cognitive capacities decline across the life span. In a computational simulation, we showed that the patterns of change in PAL scores are actually predicted by the models that formalize the associative learning process in other areas of behavioral and neuroscientific research. These models also predict that manipulating language exposure can reproduce the experience-related performance differences erroneously attributed to age-related decline in age-matched adults. Consistent with this, results showed that older bilinguals outperformed native speakers in a German PAL test, an advantage that increased with age. These analyses and results show that age-related PAL performance changes reflect the predictable effects of learning on the associability of test items, and indicate that failing to control for these effects is distorting the understanding of cognitive and brain development in adulthood.

Semanticized autobiographical memory and the default - executive coupling hypothesis of aging

As we age, the architecture of cognition undergoes a fundamental transition. Fluid intellectual abilities decline while crystalized abilities remain stable or increase. This shift has a profound impact across myriad cognitive and functional domains, yet the neural mechanisms remain under-specified. We have proposed that greater connectivity between the default network and executive control regions in lateral prefrontal cortex may underlie this shift, as older adults increasingly rely upon accumulated knowledge to support goal-directed behavior. Here we provide direct evidence for this mechanism within the domain of autobiographical memory. In a large sample of healthy adult participants (n = 103 Young; n = 80 Old) the strength of default - executive coupling reliably predicted more semanticized, or knowledge-based, recollection of autobiographical memories in the older adult cohort. The findings are consistent with the default - executive coupling hypothesis of aging and identify this shift in network dynamics as a candidate neural mechanism associated with crystalized cognition in later life that may signal adaptive capacity in the context of declining fluid cognitive abilities.

Prior Knowledge of Object Associations Shapes Attentional Templates and Information Acquisition

Studies on attentional selection typically use unpredictable and meaningless stimuli, such as simple shapes and oriented lines. The assumption is that using these stimuli minimizes effects due to learning or prior knowledge, such that the task performance indexes a "pure" measure of the underlying cognitive ability. However, prior knowledge of the test stimuli and related stimuli acquired before or during the task impacts performance in meaningful ways. This mini review focuses on prior knowledge of object associations, because it is an important, yet often ignored, aspect of attentional selection. We first briefly review recent studies demonstrating that how objects are selected during visual search depends on the participant's prior experience with other objects associated with the target. These effects appear with both task-relevant and task-irrelevant knowledge. We then review how existing object associations may influence subsequent learning of new information, which is both a driver and a consequence of selection processes. These insights highlight the importance of one aspect of prior knowledge for attentional selection and information acquisition. We briefly discuss how this work with young adults may inform other age groups throughout the lifespan, as learners gradually increase their prior knowledge. Importantly, these insights have implications for developing more accurate measurements of cognitive abilities.

Framing matters: Effects of framing on older adults' exploratory decision-making

We examined framing effects on exploratory decision-making. In Experiment 1 we tested older and younger adults in two decision-making tasks separated by one week, finding that older adults' decision-making performance was preserved when maximizing gains, but it declined when minimizing losses. Computational modeling indicates that younger adults in both conditions, and older adults in gains maximization, utilized a decreasing threshold strategy (which is optimal), but older adults in losses were better fit by a fixed-probability model of exploration. In Experiment 2 we examined within-subject behavior in older and younger adults in the same exploratory decision-making task, but without a time separation between tasks. We replicated the older adult disadvantage in loss minimization from Experiment 1 and found that the older adult deficit was significantly reduced when the loss-minimization task immediately followed the gains-maximization task. We conclude that older adults' performance in exploratory decision-making is hindered when framed as loss minimization, but that this deficit is attenuated when older adults can first develop a strategy in a gains-framed task. (PsycINFO Database Record

A Lifespan Perspective on Embodied Cognition

Since its infancy embodied cognition research has fundamentally changed our understanding of how action, perception, and cognition relate to and interact with each other. Ideas from different schools of thought have led to controversial theories and a unifying framework is still being debated. In this perspective paper, we argue that in order to improve our understanding of embodied cognition and to take significant steps toward a comprehensive framework, a lifespan approach is mandatory. Given that most established theories have been developed and tested in the adult population, which is characterized by relatively robust and stable sensorimotor and cognitive abilities, we deem it questionable whether embodied cognition effects found in this population are representative for different life stages such as childhood or the elderly. In contrast to adulthood, childhood is accompanied by a rapid increase of sensorimotor and cognitive skills, and the old age by a decline of such capacities. Hence, sensorimotor and cognitive capacities, as well as their interactions, are more fragile at both extremes of the lifespan, thereby offering a unique window into the emergence of embodied cognition effects and age-related differences therein. A lifespan approach promises to make a major contribution toward a unifying and comprehensive theory of embodied cognition that is valid across the lifespan and ‘gets better with age.’