Behavioral flexibility is associated with changes in structure and function distributed across a frontal cortical network in macaques

Decision-making shapes dynamic inter-areal communication within macaque ventral frontal cortex

Macaque ventral frontal cortex is composed of a set of anatomically heterogeneous and highly interconnected areas. Collectively, these areas have been implicated in many higher-level affective and cognitive processes, most notably the adaptive control of decision-making. Despite this appreciation, little is known about how subdivisions of ventral frontal cortex dynamically interact with each other during decision-making. Here, we assessed functional interactions between areas by analyzing the activity of thousands of single neurons recorded from eight anatomically defined subdivisions of ventral frontal cortex in macaques performing a visually guided two-choice probabilistic task for different fruit juices. We found that the onset of stimuli and reward delivery globally increased communication between all parts of ventral frontal cortex. Inter-areal communication was, however, temporally specific, occurred through unique activity subspaces between areas, and depended on the encoding of decision variables. In particular, areas 12l and 12o showed the highest connectivity with other areas while being more likely to receive information from other parts of ventral frontal cortex than to send it. This pattern of functional connectivity suggests a role for these two areas in integrating diverse sources of information during decision processes. Taken together, our work reveals the specific patterns of inter-areal communication between anatomically connected subdivisions of ventral frontal cortex that are dynamically engaged during decision-making.

Aspiration removal of orbitofrontal cortex disrupts cholinergic fibers of passage to anterior cingulate cortex in rhesus macaques

The study of anthropoid nonhuman primates has provided valuable insights into frontal cortex function in humans, as these primates share similar frontal anatomical subdivisions (Murray et al. 2011). Causal manipulation studies have been instrumental in advancing our understanding of this area. One puzzling finding is that macaques with bilateral aspiration removals of orbitofrontal cortex (OFC) are impaired on tests of cognitive flexibility and emotion regulation, whereas those with bilateral excitotoxic lesions of OFC are not (Rudebeck et al. 2013). This discrepancy is attributed to the inadvertent disruption of fibers of passage by aspiration lesions but not by excitotoxic lesions. Which fibers of passage are responsible for the impairments observed? One candidate is cholinergic fibers originating in the nucleus basalis magnocellularis (NBM) and passing nearby or through OFC on their way to other frontal cortex regions (Kitt et al. 1987). To investigate this possibility, we performed unilateral aspiration lesions of OFC in three macaques, and then compared cholinergic innervation of the anterior cingulate cortex (ACC) between hemispheres. Histological assessment revealed diminished cholinergic innervation in the ACC of hemispheres with OFC lesions relative to intact hemispheres. This finding indicates that aspiration lesions of the OFC disrupt cholinergic fibers of passage, and suggests the possibility that loss of cholinergic inputs to ACC contributes to the impairments in cognitive flexibility and emotion regulation observed after aspiration but not excitotoxic lesions of OFC.

Brain developmental and cortical connectivity changes in transgenic monkeys carrying the human-specific duplicated gene SRGAP2C

Human-specific duplicated genes contributed to phenotypic innovations during the origin of our own species, such as an enlarged brain and highly developed cognitive abilities. While prior studies on transgenic mice carrying the human-specific SRGAP2C gene have shown enhanced brain connectivity, the relevance to humans remains unclear due to the significant evolutionary gap between humans and rodents. In this study, to investigate the phenotypic outcome and underlying genetic mechanism of SRGAP2C, we generated transgenic cynomolgus macaques (Macaca fascicularis) carrying the human-specific SRGAP2C gene. Longitudinal MRI imaging revealed delayed brain development with region-specific volume changes, accompanied by altered myelination levels in the temporal and occipital regions. On a cellular level, the transgenic monkeys exhibited increased deep-layer neurons during fetal neurogenesis and delayed synaptic maturation in adolescence. Moreover, transcriptome analysis detected neotenic expression in molecular pathways related to neuron ensheathment, synaptic connections, extracellular matrix and energy metabolism. Cognitively, the transgenic monkeys demonstrated improved motor planning and execution skills. Together, our findings provide new insights into the mechanisms by which the newly evolved gene shapes the unique development and circuitry of the human brain.

An open resource combining multi-contrast MRI and microscopy in the macaque brain

Understanding brain structure and function often requires combining data across different modalities and scales to link microscale cellular structures to macroscale features of whole brain organisation. Here we introduce the BigMac dataset, a resource combining in vivo MRI, extensive postmortem MRI and multi-contrast microscopy for multimodal characterisation of a single whole macaque brain. The data spans modalities (MRI and microscopy), tissue states (in vivo and postmortem), and four orders of spatial magnitude, from microscopy images with micrometre or sub-micrometre resolution, to MRI signals on the order of millimetres. Crucially, the MRI and microscopy images are carefully co-registered together to facilitate quantitative multimodal analyses. Here we detail the acquisition, curation, and first release of the data, that together make BigMac a unique, openly-disseminated resource available to researchers worldwide. Further, we demonstrate example analyses and opportunities afforded by the data, including improvement of connectivity estimates from ultra-high angular resolution diffusion MRI, neuroanatomical insight provided by polarised light imaging and myelin-stained histology, and the joint analysis of MRI and microscopy data for reconstruction of the microscopy-inspired connectome. All data and code are made openly available.

Emotion, motivation, decision-making, the orbitofrontal cortex, anterior cingulate cortex, and the amygdala

The orbitofrontal cortex and amygdala are involved in emotion and in motivation, but the relationship between these functions performed by these brain structures is not clear. To address this, a unified theory of emotion and motivation is described in which motivational states are states in which instrumental goal-directed actions are performed to obtain rewards or avoid punishers, and emotional states are states that are elicited when the reward or punisher is or is not received. This greatly simplifies our understanding of emotion and motivation, for the same set of genes and associated brain systems can define the primary or unlearned rewards and punishers such as sweet taste or pain. Recent evidence on the connectivity of human brain systems involved in emotion and motivation indicates that the orbitofrontal cortex is involved in reward value and experienced emotion with outputs to cortical regions including those involved in language, and is a key brain region involved in depression and the associated changes in motivation. The amygdala has weak effective connectivity back to the cortex in humans, and is implicated in brainstem-mediated responses to stimuli such as freezing and autonomic activity, rather than in declarative emotion. The anterior cingulate cortex is involved in learning actions to obtain rewards, and with the orbitofrontal cortex and ventromedial prefrontal cortex in providing the goals for navigation and in reward-related effects on memory consolidation mediated partly via the cholinergic system.

Home alone: A population neuroscience investigation of brain morphology substrates

As a social species, ready exchange with peers is a pivotal asset - our "social capital". Yet, single-person households have come to pervade metropolitan cities worldwide, with unknown consequences in the long run. Here, we systematically explore the morphological manifestations associated with singular living in ∼40,000 UK Biobank participants. The uncovered population-level signature spotlights the highly associative default mode network, in addition to findings such as in the amygdala central, cortical and corticoamygdaloid nuclei groups, as well as the hippocampal fimbria and dentate gyrus. Both positive effects, equating to greater gray matter volume associated with living alone, and negative effects, which can be interpreted as greater gray matter associations with not living alone, were found across the cortex and subcortical structures Sex-stratified analyses revealed male-specific neural substrates, including somatomotor, saliency and visual systems, while female-specific neural substrates centered on the dorsomedial prefrontal cortex. In line with our demographic profiling results, the discovered neural pattern of living alone is potentially linked to alcohol and tobacco consumption, anxiety, sleep quality as well as daily TV watching. The persistent trend for solitary living will require new answers from public-health decision makers. SIGNIFICANCE STATEMENT: Living alone has profound consequences for mental and physical health. Despite this, there has been a rapid increase in single-person households worldwide, with the long-term consequences yet unknown. In the largest study of its kind, we investigate how the objective lack of everyday social interaction, through living alone, manifests in the brain. Our population neuroscience approach uncovered a gray matter signature that converged on the 'default network', alongside targeted subcortical, sex and demographic profiling analyses. The human urge for social relationships is highlighted by the evolving COVID-19 pandemic. Better understanding of how social isolation relates to the brain will influence health and social policy decision-making of pandemic planning, as well as social interventions in light of global shifts in houseful structures.

Local and global reward learning in the lateral frontal cortex show differential development during human adolescence

Reward-guided choice is fundamental for adaptive behaviour and depends on several component processes supported by prefrontal cortex. Here, across three studies, we show that two such component processes, linking reward to specific choices and estimating the global reward state, develop during human adolescence and are linked to the lateral portions of the prefrontal cortex. These processes reflect the assignment of rewards contingently to local choices, or noncontingently, to choices that make up the global reward history. Using matched experimental tasks and analysis platforms, we show the influence of both mechanisms increase during adolescence (study 1) and that lesions to lateral frontal cortex (that included and/or disconnected both orbitofrontal and insula cortex) in human adult patients (study 2) and macaque monkeys (study 3) impair both local and global reward learning. Developmental effects were distinguishable from the influence of a decision bias on choice behaviour, known to depend on medial prefrontal cortex. Differences in local and global assignments of reward to choices across adolescence, in the context of delayed grey matter maturation of the lateral orbitofrontal and anterior insula cortex, may underlie changes in adaptive behaviour.

Chronic Intermittent Ethanol Exposure Alters Behavioral Flexibility in Aged Rats Compared to Adult Rats and Modifies Protein and Protein Pathways Related to Alzheimer's Disease

Repeated excessive alcohol consumption increases the risk of developing cognitive decline and dementia. Hazardous drinking among older adults further increases such vulnerabilities. To investigate whether alcohol induces cognitive deficits in older adults, we performed a chronic intermittent ethanol exposure paradigm (ethanol or water gavage every other day 10 times) in 8-week-old young adult and 70-week-old aged rats. While spatial memory retrieval ascertained by probe trials in the Morris water maze was not significantly different between ethanol-treated and water-treated rats in both age groups after the fifth and tenth gavages, behavioral flexibility was impaired in ethanol-treated rats compared to water-treated rats in the aged group but not in the young adult group. We then examined ethanol-treatment-associated hippocampal proteomic and phosphoproteomic differences distinct in the aged rats. We identified several ethanol-treatment-related proteins, including the upregulations of the Prkcd protein level, several of its phosphosites, and its kinase activity and downregulation in the Camk2a protein level. Our bioinformatic analysis revealed notable changes in pathways involved in neurotransmission regulation, synaptic plasticity, neuronal apoptosis, and insulin receptor signaling. In conclusion, our behavioral and proteomic results identified several candidate proteins and pathways potentially associated with alcohol-induced cognitive decline in aged adults.

Prefrontal influences on the function of the neural circuitry underlying anxious temperament in primates

Anxious temperament, characterized by heightened behavioral and physiological reactivity to potential threat, is an early childhood risk factor for the later development of stress-related psychopathology. Using a well-validated nonhuman primate model, we tested the hypothesis that the prefrontal cortex (PFC) is critical in regulating the expression of primate anxiety-like behavior, as well as the function of subcortical components of the anxiety-related neural circuit. We performed aspiration lesions of a narrow 'strip' of the posterior orbitofrontal cortex (OFC) intended to disrupt both cortex and axons entering, exiting and coursing through the pOFC, particularly those of the uncinate fasciculus (UF), a white matter tract that courses adjacent to and through this region. The OFC is of particular interest as a potential regulatory region because of its extensive reciprocal connections with amygdala, other subcortical structures and other frontal lobe regions. We validated this lesion method by demonstrating marked lesion-induced decreases in the microstructural integrity of the UF, which contains most of the fibers that connect the ventral PFC with temporal lobe structures as well as with other frontal regions. While the lesions resulted in modest decreases in threat-related behavior, they substantially decreased metabolism in components of the circuit underlying threat processing. These findings provide evidence for the importance of structural connectivity between the PFC and key subcortical structures in regulating the functions of brain regions known to be involved in the adaptive and maladaptive expression of anxiety.

Chronic Intermittent Ethanol Administration during Adolescence Produces Sex Dependent Impairments in Behavioral Flexibility and Survivability

Chronic intermittent ethanol exposure during adolescence produces behavioral impairments and neurobiological changes that can last into young adulthood. One such behavioral impairment is reduced behavioral flexibility, a behavioral impairment that has been correlated with the risk for increased ethanol intake. In the current study, we investigated if chronic intermittent ethanol exposure during adolescence alters cognition, including behavioral flexibility, over a 22-month testing period. Female and male rats were treated with either 3.0 g/kg or 5.0 g/kg ethanol via gavage in a chronic intermittent fashion during adolescence and then tested every 4 to 5 months on a series of cognitive measures in the Morris water maze. Chronic intermittent ethanol selectively impaired behavioral flexibility in both female and male rats, although the pattern of results was different as a function of sex. In addition, female, but not male, rats were impaired in a short-term relearning test. Finally, male rats administered ethanol during adolescence were significantly more likely to not survive the 22-month experiment compared to female rats administered ethanol during adolescence. The current results demonstrate that adolescence is a unique period of development where chronic intermittent ethanol exposure produces long-lasting, selective cognitive impairments across the lifespan.

Anatomical and functional connectivity support the existence of a salience network node within the caudal ventrolateral prefrontal cortex

Three large-scale networks are considered essential to cognitive flexibility: the ventral and dorsal attention (VANet and DANet) and salience (SNet) networks. The ventrolateral prefrontal cortex (vlPFC) is a known component of the VANet and DANet, but there is a gap in the current knowledge regarding its involvement in the SNet. Herein, we used a translational and multimodal approach to demonstrate the existence of a SNet node within the vlPFC. First, we used tract-tracing methods in non-human primates (NHP) to quantify the anatomical connectivity strength between different vlPFC areas and the frontal and insular cortices. The strongest connections were with the dorsal anterior cingulate cortex (dACC) and anterior insula (AI) - the main cortical SNet nodes. These inputs converged in the caudal area 47/12, an area that has strong projections to subcortical structures associated with the SNet. Second, we used resting-state functional MRI (rsfMRI) in NHP data to validate this SNet node. Third, we used rsfMRI in the human to identify a homologous caudal 47/12 region that also showed strong connections with the SNet cortical nodes. Taken together, these data confirm a SNet node in the vlPFC, demonstrating that the vlPFC contains nodes for all three cognitive networks: VANet, DANet, and SNet. Thus, the vlPFC is in a position to switch between these three networks, pointing to its key role as an attentional hub. Its additional connections to the orbitofrontal, dorsolateral, and premotor cortices, place the vlPFC at the center for switching behaviors based on environmental stimuli, computing value, and cognitive control.

Atypical Neural Responses of Cognitive Flexibility in Parents of Children With Autism Spectrum Disorder

Impaired cognitive flexibility has been repeatedly demonstrated in autism spectrum disorder (ASD). There is strong evidence for genetic involvement in ASD. First-degree relatives of individuals with ASD may show mild deficits in cognitive inflexibility. The present study investigated cognitive flexibility and its neuroelectrophysiological mechanisms in first-degree relatives of individuals with ASD to assess its potential familiality. Forty-five biological parents of individuals/children with ASD (pASD) and thirty-one biological parents of typically developing individuals/children (pTD), matched by gender, age, and IQ, were enrolled. The broad autism phenotype questionnaire (BAPQ) and cognitive flexibility inventory (CFI) were used to quantitatively assess autistic traits and cognitive flexibility in daily life, respectively. The task-switching paradigm was used to evaluate the behavioral flexibility in a structured assessment situation. Event-related potentials (ERPs) induced by this paradigm were also collected. Results showed that compared with the pTD group, the pASD group had lower CFI scores (t = −2.756, p < 0.01), while both groups showed an equivalent “switch cost” in the task-switching task (p > 0.05). Compared with the pTD group, the pASD group induced greater N2 amplitude at F3, F4, Fz, and C4 (F = 3.223, p < 0.05), while P3 amplitude and latency did not differ between the two groups. In addition, there was a significant negative correlation between the CFI total scores and BAPQ total scores in the pASD group (r = −0.734, p < 0.01). After controlling for age and IQ, the N2 amplitude in the frontal lobe of pASD was negatively correlated with the CFI total scores under the repetition sequence (r = −0.304, p = 0.053). These results indicated that pASD had deficit in cognitive flexibility at the self-reported and neurological levels. The cognitive flexibility difficulties of parents of children with ASD were related to autistic traits. These findings support that cognitive flexibility is most likely a neurocognitive endophenotype of ASD, which is worthy of further investigation.

Interactions between ventrolateral prefrontal and anterior cingulate cortex during learning and behavioural change

Hypotheses and beliefs guide credit assignment - the process of determining which previous events or actions caused an outcome. Adaptive hypothesis formation and testing are crucial in uncertain and changing environments in which associations and meanings are volatile. Despite primates' abilities to form and test hypotheses, establishing what is causally responsible for the occurrence of particular outcomes remains a fundamental challenge for credit assignment and learning. Hypotheses about what surprises are due to stochasticity inherent in an environment as opposed to real, systematic changes are necessary for identifying the environment's predictive features, but are often hard to test. We review evidence that two highly interconnected frontal cortical regions, anterior cingulate cortex and ventrolateral prefrontal area 47/12o, provide a biological substrate for linking two crucial components of hypothesis-formation and testing: the control of information seeking and credit assignment. Neuroimaging, targeted disruptions, and neurophysiological studies link an anterior cingulate - 47/12o circuit to generation of exploratory behaviour, non-instrumental information seeking, and interpretation of subsequent feedback in the service of credit assignment. Our observations support the idea that information seeking and credit assignment are linked at the level of neural circuits and explain why this circuit is important for ensuring behaviour is flexible and adaptive.

Ultrasound modulation of macaque prefrontal cortex selectively alters credit assignment-related activity and behavior

Credit assignment is the association of specific instances of reward to the specific events, such as a particular choice, that caused them. Without credit assignment, choice values reflect an approximate estimate of how good the environment was when the choice was made—the global reward state—rather than exactly which outcome the choice caused. Combined transcranial ultrasound stimulation (TUS) and functional magnetic resonance imaging in macaques demonstrate credit assignment–related activity in prefrontal area 47/12o, and when this signal was disrupted with TUS, choice value representations across the brain were impaired. As a consequence, behavior was no longer guided by choice value, and decision-making was poorer. By contrast, global reward state–related activity in the adjacent anterior insula remained intact and determined decision-making after prefrontal disruption.

Viewing Ambiguous Social Interactions Increases Functional Connectivity between Frontal and Temporal Nodes of the Social Brain

Social behavior is coordinated by a network of brain regions, including those involved in the perception of social stimuli and those involved in complex functions, such as inferring perceptual and mental states and controlling social interactions. The properties and function of many of these regions in isolation are relatively well understood, but less is known about how these regions interact while processing dynamic social interactions. To investigate whether the functional connectivity between brain regions is modulated by social context, we collected fMRI data from male monkeys (Macaca mulatta) viewing videos of social interactions labeled as "affiliative," "aggressive," or "ambiguous." We show activation related to the perception of social interactions along both banks of the superior temporal sulcus, parietal cortex, medial and lateral frontal cortex, and the caudate nucleus. Within this network, we show that fronto-temporal functional connectivity is significantly modulated by social context. Crucially, we link the observation of specific behaviors to changes in functional connectivity within our network. Viewing aggressive behavior was associated with a limited increase in temporo-temporal and a weak increase in cingulate-temporal connectivity. By contrast, viewing interactions where the outcome was uncertain was associated with a pronounced increase in temporo-temporal, and cingulate-temporal functional connectivity. We hypothesize that this widespread network synchronization occurs when cingulate and temporal areas coordinate their activity when more difficult social inferences are being made.SIGNIFICANCE STATEMENT Processing social information from our environment requires the activation of several brain regions, which are concentrated within the frontal and temporal lobes. However, little is known about how these areas interact to facilitate the processing of different social interactions. Here we show that functional connectivity within and between the frontal and temporal lobes is modulated by social context. Specifically, we demonstrate that viewing social interactions where the outcome was unclear is associated with increased synchrony within and between the cingulate cortex and temporal cortices. These findings suggest that the coordination between the cingulate and temporal cortices is enhanced when more difficult social inferences are being made.

Expression of human-specific ARHGAP11B in mice leads to neocortex expansion and increased memory flexibility

Neocortex expansion during human evolution provides a basis for our enhanced cognitive abilities. Yet, which genes implicated in neocortex expansion are actually responsible for higher cognitive abilities is unknown. The expression of human-specific ARHGAP11B in embryonic/foetal mouse, ferret and marmoset neocortex was previously found to promote basal progenitor proliferation, upper-layer neuron generation and neocortex expansion during development, features commonly thought to contribute to increased cognitive abilities. However, a key question is whether this phenotype persists into adulthood and if so, whether cognitive abilities are indeed increased. Here, we generated a transgenic mouse line with physiological ARHGAP11B expression that exhibits increased neocortical size and upper-layer neuron numbers persisting into adulthood. Adult ARHGAP11B-transgenic mice showed altered neurobehaviour, notably increased memory flexibility and a reduced anxiety level. Our data are consistent with the notion that neocortex expansion by ARHGAP11B, a gene implicated in human evolution, underlies some of the altered neurobehavioural features observed in the transgenic mice, such as the increased memory flexibility, a neocortex-associated trait, with implications for the increase in cognitive abilities during human evolution.

Defining an orbitofrontal compass: Functional and anatomical heterogeneity across anterior-posterior and medial-lateral axes

The orbitofrontal cortex (OFC) plays a critical role in the flexible control of behaviors and has been the focus of increasing research interest. However, there have been a number of controversies around the exact theoretical role of the OFC. One potential source of these issues is the comparison of evidence from different studies, particularly across species, which focus on different specific sub-regions within the OFC. Furthermore, there is emerging evidence that there may be functional diversity across the OFC which may account for these theoretical differences. Therefore, in this review we consider evidence supporting functional heterogeneity within the OFC and how it relates to underlying anatomical heterogeneity. We highlight the importance of anatomical and functional distinctions within the traditionally defined OFC subregions across the medial-lateral axis, which are often not differentiated for practical and historical reasons. We then consider emerging evidence of even finer-grained distinctions within these defined subregions along the anterior-posterior axis. These fine-grained anatomical considerations reveal a pattern of dissociable, but often complementary functions within the OFC. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The orbitofrontal cortex in temporal cognition

One of the most important factors in decision-making is estimating the value of available options. Subregions of the prefrontal cortex, including the orbitofrontal cortex (OFC), have been deemed essential for this process. Value computations require a complex integration across numerous dimensions, including, reward magnitude, effort, internal state, and time. The importance of the temporal dimension is well illustrated by temporal discounting tasks, in which subjects select between smaller-sooner versus larger-later rewards. The specific role of OFC in telling time and integrating temporal information into decision-making remains unclear. Based on the current literature, in this review we reevaluate current theories of OFC function, accounting for the influence of time. Incorporating temporal information into value estimation and decision-making requires distinct, yet interrelated, forms of temporal information including the ability to tell time, represent time, create temporal expectations, and the ability to use this information for optimal decision-making in a wide range of tasks, including temporal discounting and wagering. We use the term "temporal cognition" to refer to the integrated use of these different aspects of temporal information. We suggest that the OFC may be a critical site for the integration of reward magnitude and delay, and thus important for temporal cognition. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Impact of internal and external factors on prosocial choices in rhesus macaques

While traditional economic models assume that agents are self-interested, humans and most non-human primates are social species. Therefore, many of decisions they make require the integration of information about other social agents. This study asks to what extent information about social status and the social context in which decisions are taken impact on reward-guided decisions in rhesus macaques. We tested 12 monkeys of varying dominance status in several experimental versions of a two-choice task in which reward could be delivered to self only, only another monkey, both the self and another monkey, or neither. Results showed dominant animals were more prone to make prosocial choices than subordinates, but only when the decision was between a reward for self only and a reward for both self and other. If the choice was between a reward for self only and a reward for other only, no animal expressed altruistic behaviour. Finally, prosocial choices were true social decisions as they were strikingly reduced when the social partner was replaced by a non-social object. These results showed that as in humans, rhesus macaques' social decisions are adaptive and modulated by social status and the cost associated with being prosocial. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.

Global reward state affects learning and activity in raphe nucleus and anterior insula in monkeys

People and other animals learn the values of choices by observing the contingencies between them and their outcomes. However, decisions are not guided by choice-linked reward associations alone; macaques also maintain a memory of the general, average reward rate - the global reward state - in an environment. Remarkably, global reward state affects the way that each choice outcome is valued and influences future decisions so that the impact of both choice success and failure is different in rich and poor environments. Successful choices are more likely to be repeated but this is especially the case in rich environments. Unsuccessful choices are more likely to be abandoned but this is especially likely in poor environments. Functional magnetic resonance imaging (fMRI) revealed two distinct patterns of activity, one in anterior insula and one in the dorsal raphe nucleus, that track global reward state as well as specific outcome events.