Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia

Altered dynamic large-scale brain networks and combined machine learning in primary angle-closure glaucoma

Primary angle-closure glaucoma (PACG) is a severe and irreversible blinding eye disease characterized by progressive retinal ganglion cell death. However, prior research has predominantly focused on static brain activity changes, neglecting the exploration of how PACG impacts the dynamic characteristics of functional brain networks. This study enrolled forty-four patients diagnosed with PACG and forty-four age, gender, and education level-matched healthy controls (HCs). The study employed Independent Component Analysis (ICA) techniques to extract resting-state networks (RSNs) from resting-state functional magnetic resonance imaging (rs-fMRI) data. Subsequently, the RSNs was utilized as the basis for examining and comparing the functional connectivity variations within and between the two groups of resting-state networks. To further explore, a combination of sliding time window and k-means cluster analyses identified seven stable and repetitive dynamic functional network connectivity (dFNC) states. This approach facilitated the comparison of dynamic functional network connectivity and temporal metrics between PACG patients and HCs for each state. Subsequently, a support vector machine (SVM) model leveraging functional connectivity (FC) and FNC was applied to differentiate PACG patients from HCs. Our study underscores the presence of modified functional connectivity within large-scale brain networks and abnormalities in dynamic temporal metrics among PACG patients. By elucidating the impact of changes in large-scale brain networks on disease evolution, researchers may enhance the development of targeted therapies and interventions to preserve vision and cognitive function in PACG.

Humans actively reconfigure neural task states

The ability to switch between different tasks is a core component of adaptive cognition, but a mechanistic understanding of this capacity has remained elusive. Longstanding questions over whether task switching requires active preparation remain hotly contested, in large part due to the difficulty of inferring preparatory dynamics from behavior or time-locked neuroimaging. We make progress on this debate by quantifying neural task representations using high-dimensional linear dynamical systems fit to human electroencephalographic recordings. We find that these dynamical systems have high predictive accuracy and reveal neural signatures of active preparation that are shared with task-optimized neural networks. These findings inform a classic debate about how we control our cognition, and offer a promising new paradigm for neuroimaging analysis.

Neural correlates of working memory training: An fMRI meta-analysis

Working memory (WM) can be improved by cognitive training. Numerous studies examined neural mechanisms underlying WM training, although with differing conclusions. Therefore, we conducted a meta-analysis to examine the neural substrates underlying WM training in healthy adults. Findings from global analyses showed substantial neural changes in the frontoparietal and subcortical regions. Results from training dosage analyses of WM training showed that shorter WM training could produce neural changes in the frontoparietal regions, whereas longer WM training could produce changes in the subcortical regions (striatum, anterior cingulate cortex, and insula). WM training-induced neural changes were also moderated by the type of training task, with updating tasks inducing neural changes in more regions than maintenance tasks. Overall, these results indicate that the neural changes associated with WM training occur in the frontoparietal network and dopamine-related brain areas, extending previous meta-analyses on WM training and advancing our understanding of the neural underpinnings of WM training effects.

A transient high-dimensional geometry affords stable conjunctive subspaces for efficient action selection

Flexible action selection requires cognitive control mechanisms capable of mapping the same inputs to different output actions depending on the context. From a neural state-space perspective, this requires a control representation that separates similar input neural states by context. Additionally, for action selection to be robust and time-invariant, information must be stable in time, enabling efficient readout. Here, using EEG decoding methods, we investigate how the geometry and dynamics of control representations constrain flexible action selection in the human brain. Participants performed a context-dependent action selection task. A forced response procedure probed action selection different states in neural trajectories. The result shows that before successful responses, there is a transient expansion of representational dimensionality that separated conjunctive subspaces. Further, the dynamics stabilizes in the same time window, with entry into this stable, high-dimensional state predictive of individual trial performance. These results establish the neural geometry and dynamics the human brain needs for flexible control over behavior.

Rapid context inference in a thalamocortical model using recurrent neural networks

Cognitive flexibility is a fundamental ability that enables humans and animals to exhibit appropriate behaviors in various contexts. The thalamocortical interactions between the prefrontal cortex (PFC) and the mediodorsal thalamus (MD) have been identified as crucial for inferring temporal context, a critical component of cognitive flexibility. However, the neural mechanism responsible for context inference remains unknown. To address this issue, we propose a PFC-MD neural circuit model that utilizes a Hebbian plasticity rule to support rapid, online context inference. Specifically, the model MD thalamus can infer temporal contexts from prefrontal inputs within a few trials. This is achieved through the use of PFC-to-MD synaptic plasticity with pre-synaptic traces and adaptive thresholding, along with winner-take-all normalization in the MD. Furthermore, our model thalamus gates context-irrelevant neurons in the PFC, thus facilitating continual learning. We evaluate our model performance by having it sequentially learn various cognitive tasks. Incorporating an MD-like component alleviates catastrophic forgetting of previously learned contexts and demonstrates the transfer of knowledge to future contexts. Our work provides insight into how biological properties of thalamocortical circuits can be leveraged to achieve rapid context inference and continual learning.

Thalamocortical contributions to hierarchical cognitive control

Cognitive flexibility relies on hierarchically structured task representations that organize task contexts, relevant environmental features, and subordinate decisions. Despite ongoing interest in the human thalamus, its role in cognitive control has been understudied. This study explored thalamic representation and thalamocortical interactions that contribute to hierarchical cognitive control in humans. We found that several thalamic nuclei, including the anterior, mediodorsal, ventrolateral, and pulvinar nuclei, exhibited stronger evoked responses when subjects switch between task contexts. Decoding analysis revealed that thalamic activity encodes task contexts within the hierarchical task representations. To determine how thalamocortical interactions contribute to task representations, we developed a thalamocortical functional interaction model to predict task-related cortical representation. This data-driven model outperformed comparison models, particularly in predicting activity patterns in cortical regions that encode context representations. Collectively, our findings highlight the significant contribution of thalamic activity and thalamocortical interactions for contextually guided hierarchical cognitive control.

Lateral prefrontal cortex controls interplay between working memory and actions

Humans must often keep multiple task goals in mind, at different levels of priority and immediacy, while also interacting with the environment. We might need to remember information for an upcoming task while engaged in more immediate actions. Consequently, actively maintained working memory (WM) content may bleed into ongoing but unrelated motor behavior. Here, we experimentally test the impact of WM maintenance on action execution, and we transcranially stimulate lateral prefrontal cortex (PFC) to parse its functional contributions to WM-motor interactions. We first created a task scenario wherein human participants (both sexes) executed cued hand movements during WM maintenance. We manipulated the compatibility between WM and movement goals at the trial level and the statistical likelihood that the two would be compatible at the block level. We found that remembering directional words (e.g., 'left', 'down') biased the trajectory and speed of hand movements that occurred during the WM delay, but the bias was dampened in blocks when WM content predictably conflicted with movement goals. Then we targeted left lateral PFC with two different transcranial magnetic stimulation (TMS) protocols before participants completed the task. We found that an intermittent theta-burst protocol, which is thought to be excitatory, dampened sensitivity to block-level control demands (i.e., proactive control), while a continuous theta-burst protocol, which is thought to be inhibitory, dampened adaptation to trial-by-trial conflict (i.e., reactive control). Therefore, lateral PFC is involved in controlling the interplay between WM content and manual action, but different PFC mechanisms may support different time-scales of adaptive control.

Dynamic layer-specific processing in the prefrontal cortex during working memory

The dorsolateral prefrontal cortex (dlPFC) is reliably engaged in working memory (WM) and comprises different cytoarchitectonic layers, yet their functional role in human WM is unclear. Here, participants completed a delayed-match-to-sample task while undergoing functional magnetic resonance imaging (fMRI) at ultra-high resolution. We examine layer-specific activity to manipulations in WM load and motor response. Superficial layers exhibit a preferential response to WM load during the delay and retrieval periods of a WM task, indicating a lamina-specific activation of the frontoparietal network. Multivariate patterns encoding WM load in the superficial layer dynamically change across the three periods of the task. Last, superficial and deep layers are non-differentially involved in the motor response, challenging earlier findings of a preferential deep layer activation. Taken together, our results provide new insights into the functional laminar circuitry of the dlPFC during WM and support a dynamic account of dlPFC coding.

Valence-dependent dopaminergic modulation during reversal learning in Parkinson's disease: A neurocomputational approach

Reinforcement learning, crucial for behavior in dynamic environments, is driven by rewards and punishments, modulated by dopamine (DA) changes. This study explores the dopaminergic system's influence on learning, particularly in Parkinson's disease (PD), where medication leads to impaired adaptability. Highlighting the role of tonic DA in signaling the valence of actions, this research investigates how DA affects response vigor and decision-making in PD. DA not only influences reward and punishment learning but also indicates the cognitive effort level and risk propensity in actions, which are essential for understanding and managing PD symptoms. In this work, we adapt our existing neurocomputational model of basal ganglia (BG) to simulate two reversal learning tasks proposed by Cools et al. We first optimized a Hebb rule for both probabilistic and deterministic reversal learning, conducted a sensitivity analysis (SA) on parameters related to DA effect, and compared performances between three groups: PD-ON, PD-OFF, and control subjects. In our deterministic task simulation, we explored switch error rates after unexpected task switches and found a U-shaped relationship between tonic DA levels and switch error frequency. Through SA, we classify these three groups. Then, assuming that the valence of the stimulus affects the tonic levels of DA, we were able to reproduce the results by Cools et al. As for the probabilistic task simulation, our results are in line with clinical data, showing similar trends with PD-ON, characterized by higher tonic DA levels that are correlated with increased difficulty in both acquisition and reversal tasks. Our study proposes a new hypothesis: valence, signaled by tonic DA levels, influences learning in PD, confirming the uncorrelation between phasic and tonic DA changes. This hypothesis challenges existing paradigms and opens new avenues for understanding cognitive processes in PD, particularly in reversal learning tasks.

A shared temporal window of integration across cognitive control and reinforcement learning paradigms: A correlational study

Cognitive control refers to the ability to override prepotent response tendencies to achieve goal-directed behavior. On the other hand, reinforcement learning refers to the learning of actions through feedback and reward. Although cognitive control and reinforcement learning are often viewed as opposing forces in driving behavior, recent theories have emphasized possible similarities in their underling processes. With this study, we aimed to investigate whether a similar time window of integration could be observed during the learning of control on the one hand, and the learning rate in reinforcement learning paradigms on the other. To this end, we performed a correlational analysis on a large public dataset (n = 522) including data from two reinforcement learning tasks, i.e., a probabilistic selection task and a probabilistic Wisconsin Card Sorting Task (WCST), and data from a classic conflict task (i.e., the Stroop task). Results showed expected correlations between the time scale of control indices and learning rate in the probabilistic WCST. Moreover, the learning-rate parameters of the two reinforcement learning tasks did not correlate with each other. Together, these findings suggest a reliance on a shared learning mechanism between these two traditionally distinct domains, while at the same time emphasizing that value updating processes can still be very task-specific. We speculate that updating processes in the Stroop and WCST may be more related because both tasks require task-specific updating of stimulus features (e.g., color, word meaning, pattern, shape), as opposed to stimulus identity.

Flexible control of sequence working memory in the macaque frontal cortex

To memorize a sequence, one must serially bind each item to its rank order. How the brain controls a given input to bind its associated order in sequence working memory (SWM) remains unexplored. Here, we investigated the neural representations underlying SWM control using electrophysiological recordings in the frontal cortex of macaque monkeys performing forward and backward SWM tasks. Separate and generalizable low-dimensional subspaces for sensory and memory information were found within the same frontal circuitry, and SWM control was reflected in these neural subspaces' organized dynamics. Each item at each rank was sequentially entered into a common sensory subspace and, depending on forward or backward task requirement, flexibly and timely sent into rank-selective SWM subspaces. Neural activity in these SWM subspaces faithfully predicted the recalled item and order information in single error trials. Thus, compositional neural population codes with well-orchestrated dynamics in frontal cortex support the flexible control of SWM.

From Cognitive Function to Treatment Efficacy in Obsessive-Compulsive Disorder: Insights from a Multidimensional Meta-Analytic Approach

Meta-analysis is a statistical tool used to combine and synthesise the results of multiple independent studies on a particular topic. To this end, researchers isolate important moderators and mediators to investigate their influence on outcomes. This paper introduces a novel approach to meta-analysis, known as multidimensional meta-analysis (mi-MA), to study memory performance in those with obsessive-compulsive disorder (OCD). Unlike traditional meta-analyses, mi-MA allows researchers to extract multiple data points (e.g., using different measures) from single studies and groups of participants, facilitating the exploration of relationships between various moderators while avoiding multicollinearity issues. Therefore, in the first instance, we outline the use of the mi-MA approach to quantify the impact of complex models of memory performance in individuals with OCD. This approach provides novel insights into the complex relationship between various factors affecting memory in people with OCD. By showcasing the effectiveness of mi-MA in analysing intricate data and modelling complex phenomena, the paper establishes it as a valuable tool for researchers exploring multifaceted phenomena, both within OCD research and beyond.

Bridging flexible goal-directed cognition and consciousness: The Goal-Aligning Representation Internal Manipulation theory

Goal-directed manipulation of internal representations is a key element of human flexible behaviour, while consciousness is commonly associated with higher-order cognition and human flexibility. Current perspectives have only partially linked these processes, thus preventing a clear understanding of how they jointly generate flexible cognition and behaviour. Moreover, these limitations prevent an effective exploitation of this knowledge for technological scopes. We propose a new theoretical perspective that extends our 'three-component theory of flexible cognition' toward higher-order cognition and consciousness, based on the systematic integration of key concepts from Cognitive Neuroscience and AI/Robotics. The theory proposes that the function of conscious processes is to support the alignment of representations with multi-level goals. This higher alignment leads to more flexible and effective behaviours. We analyse here our previous model of goal-directed flexible cognition (validated with more than 20 human populations) as a starting GARIM-inspired model. By bridging the main theories of consciousness and goal-directed behaviour, the theory has relevant implications for scientific and technological fields. In particular, it contributes to developing new experimental tasks and interpreting clinical evidence. Finally, it indicates directions for improving machine learning and robotics systems and for informing real-world applications (e.g., in digital-twin healthcare and roboethics).

The neuroscience of active learning and direct instruction

Throughout the educational system, students experiencing active learning pedagogy perform better and fail less than those taught through direct instruction. Can this be ascribed to differences in learning from a neuroscientific perspective? This review examines mechanistic, neuroscientific evidence that might explain differences in cognitive engagement contributing to learning outcomes between these instructional approaches. In classrooms, direct instruction comprehensively describes academic content, while active learning provides structured opportunities for learners to explore, apply, and manipulate content. Synaptic plasticity and its modulation by arousal or novelty are central to all learning and both approaches. As a form of social learning, direct instruction relies upon working memory. The reinforcement learning circuit, associated agency, curiosity, and peer-to-peer social interactions combine to enhance motivation, improve retention, and build higher-order-thinking skills in active learning environments. When working memory becomes overwhelmed, additionally engaging the reinforcement learning circuit improves retention, providing an explanation for the benefits of active learning. This analysis provides a mechanistic examination of how emerging neuroscience principles might inform pedagogical choices at all educational levels.

A Basal Ganglia model for understanding working memory functions in healthy and Parkinson's conditions

Working memory (WM) is considered as the scratchpad for reading, writing, and processing information necessary to perform cognitive tasks. The Basal Ganglia (BG) and Prefrontal Cortex are two important parts of the brain that are involved in WM functions, and both structures receive projections from dopaminergic nuclei. In this modelling study, we specifically focus on modelling the WM functions of the BG, the WM deficits in Parkinson's disease (PD) conditions, and the impact of dopamine deficiency on different kinds of WM functions. Though there are many experimental and modelling studies of WM properties, there is a paucity of models of the BG that provide insights into the contributions of the BG in WM functions. The proposed model of BG uses bistable flip-flop neurons to model striatal up-down neurons, a network of nonlinear oscillators to model the oscillations of the Indirect Pathway of BG and race-model for action selection. Five different WM tasks are used to demonstrate the generalisation ability of the proposed model. Experimental data from the four tasks are compared with model performance in both control and PD conditions. The model is extended to predict the response time of subjects and in the PD version of the model, the effect of dopaminergic medication on WM performance is also simulated. The proposed model of BG is a unified model that can explain the WM functions of the BG over a wide variety of tasks in both normal and PD conditions, and can be used to understand why specific WM functions are impaired whereas others remain intact in PD.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-023-10056-y.

Is working memory domain-general or domain-specific?

Given the fundamental role of working memory (WM) in all domains of cognition, a central question has been whether WM is domain-general. However, the term 'domain-general' has been used in different, and sometimes misleading, ways. By reviewing recent evidence and biologically plausible models of WM, we show that the level of domain-generality varies substantially between three facets of WM: in terms of computations, WM is largely domain-general. In terms of neural correlates, it contains both domain-general and domain-specific elements. Finally, in terms of application, it is mostly domain-specific. This variance encourages a shift of focus towards uncovering domain-general computational principles and away from domain-general approaches to the analysis of individual differences and WM training, favoring newer perspectives, such as training-as-skill-learning.

Dynamic changes in task preparation in a multi-task environment: The task transformation paradigm

A key element of human flexible behavior concerns the ability to continuously predict and prepare for sudden changes in tasks or actions. Here, we tested whether people can dynamically modulate task preparation processes and decision-making strategies when the identity of a to-be-performed task becomes uncertain. To this end, we developed a new paradigm where participants need to prepare for one of nine tasks on each trial. Crucially, in some blocks, the task being prepared could suddenly shift to a different task after a longer cue-target interval, by changing either the stimulus category or categorization rule that defined the initial task. We found that participants were able to dynamically modulate task preparation in the face of this task uncertainty. A second experiment shows that these changes in behavior were not simply a function of decreasing task expectancy, but rather of increasing switch expectancy. Finally, in the third and fourth experiment, we demonstrate that these dynamic modulations can be applied in a compositional manner, depending on whether either only the stimulus category or categorization rule would be expected to change.

Toward the Emergence of Intelligent Control: Episodic Generalization and Optimization

Human cognition is unique in its ability to perform a wide range of tasks and to learn new tasks quickly. Both abilities have long been associated with the acquisition of knowledge that can generalize across tasks and the flexible use of that knowledge to execute goal-directed behavior. We investigate how this emerges in a neural network by describing and testing the Episodic Generalization and Optimization (EGO) framework. The framework consists of an episodic memory module, which rapidly learns relationships between stimuli; a semantic pathway, which more slowly learns how stimuli map to responses; and a recurrent context module, which maintains a representation of task-relevant context information, integrates this over time, and uses it both to recall context-relevant memories (in episodic memory) and to bias processing in favor of context-relevant features and responses (in the semantic pathway). We use the framework to address empirical phenomena across reinforcement learning, event segmentation, and category learning, showing in simulations that the same set of underlying mechanisms accounts for human performance in all three domains. The results demonstrate how the components of the EGO framework can efficiently learn knowledge that can be flexibly generalized across tasks, furthering our understanding of how humans can quickly learn how to perform a wide range of tasks-a capability that is fundamental to human intelligence.

Encoding-related Brain Activity Predicts Subsequent Trial-level Control of Proactive Interference in Working Memory

Proactive interference (PI) appears when familiar information interferes with newly acquired information and is a major cause of forgetting in working memory. It has been proposed that encoding of item-context associations might help mitigate familiarity-based PI. Here, we investigate whether encoding-related brain activation could predict subsequent level of PI at retrieval using trial-specific parametric modulation. Participants were scanned with event-related fMRI while performing a 2-back working memory task with embedded 3-back lures designed to induce PI. We found that the ability to control interference in working memory was modulated by level of activation in the left inferior frontal gyrus, left hippocampus, and bilateral caudate nucleus during encoding. These results provide insight to the processes underlying control of PI in working memory and suggest that encoding of temporal context details support subsequent interference control.

Neurophysiological effective network connectivity supports a threshold-dependent management of dynamic working memory gating

To facilitate goal-directed actions, effective management of working memory (WM) is crucial, involving a hypothesized WM "gating mechanism." We investigate the underlying neural basis through behavioral modeling and connectivity assessments between neuroanatomical regions linked to theta, alpha, and beta frequency bands. We found opposing, threshold-dependent mechanisms governing WM gate opening and closing. Directed beta band connectivity in the parieto-frontal and parahippocampal-occipital networks was crucial for threshold-dependent WM gating dynamics. Fronto-parahippocampal connectivity in the theta band was also notable for both gating processes, although weaker than that in the beta band. Distinct roles for theta, beta, and alpha bands emerge in maintaining information in WM and shielding against interference, whereby alpha band activity likely acts as a "gatekeeper" supporting processes reflected by beta and theta band activity. The study shows that the decision criterion for WM gate opening/closing relies on concerted interplay within neuroanatomical networks defined by beta and theta band activities.

Working memory gating in obesity: Insights from a case-control fMRI study

Computational models and neurophysiological data propose that a 'gating mechanism' coordinates distractor-resistant maintenance and flexible updating of working memory contents: While maintenance of information is mainly implemented in the prefrontal cortex, updating of information is signaled by phasic increases in dopamine in the striatum. Previous literature demonstrates structural and functional alterations in these brain areas, as well as differential dopamine transmission among individuals with obesity, suggesting potential impairments in these processes. To test this hypothesis, we conducted an observational case-control fMRI study, dividing participants into groups with and without obesity based on their BMI. We probed maintenance and updating of working memory contents using a modified delayed match to sample task and investigated the effects of SNPs related to the dopaminergic system. While the task elicited the anticipated brain responses, our findings revealed no evidence for group differences in these two processes, neither at the neural level nor behaviorally. However, depending on Taq1A genotype, which affects dopamine receptor density in the striatum, participants with obesity performed worse on the task. In conclusion, this study does not support the existence of overall obesity-related differences in working memory gating. Instead, we propose that potentially subtle alterations may manifest specifically in individuals with a 'vulnerable' genotype.

Wagers for work: Decomposing the costs of cognitive effort

Some aspects of cognition are more taxing than others. Accordingly, many people will avoid cognitively demanding tasks in favor of simpler alternatives. Which components of these tasks are costly, and how much, remains unknown. Here, we use a novel task design in which subjects request wages for completing cognitive tasks and a computational modeling procedure that decomposes their wages into the costs driving them. Using working memory as a test case, our approach revealed that gating new information into memory and protecting against interference are costly. Critically, other factors, like memory load, appeared less costly. Other key factors which may drive effort costs, such as error avoidance, had minimal influence on wage requests. Our approach is sensitive to individual differences, and could be used in psychiatric populations to understand the true underlying nature of apparent cognitive deficits.

From Tripping and Falling to Ruminating and Worrying: A Meta-Control Account of Repetitive Negative Thinking

Repetitive negative thinking (RNT) is a transdiagnostic construct that encompasses rumination and worry, yet what precisely is shared between rumination and worry is unclear. To clarify this, we develop a meta-control account of RNT. Meta-control refers to the reinforcement and control of mental behavior via similar computations as reinforce and control motor behavior. We propose rumination and worry are coarse terms for failure in meta-control, just as tripping and falling are coarse terms for failure in motor control. We delineate four meta-control stages and risk factors increasing the chance of failure at each, including open-ended thoughts (stage 1), individual differences influencing subgoal execution (stage 2) and switching (stage 3), and challenges inherent to learning adaptive mental behavior (stage 4). Distinguishing these stages therefore elucidates diverse processes that lead to the same behavior of excessive RNT. Our account also subsumes prominent clinical accounts of RNT into a computational cognitive neuroscience framework.

Self-prioritization in working memory gating

Working memory (WM) involves a dynamic interplay between temporary maintenance and updating of goal-relevant information. The balance between maintenance and updating is regulated by an input-gating mechanism that determines which information should enter WM (gate opening) and which should be kept out (gate closing). We investigated whether updating and gate opening/closing are differentially sensitive to the kind of information to be encoded and maintained in WM. Specifically, since the social salience of a stimulus is known to affect cognitive performance, we investigated if self-relevant information differentially impacts maintenance, updating, or gate opening/closing. Participants first learned to associate two neutral shapes with two social labels (i.e., "you" vs. "stranger"), respectively. Subsequently they performed the reference-back paradigm, a well-established WM task that disentangles WM updating, gate opening, and gate closing. Crucially, the shapes previously associated with the self or a stranger served as target stimuli in the reference-back task. We replicated the typical finding of a repetition benefit when consecutive trials require opening the gate to WM. In Study 1 (N = 45) this advantage disappeared when self-associated stimuli were recently gated into WM and immediately needed to be replaced by stranger-associated stimuli. However, this was not replicated in a larger sample (Study 2; N = 90), where a repetition benefit always occurred on consecutive gate-opening trials. Overall, our results do not provide evidence that the self-relevance of stimuli modulates component processes of WM. We discuss possible reasons for this null finding, including the importance of continuous reinstatement and task-relevance of the shape-label associations.

Exploring the role of working memory gate opening process in creativity: An ERP study using the reference-back paradigm

We investigated the relationship between the gate opening process of working memory and an individual's proficiency in divergent (DT) and convergent thinking (CT) using the reference-back paradigm. Event-related potentials and reaction times were measured across groups with varying DT (N = 40, 27.35 ± 5.05 years) and CT levels (N = 40, 27.88 ± 4.95 years). Based on the role of striatal dopamine in supporting cognitive flexibility, which facilitates DT, and considering the significance of phasic dopamine activity as the gate opening signal originating from the basal ganglia, we assumed that the gate opening process may contribute differently to DT and CT. Despite the absence of behavioural differences in gate opening costs, distinct neural patterns emerged. In the early time windows (P1, N1), gate opening effects were detected in both DT and CT groups, with a notable interaction influenced by the level of DT, resulting in significant effects within the lower DT group. The P2 component showed a gate opening effect only in the higher DT group. In the P3 time window, the process unfolded comparably in all groups. Our results suggest that groups with different levels of convergent thinking (based on Matrix reasoning) and those with lower DT (based on Creativity Index) tend to select and activate the prefrontal cortex representation containing the required task information at an earlier stage, compared to those with better DT. This could be beneficial especially in the early phase of idea generation, as more elements become available to create associations and original ideas.

The influence of working memory and processing speed on other aspects of cognitive functioning in de novo Parkinson's disease: Initial findings from network modelling and graph theory

Deficits in working memory (WM) and processing speed (PS) are thought to undermine other cognitive functions in de novo Parkinson's disease (dnPD). However, these interrelationships are only partially understood. This study investigated whether there are stronger relationships between verbal WM and verbal episodic memory encoding and retrieval, whether verbal WM and PS have a greater influence on other aspects of cognitive functioning, and whether the overall strength of interrelationships among several cognitive functions differs in dnPD compared to health. Data for 198 healthy controls (HCs) and 293 dnPD patients were analysed. Participants completed a neuropsychological battery probing verbal WM, PS, verbal episodic memory, semantic memory, language and visuospatial functioning. Deficit analysis, network modelling and graph theory were combined to compare the groups. Results suggested that verbal WM performance, while slightly impaired, was more strongly associated with measures of verbal episodic memory encoding and retrieval, as well as other measured cognitive functions in the dnPD network model compared to the HC network model. PS task performance was impaired and more strongly associated with other neuropsychological task scores in the dnPD model. Associations among task scores were stronger overall in the dnPD model. Together, these results provide further evidence that WM and PS are important influences on the other aspects of cognitive functioning measured in this study in dnPD. Moreover, they provide novel evidence that verbal WM and PS might bear greater influence on the other measured cognitive functions and that these functions are more strongly intertwined in dnPD compared to health.

Exploring the dynamic interplay between learning and working memory within various cognitive contexts

Introduction

The intertwined relationship between reinforcement learning and working memory in the brain is a complex subject, widely studied across various domains in neuroscience. Research efforts have focused on identifying the specific brain areas responsible for these functions, understanding their contributions in accomplishing the related tasks, and exploring their adaptability under conditions such as cognitive impairment or aging.

Methods

Numerous models have been introduced to formulate either these two subsystems of reinforcement learning and working memory separately or their combination and relationship in executing cognitive tasks. This study adopts the RLWM model as a computational framework to analyze the behavioral parameters of subjects with varying cognitive abilities due to age or cognitive status. A related RLWM task is employed to assess a group of subjects across different age groups and cognitive abilities, as measured by the Montreal Cognitive Assessment tool (MoCA).

Results

Analysis reveals a decline in overall performance accuracy and speed with differing age groups (young vs. middle-aged). Significant differences are observed in model parameters such as learning rate, WM decay, and decision noise. Furthermore, among the middle-aged group, distinctions emerge between subjects categorized as normal vs. MCI based on MoCA scores, notably in speed, performance accuracy, and decision noise.

Emergence of syntax and word prediction in an artificial neural circuit of the cerebellum

The cerebellum, interconnected with the cerebral neocortex, plays a vital role in human-characteristic cognition such as language processing, however, knowledge about the underlying circuit computation of the cerebellum remains very limited. To gain a better understanding of the computation underlying cerebellar language processing, we developed a biologically constrained cerebellar artificial neural network (cANN) model, which implements the recently identified cerebello-cerebellar recurrent pathway. We found that while cANN acquires prediction of future words, another function of syntactic recognition emerges in the middle layer of the prediction circuit. The recurrent pathway of the cANN was essential for the two language functions, whereas cANN variants with further biological constraints preserved these functions. Considering the uniform structure of cerebellar circuitry across all functional domains, the single-circuit computation, which is the common basis of the two language functions, can be generalized to fundamental cerebellar functions of prediction and grammar-like rule extraction from sequences, that underpin a wide range of cerebellar motor and cognitive functions. This is a pioneering study to understand the circuit computation of human-characteristic cognition using biologically-constrained ANNs.

Out of control: computational dynamic control dysfunction in stress- and anxiety-related disorders

Control theory, which has played a central role in technological progress over the last 150 years, has also yielded critical insights into biology and neuroscience. Recently, there has been a surging interest in integrating control theory with computational psychiatry. Here, we review the state of the field of using control theory approaches in computational psychiatry and show that recent research has mapped a neural control circuit consisting of frontal cortex, parietal cortex, and the cerebellum. This basic feedback control circuit is modulated by estimates of reward and cost via the basal ganglia as well as by arousal states coordinated by the insula, dorsal anterior cingulate cortex, amygdala, and locus coeruleus. One major approach within the broader field of control theory, known as proportion-integral-derivative (PID) control, has shown promise as a model of human behavior which enables precise and reliable estimates of underlying control parameters at the individual level. These control parameters correlate with self-reported fear and with both structural and functional variation in affect-related brain regions. This suggests that dysfunctional engagement of stress and arousal systems may suboptimally modulate parameters of domain-general goal-directed control algorithms, impairing performance in complex tasks involving movement, cognition, and affect. Future directions include clarifying the causal role of control deficits in stress- and anxiety-related disorders and developing clinically useful tools based on insights from control theory.

Neural correlates of fine motor grasping skills: Longitudinal insights into motor cortex activation using fNIRS

BACKGROUND

Motor learning is essential for performing specific tasks and progresses through distinct stages, including the rapid learning phase (initial skill acquisition), the consolidation phase (skill refinement), and the stable performance phase (skill mastery and maintenance). Understanding the cortical activation dynamics during these stages can guide targeted rehabilitation interventions.

METHODS

In this longitudinal randomized controlled trial, functional near-infrared spectroscopy was used to explore the temporal dynamics of cortical activation in hand-related motor learning. Thirty-one healthy right-handed individuals were randomly assigned to perform either easy or intricate motor tasks with their non-dominant hand over 10 days. We conducted 10 monitoring sessions to track cortical activation in the right hemisphere (according to lateralization principles, the primary hemisphere for motor control) and evaluated motor proficiency concurrently.

RESULTS

The study delineated three stages of nondominant hand motor learning: rapid learning (days 1 and 2), consolidation (days 3-7), and stable performance (days 8-10). There was a power-law enhancement of motor skills correlated with learning progression. Sustained activation was observed in the supplementary motor area (SMA) and parietal lobe (PL), whereas activation in the right primary motor cortex (M1R) and dorsolateral prefrontal cortex (PFCR) decreased. These cortical activation patterns exhibited a high correlation with the augmentation of motor proficiency.

CONCLUSIONS

The findings suggest that early rehabilitation interventions, such as transcranial magnetic stimulation and transcranial direct current stimulation (tDCS), could be optimally directed at M1 and PFC in the initial stages. In contrast, SMA and PL can be targeted throughout the motor learning process. This research illuminates the path for developing tailored motor rehabilitation interventions based on specific stages of motor learning.

NEW AND NOTEWORTHY

In an innovative approach, our study uniquely combines a longitudinal design with the robustness of generalized estimating equations (GEEs). With the synergy of functional near-infrared spectroscopy (fNIRS) and the Minnesota Manual Dexterity Test (MMDT) paradigm, we precisely trace the evolution of neural resources during complex, real-world fine-motor task learning. Centering on right-handed participants using their nondominant hand magnifies the intricacies of right hemisphere spatial motor processing. We unravel the brain's dynamic response throughout motor learning stages and its potent link to motor skill enhancement. Significantly, our data point toward the early-phase rehabilitation potential of TMS and transcranial direct current stimulation on the M1 and PFC regions. Concurrently, SMA and PL appear poised to benefit from ongoing interventions during the entire learning curve. Our findings carve a path for refined motor rehabilitation strategies, underscoring the importance of timely noninvasive brain stimulation treatments.

Information-Restricted Neural Language Models Reveal Different Brain Regions' Sensitivity to Semantics, Syntax, and Context

A fundamental question in neurolinguistics concerns the brain regions involved in syntactic and semantic processing during speech comprehension, both at the lexical (word processing) and supra-lexical levels (sentence and discourse processing). To what extent are these regions separated or intertwined? To address this question, we introduce a novel approach exploiting neural language models to generate high-dimensional feature sets that separately encode semantic and syntactic information. More precisely, we train a lexical language model, GloVe, and a supra-lexical language model, GPT-2, on a text corpus from which we selectively removed either syntactic or semantic information. We then assess to what extent the features derived from these information-restricted models are still able to predict the fMRI time courses of humans listening to naturalistic text. Furthermore, to determine the windows of integration of brain regions involved in supra-lexical processing, we manipulate the size of contextual information provided to GPT-2. The analyses show that, while most brain regions involved in language comprehension are sensitive to both syntactic and semantic features, the relative magnitudes of these effects vary across these regions. Moreover, regions that are best fitted by semantic or syntactic features are more spatially dissociated in the left hemisphere than in the right one, and the right hemisphere shows sensitivity to longer contexts than the left. The novelty of our approach lies in the ability to control for the information encoded in the models' embeddings by manipulating the training set. These "information-restricted" models complement previous studies that used language models to probe the neural bases of language, and shed new light on its spatial organization.

Temporally Dissociable Mechanisms of Spatial, Feature, and Motor Selection during Working Memory-guided Behavior

Working memory (WM) is a capacity- and duration-limited system that forms a temporal bridge between fleeting sensory phenomena and possible actions. But how are the contents of WM used to guide behavior? A recent high-profile study reported evidence for simultaneous access to WM content and linked motor plans during WM-guided behavior, challenging serial models where task-relevant WM content is first selected and then mapped on to a task-relevant motor response. However, the task used in that study was not optimized to distinguish the selection of spatial versus nonspatial visual information stored in memory, nor to distinguish whether or how the chronometry of selecting nonspatial visual information stored in memory might differ from the selection of linked motor plans. Here, we revisited the chronometry of spatial, feature, and motor selection during WM-guided behavior using a task optimized to disentangle these processes. Concurrent EEG and eye position recordings revealed clear evidence for temporally dissociable spatial, feature, and motor selection during this task. Thus, our data reveal the existence of multiple WM selection mechanisms that belie conceptualizations of WM-guided behavior based on purely serial or parallel visuomotor processing.

Methylphenidate undermines or enhances divergent creativity depending on baseline dopamine synthesis capacity

Catecholamine-enhancing psychostimulants, such as methylphenidate have long been argued to undermine creative thinking. However, prior evidence for this is weak or contradictory, stemming from studies with small sample sizes that do not consider the well-established large variability in psychostimulant effects across different individuals and task demands. We aimed to definitively establish the link between psychostimulants and creative thinking by measuring effects of methylphenidate in 90 healthy participants on distinct creative tasks that measure convergent and divergent thinking, as a function of individuals' baseline dopamine synthesis capacity, indexed with 18F-FDOPA PET imaging. In a double-blind, within-subject design, participants were administered methylphenidate, placebo or selective D2 receptor antagonist sulpiride. The results showed that striatal dopamine synthesis capacity and/or methylphenidate administration did not affect divergent and convergent thinking. However, exploratory analysis demonstrated a baseline dopamine-dependent effect of methylphenidate on a measure of response divergence, a creativity measure that measures response variability. Response divergence was reduced by methylphenidate in participants with low dopamine synthesis capacity but enhanced in those with high dopamine synthesis capacity. No evidence of any effect of sulpiride was found. These results show that methylphenidate can undermine certain forms of divergent creativity but only in individuals with low baseline dopamine levels.

Aberrations in temporal dynamics of cognitive processing induced by Parkinson's disease and Levodopa

The motor symptoms of Parkinson's disease (PD) have been shown to significantly improve by Levodopa. However, despite the widespread adoption of Levodopa as a standard pharmaceutical drug for the treatment of PD, cognitive impairments linked to PD do not show visible improvement with Levodopa treatment. Furthermore, the neuronal and network mechanisms behind the PD-induced cognitive impairments are not clearly understood. In this work, we aim to explain these cognitive impairments, as well as the ones exacerbated by Levodopa, through examining the differential dynamic patterns of the phase-amplitude coupling (PAC) during cognitive functions. EEG data recorded in an auditory oddball task performed by a cohort consisting of controls and a group of PD patients during both on and off periods of Levodopa treatment were analyzed to derive the temporal dynamics of the PAC across the brain. We observed distinguishing patterns in the PAC dynamics, as an indicator of information binding, which can explain the slower cognitive processing associated with PD in the form of a latency in the PAC peak time. Thus, considering the high-level connections between the hippocampus, the posterior and prefrontal cortices established through the dorsal and ventral striatum acting as a modulatory system, we posit that the primary issue with cognitive impairments of PD, as well as Levodopa's cognitive deficit side effects, can be attributed to the changes in temporal dynamics of dopamine release influencing the modulatory function of the striatum.

Neuropsychological differential diagnosis of Alzheimer's disease and vascular dementia: a systematic review with meta-regressions

Introduction

Diagnostic classification systems and guidelines posit distinguishing patterns of impairment in Alzheimer's (AD) and vascular dementia (VaD). In our study, we aim to identify which diagnostic instruments distinguish them.

Methods

We searched PubMed and PsychInfo for empirical studies published until December 2020, which investigated differences in cognitive, behavioral, psychiatric, and functional measures in patients older than 64 years and reported information on VaD subtype, age, education, dementia severity, and proportion of women. We systematically reviewed these studies and conducted Bayesian hierarchical meta-regressions to quantify the evidence for differences using the Bayes factor (BF). The risk of bias was assessed using the Newcastle-Ottawa-Scale and funnel plots.

Results

We identified 122 studies with 17,850 AD and 5,247 VaD patients. Methodological limitations of the included studies are low comparability of patient groups and an untransparent patient selection process. In the digit span backward task, AD patients were nine times more probable (BF = 9.38) to outperform VaD patients (β g = 0.33, 95% ETI = 0.12, 0.52). In the phonemic fluency task, AD patients outperformed subcortical VaD (sVaD) patients (β g = 0.51, 95% ETI = 0.22, 0.77, BF = 42.36). VaD patients, in contrast, outperformed AD patients in verbal (β g = -0.61, 95% ETI = -0.97, -0.26, BF = 22.71) and visual (β g = -0.85, 95% ETI = -1.29, -0.32, BF = 13.67) delayed recall. We found the greatest difference in verbal memory, showing that sVaD patients outperform AD patients (β g = -0.64, 95% ETI = -0.88, -0.36, BF = 72.97). Finally, AD patients performed worse than sVaD patients in recognition memory tasks (β g = -0.76, 95% ETI = -1.26, -0.26, BF = 11.50).

Conclusion

Our findings show inferior performance of AD in episodic memory and superior performance in working memory. We found little support for other differences proposed by diagnostic systems and diagnostic guidelines. The utility of cognitive, behavioral, psychiatric, and functional measures in differential diagnosis is limited and should be complemented by other information. Finally, we identify research areas and avenues, which could significantly improve the diagnostic value of cognitive measures.

Contributions of transient and sustained reward to memory formation

Reward benefits to memory formation have been robustly linked to dopaminergic activity. Despite the established characterization of dopaminergic mechanisms as operating at multiple timescales, potentially supporting distinct functional outcomes, the temporal dynamics by which reward might modulate memory encoding are just beginning to be investigated. In the present study, we leveraged a mixed block/event experimental design to disentangle transient and sustained reward influences on task engagement and subsequent recognition memory in an adapted monetary-incentive-encoding (MIE) paradigm. Across three behavioral experiments, transient and sustained reward modulation of item and context memory was probed, at both 24-h and ~ 15-min retention intervals, to investigate the importance of overnight consolidation. In general, we observed that transient reward was associated with enhanced item memory encoding, while sustained reward modulated response speed but did not appear to benefit subsequent recognition accuracy. Notably, reward effects on item memory performance and response speed were somewhat inconsistent across the three experiments, with suggestions that RT speeding might also be related to time on task, and we did not observe reward modulation of context memory performance or amplification of reward benefits to memory by overnight consolidation. Taken together, the observed pattern of behavior is consistent with potentially distinct roles for transient and sustained reward in memory encoding and cognitive performance and suggests that further investigation of the temporal dynamics of dopaminergic contributions to memory formation will advance the understanding of motivated memory.

Exploring strategy differences between humans and monkeys with recurrent neural networks

Animal models are used to understand principles of human biology. Within cognitive neuroscience, non-human primates are considered the premier model for studying decision-making behaviors in which direct manipulation experiments are still possible. Some prominent studies have brought to light major discrepancies between monkey and human cognition, highlighting problems with unverified extrapolation from monkey to human. Here, we use a parallel model system-artificial neural networks (ANNs)-to investigate a well-established discrepancy identified between monkeys and humans with a working memory task, in which monkeys appear to use a recency-based strategy while humans use a target-selective strategy. We find that ANNs trained on the same task exhibit a progression of behavior from random behavior (untrained) to recency-like behavior (partially trained) and finally to selective behavior (further trained), suggesting monkeys and humans may occupy different points in the same overall learning progression. Surprisingly, what appears to be recency-like behavior in the ANN, is in fact an emergent non-recency-based property of the organization of the neural network's state space during its development through training. We find that explicit encouragement of recency behavior during training has a dual effect, not only causing an accentuated recency-like behavior, but also speeding up the learning process altogether, resulting in an efficient shaping mechanism to achieve the optimal strategy. Our results suggest a new explanation for the discrepency observed between monkeys and humans and reveal that what can appear to be a recency-based strategy in some cases may not be recency at all.

A whole-task brain model of associative recognition that accounts for human behavior and neuroimaging data

Brain models typically focus either on low-level biological detail or on qualitative behavioral effects. In contrast, we present a biologically-plausible spiking-neuron model of associative learning and recognition that accounts for both human behavior and low-level brain activity across the whole task. Based on cognitive theories and insights from machine-learning analyses of M/EEG data, the model proceeds through five processing stages: stimulus encoding, familiarity judgement, associative retrieval, decision making, and motor response. The results matched human response times and source-localized MEG data in occipital, temporal, prefrontal, and precentral brain regions; as well as a classic fMRI effect in prefrontal cortex. This required two main conceptual advances: a basal-ganglia-thalamus action-selection system that relies on brief thalamic pulses to change the functional connectivity of the cortex, and a new unsupervised learning rule that causes very strong pattern separation in the hippocampus. The resulting model shows how low-level brain activity can result in goal-directed cognitive behavior in humans.

Functional Connectivity and Microstructural Network Correlates of Interindividual Variability in Distinct Executive Functions of Healthy Older Adults

Executive functions, essential for daily life, are known to be impaired in older age. Some executive functions, including working memory updating and value-based decision-making, are specifically sensitive to age-related deterioration. While their neural correlates in young adults are well-described, a comprehensive delineation of the underlying brain substrates in older populations, relevant to identify targets for modulation against cognitive decline, is missing. Here, we assessed letter updating and Markov decision-making task performance to operationalize these trainable functions in 48 older adults. Resting-state functional magnetic resonance imaging was acquired to quantify functional connectivity (FC) in task-relevant frontoparietal and default mode networks. Microstructure in white matter pathways mediating executive functions was assessed with diffusion tensor imaging and quantified by tract-based fractional anisotropy (FA). Superior letter updating performance correlated with higher FC between dorsolateral prefrontal cortex and left frontoparietal and hippocampal areas, while superior Markov decision-making performance correlated with decreased FC between basal ganglia and right angular gyrus. Furthermore, better working memory updating performance was related to higher FA in the cingulum bundle and the superior longitudinal fasciculus. Stepwise linear regression showed that cingulum bundle FA added significant incremental contribution to the variance explained by fronto-angular FC alone. Our findings provide a characterization of distinct functional and structural connectivity correlates associated with performance of specific executive functions. Thereby, this study contributes to the understanding of the neural correlates of updating and decision-making functions in older adults, paving the way for targeted modulation of specific networks by modulatory techniques such as behavioral interventions and non-invasive brain stimulation.

Prefrontal cortex state representations shape human credit assignment

People learn adaptively from feedback, but the rate of such learning differs drastically across individuals and contexts. Here, we examine whether this variability reflects differences in what is learned. Leveraging a neurocomputational approach that merges fMRI and an iterative reward learning task, we link the specificity of credit assignment-how well people are able to appropriately attribute outcomes to their causes-to the precision of neural codes in the prefrontal cortex (PFC). Participants credit task-relevant cues more precisely in social compared vto nonsocial contexts, a process that is mediated by high-fidelity (i.e., distinct and consistent) state representations in the PFC. Specifically, the medial PFC and orbitofrontal cortex work in concert to match the neural codes from feedback to those at choice, and the strength of these common neural codes predicts credit assignment precision. Together this work provides a window into how neural representations drive adaptive learning.

Auricular Transcutaneous Vagus Nerve Stimulation Specifically Enhances Working Memory Gate Closing Mechanism: A System Neurophysiological Study

Everyday tasks and goal-directed behavior involve the maintenance and continuous updating of information in working memory (WM). WM gating reflects switches between these two core states. Neurobiological considerations suggest that the catecholaminergic and the GABAergic are likely involved in these dynamics. Both of these neurotransmitter systems likely underlie the effects to auricular transcutaneous vagus nerve stimulation (atVNS). We examine the effects of atVNS on WM gating dynamics and their underlying neurophysiological and neurobiological processes in a randomized crossover study design in healthy humans of both sexes. We show that atVNS specifically modulates WM gate closing and thus specifically modulates neural mechanisms enabling the maintenance of information in WM. WM gate opening processes were not affected. atVNS modulates WM gate closing processes through the modulation of EEG alpha band activity. This was the case for clusters of activity in the EEG signal referring to stimulus information, motor response information, and fractions of information carrying stimulus-response mapping rules during WM gate closing. EEG-beamforming shows that modulations of activity in fronto-polar, orbital, and inferior parietal regions are associated with these effects. The data suggest that these effects are not because of modulations of the catecholaminergic (noradrenaline) system as indicated by lack of modulatory effects in pupil diameter dynamics, in the inter-relation of EEG and pupil diameter dynamics and saliva markers of noradrenaline activity. Considering other findings, it appears that a central effect of atVNS during cognitive processing refers to the stabilization of information in neural circuits, putatively mediated via the GABAergic system.SIGNIFICANCE STATEMENT Goal-directed behavior depends on how well information in short-term memory can be flexibly updated but also on how well it can be shielded from distraction. These two functions were guarded by a working memory gate. We show how an increasingly popular brain stimulation techniques specifically enhances the ability to close the working memory gate to shield information from distraction. We show what physiological and anatomic aspects underlie these effects.

Stimulus specific cortical activity associated with ignoring distraction during working memory encoding and maintenance

Distraction disrupts Working Memory (WM) performance, but how the brain filters distraction is not known. One possibility is that neural activity associated with distractions is suppressed relative to a baseline/passive task (biased competition). Alternatively, distraction may be denied access to WM, with no suppression. Furthermore, behavioural work indicates separate mechanisms for ignoring distractions which occur (1) while we put information into WM (Encoding Distraction, ED) and (2) while we maintain already encoded information during the WM delay period (Delay Distraction, DD). Here we used fMRI in humans to measure category-sensitive cortical activity and probe the extent to which ED/DD mechanisms involve enhancement/suppression during a WM task. We observed significant enhancement of task-relevant activity, relative to a passive view task, which did not differ according to whether or when distractors appeared. For both ED and DD we found no evidence of suppression, but instead a robust increase in stimulus specific activity in response to additional stimuli presented during the passive view task, which was not seen for the WM task, when those additional stimuli were to be ignored. The results indicate that ED/DD resistance does not necessarily involve suppression of distractor-related activity. Rather, a rise in distractor-associated activity is prevented when distractors are presented, supporting models of input gating, and providing a potential mechanism by which input-gating might be achieved.

A rapid theta network mechanism for flexible information encoding

Flexible behavior requires gating mechanisms that encode only task-relevant information in working memory. Extant literature supports a theoretical division of labor whereby lateral frontoparietal interactions underlie information maintenance and the striatum enacts the gate. Here, we reveal neocortical gating mechanisms in intracranial EEG patients by identifying rapid, within-trial changes in regional and inter-regional activities that predict subsequent behavioral outputs. Results first demonstrate information accumulation mechanisms that extend prior fMRI (i.e., regional high-frequency activity) and EEG evidence (inter-regional theta synchrony) of distributed neocortical networks in working memory. Second, results demonstrate that rapid changes in theta synchrony, reflected in changing patterns of default mode network connectivity, support filtering. Graph theoretical analyses further linked filtering in task-relevant information and filtering out irrelevant information to dorsal and ventral attention networks, respectively. Results establish a rapid neocortical theta network mechanism for flexible information encoding, a role previously attributed to the striatum.

Leveraging Prior Knowledge to Support Short-term Memory: Exploring the Role of the Ventromedial Prefrontal Cortex

It is well established that the ventromedial prefrontal cortex (vmPFC) plays a critical role in memory consolidation and the retrieval of remote long-term memories. Recent evidence suggests that the vmPFC also supports rapid neocortical learning and consolidation over shorter timescales, particularly when novel events align with stored knowledge. One mechanism by which the vmPFC has been proposed to support this learning is by integrating congruent information into existing neocortical knowledge during memory encoding. An important outstanding question is whether the vmPFC also plays a critical role in linking congruent information with existing knowledge before storage in long-term memory. The current study investigated this question by testing whether lesions to the vmPFC disrupt the ability to leverage stored knowledge in support of short-term memory. Specifically, we investigated the visuospatial bootstrapping effect, the phenomenon whereby immediate verbal recall of visually presented stimuli is better when stimuli appear in a familiar visuospatial array that is congruent with prior knowledge compared with an unfamiliar visuospatial array. We found that the overall magnitude of the bootstrapping effect did not differ between patients with vmPFC lesions and controls. However, a reliable bootstrapping effect was not present in the patient group alone. Post hoc analysis of individual patient performance revealed that the bootstrapping effect did not differ from controls in nine patients but was reduced in two patients. Although mixed, these results suggest that vmPFC lesions do not uniformly disrupt the ability to leverage stored knowledge in support of short-term memory.

Advanced Reinforcement Learning and Its Connections with Brain Neuroscience

In recent years, brain science and neuroscience have greatly propelled the innovation of computer science. In particular, knowledge from the neurobiology and neuropsychology of the brain revolutionized the development of reinforcement learning (RL) by providing novel interpretable mechanisms of how the brain achieves intelligent and efficient decision making. Triggered by this, there has been a boom in research about advanced RL algorithms that are built upon the inspirations of brain neuroscience. In this work, to further strengthen the bidirectional link between the 2 communities and especially promote the research on modern RL technology, we provide a comprehensive survey of recent advances in the area of brain-inspired/related RL algorithms. We start with basis theories of RL, and present a concise introduction to brain neuroscience related to RL. Then, we classify these advanced RL methodologies into 3 categories according to different connections of the brain, i.e., micro-neural activity, macro-brain structure, and cognitive function. Each category is further surveyed by presenting several modern RL algorithms along with their mathematical models, correlations with the brain, and open issues. Finally, we introduce several important applications of RL algorithms, followed by the discussions of challenges and opportunities for future research.

Working memory control dynamics follow principles of spatial computing

Working memory (WM) allows us to remember and selectively control a limited set of items. Neural evidence suggests it is achieved by interactions between bursts of beta and gamma oscillations. However, it is not clear how oscillations, reflecting coherent activity of millions of neurons, can selectively control individual WM items. Here we propose the novel concept of spatial computing where beta and gamma interactions cause item-specific activity to flow spatially across the network during a task. This way, control-related information such as item order is stored in the spatial activity independent of the detailed recurrent connectivity supporting the item-specific activity itself. The spatial flow is in turn reflected in low-dimensional activity shared by many neurons. We verify these predictions by analyzing local field potentials and neuronal spiking. We hypothesize that spatial computing can facilitate generalization and zero-shot learning by utilizing spatial component as an additional information encoding dimension.

Computational Modeling of the n-Back Task in the ABCD Study: Associations of Drift Diffusion Model Parameters to Polygenic Scores of Mental Disorders and Cardiometabolic Diseases

BACKGROUND

Cognitive dysfunction is common in mental disorders and represents a potential risk factor in childhood. The nature and extent of associations between childhood cognitive function and polygenic risk for mental disorders is unclear. We applied computational modeling to gain insight into mechanistic processes underlying decision making and working memory in childhood and their associations with polygenic risk scores (PRSs) for mental disorders and comorbid cardiometabolic diseases.

METHODS

We used the drift diffusion model to infer latent computational processes underlying decision making and working memory during the n-back task in 3707 children ages 9 to 10 years from the Adolescent Brain Cognitive Development (ABCD) Study. Single nucleotide polymorphism-based heritability was estimated for cognitive phenotypes, including computational parameters, aggregated n-back task performance, and neurocognitive assessments. PRSs were calculated for Alzheimer's disease, bipolar disorder, coronary artery disease (CAD), major depressive disorder, obsessive-compulsive disorder, schizophrenia, and type 2 diabetes.

RESULTS

Heritability estimates of cognitive phenotypes ranged from 12% to 38%. Bayesian mixed models revealed that slower accumulation of evidence was associated with higher PRSs for CAD and schizophrenia. Longer nondecision time was associated with higher PRSs for Alzheimer's disease and lower PRSs for CAD. Narrower decision threshold was associated with higher PRSs for CAD. Load-dependent effects on nondecision time and decision threshold were associated with PRSs for Alzheimer's disease and CAD, respectively. Aggregated neurocognitive test scores were not associated with PRSs for any of the mental or cardiometabolic phenotypes.

CONCLUSIONS

We identified distinct associations between computational cognitive processes and genetic risk for mental illness and cardiometabolic disease, which could represent childhood cognitive risk factors.

Predicted utility modulates working memory fidelity in the brain

The predicted utility of information stored in working memory (WM) is hypothesized to influence the strategic allocation of WM resources. Prior work has shown that when information is prioritized, it is remembered with greater precision relative to other remembered items. However, these paradigms often complicate interpretation of the effects of predicted utility on item fidelity due to a concurrent memory load. Likewise, no fMRI studies have examined whether the predicted utility of an item modulates fidelity in the neural representation of items during the memory delay without a concurrent load. In the current study, we used fMRI to investigate whether predicted utility influences fidelity of WM representations in the brain. Using a generative model multivoxel analysis approach to estimate the quality of remembered representations across predicted utility conditions, we observed that items with greater predicted utility are maintained in memory with greater fidelity, even when they are the only item being maintained. Further, we found that this pattern follows a parametric relationship where more predicted utility corresponded to greater fidelity. These precision differences could not be accounted for based on a redistribution of resources among already-remembered items. Rather, we interpret these results in terms of a gating mechanism that allows for pre-allocation of resources based on predicted value alone. This evidence supports a theoretical distinction between resource allocation that occurs as a result of load and resource pre-allocation that occurs as a result of predicted utility.

Replay and compositional computation

Replay in the brain has been viewed as rehearsal or, more recently, as sampling from a transition model. Here, we propose a new hypothesis: that replay is able to implement a form of compositional computation where entities are assembled into relationally bound structures to derive qualitatively new knowledge. This idea builds on recent advances in neuroscience, which indicate that the hippocampus flexibly binds objects to generalizable roles and that replay strings these role-bound objects into compound statements. We suggest experiments to test our hypothesis, and we end by noting the implications for AI systems which lack the human ability to radically generalize past experience to solve new problems.

Understanding mental health through computers: An introduction to computational psychiatry

Computational psychiatry recently established itself as a new tool in the study of mental disorders and problems. Integration of different levels of analysis is creating computational phenotypes with clinical and research values, and constructing a way to arrive at precision psychiatry are part of this new branch. It conceptualizes the brain as a computational organ that receives from the environment parameters to respond to challenges through calculations and algorithms in continuous feedback and feedforward loops with a permanent degree of uncertainty. Through this conception, one can seize an understanding of the cerebral and mental processes in the form of theories or hypotheses based on data. Using these approximations, a better understanding of the disorder and its different determinant factors facilitates the diagnostics and treatment by having an individual, ecologic, and holistic approach. It is a tool that can be used to homologate and integrate multiple sources of information given by several theoretical models. In conclusion, it helps psychiatry achieve precision and reproducibility, which can help the mental health field achieve significant advancement. This article is a narrative review of the basis of the functioning of computational psychiatry with a critical analysis of its concepts.