Working memory and prefrontal cortex

Adaptive learning via BG-thalamo-cortical circuitry

People adjust their use of feedback over time through a process referred to as adaptive learning. We have recently proposed that the underlying mechanisms of adaptive learning are rooted in how the brain organizes time into similarly credited units, which we refer to as latent states. Here we develop a BG-thalamo-cortical circuit model of this process and show that it captures both the commonalities and heterogeneity in human adaptive learning behavior. Our model learns incrementally through synaptic plasticity in PFC-BG connections, but upon observing discordant information, produces thalamocortical reset signals that alter PFC connectivity, driving attractor state transitions that facilitate rapid updating of behavioral policy. We demonstrate that this mechanism can give rise to optimized learning dynamics in the context of either changepoints or reversals, and that under reasonable biological assumptions the model is able to generalize efficiently across these conditions, adjusting behavior in a context-appropriate manner. Taken together, our results provide a biologically plausible mechanistic model for adaptive learning that explains existing behavioral data and makes testable predictions about the computational roles of different brain regions in complex learning behaviors.

Timescales of learning in prefrontal cortex

The lateral prefrontal cortex (PFC) in humans and other primates is critical for immediate, goal-directed behaviour and working memory, which are classically considered distinct from the cognitive and neural circuits that support long-term learning and memory. Over the past few years, a reconsideration of this textbook perspective has emerged, in that different timescales of memory-guided behaviour are in constant interaction during the pursuit of immediate goals. Here, we will first detail how neural activity related to the shortest timescales of goal-directed behaviour (which requires maintenance of current states and goals in working memory) is sculpted by long-term knowledge and learning - that is, how the past informs present behaviour. Then, we will outline how learning across different timescales (from seconds to years) drives plasticity in the primate lateral PFC, from single neuron firing rates to mesoscale neuroimaging activity patterns. Finally, we will review how, over days and months of learning, dense local and long-range connectivity patterns in PFC facilitate longer-lasting changes in population activity by changing synaptic weights and recruiting additional neural resources to inform future behaviour. Our Review sheds light on how the machinery of plasticity in PFC circuits facilitates the integration of learned experiences across time to best guide adaptive behaviour.

Heterogeneous Forgetting Rates and Greedy Allocation in Slot-Based Memory Networks Promotes Signal Retention

A key question in the neuroscience of memory encoding pertains to the mechanisms by which afferent stimuli are allocated within memory networks. This issue is especially pronounced in the domain of working memory, where capacity is finite. Presumably the brain must embed some "policy" by which to allocate these mnemonic resources in an online manner in order to maximally represent and store afferent information for as long as possible and without interference from subsequent stimuli. Here, we engage this question through a top-down theoretical modeling framework. We formally optimize a gating mechanism that projects afferent stimuli onto a finite number of memory slots within a recurrent network architecture. In the absence of external input, the activity in each slot attenuates over time (i.e., a process of gradual forgetting). It turns out that the optimal gating policy consists of a direct projection from sensory activity to memory slots, alongside an activity-dependent lateral inhibition. Interestingly, allocating resources myopically (greedily with respect to the current stimulus) leads to efficient utilization of slots over time. In other words, later-arriving stimuli are distributed across slots in such a way that the network state is minimally shifted and so prior signals are minimally "overwritten." Further, networks with heterogeneity in the timescales of their forgetting rates retain stimuli better than those that are more homogeneous. Our results suggest how online, recurrent networks working on temporally localized objectives without high-level supervision can nonetheless implement efficient allocation of memory resources over time.

The neurocognitive role of working memory load when Pavlovian motivational control affects instrumental learning

Research suggests that a fast, capacity-limited working memory (WM) system and a slow, incremental reinforcement learning (RL) system jointly contribute to instrumental learning. Thus, situations that strain WM resources alter instrumental learning: under WM loads, learning becomes slow and incremental, the reliance on computationally efficient learning increases, and action selection becomes more random. It is also suggested that Pavlovian learning influences people's behavior during instrumental learning by providing hard-wired instinctive responses including approach to reward predictors and avoidance of punishment predictors. However, it remains unknown how constraints on WM resources affect instrumental learning under Pavlovian influence. Thus, we conducted a functional magnetic resonance imaging (fMRI) study (N = 49) in which participants completed an instrumental learning task with Pavlovian-instrumental conflict (the orthogonalized go/no-go task) both with and without extra WM load. Behavioral and computational modeling analyses revealed that WM load reduced the learning rate and increased random choice, without affecting Pavlovian bias. Model-based fMRI analysis revealed that WM load strengthened RPE signaling in the striatum. Moreover, under WM load, the striatum showed weakened connectivity with the ventromedial and dorsolateral prefrontal cortex when computing reward expectations. These results suggest that the limitation of cognitive resources by WM load promotes slow and incremental learning through the weakened cooperation between WM and RL; such limitation also makes action selection more random, but it does not directly affect the balance between instrumental and Pavlovian systems.

Background synaptic input modulates the visuospatial working memory

It is generally thought that persistent firing of neurons in the prefrontal cortex underlies working memory. Previous studies have focused on the influence of recurrent synaptic connectivity in local circuits on memory storage. Given neurons in the neocortex are extensively connected, individual neural circuits should receive synaptic inputs from other areas. Here we explore how background synaptic inputs (BSIs) modulate the visuospatial working memory in an oculomotor delayed response task. In a local recurrent network composed of pyramidal cells and interneurons, a bump attractor persists across the delay period, encoding the cue location. Under independent BSIs, the spontaneous network state before the cue presentation can be classified as inactive, active, or overactive, occurring successively with increasing the BSI strength, and the active state facilitates the memory storage. Under spatially correlated BSIs, optimal scenarios, in terms of accuracy of representation and resistance to distraction, involve the BSIs with intermediate strength and low correlation or high strength and moderate correlation. Our results demonstrate how the memory storage is regulated via tuning the balance between local excitation and global inhibition in the network. The current work reveals the functional importance of background input and suggests that robust memory storage could be accomplished over a variety of network states.

Disentangling the influences of multiple thalamic nuclei on prefrontal cortex and cognitive control

The prefrontal cortex (PFC) has a complex relationship with the thalamus, involving many nuclei which occupy predominantly medial zones along its anterior-to-posterior extent. Thalamocortical neurons in most of these nuclei are modulated by the affective and cognitive signals which funnel through the basal ganglia. We review how PFC-connected thalamic nuclei likely contribute to all aspects of cognitive control: from the processing of information on internal states and goals, facilitating its interactions with mnemonic information and learned values of stimuli and actions, to their influence on high-level cognitive processes, attentional allocation and goal-directed behavior. This includes contributions to transformations such as rule-to-choice (parvocellular mediodorsal nucleus), value-to-choice (magnocellular mediodorsal nucleus), mnemonic-to-choice (anteromedial nucleus) and sensory-to-choice (medial pulvinar). Common mechanisms appear to be thalamic modulation of cortical gain and cortico-cortical functional connectivity. The anatomy also implies a unique role for medial PFC in modulating processing in thalamocortical circuits involving other orbital and lateral PFC regions. We further discuss how cortico-basal ganglia circuits may provide a mechanism through which PFC controls cortico-cortical functional connectivity.

Chronic Restraint Stress Inhibits the Response to a Second Hit in Adult Male Rats: A Role for BDNF Signaling

Depression is a recurrent disorder, with about 50% of patients experiencing relapse. Exposure to stressful events may have an adverse impact on the long-term course of the disorder and may alter the response to a subsequent stressor. Indeed, not all the systems impaired by stress may normalize during symptoms remission, facilitating the relapse to the pathology. Hence, we investigated the long-lasting effects of chronic restraint stress (CRS) and its influence on the modifications induced by the exposure to a second hit on brain-derived neurotrophic factor (BDNF) signaling in the prefrontal cortex (PFC). We exposed adult male Sprague Dawley rats to 4 weeks of CRS, we left them undisturbed for the subsequent 3 weeks, and then we exposed animals to one hour of acute restraint stress (ARS). We found that CRS influenced the release of corticosterone induced by ARS and inhibited the ability of ARS to activate mature BDNF, its receptor Tropomyosin receptor kinase B (TRKB), and their associated intracellular cascades: the TRKB-PI3K-AKT), the MEK-MAPK/ERK, and the Phospholipase C γ (PLCγ) pathways, positively modulated by ARS in non-stressed animals. These results suggest that CRS induces protracted and detrimental consequences that interfere with the ability of PFC to cope with a challenging situation.

Crows control working memory before and after stimulus encoding

The capacity of working memory is limited and this limit is comparable in crows and primates. To maximize this resource, humans use attention to select only relevant information for maintenance. Interestingly, attention-cues are effective not only before but also after the presentation of to-be-remembered stimuli, highlighting control mechanisms beyond sensory selection. Here we explore if crows are also capable of these forms of control over working memory. Two crows (Corvus corone) were trained to memorize two, four or six visual stimuli. Comparable to our previous results, the crows showed a decrease in performance with increasing working memory load. Using attention cues, we indicated the critical stimulus on a given trial. These cues were either presented before (pre-cue) or after sample-presentation (retro-cue). On other trials no cue was given as to which stimulus was critical. We found that both pre- and retro-cues enhance the performance of the birds. These results show that crows, like humans, can utilize attention to select relevant stimuli for maintenance in working memory. Importantly, crows can also utilize cues to make the most of their working memory capacity even after the stimuli are already held in working memory. This strongly implies that crows can engage in efficient control over working memory.

Brain function during stages of working memory in schizophrenia and psychotic bipolar disorder

Working memory (WM) is impaired in psychotic disorders and linked to functional outcome. Most neurobiological models emphasize prefrontal cortex (PFC) dysfunction in the etiology of WM impairment. However, WM is composed of multiple processes, including encoding and maintenance, and the delineation of the neurobiology of these sub-processes has not been well characterized in schizophrenia and psychotic bipolar disorder. Functional MRI was obtained during an event-related spatial delayed match-to-sample task from 58 healthy individuals, 72 individuals with schizophrenia and 41 people with bipolar I disorder with psychotic features in order to: 1) characterize neural responses during encoding, maintenance and retrieval stages of WM using complementary region-of-interest and whole brain approaches; 2) determine whether schizophrenia and psychotic bipolar disorder exhibit similar abnormalities in WM-related brain function; and 3) elucidate the associations between WM-related brain function, task performance, and neuropsychological functioning. Both schizophrenia and psychotic bipolar disorder groups showed encoding- and maintenance-related impairments in the posterior parietal cortex (PPC) and frontal eye fields (FEF). BOLD response in the PPC and FEF, during encoding and maintenance respectively, was associated with task performance independent of group. Additionally, encoding-related activation in the PPC correlated with general neuropsychological functioning independent of group. Only encoding-related activation in the right ventral striatum differed between schizophrenia and psychotic bipolar disorder; individuals with schizophrenia showed significantly lower activation than both psychotic bipolar disorder and healthy groups. Our results are consistent with emerging evidence implicating PPC dysfunction in WM impairment and suggest interventions targeting neural activation in PPC may improve WM and neuropsychological functioning across psychotic disorders.

Differential Brain Mechanisms of Selection and Maintenance of Information during Working Memory

Working memory is our ability to select and temporarily hold information as needed for complex cognitive operations. The temporal dynamics of sustained and transient neural activity supporting the selection and holding of memory content is not known. To address this problem, we recorded magnetoencephalography in healthy participants performing a retro-cue working memory task in which the selection rule and the memory content varied independently. Multivariate decoding and source analyses showed that selecting the memory content relies on prefrontal and parieto-occipital persistent oscillatory neural activity. By contrast, the memory content was reactivated in a distributed occipitotemporal posterior network, preceding the working memory decision and in a different format than during the visual encoding. These results identify a neural signature of content selection and characterize differentiated spatiotemporal constraints for subprocesses of working memory.SIGNIFICANCE STATEMENT Our brain selects and maintains information during short time windows in a way that is essential to reasoning and learning. Recent advances in multivariate analysis of brain activity allowed the characterization of brain regions that stores the memory. We applied multivariate analysis to time-resolved brain signals to characterize the spatiotemporal signature underlying these subprocesses. The selection of information relies on sustained oscillatory activity in a network that includes the ventrolateral prefrontal cortex while memory content is transiently replayed in an occipitotemporal network that differs from encoding. Our results characterized differentiated spatiotemporal activity underlying encoding, selection, and maintenance of information during working memory.

Multivariate Relationships Between Cognition and Brain Anatomy Across the Psychosis Spectrum

BACKGROUND

Cognitive and structural brain abnormalities range from mild to severe in psychosis. The relationships of specific cognitive functions to specific brain structures across the psychosis spectrum is less certain.

METHODS

Participants (n = 678) with bipolar, schizoaffective, or schizophrenia psychoses and healthy control subjects were recruited via the Bipolar-Schizophrenia Network for Intermediate Phenotypes. The Schizo-Bipolar Scale was used to create a psychosis continuum (from purely affective to purely nonaffective). Canonical correlation between 14 cognitive measures and structural brain measures (gray matter volume, cortical thickness, cortical surface area, and local gyrification indices) for 68 neocortical regions yielded constructs that defined shared cognition-brain structure relationships. Canonical discriminant analysis was used to integrate these constructs and efficiently summarize cognition-brain structure relationships across the psychosis continuum.

RESULTS

General cognition was associated with larger gray matter volumes and thicker cortices but smaller cortical surface area in frontoparietal regions. Working memory was associated with larger volume and surface area in frontotemporal regions. Faster response speed was associated with thicker frontal cortices. Constructs that captured general cognitive ability and working memory and their relationship to cortical volumes primarily defined an ordered psychosis spectrum (purely affective, least abnormal through purely nonaffective, and most abnormal). A construct that captured general cognitive ability and its relationship to cortical surface area differentiated purely affective cases from other groups.

CONCLUSIONS

General cognition and working memory with cortical volume deviations characterized more nonaffective psychoses. Alternatively, affective psychosis cases with general cognitive deficits had deviations in cortical surface area, perhaps accounting for heterogeneous findings across previous studies.

Solving the prefrontal conundrum of high-order anxiety: conciliating HOTEC and hypofrontality. A theoretical review

INTRODUCTION

According to the High-order Theory of Emotional Consciousness (HOTEC), every emotional process is a conscious and high-order state of mind carried out by the General Networks of Cognition (GNC), which consists mainly of prefrontal mechanisms. This means that anxiety is also an emotional state of mind carried out by the GNC (positive correlation). However, numerous studies have suggested what is commonly called "hypofrontality" during states of anxiety (negative correlation), which seems to give rise to a theoretical and empirical contraction.

METHODS

I present a theoretical review to address the following issue: how to advocate a HOTEC view of anxiety in the face of a growing paradigm of hypofrontality during states of anxiety?

RESULTS

Here I propose that dmPFC, the dACC, and the anterior insula are GNC areas positively correlated with anxiety, which, along with the prefrontal areas responsible for regulating the activation of survival circuits and driving the attention to adaptive ways to overcome potential threats, form an interconnective model of anticipatory and regulatory mechanisms related to learned threats based on autobiographical memories.

CONCLUSIONS

Through this model, I propose that HOTEC is still a valid way to approach and understand both healthy and unhealthy anxious states of mind.

Unilateral spatial neglect in the acute phase of ischemic stroke can predict long-term disability and functional capacity

OBJECTIVE

The aim of this study was to assess the relationship between the degree of unilateral spatial neglect during the acute phase of stroke and long-term functional independence.

METHODS

This was a prospective study of right ischemic stroke patients in which the independent variable was the degree of spatial neglect and the outcome that was measured was functional independence. The potential confounding factors included sex, age, stroke severity, topography of the lesion, risk factors, glycemia and the treatment received. Unilateral spatial neglect was measured using the line cancellation test, the star cancellation test and the line bisection test within 48 hours of the onset of symptoms. Functional independence was measured using the modified Rankin and Barthel scales at 90 days after discharge. The relationship between unilateral spatial neglect and functional independence was analyzed using multiple logistic regression that was corrected for confounding factors.

RESULTS

We studied 60 patients with a median age of 68 (34-89) years, 52% of whom were male and 74% of whom were Caucasian. The risk for moderate to severe disability increased with increasing star cancellation test scores (OR=1.14 [1.03-1.26], p=0.01) corrected for the stroke severity, which was a confounding factor that had a statistically positive association with disability (OR=1.63 [1.13-2.65], p=0.01). The best chance of functional independence decreased with increasing star cancellation test scores (OR=0.86 [0.78-0.96], p=0.006) corrected for the stroke severity, which was a confounding factor that had a statistically negative association with independence (OR=0.66 [0.48-0.92], p=0.017).

CONCLUSION

The severity of unilateral spatial neglect in acute stroke worsens the degree of long-term disability and functional independence.

A novel approach to probabilistic characterisation of neural firing patterns

BACKGROUND

The advances in extracellular neural recording techniques result in big data volumes that necessitate fast, reliable, and automatic identification of statistically similar units. This study proposes a single framework yielding a compact set of probabilistic descriptors that characterise the firing patterns of a single unit.

NEW METHOD

Probabilistic features are estimated from an inter-spike-interval time series, without assumptions about the firing distribution or the stationarity. The first level of proposed firing patterns decomposition divides the inter-spike intervals into bursting, moderate and idle firing modes, yielding a coarse feature set. The second level identifies the successive bursting spikes, or the spiking acceleration/deceleration in the moderate firing mode, yielding a refined feature set. The features are estimated from simulated data and from experimental recordings from the lateral prefrontal cortex in awake, behaving rhesus monkeys.

RESULTS

An efficient and stable partitioning of neural units is provided by the ensemble evidence accumulation clustering. The possibility of selecting the number of clusters and choosing among coarse and refined feature sets provides an opportunity to explore and compare different data partitions.

CONCLUSIONS

The estimation of features, if applied to a single unit, can serve as a tool for the firing analysis, observing either overall spiking activity or the periods of interest in trial-to-trial recordings. If applied to massively parallel recordings, it additionally serves as an input to the clustering procedure, with the potential to compare the functional properties of various brain structures and to link the types of neural cells to the particular behavioural states.

Contrasting effects of individual versus combined estrogen and progestogen regimens as working memory load increases in middle-aged ovariectomized rats: one plus one does not equal two

Most estrogen-based hormone therapies are administered in combination with a progestogen, such as Levonorgestrel (Levo). Individually, the estrogen 17β-estradiol (E2) and Levo can improve cognition in preclinical models. However, although these hormones are often given together clinically, the impact of the E2 + Levo combination on cognitive function has yet to be methodically examined. Thus, we investigated E2 + Levo treatment on a cognitive battery in middle-aged, ovariectomized rats. When administered alone, E2 and Levo treatments each enhanced spatial working memory relative to vehicle treatment, whereas the E2 + Levo combination impaired high working memory load performance relative to E2 only and Levo only treatments. There were no effects on spatial reference memory. Mitogen-activated protein kinases/extracellular signal-regulated kinases pathway activation, which is involved in memory formation and estrogen-induced memory effects, was evaluated in 5 brain regions implicated in learning and memory. A distinct relationship was seen in the E2-only treatment group between mitogen-activated protein kinases/extracellular signal-regulated kinases pathway activation in the frontal cortex and working memory performance. Collectively, the results indicate that the differential neurocognitive effects of combination versus sole treatments are vital considerations as we move forward as a field to develop novel, and to understand currently used, exogenous hormone regimens across the lifespan.

Neuronal Assemblies Evidence Distributed Interactions within a Tactile Discrimination Task in Rats

Accumulating evidence suggests that neural interactions are distributed and relate to animal behavior, but many open questions remain. The neural assembly hypothesis, formulated by Hebb, states that synchronously active single neurons may transiently organize into functional neural circuits-neuronal assemblies (NAs)-and that would constitute the fundamental unit of information processing in the brain. However, the formation, vanishing, and temporal evolution of NAs are not fully understood. In particular, characterizing NAs in multiple brain regions over the course of behavioral tasks is relevant to assess the highly distributed nature of brain processing. In the context of NA characterization, active tactile discrimination tasks with rats are elucidative because they engage several cortical areas in the processing of information that are otherwise masked in passive or anesthetized scenarios. In this work, we investigate the dynamic formation of NAs within and among four different cortical regions in long-range fronto-parieto-occipital networks (primary somatosensory, primary visual, prefrontal, and posterior parietal cortices), simultaneously recorded from seven rats engaged in an active tactile discrimination task. Our results first confirm that task-related neuronal firing rate dynamics in all four regions is significantly modulated. Notably, a support vector machine decoder reveals that neural populations contain more information about the tactile stimulus than the majority of single neurons alone. Then, over the course of the task, we identify the emergence and vanishing of NAs whose participating neurons are shown to contain more information about animal behavior than randomly chosen neurons. Taken together, our results further support the role of multiple and distributed neurons as the functional unit of information processing in the brain (NA hypothesis) and their link to active animal behavior.

Callosal injury-induced working memory impairment: a computational network modeling study

Mild traumatic brain injury (mTBI) often results in working memory (WM) impairment, but the mechanistic relationship between the two remains elusive. We used a computational model of two cortical neuronal networks linked by myelinated callosal axons with distance-dependent conduction delays to simulate callosal dysfunction in mTBI and quantify its impact on WM. WM maintenance and termination in the model network depended on short-term synaptic plasticity. In injured networks, WM duration depended on the extent of callosal injury, consistent with clinical data. The model provides a framework for studying callosal injury-induced neurobehavioral alterations following mTBI, and, to the best of our knowledge, is the first computational model to address mTBI-induced WM impairment.

Associations of differential schizotypal dimensions with executive working memory: A moderated-mediation analysis

BACKGROUND

Increased schizotypal traits are observed in a percentage of the general population and in the schizophrenia-spectrum and have been associated with impairments in working memory. In this study we examined the effects of four schizotypal dimensions [Negative (NegS), Paranoid (ParS), Cognitive-Perceptual (CPS), Disorganized (DiS)] on executive working memory (EWM), as mediated by set-shifting, planning and control inhibition. We also examined whether these associations are moderated by family-history of psychosis.

METHODS

Our sample consisted of 110 unaffected first-degree relatives of schizophrenia-spectrum patients and 120 control individuals. Schizotypy was assessed with the Schizotypal Personality Questionnaire. Participants were also tested with the Letter-Number Sequencing, Wisconsin Card Sorting, Stroop Color-Word and Stockings of Cambridge tasks. The effects of set-shifting, control inhibition and planning on the relationship between schizotypy and EWM were examined with mediation analyses. Moderated-mediation analyses examined potential moderating effects of group membership (unaffected relative/community participant).

RESULTS

All mediators were significant in the relationship between NegS and EWM. The effects of ParS were mediated only by set-shifting and planning. Planning and control inhibition were the only significant mediators on the effects of CPS and DiS on EWM, respectively. The moderated-mediation analyses revealed that these findings apply only in the community group.

CONCLUSIONS

We found that the effects of different schizotypal dimensions on EWM are mediated by other cognitive processes in individuals without personal/family history of psychosis. This is probably due to either more severe impairments in the cognitive processes of the relatives or restrictions in our sample and study-design.

How the prefrontal executive got its stripes

Pathways from cortical and subcortical structures give the prefrontal cortex a panoramic view of the sensory environment and the internal milieu of motives and drives. The prefrontal cortex also receives privileged information from the output of the basal ganglia and cerebellum and innervates widely the inhibitory thalamic reticular nucleus that gates thalamo-cortical communication. Connections, in general, are strongly related to the systematic structural variation of the cortex that can be traced to development. Insights from development have profound implications for the special connections of the prefrontal cortex for executive control, learning and memory, and vulnerability in psychiatric and neurologic diseases.

Behavioral and transcriptomic profiling of mice null for Lphn3, a gene implicated in ADHD and addiction

Background

The Latrophilin 3 (LPHN3) gene (recently renamed Adhesion G protein‐coupled receptor L3 (ADGRL3)) has been linked to susceptibility to attention deficit/hyperactivity disorder (ADHD) and vulnerability to addiction. However, its role and function are not well understood as there are no known functional variants.

Methods

To characterize the function of this little known gene, we phenotyped Lphn3 null mice. We assessed motivation for food reward and working memory via instrumental responding tasks, motor coordination via rotarod, and depressive‐like behavior via forced swim. We also measured neurite outgrowth of primary hippocampal and cortical neuron cultures. Standard blood chemistries and blood counts were performed. Finally, we also evaluated the transcriptome in several brain regions.

Results

Behaviorally, loss of Lphn3 increases both reward motivation and activity levels. Lphn3 null mice display significantly greater instrumental responding for food than wild‐type mice, particularly under high response ratios, and swim incessantly during a forced swim assay. However, loss of Lphn3 does not interfere with working memory or motor coordination. Primary hippocampal and cortical neuron cultures demonstrate that null neurons display comparatively enhanced neurite outgrowth after 2 and 3 days in vitro. Standard blood chemistry panels reveal that nulls have low serum calcium levels. Finally, analysis of the transcriptome from prefrontal cortical, striatal, and hippocampal tissue at different developmental time points shows that loss of Lphn3 results in genotype‐dependent differential gene expression (DGE), particularly for cell adhesion molecules and calcium signaling proteins. Much of the DGE is attenuated with age, and is consistent with the idea that ADHD is associated with delayed cortical maturation.

Conclusions

Transcriptome changes likely affect neuron structure and function, leading to behavioral anomalies consistent with both ADHD and addiction phenotypes. The data should further motivate analyses of Lphn3 function in the developmental timing of altered gene expression and calcium signaling, and their effects on neuronal structure/function during development.

Variability in Dopamine Genes Dissociates Model-Based and Model-Free Reinforcement Learning

Considerable evidence suggests that multiple learning systems can drive behavior. Choice can proceed reflexively from previous actions and their associated outcomes, as captured by "model-free" learning algorithms, or flexibly from prospective consideration of outcomes that might occur, as captured by "model-based" learning algorithms. However, differential contributions of dopamine to these systems are poorly understood. Dopamine is widely thought to support model-free learning by modulating plasticity in striatum. Model-based learning may also be affected by these striatal effects, or by other dopaminergic effects elsewhere, notably on prefrontal working memory function. Indeed, prominent demonstrations linking striatal dopamine to putatively model-free learning did not rule out model-based effects, whereas other studies have reported dopaminergic modulation of verifiably model-based learning, but without distinguishing a prefrontal versus striatal locus. To clarify the relationships between dopamine, neural systems, and learning strategies, we combine a genetic association approach in humans with two well-studied reinforcement learning tasks: one isolating model-based from model-free behavior and the other sensitive to key aspects of striatal plasticity. Prefrontal function was indexed by a polymorphism in the COMT gene, differences of which reflect dopamine levels in the prefrontal cortex. This polymorphism has been associated with differences in prefrontal activity and working memory. Striatal function was indexed by a gene coding for DARPP-32, which is densely expressed in the striatum where it is necessary for synaptic plasticity. We found evidence for our hypothesis that variations in prefrontal dopamine relate to model-based learning, whereas variations in striatal dopamine function relate to model-free learning.

SIGNIFICANCE STATEMENT

Decisions can stem reflexively from their previously associated outcomes or flexibly from deliberative consideration of potential choice outcomes. Research implicates a dopamine-dependent striatal learning mechanism in the former type of choice. Although recent work has indicated that dopamine is also involved in flexible, goal-directed decision-making, it remains unclear whether it also contributes via striatum or via the dopamine-dependent working memory function of prefrontal cortex. We examined genetic indices of dopamine function in these regions and their relation to the two choice strategies. We found that striatal dopamine function related most clearly to the reflexive strategy, as previously shown, and that prefrontal dopamine related most clearly to the flexible strategy. These findings suggest that dissociable brain regions support dissociable choice strategies.

Low intensity magnetic field influences short-term memory: A study in a group of healthy students

This study analyzes if an external magnetic stimulus (2 kHz and approximately 0.1 μT applied near frontal cortex) influences working memory, perception, binary decision, motor execution, and sustained attention in humans. A magnetic stimulus and a sham stimulus were applied to both sides of the head (frontal cortex close to temporal-parietal area) in young and healthy male test subjects (n = 65) while performing Sternberg's memory scanning task. There was a significant change in reaction time. Times recorded for perception, sustained attention, and motor execution were lower in exposed subjects (P < 0.01). However, time employed in binary decision increased for subjects exposed to magnetic fields. From results, it seems that a low intensity 2 kHz exposure modifies short-term working memory, as well as perception, binary decision, motor execution, and sustained attention.

Pharmacological interventions for unilateral spatial neglect after stroke

BACKGROUND

Unilateral spatial neglect (USN) is characterized by the inability to report or respond to people or objects presented on the side contralateral to the lesioned side of the brain and has been associated with poor functional outcomes and long stays in hospitals and rehabilitation centers. Pharmacological interventions (medical interventions only, use of drugs to improve the health condition), such as dopamine and noradrenergic agonists or pro-cholinergic treatment, have been used in people affected by USN after stroke, and effects of these treatments could provide new insights for health professionals and policy makers.

OBJECTIVES

To evaluate the effectiveness and safety of pharmacological interventions for USN after stroke.

SEARCH METHODS

We searched the Cochrane Stroke Group Trials Register (April 2015), the Cochrane Central Register of Controlled Trials (April 2015), MEDLINE (1946 to April 2015), the Cumulative Index to Nursing and Allied Health Literature (CINAHL) (1982 to April 2015), EMBASE (1980 to April 2015), PsycINFO (1806 to April 2015) and Latin American Caribbean Health Sciences Literature (LILACS) (1982 to April 2015). We also searched trials and research registers, screened reference lists, and contacted study authors and pharmaceutical companies (April 2015).

SELECTION CRITERIA

We included randomized controlled trials (RCTs) and quasi-randomized controlled trials (quasi-RCTs) of pharmacological interventions for USN after stroke.

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed risk of bias in the included studies and extracted data.

MAIN RESULTS

We included in the review two studies with a total of 30 randomly assigned participants. We rated the quality of the evidence as very low as the result of study limitations, small numbers of events, and small sample sizes, with imprecision in the confidence interval (CI). We were not able to perform meta-analysis because of heterogeneity related to the different interventions evaluated between included studies. Very low-quality evidence from one trial (20 participants) comparing effects of rivastigmine plus rehabilitation versus rehabilitation on overall USN at discharge showed the following: Barrage (mean difference (MD) 0.30, 95% confidence interval (CI) -0.18 to 0.78); Letter Cancellation (MD 10.60, 95% CI 2.07 to 19.13); Sentence Reading (MD 0.20, 95% CI -0.69 to 1.09), and the Wundt-Jastrow Area Illusion Test (MD -4.40, 95% CI -8.28 to -0.52); no statistical significance was observed for the same outcomes at 30 days' follow-up. In another trial (10 participants), study authors showed statistically significant reduction in omissions in the three cancellation tasks under transdermal nicotine treatment (mean number of omissions 2.93 ± 0.5) compared with both baseline (4.95 ± 0.8) and placebo (5.14 ± 0.9) (main effect of treatment condition: F (2.23) = 11.06; P value < 0.0001). One major adverse event occurred in the transdermal nicotine treatment group, and treatment was discontinued in the affected participant. None of the included trials reported data on several of the prespecified outcomes (falls, balance, depression or anxiety, poststroke fatigue, and quality of life).

AUTHORS' CONCLUSIONS

The quality of the evidence from available RCTs was very low. The effectiveness and safety of pharmacological interventions for USN after stroke are therefore uncertain. Additional large RCTs are needed to evaluate these treatments.

Dynamic trajectory of multiple single-unit activity during working memory task in rats

Working memory plays an important role in complex cognitive tasks. A popular theoretical view is that transient properties of neuronal dynamics underlie cognitive processing. The question raised here as to how the transient dynamics evolve in working memory. To address this issue, we investigated the multiple single-unit activity dynamics in rat medial prefrontal cortex (mPFC) during a Y-maze working memory task. The approach worked by reconstructing state space from delays of the original single-unit firing rate variables, which were further analyzed using kernel principal component analysis (KPCA). Then the neural trajectories were obtained to visualize the multiple single-unit activity. Furthermore, the maximal Lyapunov exponent (MLE) was calculated to quantitatively evaluate the neural trajectories during the working memory task. The results showed that the neuronal activity produced stable and reproducible neural trajectories in the correct trials while showed irregular trajectories in the incorrect trials, which may establish a link between the neurocognitive process and behavioral performance in working memory. The MLEs significantly increased during working memory in the correctly performed trials, indicating an increased divergence of the neural trajectories. In the incorrect trials, the MLEs were nearly zero and remained unchanged during the task. Taken together, the trial-specific neural trajectory provides an effective way to track the instantaneous state of the neuronal population during the working memory task and offers valuable insights into working memory function. The MLE describes the changes of neural dynamics in working memory and may reflect different neuronal population states in working memory.

Transient inactivation of the medial prefrontal cortex impairs performance on a working memory-dependent conditional discrimination task

The rodent medial prefrontal cortex (mPFC) has been implicated in working memory function; lesions and inactivation of this region have been shown to result in impairments in spatial working memory (WM) tasks. Our laboratory has developed a tactile-visual conditional discrimination (CD) task, which uses floor insert cues to signal the correct goal-arm choice in a T maze. This task can be manipulated by altering the floor insert cues to be present throughout the trial (CDSTANDARD) or to be present only at the beginning of the trial (CDWM), thus making the task either WM-independent or WM-dependent, respectively. This ability to manipulate the working memory demand of the task while holding all other task features constant allows us to rule out the possibility that confounding performance variables contribute to the observed impairment. A previous study from our lab showed that mPFC inactivation did not impair performance on CDSTANDARD, confirming that mPFC inactivation does not induce sensorimotor or motivational deficits that could impact task performance. To examine whether mPFC inactivation impairs CDWM, the current study transiently inactivated the mPFC with bilateral microinfusions of muscimol immediately prior to testing on the CDWM task. As predicted, CDWM task performance was significantly impaired during the muscimol-infusion session compared with the control saline-infusion sessions. Together with our previous demonstration that the mPFC in not required for CDSTANDARD, these results not only confirm that the mPFC is crucial for working memory, but also set the stage for using the task-comparison approach to investigate corticolimbic interactions during working memory.

Neuronal representation of working memory in the medial prefrontal cortex of rats

Working memory is a process for short-term active maintenance of information. Behavioral neurophysiological studies in monkeys have demonstrated that the dorsolateral prefrontal cortex (dlPFC) is a key cortical region for working memory. The medial prefrontal cortex (mPFC) in rats is a cortical area similar to the dlPFC in monkeys in terms of anatomical connections, and is also required for behavioral performance on working-memory tasks. However, it is still controversial regarding whether and how mPFC neurons encode working memory. In the present study, we trained rats on a two-choice spatial delayed alternation task in Y maze, a typical working memory task for rodents, and investigated neuronal activities in the mPFC when rats performed the task. Our results show that, (1) inactivation of the mPFC severely impaired the performance of rats on the task, consistent with previous studies showing the importance of the mPFC for working-memory tasks; (2) 93.7% mPFC cells (449 in 479) exhibited changes in spiking frequency that were temporally locked with the task events, some of which, including delay-related cells, were tuned by spatial information; (3) differential delay activities in individual mPFC cells appeared transiently and sequentially along the delay, especially during the early phase of the delay; (4) some mPFC cells showed no change in discharge frequency but exhibited differential synchronization in firing during the delay. The present results suggest that mPFC neurons in rats are involved in encoding working memory, via increasing firing frequency or synchronization.

cGMP-dependent protein kinase type II knockout mice exhibit working memory impairments, decreased repetitive behavior, and increased anxiety-like traits

Neuronal activity regulates AMPA receptor trafficking, a process that mediates changes in synaptic strength, a key component of learning and memory. This form of plasticity may be induced by stimulation of the NMDA receptor which, among its activities, increases cyclic guanosine monophosphate (cGMP) through the nitric oxide synthase pathway. cGMP-dependent protein kinase type II (cGKII) is ultimately activated via this mechanism and AMPA receptor subunit GluA1 is phosphorylated at serine 845. This phosphorylation contributes to the delivery of GluA1 to the synapse, a step that increases synaptic strength. Previous studies have shown that cGKII-deficient mice display striking spatial learning deficits in the Morris Water Maze compared to wild-type littermates as well as lowered GluA1 phosphorylation in the postsynaptic density of the prefrontal cortex (Serulle et al., 2007; Wincott et al., 2013). In the current study, we show that cGKII knockout mice exhibit impaired working memory as determined using the prefrontal cortex-dependent Radial Arm Maze (RAM). Additionally, we report reduced repetitive behavior in the Marble Burying task (MB), and heightened anxiety-like traits in the Novelty Suppressed Feeding Test (NSFT). These data suggest that cGKII may play a role in the integration of information that conveys both anxiety-provoking stimuli as well as the spatial and environmental cues that facilitate functional memory processes and appropriate behavioral response.

Neural activity in mediodorsal nucleus of thalamus in rats performing a working memory task

The neural circuit consisting of mediodorsal nucleus (MDN) of thalamus and prefrontal cortex (PFC) has been implicated in working memory. In order to investigate whether and how the rodent MDN processes working memory-related signals, we recorded activity of single neurons from the MDN in rats performing a delayed spatial alternation task. The MDN conveyed significant neural signals for the animal's previously chosen goal (retrospective information) in the early delay period, but the signals deteriorated gradually over time so that they became weak toward the end of the delay period. Neural signals for the animal's upcoming goal choice (prospective information) were even weaker than those for the previously chosen goal. These results are in contrast to the finding in monkeys that both MDN and PFC persistently maintain task-related neural signals throughout delay period. Our results do not support sustained MDN-PFC interactions as a general mechanism for mediating working memory across different behavioral tasks and/or animal species.

Thalamic mediodorsal nucleus and its participation in spatial working memory processes: comparison with the prefrontal cortex

Working memory is a dynamic neural system that includes processes for temporarily maintaining and processing information. Working memory plays a significant role in a variety of cognitive functions, such as thinking, reasoning, decision-making, and language comprehension. Although the prefrontal cortex (PFC) is known to play an important role in working memory, several lines of evidence indicate that the thalamic mediodorsal nucleus (MD) also participates in this process. While monkeys perform spatial working memory tasks, MD neurons exhibit directionally selective delay-period activity, which is considered to be a neural correlate for the temporary maintenance of information in PFC neurons. Studies have also shown that, while most MD neurons maintain prospective motor information, some maintain retrospective sensory information. Thus, the MD plays a greater role in prospective motor aspects of working memory processes than the PFC, which participates more in retrospective aspects. For the performance of spatial working memory tasks, the information provided by a sensory cue needs to be transformed into motor information to give an appropriate response. A population vector analysis using neural activities revealed that, although the transformation of sensory-to-motor information occurred during the delay period in both the PFC and the MD, PFC activities maintained sensory information until the late phase of the delay period, while MD activities initially represented sensory information but then started to represent motor information in the earlier phase of the delay period. These results indicate that long-range neural interactions supported by reciprocal connections between the MD and the PFC could play an important role in the transformation of maintained information in working memory processes.

Current status on behavioral and biological markers of PTSD: a search for clarity in a conflicting literature

Extensive research has identified stereotypic behavioral and biological abnormalities in post-traumatic stress disorder (PTSD), such as heightened autonomic activity, an exaggerated startle response, reduced basal cortisol levels and cognitive impairments. We have reviewed primary research in this area, noting that factors involved in the susceptibility and expression of PTSD symptoms are more complex and heterogeneous than is commonly stated, with extensive findings which are inconsistent with the stereotypic behavioral and biological profile of the PTSD patient. A thorough assessment of the literature indicates that interactions among myriad susceptibility factors, including social support, early life stress, sex, age, peri- and post-traumatic dissociation, cognitive appraisal of trauma, neuroendocrine abnormalities and gene polymorphisms, in conjunction with the inconsistent expression of the disorder across studies, confounds attempts to characterize PTSD as a monolithic disorder. Overall, our assessment of the literature addresses the great challenge in developing a behavioral and biomarker-based diagnosis of PTSD.

The effects of the dopamine agonist rotigotine on hemispatial neglect following stroke

Hemispatial neglect following right-hemisphere stroke is a common and disabling disorder, for which there is currently no effective pharmacological treatment. Dopamine agonists have been shown to play a role in selective attention and working memory, two core cognitive components of neglect. Here, we investigated whether the dopamine agonist rotigotine would have a beneficial effect on hemispatial neglect in stroke patients. A double-blind, randomized, placebo-controlled ABA design was used, in which each patient was assessed for 20 testing sessions, in three phases: pretreatment (Phase A1), on transdermal rotigotine for 7-11 days (Phase B) and post-treatment (Phase A2), with the exact duration of each phase randomized within limits. Outcome measures included performance on cancellation (visual search), line bisection, visual working memory, selective attention and sustained attention tasks, as well as measures of motor control. Sixteen right-hemisphere stroke patients were recruited, all of whom completed the trial. Performance on the Mesulam shape cancellation task improved significantly while on rotigotine, with the number of targets found on the left side increasing by 12.8% (P = 0.012) on treatment and spatial bias reducing by 8.1% (P = 0.016). This improvement in visual search was associated with an enhancement in selective attention but not on our measures of working memory or sustained attention. The positive effect of rotigotine on visual search was not associated with the degree of preservation of prefrontal cortex and occurred even in patients with significant prefrontal involvement. Rotigotine was not associated with any significant improvement in motor performance. This proof-of-concept study suggests a beneficial role of dopaminergic modulation on visual search and selective attention in patients with hemispatial neglect following stroke.

Plasticity in D1-like receptor expression is associated with different components of cognitive processes

Dopamine D1-like receptors consist of D1 (D1A) and D5 (D1B) receptors and play a key role in working memory. However, their possibly differential contribution to working memory is unclear. We combined a working memory training protocol with a stepwise increase of cognitive subcomponents and real-time RT-PCR analysis of dopamine receptor expression in pigeons to identify molecular changes that accompany training of isolated cognitive subfunctions. In birds, the D1-like receptor family is extended and consists of the D1A, D1B, and D1D receptors. Our data show that D1B receptor plasticity follows a training that includes active mental maintenance of information, whereas D1A and D1D receptor plasticity in addition accompanies learning of stimulus-response associations. Plasticity of D1-like receptors plays no role for processes like response selection and stimulus discrimination. None of the tasks altered D2 receptor expression. Our study shows that different cognitive components of working memory training have distinguishable effects on D1-like receptor expression.

Space representation in the prefrontal cortex

The representation of space and its function in the prefrontal cortex have been examined using a variety of behavioral tasks. Among them, since the delayed-response task requires the temporary maintenance of spatial information, this task has been used to examine the mechanisms of spatial representation. In addition, the concept of working memory to explain prefrontal functions has helped us to understand the nature and functions of space representation in the prefrontal cortex. The detailed analysis of delay-period activity observed in spatial working memory tasks has provided important information for understanding space representation in the prefrontal cortex. Directional delay-period activity has been shown to be a neural correlate of the mechanism for temporarily maintaining information and represent spatial information for the visual cue and the saccade. In addition, many task-related prefrontal neurons exhibit spatially selective activities. These neurons are also important components of spatial information processing. In fact, information flow from sensory-related neurons to motor-related neurons has been demonstrated, along with a change in spatial representation as the trial progresses. The dynamic functional interactions among neurons exhibiting different task-related activities and representing different aspects of information could play an essential role in information processing. In addition, information provided from other cortical or subcortical areas might also be necessary for the representation of space in the prefrontal cortex. To better understand the representation of space and its function in the prefrontal cortex, we need to understand the nature of functional interactions between the prefrontal cortex and other cortical and subcortical areas.

Pyramidal cells in prefrontal cortex of primates: marked differences in neuronal structure among species

The most ubiquitous neuron in the cerebral cortex, the pyramidal cell, is characterized by markedly different dendritic structure among different cortical areas. The complex pyramidal cell phenotype in granular prefrontal cortex (gPFC) of higher primates endows specific biophysical properties and patterns of connectivity, which differ from those in other cortical regions. However, within the gPFC, data have been sampled from only a select few cortical areas. The gPFC of species such as human and macaque monkey includes more than 10 cortical areas. It remains unknown as to what degree pyramidal cell structure may vary among these cortical areas. Here we undertook a survey of pyramidal cells in the dorsolateral, medial, and orbital gPFC of cercopithecid primates. We found marked heterogeneity in pyramidal cell structure within and between these regions. Moreover, trends for gradients in neuronal complexity varied among species. As the structure of neurons determines their computational abilities, memory storage capacity and connectivity, we propose that these specializations in the pyramidal cell phenotype are an important determinant of species-specific executive cortical functions in primates.

Spatiotemporal tuning of brain activity and force performance

The spatial and temporal features of visual stimuli are either processed independently or are conflated in specific cells of visual cortex. Although spatial and temporal features of visual stimuli influence motor performance, it remains unclear how spatiotemporal information is processed beyond visual cortex in brain regions that control movement. We used functional magnetic resonance imaging to examine how brain activity and force control are influenced by visual gain at a high visual feedback frequency of 6.4 Hz and a low visual feedback frequency of 0.4 Hz. At 6.4 Hz, increasing visual gain led to improved force performance and increased activity in classic areas of the visuomotor system-V5, IPL, SPL, PMv, SMA-proper, and M1. At 0.4 Hz, increasing gain also led to improved force performance. In addition to activation in M1/PMd and IPL in the visuomotor system, increasing visual gain at 0.4 Hz also corresponded with activity in the striatal-frontal circuit including DLPFC, ACC, and widespread activity in putamen, caudate, and SMA-proper. This study demonstrates that the frequency of visual feedback drives where in the brain visual gain mediated reductions in force error are regulated.

Reward acts as a signal to control delay-period activity in delayed-response tasks

Prefrontal delay-period activity represents a neural mechanism for the active maintenance of information and needs to be controlled by some signal to appropriately operate working memory. To examine whether reward-delivery acts as this signal, the effects of delay-period activity in response to unexpected reward-delivery were examined by analyzing single-neuron activity recorded in the primate dorsolateral prefrontal cortex. Among neurons that showed delay-period activity, 34% showed inhibition of this activity in response to unexpected reward-delivery. The delay-period activity of these neurons was affected by the expectation of reward-delivery. The strength of the reward signal in controlling the delay-period activity is related to the strength of the effect of reward information on the delay-period activity. These results indicate that reward-delivery acts as a signal to control delay-period activity.

The electrotonic structure of pyramidal neurons contributing to prefrontal cortical circuits in macaque monkeys is significantly altered in aging

Whereas neuronal numbers are largely preserved in normal aging, subtle morphological changes occur in dendrites and spines, whose electrotonic consequences remain unexplored. We examined age-related morphological alterations in 2 types of pyramidal neurons contributing to working memory circuits in the macaque prefrontal cortex (PFC): neurons in the superior temporal cortex forming "long" projections to the PFC and "local" projection neurons within the PFC. Global dendritic mass homeostasis, measured by 3-dimensional scaling analysis, was conserved with aging in both neuron types. Spine densities, dendrite diameters, lengths, and branching complexity were all significantly reduced in apical dendrites of long projection neurons with aging, but only spine parameters were altered in local projection neurons. Despite these differences, voltage attenuation due to passive electrotonic structure, assuming equivalent cable parameters, was significantly reduced with aging in the apical dendrites of both neuron classes. Confirming the electrotonic analysis, simulated passive backpropagating action potential efficacy was significantly higher in apical but not basal dendrites of old neurons. Unless compensated by changes in passive cable parameters, active membrane properties, or altered synaptic properties, these effects will increase the excitability of pyramidal neurons, compromising the precisely tuned activity required for working memory, ultimately resulting in age-related PFC dysfunction.