Flexible recruitment of memory-based choice representations by the human medial frontal cortex

Neural representational geometries reflect behavioral differences in monkeys and recurrent neural networks

Animals likely use a variety of strategies to solve laboratory tasks. Traditionally, combined analysis of behavioral and neural recording data across subjects employing different strategies may obscure important signals and give confusing results. Hence, it is essential to develop techniques that can infer strategy at the single-subject level. We analyzed an experiment in which two male monkeys performed a visually cued rule-based task. The analysis of their performance shows no indication that they used a different strategy. However, when we examined the geometry of stimulus representations in the state space of the neural activities recorded in dorsolateral prefrontal cortex, we found striking differences between the two monkeys. Our purely neural results induced us to reanalyze the behavior. The new analysis showed that the differences in representational geometry are associated with differences in the reaction times, revealing behavioral differences we were unaware of. All these analyses suggest that the monkeys are using different strategies. Finally, using recurrent neural network models trained to perform the same task, we show that these strategies correlate with the amount of training, suggesting a possible explanation for the observed neural and behavioral differences.

Neural dynamics underlying minute-timescale persistent behavior in the human brain

The ability to pursue long-term goals relies on a representations of task context that can both be maintained over long periods of time and switched flexibly when goals change. Little is known about the neural substrate for such minute-scale maintenance of task sets. Utilizing recordings in neurosurgical patients, we examined how groups of neurons in the human medial frontal cortex and hippocampus represent task contexts. When cued explicitly, task context was encoded in both brain areas and changed rapidly at task boundaries. Hippocampus exhibited a temporally dynamic code with fast decorrelation over time, preventing cross-temporal generalization. Medial frontal cortex exhibited a static code that decorrelated slowly, allowing generalization across minutes of time. When task context needed to be inferred as a latent variable, hippocampus encoded task context with a static code. These findings reveal two possible regimes for encoding minute-scale task-context representations that were engaged differently based on task demands.

Persistent activity during working memory maintenance predicts long-term memory formation in the human hippocampus

Working Memory (WM) and Long-Term Memory (LTM) are often viewed as separate cognitive systems. Little is known about how these systems interact when forming memories. We recorded single neurons in the human medial temporal lobe while patients maintained novel items in WM and a subsequent recognition memory test for the same items. In the hippocampus but not the amygdala, the level of WM content-selective persist activity during WM maintenance was predictive of whether the item was later recognized with high confidence or forgotten. In contrast, visually evoked activity in the same cells was not predictive of LTM formation. During LTM retrieval, memory-selective neurons responded more strongly to familiar stimuli for which persistent activity was high while they were maintained in WM. Our study suggests that hippocampal persistent activity of the same cell supports both WM maintenance and LTM encoding, thereby revealing a common single-neuron component of these two memory systems.

A Comparison of Rapid Rule-Learning Strategies in Humans and Monkeys

Interspecies comparisons are key to deriving an understanding of the behavioral and neural correlates of human cognition from animal models. We perform a detailed comparison of the strategies of female macaque monkeys to male and female humans on a variant of the Wisconsin Card Sorting Test (WCST), a widely studied and applied task that provides a multiattribute measure of cognitive function and depends on the frontal lobe. WCST performance requires the inference of a rule change given ambiguous feedback. We found that well-trained monkeys infer new rules three times more slowly than minimally instructed humans. Input-dependent hidden Markov model-generalized linear models were fit to their choices, revealing hidden states akin to feature-based attention in both species. Decision processes resembled a win-stay, lose-shift strategy with interspecies similarities as well as key differences. Monkeys and humans both test multiple rule hypotheses over a series of rule-search trials and perform inference-like computations to exclude candidate choice options. We quantitatively show that perseveration, random exploration, and poor sensitivity to negative feedback account for the slower task-switching performance in monkeys.

Contributions of repeated learning to memory in humans: insights from single-neuron recordings in the hippocampus and amygdala

Despite the well-established phenomenon of improved memory performance through repeated learning, studies investigating the associated neural mechanisms have yielded complex and sometimes contradictory findings, and direct evidence from human neuronal recordings has been lacking. This study employs single-neuron recordings with exceptional spatial-temporal resolution, combined with representational similarity analysis, to explore the neural dynamics within the hippocampus and amygdala during repeated learning. Our results demonstrate that in the hippocampus, repetition enhances both representational specificity and fidelity, with these features predicting learning times. Conversely, the amygdala exhibits heightened representational specificity and fidelity during initial learning but does not show improvement with repetition, suggesting functional specialization of the hippocampus and amygdala during different stages of the learning repetition. Specifically, the hippocampus appears to contribute to sustained engagement necessary for benefiting from repeated learning, while the amygdala may play a role in the representation of novel items. These findings contribute to a comprehensive understanding of the intricate interplay between these brain regions in memory processes. Significance statement  For over a century, understanding how repetition contributes to memory enhancement has captivated researchers, yet direct neuronal evidence has been lacking, with a primary focus on the hippocampus and a neglect of the neighboring amygdala. Employing advanced single-neuron recordings and analytical techniques, this study unveils a nuanced functional specialization within the amygdala-hippocampal circuit during various learning repetition. The results highlight the hippocampus's role in sustaining engagement for improved memory with repetition, contrasting with the amygdala's superior ability in representing novel items. This exploration not only deepens our comprehension of memory enhancement intricacies but also sheds light on potential interventions to optimize learning and memory processes.

Spontaneous persistent activity and inactivity in vivo reveals differential cortico-entorhinal functional connectivity

Understanding the functional connectivity between brain regions and its emergent dynamics is a central challenge. Here we present a theory-experiment hybrid approach involving iteration between a minimal computational model and in vivo electrophysiological measurements. Our model not only predicted spontaneous persistent activity (SPA) during Up-Down-State oscillations, but also inactivity (SPI), which has never been reported. These were confirmed in vivo in the membrane potential of neurons, especially from layer 3 of the medial and lateral entorhinal cortices. The data was then used to constrain two free parameters, yielding a unique, experimentally determined model for each neuron. Analytic and computational analysis of the model generated a dozen quantitative predictions about network dynamics, which were all confirmed in vivo to high accuracy. Our technique predicted functional connectivity; e. g. the recurrent excitation is stronger in the medial than lateral entorhinal cortex. This too was confirmed with connectomics data. This technique uncovers how differential cortico-entorhinal dialogue generates SPA and SPI, which could form an energetically efficient working-memory substrate and influence the consolidation of memories during sleep. More broadly, our procedure can reveal the functional connectivity of large networks and a theory of their emergent dynamics.

Natural language instructions induce compositional generalization in networks of neurons

A fundamental human cognitive feat is to interpret linguistic instructions in order to perform novel tasks without explicit task experience. Yet, the neural computations that might be used to accomplish this remain poorly understood. We use advances in natural language processing to create a neural model of generalization based on linguistic instructions. Models are trained on a set of common psychophysical tasks, and receive instructions embedded by a pretrained language model. Our best models can perform a previously unseen task with an average performance of 83% correct based solely on linguistic instructions (that is, zero-shot learning). We found that language scaffolds sensorimotor representations such that activity for interrelated tasks shares a common geometry with the semantic representations of instructions, allowing language to cue the proper composition of practiced skills in unseen settings. We show how this model generates a linguistic description of a novel task it has identified using only motor feedback, which can subsequently guide a partner model to perform the task. Our models offer several experimentally testable predictions outlining how linguistic information must be represented to facilitate flexible and general cognition in the human brain.

Orthogonal neural encoding of targets and distractors supports multivariate cognitive control

The complex challenges of our mental life require us to coordinate multiple forms of neural information processing. Recent behavioural studies have found that people can coordinate multiple forms of attention, but the underlying neural control process remains obscure. We hypothesized that the brain implements multivariate control by independently monitoring feature-specific difficulty and independently prioritizing feature-specific processing. During functional MRI, participants performed a parametric conflict task that separately tags target and distractor processing. Consistent with feature-specific monitoring, univariate analyses revealed spatially segregated encoding of target and distractor difficulty in the dorsal anterior cingulate cortex. Consistent with feature-specific attentional priority, our encoding geometry analysis revealed overlapping but orthogonal representations of target and distractor coherence in the intraparietal sulcus. Coherence representations were mediated by control demands and aligned with both performance and frontoparietal activity, consistent with top-down attention. Together, these findings provide evidence for the neural geometry necessary to coordinate multivariate cognitive control.

Control of working memory by phase-amplitude coupling of human hippocampal neurons

Retaining information in working memory is a demanding process that relies on cognitive control to protect memoranda-specific persistent activity from interference1,2. However, how cognitive control regulates working memory storage is unclear. Here we show that interactions of frontal control and hippocampal persistent activity are coordinated by theta-gamma phase-amplitude coupling (TG-PAC). We recorded single neurons in the human medial temporal and frontal lobe while patients maintained multiple items in their working memory. In the hippocampus, TG-PAC was indicative of working memory load and quality. We identified cells that selectively spiked during nonlinear interactions of theta phase and gamma amplitude. The spike timing of these PAC neurons was coordinated with frontal theta activity when cognitive control demand was high. By introducing noise correlations with persistently active neurons in the hippocampus, PAC neurons shaped the geometry of the population code. This led to higher-fidelity representations of working memory content that were associated with improved behaviour. Our results support a multicomponent architecture of working memory1,2, with frontal control managing maintenance of working memory content in storage-related areas3-5. Within this framework, hippocampal TG-PAC integrates cognitive control and working memory storage across brain areas, thereby suggesting a potential mechanism for top-down control over sensory-driven processes.

Nonlinear manifolds underlie neural population activity during behaviour

There is rich variety in the activity of single neurons recorded during behaviour. Yet, these diverse single neuron responses can be well described by relatively few patterns of neural co-modulation. The study of such low-dimensional structure of neural population activity has provided important insights into how the brain generates behaviour. Virtually all of these studies have used linear dimensionality reduction techniques to estimate these population-wide co-modulation patterns, constraining them to a flat "neural manifold". Here, we hypothesised that since neurons have nonlinear responses and make thousands of distributed and recurrent connections that likely amplify such nonlinearities, neural manifolds should be intrinsically nonlinear. Combining neural population recordings from monkey, mouse, and human motor cortex, and mouse striatum, we show that: 1) neural manifolds are intrinsically nonlinear; 2) their nonlinearity becomes more evident during complex tasks that require more varied activity patterns; and 3) manifold nonlinearity varies across architecturally distinct brain regions. Simulations using recurrent neural network models confirmed the proposed relationship between circuit connectivity and manifold nonlinearity, including the differences across architecturally distinct regions. Thus, neural manifolds underlying the generation of behaviour are inherently nonlinear, and properly accounting for such nonlinearities will be critical as neuroscientists move towards studying numerous brain regions involved in increasingly complex and naturalistic behaviours.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Tuned geometries of hippocampal representations meet the computational demands of social memory

Social memory consists of two processes: the detection of familiar compared with novel conspecifics and the detailed recollection of past social episodes. We investigated the neural bases for these processes using calcium imaging of dorsal CA2 hippocampal pyramidal neurons, known to be important for social memory, during social/spatial encounters with novel conspecifics and familiar littermates. Whereas novel individuals were represented in a low-dimensional geometry that allows for generalization of social identity across different spatial locations and of location across different identities, littermates were represented in a higher-dimensional geometry that supports high-capacity memory storage. Moreover, familiarity was represented in an abstract format, independent of individual identity. The degree to which familiarity increased the dimensionality of CA2 representations for individual mice predicted their performance in a social novelty recognition memory test. Thus, by tuning the geometry of structured neural activity, CA2 is able to meet the demands of distinct social memory processes.

Cortico-cerebellar coordination facilitates neuroprosthetic control

Temporally coordinated neural activity is central to nervous system function and purposeful behavior. Still, there is a paucity of evidence demonstrating how this coordinated activity within cortical and subcortical regions governs behavior. We investigated this between the primary motor (M1) and contralateral cerebellar cortex as rats learned a neuroprosthetic/brain-machine interface (BMI) task. In neuroprosthetic task, actuator movements are causally linked to M1 "direct" neurons that drive the decoder for successful task execution. However, it is unknown how task-related M1 activity interacts with the cerebellum. We observed a notable 3 to 6 hertz coherence that emerged between these regions' local field potentials (LFPs) with learning that also modulated task-related spiking. We identified robust task-related indirect modulation in the cerebellum, which developed a preferential relationship with M1 task-related activity. Inhibiting cerebellar cortical and deep nuclei activity through optogenetics led to performance impairments in M1-driven neuroprosthetic control. Together, these results demonstrate that cerebellar influence is necessary for M1-driven neuroprosthetic control.

Local field potentials, spiking activity, and receptive fields in human visual cortex

The concept of receptive field (RF) is central to sensory neuroscience. Neuronal RF properties have been substantially studied in animals, while those in humans remain nearly unexplored. Here, we measured neuronal RFs with intracranial local field potentials (LFPs) and spiking activity in human visual cortex (V1/V2/V3). We recorded LFPs via macro-contacts and discovered that RF sizes estimated from low-frequency activity (LFA, 0.5-30 Hz) were larger than those estimated from low-gamma activity (LGA, 30-60 Hz) and high-gamma activity (HGA, 60-150 Hz). We then took a rare opportunity to record LFPs and spiking activity via microwires in V1 simultaneously. We found that RF sizes and temporal profiles measured from LGA and HGA closely matched those from spiking activity. In sum, this study reveals that spiking activity of neurons in human visual cortex could be well approximated by LGA and HGA in RF estimation and temporal profile measurement, implying the pivotal functions of LGA and HGA in early visual information processing.

Multimodal single-neuron, intracranial EEG, and fMRI brain responses during movie watching in human patients

We present a multimodal dataset of intracranial recordings, fMRI, and eye tracking in 20 participants during movie watching. Recordings consist of single neurons, local field potential, and intracranial EEG activity acquired from depth electrodes targeting the amygdala, hippocampus, and medial frontal cortex implanted for monitoring of epileptic seizures. Participants watched an 8-min long excerpt from the video "Bang! You're Dead" and performed a recognition memory test for movie content. 3 T fMRI activity was recorded prior to surgery in 11 of these participants while performing the same task. This NWB- and BIDS-formatted dataset includes spike times, field potential activity, behavior, eye tracking, electrode locations, demographics, and functional and structural MRI scans. For technical validation, we provide signal quality metrics, assess eye tracking quality, behavior, the tuning of cells and high-frequency broadband power field potentials to familiarity and event boundaries, and show brain-wide inter-subject correlations for fMRI. This dataset will facilitate the investigation of brain activity during movie watching, recognition memory, and the neural basis of the fMRI-BOLD signal.

Dataset of human-single neuron activity during a Sternberg working memory task

We present a dataset of 1809 single neurons recorded from the human medial temporal lobe (amygdala and hippocampus) and medial frontal lobe (anterior cingulate cortex, pre-supplementary motor area, ventral medial prefrontal cortex) across 41 sessions from 21 patients that underwent seizure monitoring with depth electrodes. Subjects performed a screening task (907 neurons) to identify images for which highly selective cells were present. Subjects then performed a working memory task (902 neurons), in which they were sequentially presented with 1-3 images for which highly selective cells were present and, following a maintenance period, were asked if the probe was identical to one of the maintained images. This Neurodata Without Borders formatted dataset includes spike times, extracellular spike waveforms, stimuli presented, behavior, electrode locations, and subject demographics. As validation, we replicate previous findings on the selectivity of concept cells and their persistent activity during working memory maintenance. This large dataset of rare human single-neuron recordings and behavior enables the investigation of the neural mechanisms of working memory in humans.

MTL neurons phase-lock to human hippocampal theta

Memory formation depends on neural activity across a network of regions, including the hippocampus and broader medial temporal lobe (MTL). Interactions between these regions have been studied indirectly using functional MRI, but the bases for interregional communication at a cellular level remain poorly understood. Here, we evaluate the hypothesis that oscillatory currents in the hippocampus synchronize the firing of neurons both within and outside the hippocampus. We recorded extracellular spikes from 1854 single- and multi-units simultaneously with hippocampal local field potentials (LFPs) in 28 neurosurgical patients who completed virtual navigation experiments. A majority of hippocampal neurons phase-locked to oscillations in the slow (2-4 Hz) or fast (6-10 Hz) theta bands, with a significant subset exhibiting nested slow theta × beta frequency (13-20 Hz) phase-locking. Outside of the hippocampus, phase-locking to hippocampal oscillations occurred only at theta frequencies and primarily among neurons in the entorhinal cortex and amygdala. Moreover, extrahippocampal neurons phase-locked to hippocampal theta even when theta did not appear locally. These results indicate that spike-time synchronization with hippocampal theta is a defining feature of neuronal activity in the hippocampus and structurally connected MTL regions. Theta phase-locking could mediate flexible communication with the hippocampus to influence the content and quality of memories.

A view-based decision mechanism for rewards in the primate amygdala

Primates make decisions visually by shifting their view from one object to the next, comparing values between objects, and choosing the best reward, even before acting. Here, we show that when monkeys make value-guided choices, amygdala neurons encode their decisions in an abstract, purely internal representation defined by the monkey's current view but not by specific object or reward properties. Across amygdala subdivisions, recorded activity patterns evolved gradually from an object-specific value code to a transient, object-independent code in which currently viewed and last-viewed objects competed to reflect the emerging view-based choice. Using neural-network modeling, we identified a sequence of computations by which amygdala neurons implemented view-based decision making and eventually recovered the chosen object's identity when the monkeys acted on their choice. These findings reveal a neural mechanism in the amygdala that derives object choices from abstract, view-based computations, suggesting an efficient solution for decision problems with many objects.

Abstract representations emerge in human hippocampal neurons during inference behavior

Humans have the remarkable cognitive capacity to rapidly adapt to changing environments. Central to this capacity is the ability to form high-level, abstract representations that take advantage of regularities in the world to support generalization 1 . However, little is known about how these representations are encoded in populations of neurons, how they emerge through learning, and how they relate to behavior 2,3 . Here we characterized the representational geometry of populations of neurons (single-units) recorded in the hippocampus, amygdala, medial frontal cortex, and ventral temporal cortex of neurosurgical patients who are performing an inferential reasoning task. We find that only the neural representations formed in the hippocampus simultaneously encode multiple task variables in an abstract, or disentangled, format. This representational geometry is uniquely observed after patients learn to perform inference, and consisted of disentangled directly observable and discovered latent task variables. Interestingly, learning to perform inference by trial and error or through verbal instructions led to the formation of hippocampal representations with similar geometric properties. The observed relation between representational format and inference behavior suggests that abstract/disentangled representational geometries are important for complex cognition.

Functional alterations of the prefrontal circuit underlying cognitive aging in mice

Executive function is susceptible to aging. How aging impacts the circuit-level computations underlying executive function remains unclear. Using calcium imaging and optogenetic manipulation during memory-guided behavior, we show that working-memory coding and the relevant recurrent connectivity in the mouse medial prefrontal cortex (mPFC) are altered as early as middle age. Population activity in the young adult mPFC exhibits dissociable yet overlapping patterns between tactile and auditory modalities, enabling crossmodal memory coding concurrent with modality-dependent coding. In middle age, however, crossmodal coding remarkably diminishes while modality-dependent coding persists, and both types of coding decay in advanced age. Resting-state functional connectivity, especially among memory-coding neurons, decreases already in middle age, suggesting deteriorated recurrent circuits for memory maintenance. Optogenetic inactivation reveals that the middle-aged mPFC exhibits heightened vulnerability to perturbations. These findings elucidate functional alterations of the prefrontal circuit that unfold in middle age and deteriorate further as a hallmark of cognitive aging.

Abstract perceptual choice signals during action-linked decisions in the human brain

Humans can make abstract choices independent of motor actions. However, in laboratory tasks, choices are typically reported with an associated action. Consequentially, knowledge about the neural representation of abstract choices is sparse, and choices are often thought to evolve as motor intentions. Here, we show that in the human brain, perceptual choices are represented in an abstract, motor-independent manner, even when they are directly linked to an action. We measured MEG signals while participants made choices with known or unknown motor response mapping. Using multivariate decoding, we quantified stimulus, perceptual choice, and motor response information with distinct cortical distributions. Choice representations were invariant to whether the response mapping was known during stimulus presentation, and they occupied a distinct representational space from motor signals. As expected from an internal decision variable, they were informed by the stimuli, and their strength predicted decision confidence and accuracy. Our results demonstrate abstract neural choice signals that generalize to action-linked decisions, suggesting a general role of an abstract choice stage in human decision-making.

Single-neuron and population measures of neuronal activity in working memory tasks

Information represented in working memory is reflected in the firing rate of neurons in the prefrontal cortex and brain areas connected to it. In recent years, there has been an increased realization that population measures capture more accurately neural correlates of cognitive functions. We examined how single neuron firing in the prefrontal and posterior parietal cortex of two male monkeys compared with population measures in spatial working memory tasks. Persistent activity was observed in the dorsolateral prefrontal and posterior parietal cortex and firing rate predicted working memory behavior, particularly in the prefrontal cortex. These findings had equivalents in population measures, including trajectories in state space that became less separated in error trials. We additionally observed rotations of stimulus representations in the neuronal state space for different task conditions, which were not obvious in firing rate measures. These results suggest that population measures provide a richer view of how neuronal activity is associated with behavior, largely confirming that persistent activity is the core phenomenon that maintains visual-spatial information in working memory.NEW & NOTEWORTHY Recordings from large numbers of neurons led to a reevaluation of neural correlates of cognitive functions, which traditionally were defined based on responses of single neurons or averages of firing rates. Analysis of neuronal recordings from the dorsolateral prefrontal and posterior parietal cortex revealed that properties of neuronal firing captured in classical studies of persistent activity can account for population representations, though some population characteristics did not have clear correlates in single neuron activity.

Testing the generalization of neural representations

Multivariate analysis methods are widely used in neuroscience to investigate the presence and structure of neural representations. Representational similarities across time or contexts are often investigated using pattern generalization, e.g. by training and testing multivariate decoders in different contexts, or by comparable pattern-based encoding methods. It is however unclear what conclusions can be validly drawn on the underlying neural representations when significant pattern generalization is found in mass signals such as LFP, EEG, MEG, or fMRI. Using simulations, we show how signal mixing and dependencies between measurements can drive significant pattern generalization even though the true underlying representations are orthogonal. We suggest that, using an accurate estimate of the expected pattern generalization given identical representations, it is nonetheless possible to test meaningful hypotheses about the generalization of neural representations. We offer such an estimate of the expected magnitude of pattern generalization and demonstrate how this measure can be used to assess the similarity and differences of neural representations across time and contexts.

Putative cell-type-specific multiregional mode in posterior parietal cortex during coordinated visual behavior

In the reach and saccade regions of the posterior parietal cortex (PPC), multiregional communication depends on the timing of neuronal activity with respect to beta-frequency (10-30 Hz) local field potential (LFP) activity, termed dual coherence. Neural coherence is believed to reflect neural excitability, whereby spiking tends to occur at a particular phase of LFP activity, but the mechanisms of multiregional dual coherence remain unknown. Here, we investigate dual coherence in the PPC of non-human primates performing eye-hand movements. We computationally model dual coherence in terms of multiregional neural excitability and show that one latent component, a multiregional mode, reflects shared excitability across distributed PPC populations. Analyzing the power in the multiregional mode with respect to different putative cell types reveals significant modulations with the spiking of putative pyramidal neurons and not inhibitory interneurons. These results suggest a specific role for pyramidal neurons in dual coherence supporting multiregional communication in PPC.

Neurons in human pre-supplementary motor area encode key computations for value-based choice

Adaptive behaviour in real-world environments requires that choices integrate several variables, including the novelty of the options under consideration, their expected value and uncertainty in value estimation. Here, to probe how integration over decision variables occurs during decision-making, we recorded neurons from the human pre-supplementary motor area (preSMA), ventromedial prefrontal cortex and dorsal anterior cingulate. Unlike the other areas, preSMA neurons not only represented separate pre-decision variables for each choice option but also encoded an integrated utility signal for each choice option and, subsequently, the decision itself. Post-decision encoding of variables for the chosen option was more widely distributed and especially prominent in the ventromedial prefrontal cortex. Our findings position the human preSMA as central to the implementation of value-based decisions.

Human acute microelectrode array recordings with broad cortical access, single-unit resolution, and parallel behavioral monitoring

There are vast gaps in our understanding of the organization and operation of the human nervous system at the level of individual neurons and their networks. Here, we report reliable and robust acute multichannel recordings using planar microelectrode arrays (MEAs) implanted intracortically in awake brain surgery with open craniotomies that grant access to large parts of the cortical hemisphere. We obtained high-quality extracellular neuronal activity at the microcircuit, local field potential level and at the cellular, single-unit level. Recording from the parietal association cortex, a region rarely explored in human single-unit studies, we demonstrate applications on these complementary spatial scales and describe traveling waves of oscillatory activity as well as single-neuron and neuronal population responses during numerical cognition, including operations with uniquely human number symbols. Intraoperative MEA recordings are practicable and can be scaled up to explore cellular and microcircuit mechanisms of a wide range of human brain functions.

Single neurons in the human medial temporal lobe flexibly shift representations across spatial and memory tasks

Investigations into how individual neurons encode behavioral variables of interest have revealed specific representations in single neurons, such as place and object cells, as well as a wide range of cells with conjunctive encodings or mixed selectivity. However, as most experiments examine neural activity within individual tasks, it is currently unclear if and how neural representations change across different task contexts. Within this discussion, the medial temporal lobe is particularly salient, as it is known to be important for multiple behaviors including spatial navigation and memory, however the relationship between these functions is currently unclear. Here, to investigate how representations in single neurons vary across different task contexts in the medial temporal lobe, we collected and analyzed single-neuron activity from human participants as they completed a paired-task session consisting of a passive-viewing visual working memory and a spatial navigation and memory task. Five patients contributed 22 paired-task sessions, which were spike sorted together to allow for the same putative single neurons to be compared between the different tasks. Within each task, we replicated concept-related activations in the working memory task, as well as target-location and serial-position responsive cells in the navigation task. When comparing neuronal activity between tasks, we first established that a significant number of neurons maintained the same kind of representation, responding to stimuli presentations across tasks. Further, we found cells that changed the nature of their representation across tasks, including a significant number of cells that were stimulus responsive in the working memory task that responded to serial position in the spatial task. Overall, our results support a flexible encoding of multiple, distinct aspects of different tasks by single neurons in the human medial temporal lobe, whereby some individual neurons change the nature of their feature coding between task contexts.

Using multi-task experiments to test principles of hippocampal function

Investigations of hippocampal functions have revealed a dizzying array of findings, from lesion-based behavioral deficits, to a diverse range of characterized neural activations, to computational models of putative functionality. Across these findings, there remains an ongoing debate about the core function of the hippocampus and the generality of its representation. Researchers have debated whether the hippocampus's primary role relates to the representation of space, the neural basis of (episodic) memory, or some more general computation that generalizes across various cognitive domains. Within these different perspectives, there is much debate about the nature of feature encodings. Here, we suggest that in order to evaluate hippocampal responses-investigating, for example, whether neuronal representations are narrowly targeted to particular tasks or if they subserve domain-general purposes-a promising research strategy may be the use of multi-task experiments, or more generally switching between multiple task contexts while recording from the same neurons in a given session. We argue that this strategy-when combined with explicitly defined theoretical motivations that guide experiment design-could be a fruitful approach to better understand how hippocampal representations support different behaviors. In doing so, we briefly review key open questions in the field, as exemplified by articles in this special issue, as well as previous work using multi-task experiments, and extrapolate to consider how this strategy could be further applied to probe fundamental questions about hippocampal function.

Control of working memory maintenance by theta-gamma phase amplitude coupling of human hippocampal neurons

Retaining information in working memory (WM) is a demanding process that relies on cognitive control to protect memoranda-specific persistent activity from interference. How cognitive control regulates WM storage, however, remains unknown. We hypothesized that interactions of frontal control and hippocampal persistent activity are coordinated by theta-gamma phase amplitude coupling (TG-PAC). We recorded single neurons in the human medial temporal and frontal lobe while patients maintained multiple items in WM. In the hippocampus, TG-PAC was indicative of WM load and quality. We identified cells that selectively spiked during nonlinear interactions of theta phase and gamma amplitude. These PAC neurons were more strongly coordinated with frontal theta activity when cognitive control demand was high, and they introduced information-enhancing and behaviorally relevant noise correlations with persistently active neurons in the hippocampus. We show that TG-PAC integrates cognitive control and WM storage to improve the fidelity of WM representations and facilitate behavior.

Resolving the prefrontal mechanisms of adaptive cognitive behaviors: A cross-species perspective

The prefrontal cortex (PFC) enables a staggering variety of complex behaviors, such as planning actions, solving problems, and adapting to new situations according to external information and internal states. These higher-order abilities, collectively defined as adaptive cognitive behavior, require cellular ensembles that coordinate the tradeoff between the stability and flexibility of neural representations. While the mechanisms underlying the function of cellular ensembles are still unclear, recent experimental and theoretical studies suggest that temporal coordination dynamically binds prefrontal neurons into functional ensembles. A so far largely separate stream of research has investigated the prefrontal efferent and afferent connectivity. These two research streams have recently converged on the hypothesis that prefrontal connectivity patterns influence ensemble formation and the function of neurons within ensembles. Here, we propose a unitary concept that, leveraging a cross-species definition of prefrontal regions, explains how prefrontal ensembles adaptively regulate and efficiently coordinate multiple processes in distinct cognitive behaviors.

Geometric transformation of cognitive maps for generalization across hippocampal-prefrontal circuits

The ability to abstract information to guide decisions during navigation across changing environments is essential for adaptation and requires the integrity of the hippocampal-prefrontal circuitry. The hippocampus encodes navigational information in a cognitive map, but it remains unclear how cognitive maps are transformed across hippocampal-prefrontal circuits to support abstraction and generalization. Here, we simultaneously record hippocampal-prefrontal ensembles as rats generalize navigational rules across distinct environments. We find that, whereas hippocampal representational maps maintain specificity of separate environments, prefrontal maps generalize across environments. Furthermore, while both maps are structured within a neural manifold of population activity, they have distinct representational geometries. Prefrontal geometry enables abstraction of rule-informative variables, a representational format that generalizes to novel conditions of existing variable classes. Hippocampal geometry lacks such abstraction. Together, these findings elucidate how cognitive maps are structured into distinct geometric representations to support abstraction and generalization while maintaining memory specificity.

An integrative view of human hippocampal function: Differences with other species and capacity considerations

We describe an integrative model that encodes associations between related concepts in the human hippocampal formation, constituting the skeleton of episodic memories. The model, based on partially overlapping assemblies of "concept cells," contrast markedly with the well-established notion of pattern separation, which relies on conjunctive, context dependent single neuron responses, instead of the invariant, context independent responses found in the human hippocampus. We argue that the model of partially overlapping assemblies is better suited to cope with memory capacity limitations, that the finding of different types of neurons and functions in this area is due to a flexible and temporary use of the extraordinary machinery of the hippocampus to deal with the task at hand, and that only information that is relevant and frequently revisited will consolidate into long-term hippocampal representations, using partially overlapping assemblies. Finally, we propose that concept cells are uniquely human and that they may constitute the neuronal underpinnings of cognitive abilities that are much further developed in humans compared to other species.

Neurophysiological mechanisms of error monitoring in human and non-human primates

Performance monitoring is an important executive function that allows us to gain insight into our own behaviour. This remarkable ability relies on the frontal cortex, and its impairment is an aspect of many psychiatric diseases. In recent years, recordings from the macaque and human medial frontal cortex have offered a detailed understanding of the neurophysiological substrate that underlies performance monitoring. Here we review the discovery of single-neuron correlates of error monitoring, a key aspect of performance monitoring, in both species. These neurons are the generators of the error-related negativity, which is a non-invasive biomarker that indexes error detection. We evaluate a set of tasks that allows the synergistic elucidation of the mechanisms of cognitive control across the two species, consider differences in brain anatomy and testing conditions across species, and describe the clinical relevance of these findings for understanding psychopathology. Last, we integrate the body of experimental facts into a theoretical framework that offers a new perspective on how error signals are computed in both species and makes novel, testable predictions.

Single neurons in the human medial temporal lobe flexibly shift representations across spatial and memory tasks

Investigations into how individual neurons encode behavioral variables of interest have revealed specific representations in single neurons, such as place and object cells, as well as a wide range of cells with conjunctive encodings or mixed selectivity. However, as most experiments examine neural activity within individual tasks, it is currently unclear if and how neural representations change across different task contexts. Within this discussion, the medial temporal lobe is particularly salient, as it is known to be important for multiple behaviors including spatial navigation and memory, however the relationship between these functions is currently unclear. Here, to investigate how representations in single neurons vary across different task contexts in the MTL, we collected and analyzed single-neuron activity from human participants as they completed a paired-task session consisting of a passive-viewing visual working memory and a spatial navigation and memory task. Five patients contributed 22 paired-task sessions, which were spike sorted together to allow for the same putative single neurons to be compared between the different tasks. Within each task, we replicated concept-related activations in the working memory task, as well as target-location and serial-position responsive cells in the navigation task. When comparing neuronal activity between tasks, we first established that a significant number of neurons maintained the same kind of representation, responding to stimuli presentations across tasks. Further, we found cells that changed the nature of their representation across tasks, including a significant number of cells that were stimulus responsive in the working memory task that responded to serial position in the spatial task. Overall, our results support a flexible encoding of multiple, distinct aspects of different tasks by single neurons in the human MTL, whereby some individual neurons change the nature of their feature coding between task contexts.

Comparing rapid rule-learning strategies in humans and monkeys

Inter-species comparisons are key to deriving an understanding of the behavioral and neural correlates of human cognition from animal models. We perform a detailed comparison of macaque monkey and human strategies on an analogue of the Wisconsin Card Sort Test, a widely studied and applied multi-attribute measure of cognitive function, wherein performance requires the inference of a changing rule given ambiguous feedback. We found that well-trained monkeys rapidly infer rules but are three times slower than humans. Model fits to their choices revealed hidden states akin to feature-based attention in both species, and decision processes that resembled a Win-stay lose-shift strategy with key differences. Monkeys and humans test multiple rule hypotheses over a series of rule-search trials and perform inference-like computations to exclude candidates. An attention-set based learning stage categorization revealed that perseveration, random exploration and poor sensitivity to negative feedback explain the under-performance in monkeys.

Readiness to remember: predicting variability in episodic memory

Learning and remembering are fundamental to our lives, so what causes us to forget? Answers often highlight preparatory processes that precede learning, as well as mnemonic processes during the act of encoding or retrieval. Importantly, evidence now indicates that preparatory processes that precede retrieval attempts also have powerful influences on memory success or failure. Here, we review recent work from neuroimaging, electroencephalography, pupillometry, and behavioral science to propose an integrative framework of retrieval-period dynamics that explains variance in remembering in the moment and across individuals as a function of interactions among preparatory attention, goal coding, and mnemonic processes. Extending this approach, we consider how a 'readiness to remember' (R2R) framework explains variance in high-level functions of memory and mnemonic disruptions in aging.

Indoor Air Pollution and Decision-Making Behavior: An Interdisciplinary Review

The human brain is constantly exposed to air pollutants, some of which might be disruptive or even lethal to certain neurons implicated in abstract features of cognitive function. In this review, we present new evidence from behavioral and neural studies in humans, suggesting a link between indoor fine particulate matter and decision-making behavior. To illustrate this relationship, we use qualitative sources, such as historical documents of the Vietnam War to develop hypotheses of how aerial transmission of pollutants might obstruct alternative choices during the evaluation of policy decisions. We first describe the neural circuits driving decision-making processes by addressing how neurons and their cognate receptors directly evaluate and transduce physical phenomena into sensory perceptions that allow us to decide the best course of action among competing alternatives. We then raise the possibility that indoor air pollutants might also impact cell-signaling systems outside the brain parenchyma to further obstruct the computational analysis of the social environment. We also highlight how particulate matter might be pathologically integrated into the brain to override control of sensory decisions, and thereby perturb selection of choice. These lines of research aim to extend our understanding of how inhalation of airborne particulates and toxicants in smoke, for example, might contribute to cognitive impairment and negative health outcomes.

Neural correlates of transitive inference: An SDM meta-analysis on 32 fMRI studies

Transitive inference (TI) is a critical capacity involving the integration of relevant information into prior knowledge structure for drawing novel inferences on unobserved relationships. To date, the neural correlates of TI remain unclear due to the small sample size and heterogeneity of various experimental tasks from individual studies. Here, the meta-analysis on 32 fMRI studies was performed to detect brain activation patterns of TI and its three paradigms (spatial inference, hierarchical inference, and associative inference). We found the hippocampus, prefrontal cortex (PFC), putamen, posterior parietal cortex (PPC), retrosplenial cortex (RSC), supplementary motor area (SMA), precentral gyrus (PreCG), and median cingulate cortex (MCC) were engaged in TI. Specifically, the RSC was implicated in the associative inference, whereas PPC, SMA, PreCG, and MCC were implicated in the hierarchical inference. In addition, the hierarchical inference and associative inference both evoked activation in the hippocampus, medial PFC, and PCC. Although the meta-analysis on spatial inference did not generate a reliable result due to insufficient amount of investigations, the present work still offers a new insight for better understanding the neural basis underlying TI.

The geometry of domain-general performance monitoring in the human medial frontal cortex

Controlling behavior to flexibly achieve desired goals depends on the ability to monitor one's own performance. It is unknown how performance monitoring can be both flexible, to support different tasks, and specialized, to perform each task well. We recorded single neurons in the human medial frontal cortex while subjects performed two tasks that involve three types of cognitive conflict. Neurons encoding conflict probability, conflict, and error in one or both tasks were intermixed, forming a representational geometry that simultaneously allowed task specialization and generalization. Neurons encoding conflict retrospectively served to update internal estimates of conflict probability. Population representations of conflict were compositional. These findings reveal how representations of evaluative signals can be both abstract and task-specific and suggest a neuronal mechanism for estimating control demand.

Symmetry-Based Representations for Artificial and Biological General Intelligence

Biological intelligence is remarkable in its ability to produce complex behavior in many diverse situations through data efficient, generalizable, and transferable skill acquisition. It is believed that learning "good" sensory representations is important for enabling this, however there is little agreement as to what a good representation should look like. In this review article we are going to argue that symmetry transformations are a fundamental principle that can guide our search for what makes a good representation. The idea that there exist transformations (symmetries) that affect some aspects of the system but not others, and their relationship to conserved quantities has become central in modern physics, resulting in a more unified theoretical framework and even ability to predict the existence of new particles. Recently, symmetries have started to gain prominence in machine learning too, resulting in more data efficient and generalizable algorithms that can mimic some of the complex behaviors produced by biological intelligence. Finally, first demonstrations of the importance of symmetry transformations for representation learning in the brain are starting to arise in neuroscience. Taken together, the overwhelming positive effect that symmetries bring to these disciplines suggest that they may be an important general framework that determines the structure of the universe, constrains the nature of natural tasks and consequently shapes both biological and artificial intelligence.

Cognitive neuroscience: Theta network oscillations coordinate development of episodic memory

Our ability to remember life events matures through childhood and adolescence. A new study has revealed how theta oscillations between two anatomical brain regions supporting memory and executive functions are synchronized and develop across age through functional and structural connectivity.

Saccade-related neural communication in the human medial temporal lobe is modulated by the social relevance of stimuli

Humans predominantly explore their environment by moving their eyes. To optimally communicate and process visual information, neural activity needs to be coordinated with the execution of eye movements. We investigated the coordination between visual exploration and interareal neural communication by analyzing local field potentials and single neuron activity in patients with epilepsy. We demonstrated that during the free viewing of images, neural communication between the human amygdala and hippocampus is coordinated with the execution of eye movements. The strength and direction of neural communication and hippocampal saccade-related phase alignment were strongest for fixations that landed on human faces. Our results argue that the state of the human medial temporal lobe network is selectively coordinated with motor behavior. Interareal neural communication was facilitated for social stimuli as indexed by the category of the attended information.

Properties and hemispheric differences of theta oscillations in the human hippocampus

The left and right primate hippocampi (LH and RH) are thought to support distinct functions, but little is known about differences between the hemispheres at the neuronal level. We recorded single-neuron and local field potentials from the human hippocampus in epilepsy patients implanted with depth electrodes. We detected theta-frequency bouts of oscillatory activity while patients performed a visual recognition memory task. Theta appeared in bouts of 3.16 cycles, with sawtooth-shaped oscillations that had a prolonged downswing period. Outside the seizure onset zone, the average frequency of theta bouts was higher in the RH compared to the LH (6.0 vs. 5.3 Hz). LH theta bouts had lower amplitudes and a higher prevalence compared to the RH (26% vs. 21% of total time). Additionally, the RH contained a population of thin spiking visually tuned neurons that were not present in the LH. These data show that human theta appears in short oscillatory bouts whose properties vary between hemispheres, thereby revealing neurophysiological properties of the hippocampus that differ between the hemispheres.

More Prominent Nonlinear Mixed Selectivity in the Dorsolateral Prefrontal than Posterior Parietal Cortex

Neurons in the dorsolateral prefrontal cortex (dlPFC) and posterior parietal cortex (PPC) are activated by different cognitive tasks and respond differently to the same stimuli depending on task. The conjunctive representations of multiple tasks in nonlinear fashion in single neuron activity, is known as nonlinear mixed selectivity (NMS). Here, we compared NMS in a working memory task in areas 8a and 46 of the dlPFC and 7a and lateral intraparietal cortex (LIP) of the PPC in macaque monkeys. NMS neurons were more frequent in dlPFC than in PPC and this was attributed to more cells gaining selectivity in the course of a trial. Additionally, in our task, the subjects' behavioral performance improved within a behavioral session as they learned the session-specific statistics of the task. The magnitude of NMS in the dlPFC also increased as a function of time within a single session. On the other hand, we observed minimal rotation of population responses and no appreciable differences in NMS between correct and error trials in either area. Our results provide direct evidence demonstrating a specialization in NMS between dlPFC and PPC and reveal mechanisms of neural selectivity in areas recruited in working memory tasks.

Neurons as will and representation

Memory recollections and voluntary actions are often perceived as spontaneously generated irrespective of external stimuli. Although products of our neurons, they are only rarely accessible in humans at the neuronal level. Here I review insights gleaned from unique neurosurgical opportunities to record and stimulate single-neuron activity in people who can declare their thoughts, memories and wishes. I discuss evidence that the subjective experience of human recollection and that of voluntary action arise from the activity of two internal neuronal generators, the former from medial temporal lobe reactivation and the latter from frontoparietal preactivation. I characterize properties of these generators and their interaction, enabling flexible recruitment of memory-based choices for action as well as recruitment of action-based plans for the representation of conceptual knowledge in memories. Both internal generators operate on surprisingly explicit but different neuronal codes, which appear to arise with distinct single-neuron activity, often observed before participants' reports of conscious awareness. I discuss prediction of behaviour based on these codes, and the potential for their modulation. The prospects of editing human memories and volitions by enhancement, inception or deletion of specific, selected content raise therapeutic possibilities and ethical concerns.

Intracranial electrophysiological recordings from the human brain during memory tasks with pupillometry

Data comprise intracranial EEG (iEEG) brain activity represented by stereo EEG (sEEG) signals, recorded from over 100 electrode channels implanted in any one patient across various brain regions. The iEEG signals were recorded in epilepsy patients (N = 10) undergoing invasive monitoring and localization of seizures when they were performing a battery of four memory tasks lasting approx. 1 hour in total. Gaze tracking on the task computer screen with estimating the pupil size was also recorded together with behavioral performance. Each dataset comes from one patient with anatomical localization of each electrode contact. Metadata contains labels for the recording channels with behavioral events marked from all tasks, including timing of correct and incorrect vocalization of the remembered stimuli. The iEEG and the pupillometric signals are saved in BIDS data structure to facilitate efficient data sharing and analysis.

Task Modulation of Single-Neuron Activity in the Human Amygdala and Hippocampus

The human amygdala and hippocampus are critically involved in various processes in face perception. However, it remains unclear how task demands or evaluative contexts modulate processes underlying face perception. In this study, we employed two task instructions when participants viewed the same faces and recorded single-neuron activity from the human amygdala and hippocampus. We comprehensively analyzed task modulation for three key aspects of face processing and we found that neurons in the amygdala and hippocampus (1) encoded high-level social traits such as perceived facial trustworthiness and dominance and this response was modulated by task instructions; (2) encoded low-level facial features and demonstrated region-based feature coding, which was not modulated by task instructions; and (3) encoded fixations on salient face parts such as the eyes and mouth, which was not modulated by task instructions. Together, our results provide a comprehensive survey of task modulation of neural processes underlying face perception at the single-neuron level in the human amygdala and hippocampus.

LeGUI: A Fast and Accurate Graphical User Interface for Automated Detection and Anatomical Localization of Intracranial Electrodes

Accurate anatomical localization of intracranial electrodes is important for identifying the seizure foci in patients with epilepsy and for interpreting effects from cognitive studies employing intracranial electroencephalography. Localization is typically performed by coregistering postimplant computed tomography (CT) with preoperative magnetic resonance imaging (MRI). Electrodes are then detected in the CT, and the corresponding brain region is identified using the MRI. Many existing software packages for electrode localization chain together separate preexisting programs or rely on command line instructions to perform the various localization steps, making them difficult to install and operate for a typical user. Further, many packages provide solutions for some, but not all, of the steps needed for confident localization. We have developed software, Locate electrodes Graphical User Interface (LeGUI), that consists of a single interface to perform all steps needed to localize both surface and depth/penetrating intracranial electrodes, including coregistration of the CT to MRI, normalization of the MRI to the Montreal Neurological Institute template, automated electrode detection for multiple types of electrodes, electrode spacing correction and projection to the brain surface, electrode labeling, and anatomical targeting. The software is written in MATLAB, core image processing is performed using the Statistical Parametric Mapping toolbox, and standalone executable binaries are available for Windows, Mac, and Linux platforms. LeGUI was tested and validated on 51 datasets from two universities. The total user and computational time required to process a single dataset was approximately 1 h. Automatic electrode detection correctly identified 4362 of 4695 surface and depth electrodes with only 71 false positives. Anatomical targeting was verified by comparing electrode locations from LeGUI to locations that were assigned by an experienced neuroanatomist. LeGUI showed a 94% match with the 482 neuroanatomist-assigned locations. LeGUI combines all the features needed for fast and accurate anatomical localization of intracranial electrodes into a single interface, making it a valuable tool for intracranial electrophysiology research.

Hippocampus-Prefrontal Coupling Regulates Recognition Memory for Novelty Discrimination

Recognition memory provides the ability to distinguish familiar from novel objects and places, and is important for recording and updating events to guide appropriate behavior. The hippocampus (HPC) and medial prefrontal cortex (mPFC) have both been implicated in recognition memory, but the nature of HPC-mPFC interactions, and its impact on local circuits in mediating this process is not known. Here we show that novelty discrimination is accompanied with higher theta activity (4-10 Hz) and increased c-Fos expression in both these regions. Moreover, theta oscillations were highly coupled between the HPC and mPFC during recognition memory retrieval for novelty discrimination, with the HPC leading the mPFC, but not during initial learning. Principal neurons and interneurons in the mPFC responded more strongly during recognition memory retrieval compared with learning. Optogenetic silencing of HPC input to the mPFC disrupted coupled theta activity between these two structures, as well as the animals' (male Sprague Dawley rats) ability to differentiate novel from familiar objects. These results reveal a key role of monosynaptic connections between the HPC and mPFC in novelty discrimination via theta coupling and identify neural populations that underlie this recognition memory-guided behavior.SIGNIFICANCE STATEMENT Many memory processes are highly dependent on the interregional communication between the HPC and mPFC via neural oscillations. However, how these two brain regions coordinate their oscillatory activity to engage local neural populations to mediate recognition memory for novelty discrimination is poorly understood. This study revealed that the HPC and mPFC theta oscillations and their temporal coupling is correlated with recognition memory-guided behavior. During novel object recognition, the HPC drives mPFC interneurons to effectively reduce the activity of principal neurons. This study provides the first evidence for the requirement of the HPC-mPFC pathway to mediate recognition memory for novelty discrimination and describes a mechanism for how this memory is regulated.

Metamemory: Rats know the strength of their memory

Assessing the quality of one's own memories is a core cognitive function, but it has been unclear whether rodents possess this ability. Evidence that they do has come from research using a new behavioural paradigm in which rats make temporal bets guided by memory confidence.