Volitional learning promotes theta phase coding in the human hippocampus

Maintenance and transformation of representational formats during working memory prioritization

Visual working memory depends on both material-specific brain areas in the ventral visual stream (VVS) that support the maintenance of stimulus representations and on regions in the prefrontal cortex (PFC) that control these representations. How executive control prioritizes working memory contents and whether this affects their representational formats remains an open question, however. Here, we analyzed intracranial EEG (iEEG) recordings in epilepsy patients with electrodes in VVS and PFC who performed a multi-item working memory task involving a retro-cue. We employed Representational Similarity Analysis (RSA) with various Deep Neural Network (DNN) architectures to investigate the representational format of prioritized VWM content. While recurrent DNN representations matched PFC representations in the beta band (15-29 Hz) following the retro-cue, they corresponded to VVS representations in a lower frequency range (3-14 Hz) towards the end of the maintenance period. Our findings highlight the distinct coding schemes and representational formats of prioritized content in VVS and PFC.

Phase locking of hippocampal CA3 neurons to distal CA1 theta oscillations selectively predicts memory performance

How the coordination of neuronal spiking and brain rhythms between hippocampal subregions supports memory function remains elusive. We studied the interregional coordination of CA3 neuronal spiking with CA1 theta oscillations by recording electrophysiological signals along the proximodistal axis of the hippocampus in rats that were performing a high-memory-demand recognition memory task adapted from humans. We found that CA3 population spiking occurs preferentially at the peak of distal CA1 theta oscillations when memory was tested but only when previously encountered stimuli were presented. In addition, decoding analyses revealed that only population cell firing of proximal CA3 together with that of distal CA1 can predict performance at test in the present non-spatial task. Overall, our work demonstrates an important role for the synchronization of CA3 neuronal activity with CA1 theta oscillations during memory testing.

Causal role of the angular gyrus in insight-driven memory reconfiguration

Maintaining an accurate model of the world relies on our ability to update memory representations in light of new information. Previous research on the integration of new information into memory mainly focused on the hippocampus. Here, we hypothesized that the angular gyrus, known to be involved in episodic memory and imagination, plays a pivotal role in the insight-driven reconfiguration of memory representations. To test this hypothesis, participants received continuous theta burst stimulation (cTBS) over the left angular gyrus or sham stimulation before gaining insight into the relationship between previously separate life-like animated events in a narrative-insight task. During this task, participants also underwent EEG recording and their memory for linked and non-linked events was assessed shortly thereafter. Our results show that cTBS to the angular gyrus decreased memory for the linking events and reduced the memory advantage for linked relative to non-linked events. At the neural level, cTBS targeting the angular gyrus reduced centro-temporal coupling with frontal regions and abolished insight-induced neural representational changes for events linked via imagination, indicating impaired memory reconfiguration. Further, the cTBS group showed representational changes for non-linked events that resembled the patterns observed in the sham group for the linked events, suggesting failed pruning of the narrative in memory. Together, our findings demonstrate a causal role of the left angular gyrus in insight-related memory reconfigurations.

Harmonic memory signals in the human cerebral cortex induced by semantic relatedness of words

When we memorize multiple words simultaneously, semantic relatedness among those words assists memory. For example, the information about "apple", "banana," and "orange" will be connected via a common concept of "fruits" and become easy to retain and recall. Neural mechanisms underlying this semantic integration in verbal working memory remain unclear. Here I used electroencephalography (EEG) and investigated neural signals when healthy human participants memorized five nouns semantically related (Sem trial) or not (NonSem trial). The regularity of oscillatory signals (8-30 Hz) during the retention period was found to be lower in NonSem than Sem trials, indicating that memorizing words unrelated to each other induced a non-harmonic (irregular) waveform in the temporal cortex. These results suggest that (i) semantic features of a word are retained as a set of neural oscillations at specific frequencies and (ii) memorizing words sharing a common semantic feature produces harmonic brain responses through a resonance or integration (sharing) of the oscillatory signals.

Parallel cognitive maps for multiple knowledge structures in the hippocampal formation

The hippocampal-entorhinal system uses cognitive maps to represent spatial knowledge and other types of relational information. However, objects can often be characterized by different types of relations simultaneously. How does the hippocampal formation handle the embedding of stimuli in multiple relational structures that differ vastly in their mode and timescale of acquisition? Does the hippocampal formation integrate different stimulus dimensions into one conjunctive map or is each dimension represented in a parallel map? Here, we reanalyzed human functional magnetic resonance imaging data from Garvert et al. (2017) that had previously revealed a map in the hippocampal formation coding for a newly learnt transition structure. Using functional magnetic resonance imaging adaptation analysis, we found that the degree of representational similarity in the bilateral hippocampus also decreased as a function of the semantic distance between presented objects. Importantly, while both map-like structures localized to the hippocampal formation, the semantic map was located in more posterior regions of the hippocampal formation than the transition structure and thus anatomically distinct. This finding supports the idea that the hippocampal-entorhinal system forms parallel cognitive maps that reflect the embedding of objects in diverse relational structures.

The effect of choice on memory: The role of theta oscillations

People value the opportunity to exercise control over the environment or make their own choices. Recent studies have revealed that simply having the opportunity to make choices can facilitate memory performance, suggesting an interaction between reward (due to choice making) and memory systems. However, little is known about the electrophysiological basis of choice-related memory. In the current study, we used scalp electroencephalography combined with a choice encoding task to examine the role of theta oscillations (which have been widely connected to reward and memory processing) in choice-related memory formation. The encoding task had two conditions. In the choice condition, participants were asked to choose between two occluded memoranda by themselves, whereas in the fixed condition, the decision was made by the computer. Behavioral results showed the choice effect, with better performance in the choice condition than the fixed condition on the recognition test given after a 24-h delay. Increases in theta power during an early latency of encoding period predicted successful memory formation in the choice condition, but not in the fixed condition. Furthermore, decreases in theta power during a late latency predicted successful memory formation in both the fixed and the choice conditions. Finally, we observed increased theta power in the choice condition compared to the fixed condition during an early latency of encoding period and decreased theta power in the choice condition compared to the fixed condition during a late latency. Our results suggest that theta oscillations play a significant role in choice-related memory formation.

Gamma amplitude is coupled to opposed hippocampal theta-phase states during the encoding and retrieval of episodic memories in humans

Computational models and in vivo studies in rodents suggest that the emergence of gamma activity (40-140 Hz) during memory encoding and retrieval is coupled to opposed-phase states of the underlying hippocampal theta rhythm (4-9 Hz).^{1,2,3,4,5,6,7,8,9,10} However, direct evidence for whether human hippocampal gamma-modulated oscillatory activity in memory processes is coupled to opposed-phase states of the ongoing theta rhythm remains elusive. Here, we recorded local field potentials (LFPs) directly from the hippocampus of 10 patients with epilepsy, using depth electrodes. We used a memory encoding and retrieval task whereby trial unique sequences of pictures depicting real-life episodes were presented, and 24 h later, participants were asked to recall them upon the appearance of the first picture of the encoded episodic sequence. We found theta-to-gamma cross-frequency coupling that was specific to the hippocampus during both the encoding and retrieval of episodic memories. We also revealed that gamma was coupled to opposing theta phases during both encoding and recall processes. Additionally, we observed that the degree of theta-gamma phase opposition between encoding and recall was associated with participants' memory performance, so gamma power was modulated by theta phase for both remembered and forgotten trials, although only for remembered trials the dominant theta phase was different for encoding and recall trials. The current results offer direct empirical evidence in support of hippocampal theta-gamma phase opposition models in human long-term memory and provide fundamental insights into mechanistic predictions derived from computational and animal work, thereby contributing to establishing similarities and differences across species.

GABAergic synaptic transmission and cortical oscillation patterns in the primary somatosensory area of a valproic acid rat model of autism spectrum disorder

Autism spectrum disorder (ASD) is characterized by impaired social communication and interaction associated with repetitive or stereotyped behaviour. Prenatal valproic acid (VPA) exposure in rodents is a commonly used model of ASD. Resveratrol (RSV) has been shown to prevent interneuronal and behavioural impairments in the VPA model. We investigated the effects of prenatal VPA exposure and RSV on the GABAergic synaptic transmission, brain oscillations and on the genic expression of interneuron-associated transcription factor LHX6 in the primary somatosensory area (PSSA). Prenatal VPA exposure decreased the sIPSC and mIPSC frequencies and the sIPSC decay kinetics onto layers 4/5 pyramidal cells of PSSA. About 40% of VPA animals exhibited absence-like spike-wave discharge (SWD) events associated with behaviour arrest and increased power spectrum density of delta, beta and gamma cortical oscillations. VPA animals had reduced LHX6 expression in PSSA, but VPA animals treated with RSV had no changes on synaptic inhibition or LHX6 expression in the PSSA. SWD events associated with behaviour arrest and the abnormal increment of cortical oscillations were also absent in VPA animals treated with RSV. These findings provide new venues to investigate the role of both RSV and VPA in the pathophysiology of ASD and highlight the VPA animal model as an interesting tool to investigate pathways related to the aetiology and possible future therapies to this neuropsychiatric disorder.

Temporal Dynamics of Competition between Statistical Learning and Episodic Memory in Intracranial Recordings of Human Visual Cortex

The function of long-term memory is not just to reminisce about the past, but also to make predictions that help us behave appropriately and efficiently in the future. This predictive function of memory provides a new perspective on the classic question from memory research of why we remember some things but not others. If prediction is a key outcome of memory, then the extent to which an item generates a prediction signifies that this information already exists in memory and need not be encoded. We tested this principle using human intracranial EEG as a time-resolved method to quantify prediction in visual cortex during a statistical learning task and link the strength of these predictions to subsequent episodic memory behavior. Epilepsy patients of both sexes viewed rapid streams of scenes, some of which contained regularities that allowed the category of the next scene to be predicted. We verified that statistical learning occurred using neural frequency tagging and measured category prediction with multivariate pattern analysis. Although neural prediction was robust overall, this was driven entirely by predictive items that were subsequently forgotten. Such interference provides a mechanism by which prediction can regulate memory formation to prioritize encoding of information that could help learn new predictive relationships.SIGNIFICANCE STATEMENT When faced with a new experience, we are rarely at a loss for what to do. Rather, because many aspects of the world are stable over time, we rely on past experiences to generate expectations that guide behavior. Here we show that these expectations during a new experience come at the expense of memory for that experience. From intracranial recordings of visual cortex, we decoded what humans expected to see next in a series of photographs based on patterns of neural activity. Photographs that generated strong neural expectations were more likely to be forgotten in a later behavioral memory test. Prioritizing the storage of experiences that currently lead to weak expectations could help improve these expectations in future encounters.

Phase separation of competing memories along the human hippocampal theta rhythm

Competition between overlapping memories is considered one of the major causes of forgetting, and it is still unknown how the human brain resolves such mnemonic conflict. In the present magnetoencephalography (MEG) study, we empirically tested a computational model that leverages an oscillating inhibition algorithm to minimise overlap between memories. We used a proactive interference task, where a reminder word could be associated with either a single image (non-competitive condition) or two competing images, and participants were asked to always recall the most recently learned word-image association. Time-resolved pattern classifiers were trained to detect the reactivated content of target and competitor memories from MEG sensor patterns, and the timing of these neural reactivations was analysed relative to the phase of the dominant hippocampal 3 Hz theta oscillation. In line with our pre-registered hypotheses, target and competitor reactivations locked to different phases of the hippocampal theta rhythm after several repeated recalls. Participants who behaviourally experienced lower levels of interference also showed larger phase separation between the two overlapping memories. The findings provide evidence that the temporal segregation of memories, orchestrated by slow oscillations, plays a functional role in resolving mnemonic competition by separating and prioritising relevant memories under conditions of high interference.

Rhythms of human attention and memory: An embedded process perspective

It remains a dogma in cognitive neuroscience to separate human attention and memory into distinct modules and processes. Here we propose that brain rhythms reflect the embedded nature of these processes in the human brain, as evident from their shared neural signatures: gamma oscillations (30-90 Hz) reflect sensory information processing and activated neural representations (memory items). The theta rhythm (3-8 Hz) is a pacemaker of explicit control processes (central executive), structuring neural information processing, bit by bit, as reflected in the theta-gamma code. By representing memory items in a sequential and time-compressed manner the theta-gamma code is hypothesized to solve key problems of neural computation: (1) attentional sampling (integrating and segregating information processing), (2) mnemonic updating (implementing Hebbian learning), and (3) predictive coding (advancing information processing ahead of the real time to guide behavior). In this framework, reduced alpha oscillations (8-14 Hz) reflect activated semantic networks, involved in both explicit and implicit mnemonic processes. Linking recent theoretical accounts and empirical insights on neural rhythms to the embedded-process model advances our understanding of the integrated nature of attention and memory - as the bedrock of human cognition.

Mnemonic construction and representation of temporal structure in the hippocampal formation

The hippocampal-entorhinal region supports memory for episodic details, such as temporal relations of sequential events, and mnemonic constructions combining experiences for inferential reasoning. However, it is unclear whether hippocampal event memories reflect temporal relations derived from mnemonic constructions, event order, or elapsing time, and whether these sequence representations generalize temporal relations across similar sequences. Here, participants mnemonically constructed times of events from multiple sequences using infrequent cues and their experience of passing time. After learning, event representations in the anterior hippocampus reflected temporal relations based on constructed times. Temporal relations were generalized across sequences, revealing distinct representational formats for events from the same or different sequences. Structural knowledge about time patterns, abstracted from different sequences, biased the construction of specific event times. These findings demonstrate that mnemonic construction and the generalization of relational knowledge combine in the hippocampus, consistent with the simulation of scenarios from episodic details and structural knowledge.

Escaping from the IIT Munchausen method: Re-establishing the scientific method in the study of consciousness

Integrated information theory (IIT) is an example of "ironic science" and obstructs the scientific study of consciousness. By confusing the ontological status of a method to quantify network complexity with that of a theory of consciousness, IIT has to square the circle and spirals toward its panpsychism conclusion. I analyze the consequences of this fallacy and suggest how the study of consciousness can be brought back into the realm of rational, empirical science.

Looking for the neural basis of memory

Memory neuroscientists often measure neural activity during task trials designed to recruit specific memory processes. Behavior is championed as crucial for deciphering brain-memory linkages but is impoverished in typical experiments that rely on summary judgments. We criticize this approach as being blind to the multiple cognitive, neural, and behavioral processes that occur rapidly within a trial to support memory. Instead, time-resolved behaviors such as eye movements occur at the speed of cognition and neural activity. We highlight successes using eye-movement tracking with in vivo electrophysiology to link rapid hippocampal oscillations to encoding and retrieval processes that interact over hundreds of milliseconds. This approach will improve research on the neural basis of memory because it pinpoints discrete moments of brain-behavior-cognition correspondence.

A Platform for Cognitive Monitoring of Neurosurgical Patients During Hospitalization

Intracranial recordings in epilepsy patients are increasingly utilized to gain insight into the electrophysiological mechanisms of human cognition. There are currently several practical limitations to conducting research with these patients, including patient and researcher availability and the cognitive abilities of patients, which limit the amount of task-related data that can be collected. Prior studies have synchronized clinical audio, video, and neural recordings to understand naturalistic behaviors, but these recordings are centered on the patient to understand their seizure semiology and thus do not capture and synchronize audiovisual stimuli experienced by patients. Here, we describe a platform for cognitive monitoring of neurosurgical patients during their hospitalization that benefits both patients and researchers. We provide the full specifications for this system and describe some example use cases in perception, memory, and sleep research. We provide results obtained from a patient passively watching TV as proof-of-principle for the naturalistic study of cognition. Our system opens up new avenues to collect more data per patient using real-world behaviors, affording new possibilities to conduct longitudinal studies of the electrophysiological basis of human cognition under naturalistic conditions.

The Radically Embodied Conscious Cybernetic Bayesian Brain: From Free Energy to Free Will and Back Again

Drawing from both enactivist and cognitivist perspectives on mind, I propose that explaining teleological phenomena may require reappraising both "Cartesian theaters" and mental homunculi in terms of embodied self-models (ESMs), understood as body maps with agentic properties, functioning as predictive-memory systems and cybernetic controllers. Quasi-homuncular ESMs are suggested to constitute a major organizing principle for neural architectures due to their initial and ongoing significance for solutions to inference problems in cognitive (and affective) development. Embodied experiences provide foundational lessons in learning curriculums in which agents explore increasingly challenging problem spaces, so answering an unresolved question in Bayesian cognitive science: what are biologically plausible mechanisms for equipping learners with sufficiently powerful inductive biases to adequately constrain inference spaces? Drawing on models from neurophysiology, psychology, and developmental robotics, I describe how embodiment provides fundamental sources of empirical priors (as reliably learnable posterior expectations). If ESMs play this kind of foundational role in cognitive development, then bidirectional linkages will be found between all sensory modalities and frontal-parietal control hierarchies, so infusing all senses with somatic-motoric properties, thereby structuring all perception by relevant affordances, so solving frame problems for embodied agents. Drawing upon the Free Energy Principle and Active Inference framework, I describe a particular mechanism for intentional action selection via consciously imagined (and explicitly represented) goal realization, where contrasts between desired and present states influence ongoing policy selection via predictive coding mechanisms and backward-chained imaginings (as self-realizing predictions). This embodied developmental legacy suggests a mechanism by which imaginings can be intentionally shaped by (internalized) partially-expressed motor acts, so providing means of agentic control for attention, working memory, imagination, and behavior. I further describe the nature(s) of mental causation and self-control, and also provide an account of readiness potentials in Libet paradigms wherein conscious intentions shape causal streams leading to enaction. Finally, I provide neurophenomenological handlings of prototypical qualia including pleasure, pain, and desire in terms of self-annihilating free energy gradients via quasi-synesthetic interoceptive active inference. In brief, this manuscript is intended to illustrate how radically embodied minds may create foundations for intelligence (as capacity for learning and inference), consciousness (as somatically-grounded self-world modeling), and will (as deployment of predictive models for enacting valued goals).

Rapid coordination of effective learning by the human hippocampus

Although the human hippocampus is necessary for long-term memory, controversial findings suggest that it may also support short-term memory in the service of guiding effective behaviors during learning. We tested the counterintuitive theory that the hippocampus contributes to long-term memory through remarkably short-term processing, as reflected in eye movements during scene encoding. While viewing scenes for the first time, short-term retrieval operative within the episode over only hundreds of milliseconds was indicated by a specific eye-movement pattern, which was effective in that it enhanced spatiotemporal memory formation. This viewing pattern was predicted by hippocampal theta oscillations recorded from depth electrodes and by shifts toward top-down influence of hippocampal theta on activity within visual perception and attention networks. The hippocampus thus supports short-term memory processing that coordinates behavior in the service of effective spatiotemporal learning.