Human hippocampal pre-activation predicts behavior

Predictable and unpredictable deviance detection in the human hippocampus and amygdala

Our brains extract structure from the environment and form predictions given past experience. Predictive circuits have been identified in wide-spread cortical regions. However, the contribution of medial temporal structures in predictions remains under-explored. The hippocampus underlies sequence detection and is sensitive to novel stimuli, sufficient to gain access to memory, while the amygdala to novelty. Yet, their electrophysiological profiles in detecting predictable and unpredictable deviant auditory events remain unknown. Here, we hypothesized that the hippocampus would be sensitive to predictability, while the amygdala to unexpected deviance. We presented epileptic patients undergoing presurgical monitoring with standard and deviant sounds, in predictable or unpredictable contexts. Onsets of auditory responses and unpredictable deviance effects were detected earlier in the temporal cortex compared with the amygdala and hippocampus. Deviance effects in 1-20 Hz local field potentials were detected in the lateral temporal cortex, irrespective of predictability. The amygdala showed stronger deviance in the unpredictable context. Low-frequency deviance responses in the hippocampus (1-8 Hz) were observed in the predictable but not in the unpredictable context. Our results reveal a distributed network underlying the generation of auditory predictions and suggest that the neural basis of sensory predictions and prediction error signals needs to be extended.

Differential effects of expectancy on memory formation in young and older adults

Novelty can promote subsequent long-term memory via the mesolimbic system, including the medial temporal lobe and midbrain structures. Importantly, these and other brain regions typically degenerate during healthy aging, which suggests a reduced impact of novelty on learning. However, evidence in favor of such a hypothesis is scarce. Thus, we used functional MRI in combination with an established paradigm in healthy young (19-32 years, n = 30) and older (51-81 years, n = 32) humans. During encoding, colored cues predicted the subsequent presentation of either a novel or previously familiarized image (75% cue validity), and approximately 24 h later, recognition memory for novel images was tested. Behaviorally, expected novel images, as compared to unexpected novel images, were better recognized in young and, to a lesser degree, older subjects. At the neural level, familiar cues activated memory related areas, especially the medial temporal lobe, whereas novelty cues activated the angular gyrus and inferior parietal lobe, which may reflect enhanced attentional processing. During outcome processing, expected novel images activated the medial temporal lobe, angular gyrus and inferior parietal lobe. Importantly, a similar activation pattern was observed for subsequently recognized novel items, which helps to explain the behavioral effect of novelty on long-term memory. Finally, age-effects were pronounced for successfully recognized novel images with relatively stronger activations in attention-related brain regions in older adults; younger adults, on the other hand, showed stronger hippocampal activation. Together, expectancy promotes memory formation for novel items via neural activity in medial temporal lobe structures and this effect appears to be reduced with age.

Activating words without language: beta and theta oscillations reflect lexical access and control processes during verbal and non-verbal object recognition tasks

The intention to name an object modulates neural responses during object recognition tasks. However, the nature of this modulation is still unclear. We established whether a core operation in language, i.e. lexical access, can be observed even when the task does not require language (size-judgment task), and whether response selection in verbal versus non-verbal semantic tasks relies on similar neuronal processes. We measured and compared neuronal oscillatory activities and behavioral responses to the same set of pictures of meaningful objects, while the type of task participants had to perform (picture-naming versus size-judgment) and the type of stimuli to measure lexical access (cognate versus non-cognate) were manipulated. Despite activation of words was facilitated when the task required explicit word-retrieval (picture-naming task), lexical access occurred even without the intention to name the object (non-verbal size-judgment task). Activation of words and response selection were accompanied by beta (25-35 Hz) desynchronization and theta (3-7 Hz) synchronization, respectively. These effects were observed in both picture-naming and size-judgment tasks, suggesting that words became activated via similar mechanisms, irrespective of whether the task involves language explicitly. This finding has important implications to understand the link between core linguistic operations and performance in verbal and non-verbal semantic tasks.

Dropping Beans or Spilling Secrets: How Idiomatic Context Bias Affects Prediction

Idioms can have both a literal interpretation and a figurative interpretation (e.g., to "kick the bucket"). Which interpretation should be activated can be disambiguated by a preceding context (e.g., "The old man was sick. He kicked the bucket."). We investigated whether the idiomatic and literal uses of idioms have different predictive properties when the idiom has been biased toward a literal or figurative sentence interpretation. EEG was recorded as participants performed a lexical decision task on idiom-final words in biased idioms and literal (compositional) sentences. Targets in idioms were identified faster in both figuratively and literally used idioms than in compositional sentences. Time-frequency analysis of a prestimulus interval revealed relatively more alpha-beta power decreases in literally than figuratively used idiomatic sequences and compositional sentences. We argue that lexico-semantic retrieval plays a larger role in literally than figuratively biased idioms, as retrieval of the word meaning is less relevant in the latter and the word form has to be matched to a template. The results are interpreted in terms of context integration and word retrieval and have implications for models of language processing and predictive processing in general.

Moment-by-moment tracking of naturalistic learning and its underlying hippocampo-cortical interactions

Humans form lasting memories of stimuli that were only encountered once. This naturally occurs when listening to a story, however it remains unclear how and when memories are stored and retrieved during story-listening. Here, we first confirm in behavioral experiments that participants can learn about the structure of a story after a single exposure and are able to recall upcoming words when the story is presented again. We then track mnemonic information in high frequency activity (70–200 Hz) as patients undergoing electrocorticographic recordings listen twice to the same story. We demonstrate predictive recall of upcoming information through neural responses in auditory processing regions. This neural measure correlates with behavioral measures of event segmentation and learning. Event boundaries are linked to information flow from cortex to hippocampus. When listening for a second time, information flow from hippocampus to cortex precedes moments of predictive recall. These results provide insight on a fine-grained temporal scale into how episodic memory encoding and retrieval work under naturalistic conditions.

When listening to a story, humans learn about its structure and content. Here the authors reveal the neural processes behind episodic memory and predictive recall at a fine temporal scale in this naturalistic setting

Evidence of impaired naming in patients with hippocampal amnesia

Object naming involves accessing meaning and retrieving the associated word form from remote semantic memory. Historically, previously acquired semantic knowledge (i.e., remote semantic memory) was thought to be independent of the hippocampus via neocortical consolidation. This view is based on evidence demonstrating a dissociation in behavior in patients with hippocampal amnesia: amnesic patients are impaired in acquiring new vocabulary yet can name and define previously acquired words. More recently, the view that remote semantic memory is hippocampus-independent has been challenged by the documentation of disruptions in aspects of remote semantic memory in patients with hippocampal amnesia, particularly in language use and depth of semantic knowledge. Based on these findings, we hypothesized that the hippocampus plays a long-term role in remote semantic memory. We tested amnesic patients and demographically matched healthy comparison participants in an extensive naming task using photographic images of objects normalized for familiarity, object agreement, and visual complexity. Amnesic patients were less likely to correctly name objects than healthy comparison participants. Further, amnesic patients' performance worsened for words that were less familiar, more visually complex, and had less object agreement. These findings suggest that the hippocampus may play a long-term role in semantic memory processes, rather than a time-limited role in the initial acquisition of semantic information, and that hippocampal damage can disrupt object naming.

Common fronto-temporal effective connectivity in humans and monkeys

Human brain pathways supporting language and declarative memory are thought to have differentiated substantially during evolution. However, cross-species comparisons are missing on site-specific effective connectivity between regions important for cognition. We harnessed functional imaging to visualize the effects of direct electrical brain stimulation in macaque monkeys and human neurosurgery patients. We discovered comparable effective connectivity between caudal auditory cortex and both ventro-lateral prefrontal cortex (VLPFC, including area 44) and parahippocampal cortex in both species. Human-specific differences were clearest in the form of stronger hemispheric lateralization effects. In humans, electrical tractography revealed remarkably rapid evoked potentials in VLPFC following auditory cortex stimulation and speech sounds drove VLPFC, consistent with prior evidence in monkeys of direct auditory cortex projections to homologous vocalization-responsive regions. The results identify a common effective connectivity signature in human and nonhuman primates, which from auditory cortex appears equally direct to VLPFC and indirect to the hippocampus. VIDEO ABSTRACT.

The limited role of hippocampal declarative memory in transient semantic activation during online language processing

Recent findings point to a role for hippocampus in the moment-by-moment processing of language, including the use and generation of semantic features in certain contexts. What role the hippocampus might play in the processing of semantic relations in spoken language comprehension, however, is unknown. Here we test patients with bilateral hippocampal damage and dense amnesia in order to examine the necessity of hippocampus for lexico-semantic mapping processes in spoken language understanding. In two visual-world eye-tracking experiments, we monitor eye movements to images that are semantically related to spoken words and sentences. We find no impairment in amnesia, relative to matched healthy comparison participants. These findings suggest, at least for close semantic links and simple language comprehension tasks, a lack of necessity for hippocampus in lexico-semantic mapping between spoken words and simple pictures.

The language of mental images: Characterizing hippocampal contributions to imageable word use during event construction

Accumulating evidence suggests that the hippocampus plays a critical role in the creative and flexible use of language at the sentence or discourse level. Yet it is currently unclear whether the hippocampus also supports language use at the level of single words. A recent study by Hilverman et al. (2017) found that amnesic patients with hippocampal damage use less imageable words when describing autobiographical episodes compared to healthy controls, but this deficit was attributed to patients' deficits in episodic memory rather than impairments in linguistic functions of the hippocampus per se. Yet, in addition to affecting word use by way of its role in memory, the hippocampus could also impact language use more directly. The current study aimed to test this hypothesis by investigating the status of imageable word use in amnesia during two different types of language production tasks. In Experiment 1, participants constructed narratives about events depicted in visually presented pictures (picture narratives). In Experiment 2, participants constructed verbal narratives about remembered events from the past or simulated events in the future (past/future narratives). Across all types of narratives, patients produced words that were rated as having similar levels of imageability compared to controls. Importantly, this was the case both in patients' picture narratives, which did not require generating details from episodic memory and were matched to those of controls with respect to narrative content, and in patients' narratives about past/future events, which required generating details from memory and which were reduced in narrative content compared to those of controls. These results distinguish between the quantity and quality of individual linguistic details produced in amnesia during narrative construction, and suggest that the use of imageable linguistic representations does not depend on intact episodic memory and can be supported by regions outside the hippocampus.

Insights into human cognition from intracranial EEG: A review of audition, memory, internal cognition, and causality

By recording neural activity directly from the human brain, researchers gain unprecedented insight into how neurocognitive processes unfold in real time. We first briefly discuss how intracranial electroencephalography (iEEG) recordings, performed for clinical practice, are used to study human cognition with the spatiotemporal and single-trial precision traditionally limited to non-human animal research. We then delineate how studies using iEEG have informed our understanding of issues fundamental to human cognition: auditory prediction, working and episodic memory, and internal cognition. We also discuss the potential of iEEG to infer causality through the manipulation or 'engineering' of neurocognitive processes via spatiotemporally precise electrical stimulation. We close by highlighting limitations of iEEG, potential of burgeoning techniques to further increase spatiotemporal precision, and implications for future research using intracranial approaches to understand, restore, and enhance human cognition.

Semantic Memory and the Hippocampus: Revisiting, Reaffirming, and Extending the Reach of Their Critical Relationship

Since Tulving proposed a distinction in memory between semantic and episodic memory, considerable effort has been directed towards understanding their similar and unique features. Of particular interest has been the extent to which semantic and episodic memory have a shared dependence on the hippocampus. In contrast to the definitive evidence for the link between hippocampus and episodic memory, the role of the hippocampus in semantic memory has been a topic of considerable debate. This debate stems, in part, from highly variable reports of new semantic memory learning in amnesia ranging from profound impairment to full preservation, and various degrees of deficit and ability in between. More recently, a number of significant advances in experimental methods have occurred, alongside new provocative data on the role of the hippocampus in semantic memory, making this an ideal moment to revisit this debate, to re-evaluate data, methods, and theories, and to synthesize new findings. In line with these advances, this review has two primary goals. First, we provide a historical lens with which to reevaluate and contextualize the literature on semantic memory and the hippocampus. The second goal of this review is to provide a synthesis of new findings on the role of the hippocampus and semantic memory. With the perspective of time and this critical review, we arrive at the interpretation that the hippocampus does indeed make necessary contributions to semantic memory. We argue that semantic memory, like episodic memory, is a highly flexible, (re)constructive, relational and multimodal system, and that there is value in developing methods and materials that fully capture this depth and richness to facilitate comparisons to episodic memory. Such efforts will be critical in addressing questions regarding the cognitive and neural (inter)dependencies among forms of memory, and the role that these forms of memory play in support of cognition more broadly. Such efforts also promise to advance our understanding of how words, concepts, and meaning, as well as episodes and events, are instantiated and maintained in memory and will yield new insights into our two most quintessentially human abilities: memory and language.

Medial Orbitofrontal Cortex, Dorsolateral Prefrontal Cortex, and Hippocampus Differentially Represent the Event Saliency

Two primary functions attributed to the hippocampus and prefrontal cortex (PFC) network are retaining the temporal and spatial associations of events and detecting deviant events. It is unclear, however, how these two functions converge into one mechanism. Here, we tested whether increased activity with perceiving salient events is a deviant detection signal or contains information about the event associations by reflecting the magnitude of deviance (i.e., event saliency). We also tested how the deviant detection signal is affected by the degree of anticipation. We studied regional neural activity when people watched a movie that had varying saliency of a novel or an anticipated flow of salient events. Using intracranial electroencephalography from 10 patients, we observed that high-frequency activity (50-150 Hz) in the hippocampus, dorsolateral PFC, and medial OFC tracked event saliency. We also observed that medial OFC activity was stronger when the salient events were anticipated than when they were novel. These results suggest that dorsolateral PFC and medial OFC, as well as the hippocampus, signify the saliency magnitude of events, reflecting the hierarchical structure of event associations.

Transcending time in the brain: How event memories are constructed from experience

Our daily lives unfold continuously, yet when we reflect on the past, we remember those experiences as distinct and cohesive events. To understand this phenomenon, early investigations focused on how and when individuals perceive natural breakpoints, or boundaries, in ongoing experience. More recent research has examined how these boundaries modulate brain mechanisms that support long-term episodic memory. This work has revealed that a complex interplay between hippocampus and prefrontal cortex promotes the integration and separation of sequential information to help organize our experiences into mnemonic events. Here, we discuss how both temporal stability and change in one's thoughts, goals, and surroundings may provide scaffolding for these neural processes to link and separate memories across time. When learning novel or familiar sequences of information, dynamic hippocampal processes may work both independently from and in concert with other brain regions to bind sequential representations together in memory. The formation and storage of discrete episodic memories may occur both proactively as an experience unfolds. They may also occur retroactively, either during a context shift or when reactivation mechanisms bring the past into the present to allow integration. We also describe conditions and factors that shape the construction and integration of event memories across different timescales. Together these findings shed new light on how the brain transcends time to transform everyday experiences into meaningful memory representations.

Remote Memory and the Hippocampus: A Constructive Critique

The hippocampus is known to be recruited during the recall of experiences from our distant past, despite evidence that memory traces in this region vanish over time. Extant theories of systems-level consolidation have yet to accommodate both phenomena. We propose that the hippocampus reconstructs remote memories in the absence of the original trace. It accomplishes this by assembling consolidated neocortical elements into spatially coherent scenes that form the basis of unfolding memory events. This reconstruction is likely facilitated by input from the ventromedial prefrontal cortex. This process-oriented approach to hippocampal recruitment during remote recollection is consistent with its increasingly acknowledged role in constructing mental representations beyond the domain of memory.

Specific lexico-semantic predictions are associated with unique spatial and temporal patterns of neural activity

We used Magnetoencephalography (MEG) in combination with Representational Similarity Analysis to probe neural activity associated with distinct, item-specific lexico-semantic predictions during language comprehension. MEG activity was measured as participants read highly constraining sentences in which the final words could be predicted. Before the onset of the predicted words, both the spatial and temporal patterns of brain activity were more similar when the same words were predicted than when different words were predicted. The temporal patterns localized to the left inferior and medial temporal lobe. These findings provide evidence that unique spatial and temporal patterns of neural activity are associated with item-specific lexico-semantic predictions. We suggest that the unique spatial patterns reflected the prediction of spatially distributed semantic features associated with the predicted word, and that the left inferior/medial temporal lobe played a role in temporally 'binding' these features, giving rise to unique lexico-semantic predictions.