Hippocampal contributions to language: evidence of referential processing deficits in amnesia

EPS mid-career prize: An integrated framework for the learning, recognition and interpretation of words

In this article, I review the evidence on the involvement of sleep and consolidation in word learning and processing during language comprehension, focusing on implications for theory. The theoretical basis for the review is a complementary systems account of word learning involving flexible (hippocampal) and stable (cortical) pathways to lexical knowledge. I argue that the accumulated data are consistent with a role for both pathways in both learning and recognition of lexical items, with sleep and consolidation supporting the transfer of recent experience between the pathways. The level of involvement of each pathway is dependent on key factors, such as consistency with prior knowledge in the case of learning, and reliance on context and/or automaticity in the case of recognition. As a consequence, the notion of a mental lexicon cannot really be restricted to just the listener's stable knowledge about words: flexible knowledge and recent experiences are also important. Furthermore, I argue that the flexible pathway plays a critical role even in the absence of new lexical items. The available evidence suggests that this pathway encodes (and potentially consolidates) recent linguistic experiences, providing potential benefits to interpretation of subsequent language and the long-term retention of knowledge. In conclusion, I propose that a dual-pathway account incorporating both flexibility and stability is necessary to explain the learning, recognition, and interpretation of words.

Reduced on-line speech gesture integration during multimodal language processing in adults with moderate-severe traumatic brain injury: Evidence from eye-tracking

BACKGROUND

Language is multimodal and situated in rich visual contexts. Language is also incremental, unfolding moment-to-moment in real time, yet few studies have examined how spoken language interacts with gesture and visual context during multimodal language processing. Gesture is a rich communication cue that is integrally related to speech and often depicts concrete referents from the visual world. Using eye-tracking in an adapted visual world paradigm, we examined how participants with and without moderate-severe traumatic brain injury (TBI) use gesture to resolve temporary referential ambiguity.

METHODS

Participants viewed a screen with four objects and one video. The speaker in the video produced sentences (e.g., "The girl will eat the very good sandwich"), paired with either a meaningful gesture (e.g., sandwich-holding gesture) or a meaningless grooming movement (e.g., arm scratch) at the verb "will eat." We measured participants' gaze to the target object (e.g., sandwich), a semantic competitor (e.g., apple), and two unrelated distractors (e.g., piano, guitar) during the critical window between movement onset in the gesture modality and onset of the spoken referent in speech.

RESULTS

Both participants with and without TBI were more likely to fixate the target when the speaker produced a gesture compared to a grooming movement; however, relative to non-injured participants, the effect was significantly attenuated in the TBI group.

DISCUSSION

We demonstrated evidence of reduced speech-gesture integration in participants with TBI relative to non-injured peers. This study advances our understanding of the communicative abilities of adults with TBI and could lead to a more mechanistic account of the communication difficulties adults with TBI experience in rich communication contexts that require the processing and integration of multiple co-occurring cues. This work has the potential to increase the ecological validity of language assessment and provide insights into the cognitive and neural mechanisms that support multimodal language processing.

Pronouns reactivate conceptual representations in human hippocampal neurons

During discourse comprehension, every new word adds to an evolving representation of meaning that accumulates over consecutive sentences and constrains the next words. To minimize repetition and utterance length, languages use pronouns, like the word "she," to refer to nouns and phrases that were previously introduced. It has been suggested that language comprehension requires that pronouns activate the same neuronal representations as the nouns themselves. We recorded from individual neurons in the human hippocampus during a reading task. Cells that were selective to a particular noun were later reactivated by pronouns that refer to the cells' preferred noun. These results imply that concept cells contribute to a rapid and dynamic semantic memory network that is recruited during language comprehension.

Keeping track of who knows what in multiparty conversation despite severe memory impairment

Language use has long been understood to be tailored to the intended addressee, a process termed audience design. Audience design is reflected in multiple aspects of language use, including adjustments based on the addressee's knowledge about the topic at hand. In group settings, audience design depends on representations of multiple individuals, each of whom may have different knowledge about the conversational topic. A central question, then, concerns how these representations are encoded and retrieved in multiparty conversation where successful conversation requires keeping track of who knows what. In the present research, we probe the biological memory systems that are involved in this process of multiparty audience design. We present the results of two experiments that compare language use in persons with bilateral hippocampal damage and severe declarative memory impairment (amnesia), and demographically matched neurotypical comparison participants. Participants played a game in which they discussed abstract images with one partner in conversation, and then discussed the images again with the same partner or with a new partner in a three-party conversation. Neurotypical participants' language use reflected newly formed representations of which partner was familiar with which images. Participants with amnesia showed evidence of partner-specific audience design in multiparty conversation but it was attenuated, especially when success required rapid alternations between representations of common ground. The findings suggest partial independence of the formation and use of partner-specific representations from the hippocampal-dependent declarative memory system and highlight the unique contributions of the declarative memory system to flexible and dynamic language use.

Neural correlates of pronoun processing: An activation likelihood estimation meta-analysis

Pronouns are unique linguistic devices that allow for the expression of referential relationships. Despite their communicative utility, the neural correlates of the operations involved in reference assignment and/or resolution, are not well-understood. The present study synthesized the neuroimaging literature on pronoun processing to test extant theories of pronoun comprehension. Following the PRISMA guidelines and thebest-practice recommendations for neuroimaging meta-analyses, a systematic literature search and record assessment were performed. As a result, 16 fMRI studies were included in the meta-analysis, and were coded in Scribe 3.6 for inclusion in the BrainMap database. The activation coordinates for the contrasts of interest were transformed into Talairach space and submitted to an Activation Likelihood Estimation (ALE) meta-analysis in GingerALE 3.0.1. The results indicated that pronoun processing had functional convergence in the left posterior middle and superior temporal gyri, potentially reflecting the retrieval, prediction and integration roles of these areas for pronoun processing.

The hearing hippocampus

The hippocampus has a well-established role in spatial and episodic memory but a broader function has been proposed including aspects of perception and relational processing. Neural bases of sound analysis have been described in the pathway to auditory cortex, but wider networks supporting auditory cognition are still being established. We review what is known about the role of the hippocampus in processing auditory information, and how the hippocampus itself is shaped by sound. In examining imaging, recording, and lesion studies in species from rodents to humans, we uncover a hierarchy of hippocampal responses to sound including during passive exposure, active listening, and the learning of associations between sounds and other stimuli. We describe how the hippocampus' connectivity and computational architecture allow it to track and manipulate auditory information - whether in the form of speech, music, or environmental, emotional, or phantom sounds. Functional and structural correlates of auditory experience are also identified. The extent of auditory-hippocampal interactions is consistent with the view that the hippocampus makes broad contributions to perception and cognition, beyond spatial and episodic memory. More deeply understanding these interactions may unlock applications including entraining hippocampal rhythms to support cognition, and intervening in links between hearing loss and dementia.

Mapping of Language-and-Memory Networks in Patients With Temporal Lobe Epilepsy by Using the GE2REC Protocol

Preoperative mapping of language and declarative memory functions in temporal lobe epilepsy (TLE) patients is essential since they frequently encounter deterioration of these functions and show variable degrees of cerebral reorganization. Due to growing evidence on language and declarative memory interdependence at a neural and neuropsychological level, we propose the GE2REC protocol for interactive language-and-memory network (LMN) mapping. GE2REC consists of three inter-related tasks, sentence generation with implicit encoding (GE) and two recollection (2REC) memory tasks: recognition and recall. This protocol has previously been validated in healthy participants, and in this study, we showed that it also maps the LMN in the left TLE (N = 18). Compared to healthy controls (N = 19), left TLE (LTLE) showed widespread inter- and intra-hemispheric reorganization of the LMN through reduced activity of regions engaged in the integration and the coordination of this meta-network. We also illustrated how this protocol could be implemented in clinical practice individually by presenting two case studies of LTLE patients who underwent efficient surgery and became seizure-free but showed different cognitive outcomes. This protocol can be advantageous for clinical practice because it (a) is short and easy to perform; (b) allows brain mapping of essential cognitive functions, even at an individual level; (c) engages language-and-memory interaction allowing to evaluate the integrative processes within the LMN; (d) provides a more comprehensive assessment by including both verbal and visual modalities, as well as various language and memory processes. Based on the available postsurgical data, we presented preliminary results obtained with this protocol in LTLE patients that could potentially inform the clinical practice. This implies the necessity to further validate the potential of GE2REC for neurosurgical planning, along with two directions, guiding resection and describing LMN neuroplasticity at an individual level.

Moving From Bilingual Traits to States: Understanding Cognition and Language Processing Through Moment-to-Moment Variation

The study of how bilingualism is linked to cognitive processing, including executive functioning, has historically focused on comparing bilinguals to monolinguals across a range of tasks. These group comparisons presume to capture relatively stable cognitive traits and have revealed important insights about the architecture of the language processing system that could not have been gleaned from studying monolinguals alone. However, there are drawbacks to using a group-comparison, or Traits, approach. In this theoretical review, we outline some limitations of treating executive functions as stable traits and of treating bilinguals as a uniform group when compared to monolinguals. To build on what we have learned from group comparisons, we advocate for an emerging complementary approach to the question of cognition and bilingualism. Using an approach that compares bilinguals to themselves under different linguistic or cognitive contexts allows researchers to ask questions about how language and cognitive processes interact based on dynamically fluctuating cognitive and neural states. A States approach, which has already been used by bilingualism researchers, allows for cause-and-effect hypotheses and shifts our focus from questions of group differences to questions of how varied linguistic environments influence cognitive operations in the moment and how fluctuations in cognitive engagement impact language processing.

Fractionating the episodic buffer

The episodic buffer is a putative component of working memory proposed to account for several short-term memory functions, including unexpectedly preserved immediate prose recall by amnesic patients. Over the course of time, this component has increasingly become associated with binding functions. Considering recent findings regarding the performance of both memory-impaired and healthy individuals on the range of tasks purported to require the contribution of the episodic buffer, we suggest that it should be fractionated into two functional systems. One is a schematic store instantiated in brain areas responsible for conceptual and schema representations, which is likely to be hippocampus-independent, and preserved in the face of amnesia. In contrast, short-term maintenance of novel associative binding is likely to require the contribution of the hippocampus and may therefore not be functionally dissociable from long-term memory.

The limited role of hippocampal declarative memory in transient semantic activation during online language processing

Recent findings point to a role for hippocampus in the moment-by-moment processing of language, including the use and generation of semantic features in certain contexts. What role the hippocampus might play in the processing of semantic relations in spoken language comprehension, however, is unknown. Here we test patients with bilateral hippocampal damage and dense amnesia in order to examine the necessity of hippocampus for lexico-semantic mapping processes in spoken language understanding. In two visual-world eye-tracking experiments, we monitor eye movements to images that are semantically related to spoken words and sentences. We find no impairment in amnesia, relative to matched healthy comparison participants. These findings suggest, at least for close semantic links and simple language comprehension tasks, a lack of necessity for hippocampus in lexico-semantic mapping between spoken words and simple pictures.

The language of mental images: Characterizing hippocampal contributions to imageable word use during event construction

Accumulating evidence suggests that the hippocampus plays a critical role in the creative and flexible use of language at the sentence or discourse level. Yet it is currently unclear whether the hippocampus also supports language use at the level of single words. A recent study by Hilverman et al. (2017) found that amnesic patients with hippocampal damage use less imageable words when describing autobiographical episodes compared to healthy controls, but this deficit was attributed to patients' deficits in episodic memory rather than impairments in linguistic functions of the hippocampus per se. Yet, in addition to affecting word use by way of its role in memory, the hippocampus could also impact language use more directly. The current study aimed to test this hypothesis by investigating the status of imageable word use in amnesia during two different types of language production tasks. In Experiment 1, participants constructed narratives about events depicted in visually presented pictures (picture narratives). In Experiment 2, participants constructed verbal narratives about remembered events from the past or simulated events in the future (past/future narratives). Across all types of narratives, patients produced words that were rated as having similar levels of imageability compared to controls. Importantly, this was the case both in patients' picture narratives, which did not require generating details from episodic memory and were matched to those of controls with respect to narrative content, and in patients' narratives about past/future events, which required generating details from memory and which were reduced in narrative content compared to those of controls. These results distinguish between the quantity and quality of individual linguistic details produced in amnesia during narrative construction, and suggest that the use of imageable linguistic representations does not depend on intact episodic memory and can be supported by regions outside the hippocampus.

The effect of repetition on pronoun resolution in patients with memory impairment

Referring to things in the world - that woman, her idea, she - is a central component of language. Understanding reference requires the listener to keep track of the unfolding discourse history while integrating multiple sources of information to interpret the speech stream as it unfolds in time. Pronouns are a common way to establish reference. But due to their impoverished form, to understand them listeners must relate features of the pronoun (e.g., gender, animacy) with existing representations of potential discourse referents. Successful referential processing seems to place demands on memory. In a previous study, patients with hippocampal amnesia and healthy participants listened to short stories as their eye movements were monitored. When interpreting ambiguous pronouns, healthy participants demonstrated order-of-mention effects, whereby ambiguous pronouns are interpreted as referring to the first-mentioned referent in the story. By contrast, memory-impaired patients exhibited significant disruptions in their ability to use information about which character had been mentioned first to interpret pronouns. Repetition of the most salient information is a common clinical recommendation for improving pronoun resolution and communication in individuals with memory disorders (e.g., Alzheimer's disease) but this recommendation lacks an evidentiary basis. The present study seeks to determine whether the pronoun resolution performance of hippocampal patients can be improved, by repetition of the target referent, increasing its salience. Results indicate that patients with hippocampal damage demonstrate improved processing of pronouns following repetition of the target referent, but benefit from this repetition to a significantly smaller degree compared to healthy participants. These results provide further evidence for the role of the hippocampal-dependent memory system in language processing and point to the need for empirically tested communication interventions.

Even an activated long-term memory system still needs a separate short-term store: A reply to Cowan (2019)

In Norris (2017), I explained why the notion of activated LTM (long-term memory) combined with a focus of attention was unable to perform the computations required to support short-term memory (STM) and argued that those extra computations must require a separate STM system. Cowan (2019) made the alternative proposal that this full set of computations is better conceptualized as a unitary system of activated LTM. To this he added a pointer system, the ability to perform variable binding, and an unspecified model of STM that acts as a front end to LTM. This appears to be simply an exercise in relabeling. Furthermore, without a computational specification of how the components work, the model lacks the ability to simulate even the most basic STM phenomena. If the model were specified in more detail it seems almost inevitable that it would contain something instantly recognizable as an STM system. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Short-term memory based on activated long-term memory: A review in response to Norris (2017)

Short-term memory (STM), the limited information temporarily in a state of heightened accessibility, includes just-presented events and recently retrieved information. Norris (2017) argued for a prominent class of theories in which STM depends on the brain keeping a separate copy of new information, and against alternatives in which the information is held only in a portion of long-term memory (LTM) that is currently activated (aLTM). Here I question premises of Norris' case for separate-copy theories in the following ways. (a) He did not allow for implications of the common assumption (e.g., Cowan, 1999; Cowan & Chen, 2009) that aLTM can include new, rapidly formed LTM records of a trial within an STM task. (b) His conclusions from pathological cases of impaired STM along with intact LTM are tenuous; these rare cases can be explained by impairments in encoding, processing, or retrieval related to LTM rather than passive maintenance. (c) Although Norris reasonably allowed structured pointers to aLTM instead of separate copies of the actual item representations in STM, the same structured pointers may well be involved in long-term learning. (d) Last, models of STM storage can serve as the front end of an LTM learning system rather than being separate. I summarize evidence for these premises and an updated version of an alternative theory in which storage depends on aLTM (newly clarified), and, embedded within it, information enhanced by the current focus of attention (Cowan, 1988, 1999), with no need for a separate STM copy. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Recalling the firedog: Individual differences in associative memory for unitized and nonunitized associations among older adults

Memory deficits in aging are characterized by impaired hippocampus-mediated relational binding-the formation of links between items in memory. By reducing reliance on relational binding, unitization of two items into one concept enhances associative recognition among older adults. Can a similar enhancement be obtained when probing memory with recall? This question has yet to be examined, because recall has been assumed to rely predominantly on relational binding. Inspired by recent evidence challenging this assumption, we investigated individual differences in older adults' recall of unitized and nonunitized associations. Compared with successfully aging individuals, older adults with mild memory deficits, typically mediated by the hippocampus, were impaired in recall of paired-associates in a task which relies on relational binding (study: "PLAY-TUNNEL"; test: PLAY-T?). In stark contrast, the two groups showed similar performance when items were unitized into a novel compound word (study: "LOVEGIGGLE"; test: LOVEG?). Thus, boosting nonrelational aspects of recall enhances associative memory among aging individuals with subtle memory impairments to comparable levels as successfully aging older adults.

Discourse macrolinguistic impairment as a marker of linguistic and extralinguistic functions decline in early Alzheimer's disease

BACKGROUND

Alzheimer's disease is characterized by macrolinguistic changes. This decline is often analyzed with quantitative scales.

AIMS

To analyze discourse production in early Alzheimer's disease (AD) and to identify qualitative markers of macrolinguistic decline.

METHODS & PROCEDURES

We analyzed macrolinguistic features of a clinical narrative task along with patients' cognitive changes. To do so, 17 early AD participants and 17 healthy controls were recruited and given a full neuropsychological and language assessment. Narrative discourses produced during the language assessment were transcribed and macrolinguistic features were qualitatively analyzed (i.e., local and global coherence marks and discourse informativeness). Inter-group comparison was complemented by intra-group correlation. As some inter-group comparisons revealed the existence of subgroups of patients, permutation tests were used to investigate how these subgroups differed vis-à-vis cognitive measures.

OUTCOMES & RESULTS

Overall, the results indicate that AD participants presented declines in informativeness and global coherence, correlated with declines in memory and executive functions. Permutation tests showed that participants with AD producing referential errors or misinterpretations had a deeper lexical-executive decline and a lower Mini-Mental State Evaluation (MMSE).

CONCLUSIONS & IMPLICATIONS

This study shows that two clinically relevant, qualitative signs differ in discourse production between typical ageing and early AD, namely information units and modalizing discourse. It also shows that macrolinguistic assessment is a useful tool for revealing impaired communication and cognition in early AD. Although lexical processing decline probably contributes to patients' macrolinguistic impairment, implications of extralinguistic functioning should be further investigated.

The nature of recollection across months and years and after medial temporal lobe damage

We studied the narrative recollections of memory-impaired patients with medial temporal lobe (MTL) damage who took a 25-min guided walk during which 11 planned events occurred. The recollections of the patients, recorded directly after the walk, were compared with the recollections of controls tested directly after the walk (C1), after one month (C2), or after 2.6 years (C3). With respect to memory for the walk, the narrative recollections of the patients were impoverished compared with C1 but resembled the recollections of volunteers tested after long delays (C2 and C3). In addition, how language was used by the patients in their recollections resembled how language was used by groups C2 and C3 (higher-frequency words, less concrete words, fewer nouns, more adverbs, more pronouns, and more indefinite articles). These findings appear to reflect how individuals, either memory-impaired patients or controls, typically speak about the past when memory is weak and lacks detail and need not have special implications about language use and MTL function beyond the domain of memory. A notable exception to the similarity between patient narratives and the narratives of C2 and C3 was that the control groups reported the events of the walk in correct chronological order, whereas the order in which patients reported events bore no relationship to the order in which events occurred. We suggest that the MTL is especially important for accessing global information about events and the relationships among their elements.

The Hippocampus Promotes Effective Saccadic Information Gathering in Humans

It is well established that the hippocampus is critical for memory. Recent evidence suggests that one function of hippocampal memory processing is to optimize how people actively explore the world. Here we demonstrate that the link between the hippocampus and exploration extends even to the moment-to-moment use of eye movements during visuospatial memory encoding. In Experiment 1, we examined relationships between study-phase eye movements in healthy individuals and subsequent performance on a spatial reconstruction test. In addition to quantitative measures of viewing behaviors (e.g., how many fixations or saccades were deployed during study), we used the information-theoretic measure of entropy to assess the amount of randomness or disorganization in participants' scanning behaviors. We found that the use of scanpaths during study that were lower in entropy (e.g., more organized, less random) predicted more accurate spatial reconstruction both within and between participants. Scanpath entropy was a better predictor of reconstruction accuracy than were the quantitative measures of viewing. In Experiment 2, we found that individuals with hippocampal amnesia tended to engage in viewing patterns that were higher in entropy (less organized) relative to healthy comparisons. These findings reveal a critical role of the hippocampus in guiding eye movement exploration to optimize visuospatial relational memory.

When two are better than one: Bilateral mesial temporal lobe contributions associated with better vocabulary skills in children and adolescents

This study considered the involvement of the mesial temporal lobe (MTL) in language and verbal memory functions in healthy children and adolescents. We investigated 30 healthy, right-handed children and adolescents, aged 7-16, with a fMRI language paradigm and a comprehensive cognitive test battery. We found significant MTL activations during language fMRI in all participants; 63% of them had left lateralized MTL activations, 20% exhibited right MTL lateralization, and 17% showed bilateral MTL involvement during the fMRI language paradigm. Group analyses demonstrated a strong negative correlation between the lateralization of MTL activations and language functions. Specifically, children with less lateralized MTL activation showed significantly better vocabulary skills. These findings suggest that the mesial temporal lobes of both hemispheres play an important role in language functioning, even in right-handers. Our results furthermore show that bilateral mesial temporal lobe involvement is advantageous for vocabulary skills in healthy, right-handed children and adolescents.

Patients with hippocampal amnesia successfully integrate gesture and speech

During conversation, people integrate information from co-speech hand gestures with information in spoken language. For example, after hearing the sentence, "A piece of the log flew up and hit Carl in the face" while viewing a gesture directed at the nose, people tend to later report that the log hit Carl in the nose (information only in gesture) rather than in the face (information in speech). The cognitive and neural mechanisms that support the integration of gesture with speech are unclear. One possibility is that the hippocampus - known for its role in relational memory and information integration - is necessary for integrating gesture and speech. To test this possibility, we examined how patients with hippocampal amnesia and healthy and brain-damaged comparison participants express information from gesture in a narrative retelling task. Participants watched videos of an experimenter telling narratives that included hand gestures that contained supplementary information. Participants were asked to retell the narratives and their spoken retellings were assessed for the presence of information from gesture. For features that had been accompanied by supplementary gesture, patients with amnesia retold fewer of these features overall and fewer retellings that matched the speech from the narrative. Yet their retellings included features that contained information that had been present uniquely in gesture in amounts that were not reliably different from comparison groups. Thus, a functioning hippocampus is not necessary for gesture-speech integration over short timescales. Providing unique information in gesture may enhance communication for individuals with declarative memory impairment, possibly via non-declarative memory mechanisms.

Knowledge and learning of verb biases in amnesia

Verb bias-the co-occurrence frequencies between a verb and the syntactic structures it may appear with-is a critical and reliable linguistic cue for online sentence processing. In particular, listeners use this information to disambiguate sentences with multiple potential syntactic parses (e.g., Feel the frog with the feather.). Further, listeners dynamically update their representations of specific verbs in the face of new evidence about verb-structure co-occurrence. Yet, little is known about the biological memory systems that support the use and dynamic updating of verb bias. We propose that hippocampal-dependent declarative (relational) memory represents a likely candidate system because it has been implicated in the flexible binding of relational co-occurrences and in statistical learning. We explore this question by testing patients with severe and selective deficits in declarative memory (anterograde amnesia), and demographically matched healthy participants, in their on-line interpretation of ambiguous sentences and the ability to update their verb bias with experience. We find that (1) patients and their healthy counterparts use existing verb bias to successfully interpret on-line ambiguity, however (2) unlike healthy young adults, neither group updated these biases in response to recent exposure. These findings demonstrate that using existing representations of verb bias does not necessitate involvement of the declarative memory system, but leave open the question of whether the ability to update representations of verb-specific biases requires hippocampal engagement.

The influence of the hippocampus and declarative memory on word use: Patients with amnesia use less imageable words

Hippocampal functioning contributes to our ability to generate multifaceted, imagistic event representations. Patients with hippocampal damage produce event narratives that contain fewer details and fewer imagistic features. We hypothesized that impoverished memory representations would influence language at the word level, yielding words lower in imageability and concreteness. We tested this by examining language produced by patients with bilateral hippocampal damage and severe declarative memory impairment, and brain-damaged and healthy comparison groups. Participants described events from the real past, imagined past, imagined present, and imagined future. We analyzed the imageability and concreteness of words used. Patients with amnesia used words that were less imageable than those of comparison groups across time periods, even when accounting for the amount of episodic detail in narratives. Moreover, all participants used words that were relatively more imageable when discussing real past events than other time periods. Taken together, these findings suggest that the memory that we have for an event affects how we talk about that event, and this extends all the way to the individual words that we use.

Dynamic Hippocampal and Prefrontal Contributions to Memory Processes and Representations Blur the Boundaries of Traditional Cognitive Domains

The hippocampus has long been known to be a critical component of the memory system involved in the formation and use of long-term declarative memory. However, recent findings have revealed that the reach of hippocampal contributions extends to a variety of domains and tasks that require the flexible use of cognitive and social behavior, including domains traditionally linked to prefrontal cortex (PFC), such as decision-making. In addition, the prefrontal cortex (PFC) has gained traction as a necessary part of the memory system. These findings challenge the conventional characterizations of hippocampus and PFC as being circumscribed to traditional cognitive domains. Here, we emphasize that the ability to parsimoniously account for the breadth of hippocampal and PFC contributions to behavior, in terms of memory function and beyond, requires theoretical advances in our understanding of their characteristic processing features and mental representations. Notably, several literatures exist that touch upon this issue, but have remained disjointed because of methodological differences that necessarily limit the scope of inquiry, as well as the somewhat artificial boundaries that have been historically imposed between domains of cognition. In particular, this article focuses on the contribution of relational memory theory as an example of a framework that describes both the representations and processes supported by the hippocampus, and further elucidates the role of the hippocampal–PFC network to a variety of behaviors.

Neural Oscillations and a Nascent Corticohippocampal Theory of Reference

The ability to use words to refer to the world is vital to the communicative power of human language. In particular, the anaphoric use of words to refer to previously mentioned concepts (antecedents) allows dialogue to be coherent and meaningful. Psycholinguistic theory posits that anaphor comprehension involves reactivating a memory representation of the antecedent. Whereas this implies the involvement of recognition memory or the mnemonic subroutines by which people distinguish old from new, the neural processes for reference resolution are largely unknown. Here, we report time–frequency analysis of four EEG experiments to reveal the increased coupling of functional neural systems associated with referentially coherent expressions compared with referentially problematic expressions. Despite varying in modality, language, and type of referential expression, all experiments showed larger gamma-band power for referentially coherent expressions compared with referentially problematic expressions. Beamformer analysis in high-density Experiment 4 localized the gamma-band increase to posterior parietal cortex around 400–600 msec after anaphor onset and to frontotemporal cortex around 500–1000 msec. We argue that the observed gamma-band power increases reflect successful referential binding and resolution, which links incoming information to antecedents through an interaction between the brain's recognition memory networks and frontotemporal language network. We integrate these findings with previous results from patient and neuroimaging studies, and we outline a nascent corticohippocampal theory of reference.

Language plasticity after hemispherotomy of the dominant hemisphere in 3 patients: Implication of non-linguistic networks

The neural networks involved in language recovery following hemispherotomy of the dominant hemisphere after language acquisition in children remain poorly known. Twelve hemispherotomized children (mean age at surgery: 11.3years) with comparable post-operative neuropsychological patterns underwent multi-task language functional MRI. Three of them had recovered from an initial postoperative aphasia i.e., hemispherotomy was performed on the language-dominant hemisphere. Our main results revealed (1) perisylvian activations in all patients after either left or right hemispherotomy; (2) no differences in activations between groups regarding the side of hemispherotomy; (3) additional activations in pre-frontal (3/3) and hippocampal/parahippocampal and occipito-parietal (2/3) areas, when comparing language activation in each of the three subjects with hemispherotomy of the language-dominant hemisphere to the group of 9 non-dominant hemispherotomized patients. These neural networks support the stronger engagement of learning and memory during language recovery in a hemisphere that was not initially actively subserving language.

Abstraction and generalization in statistical learning: implications for the relationship between semantic types and episodic tokens

Statistical approaches to emergent knowledge have tended to focus on the process by which experience of individual episodes accumulates into generalizable experience across episodes. However, there is a seemingly opposite, but equally critical, process that such experience affords: the process by which, from a space of types (e.g. onions-a semantic class that develops through exposure to individual episodes involving individual onions), we can perceive or create, on-the-fly, a specific token (a specific onion, perhaps one that is chopped) in the absence of any prior perceptual experience with that specific token. This article reviews a selection of statistical learning studies that lead to the speculation that this process-the generation, on the basis of semantic memory, of a novel episodic representation-is itself an instance of a statistical, in fact associative, process. The article concludes that the same processes that enable statistical abstraction across individual episodes to form semantic memories also enable the generation, from those semantic memories, of representations that correspond to individual tokens, and of novel episodic facts about those tokens. Statistical learning is a window onto these deeper processes that underpin cognition.This article is part of the themed issue 'New frontiers for statistical learning in the cognitive sciences'.

Serum ApoB levels in depressive patients: associated with cognitive deficits

Cognitive deficits have been regarded as one of the most significant clinical symptoms of depressive disorder. Accumulating evidence has shown that apolipoprotein B (ApoB) levels, which are responsible for inducing neurodegeneration, may be involved in cognitive deficits. This study examines cognitive deficits, and the correlation of serum ApoB levels with cognitive deficits of depressive disorder. 90 depressive patients and 90 healthy controls with matched age and gender were recruited. Cognition was assessed using the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). Serum ApoB levels in depressive patients were measured by immunoturbidimetric method. Our results showed that depressive patients had lower scores of cognition including RBANS total score and subscales of language and delayed memory (all, p < 0.001) than healthy controls after controlling for the variables. The differences in cognitive functions also passed Bonferroni corrections. Serum ApoB levels were negatively correlated with delayed memory score in depressive patients (r = −0.30, p = 0.01). Furthermore, stepwise multivariate regression analysis indicated that serum ApoB levels independently contributed to delayed memory in depressive patients (t = −2.68, p = 0.01). Our findings support that serum ApoB levels may be involved in delayed memory decline in depressive patients. Depressive patients also experience greater cognitive deficits, especially in delayed memory and language than healthy controls.

Assessing hippocampal development and language in early childhood: Evidence from a new application of the Automatic Segmentation Adapter Tool

Volumetric assessments of the hippocampus and other brain structures during childhood provide useful indices of brain development and correlates of cognitive functioning in typically and atypically developing children. Automated methods such as FreeSurfer promise efficient and replicable segmentation, but may include errors which are avoided by trained manual tracers. A recently devised automated correction tool that uses a machine learning algorithm to remove systematic errors, the Automatic Segmentation Adapter Tool (ASAT), was capable of substantially improving the accuracy of FreeSurfer segmentations in an adult sample [Wang et al., 2011], but the utility of ASAT has not been examined in pediatric samples. In Study 1, the validity of FreeSurfer and ASAT corrected hippocampal segmentations were examined in 20 typically developing children and 20 children with autism spectrum disorder aged 2 and 3 years. We showed that while neither FreeSurfer nor ASAT accuracy differed by disorder or age, the accuracy of ASAT corrected segmentations were substantially better than FreeSurfer segmentations in every case, using as few as 10 training examples. In Study 2, we applied ASAT to 89 typically developing children aged 2 to 4 years to examine relations between hippocampal volume, age, sex, and expressive language. Girls had smaller hippocampi overall, and in left hippocampus this difference was larger in older than younger girls. Expressive language ability was greater in older children, and this difference was larger in those with larger hippocampi, bilaterally. Overall, this research shows that ASAT is highly reliable and useful to examinations relating behavior to hippocampal structure.

The problem of multimodal concurrent serial order in behavior

The "problem of serial order in behavior," as formulated and discussed by Lashley (1951), is arguably more pervasive and more profound both than originally stated and than currently appreciated. We spell out two complementary aspects of what we term the generalized problem of behavior: (i) multimodality, stemming from the disparate nature of the sensorimotor variables and processes that underlie behavior, and (ii) concurrency, which reflects the parallel unfolding in time of these processes and of their asynchronous interactions. We illustrate these on a number of examples, with a special focus on language, briefly survey the computational approaches to multimodal concurrency, offer some hypotheses regarding the manner in which brains address it, and discuss some of the broader implications of these as yet unresolved issues for cognitive science.

Cueing the personal future to reduce discounting in intertemporal choice: Is episodic prospection necessary?

How does the ability to imagine detailed future experiences (i.e., episodic prospection) contribute to choices between immediate and delayed rewards? Individuals with amnesia do not show abnormally steep discounting in intertemporal choice, suggesting that neither medial temporal lobe (MTL) integrity nor episodic prospection is required for the valuation of future rewards (Kwan et al. (), Hippocampus, 22:1215-1219; Kwan et al. (2013), J Exp Psychol, 142:1355-1369 2013). However, hippocampally mediated episodic prospection in healthy adults reduces the discounting of future rewards (Peters and Büchel (2010), Neuron, 66:138-148; Benoit et al. (2011), J Neurosci, 31:6771-6779), raising the possibility that MTL damage causes more subtle impairments to this form of decision-making than noted in previous patient studies. Intertemporal choice appears normal in amnesic populations, yet they may be unable to use episodic prospection to adaptively modulate the value assigned to future rewards. To investigate how the extended hippocampal system, including the hippocampus and related MTL structures, contributes to the valuation of future rewards, we compared the performance of six amnesic cases with impaired episodic prospection to that of 20 control participants on two versions of an intertemporal choice task: a standard discounting task, and a cued version in which cues prompted them to imagine specific personal future events temporally contiguous with the receipt of delayed rewards. Amnesic individuals' intertemporal choices in the standard condition were indistinguishable from those of controls, replicating previous findings. Surprisingly, performance of the amnesic cases in the cued condition indicates that amnesia does not preclude flexible modulation of choices in response to future event cues, even in the absence of episodic prospection. Cueing the personal future to modulate decisions appears to constitute a less demanding or a qualitatively different (e.g., personal semantic) form of prospection that is not as sensitive to MTL damage as prospective narrative generation.

Distinct functional connectivity of the hippocampus during semantic and phonemic fluency

Verbal fluency tasks are typically used in neuropsychological practice for assessment of language function in a variety of neurological disorders. Recently, it has been shown that the hippocampus, a region thought to be exclusive to the domain of memory, is also involved in tests of semantic fluency. The present study further explores hippocampal contribution to verbal fluency using functional Magnetic Resonance Imaging (fMRI) and examining mean activity and inter-regional functional connectivity with known task-related brain regions. Given the clear lateralization of brain areas involved in language, lateralization of hippocampal involvement in semantic and phonemic word fluency was also investigated. Different hippocampal recruitment during semantic and phonemic fluency was found: greater change in activity was seen during semantic fluency, as compared with phonemic fluency. This pattern was obtained in the right and the left hippocampus, with no lateralization effects. Functional connectivity analyses corroborate the notion of selective contribution of the hippocampus to semantic fluency. During the semantic fluency task, connectivity levels between the hippocampi and components of the semantic network did not differ from connectivity levels within the semantic network. In contrast, during the phonemic fluency task, the hippocampi were less correlated with components of the phonemic network, as compared to the within phonemic network connectivity. Importantly, hippocampal connectivity with the semantic network was task-dependent and restricted to periods of semantic fluency performance. Altogether, results suggest that the right and the left hippocampus are integral components of the brain network that selectively supports verbal semantic fluency, but not phonemic fluency.

Hippocampus contributes to the maintenance but not the quality of visual information over time

The hippocampus has recently been implicated in the brief representation of visual information, but its specific role is not well understood. We investigated this role using a paradigm that distinguishes quantity and quality of visual memory as described in a previous study. We found that amnesic patients with bilateral hippocampal damage (N = 5) were less likely to remember test stimuli than comparison participants despite a brief maintenance interval (900 msec). However, estimates of memory quality were similar for all groups. Our findings suggest that the hippocampus contributes to brief maintenance of visual information but does not contribute to the quality of that information.

The influence of partner-specific memory associations on picture naming: a failure to replicate Horton (2007)

The results of two experiments by Horton (2007) show that speakers name a pictured object faster when in the presence of another person with whom the speaker has previously associated that object name. The first of those two experiments (Horton, 2007, Experiment 1) is the focus of the present research. This paper presents the results of three experiments designed to replicate and extend Horton's (2007) Experiment 1. The original findings were not replicated. These findings do not support the hypothesis that partner-specific memory associations facilitate object naming.

The role of the hippocampus in flexible cognition and social behavior

Successful behavior requires actively acquiring and representing information about the environment and people, and manipulating and using those acquired representations flexibly to optimally act in and on the world. The frontal lobes have figured prominently in most accounts of flexible or goal-directed behavior, as evidenced by often-reported behavioral inflexibility in individuals with frontal lobe dysfunction. Here, we propose that the hippocampus also plays a critical role by forming and reconstructing relational memory representations that underlie flexible cognition and social behavior. There is mounting evidence that damage to the hippocampus can produce inflexible and maladaptive behavior when such behavior places high demands on the generation, recombination, and flexible use of information. This is seen in abilities as diverse as memory, navigation, exploration, imagination, creativity, decision-making, character judgments, establishing and maintaining social bonds, empathy, social discourse, and language use. Thus, the hippocampus, together with its extensive interconnections with other neural systems, supports the flexible use of information in general. Further, we suggest that this understanding has important clinical implications. Hippocampal abnormalities can produce profound deficits in real-world situations, which typically place high demands on the flexible use of information, but are not always obvious on diagnostic tools tuned to frontal lobe function. This review documents the role of the hippocampus in supporting flexible representations and aims to expand our understanding of the dynamic networks that operate as we move through and create meaning of our world.

Mechanisms for widespread hippocampal involvement in cognition

The quintessential memory system in the human brain--the hippocampus and surrounding medial temporal lobe--is often treated as a module for the formation of conscious, or declarative, memories. However, growing evidence suggests that the hippocampus plays a broader role in memory and cognition and that theories organizing memory into strictly dedicated systems may need to be updated. We first consider the historical evidence for the specialized role of the hippocampus in declarative memory. Then, we describe the serendipitous encounter that motivated the special section in this issue, based on parallel research from our labs that suggested a more pervasive contribution of the hippocampus to cognition beyond declarative memory. Finally, we develop a theoretical framework that describes 2 general mechanisms for how the hippocampus interacts with other brain systems and cognitive processes: the memory modulation hypothesis, in which mnemonic representations in the hippocampus modulate the operation of other systems, and the adaptive function hypothesis, in which specialized computations in the hippocampus are recruited as a component of both mnemonic and nonmnemonic functions. This framework is consistent with an emerging view that the most fertile ground for discovery in cognitive psychology and neuroscience lies at the interface between parts of the mind and brain that have traditionally been studied in isolation.

Multiple Memory Systems and Their Support of Language

There is a long history of research linking the various forms of memory to different aspects of language. Clinically, we see this memory-language connection in the prevalence of language and communication deficits in populations that have concomitant impairments in memory and learning. In this article, we provide an overview of how the demands of language use and processing are supported by multiple memory systems in the brain, including working memory, declarative memory and nondeclarative memory, and how disruptions in different forms of memory may affect language. While not an exhaustive review of the literature, special attention is paid to populations who speech-language pathologists (SLPs) routinely serve. The goal of this review is to provide a resource for clinicians working with clients with disorders in memory and learning in helping to understand and anticipate the range of disruptions in language and communication that can arise as a consequence of memory impairment. We also hope this is a catalyst for more research on the contribution of multiple memory systems to language and communication.

Talker-specific learning in amnesia: Insight into mechanisms of adaptive speech perception

A hallmark of human speech perception is the ability to comprehend speech quickly and effortlessly despite enormous variability across talkers. However, current theories of speech perception do not make specific claims about the memory mechanisms involved in this process. To examine whether declarative memory is necessary for talker-specific learning, we tested the ability of amnesic patients with severe declarative memory deficits to learn and distinguish the accents of two unfamiliar talkers by monitoring their eye-gaze as they followed spoken instructions. Analyses of the time-course of eye fixations showed that amnesic patients rapidly learned to distinguish these accents and tailored perceptual processes to the voice of each talker. These results demonstrate that declarative memory is not necessary for this ability and points to the involvement of non-declarative memory mechanisms. These results are consistent with findings that other social and accommodative behaviors are preserved in amnesia and contribute to our understanding of the interactions of multiple memory systems in the use and understanding of spoken language.