Holistic versus feature-based binding in the medial temporal lobe

Real-world objects are not stored in holistic representations in visual working memory

When storing multiple objects in visual working memory, observers sometimes misattribute perceived features to incorrect locations or objects. These misattributions are called binding errors (or swaps) and have been previously demonstrated mostly in simple objects whose features are easy to encode independently and arbitrarily chosen, like colors and orientations. Here, we tested whether similar swaps can occur with real-world objects, where the connection between features is meaningful rather than arbitrary. In Experiments 1 and 2, observers were simultaneously shown four items from two object categories. Within a category, the two exemplars could be presented in either the same or different states (e.g., open/closed; full/empty). After a delay, both exemplars from one of the categories were probed, and participants had to recognize which exemplar went with which state. We found good memory for state information and exemplar information on their own, but a significant memory decrement for exemplar–state combinations, suggesting that binding was difficult for observers and swap errors occurred even for meaningful real-world objects. In Experiment 3, we used the same task, but in one-half of the trials, the locations of the exemplars were swapped at test. We found that there are more errors in general when the locations of exemplars were swapped. We concluded that the internal features of real-world objects are not perfectly bound in working memory, and location updates impair object and feature representations. Overall, we provide evidence that even real-world objects are not stored in an entirely unitized format in working memory.

Mnemonic Similarity Task: A Tool for Assessing Hippocampal Integrity

The hippocampus is critical for learning and memory, relying in part on pattern separation processes supported by the dentate gyrus (DG) to prevent interference from overlapping memory representations. In 2007, we designed the Mnemonic Similarity Task (MST), a modified object recognition memory task, to be highly sensitive to hippocampal function by placing strong demands on pattern separation. The MST is now a widely used behavioral task, repeatedly shown to be sensitive to age-related memory decline, hippocampal connectivity, and hippocampal function, with specificity to the DG. Here, we review the utility of the MST, its relationship to hippocampal function, its utility in detecting hippocampal-based memory alterations across the lifespan, and impairments associated with clinical pathology from a variety of disorders.

Feature-coding transitions to conjunction-coding with progression through human visual cortex

Identifying an object and distinguishing it from similar items depends upon the ability to perceive its component parts as conjoined into a cohesive whole, but the brain mechanisms underlying this ability remain elusive. The ventral visual processing pathway in primates is organized hierarchically: Neuronal responses in early stages are sensitive to the manipulation of simple visual features, whereas neuronal responses in subsequent stages are tuned to increasingly complex stimulus attributes. It is widely assumed that feature-coding dominates in early visual cortex whereas later visual regions employ conjunction-coding in which object representations are different from the sum of their simple feature parts. However, no study in humans has demonstrated that putative object-level codes in higher visual cortex cannot be accounted for by feature-coding and that putative feature codes in regions prior to ventral temporal cortex are not equally well characterized as object-level codes. Thus the existence of a transition from feature- to conjunction-coding in human visual cortex remains unconfirmed, and if a transition does occur its location remains unknown. By employing multivariate analysis of functional imaging data, we measure both feature-coding and conjunction-coding directly, using the same set of visual stimuli, and pit them against each other to reveal the relative dominance of one vs. the other throughout cortex. Our results reveal a transition from feature-coding in early visual cortex to conjunction-coding in both inferior temporal and posterior parietal cortices. This novel method enables the use of experimentally controlled stimulus features to investigate population-level feature and conjunction codes throughout human cortex.NEW & NOTEWORTHY We use a novel analysis of neuroimaging data to assess representations throughout visual cortex, revealing a transition from feature-coding to conjunction-coding along both ventral and dorsal pathways. Occipital cortex contains more information about spatial frequency and contour than about conjunctions of those features, whereas inferotemporal and parietal cortices contain conjunction coding sites in which there is more information about the whole stimulus than its component parts.

Interaction between attentional systems and episodic memory encoding: the impact of conflict on binding of information

Episodic memory (EM) is defined as a long-term memory system that stores information that can be retrieved along with details of the context of the original events (binding). Several studies have shown that manipulation of attention during encoding can impact subsequent memory performance. An influential model of attention distinguishes between three partially independent attentional networks: the alerting, the orienting and the executive or conflict resolution component. To date, the impact of the engagement of these sub-systems during encoding on item and relational context binding has not been investigated. Here, we developed a new task combining the Attentional Network Test and an incidental episodic memory encoding task to study this issue. We reported that when the alerting network was not solicited, resolving conflict hindered item encoding. Moreover, resolving conflict, independently of the cueing condition, had a negative impact on context binding. These novel findings could have a potential impact in the understanding EM formation, and memory disorders in different populations, including healthy elderly people.