Spatio-Temporal Structure, Path Characteristics, and Perceptual Grouping in Immediate Serial Spatial Recall

Inter-individual variability (but intra-individual stability) of overt versus covert rehearsal strategies in a digital Corsi task

The Corsi (block-tapping) paradigm is a classic and well-established visuospatial working memory task in humans involving internal computations (memorizing of item sequences, organizing and updating the memorandum, and recall processes), as well as both overt and covert shifts of attention to facilitate rehearsal, serving to maintain the Corsi sequences during the retention phase. Here, we introduce a novel digital version of a Corsi task in which i) the difficulty of the memorandum (using sequence lengths ranging from 3 to 8) was controlled, ii) the execution of overt and/or covert attention as well as the visuospatial working memory load during the retention phase was manipulated, and iii) shifts of attention were quantified in all experimental phases. With this, we present behavioral data that demonstrate, characterize, and classify the individual effects of overt and covert strategies used as a means of encoding and rehearsal. In a full within-subject design, we tested 28 participants who had to solve three different Corsi conditions. While in condition A neither of the two strategies were restricted, in condition B the overt and in condition C the overt as well as the covert strategies were suppressed. Analyzing Corsi span, (eye) exploration index, and pupil size (change), data clearly show a continuum between overt and covert strategies over all participants (indicating inter-individual variability). Further, all participants showed stable strategy choice (indicating intra-individual stability), meaning that the preferred strategy was maintained in all three conditions, phases, and sequence lengths of the experiment.

Event-related theta and gamma band oscillatory dynamics during visuo-spatial sequence memory in younger and older adults

Visuo-spatial working memory (VSWM) for sequences is thought to be crucial for daily behaviors. Decades of research indicate that oscillations in the gamma and theta bands play important functional roles in the support of visuo-spatial working memory, but the vast majority of that research emphasizes measures of neural activity during memory retention. The primary aims of the present study were (1) to determine whether oscillatory dynamics in the Theta and Gamma ranges would reflect item-level sequence encoding during a computerized spatial span task, (2) to determine whether item-level sequence recall is also related to these neural oscillations, and (3) to determine the nature of potential changes to these processes in healthy cognitive aging. Results indicate that VSWM sequence encoding is related to later (∼700 ms) gamma band oscillatory dynamics and may be preserved in healthy older adults; high gamma power over midline frontal and posterior sites increased monotonically as items were added to the spatial sequence in both age groups. Item-level oscillatory dynamics during the recall of VSWM sequences were related only to theta-gamma phase amplitude coupling (PAC), which increased monotonically with serial position in both age groups. Results suggest that, despite a general decrease in frontal theta power during VSWM sequence recall in older adults, gamma band dynamics during encoding and theta-gamma PAC during retrieval play unique roles in VSWM and that the processes they reflect may be spared in healthy aging.

Working Memory for Spatial Sequences: Developmental and Evolutionary Factors in Encoding Ordinal and Relational Structures

Sequence learning is a ubiquitous facet of human and animal cognition. Here, using a common sequence reproduction task, we investigated whether and how the ordinal and relational structures linking consecutive elements are acquired by human adults, children, and macaque monkeys. While children and monkeys exhibited significantly lower precision than adults for spatial location and temporal order information, only monkeys appeared to exceedingly focus on the first item. Most importantly, only humans, regardless of age, spontaneously extracted the spatial relations between consecutive items and used a chunking strategy to compress sequences in working memory. Monkeys did not detect such relational structures, even after extensive training. Monkey behavior was captured by a conjunctive coding model, whereas a chunk-based conjunctive model explained more variance in humans. These age- and species-related differences are indicative of developmental and evolutionary mechanisms of sequence encoding and may provide novel insights into the uniquely human cognitive capacities.SIGNIFICANCE STATEMENT Sequence learning, the ability to encode the order of discrete elements and their relationships presented within a sequence, is a ubiquitous facet of cognition among humans and animals. By exploring sequence-processing abilities at different human developmental stages and in nonhuman primates, we found that only humans, regardless of age, spontaneously extracted the spatial relations between consecutive items and used an internal language to compress sequences in working memory. The findings provided insights into understanding the origins of sequence capabilities in humans and how they evolve through development to identify the unique aspects of human cognitive capacity, which includes the comprehension, learning, and production of sequences, and perhaps, above all, language processing.

A comparison of simultaneous and sequential visuo-spatial memory in children born very preterm

Research suggests that children born very preterm (≤32 weeks' gestation) are at greater risk of impairments in information processing (particularly when information is presented simultaneously rather than sequentially) and visuo-spatial short-term and working memory relative to children born at term. This study compared the performance of children born very preterm with their term-born peers to elucidate the nature of group differences in these areas. 113 children (65 very preterm; 48 term-born) aged 8-to-11 years completed four visuo-spatial recall tasks. Tasks varied by presentation type (simultaneous or sequential) and memory type (short-term or working memory). Both groups recalled more locations in simultaneous than sequential tasks, and in short-term than working memory tasks. In short-term memory tasks, children born at term recalled more locations than children born very preterm for the sequential task, but groups did not differ on the simultaneous task. The opposite pattern was observed in the working memory tasks, with no group differences on the sequential task, but better performance on the simultaneous task for children born at term. Our findings indicate that simultaneous processing may not be impaired in children born very preterm per se, with poorer performance observed only under high cognitive demand. This interaction suggests very preterm birth may affect the level of cognitive resources available during feature integration, the consequences of which become apparent when resources are already stretched. The impact of interactions with cognitive demand in this population should be an important consideration for educational support strategies, and for assessment in research and clinic.

Sources of variation in search and foraging: A theoretical perspective

Search-the problem of exploring a space of alternatives to identify target goals-is a fundamental behaviour for many species. Although its foundation lies in foraging, most studies of human search behaviour have been directed towards understanding the attentional mechanisms that underlie the efficient visual exploration of two-dimensional (2D) scenes. With this review, we aim to characterise how search behaviour can be explained across a wide range of contexts, environments, spatial scales, and populations, both typical and atypical. We first consider the generality of search processes across psychological domains. We then review studies of interspecies differences in search. Finally, we explore in detail the individual and contextual variables that affect visual search and related behaviours in established experimental psychology paradigms. Despite the heterogeneity of the findings discussed, we identify that variations in control processes, along with the ability to regulate behaviour as a function of the structure of search space and the sampling processes adopted, to be central to explanations of variations in search behaviour. We propose a tentative theoretical model aimed at integrating these notions and close by exploring questions that remain unaddressed.

Differences in Encoding Strategy as a Potential Explanation for Age-Related Decline in Place Recognition Ability

The ability to recognise places is known to deteriorate with advancing age. In this study, we investigated the contribution of age-related changes in spatial encoding strategies to declining place recognition ability. We recorded eye movements while younger and older adults completed a place recognition task first described by Muffato et al. (2019). Participants first learned places, which were defined by an array of four objects, and then decided whether the next place they were shown was the same or different to the one they learned. Places could be shown from the same spatial perspective as during learning or from a shifted perspective (30° or 60°). Places that were different to those during learning were changed either by substituting an object in the place with a novel object or by swapping the locations of two objects. We replicated the findings of Muffato et al. (2019) showing that sensitivity to detect changes in a place declined with advancing age and declined when the spatial perspective was shifted. Additionally, older adults were particularly impaired on trials in which object locations were swapped; however, they were not differentially affected by perspective changes compared to younger adults. During place encoding, older adults produced more fixations and saccades, shorter fixation durations, and spent less time looking at objects compared to younger adults. Further, we present an analysis of gaze chaining, designed to capture spatio-temporal aspects of gaze behaviour. The chaining measure was a significant predictor of place recognition performance. We found significant differences between age groups on the chaining measure and argue that these differences in gaze behaviour are indicative of differences in encoding strategy between age groups. In summary, we report a direct replication of Muffato et al. (2019) and provide evidence for age-related differences in spatial encoding strategies, which are related to place recognition performance.

Variations in the Beneficial Effects of Spatial Structure and Serial Organisation on Working Memory Span in Humans and Other Species

This chapter reviews studies of spontaneous search in large-scale settings and studies featuring variations of the Corsi test in humans and animals. It aims to highlight a synergy of working memory (WM) processes and the use of spatio-temporal structure and explain its underpinnings within a comparative framework. The chapter starts by showing that the degree of organisation of serial search patterns spontaneously deployed by humans and animals in simulated foraging tasks is associated with a reduction of WM errors. Then, by comparing studies conducted on different species, it exposes a parallel between the degree of search organisation and taxonomic relatedness to humans. Such a parallel could indicate that a hallmark of the cognition of humans and closely related species is the ability to offload WM by developing serially organised search patterns that exploit the spatial structure of the environment. However, a causal relationship between serial organisation and search efficiency can only be inferred with serial recall tasks, where the structure of specific sequences can be systematically manipulated. Thus, studies using variations of the Corsi test are considered subsequently, which suggest that humans might enjoy an exceptional aptitude to benefit from the spatio-temporal structure in serial tasks, despite remarkable memory abilities shown by other primate species as well. The extent to which the benefit of spatial organisation in human WM span must be mediated by perceptual grouping processes is then considered. To clarify this issue, recent experiments using virtual reality to compare serial recall in small visual displays that afford perceptual grouping and in immersive navigational spaces that cannot do so are discussed. The results of these latter experiments indicate that the effects of structure in serial recall emerge in conditions not affording grouping at perceptual level. Thus, it is suggested that more central representational processes play a role in the interaction between spatio-temporal organisation and working memory span in humans.

Training Motor Sequences: Effects of Speed and Accuracy Instructions

Participants practiced a fixed 3- and a fixed 6-key press sequence for 144 times each. In the speed group, they were instructed to execute their sequences fast without bothering much about errors while the accurate group was instructed to be careful and prevent errors. In the test phase, participants executed series of 3 and 6 responses (a) when all element-specific stimuli were displayed in the familiar order, (b) in response to just the familiar first stimulus, and (c) by responding to random stimuli. The speed instruction yielded stronger sequencing skill while the accuracy instruction developed stronger reaction skill.

Pointing movements both impair and improve visuospatial working memory depending on serial position

Two experiments investigated the effects of pointing movements on the item and order recall of random, horizontal, and vertical arrays consisting of 6 and 7 squares (Experiment 1) or 8 and 9 squares (Experiment 2). In the encoding phase, participants either viewed the items passively (passive-view condition) or pointed towards them (pointing condition). Then, after a brief interval, they were requested to recall the locations of the studied squares in the correct order of presentation. The critical result was that, for all types of arrays, the effects of the encoding condition varied as a function of serial position: for the initial and central positions accuracy was higher in the passive-view than in the pointing condition (confirming the standard inhibitory effect of pointing movements on visuospatial working memory), whereas the reverse pattern occurred in the final positions-showing a significant advantage of the pointing condition over the passive-view condition. Findings are interpreted as showing that pointing can have two simultaneous effects on the recall of spatial locations, a positive one due to the addition of a motor code and a negative one due to the attentional requirements of hand movements, with the net impact on serial recall depending on the amount of attention resources needed for the encoding of each position. Implications for the item-order hypothesis and the perceptual-gestural account of working memory are also discussed.