Finding the answer in space: the mental whiteboard hypothesis on serial order in working memory

Spatial-positional associations in short-term memory can vanish in long-term memory

Studies on the SPoARC effect have shown that serial information is spatially processed in working memory. However, it remains unknown whether these spatial-positional associations are durable or only temporary. This study aimed at investigating whether spatialization would persist when a sequence presented repeatedly is expected to be chunked. If chunked, the items could be unified spatially and their spatialization could vanish. Thirty-seven participants performed a spatialization task which was remotely inspired by the Hebb repetition paradigm. A sequence of four stimuli presented individually in the middle of a computer screen was repeated throughout the task. After each sequence, participants had to decide whether a probe belonged to the series using two lateralized response keys. The results showed no spatialization for these repetitive sequences, on average. Moreover, further analysis revealed that the effect was detectable at the beginning of the task, suggesting that the more the sequence was repeated, the less participants spatialized information from left to right. These findings show that associations created in working memory between items and space can vanish in repeated sequences: we discuss the idea that working memory progressively saves on spatialization once a sequence is chunked in long-term memory.

Separating spatial representations from polarity encoding in the processing of number and sequence stimuli in a four-way classification task

Although the SNARC effect in the processing of most magnitude stimuli and sequence stimuli has been reported for the past 30 years, it remains unclear whether this effect is caused by the spatial representation or polarity encoding of stimuli. In the present study, we designed five experiments using a four-way classification task to evaluate the ability of spatial representation theory and polarity encoding theory to explain the SNARC effect in the processing of number and sequence stimuli. In all five experiments in the present study, stimuli (Experiments 1 and 4: four different Arabic numbers, Experiment 2: sequence stimuli, Experiment 3: ordinal sequences relevant to working memory, Experiment 5: Chinese characters without any implicit spatial information) were centrally presented. Participants were asked to respond to specific number or sequence stimuli by pressing the A, S, K, and L keys in consistent trials (or the L, K, S, and A keys in inconsistent trials). The results showed that (1) the SNARC effect occurred in the processing of number and sequence stimuli both when only one specific number was mapped to one specific key (Experiments 1, 2 and 3) and when two numbers were mapped to one specific key (Experiment 4). (2) There was not a SNARC effect when the numbers were replaced with Chinese characters without any implicit spatial information (Experiment 5). The results of these five experiments imply that the SNARC effect in the processing of magnitude stimuli, including numbers and sequences, originates from the spatial representation of stimuli, supporting spatial representation theory.

The reciprocity of spatial-numerical associations of vocal response codes depends on stimulus mode

Individuals make faster left responses to small/er numbers and faster right responses to large/r numbers than vice versa. This "spatial-numerical association of response codes" (SNARC) effect represents evidence for an overlap between the cognitive representations of number and space. Theories of the SNARC effect differ in whether they predict bidirectional S-R associations between number and space or not. We investigated the reciprocity of S-R priming effects between number and location in three experiments with vocal responses. In Experiments 1 and 2, participants completed a number-location task, with digits as stimuli and location words as responses, and a location-number task, with physical locations as stimuli and number words as responses. In addition, we varied the S-R mapping in each task. Results revealed a strong SNARC effect in the number-location task, but no reciprocal SNARC effect in the location-number task. In Experiment 3, we replaced physical location stimuli with location words and digit stimuli with number words. Results revealed a regular and a reciprocal SNARC effect of similar size. Reciprocal SNARC effects thus seem to emerge with verbal location stimuli and vocal responses, but not with physical location stimuli and vocal responses. The S-R associations underlying the SNARC effect with vocal responses thus appear bidirectional and symmetrical for some combinations of stimulus and response sets, but not for others. This has implications for theoretical accounts of the SNARC effect which need to explain how stimulus mode affects the emergence of reciprocal but not regular SNARC effects.

Inhibition and working memory capacity modulate the mental space-time association

This research aimed to investigate whether the mental space-time association of temporal concepts could be modulated by the availability of cognitive resources (in terms of working memory and inhibitory control capacities) and to explore whether access to this association could be an automatic process. To achieve this, two experiments were carried out. In Experiment 1, participants had to classify words with future and past meanings. The working memory load (high vs. low) was manipulated and the participants were grouped into quartiles according to their visuospatial working memory capacity (WMC). Temporal concepts were displayed subliminally (immediate masking) and supraliminally (delayed masking). The ANOVA showed a performance pattern consistent with the left-past right-future conceptual scheme, regardless of both the type of masking and the working memory load, except in high WMC participants, in which, interestingly, the space-time association effect was absent. In Experiment 2, participants were asked to respond to the colour of the font of the temporal words, and their attentional control capacity was assessed. The results indicated a timeline effect that was irrespective of the WM load and the type of perceptual processing, but not of the WM capacity or the inhibitory abilities. These findings partially endorse the automatic and implicit access to the mental space-time association and suggest the involvement of the availability of cognitive resources. Individual WMC differences appear to modulate the automatic nature of the effect rather than the processing conditions themselves.

Vertical Mental Timeline Is Not Influenced by VisuoSpatial Processing

The results examining the direction (bottom-to-top vs. top-to-bottom) of the mental vertical timeline are not conclusive. The visuospatial processing of temporal stimuli along vertical space could influence this time representation. This study aimed to investigate whether and how the visuospatial processing stage modulated the vertical timeline in an online temporal categorization task. In three studies, Italian university students (N = 150) responded more quickly to words expressing the past with a down arrow key, and more quickly to words expressing the future with an up arrow key, irrespective of whether the words were located in the top, middle, or bottom space (Experiment 1), or were presented downward (from top to bottom; Experiment 2A) or upward (from bottom to top Experiment 2B). These results suggest that the representation of time was not influenced by the visuospatial processing. The daily experience with verticality (e.g., to reach the attic, the lift goes up) could explain the bottom-to-top direction of the mental timeline.

Temporal and Spatial Information Elicit Different Power and Connectivity Profiles during Working Memory Maintenance

Working memory (WM) is the cognitive ability to store and manipulate information necessary for ongoing tasks. Although frontoparietal areas are involved in the retention of visually presented information, oscillatory neural activity differs for temporal and spatial WM processing. In this study, we corroborated previous findings describing the modulation of neural oscillations and expanded our investigation to the network organization underlying the cognitive processing of temporal and spatial information. We utilized MEG recordings during a Sternberg visual WM task. The spectral oscillatory activity in the maintenance phase revealed increased frontal theta (4-8 Hz) and parietal beta (13-30 Hz) in the temporal condition. Source level coherence analysis delineated the prominent role of parietal areas in all frequency bands during the maintenance of temporal information, whereas frontal and central areas showed major contributions in theta and beta ranges during the maintenance of spatial information. Our study revealed distinct spectral profiles of neural oscillations for separate cognitive subdomains of WM processing. The delineation of specific functional networks might have important implications for clinical applications, enabling the development of stimulation protocols targeting cognitive disabilities associated with WM impairments.

Microsaccades Track Location-Based Object Rehearsal in Visual Working Memory

Besides controlling eye movements, the brain's oculomotor system has been implicated in the control of covert spatial attention and the rehearsal of spatial information in working memory. We investigated whether the oculomotor system also contributes to rehearsing visual objects in working memory when object location is never asked about. To address this, we tracked the incidental use of locations for mnemonic rehearsal via directional biases in microsaccades while participants maintained two visual objects (colored oriented gratings) in working memory. By varying the stimulus configuration (horizontal, diagonal, and vertical) at encoding, we could quantify whether microsaccades were more aligned with the configurational axis of the memory contents, as opposed to the orthogonal axis. Experiment 1 revealed that microsaccades continued to be biased along the axis of the memory content several seconds into the working memory delay. In Experiment 2, we confirmed that this directional microsaccade bias was specific to memory demands, ruling out lingering effects from passive and attentive encoding of the same visual objects in the same configurations. Thus, by studying microsaccade directions, we uncover oculomotor-driven rehearsal of visual objects in working memory through their associated locations.

No obligatory trade-off between the use of space and time for working memory

Space and time can each act as scaffolds for the individuation and selection of visual objects in working memory. Here we ask whether there is a trade-off between the use of space and time for visual working memory: whether observers will rely less on space, when memoranda can additionally be individuated through time. We tracked the use of space through directional biases in microsaccades after attention was directed to memory contents that had been encoded simultaneously or sequentially to the left and right of fixation. We found that spatial gaze biases were preserved when participants could (Experiment 1) and even when they had to (Experiment 2) additionally rely on time for object individuation. Thus, space remains a profound organizing medium for working memory even when other organizing sources are available and utilized, with no evidence for an obligatory trade-off between the use of space and time.

Heterogeneity of short-term memory deficits in children with dyslexia

Many studies have highlighted short-term memory (STM) impairment in dyslexic individuals. Several studies showed deficits for both item and serial order aspects of verbal STM in dyslexic individuals. These group-based studies, however, do not inform us about the prevalence of these deficits and, importantly, their potential heterogeneity at the individual level. The present study examined both group-level and individual STM profiles in dyslexic and age-matched non-dyslexic children. While confirming previous group-based results of both item and serial order STM deficits, individual analyses indicated two distinct profiles: one profile was associated with verbal item STM and phonological impairment while another profile showed selective serial STM deficits in both verbal and visual domains. Our results highlight the need for practitioners to consider the heterogeneous nature of STM impairment in dyslexia and to adapt STM and reading treatment strategies accordingly.

Optimized experimental designs to best detect spatial positional association of response codes in working memory

The SPoARC (Spatial Positional Association of Response Codes) effect refers to spatialization of information in working memory. Among the potential factors that could influence how order is mapped onto a mental space during the recognition process, we selected the following two factors: i) the type of stimuli, in particular their verbal vs. visual aspects and ii) the number of probes. In this study, 137 participants memorized sequences of either words or pictures and subsequently performed a recognition test for which they responded using lateralized keys. For half of the participants, only one probe was presented after each sequence, whereas the other half was administered several probes. A significantly greater number of participants presented a SPoARC using a single probe. We discuss that spatialization is best detected when the sequence is scanned only once. Results also showed no difference between the two types of stimuli (i.e., verbal vs. visual). This finding raises the question of the respective roles of verbalization and visualization in the SPoARC.

The Role of Temporal Order in Egocentric and Allocentric Spatial Representations

Several studies have shown that spatial information is encoded using two types of reference systems: egocentric (body-based) and/or allocentric (environment-based). However, most studies have been conducted in static situations, neglecting the fact that when we explore the environment, the objects closest to us are also those we encounter first, while those we encounter later are usually those closest to other environmental objects/elements. In this study, participants were shown with two stimuli on a computer screen, each depicting a different geometric object, placed at different distances from them and an external reference (i.e., a bar). The crucial manipulation was that the stimuli were shown sequentially. After participants had memorized the position of both stimuli, they had to indicate which object appeared closest to them (egocentric judgment) or which object appeared closest to the bar (allocentric judgment). The results showed that egocentric judgements were facilitated when the object closest to them was presented first, whereas allocentric judgements were facilitated when the object closest to the bar was presented second. These results show that temporal order has a different effect on egocentric and allocentric frames of reference, presumably rooted in the embodied way in which individuals dynamically explore the environment.

Role of time in binding features in visual working memory

Previous research on feature binding in visual working memory has supported a privileged role for location in binding an object's nonspatial features. However, humans are able to correctly recall feature conjunctions of objects that occupy the same location at different times. In a series of behavioral experiments, we investigated binding errors under these conditions, and specifically tested whether ordinal position can take the role of location in mediating feature binding. We performed two dual report experiments in which participants had to memorize three colored shapes presented sequentially at the screen center. When participants were cued with the ordinal position of one item and had to report its shape and color, report errors for the two features were largely uncorrelated. In contrast, when participants were cued, for example, with an item's shape and reported an incorrect ordinal position, they had a high chance of making a corresponding error in the color report. This pattern of error correlations closely matched the predictions of a model in which color and shape are bound to each other only indirectly via an item's ordinal position. In a third experiment, we directly compared the roles of location and sequential position in feature binding. Participants viewed a sequence of colored disks displayed at different locations and were cued either by a disk's location or its ordinal position to report its remaining properties. The pattern of errors supported a mixed strategy with individual variation, suggesting that binding via either time or space could be used for this task. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Learning and generalization of repetition-based rules in autism

Rule Learning (RL) allows us to extract and generalize high-order rules from a sequence of elements. Despite the critical role of RL in the acquisition of linguistic and social abilities, no study has investigated RL processes in Autism Spectrum Disorder (ASD). Here, we investigated RL in high-functioning autistic adolescents with ASD, examining whether their ability to extract and generalize rules from a sequence of visual elements is affected by the social vs. non-social nature of the stimulus and by visual working memory (WM). Using a forced-choice paradigm, ASD adolescents and typically developing (TD) peers were tested for their ability to detect and generalize high-order, repetition-based rules from visual sequences of simple non-social stimuli (shapes), complex non-social stimuli (inverted faces), and social stimuli (upright face). Both ASD and TD adolescents were able to generalize the rule they had learned to new stimuli, and their ability was modulated by the social nature of the stimuli and the complexity of the rule. Moreover, an association between RL and WM was found in the ASD, but not TD group, suggesting that ASD might have used additional or alternative strategies that relied on visual WM resources.

Sequential versus simultaneous presentation of memoranda in verbal working memory: (How) does it matter?

To-be-memorized information in verbal working memory (WM) can be presented sequentially, like in oral language, and simultaneously, like in written language. Few studies have addressed the importance and implications for verbal WM processing of these two presentation modes. While sequential presentation may favor discrete, temporal encoding processes, simultaneous presentation may favor spatial encoding processes. We compared immediate serial recall tasks for sequential versus simultaneous word list presentation with a specific focus on serial position curves of recall performance, transposition gradients, and the nature of serial order errors. First, we observed higher recall performance in the simultaneous compared to the sequential conditions, with a particularly large effect at end-of-list items. Moreover, results showed more transposition errors between non-adjacent items for the sequential condition, as well as more omission errors especially for start-of-list items. This observation can be explained in terms of differences in refreshing opportunities for start-of-list items during encoding between conditions. This study shows that the presentation mode of sequential material can have a significant impact on verbal WM performance, with an advantage for simultaneous encoding of sequence information.

A SPoARC of Music: Musicians Spatialize Melodies but not All-Comers

Recent studies on the spatial positional associated response codes (SPoARC) effect have shown that when Western adults are asked to keep in mind sequences of verbal items, they mentally spatialize them along the horizontal axis, with the initial items being associated with the left and the last items being associated with the right. The origin of this mental line is still debated, but it has been theorized that it necessitates specific spatial cognitive structures to emerge, which are built through expertise. This hypothesis is examined by testing for the first time whether Western individuals spatialize melodies from left to right and whether expertise in the musical domain is necessary for this effect to emerge. Two groups (musicians and non-musicians) of participants were asked to memorize sequences of four musical notes and to indicate if a subsequent probe was part of the sequence by pressing a "yes" key or a "no" key with the left or right index finger. Left/right-hand key assignment was reversed at mid-experiment. The results showed a SPoARC effect only for the group of musicians. Moreover, no association between pitch and hand responses was observed in either of the two groups. These findings suggest a crucial role of expertise in the SPoARC effect.

Neural Patterns in Parietal Cortex and Hippocampus Distinguish Retrieval of Start versus End Positions in Working Memory

Coding serial order of information is a fundamental ability of our cognitive system, and still, little is known about its neural substrate. This study examined the neural substrates involved in the retrieval of information that is serially stored in verbal working memory task using a sensitive multivariate analysis approach. We compared neural activity for memorized items stemming from the beginning versus the end of a memory list assessing the degree of neural pattern discordance between order positions (beginning vs. end). The present results confirmed and refined the role of the intraparietal sulcus in the processing of serial order information in working memory. An important finding is that the hippocampus showed sensitivity to serial order information. Our results indicate that the representation of serial order information relies on a broader set of neural areas and highlight the role of the intraparietal sulcus and the hippocampus, in addition to the supramarginal gyrus and the SMA. The contribution of different neural regions might reflect the involvement of distinct levels of serial order coding (i.e., spatial, attentional, temporal) that support the representation of serial order information.

Spatialization in working memory and its relation to math anxiety

Working memory (WM) is one of the most important cognitive functions that may play a role in the relation between math anxiety (MA) and math performance. The processing efficiency theory proposes that rumination and worrisome thoughts (induced by MA) result in less available WM resources (which are needed to solve math problems). At the same time, high MA individuals have lower verbal and spatial WM capacity in general. Extending these findings, we found that MA is also linked to the spatial coding of serial order in verbal WM: subjects who organize sequences from left-to-right in verbal WM show lower levels of MA compared with those who do not spatialize. Furthermore, these spatial coders have higher verbal WM capacity, better numerical order judgment abilities, and higher math scores. These findings suggest that spatially structuring the verbal mind is a promising cognitive correlate of MA and opens new avenues for exploring causal links between elementary cognitive processes and MA.

The predictive role of eye movements in mental arithmetic

Behavioural studies have suggested that number manipulation involves shifting attention along a left-to-right oriented continuum. However, these studies provide little evidence about the time course of attention shifts during number processing. We used an eye-tracker with high spatio-temporal resolution to measure eye movements during the mental solving of addition (e.g., 43 + 4) and subtraction problems (e.g., 53 - 6), as a proxy for the rightward and leftward attention shifts that accompany these operations. A first difference in eye position was observed as soon as the operator was heard: the hearing of "plus" shifted the eye rightward compared to "minus". A second difference was observed later between problem offset and response onset: addition shifted the eye rightward and upward compared to subtraction, suggesting that the space used to represent the problem is bidimensional. Further analyses confirmed the fast deployment of spatial attention and evidenced its relationship with the carrying and borrowing procedures triggered by the problem presentation. The predictive role of horizontal eye movements, in particular, is essential to understand how attention contributes to narrow down the range of plausible answers. We propose that attention illuminates significant portions of the numerical continuum anticipatively to guide the search of the answer and facilitate the implementation of solving procedures in verbal working memory.

Tradeoffs between Item and Order Information in Short-Term Memory

Recently, Guitard et al. (2021) used a two-list procedure and varied the kind of encoding carried out for each list (item or order encoding). They found dual-list impairment on an order test was consistently greater when the other list was also encoded for an order test, compared to when it was in the presence of another list encoded for an item test. They also found a dual-list cost relative to one list for both order and item information. Here we address the bases of the interference costs with a novel task in which, prior to each list presentation, participants are instructed to expect an item fragment completion test, an order reconstruction test, or either type of test. In five experiments, we contrast two competing accounts of item and order processing, the conflicting representation hypothesis and the common resource hypothesis. An asymmetry with larger dual-attention costs on order compared to item tests was found, with the effect magnitude changing with task conditions. Our results support a version of the common resource hypothesis in which both item and order processing occur no matter which test is expected, but in which additional processing is divided between item and order codes in a manner that depends on task demands.

Is the future near or far depending on the verb tense markers used? An experimental investigation into the effects of the grammaticalization of the future

Psycholinguistic approaches that study the effects of language on mental representations have ignored a potential role of the grammaticalization of the future (i.e., how the future manifests linguistically). We argue that the grammaticalization of the future may be an important aspect, as thinking about the future is omnipresent in our everyday life. The aim of this study was to experimentally manipulate the degree of future time references (i.e., present and future verb tense and temporal adverbials) to address their impact on the perceived location of future events. Across four experiments, two in French and two in German, no effect was found, irrespective of our verb and adverbial manipulations, and contrary to our hypotheses. Bayes factors confirmed that our null effects were not due to a lack of power. We present one of the first empirical accounts investigating the role of the grammaticalization of the future on effects of mental representations. We discuss possible reasons for these null results and illustrate further avenues for future research.

Transcranial Direct Current Stimulation over the Right Inferior Parietal Cortex Reduces Transposition Errors in a Syllabic Reordering Task

Evidence derived from functional imaging and brain-lesion studies has shown a strong left lateralization for language, and a complementary right hemisphere dominance for visuospatial abilities. Nevertheless, the symmetrical functional division of the two hemispheres gives no reason for the complexity of the cognitive operations involved in carrying out a linguistic task. In fact, a growing number of neuroimaging and neurostimulation studies suggest a possible right hemisphere involvement in language processing. The objective of this work was to verify the contribution of the left and right parietal areas in a phonological task. We applied anodal transcranial direct current stimulation (tDCS) to the right or left inferior parietal lobe, during a syllabic reordering task. After having learnt a combination of images of real objects and trisyllabic pseudowords with a simple consonant–vowel (CV) syllabic structure (e.g., tu-ru-cu), participants were shown the same images paired to two different pseudowords: one correct but with transposed syllables, and one alternative, never before seen. The participant’s task was to orally produce the chosen pseudoword, after having rearranged the order of its syllables. Two types of error were considered: transposition (correct pseudoword but incorrectly reordered) and identity (incorrect pseudoword). The results showed that right anodal stimulation significantly reduced the number of transposition errors, whereas left anodal stimulation significantly reduced the number of identity errors. These results suggested that both left and right inferior parietal areas were differentially involved in a syllabic reordering task, and, crucially, they demonstrated that visuospatial processes served by the right inferior parietal area could be competent for establishing the correct syllabic order within a word.

Eye-movements reveal the serial position of the attended item in verbal working memory

The problem of how the mind can retain sequentially organized information has a long research tradition that remains unresolved. While various computational models propose a mechanism of binding serial order information to position markers, the representational nature and processes that operate on these position markers are not clear. Recent behavioral work suggests that space is used to mark positions in serial order and that this process is governed by spatial attention. Based on the assumption that brain areas controlling spatial attention are also involved in saccadic planning, we continuously tracked the eye-movements as a direct measure of the spatial attention during retrieval from a verbal WM sequence. Participants memorized a sequence of auditory numbers. During retention, they heard a number-cue that did or did not belong to the memorized set. After this number-cue, a target-beep could be presented to which they had to respond if the number-cue belonged to the memorized sequence. In Experiment 1, the target-beep was either presented to the left or right ear, and in Experiment 2 bilaterally (removing any spatial aspect). We tested the hypothesis that systematic eye-movements are made when people retrieve items of sequences of auditory words and found that the retrieval of begin items resulted in leftward eye-movements and the retrieval of end items in rightward eye-movements. These observations indicate that the oculomotor system is also involved in the serial order processes in verbal WM thereby providing a promising novel approach to get insight into abstract cognitive processes.

Early is left and up: Saccadic responses reveal horizontal and vertical spatial associations of serial order in working memory

Maintaining serial order in working memory is crucial for cognition. Recent theories propose that serial information is achieved by positional coding of items on a spatial frame of reference. In line with this, an early-left and late-right spatial-positional association of response code (SPoARC) effect has been established. Various theoretical accounts have been put forward to explain the SPoARC effect (the mental whiteboard hypothesis, conceptual metaphor theory, polarity correspondence, or the indirect spatial-numerical association effect). Crucially, while all these accounts predict a left-to-right orientation of the SPoARC effect, they make different predictions regarding the direction of a possible vertical SPoARC effect. In this study, we therefore investigated SPoARC effects along the horizontal and vertical spatial dimension by means of saccadic responses. We replicated the left-to-right horizontal SPoARC effect and established for the first time an up-to-down vertical SPoARC effect. The direction of the vertical SPoARC effect was in contrast to that predicted by metaphor theory, polarity correspondence, or by the indirect spatial-numerical association effect. Rather, our results support the mental whiteboard-hypothesis, according to which positions can be flexibly coded on an internal space depending on the task demands. We also found that the strengths of the horizontal and vertical SPoARC effects were correlated, showing that some people are more prone than others to use spatial references for position coding. Our results therefore suggest that context templates used for position marking are not necessarily spatial in nature but depend on individual strategy preferences.

Interaction mechanism between location and sequence in letter cognition

A previous study used days as a sequence symbol to investigate the interaction mechanism between location and sequence in sequence symbol cognition; the study findings suggested that the spatial stimulus-response compatibility effect and the Simon effect could not co-exist with the SNARC-like effect when processing sequence symbols. The previous study did not include the influence of the difficulty of identifying sequence symbols on the Simon effect in the investigation, so it is unclear whether the conclusion about processing sequence symbols with considerable identification difficulty can be extended to the processing of sequence symbols with less identification difficulty. Therefore, the present study explored letters that have a low level of identification difficulty to investigate the interaction mechanism between location and sequence in sequence symbol cognition. Participants were asked to classify a probe letter, which was randomly displayed on the left or right side of the screen, according to its location (Experiment 1), its sequence (Experiment 2) or its colour (Experiment 3). The results indicated that (1) only the spatial stimulus-response compatibility effect and Simon effect were present in the letter location classification task and letter colour classification task, respectively. (2) The Simon effect co-existed with the SNARC-like effect, and these two effects interacted with each other in the letter sequence classification task. From these results, it can be concluded that the task determines whether the Simon effect and the SNARC-like effect can co-exist, with differences presented across sequence symbols.

Using space to remember: Short-term spatial structure spontaneously improves working memory

Spatial information plays an important role in how we remember. In general, there are two (non mutually exclusive) views regarding the role that space plays in memory. One view is that objects overlapping in space interfere with each other in memory. For example, objects presented in the same location (at different points in time) are more frequently confused with one another than objects that are not. Another view is that spatial information can 'bootstrap' other kinds of information. For example, remembering a phone number is easier one can see the arrangement of a keypad. Here, building on both perspectives, we test the hypothesis that task-irrelevant spatial structure (i.e., objects appearing in stable locations over repeated iterations) improves working memory. Across 7 experiments, we demonstrate that (1) irrelevant spatial structure improves memory for sequences of objects; (2) this effect does not depend on long-term spatial associations; (3) this effect is unique to space (as opposed to features like color); and (4) spatial structure can be teased apart from spatial interference, and the former drives memory improvement. We discuss how these findings relate to and challenge 'spatial interference' accounts as well as 'visuospatial bootstrapping'.

Are Rank Orders Mentally Represented by Spatial Arrays?

The present contribution argues that transitive reasoning, as exemplified in paradigms of linear order construction in mental space, is associated with spatial effects. Starting from robust findings from the early 70s, research so far has widely discussed the symbolic distance effect (SDE). This effect shows that after studying pairs of relations, e.g., "A > B," "B > C," and "D > E," participants are more correct, and faster in correct responding, the wider the "distance" between two elements within the chain A > B > C > D > E. The SDE has often been given spatial interpretations, but alternatively, non-spatial models of the effect are also viable on the empirical basis so far, which means the question about spatial contributions to the construction of analog representations of rank orders is still open. We suggest here that laterality effects can add the necessary additional information to support the idea of spatial processes. We introduce anchoring effects in terms of showing response advantages for congruent versus incongruent pairings of presentation location on a screen on the one hand, and the hypothetical spatial arrangement of the order in mental space, on the other hand. We report pertinent findings and discuss anchoring paradigms with respect to their internal validity as well as their being rooted in basic mechanisms of trained reading/writing direction.

Location-independent feature binding in visual working memory for sequentially presented objects

Spatial location is believed to have a privileged role in binding features held in visual working memory. Supporting this view, Pertzov and Husain (Attention, Perception, & Psychophysics, 76(7), 1914–1924, 2014) reported that recall of bindings between visual features was selectively impaired when items were presented sequentially at the same location compared to sequentially at different locations. We replicated their experiment, but additionally tested whether the observed impairment could be explained by perceptual interference during encoding. Participants viewed four oriented bars in highly discriminable colors presented sequentially either at the same or different locations, and after a brief delay were cued with one color to reproduce the associated orientation. When we used the same timing as the original study, we reproduced its key finding of impaired binding memory in the same-location condition. Critically, however, this effect was significantly modulated by the duration of the inter-stimulus interval, and disappeared if memoranda were presented with longer delays between them. In a second experiment, we tested whether the effect generalized to other visual features, namely reporting of colors cued by stimulus shape. While we found performance deficits in the same-location condition, these did not selectively affect binding memory. We argue that the observed effects are best explained by encoding interference, and that memory for feature binding is not necessarily impaired when memoranda share the same location.

Spatial Attention in Serial Order Working Memory: An EEG Study

Theoretical models explaining serial order processing link order information to specified position markers. However, the precise characteristics of position marking have remained largely elusive. Recent studies have shown that space is involved in marking serial position of items in verbal working memory (WM). Furthermore, it has been suggested, but not proven, that accessing these items involves horizontal shifts of spatial attention. We used continuous electroencephalography recordings to show that memory search in serial order verbal WM involves spatial attention processes that share the same electrophysiological signatures as those operating on the visuospatial WM and external space. Accessing an item from a sequence in verbal WM induced posterior “early directing attention negativity” and “anterior directing attention negativity” contralateral to the position of the item in mental space (i.e., begin items on the left; end items on the right). In the frequency domain, we observed posterior alpha suppression contralateral to the position of the item. Our results provide clear evidence for the involvement of spatial attention in retrieving serial information from verbal WM. Implications for WM models are discussed.

Absolute and relative knowledge of ordinal position on implied lists

Does serial learning result in specific associations between pairs of items, or does it result in a cognitive map based on relations of all items? In 2 experiments, we trained human participants to learn various lists of photographic images. We then tested the participants on new lists of photographic images. These new lists were constructed by selecting only 1 image from each list learned during training. In Experiment 1, participants were trained to choose the earlier (experimenter defined) item when presented with adjacent pairs of items on each of 5 different 5-item lists. Participants were then tested on derived lists, in which each item retained its original ordinal position, even though each of the presented pairs was novel. Participants performed above chance on all of the derived lists. In Experiment 2, a different group of participants received the same training as those of Experiment 1, but the ordinal positions of items were systematically changed on each derived list. The response accuracy for Experiment 2 varied inversely with the degree to which an item's original ordinal position was changed. These results can be explained by a model in which participants learned to make both positional inferences about the absolute rank of each stimulus, and transitive inferences about the relative ranks of pairs of stimuli. These inferences enhanced response accuracy when ordinal position was maintained, but not when it was changed. Our results demonstrate quantitatively that, in addition to item-item associations that participants acquire while learning a list of arbitrary items, they form a cognitive map that represents both experienced and inferred relationships. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Spatialization in working memory: can individuals reverse the cultural direction of their thoughts?

A recent study based on the SPoARC effect (spatial position association response codes) showed that culture heavily shapes cognition and more specifically the way thought is organized; when Western adults are asked to keep in mind a sequence of colors, they mentally organize them from left to right, whereas right-to-left reading/writing adults spatialize them in the opposite direction. Here, we investigate if the spontaneous direction of spatialization in Westerners can be reversed. Lists of five consonants were presented auditorily at a rate of 3 s per item, participants were asked to mentally organize the memoranda from right to left. Each list was followed by a probe. Participants had to indicate whether the probe was part of the sequence by pressing a "yes" key or a "no" key with the left or right index finger. Left/right-hand key assignment was switched after half of the trials were completed. The results showed a reverse SPoARC effect that was comparable in magnitude to the spontaneous left-to-right SPoARC effect found in a previous study. Overall, our results suggest that individuals can reverse the cultural direction of their thoughts.

The development of working memory spatialization revealed by using the cave paradigm in a two-alternative spatial choice

When Western participants are asked to keep in mind a sequence of verbal items, they tend to associate the first items to the left and the last items to the right. This phenomenon, known as the spatial-positional association response codes effect, has been interpreted as showing that individuals spatialize the memoranda by creating a left-to-right mental line with them. One important gap in our knowledge concerns the development of this phenomenon: when do Western individuals start organizing their thought from left to right? To answer this question, 274 participants in seven age groups were tested (kindergarten, Grades 1, 2, 3, 4, and 5, and adults). We used a new protocol meant to be child-friendly, which involves associating two caves with two animals using a two-alternative spatial forced choice. Participants had to guess in which cave a specific animal could be hidden. Results showed that it is from Grade 3 on that participants spatialize information in working memory in a left-to-right fashion like adults.

Can short-term memory be trained?

Is the capacity of short-term memory fixed, or does it improve with practice? It is already known that training on complex working memory tasks is more likely to transfer to untrained tasks with similar properties, but this approach has not been extended to the more basic short-term memory system responsible for verbal serial recall. Here we investigated this with adaptive training algorithms widely applied in working memory training. Serial recall of visually presented digits was found to improve over the course of 20 training sessions, but this improvement did not extend to recall of either spoken digits or visually presented letters. In contrast, training on a nonserial visual short-term memory color change detection task did transfer to a line orientation change detection task. We suggest that training only generates substantial transfer when the unfamiliar demands of the training activities require the development of novel routines that can then be applied to untrained versions of the same paradigm (Gathercole, Dunning, Holmes, & Norris, 2019). In contrast, serial recall of digits is fully supported by the existing verbal short-term memory system and does not require the development of new routines.

Factoring in the spatial effects of symbolic number representation

Spatial constituents of adult symbolic number representation produce effects of size-value congruity, Spatial Numerical Association of Response Codes (SNARC), and numerical distance. According to behavioral experiments, these effects belong to distinct processing stages. Yet, these effects evoke overlapping responses in both early and late Event Related Potentials (ERPs). To probe whether these overlaps indicate sharing of resources, all relevant stimulus and response conditions were factorially combined in a numerical value comparison task. To secure ERP validity, same numbers were compared against variable reference values. This design resulted in previously unobserved interactions in behavior but inhibited late ERP effects. All effects arose early in the P1 component (around 100 ms) and most showed hemispheric specificity. Independency of congruity and SNARC effects was observed, whereas SNARC and numerical distance were closely intertwined. Differences in hemispheric specificity, rather than stage-wise separation, were key to independence.

Scanning of speechless comics changes spatial biases in mental model construction

The mental representation of both time and number shows lateral spatial biases, which can be affected by habitual reading and writing direction. However, this effect is in place before children begin to read. One potential early cause is the experiences of looking at picture books together with a carer, as those images also follow the directionality of the script. What is the underlying mechanism for this effect? In the present study, we test the possibility that such experiences induce spatial biases in mental model construction, a mechanism which is a good candidate to induce the biases observed with numbers and times. We presented a speechless comic in either standard (left-to-right) or mirror-reversed (right-to-left) form to adult Spanish participants. We then asked them to draw the scene depicted by sentences like 'the square is between the cross and the circle'. The position of the lateral objects in these drawings reveals the spatial biases at work when building mental models in working memory. Under conditions of highly consistent directionality, the mirror comic changed pre-existing lateral biases. Processes of mental model construction in working memory stand as a potential mechanism for the generation of spatial biases for time and number.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

The Graded Fate of Unattended Stimulus Representations in Visuospatial Working Memory

As in visual perception, information can be selected for prioritized processing at the expense of unattended representations in visual working memory (VWM). However, what is not clear is whether and how this prioritization degrades the unattended representations. We addressed two hypotheses. First, the representational quality of unattended items could be degraded as a function of the spatial distance to attended information in VWM. Second, the strength with which an item is bound to its location is degraded as a function of the spatial distance to attended information in VWM. To disentangle these possibilities, we designed an experiment in which participants performed a continuous production task in which they memorized a visual array with colored discs, one of which was spatially retro-cued, informing the target location of an impending probe that was to be recalled (Experiment 1). We systematically varied the spatial distance between the cued and probed locations and obtained model-based estimates of the representational quality and binding strengths at varying cue-probe distances. Although the representational quality of the unattended representations remained unaffected by the cue-probe distance, spatially graded binding strengths were observed, as reflected in more spatial confusions at smaller cue-probe distances. These graded binding strengths were further replicated with a model-free approach in a categorical version of the production task in which stimuli and responses consisted of easily discriminable colors (Experiment 2). These results demonstrate that unattended representations are prone to spatial confusions due to spatial degradation of binding strengths in WM, even though they are stored with the same representational quality.

The metaphoric nature of the ordinal position effect

Serial orders are thought to be spatially represented in working memory: The beginning items in the memorised sequence are associated with the left side of space and the ending items are associated with the right side of space. However, the origin of this ordinal position effect has remained unclear. It was suggested that the direction of serial order-space interaction is related to the reading/writing experience. An alternative hypothesis is that it originates from the "more is right"/"more is up" spatial metaphors we use in daily life. We can adjudicate between the two viewpoints in Chinese readers; they read left-to-right but also have a culturally ancient top-to-bottom reading/writing direction. Thus, the reading/writing viewpoint predicts no or a top-to-bottom effect in serial order-space interaction; whereas the spatial metaphor theory predicts a clear bottom-to-top effect. We designed four experiments to investigate this issue. First, we found a left-to-right ordinal position effect, replicating results obtained in Western populations. However, the vertical ordinal position effect was in the bottom-to-top direction; moreover, it was modulated by hand position (e.g., left hand bottom or up). We suggest that order-space interactions may originate from different sources and are driven by metaphoric comprehension, which itself may ground cognitive processing.

The Mechanism of the Ordinal Position Effect: Stability Across Sense Modalities and the Hands Crossed Context

The ordinal position effect posits that items positioned earlier in an ordinal sequence are responded to faster with the left key than the right key, and items positioned later in an ordinal sequence are responded to faster with the right key than the left key. Although the mechanism of the ordinal position effect has been investigated in many studies, it is unclear whether the ordinal position effect can extend to the auditory modality and the hands crossed context. Therefore, the present study employed days as the order information to investigate this question. Days were visually or acoustically displayed on a screen in random order, and participants were instructed to judge whether the probe day they perceived was before or after the current day (days-relevant task) or to identify the color or voice of the probe day they perceived (days-irrelevant task). The results indicate the following: (a) The days before the current day were responded to faster with the left key than the right key, and the days after the current day were responded to faster with the right key than the left key, both when the days-relevant task and the days-irrelevant task were performed, regardless of the sense modality. (b) The ordinal position effect for judgments of days was also obtained in the auditory modality even when the hands were crossed. These results indicate that the ordinal position effect can extend to the auditory modality and the hands crossed context, similar to the spatial-numerical association of response codes effect of numbers.

Multiple left-to-right spatial representations of number magnitudes? Evidence from left spatial neglect

The SNARC effect reflects the observation that when healthy observers with left-to-right reading habits are asked to compare the magnitude or to judge the parity of numbers, they provide faster reaction times (RT) to small numbers with left-sided responses and faster RTs to large numbers with right-sided responses. In magnitude comparison (MC), right brain damaged patients with left-sided neglect typically show a pathologically enlarged SNARC for large numbers and selective slowing to numbers that are immediately lower than the numerical reference (e.g. 4 for reference 5). This asymmetry has been taken as evidence that small numbers are mentally positioned to the left of the reference and, therefore, are processed less efficiently by patients neglecting the left side of space. In parity judgement (PJ), on the other hand, the size of the SNARC effect is unaffected by neglect. This dissociation is typically attributed to the disturbed explicit processing of number magnitude in MC and preserved implicit processing of magnitude in PJ. Before accepting this interpretation, however, it remains to be investigated whether neglect patients show the same RT pattern that characterizes the performance of healthy participants (i.e. left-side RTs that increase linearly as a function of number magnitude and right-side RTs that decrease linearly as a function of magnitude). Clarifying this point is crucial, because an equally sized SNARC can originate from different RT patterns. Here we demonstrate that the RT pattern of neglect patients during PJ is entirely comparable to those of patients without neglect and healthy controls, while the same neglect patients show selective slowing to numbers that are immediately lower than the numerical reference in MC. These findings suggest the existence of multiple left-to-right spatial representations of number magnitude and provides an explanation of the functional dissociation between MC and PJ tasks.

Current directions in visual working memory research: An introduction and emerging insights

Visual working memory (VWM) is a core construct in the cognitive (neuro-)sciences, assumed to serve as a hub for information exchange and thus supporting a multitude of cognitive functions related to processing visual information. Here, we give an introduction into key terms and paradigms and an overview of ongoing debates in the field, to which the articles collected in this Special Issue on 'Current Directions in Visual Working Memory Research' contribute. Our aim is to extract, from this overview, some 'emerging' theoretical insights concerning questions such as the optimal way to examine VWM, which types of mental representations contribute to performance on VWM tasks, and how VWM keeps features from the same object together and apart from features of concurrently maintained objects (the binding problem).