The reciprocity of spatial-numerical associations of vocal response codes depends on stimulus mode

Individuals make faster left responses to small/er numbers and faster right responses to large/r numbers than vice versa. This "spatial-numerical association of response codes" (SNARC) effect represents evidence for an overlap between the cognitive representations of number and space. Theories of the SNARC effect differ in whether they predict bidirectional S-R associations between number and space or not. We investigated the reciprocity of S-R priming effects between number and location in three experiments with vocal responses. In Experiments 1 and 2, participants completed a number-location task, with digits as stimuli and location words as responses, and a location-number task, with physical locations as stimuli and number words as responses. In addition, we varied the S-R mapping in each task. Results revealed a strong SNARC effect in the number-location task, but no reciprocal SNARC effect in the location-number task. In Experiment 3, we replaced physical location stimuli with location words and digit stimuli with number words. Results revealed a regular and a reciprocal SNARC effect of similar size. Reciprocal SNARC effects thus seem to emerge with verbal location stimuli and vocal responses, but not with physical location stimuli and vocal responses. The S-R associations underlying the SNARC effect with vocal responses thus appear bidirectional and symmetrical for some combinations of stimulus and response sets, but not for others. This has implications for theoretical accounts of the SNARC effect which need to explain how stimulus mode affects the emergence of reciprocal but not regular SNARC effects.

Attention allocation between item and order information in short-term memory

In immediate memory for verbal lists, recently it has been shown that participants can choose to carry out encoding that prioritises readiness for an item test at some cost to order information or, conversely, that prioritises readiness for an order test at a cost to item information. Here, we ask whether participants can control attention to items and order in a graded fashion. We examined this issue by manipulating the percentage of order or item test trials participants would receive in a block (for each type of test, 25%, 50%, 75%, or 100% of the trials in a block). Overall, the results revealed that participants were able to allocate their attention in a fine-grained manner that took into account the trial distribution within the block. However, there was a difference between the effects of allocating attention to item versus order. Divided attention, compared with full attention to one attribute, had an asymmetry, such that divided attention impaired order performance more than item performance. The exact point at which this asymmetry could be seen differed between two experiments, which included different item tests (fragment completion vs. free recall). The results suggest a common resource for item and order encoding and/or retention in working memory, which can be voluntarily allocated to different mixtures of these two attributes.

Neural Patterns in Parietal Cortex and Hippocampus Distinguish Retrieval of Start versus End Positions in Working Memory

Coding serial order of information is a fundamental ability of our cognitive system, and still, little is known about its neural substrate. This study examined the neural substrates involved in the retrieval of information that is serially stored in verbal working memory task using a sensitive multivariate analysis approach. We compared neural activity for memorized items stemming from the beginning versus the end of a memory list assessing the degree of neural pattern discordance between order positions (beginning vs. end). The present results confirmed and refined the role of the intraparietal sulcus in the processing of serial order information in working memory. An important finding is that the hippocampus showed sensitivity to serial order information. Our results indicate that the representation of serial order information relies on a broader set of neural areas and highlight the role of the intraparietal sulcus and the hippocampus, in addition to the supramarginal gyrus and the SMA. The contribution of different neural regions might reflect the involvement of distinct levels of serial order coding (i.e., spatial, attentional, temporal) that support the representation of serial order information.

Spatialization in working memory and its relation to math anxiety

Working memory (WM) is one of the most important cognitive functions that may play a role in the relation between math anxiety (MA) and math performance. The processing efficiency theory proposes that rumination and worrisome thoughts (induced by MA) result in less available WM resources (which are needed to solve math problems). At the same time, high MA individuals have lower verbal and spatial WM capacity in general. Extending these findings, we found that MA is also linked to the spatial coding of serial order in verbal WM: subjects who organize sequences from left-to-right in verbal WM show lower levels of MA compared with those who do not spatialize. Furthermore, these spatial coders have higher verbal WM capacity, better numerical order judgment abilities, and higher math scores. These findings suggest that spatially structuring the verbal mind is a promising cognitive correlate of MA and opens new avenues for exploring causal links between elementary cognitive processes and MA.

Tradeoffs between Item and Order Information in Short-Term Memory

Recently, Guitard et al. (2021) used a two-list procedure and varied the kind of encoding carried out for each list (item or order encoding). They found dual-list impairment on an order test was consistently greater when the other list was also encoded for an order test, compared to when it was in the presence of another list encoded for an item test. They also found a dual-list cost relative to one list for both order and item information. Here we address the bases of the interference costs with a novel task in which, prior to each list presentation, participants are instructed to expect an item fragment completion test, an order reconstruction test, or either type of test. In five experiments, we contrast two competing accounts of item and order processing, the conflicting representation hypothesis and the common resource hypothesis. An asymmetry with larger dual-attention costs on order compared to item tests was found, with the effect magnitude changing with task conditions. Our results support a version of the common resource hypothesis in which both item and order processing occur no matter which test is expected, but in which additional processing is divided between item and order codes in a manner that depends on task demands.

The domain-specificity of serial order working memory

Making a turn while driving is simple: turn on the indicator, check for cars, then turn. Two types of information are required to perform this sequence of events: information about the items (e.g., the correct indicator), and the serial order of those items (e.g., checking before turning rather than vice-versa). Previous research has found distinct working memory capacities (WMCs) for item and serial order information in both verbal and nonverbal domains. The current study investigates whether the serial order WMC is shared for sequences from different content domains. One hundred and fifty-three participants performed sequence matching tasks with verbal (letters and words) and nonverbal (locations and arrows) stimuli. The accuracy of detecting mismatched item-identity and serial order information in sequences was used to operationalize item and order WMC. Using structural equation modeling analyses, we directly compared models that included either domain-specific or domain-general serial order WMC latent variables, finding that models with domain-specific serial order WMC latent variables for verbal and nonverbal materials fit the data better than models with domain-general latent variables. The findings support the hypothesis that there are separate capacities for serial order working memory depending on the type of material being ordered.

Eye-movements reveal the serial position of the attended item in verbal working memory

The problem of how the mind can retain sequentially organized information has a long research tradition that remains unresolved. While various computational models propose a mechanism of binding serial order information to position markers, the representational nature and processes that operate on these position markers are not clear. Recent behavioral work suggests that space is used to mark positions in serial order and that this process is governed by spatial attention. Based on the assumption that brain areas controlling spatial attention are also involved in saccadic planning, we continuously tracked the eye-movements as a direct measure of the spatial attention during retrieval from a verbal WM sequence. Participants memorized a sequence of auditory numbers. During retention, they heard a number-cue that did or did not belong to the memorized set. After this number-cue, a target-beep could be presented to which they had to respond if the number-cue belonged to the memorized sequence. In Experiment 1, the target-beep was either presented to the left or right ear, and in Experiment 2 bilaterally (removing any spatial aspect). We tested the hypothesis that systematic eye-movements are made when people retrieve items of sequences of auditory words and found that the retrieval of begin items resulted in leftward eye-movements and the retrieval of end items in rightward eye-movements. These observations indicate that the oculomotor system is also involved in the serial order processes in verbal WM thereby providing a promising novel approach to get insight into abstract cognitive processes.

Space modulates cross-domain transfer of abstract rules in infants

Developmental studies have shown that infants exploit ordinal information to extract and generalize repetition-based rules from a sequence of items. Within the visual modality, this ability is constrained by the spatial layout within which items are delivered given that a left-to-right orientation boosts infants' rule learning, whereas a right-to-left orientation hinders this ability. Infants' rule learning operates across different domains and can also be transferred across modalities when learning is triggered by speech. However, no studies have investigated whether the transfer of rule learning occurs across different domains when language is not involved. Using a visual habituation procedure, we tested 7-month-old infants' ability to extract rule-like patterns from numerical sequences and generalize them to non-numerical sequences of visual shapes and whether this ability is affected by the spatial orientation. Infants were first habituated to left-to-right or right-to-left oriented numerical sequences instantiating an ABB rule and were then tested with the familiar rule instantiated across sequences of single geometrical shapes and a novel (ABA) rule. Results showed a transfer of learning from number to visual shapes for left-to-right oriented sequences but not for right-to-left oriented ones (Experiment 1) even when the direction of the numerical change (increasing vs. decreasing) within the habituation sequences violated a small-left/large-right number-space association (Experiment 2). These results provide the first demonstration that visual rule learning mechanisms in infancy operate at a high level of abstraction and confirm earlier findings that left-to-right oriented directional cues facilitate infants' representation of order.

The Neural Representation of Ordinal Information: Domain-Specific or Domain-General?

Ordinal processing allows for the representation of the sequential relations between stimuli and is a fundamental aspect of different cognitive domains such as verbal working memory (WM), language and numerical cognition. Several studies suggest common ordinal coding mechanisms across these different domains but direct between-domain comparisons of ordinal coding are rare and have led to contradictory evidence. This fMRI study examined the commonality of ordinal representations across the WM, the number, and the letter domains by using a multivoxel pattern analysis approach and by focusing on triplet stimuli associated with robust ordinal distance effects. Neural patterns in fronto-parietal cortices distinguished ordinal distance in all domains. Critically, between-task predictions of ordinal distance in fronto-parietal cortices were robust between serial order WM, alphabetical order judgment but not when involving the numerical order judgment tasks. Moreover, frontal ROIs further supported between-task prediction of distance for the luminance judgment control task, the serial order WM, and the alphabetical tasks. These results suggest that common neural substrates characterize processing of ordinal information in WM and alphabetical but not numerical domains. This commonality, particularly in frontal cortices, may however reflect attentional control processes involved in judging ordinal distances rather than the intervention of domain-general ordinal codes.

The neural mechanism of spatial-positional association in working memory: A fMRI study

In the last decade, research has reported that items at the beginning of a memorized sequence are responded to faster with the left hand, whereas items at the end are responded to faster with the right hand. This Spatial-Positional Associations of Response Codes effect has been extensively studied using behavioral methods. However, the neural networks underlying it remain unclear. We found using functional magnetic resonance imaging (fMRI) that the dorsal attention network was involved in spatial-positional associations, in particular a region of the right superior frontal cortex / pre-supplementary motor area (pre-SMA), within which neural activity correlated with behavioral measures of the strength of spatial-positional associations. Psychophysiological interaction (PPI) analysis revealed functional connectivity between this area and other regions of the dorsal attentional network including the SMA, and with the hippocampal-retrosplenial network. In contrast, explicit processing of serial order independent of spatial-positional associations was related to activity in the inferior parietal cortex. Our results provide new insight into positional coding theories of working memory, including the mental whiteboard hypothesis. They suggest that the behavioral effects of positional coding (congruency between hand and ordinal position within the list) are mediated through spatial and motor control maps in the dorsal attentional system.

Spatial-numerical associations from a novel paradigm support the mental number line account

Multiple tasks have been used to demonstrate the relation between numbers and space. The classic interpretation of these directional spatial-numerical associations (d-SNAs) is that they are the product of a mental number line (MNL), in which numerical magnitude is intrinsically associated with spatial position. The alternative account is that d-SNAs reflect task demands, such as explicit numerical judgements and/or categorical responses. In the novel "Where was The Number?" task, no explicit numerical judgements were made. Participants were simply required to reproduce the location of a numeral within a rectangular space. Using a between-subject design, we found that numbers, but not letters, biased participants' responses along the horizontal dimension, such that larger numbers were placed more rightward than smaller numbers, even when participants completed a concurrent verbal working memory task. These findings are consistent with the MNL account, such that numbers specifically are inherently left-to-right oriented in Western participants.

Spatial Attention in Serial Order Working Memory: An EEG Study

Theoretical models explaining serial order processing link order information to specified position markers. However, the precise characteristics of position marking have remained largely elusive. Recent studies have shown that space is involved in marking serial position of items in verbal working memory (WM). Furthermore, it has been suggested, but not proven, that accessing these items involves horizontal shifts of spatial attention. We used continuous electroencephalography recordings to show that memory search in serial order verbal WM involves spatial attention processes that share the same electrophysiological signatures as those operating on the visuospatial WM and external space. Accessing an item from a sequence in verbal WM induced posterior “early directing attention negativity” and “anterior directing attention negativity” contralateral to the position of the item in mental space (i.e., begin items on the left; end items on the right). In the frequency domain, we observed posterior alpha suppression contralateral to the position of the item. Our results provide clear evidence for the involvement of spatial attention in retrieving serial information from verbal WM. Implications for WM models are discussed.

Spatialization in working memory: can individuals reverse the cultural direction of their thoughts?

A recent study based on the SPoARC effect (spatial position association response codes) showed that culture heavily shapes cognition and more specifically the way thought is organized; when Western adults are asked to keep in mind a sequence of colors, they mentally organize them from left to right, whereas right-to-left reading/writing adults spatialize them in the opposite direction. Here, we investigate if the spontaneous direction of spatialization in Westerners can be reversed. Lists of five consonants were presented auditorily at a rate of 3 s per item, participants were asked to mentally organize the memoranda from right to left. Each list was followed by a probe. Participants had to indicate whether the probe was part of the sequence by pressing a "yes" key or a "no" key with the left or right index finger. Left/right-hand key assignment was switched after half of the trials were completed. The results showed a reverse SPoARC effect that was comparable in magnitude to the spontaneous left-to-right SPoARC effect found in a previous study. Overall, our results suggest that individuals can reverse the cultural direction of their thoughts.

The development of working memory spatialization revealed by using the cave paradigm in a two-alternative spatial choice

When Western participants are asked to keep in mind a sequence of verbal items, they tend to associate the first items to the left and the last items to the right. This phenomenon, known as the spatial-positional association response codes effect, has been interpreted as showing that individuals spatialize the memoranda by creating a left-to-right mental line with them. One important gap in our knowledge concerns the development of this phenomenon: when do Western individuals start organizing their thought from left to right? To answer this question, 274 participants in seven age groups were tested (kindergarten, Grades 1, 2, 3, 4, and 5, and adults). We used a new protocol meant to be child-friendly, which involves associating two caves with two animals using a two-alternative spatial forced choice. Participants had to guess in which cave a specific animal could be hidden. Results showed that it is from Grade 3 on that participants spatialize information in working memory in a left-to-right fashion like adults.

Scanning of speechless comics changes spatial biases in mental model construction

The mental representation of both time and number shows lateral spatial biases, which can be affected by habitual reading and writing direction. However, this effect is in place before children begin to read. One potential early cause is the experiences of looking at picture books together with a carer, as those images also follow the directionality of the script. What is the underlying mechanism for this effect? In the present study, we test the possibility that such experiences induce spatial biases in mental model construction, a mechanism which is a good candidate to induce the biases observed with numbers and times. We presented a speechless comic in either standard (left-to-right) or mirror-reversed (right-to-left) form to adult Spanish participants. We then asked them to draw the scene depicted by sentences like 'the square is between the cross and the circle'. The position of the lateral objects in these drawings reveals the spatial biases at work when building mental models in working memory. Under conditions of highly consistent directionality, the mirror comic changed pre-existing lateral biases. Processes of mental model construction in working memory stand as a potential mechanism for the generation of spatial biases for time and number.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

The metaphoric nature of the ordinal position effect

Serial orders are thought to be spatially represented in working memory: The beginning items in the memorised sequence are associated with the left side of space and the ending items are associated with the right side of space. However, the origin of this ordinal position effect has remained unclear. It was suggested that the direction of serial order-space interaction is related to the reading/writing experience. An alternative hypothesis is that it originates from the "more is right"/"more is up" spatial metaphors we use in daily life. We can adjudicate between the two viewpoints in Chinese readers; they read left-to-right but also have a culturally ancient top-to-bottom reading/writing direction. Thus, the reading/writing viewpoint predicts no or a top-to-bottom effect in serial order-space interaction; whereas the spatial metaphor theory predicts a clear bottom-to-top effect. We designed four experiments to investigate this issue. First, we found a left-to-right ordinal position effect, replicating results obtained in Western populations. However, the vertical ordinal position effect was in the bottom-to-top direction; moreover, it was modulated by hand position (e.g., left hand bottom or up). We suggest that order-space interactions may originate from different sources and are driven by metaphoric comprehension, which itself may ground cognitive processing.

Multiple left-to-right spatial representations of number magnitudes? Evidence from left spatial neglect

The SNARC effect reflects the observation that when healthy observers with left-to-right reading habits are asked to compare the magnitude or to judge the parity of numbers, they provide faster reaction times (RT) to small numbers with left-sided responses and faster RTs to large numbers with right-sided responses. In magnitude comparison (MC), right brain damaged patients with left-sided neglect typically show a pathologically enlarged SNARC for large numbers and selective slowing to numbers that are immediately lower than the numerical reference (e.g. 4 for reference 5). This asymmetry has been taken as evidence that small numbers are mentally positioned to the left of the reference and, therefore, are processed less efficiently by patients neglecting the left side of space. In parity judgement (PJ), on the other hand, the size of the SNARC effect is unaffected by neglect. This dissociation is typically attributed to the disturbed explicit processing of number magnitude in MC and preserved implicit processing of magnitude in PJ. Before accepting this interpretation, however, it remains to be investigated whether neglect patients show the same RT pattern that characterizes the performance of healthy participants (i.e. left-side RTs that increase linearly as a function of number magnitude and right-side RTs that decrease linearly as a function of magnitude). Clarifying this point is crucial, because an equally sized SNARC can originate from different RT patterns. Here we demonstrate that the RT pattern of neglect patients during PJ is entirely comparable to those of patients without neglect and healthy controls, while the same neglect patients show selective slowing to numbers that are immediately lower than the numerical reference in MC. These findings suggest the existence of multiple left-to-right spatial representations of number magnitude and provides an explanation of the functional dissociation between MC and PJ tasks.

Functionally distinct contributions of parietal cortex to a numerical landmark task: An fMRI study

This study aimed at establishing the neural basis of magnitude processing of multiple numbers from working memory. We designed a numerical landmark task and embedded it in a fragmented trial event-related fMRI design, allowing to separate encoding from decision processing. An attentional localiser task not involving numbers allowed further functional specification. The results show that in a numerical landmark task the right anterior intraparietal sulcus is involved in number encoding while more posterior parietal regions, bilateral superior parietal lobule and right inferior parietal lobule, provide domain-general support in the form of constructing a working memory representation or orienting spatial attention within that mental representation during number comparison. The results are in line with earlier studies reporting a functional distinction between anterior and posterior parietal contributions to number processing and further specify their role at a functional level.

Hemispatial neglect and serial order in verbal working memory

Working memory refers to our ability to actively maintain and process a limited amount of information during a brief period of time. Often, not only the information itself but also its serial order is crucial for good task performance. It was recently proposed that serial order is grounded in spatial cognition. Here, we compared performance of a group of right hemisphere-damaged patients with hemispatial neglect to healthy controls in verbal working memory tasks. Participants memorized sequences of consonants at span level and had to judge whether a target consonant belonged to the memorized sequence (item task) or whether a pair of consonants were presented in the same order as in the memorized sequence (order task). In line with this idea that serial order is grounded in spatial cognition, we found that neglect patients made significantly more errors in the order task than in the item task compared to healthy controls. Furthermore, this deficit seemed functionally related to neglect severity and was more frequently observed following right posterior brain damage. Interestingly, this specific impairment for serial order in verbal working memory was not lateralized. We advance the hypotheses of a potential contribution to the deficit of serial order in neglect patients of either or both (1) reduced spatial working memory capacity that enables to keep track of the spatial codes that provide memorized items with a positional context, (2) a spatial compression of these codes in the intact representational space.

Switching between Multiple Codes of SNARC-Like Associations: Two Conceptual Replication Attempts with Anodal tDCS in Sham-Controlled Cross-Over Design

In societies with left-to-right reading direction, left-side vs. right-side behavioral decisions are faster for relatively small vs. large number magnitudes, and vice versa, a phenomenon termed Spatial-Numerical Associations of Response Codes (SNARC) effect. But also for non-numerical sequential items, SNARC-like effects were observed, suggesting a common neurocognitive mechanism based on the ordinal structures of both numbers and sequences. Modulation of prefrontal networks that are involved in providing spatial associations during cognitive behavior can contribute to elaborate their neuropsychological theoretical foundations. With transcranial direct current stimulation (tDCS) directed to the left prefrontal cortex, we recently showed that (i) cathodal tDCS can block the emergence of spatial-numerical associations and that (ii) anodal tDCS can reverse spatial associations of sequential order, most likely based on markedness correspondence. Two conceptual replication attempts of the latter reversal of space-order associations are presented in the current sham-controlled experiment, using either weekdays (Monday-Friday) or month names (January-December) as stimuli in the temporal order classification task. In addition, to control for possible influences of notation, number stimuli were presented as written German names (One-Five). We report on a successful modulation of spatial-numerical associations of response codes (SNARC) effects with month stimuli induced by anodal tDCS, but failed to observe the same reversal of SNARC effects for weekday stimuli. The former stimulation effect was orthogonal to the small anodal tDCS effect on written number words, which replicates the dissociation of SNARC effects for numbers vs. non-numerical sequences. Moreover, this result reinforces the hypothesis that the ordinal item and task structure was the source of dissociation (as opposed to verbal presentation). We suggest that the diverging results can be explained by the markedness correspondence account of spatial associations in a multiple coding framework. Left-hemispheric prefrontal excitation from anodal tDCS renders verbal markedness relatively more dominant, but this effect is not absolute. We discuss task contagion, study design, and individual differences in performance measures or tDCS response as possible contributors to systematic variation of the weights of multiple coding parameters for spatial-numerical associations.