The time course of hemispheric differences in categorical and coordinate spatial processing

Working memory load modulates oscillatory activity and the distribution of fast frequencies across frontal theta phase during working memory maintenance

Working memory (WM) is a keystone of our cognitive abilities. Increasing load has been shown to dampen its performance and affect oscillatory neural activity in different frequency bands. Nevertheless, mixed results regarding fast frequencies activity and a lack of research on WM load modulations of cross-frequency phase-amplitude coupling mechanisms preclude a better understanding of the impact of increased WM load levels on brain activity as well as inter-regional communication and coordination supporting WM processes. Hence, we analyzed the EEG activity of 25 participants while performing a delayed-matching-to-sample (DMS) WM task with three WM load levels. Current density power and distribution at the source level for theta, beta, and gamma frequencies during the task's delay period were compared for each pair of WM load conditions. Results showed maximal increases of theta activity in frontal areas and of fast frequencies' activity in posterior regions with WM load, showing the involvement of frontal theta activity in WM maintenance and the control of attentional resources and visual processing by beta and gamma activity. To study whether WM load modulates communication between cortical areas, posterior beta and gamma amplitudes distribution across frontal theta phase was also analysed for those areas showing the largest significant WM load modulations. Higher beta activity amplitude at bilateral cuneus and right middle occipital gyrus, and higher gamma activity amplitude at bilateral posterior cingulate were observed during frontal theta phase peak in low than high memory load conditions. Moreover, greater fast beta amplitude at the right postcentral gyrus was observed during theta phase trough at right middle frontal gyrus in high than low memory load conditions. These results show that WM load modulates whether interregional communication occurs during theoretically optimal or non-optimal time windows, depending on the demands of frontal control of posterior areas required to perform the task successfully.

Frames of reference and categorical/coordinate spatial relations in a "what was where" task

The aim of this study was to explore how people use egocentric (i.e., with respect to their body) and allocentric (i.e., with respect to another element in the environment) references in combination with coordinate (metric) or categorical (abstract) spatial information to identify a target element. Participants were asked to memorize triads of 3D objects or 2D figures, and immediately or after a delay of 5 s, they had to verbally indicate what was the object/figure: (1) closest/farthest to them (egocentric coordinate task); (2) on their right/left (egocentric categorical task); (3) closest/farthest to another object/figure (allocentric coordinate task); (4) on the right/left of another object/figure (allocentric categorical task). Results showed that the use of 2D figures favored categorical judgments over the coordinate ones with either an egocentric or an allocentric reference frame, whereas the use of 3D objects specifically favored egocentric coordinate judgments rather than the allocentric ones. Furthermore, egocentric judgments were more accurate than allocentric judgments when the response was Immediate rather than delayed and 3D objects rather than 2D figures were used. This pattern of results is discussed in the light of the functional roles attributed to the frames of reference and spatial relations by relevant theories of visuospatial processing.

An Event Related Potentials Study of the Effects of Age, Load and Maintenance Duration on Working Memory Recognition

Age-related decline in cognitive capacities has been attributed to a generalized slowing of processing speed and a reduction in working memory (WM) capacity. Nevertheless, it is unclear how age affects visuospatial WM recognition and its underlying brain electrical activity. Whether age modulates the effects of memory load or information maintenance duration, which determine the limits of WM, remains also elusive. In this exploratory study, performance in a delayed match to sample task declined with age, particularly in conditions with high memory load. Event related potentials analysis revealed longer N2 and P300 latencies in old than in young adults during WM recognition, which may reflect slowing of stimulus evaluation and classification processes, respectively. Although there were no differences between groups in N2 or P300 amplitudes, the latter was more homogeneously distributed in old than in young adults, which may indicate an age-related increased reliance in frontal vs parietal resources during WM recognition. This was further supported by an age-related reduced posterior cingulate activation and increased superior frontal gyrus activation revealed through standardized low resolution electromagnetic tomography. Memory load and maintenance duration effects on brain activity were similar in both age groups. These behavioral and electrophysiological results add evidence in support of age-related decline in WM recognition theories, with a slowing of processing speed that may be limited to stimulus evaluation and categorization processes -with no effects on perceptual processes- and a posterior to anterior shift in the recruitment of neural resources.

Categorical biases in perceiving spatial relations

We investigate the effect of spatial categories on visual perception. In three experiments, participants made same/different judgments on pairs of simultaneously presented dot-cross configurations. For different trials, the position of the dot within each cross could differ with respect to either categorical spatial relations (the dots occupied different quadrants) or coordinate spatial relations (the dots occupied different positions within the same quadrant). The dot-cross configurations also varied in how readily the dot position could be lexicalized. In harder-to-name trials, crosses formed a “+” shape such that each quadrant was associated with two discrete lexicalized spatial categories (e.g., “above” and “left”). In easier-to-name trials, both crosses were rotated 45° to form an “×” shape such that quadrants were unambiguously associated with a single lexicalized spatial category (e.g., “above” or “left”). In Experiment 1, participants were more accurate when discriminating categorical information between easier-to-name categories and more accurate at discriminating coordinate spatial information within harder-to-name categories. Subsequent experiments attempted to down-regulate or up-regulate the involvement of language in task performance. Results from Experiment 2 (verbal interference) and Experiment 3 (verbal training) suggest that the observed spatial relation type-by-nameability interaction is resistant to online language manipulations previously shown to affect color and object-based perceptual processing. The results across all three experiments suggest that robust biases in the visual perception of spatial relations correlate with patterns of lexicalization, but do not appear to be modulated by language online.

Effects of load and maintenance duration on the time course of information encoding and retrieval in working memory: from perceptual analysis to post-categorization processes

WORKING MEMORY (WM) INVOLVES THREE COGNITIVE EVENTS

information encoding, maintenance, and retrieval; these are supported by brain activity in a network of frontal, parietal and temporal regions. Manipulation of WM load and duration of the maintenance period can modulate this activity. Although such modulations have been widely studied using the event-related potentials (ERP) technique, a precise description of the time course of brain activity during encoding and retrieval is still required. Here, we used this technique and principal component analysis to assess the time course of brain activity during encoding and retrieval in a delayed match to sample task. We also investigated the effects of memory load and duration of the maintenance period on ERP activity. Brain activity was similar during information encoding and retrieval and comprised six temporal factors, which closely matched the latency and scalp distribution of some ERP components: P1, N1, P2, N2, P300, and a slow wave. Changes in memory load modulated task performance and yielded variations in frontal lobe activation. Moreover, the P300 amplitude was smaller in the high than in the low load condition during encoding and retrieval. Conversely, the slow wave amplitude was higher in the high than in the low load condition during encoding, and the same was true for the N2 amplitude during retrieval. Thus, during encoding, memory load appears to modulate the processing resources for context updating and post-categorization processes, and during retrieval it modulates resources for stimulus classification and context updating. Besides, despite the lack of differences in task performance related to duration of the maintenance period, larger N2 amplitude and stronger activation of the left temporal lobe after long than after short maintenance periods were found during information retrieval. Thus, results regarding the duration of maintenance period were complex, and future work is required to test the time-based decay theory predictions.

Sex differences in the weighting of metric and categorical information in spatial location memory

According to the Category Adjustment model, remembering a spatial location involves the Bayesian combination of fine-grained and categorical information about that location, with each cue weighted by its relative certainty. However, individuals may differ in terms of their certainty about each cue, resulting in estimates that rely more or less on metric or categorical representations. To date, though, very little research has examined individual differences in the relative weighting of these cues in spatial location memory. Here, we address this gap in the literature. Participants were asked to recall point locations in uniform geometric shapes and in photographs of complex, natural scenes. Error patterns were analyzed for evidence of a sex difference in the relative use of metric and categorical information. As predicted, women placed relatively more emphasis on categorical cues, while men relied more heavily on metric information. Location reproduction tasks showed a similar effect, implying that the sex difference arises early in spatial processing, possibly during encoding.

Retinotopic mapping of categorical and coordinate spatial relation processing in early visual cortex

Spatial relations are commonly divided in two global classes. Categorical relations concern abstract relations which define areas of spatial equivalence, whereas coordinate relations are metric and concern exact distances. Categorical and coordinate relation processing are thought to rely on at least partially separate neurocognitive mechanisms, as reflected by differential lateralization patterns, in particular in the parietal cortex. In this study we address this textbook principle from a new angle. We studied retinotopic activation in early visual cortex, as a reflection of attentional distribution, in a spatial working memory task with either a categorical or a coordinate instruction. Participants were asked to memorize a dot position, with regard to a central cross, and to indicate whether a subsequent dot position matched the first dot position, either categorically (opposite quadrant of the cross) or coordinately (same distance to the centre of the cross). BOLD responses across the retinotopic maps of V1, V2, and V3 indicate that the spatial distribution of cortical activity was different for categorical and coordinate instructions throughout the retention interval; a more local focus was found during categorical processing, whereas focus was more global for coordinate processing. This effect was strongest for V3, approached significance in V2 and was absent in V1. Furthermore, during stimulus presentation the two instructions led to different levels of activation in V3 during stimulus encoding; a stronger increase in activity was found for categorical processing. Together this is the first demonstration that instructions for specific types of spatial relations may yield distinct attentional patterns which are already reflected in activity early in the visual cortex.

Displacement of location in illusory line motion

Six experiments examined displacement in memory for the location of the line in illusory line motion (ILM; appearance or disappearance of a stationary cue is followed by appearance of a stationary line that is presented all at once, but the stationary line is perceived to "unfold" or "be drawn" from the end closest to the cue to the end most distant from the cue). If ILM was induced by having a single cue appear, then memory for the location of the line was displaced toward the cue, and displacement was larger if the line was closer to the cue. If ILM was induced by having one of two previously visible cues vanish, then memory for the location of the line was displaced away from the cue that vanished. In general, the magnitude of displacement increased and then decreased as retention interval increased from 50 to 250 ms and from 250 to 450 ms, respectively. Displacement of the line (a) is consistent with a combination of a spatial averaging of the locations of the cue and the line with a relatively weaker dynamic in the direction of illusory motion, (b) might be implemented in a spreading activation network similar to networks previously suggested to implement displacement resulting from implied or apparent motion, and (c) provides constraints and challenges for theories of ILM.

The nature of categorical and coordinate spatial relation processing: An interference study

Spatial relation information can be encoded in two different ways: categorically, which is abstract, and coordinately, which is metric. Although categorical and coordinate spatial relation processing is commonly conceived as relying on spatial representations and spatial cognitive processes, some suggest that representations and cognitive processes involved in categorical spatial relation processing can be verbal as well as spatial. We assessed the extent to which categorical and coordinate spatial relation processing engages verbal and spatial representations and processes using a dual-task paradigm. Participants performed the classical dot-bar paradigm and simultaneously performed either a spatial tapping task, or an articulatory suppression task. When participants were requested to tap blocks in a given pattern (spatial tapping), their performance decreased in both the categorical and coordinate tasks compared to a control condition without interference. In contrast, articulatory suppression did not affect performance in either spatial relation task. A follow-up experiment indicated that this outcome could not be attributed to different levels of difficulty of the two interference tasks. These results provide strong evidence that both coordinate and categorical spatial relation processing relies mainly on spatial mechanisms. These findings have implications for theories on why categorical and coordinate spatial relations processing are lateralized in the brain.

Individual differences in spatial relation processing: effects of strategy, ability, and gender

Numerous studies have focused on the distinction between categorical and coordinate spatial relations. Categorical relations are propositional and abstract, and often related to a left hemisphere advantage. Coordinate relations specify the metric information of the relative locations of objects, and can be linked to right hemisphere processing. Yet, not all studies have reported such a clear double dissociation; in particular the categorical left hemisphere advantage is not always reported. In the current study we investigated whether verbal and spatial strategies, verbal and spatial cognitive abilities, and gender could account for the discrepancies observed in hemispheric lateralization of spatial relations. Seventy-five participants performed two visual half field, match-to-sample tasks (Van der Ham, van Wezel, Oleksiak, & Postma, 2007; Van der Ham, Raemaekers, van Wezel, Oleksiak, and Postma, 2009) to study the lateralization of categorical and coordinate relation processing. For each participant we determined the strategy they used in each of the two tasks. Consistent with previous findings, we found an overall categorical left hemisphere advantage and coordinate right hemisphere advantage. The lateralization pattern was affected selectively by the degree to which participants used a spatial strategy and by none of the other variables (i.e., verbal strategy, cognitive abilities, and gender). Critically, the categorical left hemisphere advantage was observed only for participants that relied strongly on a spatial strategy. This result is another piece of evidence that categorical spatial relation processing relies on spatial and not verbal processes.

Hemispheric asymmetries in categorical perception of orientation in infants and adults

Orientation CP is the faster or more accurate discrimination of two orientations from different categories (e.g., oblique1 and vertical1) compared to two orientations from the same category (e.g., oblique1 and oblique2), even when the degree of difference is equated across conditions. Here, we assess whether there are hemispheric asymmetries in this effect for adults and 5-month-old infants. Experiment 1 identified the location of the vertical-oblique category boundary. Experiment 2, using a visual search task with oriented lines found that adult search was more accurate when the target and distractors were from different orientation categories, compared to targets and distractors of an equivalent physical difference taken from the same category. This effect was stronger for targets lateralized to the left visual field (LVF) than the right visual field (RVF), indicating a right hemisphere (RH) bias in adult orientation CP. Experiment 3, replicated the RH bias using different stimuli and also investigated the impact of visual and verbal interference on the category effect. Experiment 4, using the same visual search task, found that infant search was also faster when the target and distractors were from different orientation categories than the same, yet this category effect was stronger for RVF than LVF lateralized targets, indicating a LH bias in orientation CP at 5 months. These findings are contrasted to equivalent studies on the lateralization of color CP (e.g., Gilbert, Regier, Kay, & Ivry, 2005). The implications for theories on the contribution of the left and right hemispheres of the infant and adult brain to categorical computations are discussed.

Is there continuity between categorical and coordinate spatial relations coding? Evidence from a grid/no-grid working memory paradigm

We ask the question whether the coding of categorical versus coordinate spatial relations depends on different neural networks showing hemispheric specialization or whether there is continuity between these two coding types. The 'continuous spatial coding' hypothesis would mean that the two coding types rely essentially on the same neural network consisting of more general-purpose processes, such as visuo-spatial attention, but with a different weighting of these general processes depending on exact task requirements. With event-related fMRI, we have studied right-handed male subjects performing a grid/no-grid visuo-spatial working memory task inducing categorical and coordinate spatial relations coding. Our data support the 'continuous spatial coding' hypothesis, indicating that, while based on the same fronto-parieto-occipital neural network than categorical spatial relations coding, the coding of coordinate spatial relations relies more heavily on attentional and executive processes, which could induce hemispheric differences similar to those described in the literature. The results also show that visuo-spatial working memory consists of a short-term posterior store with a capacity of up to three elements in the parietal and extrastriate cortices. This store depends on the presence of a visible space categorization and thus can be used for the coding of categorical spatial relations. When no visible space categorization is given or when more than three elements have to be coded, additional attentional and executive processes are recruited, mainly located in the dorso-lateral prefrontal cortex.