Space-time interdependence: evidence against asymmetric mapping between time and space

Memory traces of duration and location in the right intraparietal sulcus

Time and space form an integral part of every human experience, and for the neuronal representation of these perceptual dimensions, previous studies point to the involvement of the right-hemispheric intraparietal sulcus and structures in the medial temporal lobe. Here we used multi-voxel pattern analysis (MVPA) to investigate long-term memory traces for temporal and spatial stimulus features in those areas. Participants were trained on four images associated with short versus long durations and with left versus right locations. Our results demonstrate stable representations of both temporal and spatial information in the right posterior intraparietal sulcus. Building upon previous findings of stable neuronal codes for directly perceived durations and locations, these results show that the reactivation of long-term memory traces for temporal and spatial features can be decoded from neuronal activation patterns in the right parietal cortex.

Memory capacity as the core mechanism of the development of space-time interferences in children

This study investigated the development of spatiotemporal perceptual interactions in 5-to-7 years old children. Participants reproduced the temporal and spatial interval between sequentially presented visual stimuli. The time and spacing between stimuli were experimentally manipulated. In addition, cognitive capacities were assessed using neuropsychological tests. Results revealed that starting at 5 years old, children exhibited spatial biases in their time estimations and temporal biases in their spatial estimations, pointing at space-time interference. In line with developmental improvement of temporal and spatial abilities, these spatiotemporal biases decreased with age. Importantly, short-term memory capacity was a predictor of space-time interference pointing to shared cognitive mechanisms between time and space processing. Our results support the symmetrical hypothesis that proposes a common neurocognitive mechanism for processing time and space.

Ebbinghaus, Müller-Lyer, and Ponzo: Three examples of bidirectional space-time interference

Previous studies have shown interference between illusory size and perceived duration. The present study replicated this space-time interference in three classic visual-spatial illusions, the Ebbinghaus, the Müller-Lyer, and the Ponzo illusion. The results showed bidirectional interference between illusory size and duration for all three illusions. That is, subjectively larger stimuli were judged to be presented longer, and stimuli that were presented longer were judged to be larger. Thus, cross-dimensional interference between illusory size and duration appears to be a robust phenomenon and to generalize across a wide range of visual size illusions. This space-time interference most likely arises at the memory level and supports the theoretical notion of a common representational metric for space and time.

Time and visual-spatial illusions: Evidence for cross-dimensional interference between duration and illusory size

Time and space are intimately related to each other. Previous evidence has shown that stimulus size can affect perceived duration even when size differences are illusory. In the present study, we investigated the effect of visual-spatial illusions on duration judgments in a temporal reproduction paradigm. Specifically, we induced the Ebbinghaus illusion (Exp. 1) and the horizontal-vertical illusion (Exp. 2) during the encoding phase of the target interval or the reproduction phase. The results showed (a) that illusory size affects temporal processing similarly to the way physical size does, (b) that the effect is independent of whether the illusion appeared during encoding or reproduction, and (c) that the interference between size and temporal processing is bidirectional. These results suggest a rather late locus of size-time interference in the processing stream.

On the interplay between time and space perception in discontinuous stimulus displays

The present study examined whether and how the mutual perceptual biases of temporal and spatial information, known as the kappa and the tau effects, depend on the duration and spatial extent of sensory stimulation as well as on the magnitude of spatio-temporal discrepancy. Three small circles were presented in succession at different spatial positions. The time points of presentation and the spatial position of the second circle systematically varied. Participants judged either whether the temporal interval between the first and the second circle was longer than the interval between the second and the third circle (Experiment 1) or whether the spatial distance between the first and the second circle was larger than the distance between the second and the third circle (Experiment 2), or both in separate blocks of trials (Experiment 3). The impact of spatial information on temporal perception (i.e., the kappa effect) increased with velocity of motion presumably imputed by the participants to the static displays and decreased with spatio-temporal discrepancy. No inverse biases (i.e., no tau effects) were observed. These results are considered as an indication that integration of spatial and temporal signals follow the same basic principles as multisensory integration of redundant signals, such as those from vision and touch.

Gradient Organization of Space, Time, and Numbers in the Brain: A Meta-analysis of Neuroimaging Studies

In this study, we ran a meta-analysis of neuroimaging studies to pinpoint the neural regions that are commonly activated across space, time, and numerosity, and we tested the existence of gradient transitions among these magnitude representations in the brain. Following PRISMA guidelines, we included in the meta-analysis 112 experiments (for space domain), 114 experiments (time domain), and 115 experiments (numerosity domain), and we used the activation likelihood estimation method. We found a system of brain regions that was commonly recruited in all the three magnitudes, which included bilateral insula, the supplementary motor area (SMA), the right inferior frontal gyrus, and bilateral intraparietal sulci. Gradiental transitions between different magnitudes were found along all these regions but insulae, with space and numbers leading to gradients mainly over parietal regions (and SMA) whereas time and numbers mainly over frontal regions. These findings provide evidence for the GradiATOM theory (Gradient Theory of Magnitude), suggesting that spatial proximity given by overlapping activations and gradients is a key aspect for efficient interactions and integrations among magnitudes.

Near-optimal integration of the magnitude information of time and numerosity

Magnitude information is often correlated in the external world, providing complementary information about the environment. As if to reflect this relationship, the perceptions of different magnitudes (e.g. time and numerosity) are known to influence one another. Recent studies suggest that such magnitude interaction is similar to cue integration, such as multisensory integration. Here, we tested whether human observers could integrate the magnitudes of two quantities with distinct physical units (i.e. time and numerosity) as abstract magnitude information. The participants compared the magnitudes of two visual stimuli based on time, numerosity, or both. Consistent with the predictions of the maximum-likelihood estimation model, the participants integrated time and numerosity in a near-optimal manner; the weight of each dimension was proportional to their relative reliability, and the integrated estimate was more reliable than either the time or numerosity estimate. Furthermore, the integration approached a statistical optimum as the temporal discrepancy of the acquisition of each piece of information became smaller. These results suggest that magnitude interaction arises through a similar computational mechanism to cue integration. They are also consistent with the idea that different magnitudes are processed by a generalized magnitude system.

Modal-based attention modulates the redundant-signals effect: Role of unimodal target probability

Multisensory integration includes two behavioral manifestations: the modality dominance effect and the redundant-signals effect (RSE). RSE is a multisensory improvement effect in which individuals respond more quickly and accurately to bimodal audiovisual (AV) targets than to unimodal auditory (A) or visual (V) targets. Previous studies have confirmed that RSE is the product of modality interactions between different modalities. The goal of this study was to systematically investigate the effects of the modality dominance manipulated by modal-based attention and unimodal target probability on RSE. The results showed that when paying attention to both the A and V modalities (Exp. 1), RSE was not significantly different between unimodal target probabilities. When selectively paying attention to the A modality (Exp. 2A), RSE was also not significantly different between unimodal target probabilities. However, when selectively paying attention to the V modality (Exp. 2B), the magnitude of RSE showed a significant decreasing trend with the increasing probability of V targets. Our study is the first to reveal that the unimodal target probability significantly modulates RSE in visual selective attention, and this modulatory effect of the unimodal target probability on RSE is opposite to the modulatory effect on the modality dominance effect.

Exploring spatiotemporal interactions: On the superiority of time over space

Space and time mutually influence each other such that space affects time estimation (space-on-time effect), and conversely (time-on-space effect). These reciprocal interferences suggest that space and time are intrinsically linked in the human mind. Yet, recent evidence for an asymmetrical advantage for space over time challenges the classical theoretical interpretation. In the present study, we tested whether the superiority of space over time in magnitude interference depends on the cognitive resources engaged in the spatial task. We conducted three experiments in which participants performed judgments on temporal intervals and spatial distances in separate blocks. In each trial, two dots were successively flashed at various locations, and participants were to judge whether the duration or distance between the dots was short or long. To manipulate cognitive demands in the spatial task, distances varied across experiments (highly discriminable for the non-demanding spatial task in Experiment 1 and scarcely discriminable for the demanding spatial task in Experiment 2). Importantly, this manipulation tended to enhance perceptual sensitivity (as indexed by Weber Ratios) but slowed down the decision process (as indexed by response times) in the demanding experiment. Our results provide evidence for robust space-on-time and time-on-space effects (Experiments 1 and 2). More crucially, the involvement of cognitive resources in a demanding spatial task causes a massive time-on-space effect: Spatial judgments are indeed more influenced by irrelevant temporal information than the reverse (Experiments 2 and 3). Overall, the flexibility of spatiotemporal interferences has direct theoretical implications and questions the origins of space-time interaction.

The nature of magnitude integration: Contextual interference versus active magnitude binding

Magnitude dimensions such as duration and numerosity have been shown to systematically interact, biasing each other in a congruent fashion: the more numerous a set of items is, the longer it is perceived to last in time. This integration between dimensions plays an important role in defining how we perceive magnitude. So far, however, the nature of magnitude integration remains unclear. Is magnitude integration a contextual interference, occurring whenever different types of information are concurrently available in the visual field, or does it involve an active “binding” of the different dimensions of the same object? To address these possibilities, we measured the integration bias induced by numerosity on perceived duration, in two cases: with duration and numerosity conveyed by distinct stimuli, or by the same stimulus. We show that a congruent integration effect can be observed only when the two magnitudes belong to the same stimulus. Instead, when the two magnitudes are conveyed by distinct stimuli, we observed an opposite effect. These findings demonstrate for the first time that a congruent integration occurs only between the dimensions of the same stimulus, suggesting the involvement of an active mechanism integrating the different dimensions of the same object in a unified percept.

Number-time interaction: Search for a common magnitude system in a cross-modal setting

A theory of magnitude (ATOM) suggests that a generalized magnitude system in the brain processes magnitudes such as space, time, and numbers. Numerous behavioral and neurocognitive studies have provided support to ATOM theory. However, the evidence for common magnitude processing primarily comes from the studies in which numerical and temporal information are presented visually. Our current understanding of such cross-dimensional magnitude interactions is limited to visual modality only. However, it is still unclear whether the ATOM-framework accounts for the integration of cross-modal magnitude information. To examine the cross-modal influence of numerical magnitude on temporal processing of the tone, we conducted three experiments using a temporal bisection task. We presented the numerical magnitude information in the visual domain and the temporal information in the auditory either simultaneously with duration judgment task (Experiment-1), before duration judgment task (Experiment-2), and before duration judgment task but with numerical magnitude also being task-relevant (Experiment-3). The results suggest that the numerical information presented in the visual domain affects temporal processing of the tone only when the numerical magnitudes were task-relevant and available while making a temporal judgment (Experiments-1 and 3). However, numerical information did not interfere with temporal information when presented temporally separated from the duration information (Experiments-2). The findings indicate that the influence of visual numbers on temporal processing in cross-modal settings may not arise from the common magnitude system but instead from general cognitive mechanisms like attention and memory.

Cross-dimensional magnitude interactions reflect statistical correlations among physical dimensions: Evidence from space-time interaction

Magnitudes of different physical dimensions have been assumed to be processed by a common metric in order to account for interactions between different dimensions (e.g., space, time). This paper tested a different hypothesis, that these cross-dimensional interactions reflect people's experience of statistical correlations among physical dimensions. In the experiment, we manipulated the correlation between space (length) and time (duration). A stimulus consisting of two vertical bars that demarcated a variable stimulus length was presented for a variable stimulus duration; participants were to reproduce either the stimulus length or the stimulus duration. Critically, to reproduce a stimulus length, participants held down the spacebar to grow or shrink (in a blocked design) a length to the stimulus length such that space (i.e. reproduced length) positively or negatively co-varied with time. Reproduced lengths did not vary as a function of stimulus duration under positive space-time correlation but decreased as a function of stimulus duration under negative space-time correlation; reproduced durations increased as a function of stimulus length under positive space-time correlation but this space-on-time effect appeared to be attenuated under negative space-time correlation. These findings are consistent with a Bayesian inference account whereby cross-dimensional interactions reflect people's prior belief/knowledge of cross-dimensional statistical correlation, which itself tunes to recent input.

Tau and kappa in interception - how perceptual spatiotemporal interrelations affect movements

Batting and catching are real-life examples of interception. Due to latencies between the processing of sensory input and the corresponding motor response, successful interception requires accurate spatiotemporal prediction. However, spatiotemporal predictions can be subject to bias. For instance, the more spatially distant two sequentially presented objects are, the longer the interval between their presentations is perceived (kappa effect) and vice versa (tau effect). In this study, we deployed these phenomena to test in two sensory modalities whether temporal representations depend asymmetrically on spatial representations, or whether both are symmetrically interrelated. We adapted the tau and kappa paradigms to an interception task by presenting four stimuli (visually or auditorily) one after another on four locations, from left to right, with constant spatial and temporal intervals in between. In two experiments, participants were asked to touch the screen where and when they predicted a fifth stimulus to appear. In Exp. 2, additional predictive gaze measures were examined. Across experiments, auditory but not visual stimuli produced a tau effect for interception, supporting the idea that the relationship between space and time is moderated by the sensory modality. Results did not reveal classical auditory or visual kappa effects and no visual tau effects. Gaze data in Exp. 2 showed that the (spatial) gaze orientation depended on temporal intervals while the timing of fixations was modulated by spatial intervals, thereby indicating tau and kappa effects across modalities. Together, the results suggest that sensory modality plays an important role in spatiotemporal predictions in interception.

Partially Separable Aspects of Spatial and Temporal Estimations in Virtual Navigation as Revealed by Adaptation

Recent studies claim that estimating the magnitude of the spatial and temporal aspects of one's self-motion shows similar characteristics, suggesting shared processing mechanisms between these two dimensions. While the estimation of other magnitude dimensions, such as size, number, and duration, exhibits negative aftereffects after prolonged exposure to the stimulus, it remains to be elucidated whether this could occur similarly in the estimation of the distance travelled and time elapsed during one's self-motion. We sought to fill this gap by examining the effects of adaptation on distance and time estimation using a virtual navigation task. We found that a negative aftereffect occurred in the distance reproduction task after repeated exposure to self-motion with a fixed travel distance. No such aftereffect occurred in the time reproduction task after repeated exposure to self-motion with a fixed elapsed time. Further, the aftereffect in distance reproduction occurred only when the distance of the adapting stimulus was fixed, suggesting that it did not reflect adaptation to time, which varied with distance. The estimation of spatial and temporal aspects of self-motion is thus processed by partially separable mechanisms, with the distance estimation being similar to the estimation of other magnitude dimensions.

The relationship between space and time perception: A registered replication of Casasanto and Boroditsky (2008)

Everything in our environment moves through both space and time, and to effectively act we must be aware of both spatial and temporal elements in relation to our own body. Thus, perception of space and time have an intimate relationship. Walsh's a theory of magnitude (ATOM) suggests that space and time perception rely on a general magnitude system and their relationship should be roughly symmetrical. Alternatively, metaphor theory, which is based on the philosophical work of Lakoff and Johnson, argues that we represent time using spatial metaphor and thus the relationship should be asymmetrical (with space influencing time more than time influences space). A compelling line of evidence for metaphor theory comes from the work of Casasanto and Boroditsky who experimentally demonstrated this asymmetric effect. However, in our previous unpublished online replication attempt of this work, we found a roughly symmetrical relationship between space and time, more in line with the theoretical predictions of ATOM. Given this, we performed a registered replication of Casasanto and Boroditsky (2008) in both an online and laboratory environment.

Electrophysiological Evidence for a Common Magnitude Representation of Spatiotemporal Information in Working Memory

Spatiotemporal interference has attracted increasing attention because it provides a window for studying the neural representation of magnitude in the brain. We aimed to identify the neural basis of spatiotemporal interference using a Kappa effect task in which two circles were presented in sequence with two time intervals and three space distances. Participants reproduced the time intervals while ignoring the space distance when electroencephalogram signals were recorded synchronously. The behavior results showed that production time increased with time interval and space distance. Offset of the time intervals elicited typical P2 and P3b components. Larger parietal P2 and P3b amplitudes were elicited by the combination of longer time intervals and longer space distances. The parietal P2 and P3b amplitudes were positively correlated with the production time, and the corresponding neural source was located in the parietal cortex. The results suggest that the parietal P2 and P3b index updates a common representation of spatiotemporal information in working memory, which provides electrophysiological evidence for the mechanisms underlying spatiotemporal interferences. Our study supports a theory of magnitude, in which different dimensions can be integrated into a common magnitude representation in a generalized magnitude system that is localized at the parietal cortex.

The specious interaction of time and numerosity perception

Magnitude information is essential to create a representation of the external environment and successfully interact with it. Duration and numerosity, for example, can shape our predictions and bias each other (i.e. the greater the number of people queuing, the longer we expect to wait). While these biases suggest the existence of a generalized magnitude system, asymmetric effects (i.e. numerosity affecting duration but not vice versa) challenged this idea. Here, we propose that such asymmetric integration depends on the stimuli used and the neural processing dynamics they entail. Across multiple behavioural experiments employing different stimulus presentation displays (static versus dynamic) and experimental manipulations known to bias numerosity and duration perceptions (i.e. connectedness and multisensory integration), we show that the integration between numerosity and time can be symmetrical if the stimuli entail a similar neural time-course and numerosity unfolds over time. Overall, these findings support the idea of a generalized magnitude system, but also highlight the role of early sensory processing in magnitude representation and integration.

A unifying Bayesian framework accounting for spatiotemporal interferences with a deceleration tendency

Spatial and temporal levels of information processing interfere with each other. The Kappa effect is a well-known spatiotemporal interference in which the estimated time between two lights increases as the distance between them increases, showing a deceleration tendency. A classical model attributes this interference to constant speeds and predicts a linear relation, whereas a slowness model attributes the interference to slow speeds and proposes that the tendency is due to the uncertainty of stimuli locations. This study integrated a unifying Bayesian framework with the classical model and argued that this tendency is the result of the Weber-Fechner law. This hypothesis was tested via two time discrimination tasks that manipulated the uncertainty of stimuli locations and the distance between stimuli. Experiment 1 showed that the estimated time was not modulated by the uncertainty of the stimuli locations. Experiment 2 revealed that the behavioral predictions made by the Bayesian model on logarithmic scales were more accurate than those made by the linear model. Our results suggest that the deceleration tendency in the Kappa effect is the result of the Weber-Fechner law.

The impact of pitch on tempo-spatial accuracy and precision in intercepting a virtually moving ball

In two experiments, horizontal and vertical orientated sounds moved in parabolas. Participants had to touch a screen to indicate where and when a virtual moving ball would cross a visible line. We predicted that due to the sensitivity of the auditory system to temporal information, manipulations of pitch should affect temporal errors more than spatial errors. Stimuli were sound sources at five different pitches moving along a parabola produced through loudspeakers mounted around a touch screen. Results showed pitch effects on spatial constant and spatial variable errors when the parabola was horizontally oriented (Exp. 1), and on temporal constant errors in vertically oriented parabolas (Exp. 2). We conclude that temporal and spatial precision in interception tasks were affected differently by pitch manipulations and require consideration in future studies when assessing the impact of auditory information on catching virtually moving balls.

Attention mediates the influence of numerical magnitude on temporal processing

The processing of time and numbers has been fundamental to human cognition. One of the prominent theories of magnitude processing, a theory of magnitude (ATOM), suggests that a generalized magnitude system processes space, time, and numbers; thereby, the magnitude dimensions could potentially interact with one another. However, more recent studies have found support for domain-specific magnitude processing and argued that the magnitudes related to time and number are processed through distinct mechanisms. Such mixed findings have raised questions about whether these magnitudes are processed independently or share a common processing mechanism. In the present study, we examine the influence of numerical magnitude on temporal processing. To investigate, we conducted two experiments using a temporal comparison task, wherein we presented positive and negative numerical magnitudes (large and small) in a blocked (Experiment-1) and intermixed manner (Experiment-2). Results from experiment-1 suggest that numerical magnitude affects temporal processing only in positive numbers but not for negative numbers. Further, results from experiment-2 indicate that the polarity (positive and negative) of the numbers influences temporal processing instead of the numerical magnitude itself. Overall, the current study seems to suggest that cross-domain interaction of magnitudes arises from attentional mechanisms and may not need to posit a common magnitude processing system.

Cross-dimensional magnitude interaction is modulated by representational noise: evidence from space-time interaction

Magnitudes along different dimensions (e.g., space and time) tend to interact with each other in perception, with some magnitude dimensions more susceptible to cross-dimensional interference than others. What causes such asymmetries in cross-dimensional magnitude interaction is being debated. The current study investigated whether the representational noise of magnitudes modulates the (a)symmetry in space-time interaction. In three experiments using different formats of length, we showed that dynamic unfilled lengths resulted in a higher representational noise than either static unfilled length or static filled length. Correspondingly, we observed that the time-on-space effect was larger for dynamic unfilled lengths than for static unfilled length or static filled length (and it did not differ between the latter two). Further correlational analyses showed that the susceptibility of a target dimension to the influence of a concurrent dimension increased as a function of participants' representational noise in the target dimension (e.g., the noisier length representations, the larger the time-on-space effect). In all, our study showed that the representational noise of space and time modulates the way the two dimensions interact. These findings suggest that cross-dimensional magnitude interactions arise as a result of memory interference, with noisier magnitudes being more prone to being nudged by concurrent magnitudes in other dimensions. Such memory interference can be seen as a result of Bayesian inference with correlated priors between magnitude dimensions.

Numerical Magnitude Affects Accuracy but Not Precision of Temporal Judgments

A Theory of Magnitude (ATOM) suggests that space, time, and quantities are processed through a generalized magnitude system. ATOM posits that task-irrelevant magnitudes interfere with the processing of task-relevant magnitudes as all the magnitudes are processed by a common system. Many behavioral and neuroimaging studies have found support in favor of a common magnitude processing system. However, it is largely unknown whether such cross-domain monotonic mapping arises from a change in the accuracy of the magnitude judgments or results from changes in precision of the processing of magnitude. Therefore, in the present study, we examined whether large numerical magnitude affects temporal accuracy or temporal precision, or both. In other words, whether numerical magnitudes change our temporal experience or simply bias duration judgments. The temporal discrimination (between comparison and standard duration) paradigm was used to present numerical magnitudes (“1,” “5,” and “9”) across varied durations. We estimated temporal accuracy (PSE) and precision (Weber ratio) for each numerical magnitude. The results revealed that temporal accuracy (PSE) for large (9) numerical magnitude was significantly lower than that of small (1) and identical (5) magnitudes. This implies that the temporal duration was overestimated for large (9) numerical magnitude compared to small (1) and identical (5) numerical magnitude, in line with ATOM’s prediction. However, no influence of numerical magnitude was observed on temporal precision (Weber ratio). The findings of the present study suggest that task-irrelevant numerical magnitude selectively affects the accuracy of processing of duration but not duration discrimination itself. Further, we argue that numerical magnitude may not directly affect temporal processing but could influence via attentional mechanisms.

Do primates flexibly use spatio-temporal cues when foraging?

Foraging in seasonal environments can be cognitively demanding. Comparative studies have associated large brain size with a frugivorous diet. We investigated the ability of three semi-free-ranging primate species with different degrees of frugivory (N_trials: Macaca tonkeana = 419, Macaca fascicularis = 197, Sapajus apella = 346) in developing a mental representation of the spatio-temporal distribution of food using foraging experiments. Forty-two boxes were fixed on trees, and each week ("season"), some of them were filled with fruits which were either highly preferred, or less preferred. Spatial (geometrical panels) and temporal (peel skin of the available fruit) cues were present at each season to indicate where (food location), what (which food) was available, and when. To test the flexible use of the cues in primate foraging behaviour, we first removed the spatial and temporal cues one at a time, and then, we manipulated the "seasonal" order of the available fruit. We compared the foraging performances in the absence and the presence of the cues and during the usual and unusual seasonal order. The average proportion of baited boxes chosen by the subjects in presence of both cues was high (between 73% and 98%) for all species. The primates seemed to remember the spatio-temporal food availability (or used other cues) because no difference was found between trials with or without our spatial and temporal cues. When the usual seasonal pattern was changed, they flexibly adjusted the feeding choice by using the provided temporal cues. We discuss these results also in view of a possible experimental bias.

From ATOM to GradiATOM: Cortical gradients support time and space processing as revealed by a meta-analysis of neuroimaging studies

According to the ATOM (A Theory Of Magnitude), formulated by Walsh more than fifteen years ago, there is a general system of magnitude in the brain that comprises regions, such as the parietal cortex, shared by space, time and other magnitudes. The present meta-analysis of neuroimaging studies used the Activation Likelihood Estimation (ALE) method in order to determine the set of regions commonly activated in space and time processing and to establish the neural activations specific to each magnitude domain. Following PRISMA guidelines, we included in the analysis a total of 112 and 114 experiments, exploring space and time processing, respectively. We clearly identified the presence of a system of brain regions commonly recruited in both space and time that includes: bilateral insula, the pre-supplementary motor area (pre-SMA), the right frontal operculum and the intraparietal sulci. These regions might be the best candidates to form the core magnitude neural system. Surprisingly, along each of these regions but the insula, ALE values progressed in a cortical gradient from time to space. The SMA exhibited an anterior-posterior gradient, with space activating more-anterior regions (i.e., pre-SMA) and time activating more-posterior regions (i.e., SMA-proper). Frontal and parietal regions showed a dorsal-ventral gradient: space is mediated by dorsal frontal and parietal regions, and time recruits ventral frontal and parietal regions. Our study supports but also expands the ATOM theory. Therefore, we here re-named it the 'GradiATOM' theory (Gradient Theory of Magnitude), proposing that gradient organization can facilitate the transformations and integrations of magnitude representations by allowing space- and time-related neural populations to interact with each other over minimal distances.

Can Implicit or Explicit Time Processing Impact Numerical Representation? Evidence From a Dual Task Paradigm

Whether the human brain processes various types of magnitude, such as numbers and time, through a shared representation or whether there are different representations for each type of magnitude is still debated. Here, we investigated two aspects of number-time interaction: the effects of implicit and explicit processing of time on numbers and the bi-directional interaction between time and number processing. Thirty-two participants were randomly assigned into two experimental groups that performed, respectively, a Single task (number comparison, with implicit time processing) and a Dual task (number comparison as a primary task, with explicit time processing as a secondary task). Results showed that participants, only in the Dual task, were faster and more accurate when processing large numbers paired with long rather than short durations, whereas the opposite pattern was not evident for small numbers. Moreover, participants were more accurate when judging long durations after having processed large rather than small numbers, whereas the opposite pattern emerged for short durations. We propose that number processing influences time processing more than vice versa, suggesting that numbers and time might be at least partially independently represented. This finding can pave the way for investigating the hierarchical representation of space, numbers, and time.

The modality switching costs of Chinese-English bilinguals in the processing of L1 and L2

Modality switching cost indicates that people's performance becomes worse when they judge sequential information that is related to different sensory modalities than judging information that is related to the same modality. In this study, we conducted three experiments on proficient and non-proficient bilingual individuals to investigate the modality switching costs in L1 and L2 processing separately. In Experiment 1, materials were L1 and L2 words that were either conceptually related to a visual modality (e.g., light) or related to an auditory modality (e.g., song). The modality switching costs were investigated in a lexical decision task in both L1 and L2. Experiment 2 further explored the modality switching costs while weakening the activation level of the perceptual modality by adding a set of fillers. Experiment 3 used a word-naming task to explore the modality switching effect in language production in L1 and L2. Results of these experiments showed that the modality switching costs appeared in both language comprehension and production in L1 and L2 conditions. The magnitude of the modality switching costs was conditionally modulated by the L2 proficiency level, such as in the L2 condition in Experiment 1 and in both L1 and L2 conditions in Experiment 3. These results suggest that sensorimotor simulation is involved in not only language comprehension but also language production. The sensorimotor simulation that is acquired in L1 can be transferred to L2.

Where and what? Frugivory is associated with more efficient foraging in three semi-free ranging primate species

Foraging in seasonal environments can be cognitively challenging. Comparative studies have associated brain size with a frugivorous diet. We investigated how fruit distribution (where) and preference (what) affect foraging decisions in three semi-free ranging primate species with different degrees of frugivory: Macaca tonkeana (N indiv = 5; N trials = 430), M. fascicularis (N indiv = 3; N trials = 168) and Sapajus apella (N indiv = 6; N trials = 288). We used 36 boxes fixed on trees and filled with highly and less preferred fruits with different (weekly) spatio-temporal distributions. Individuals were tested in two conditions: (1) same fruit provided concurrently in the same quantity but in a scattered and in a clumped distribution, (2) highly preferred fruit was scattered while the less preferred was clumped. Generally, primates preferred feeding first on the boxes of the clumped distribution in both conditions, with the more frugivorous species at a higher degree than the less frugivorous species in condition (1), but not (2). Therefore, what fruit was available changed the foraging decisions of the more frugivorous species who also engaged more in goal-directed travel. When feeding on preferred fruit, primates probably maximized foraging efficiency regardless of their degree of frugivory. Our findings emphasize that the food type and distribution may be a preponderant driver in cognitive evolution.

Space Trumps Time When Talking About Objects

The nature of the relationship between the concepts of space and time in the human mind is much debated. Some claim that space is primary and that it structures time (cf. Lakoff & Johnson, 1980) while others (cf. Walsh, 2003) maintain no difference in status between them. Using fully immersive virtual reality (VR), we examined the influence of object distance and time of appearance on choice of demonstratives (this and that) to refer to objects. Critically, demonstratives can be used spatially (this/that red triangle) and temporally (this/that month). Experiment 1 showed a pattern of demonstrative usage in VR that is consistent with results found in real‐world studies. Experiments 2, 3, and 4 manipulated both when and where objects appeared, providing scenarios where participants were free to use demonstratives in either a temporal or spatial sense. Although we find evidence for time of presentation affecting object mention, the experiments found that demonstrative choice was affected only by distance. These results support the view that spatial uses of demonstratives are privileged over temporal uses.

Number, time, and space are not singularly represented: Evidence against a common magnitude system beyond early childhood

Our ability to represent temporal, spatial, and numerical information is critical for understanding the world around us. Given the prominence of quantitative representations in the natural world, numerous cognitive, neurobiological, and developmental models have been proposed as a means of describing how we track quantity. One prominent theory posits that time, space, and number are represented by a common magnitude system, or a common neural locus (i.e., Bonn & Cantlon in Cognitive Neuropsychology, 29(1/2), 149-173, 2012; Cantlon, Platt, & Brannon in Trends in Cognitive Sciences, 13(2), 83-91, 2009; Meck & Church in Animal Behavior Processes, 9(3), 320, 1983; Walsh in Trends in Cognitive Sciences, 7(11), 483-488, 2003). Despite numerous similarities in representations of time, space, and number, an increasing body of literature reveals striking dissociations in how each quantity is processed, particularly later in development. These findings have led many researchers to consider the possibility that separate systems may be responsible for processing each quantity. This review will analyze evidence in favor of a common magnitude system, particularly in infancy, which will be tempered by counter evidence, the majority of which comes from experiments with children and adult participants. After reviewing the current data, we argue that although the common magnitude system may account for quantity representations in infancy, the data do not provide support for this system throughout the life span. We also identify future directions for the field and discuss the likelihood of the developmental divergence model of quantity representation, like that of Newcombe (Ecological Psychology, 2, 147-157, 2014), as a more plausible account of quantity development.

Temporal Cognition Can Affect Spatial Cognition More Than Vice Versa: The Effect of Task-Related Stimulus Saliency

Cognition of space and time affect each other; a line with longer length appears to be longer in exposure duration (space on time), and a line with longer exposure duration appears to be longer in length (time on space). This cognitive interaction is known to be asymmetric; the effect of space on time is larger than that of time on space. We conjectured that this asymmetry is not intrinsic but may depend on the saliency of relevant signals. Participants were asked to judge the visual exposure duration of lines that varied in length or the lengths of the lines with different exposure times. The ranges of task-relevant and -irrelevant stimulus values were the same in the spatial and temporal tasks. Task difficulty was also evaluated by subjective rating. We found that duration affected the judgment of length more than vice versa, when the spatial task was significantly more difficult than the temporal task. Together with our previous results that showed the opposite effect, our conjecture is supported that the saliency of stimuli should affect the balance of interactions.

Interrelations Between Temporal and Spatial Cognition: The Role of Modality-Specific Processing

Temporal and spatial representations are not independent of each other. Two conflicting theories provide alternative hypotheses concerning the specific interrelations between temporal and spatial representations. The asymmetry hypothesis (based on the conceptual metaphor theory, Lakoff and Johnson, 1980) predicts that temporal and spatial representations are asymmetrically interrelated such that spatial representations have a stronger impact on temporal representations than vice versa. In contrast, the symmetry hypothesis (based on a theory of magnitude, Walsh, 2003) predicts that temporal and spatial representations are symmetrically interrelated. Both theoretical approaches have received empirical support. From an embodied cognition perspective, we argue that taking sensorimotor processes into account may be a promising steppingstone to explain the contradictory findings. Notably, different modalities are differently sensitive to the processing of time and space. For instance, auditory information processing is more sensitive to temporal than spatial information, whereas visual information processing is more sensitive to spatial than temporal information. Consequently, we hypothesized that different sensorimotor tasks addressing different modalities may account for the contradictory findings. To test this, we critically reviewed relevant literature to examine which modalities were addressed in time-space mapping studies. Results indicate that the majority of the studies supporting the asymmetry hypothesis applied visual tasks for both temporal and spatial representations. Studies supporting the symmetry hypothesis applied mainly auditory tasks for the temporal domain, but visual tasks for the spatial domain. We conclude that the use of different tasks addressing different modalities may be the primary reason for (a)symmetric effects of space on time, instead of a genuine (a)symmetric mapping.

On the interplay of visuospatial and audiotemporal dominance: Evidence from a multimodal kappa effect

When participants judge multimodal audiovisual stimuli, the auditory information strongly dominates temporal judgments, whereas the visual information dominates spatial judgments. However, temporal judgments are not independent of spatial features. For example, in the kappa effect, the time interval between two marker stimuli appears longer when they originate from spatially distant sources rather than from the same source. We investigated the kappa effect for auditory markers presented with accompanying irrelevant visual stimuli. The spatial sources of the markers were varied such that they were either congruent or incongruent across modalities. In two experiments, we demonstrated that the spatial layout of the visual stimuli affected perceived auditory interval duration. This effect occurred although the visual stimuli were designated to be task-irrelevant for the duration reproduction task in Experiment 1, and even when the visual stimuli did not contain sufficient temporal information to perform a two-interval comparison task in Experiment 2. We conclude that the visual and auditory marker stimuli were integrated into a combined multisensory percept containing temporal as well as task-irrelevant spatial aspects of the stimulation. Through this multisensory integration process, visuospatial information affected even temporal judgments, which are typically dominated by the auditory modality.

Evidence for different processes involved in the effects of nontemporal stimulus size and numerical digit value on duration judgments

Perceived duration has been shown to be positively related to task-irrelevant, nontemporal stimulus magnitude. To account for this finding, Walsh's (2003) A Theory of Magnitude (ATOM) model suggests that magnitude of time is not differentiated from magnitude of other nontemporal stimulus characteristics and collectively processed by a generalized magnitude system. In Experiment 1, we investigated the combined effects of stimulus size and numerical quantity, as two nontemporal stimulus dimensions covered by the ATOM model, on duration judgments. Participants were required to reproduce the duration of target intervals marked by Arabic digits varying in physical size and numerical value. While the effect of stimulus size was effectively moderated by target duration, the effect of numerical value appeared to require attentional resources directed to the numerical value in order to become effective. Experiment 2 was designed to further elucidate the mediating influence of attention on the effect of numerical value on duration judgments. An effect of numerical value was only observed when participants' attention was directed to digit value, but not when participants were required to pay special attention to digit parity. While the ATOM model implies a common metrics and generalized magnitude processing for time, size, and quantity, the present findings provided converging evidence for the notion of two qualitatively different mechanisms underlying the effects of nontemporal stimulus size and numerical value on duration judgments. Furthermore, our data challenge the implicit common assumption that the effect of numerical value on duration judgments represents a continuously increasing function of digit magnitude.

Linguistic asymmetry, egocentric anchoring, and sensory modality as factors for the observed association between time and space perception

Temporal and spatial representations have been consistently shown to be inextricably intertwined. However, the exact nature of time-space mapping remains unknown. On the one hand, the conceptual metaphor theory postulates unilateral, asymmetric mapping of time onto space, that is, time is perceived in spatial terms but the perception of space is relatively independent of time. On the other hand, a theory of magnitude assumes bilateral and symmetric interactions between temporal and spatial perceptions. In the present paper, we argue that the concepts of linguistic asymmetry, egocentric anchoring, and sensory modality provide potential explanations for why evidences favoring both asymmetry and symmetry have been obtained. We first examine the asymmetry model and suggest that language plays a critical role in it. Next, we discuss the symmetry model in relation to egocentric anchoring and sensory modality. We conclude that since these three factors may jointly account for some conflicting past results regarding the strength and directionality of time-space mapping, they should be taken into serious consideration in future test designs.

A Bayesian Perspective on Accumulation in the Magnitude System

Several theoretical and empirical work posit the existence of a common magnitude system in the brain. Such a proposal implies that manipulating stimuli in one magnitude dimension (e.g. duration in time) should interfere with the subjective estimation of another magnitude dimension (e.g. size in space). Here, we asked whether a generalized Bayesian magnitude estimation system would sample sensory evidence using a common, amodal prior. Two psychophysical experiments separately tested participants on their perception of duration, surface, and numerosity when the non-target magnitude dimensions and the rate of sensory evidence accumulation were manipulated. First, we found that duration estimation was resilient to changes in surface and numerosity, whereas lengthening (shortening) the duration yielded under- (over-) estimations of surface and numerosity. Second, the perception of surface and numerosity were affected by changes in the rate of sensory evidence accumulation, whereas duration was not. Our results suggest that a generalized magnitude system based on Bayesian computations would minimally necessitate multiple priors.

Remember Hard But Think Softly: Metaphorical Effects of Hardness/Softness on Cognitive Functions

Previous studies have found that bodily stimulation, such as hardness biases social judgment and evaluation via metaphorical association; however, it remains unclear whether bodily stimulation also affects cognitive functions, such as memory and creativity. The current study used metaphorical associations between “hard” and “rigid” and between “soft” and “flexible” in Chinese, to investigate whether the experience of hardness affects cognitive functions whose performance depends prospectively on rigidity (memory) and flexibility (creativity). In Experiment 1, we found that Chinese-speaking participants performed better at recalling previously memorized words while sitting on a hard-surface stool (the hard condition) than a cushioned one (the soft condition). In Experiment 2, participants sitting on a cushioned stool outperformed those sitting on a hard-surface stool on a Chinese riddle task, which required creative/flexible thinking, but not on an analogical reasoning task, which required both rigid and flexible thinking. The results suggest the hardness experience affects cognitive functions that are metaphorically associated with rigidity or flexibility. They support the embodiment proposition that cognitive functions and representations can be grounded in bodily states via metaphorical associations.

On magnitudes in memory: An internal clock account of space-time interaction

Traditionally, research on time perception has diverged into a representational approach that focuses on the interaction between time and non-temporal magnitude information like spatial distance, and a mechanistic approach that emphasizes the workings and timecourse of components within an internal clock. We combined these approaches in order to identify the locus of space-time interaction effects in the mechanistic framework of the internal clock model. In three experiments, we contrasted the effects of spatial distance (a long- vs. short-distance line) on time perception with those of visual flicker (a flickering vs. static stimulus) in a duration reproduction paradigm. We found that both a flickering stimulus and a long-distance line lengthened reproduced time when presented during time encoding. However, when presented during time reproduction, a flickering stimulus shortened reproduced time but a long-distance line had no effect. The results thus show that, while visual flickers affects duration accumulation itself, spatial distance instead biases the memory of the accumulated duration. These findings are consistent with a clock-magnitude account of space-time interaction whereby both temporal duration and spatial distance are represented as mental magnitudes that can interfere with each other while being kept in memory, and places the locus of interaction between temporal and non-temporal magnitude dimensions at the memory maintenance stage of the internal clock model.

What makes space-time interactions in human vision asymmetrical?

The interaction of space and time affects perception of extents: (1) the longer the exposure duration, the longer the line length is perceived and vice versa; (2) the shorter the line length is, the shorter the exposure duration is perceived. Previous studies have shown that space-time interactions in human vision are asymmetrical; spatial cognition has a larger effect on temporal cognition rather than vice versa (Merritt et al., 2010). What makes the interactions asymmetrical? In this study, participants were asked to judge exposure duration of lines that differed in length or to judge the lengths of the lines with different exposure time; to judge the task-relevant stimulus extents that also varied in the task-irrelevant stimulus extents. Paired spatial and temporal tasks in which the ranges of task-relevant and -irrelevant stimulus values were common, were conducted. In our hypothesis, the imbalance in saliency of spatial and temporal information would cause asymmetrical space-time interaction. To assess the saliency, task difficulty was rated. If saliency of relevant stimuli is high, the difficulty of discrimination task would be low, and vice versa. The saliency of irrelevant stimuli in one task would be reflected in the difficulty of the other task, in the pair of tasks. If saliency of irrelevant stimuli is high, the difficulty of paired task would be low, and vice versa. The result supports our hypothesis; spatial cognition asymmetrically affected on temporal cognition when the difficulty of temporal task was significantly higher than that of spatial task.