Eye movements during mental time travel follow a diagonal line

Writing direction influences the spatial representations of past- and future-tense forms: Evidence from eye tracking

The present study tests the hypothesis that the directionality of reading habits (left-to-right or right-to-left) impacts individuals' representation of nonspatial events. Using the blank screen paradigm, we examine whether eye movements reflect culture-specific spatial biases in processing temporal information, specifically, grammatical tense in Russian and Hebrew. Sixty-two native speakers of Russian (a language with a left-to-right reading and writing system) and 62 native speakers of Hebrew (a language with a right-to-left reading and writing system) listened to verbs in the past or future tense while their spontaneous gaze positions were recorded. Following the verb, a visual spatial probe appeared in one of the five locations of the screen, and participants responded manually to indicate its position. While participants' response latencies to the spatial probe revealed no significant effects, their gaze positions along the horizontal axis for past- and future-tensed verbs aligned with the reading and writing direction in their language. These results provide novel evidence that eye movements during auditory processing of grammatical tense are influenced by culturally specific reading and writing conventions, shifting leftward or rightward on the horizontal plane depending on the stimuli's time reference (past or future) and the participants' language (Russian or Hebrew). This spatial bias indicates a common underlying cognitive mechanism that uses spatial dimensions to represent temporal constructs.

Conscious but not thinking-Mind-blanks during visuomotor tracking: An fMRI study of endogenous attention lapses

Attention lapses (ALs) are complete lapses of responsiveness in which performance is briefly but completely disrupted and during which, as opposed to microsleeps, the eyes remain open. Although the phenomenon of ALs has been investigated by behavioural and physiological means, the underlying cause of an AL has largely remained elusive. This study aimed to investigate the underlying physiological substrates of behaviourally identified endogenous ALs during a continuous visuomotor task, primarily to answer the question: Were the ALs during this task due to extreme mind-wandering or mind-blanks? The data from two studies were combined, resulting in data from 40 healthy non-sleep-deprived subjects (20M/20F; mean age 27.1 years, 20-45). Only 17 of the 40 subjects were used in the analysis due to a need for a minimum of two ALs per subject. Subjects performed a random 2-D continuous visuomotor tracking task for 50 and 20 min in Studies 1 and 2, respectively. Tracking performance, eye-video, and functional magnetic resonance imaging (fMRI) were recorded simultaneously. A human expert visually inspected the tracking performance and eye-video recordings to identify and categorise lapses of responsiveness as microsleeps or ALs. Changes in neural activity during 85 ALs (17 subjects) relative to responsive tracking were estimated by whole-brain voxel-wise fMRI and by haemodynamic response (HR) analysis in regions of interest (ROIs) from seven key networks to reveal the neural signature of ALs. Changes in functional connectivity (FC) within and between the key ROIs were also estimated. Networks explored were the default mode network, dorsal attention network, frontoparietal network, sensorimotor network, salience network, visual network, and working memory network. Voxel-wise analysis revealed a significant increase in blood-oxygen-level-dependent activity in the overlapping dorsal anterior cingulate cortex and supplementary motor area region but no significant decreases in activity; the increased activity is considered to represent a recovery-of-responsiveness process following an AL. This increased activity was also seen in the HR of the corresponding ROI. Importantly, HR analysis revealed no trend of increased activity in the posterior cingulate of the default mode network, which has been repeatedly demonstrated to be a strong biomarker of mind-wandering. FC analysis showed decoupling of external attention, which supports the involuntary nature of ALs, in addition to the neural recovery processes. Other findings were a decrease in HR in the frontoparietal network before the onset of ALs, and a decrease in FC between default mode network and working memory network. These findings converge to our conclusion that the ALs observed during our task were involuntary mind-blanks. This is further supported behaviourally by the short duration of the ALs (mean 1.7 s), which is considered too brief to be instances of extreme mind-wandering. This is the first study to demonstrate that at least the majority of complete losses of responsiveness on a continuous visuomotor task are, if not due to microsleeps, due to involuntary mind-blanks.

Space-time mapping relationships in sensorimotor communication during asymmetric joint action

Background

Sensorimotor communication is frequently observed in complex joint actions and social interactions. However, it remains challenging to explore the cognitive foundations behind sensorimotor communication.

Methods

The present study extends previous research by introducing a single-person baseline condition and formulates two distinct categories of asymmetric joint action tasks: distance tasks and orientation tasks. This research investigates the action performance of 65 participants under various experimental conditions utilizing a 2 (cooperative intention: Coop, No-coop) × 2 (task characteristic: distance, orientation) × 4 (target: T1, T2, T3, T4) repeated-measures experimental design to investigate the cognitive mechanisms underlying sensorimotor communication between individuals.

Results

The results showed that (1) target key dwell time, motion time, total motion time, and maximum motion height in the Coop condition are more than in the No-coop condition. (2) In the distance task without cooperative intention, the dwell time of T4 is smaller than T1, T2, T3, and its variability of T1, T2, T3, and T4 were no different. In the distance task with cooperative intention, the dwell time and its variability of T1, T2, T3, and T4 displayed an increasing trend. (3) In the orientation task without cooperative intention, the dwell time of T1 is smaller than T2, T3, T4, and variability of the target keys T1, T2, T3, and T4 had no difference. In the orientation task with cooperative intention, the dwell time and variability of the target keys T1, T2, T3, and T4 had increasing trends.

Conclusions

Those findings underscore the importance of cooperative intention for sensorimotor communication. In the distance task with cooperative intention, message senders establish a mapping relationship characterized by "near-small, far-large" between the task distance and the individual's action characteristics through sensorimotor experience. In the orientation task with cooperative intention, message senders combined sensorimotor experience and verbal metaphors to establish a mapping relationship between task orientation and action characteristics, following the sequence of "left-up, right-up, left-down, right-down" to transmit the message to others.

Journeying to the past: time travel and mental time travel, how far apart?

Spatial models dominated memory research throughout much of the twentieth century, but in recent decades, the concept of memory as a form of mental time travel (MTT) to the past has gained prominence. Initially introduced as a metaphor, the MTT perspective shifted the focus from internal memory processes to the subjective conscious experience of remembering. Despite its significant impact on empirical and theoretical memory research, there has been limited discussion regarding the meaning and adequacy of the MTT metaphor in accounting for memory. While in previous work I have addressed the general limitations of the MTT metaphor in explaining memory, the objective of this article is more focused and modest: to gain a better understanding of what constitutes MTT to the past. To achieve this objective, a detailed analysis of the characteristics of MTT to the past is presented through a comparison with time travel (TT) to the past. Although acknowledging that TT does not refer to an existing physical phenomenon, it is an older concept extensively discussed in the philosophical literature and provides commonly accepted grounds, particularly within orthodox theories of time, that can offer insights into the nature of MTT. Six specific characteristics serve as points of comparison: (1) a destination distinct from the present, (2) the distinction between subjective time and objective time, (3) the subjective experience of the time traveler, (4) their differentiation from the past self, (5) the existence of the past, and (6) its unchangeability. Through this research, a detailed exploration of the phenomenal and metaphysical aspects of MTT to the past is undertaken, shedding light on the distinct features that mental time travel to the past acquires when it occurs within the realm of the mind rather than as a physical phenomenon. By examining these characteristics, a deeper understanding of the nature of mental time travel is achieved, offering insights into how it operates in relation to memory and the past.

Joint spatial-temporal association of response codes (STEARC) effect: Mental timelines embodied interpersonally

A co-action task was used to explore the effect of social interactions on temporal judgements, in comparison with an individual-task condition. In Experiment 1, the co-actors sat either individually (individual condition) or alongside a partner (joint condition) in front of a monitor and then responded to time-related words (e.g. yesterday, tomorrow). In Experiment 2, co-actors sat separately in front of two monitors and categorized the words either individually or jointly. Participants' response times to past- and future-related words in the individual conditions of both experiments had no significant difference. However, in the joint conditions, the responses were faster when the past-time words were mapped toward the participants on the left than when future-time words were mapped toward them. Our data support the existence of a specific mapping between past-time-left space and future-time-right space. This suggests that the two cooperators probably shared a similar mental timeline.

The combination of the horizontal and vertical dimensions in mental time representation: the existence of a spatial mental map of time

Horizontal and vertical representations of time (past-left or down and future-right or top) have been demonstrated. However, only a few studies have investigated the existence of a spatial map of time, considering it as the interaction of different spatial dimensions in space. The aim of this study was to investigate the existence of a mental time representation along the diagonal axes, intended as the combination of the horizontal and the vertical dimensions. Seventy-nine Italian participants (85% females; mean age = 25.11 ± 4.86 years; 77 right-handed) performed an online temporal judgment task using 20 Italian temporal expressions presented either always in the center (Experiment 1) or in the four corners of the screen (Experiment 2) and two pairs of response keys ("C" and "U" for the positive diagonal; "R" and "N" for the negative diagonal). Results showed spatial-temporal associations in positive (i.e., time was represented from left-bottom to right-top) and negative (i.e., time was represented from left-top to right-bottom) diagonals, although in Experiment 2 these associations were weak for the negative diagonal. These spatial-temporal associations along both diagonals were confirmed even when participants were free to place different temporal stimuli along a diagonally drawn line, in a Time-to-Position task, indicating that the temporal expressions could be ordered linearly along the diagonal spaces. Finally, these data indicated that the horizontal information was mainly used for determining the spatial-temporal associations along both diagonals, whereas the vertical information was flexible with a bottom-to-top (for positive diagonal) and top-to-bottom (for negative diagonal) temporal representation.

When time stands upright: STEARC effects along the vertical axis

According to the spatial-temporal association of response codes (STEARC) effect, time can be spatially represented from left to right. However, exploration of a possible STEARC effect along the vertical axis has yielded mixed results. Here, in six experiments based on a novel paradigm, we systematically explored whether a STEARC effect could emerge when participants were asked to classify the actual temporal duration of a visual stimulus. Speeded manual responses were provided using a vertically oriented response box. Interestingly, although a top-to-bottom time representation emerged when only two temporal durations were employed, an inverted bottom-to-top time representation emerged when a denser set of temporal durations, arranged along a continuum, was used. Moreover, no STEARC effects emerged when participants classified the shapes of visual stimuli rather than their temporal duration. Finally, three additional experiments explored the STEARC effect along the horizontal axis, confirming that the paradigm we devised successfully replicated the standard left-to-right representation of time. These results provide supporting evidence for the notion that temporal durations can be mapped along the vertical axis, and that such mapping appears to be relatively flexible.

Representations of Diagonal Timelines in English and Mandarin Speakers

Abstract. Background: Much experimental work has established that the passage of time is represented along a horizontal or a vertical mental timeline (MTL). Recent research ( Hartmann et al., 2014 ) discovered an additional diagonal MTL that develops from bottom left to top right. This study sought to extend Hartmann et al.’s (2014) work by exploring if the particular representations of diagonal timelines vary across linguistic communities. Methods: We conducted an experiment that recruited English and Mandarin speakers as participants. The experimental setups measured the participants’ space-time mappings along the bottom-left/top-right, top-left/bottom-right, bottom-right/top-left, and top-right/bottom-left axes. Results: There are cross-linguistic/cultural differences in the mental representations of diagonal timelines. While the English speakers displayed a salient propensity to conceive of time as oriented from bottom left to top right, the Mandarin speakers favored a timeline unfolding from top left to bottom right. Discussion: We assume that cultural artifacts such as writing direction may play an important role in affecting the horizontal dimension of people’s MTLs. The current findings refine the existing literature and demonstrate that distinct types of linguistic metaphors may respectively explain the vertical dimension of the MTLs for speakers of different native languages.

Space-Time Congruency Effects Using Eye Movements During Processing of Past- and Future-Related Words

In Western cultures where people read and write from left to right, time is represented along a spatial continuum that goes from left to right (past to future), known as the mental timeline (MTL). In language, this MTL was supported by space-time congruency effects: People are faster to make lexical decisions to words conveying past or future information when left/right manual responses are compatible with the MTL. Alternatively, in cultures where people read from right to left, space-time congruency effects go in the opposite direction. Such cross-cultural differences suggest that repeated writing and reading dynamic movements are critically involved in the spatial representation of time. In most experiments on the space-time congruency effect, participants use their hand for responding, an effector that is associated to the directionality of writing. To investigate the role of the directionality of reading in the space-time congruency effect, we asked participants to make lateralized eye movements (left or right saccades) to indicate whether stimuli were real words or not (lexical decision). Eye movement responses were slower and higher in amplitude for responses incompatible with the direction of the MTL. These results reinforce the claim that repeated directional reading and writing movements promote the embodiment of time-related words.

The Variability of Mental Timeline in Vertical Dimension

People often use concrete spatial terms to represent abstract time. Previous studies have shown that mental timeline (MTL) is represented along a horizontal axis. Studies of the mental timeline have demonstrated that compared with English speakers, Mandarin speakers are more likely to think about time vertically (up-down) than horizontally (left-right/front-back). Prior studies have suggested that MTL in the up and down dimensions originated from temporal-spatial metaphors in language. However, there are still a large number of perceptual experiences in the up and down dimensions, such as visual and sensorimotor experience. Then does the visual experience in daily life affect the MTL in the vertical dimension? This study is aimed to investigate whether visual experience can promote or activate the opposite direction of MTL from implicit and explicit levels. The results showed that when the time information in the task was not prominent, the direction of vertical MTL cannot be affected by ascending or descending perceptual experience. While when the time information was prominent, whether the task was implicit or explicit, compared with the control group, watching the top-down scene significantly increased the top-down direction selection, while in the implicit task, watching the bottom-up scene made the top-down MTL disappear. To the best of our knowledge, our study provides the first evidence that the flexibility of space–time associations in vertical dimension extends beyond explicit and embraces even implicit levels. This study shows that the vertical MTL is activated in certain conditions and could be affected by the visual experience.

The vertical space-time association

The space-time interaction suggests a left-to-right directionality in the mind's representation of elapsing time. However, studies showing a possible vertical time representation are scarce and contradictory. In Experiment 1, 32 participants had to judge the duration (200, 300, 500, or 600 ms) of the target stimulus that appeared at the top, centre, or bottom of the screen, compared with a reference stimulus (400 ms) that always appeared in the centre of the screen. In Experiment 2, 32 participants were administered the same procedure, but the reference stimulus appeared at the top, centre, or bottom of the screen and the target stimulus was fixed in the centre location. In both experiments, a space-time interaction was found with an association between short durations and bottom response key as well as between long durations and top key. The evidence of a vertical mental timeline was further confirmed by the distance effect with a lower level of performance for durations close to that of the reference stimulus. The results suggest a bottom-to-top mapping of time representation, more in line with the metaphor "more is up."

Early is left and up: Saccadic responses reveal horizontal and vertical spatial associations of serial order in working memory

Maintaining serial order in working memory is crucial for cognition. Recent theories propose that serial information is achieved by positional coding of items on a spatial frame of reference. In line with this, an early-left and late-right spatial-positional association of response code (SPoARC) effect has been established. Various theoretical accounts have been put forward to explain the SPoARC effect (the mental whiteboard hypothesis, conceptual metaphor theory, polarity correspondence, or the indirect spatial-numerical association effect). Crucially, while all these accounts predict a left-to-right orientation of the SPoARC effect, they make different predictions regarding the direction of a possible vertical SPoARC effect. In this study, we therefore investigated SPoARC effects along the horizontal and vertical spatial dimension by means of saccadic responses. We replicated the left-to-right horizontal SPoARC effect and established for the first time an up-to-down vertical SPoARC effect. The direction of the vertical SPoARC effect was in contrast to that predicted by metaphor theory, polarity correspondence, or by the indirect spatial-numerical association effect. Rather, our results support the mental whiteboard-hypothesis, according to which positions can be flexibly coded on an internal space depending on the task demands. We also found that the strengths of the horizontal and vertical SPoARC effects were correlated, showing that some people are more prone than others to use spatial references for position coding. Our results therefore suggest that context templates used for position marking are not necessarily spatial in nature but depend on individual strategy preferences.

Processing of an ambiguous time phrase in posttraumatic stress disorder: Eye movements suggest a passive, oncoming perception of the future

Metaphorically, the future can be perceived as approaching us (time-moving metaphor) or as being approached by us (ego-moving metaphor). Also, in line with findings that our eyes look more up when thinking about the future than the past, the future's location can be conceptualized in upwards terms. Eye movements were recorded in 19 participants with PTSD and 20 healthy controls. Participants with PTSD showed downward and healthy controls upward eye movements while processing an ego/time-moving ambiguous phrase, suggesting a passive (time-moving) outlook toward the future. If replicated, our findings may have implications for the conceptualization and treatment of PTSD.

Emotional SNARC: emotional faces affect the impact of number magnitude on gaze patterns

The Spatial-Numerical Association of Response Codes (SNARC) effect is characterised by a spatial cognitive representation of low numbers to the left side of space and high numbers to the right side of space. This effect has been found using a diversity of stimuli and experimental paradigms. However, the influence of emotional stimuli on this effect remains unclear. In this study, the SNARC effect is analysed in relation to pairs of emotional facial stimuli (happy-neutral, sad-neutral and happy-sad pairs). Gaze patterns of 151 participants were analysed when exposed to a free-viewing eye-tracking paradigm consisting of pairs of emotional faces preceded by small and large numbers. Replicating previous results, a standard SNARC effect was found independently of the emotional expressions of the faces (i.e., there was a significant linear trend of number magnitude in the frequency of first fixations of the gaze to the left side space). However, specific slope analyses revealed that the SNARC effect was influenced by the spatial position of each emotion presented in the emotional pairs. Specifically, the effect disappeared in happy-neutral trials, when the happy faces were allocated in the right position and also in happy-sad trials when two emotional stimuli were simultaneously displayed. The study revealed that the SNARC effect is sensitive to the spatial position of emotional stimuli which further adds to other known limits of the phenomenon. The limitations of the study and its implications in the area of cognition and emotion are also discussed.

Where Are the Months? Mental Images of Circular Time in a Large Online Sample

People may think about time by mentally imaging it in some spatial form, or as "spacetime." In an online survey, 76,922 Norwegian individuals positioned two dots corresponding to the months of December and March on what they imagined to be their appropriate places on a circle. The majority of respondents placed December within a section of the circumference ranging from 11:00 to 12:00 o'clock, but a group of respondents chose positions around the diametrically opposite 6:00 o'clock position. A similar relationship occurred for March, where most respondents chose a position ranging from 2:30 to 3:00 o'clock but a group of respondents chose positions around 9:00 o'clock. About half of the respondents (N = 39,797) continued to fill out an online questionnaire probing their mental images related to the "year" concept. This clarified that 75% of respondents "saw" the months unfolding in a clockwise direction versus 19% in a counter clockwise fashion. Moreover, while a majority (70%) stated that they imagined the year as a "circle," the rest indicated the use of other mental images (e.g., ellipses and spirals, lines and squares, idiosyncratic or synesthetic spatial forms). We found only weak effects or preferences for spatial forms based on respondents' gender, handedness, age, or geographical location.

A standard conceptual framework for the study of subjective time

Research on the mental representation of time ('subjective time') has provided broad insights into the nature of time perception and temporal processing. As the field comprises different scientific disciplines, such as psychology, philosophy, and neuroscience, studies differ with regard to the basic terms and concepts used. For this reason, research on subjective time lacks a coherent conceptual system. We argue that research in the field of subjective time should aim at establishing such a system, i.e., a more standardized terminology, in order to strengthen its theoretical basis and to support an efficient communication of results. Based on key empirical findings and concepts that are commonly (but inconsistently) used in the literature, we argue for a conceptual framework for the study of subjective time that differentiates between three types of mental representations of time: basic temporal processing, time perception in terms of passage, and time perception in terms of duration.

“Next Wednesday’s Meeting has been Moved Forward Two Days”

Abstract. If time is conceived of as a river, we either have the perspective of seeing ourselves as moving downstream toward the future (e.g., “We are approaching the future,” called ego moving), or we have the perspective of the future as moving upstream toward us (e.g., “The future is approaching,” called time moving). Most ego- and time-moving studies have been conducted by using an English ego/time-moving ambiguous question to implicitly measure a person’s current time perspective (ego vs. time moving). In the current study, we replicate previous findings that in (Standard) German the time-perspective question is not ambiguous, while showing as a new finding that it is ambiguous in Swiss German. We attribute this difference to different normative uses in these two German variants. To our knowledge, this study is the first to investigate dialectal differences in relation to cognitive processing of ego-/time-moving metaphors. Psychological and linguistic implications are discussed.

Spontaneous eye movements during focused-attention mindfulness meditation

Oculometric measures have been proven to be useful markers of mind-wandering during visual tasks such as reading. However, little is known about ocular activity during mindfulness meditation, a mental practice naturally involving mind-wandering episodes. In order to explore this issue, we extracted closed-eyes ocular movement measurements via a covert technique (EEG recordings) from expert meditators during two repetitions of a 7-minute mindfulness meditation session, focusing on the breath, and two repetitions of a 7-minute instructed mind-wandering task. Power spectral density was estimated on both the vertical and horizontal components of eye movements. The results show a significantly smaller average amplitude of eye movements in the delta band (1–4 Hz) during mindfulness meditation than instructed mind-wandering. Moreover, participants’ meditation expertise correlated significantly with this average amplitude during both tasks, with more experienced meditators generally moving their eyes less than less experienced meditators. These findings suggest the potential use of this measure to detect mind-wandering episodes during mindfulness meditation and to assess meditation performance.

Do Writing Directions Influence How People Map Space onto Time?

Abstract. The causal role of a unidirectional orthography in shaping speakers’ mental representations of time seems to be well established by many psychological experiments. However, the question of whether bidirectional writing systems in some languages can also produce such an impact on temporal cognition remains unresolved. To address this issue, the present study focused on Japanese and Taiwanese, both of which have a similar mix of texts written horizontally from left to right (HLR) and vertically from top to bottom (VTB). Two experiments were performed which recruited Japanese and Taiwanese speakers as participants. Experiment 1 used an explicit temporal arrangement design, and Experiment 2 measured implicit space-time associations in participants along the horizontal (left/right) and the vertical (up/down) axis. Converging evidence gathered from the two experiments demonstrate that neither Japanese speakers nor Taiwanese speakers aligned their vertical representations of time with the VTB writing orientation. Along the horizontal axis, only Japanese speakers encoded elapsing time into a left-to-right linear layout, which was commensurate with the HLR writing direction. Therefore, two distinct writing orientations of a language could not bring about two coexisting mental time lines. Possible theoretical implications underlying the findings are discussed.

Space-time interaction: visuo-spatial processing affects the temporal focus of mind wandering

Our understanding of mind wandering (MW) has dramatically increased over the past decade. Studies have shown that in the vast majority of cases, MW is directed to times other than the present, and a bias toward the future has been reported (prospective bias). The processing of time is not independent of the processing of space: humans represent time along a spatial continuum, on a "mental time line" (MTL). In cultures with a left to right reading/writing system, the MTL expands from left to right. Capitalizing on these findings, here we aimed at investigating the effects of visuo-spatial processing on the temporal orientation of spontaneous MW, and specifically we asked whether we could steer the temporal focus of MW towards the past or the future, by experimentally inducing a leftward and a rightward orienting of attention, respectively. To this aim, we experimentally manipulated the spatial orientation demands associated with the focal task in two independent groups, with a leftward orienting of attention (left-pointing arrows, LA group) and a rightward orienting of attention (right-pointing arrows, RA group). We found that the temporal orientation of MW critically depended on the spatial orientation demands of the task: specifically, the proportion of spontaneous past-oriented MW episodes was higher under the induction of a leftward orienting attention (LA group) than under the induction of a rightward orienting attention (RA group). The opposite pattern was found for spontaneous future-oriented MW episodes. Possible mechanisms involved in this effect and their implications for research on MW and spontaneous cognition are discussed.

Systematic spatial patterns of the sense of familiarity: Hierarchical modelling based on eye-tracking experiments

Using different types of stimuli, such as pictures, horizontally written Japanese words, and vertically written Japanese words, this study investigated the spatial patterns of the sense of familiarity within the visual field. The perceptual asymmetry theory predicted that stimuli in the lower visual field would be processed more fluently and would therefore be perceived as more familiar. The working memory theory, originally proposed in space-number research, envisaged type-specific spatial patterns for different stimuli. Participants made old/new recognition memory judgements for stimuli, presented at random positions, while their eye movements were recorded. The observed spatial patterns changed according to the stimulus type (e.g., "more left = older" for horizontally written words and "upper = older" for vertically written words), and this flexibility is encapsulated by the working memory theory as follows: (a) stimulus-type-specific spatial configurations are encoded in long-term memory on the basis of one's experience (e.g., vertically written words are empirically associated with the "upper = older" spatial configuration), (b) the presentation of a stimulus automatically cues the temporal activation of the associated spatial configuration in working memory, and (c) the referential process between the stimulus and configuration unconsciously affects the viewer's sense of familiarity.

Does movement influence representations of time and space?

Embodied cognition posits that abstract conceptual knowledge such as mental representations of time and space are at least partially grounded in sensorimotor experiences. If true, then the execution of whole-body movements should result in modulations of temporal and spatial reference frames. To scrutinize this hypothesis, in two experiments participants either walked forward, backward or stood on a treadmill and responded either to an ambiguous temporal question (Experiment 1) or an ambiguous spatial question (Experiment 2) at the end of the walking manipulation. Results confirmed the ambiguousness of the questions in the control condition. Nevertheless, despite large power, walking forward or backward did not influence the answers or response times to the temporal (Experiment 1) or spatial (Experiment 2) question. A follow-up Experiment 3 indicated that this is also true for walking actively (or passively) in free space (as opposed to a treadmill). We explore possible reasons for the null-finding as concerns the modulation of temporal and spatial reference frames by movements and we critically discuss the methodological and theoretical implications.

Non-musicians also have a piano in the head: evidence for spatial-musical associations from line bisection tracking

The spatial representation of ordinal sequences (numbers, time, tones) seems to be a fundamental cognitive property. While an automatic association between horizontal space and pitch height (left-low pitch, right-high pitch) is constantly reported in musicians, the evidence for such an association in non-musicians is mixed. In this study, 20 non-musicians performed a line bisection task while listening to irrelevant high- and low-pitched tones and white noise (control condition). While pitch height had no influence on the final bisection point, participants' movement trajectories showed systematic biases: When approaching the line and touching the line for the first time (initial bisection point), the mouse cursor was directed more rightward for high-pitched tones compared to low-pitched tones and noise. These results show that non-musicians also have a subtle but nevertheless automatic association between pitch height and the horizontal space. This suggests that spatial-musical associations do not necessarily depend on constant sensorimotor experiences (as it is the case for musicians) but rather reflect the seemingly inescapable tendency to represent ordinal information on a horizontal line.

How Long Did You Look At Me? The Influence of Gaze Direction on Perceived Duration and Temporal Sensitivity

Faces that exhibit emotionally negative expressions in mutual gaze have been shown to induce a dilation of perceived duration. The influence of gaze by itself on duration judgments, however, has rarely been investigated. We argue for a social interaction hypothesis, according to which humans should be highly accurate and precise (sensitive) when processing the temporal dynamics of mutual gaze. In three experiments, we investigated whether the direction of observed gaze affects perceived duration and temporal sensitivity. In Experiment 1, subjects did indeed estimate the duration of direct gaze more accurately as compared to the duration of averted gaze. In Experiments 2 and 3, subjects had to categorize direct and averted gaze stimuli as being short or long in duration (temporal bisection). Experiment 2 found temporal sensitivity (but not mean duration judgments) to be improved in cases of mutual gaze. In Experiment 3, the effect of mutual gaze on prolonged subjective duration did replicate, however, it was rather small. Moreover, temporal precision was not improved in the case of naturalistic stimuli. In sum, effects of mutual gaze on duration judgments are rather weak, and cannot be attributed to arousal, as such ratings did not differ between direct and averted gaze stimuli.

Space, time, and numbers in the right posterior parietal cortex: Differences between response code associations and congruency effects

The mental representations of space, time, and number magnitude are inherently linked. The right posterior parietal cortex (PPC) has been suggested to contain a general magnitude system that underlies the overlap between various perceptual dimensions. However, comparative studies including spatial, temporal, and numerical dimensions are missing. In a unified paradigm, we compared the impact of right PPC inhibition on associations with spatial response codes (i.e., Simon, SNARC, and STARC effects) and on congruency effects between space, time, and numbers. Prolonged cortical inhibition was induced by continuous theta-burst stimulation (cTBS), a protocol for transcranial magnetic stimulation (TMS), at the right intraparietal sulcus (IPS). Our results show that congruency effects, but not response code associations, are affected by right PPC inhibition, indicating different neuronal mechanisms underlying these effects. Furthermore, the results demonstrate that interactions between space and time perception are reflected in congruency effects, but not in an association between time and spatial response codes. Taken together, these results implicate that the congruency between purely perceptual dimensions is processed in PPC areas along the IPS, while the congruency between percepts and behavioral responses is independent of this region.

Spatial biases during mental arithmetic: evidence from eye movements on a blank screen

While the influence of spatial-numerical associations in number categorization tasks has been well established, their role in mental arithmetic is less clear. It has been hypothesized that mental addition leads to rightward and upward shifts of spatial attention (along the “mental number line”), whereas subtraction leads to leftward and downward shifts. We addressed this hypothesis by analyzing spontaneous eye movements during mental arithmetic. Participants solved verbally presented arithmetic problems (e.g., 2 + 7, 8–3) aloud while looking at a blank screen. We found that eye movements reflected spatial biases in the ongoing mental operation: Gaze position shifted more upward when participants solved addition compared to subtraction problems, and the horizontal gaze position was partly determined by the magnitude of the operands. Interestingly, the difference between addition and subtraction trials was driven by the operator (plus vs. minus) but was not influenced by the computational process. Thus, our results do not support the idea of a mental movement toward the solution during arithmetic but indicate a semantic association between operation and space.