Video game experience predicts virtual, but not real navigation performance

Less spatial exploration is associated with poorer spatial memory in midlife adults

Introduction

Despite its importance for navigation, very little is known about how the normal aging process affects spatial exploration behavior. We aimed to investigate: (1) how spatial exploration behavior may be altered early in the aging process, (2) the relationship between exploration behavior and subsequent spatial memory, and (3) whether exploration behavior can classify participants according to age.

Methods

Fifty healthy young (aged 18-28) and 87 healthy midlife adults (aged 43-61) freely explored a desktop virtual maze, learning the locations of nine target objects. Various exploration behaviors (object visits, distance traveled, turns made, etc.) were measured. In the test phase, participants navigated from one target object to another without feedback, and their wayfinding success (% correct trials) was measured.

Results

In the exploration phase, midlife adults exhibited less exploration overall compared to young adults, and prioritized learning target object locations over maze layout. In the test phase, midlife adults exhibited less wayfinding success when compared to the young adults. Furthermore, following principal components analysis (PCA), regression analyses indicated that both exploration quantity and quality components were associated with wayfinding success in the midlife group, but not the young adults. Finally, we could classify participants according to age with similar accuracy using either their exploration behavior or wayfinding success scores.

Discussion

Our results aid in the understanding of how aging impacts spatial exploration, and encourages future investigations into how pathological aging may affect spatial exploration behavior.

Theta oscillations support active exploration in human spatial navigation

Active navigation seems to yield better spatial knowledge than passive navigation, but it is unclear how active decision-making influences learning and memory. Here, we examined the contributions of theta oscillations to memory-related exploration while testing theories about how they contribute to active learning. Using electroencephalography (EEG), we tested individuals on a maze-learning task in which they made discrete decisions about where to explore at each choice point in the maze. Half the participants were free to make active decisions at each choice point, and the other half passively explored by selecting a marked choice (matched to active exploration) at each intersection. Critically, all decisions were made when stationary, decoupling the active decision-making process from movement and speed factors, which is another prominent potential role for theta oscillations. Participants were then tested on their knowledge of the maze by traveling from object A to object B within the maze. Results show an advantage for active decision-making during learning and indicate that the active group had greater theta power during choice points in exploration, particularly in midfrontal channels. These findings demonstrate that active exploration is associated with theta oscillations during human spatial navigation, and that these oscillations are not exclusively related to movement or speed. Results demonstrating increased theta oscillations in prefrontal regions suggest communication with the hippocampus and integration of new information into memory. We also found evidence for alpha oscillations during active navigation, suggesting a role for attention as well. This study finds support for a general mnemonic role for theta oscillations during navigational learning.

Sex Differences and the Role of Gaming Experience in Spatial Cognition Performance in Primary School Children: An Exploratory Study

Sex differences are repeatedly observed in spatial cognition tasks. However, the role of environmental factors such as gaming experience remains unclear. In this exploratory study, navigation and object-relocation were combined in a naturalistic virtual reality-based spatial task. The sample consisted of n = 53 Dutch children aged 9–11 years. Overall, girls (n = 24) and boys (n = 29) performed equally accurately, although there was an increase in accuracy with age for boys (η_p² = 0.09). Boys navigated faster than girls (η_p² = 0.29), and this difference increased with age (η_p² = 0.07). More gaming experience in boys versus girls (Cohen’s d = 0.88) did not explain any result observed. We encourage future confirmatory studies to use the paradigm presented here to investigate the current results in a larger sample. These findings could be beneficial for optimizing spatial cognition training interventions.

Perspective taking and systematic biases in object location memory

The aim of the current study was to develop a novel task that allows for the quick assessment of spatial memory precision with minimal technical and training requirements. In this task, participants memorized the position of an object in a virtual room and then judged from a different perspective, whether the object has moved to the left or to the right. Results revealed that participants exhibited a systematic bias in their responses that we termed the reversed congruency effect. Specifically, they performed worse when the camera and the object moved in the same direction than when they moved in opposite directions. Notably, participants responded correctly in almost 100% of the incongruent trials, regardless of the distance by which the object was displaced. In Experiment 2, we showed that this effect cannot be explained by the movement of the object on the screen, but that it relates to the perspective shift and the movement of the object in the virtual world. We also showed that the presence of additional objects in the environment reduces the reversed congruency effect such that it no longer predicts performance. In Experiment 3, we showed that the reversed congruency effect is greater in older adults, suggesting that the quality of spatial memory and perspective-taking abilities are critical. Overall, our results suggest that this effect is driven by difficulties in the precise encoding of object locations in the environment and in understanding how perspective shifts affect the projected positions of the objects in the two-dimensional image.

The relationship between mental and physical space and its impact on topographical disorientation

We generate mental representations of space to facilitate our ability to remember things and navigate our environment. Many studies implicitly assume that these representations simply reflect the environments that they represent without considering other factors that influence the extent to which this is the case. Here, we bring together findings from cognitive psychology, environmental psychology, geography, urban planning, and neuroscience to discuss how internalizing the environment involves a complex interplay between bottom-up and top-down mental processes and depends on key characteristics of the physical environment itself. We describe how mental space is structured, the ways in which mental and physical space converge and diverge, and the disparate but complementary techniques used to assess these relationships. Finally, we contextualize this knowledge in the clinical populations affected by acquired and developmental topographical disorientation, exploring mechanisms that cause these patients to get lost in familiar surroundings.

Transfer of motor skill between virtual reality viewed using a head-mounted display and conventional screen environments

BACKGROUND

Virtual reality viewed using a head-mounted display (HMD-VR) has the potential to be a useful tool for motor learning and rehabilitation. However, when developing tools for these purposes, it is important to design applications that will effectively transfer to the real world. Therefore, it is essential to understand whether motor skills transfer between HMD-VR and conventional screen-based environments and what factors predict transfer.

METHODS

We randomized 70 healthy participants into two groups. Both groups trained on a well-established measure of motor skill acquisition, the Sequential Visual Isometric Pinch Task (SVIPT), either in HMD-VR or in a conventional environment (i.e., computer screen). We then tested whether the motor skills transferred from HMD-VR to the computer screen, and vice versa. After the completion of the experiment, participants responded to questions relating to their presence in their respective training environment, age, gender, video game use, and previous HMD-VR experience. Using multivariate and univariate linear regression, we then examined whether any personal factors from the questionnaires predicted individual differences in motor skill transfer between environments.

RESULTS

Our results suggest that motor skill acquisition of this task occurs at the same rate in both HMD-VR and conventional screen environments. However, the motor skills acquired in HMD-VR did not transfer to the screen environment. While this decrease in motor skill performance when moving to the screen environment was not significantly predicted by self-reported factors, there were trends for correlations with presence and previous HMD-VR experience. Conversely, motor skills acquired in a conventional screen environment not only transferred but improved in HMD-VR, and this increase in motor skill performance could be predicted by self-reported factors of presence, gender, age and video game use.

CONCLUSIONS

These findings suggest that personal factors may predict who is likely to have better transfer of motor skill to and from HMD-VR. Future work should examine whether these and other predictors (i.e., additional personal factors such as immersive tendencies and task-specific factors such as fidelity or feedback) also apply to motor skill transfer from HMD-VR to more dynamic physical environments.

The Emergence of Cognitive Maps for Spatial Navigation in 7- to 10-Year-Old Children

Although much is known about adults' ability to orient by means of cognitive maps (mental representations of the environment), it is less clear when this important ability emerges in development. In the present study, 97 seven- to 10-year-olds and 26 adults played a video game designed to investigate the ability to orient using cognitive maps. The game required participants to reach target locations as quickly as possible, necessitating the identification and use of novel shortcuts. Seven- and 8-year-olds were less effective than older children and adults in using shortcuts. These findings provide clear evidence of a distinct developmental change around 9 years of age when children begin to proficiently orient and navigate using cognitive maps.

Effectiveness of the method of loci is only minimally related to factors that should influence imagined navigation

The method of loci is arguably the most famous mnemonic strategy and is highly effective for memorising lists of non-spatial information in order. As described and instructed, this strategy apparently relies on a spatial/navigational metaphor. The user imagines moving through an environment, placing (study) and reporting (recall) list items along the way. However, whether the method relies critically on this spatial/navigation metaphor is unknown. An alternative hypothesis is that the navigation component is superfluous to memory success, and the method of loci is better viewed as a special case of a larger class of imagery-based peg strategies. Training participants on three virtual environments varying in their characteristics (an apartment, an open field, and a radial-arm maze), we asked participants to use each trained environment as the basis of the method of loci to learn five 11-word lists. Performance varied significantly across environment. However, the effects were small in magnitude. Further tests suggested that navigation-relevant knowledge and ability were not major determinants of success in verbal memory, even for participants who were confirmed to have been compliant with the strategy. These findings echo neuroimaging findings that navigation-based cognition does occur during application of the method of loci, but imagined navigation is unlikely to be directly responsible for its effectiveness. Instead, the method of loci may be best viewed as a variant of peg methods.

Virtual navigation tested on a mobile app is predictive of real-world wayfinding navigation performance

Virtual reality environments presented on tablets and smartphones have potential to aid the early diagnosis of conditions such as Alzheimer’s dementia by quantifying impairments in navigation performance. However, it is unclear whether performance on mobile devices can predict navigation errors in the real world. We compared the performance of 49 participants (25 females, 18-35 years old) at wayfinding and path integration tasks designed in our mobile app ‘Sea Hero Quest’ with their performance at similar tasks in a real-world environment. We first performed this experiment in the streets of London (UK) and replicated it in Paris (France). In both cities, we found a significant correlation between virtual and real-world wayfinding performance and a male advantage in both environments, although smaller in the real world (Cohen’s d in the game = 0.89, in the real world = 0.59). Results in London and Paris were highly similar, and controlling for familiarity with video games did not change the results. The strength of the correlation between real world and virtual environment increased with the difficulty of the virtual wayfinding task, indicating that Sea Hero Quest does not merely capture video gaming skills. The fact that the Sea Hero Quest wayfinding task has real-world ecological validity constitutes a step toward controllable, sensitive, safe, low-cost, and easy to administer digital cognitive assessment of navigation ability.

The potential of virtual reality for spatial navigation research across the adult lifespan

Older adults often experience serious problems in spatial navigation, and alterations in underlying brain structures are among the first indicators for a progression to neurodegenerative diseases. Studies investigating the neural mechanisms of spatial navigation and its changes across the adult lifespan are increasingly using virtual reality (VR) paradigms. VR offers major benefits in terms of ecological validity, experimental control and options to track behavioral responses. However, navigation in the real world differs from navigation in VR in several aspects. In addition, the importance of body-based or visual cues for navigation varies between animal species. Incongruences between sensory and motor input in VR might consequently affect their performance to a different degree. After discussing the specifics of using VR in spatial navigation research across species, we outline several challenges when investigating age-related deficits in spatial navigation with the help of VR. In addition, we discuss ways to reduce their impact, together with the possibilities VR offers for improving navigational abilities in older adults.

Action compatibility in spatial knowledge developed through virtual navigation

Action-compatibility effects (ACEs) arise due to incongruity between perceptuo-motor traces stored in memory and the perceptuo-motor demands of a retrieval task. Recent research has suggested that ACEs arising during spatial memory retrieval are additionally modulated by individual differences in how experienced participants are with a college campus environment. However, the extent and nature of experience with a real-world environment is difficult to assess and control, and characteristics of the retrieval task itself might modulate ACEs during spatial memory retrieval. The present study provides a more controlled and in-depth examination of how individual differences and task-based factors interact to shape ACEs when participants retrieve spatial memories. In two experiments, participants with varied video game experience learned a virtual environment and then used the computer mouse to verify spatial relationships from different perspectives. Mouse trajectories demonstrated ACEs, differing by retrieval perspective and video game experience. Videogame experts demonstrated the ACE based on learned spatial relationships during egocentric retrieval only, whereas videogame novices showed the ACE based on semantic processing of directional terms only. Specifically, gaming experts invoke perspective-specific perceptuo-motor associations to retrieve spatial knowledge, whereas non-experts are influenced by semantically based associations specific to the retrieval task. Results are discussed in the context of action-compatibility effects, the intentional weighting hypothesis, and the flexible encoding and retrieval of spatial information.

The path more travelled: Time pressure increases reliance on familiar route-based strategies during navigation

Navigating large-scale environments involves dynamic interactions between the physical world and individuals' knowledge, goals, and strategies. Time pressure can result from self-imposed goals or relatively dynamic situational factors that induce varied constraints. While time pressure is ubiquitous in daily life and has been shown to influence affective states, cost-benefit analyses, and strategy selection, its influence on navigation behaviour is unknown. The present study examined how introducing varied time constraints during virtual urban navigation would influence spatial strategies and impact the efficiency and effectiveness of goal-directed wayfinding. Participants learned a large-scale urban virtual environment by wayfinding between a series of 20 successive landmark goals (e.g., You have reached the Theater. Now find the Bank.). A day later, they again performed the same task, but landmark-to-landmark trials were characterized by conditions of low-, moderate-, or high-pressure time limits as quantified by a pilot experiment. As time pressure increased, participants more likely navigated along previously experienced paths and less likely travelled in the global direction of the destination. Results suggest strategy shifts under time constraints that increase reliance on egocentric, route-based strategies and decrease reliance on global configural knowledge, probably in an attempt to reduce cognitive demands and support performance under pressure.

Changes in spatial cognition and brain activity after a single dose of testosterone in healthy women

Studies have consistently shown that males perform better than females on several spatial tasks. Animal and human literature suggests that sex hormones have an important role in both establishing and maintaining this difference. The aim of the present study was to examine the effects of exogenous testosterone on spatial cognition and brain activity in healthy women. A cross-sectional, double-blind, randomized, placebo-controlled study was performed in 42 healthy young women who either received one dose of 0.5mg sublingual testosterone or placebo. They then learned a virtual environment and performed navigation tasks during functional magnetic resonance imaging (fMRI). Subsequently, their knowledge of the virtual environment, self-reported navigation strategy, and mental rotation abilities were measured. The testosterone group had improved representations of the directions within the environment and performed significantly better on the mental rotation task compared to the placebo group, but navigation success and navigation strategy were similar in the two groups. Nevertheless, the testosterone group had significantly increased activity within the medial temporal lobe during successful navigation compared to the placebo group, and a positive correlation between testosterone load and medial temporal lobe activity was found. Fetal testosterone levels, measured as second-to-fourth digit length ratio, interacted significantly with parahippocampal activity and tended towards giving higher mental rotation task scores. These results demonstrated that testosterone had a limited effect pertaining specifically to spatial cognition involving 3D-visualization in healthy women, while complex behaviors such as navigation, relying more on learned strategies, were not altered despite increased neuronal activity in relevant brain regions.

From cognitive maps to cognitive graphs

We investigate the structure of spatial knowledge that spontaneously develops during free exploration of a novel environment. We present evidence that this structure is similar to a labeled graph: a network of topological connections between places, labeled with local metric information. In contrast to route knowledge, we find that the most frequent routes and detours to target locations had not been traveled during learning. Contrary to purely topological knowledge, participants typically traveled the shortest metric distance to a target, rather than topologically equivalent but longer paths. The results are consistent with the proposal that people learn a labeled graph of their environment.

Vigilance on the move: video game-based measurement of sustained attention

Vigilance represents the capacity to sustain attention to any environmental source of information over prolonged periods on watch. Most stimuli used in vigilance research over the previous six decades have been relatively simple and often purport to represent important aspects of detection and discrimination tasks in real-world settings. Such displays are most frequently composed of single stimulus presentations in discrete trials against a uniform, often uncluttered background. The present experiment establishes a dynamic, first-person perspective vigilance task in motion using a video-game environment. 'Vigilance on the move' is thus a new paradigm for the study of sustained attention. We conclude that the stress of vigilance extends to the new paradigm, but whether the performance decrement emerges depends upon specific task parameters. The development of the task, the issues to be resolved and the pattern of performance, perceived workload and stress associated with performing such dynamic vigilance are reported.

PRACTITIONER SUMMARY

The present experiment establishes a dynamic, first-person perspective movement-based vigilance task using a video-game environment. 'Vigilance on the move' is thus a new paradigm for the evaluation of sustained attention in operational environments in which individuals move as they monitor their environment. Issues addressed in task development are described.

Amount of lifetime video gaming is positively associated with entorhinal, hippocampal and occipital volume

Playing video games is a popular leisure activity among children and adults, and may therefore potentially influence brain structure. We have previously shown a positive association between probability of gray matter (GM) volume in the ventral striatum and frequent video gaming in adolescence. Here we set out to investigate structural correlates of video gaming in adulthood, as the effects observed in adolescents may reflect only a fraction of the potential neural long-term effects seen in adults. On magnetic resonance imaging (MRI) scans of 62 male adults, we computed voxel-based morphometry to explore the correlation of GM with the lifetime amount of video gaming (termed joystick years). We found a significant positive association between GM in bilateral parahippocamal region (entorhinal cortex) and left occipital cortex/inferior parietal lobe and joystick years (P<0.001, corrected for multiple comparisons). An exploratory analysis showed that the entorhinal GM volume can be predicted by the video game genres played, such as logic/puzzle games and platform games contributing positively, and action-based role-playing games contributing negatively. Furthermore, joystick years were positively correlated with hippocampus volume. The association of lifetime amount of video game playing with bilateral entorhinal cortex, hippocampal and occipital GM volume could reflect adaptive neural plasticity related to navigation and visual attention.

Virtual navigation performance: the relationship to field of view and prior video gaming experience

Two experiments examined whether learning a virtual environment was influenced by field of view and how it related to prior video gaming experience. In the first experiment, participants (42 men, 39 women; M age = 19.5 yr., SD = 1.8) performed worse on a spatial orientation task displayed with a narrow field of view in comparison to medium and wide field-of-view displays. Counter to initial hypotheses, wide field-of-view displays did not improve performance over medium displays, and this was replicated in a second experiment (30 men, 30 women; M age = 20.4 yr., SD = 1.9) presenting a more complex learning environment. Self-reported video gaming experience correlated with several spatial tasks: virtual environment pointing and tests of Judgment of Line Angle and Position, mental rotation, and Useful Field of View (with correlations between .31 and .45). When prior video gaming experience was included as a covariate, sex differences in spatial tasks disappeared.