Different Types of Survey-Based Environmental Representations: Egocentric vs. Allocentric Cognitive Maps

The goal of the current study was to show the existence of distinct types of survey-based environmental representations, egocentric and allocentric, and provide experimental evidence that they are formed by different types of navigational strategies, path integration and map-based navigation, respectively. After traversing an unfamiliar route, participants were either disoriented and asked to point to non-visible landmarks encountered on the route (Experiment 1) or presented with a secondary spatial working memory task while determining the spatial locations of objects on the route (Experiment 2). The results demonstrate a double dissociation between the navigational strategies underlying the formation of allocentric and egocentric survey-based representation. Specifically, only the individuals who generated egocentric survey-based representations of the route were affected by disorientation, suggesting they relied primarily on a path integration strategy combined with landmark/scene processing at each route segment. In contrast, only allocentric-survey mappers were affected by the secondary spatial working memory task, suggesting their use of map-based navigation. This research is the first to show that path integration, in conjunction with egocentric landmark processing, is a distinct standalone navigational strategy underpinning the formation of a unique type of environmental representation-the egocentric survey-based representation.

Combination and competition between path integration and landmark navigation in the estimation of heading direction

Successful navigation requires the ability to compute one’s location and heading from incoming multisensory information. Previous work has shown that this multisensory input comes in two forms: body-based idiothetic cues, from one’s own rotations and translations, and visual allothetic cues, from the environment (usually visual landmarks). However, exactly how these two streams of information are integrated is unclear, with some models suggesting the body-based idiothetic and visual allothetic cues are combined, while others suggest they compete. In this paper we investigated the integration of body-based idiothetic and visual allothetic cues in the computation of heading using virtual reality. In our experiment, participants performed a series of body turns of up to 360 degrees in the dark with only a brief flash (300ms) of visual feedback en route. Because the environment was virtual, we had full control over the visual feedback and were able to vary the offset between this feedback and the true heading angle. By measuring the effect of the feedback offset on the angle participants turned, we were able to determine the extent to which they incorporated visual feedback as a function of the offset error. By further modeling this behavior we were able to quantify the computations people used. While there were considerable individual differences in performance on our task, with some participants mostly ignoring the visual feedback and others relying on it almost entirely, our modeling results suggest that almost all participants used the same strategy in which idiothetic and allothetic cues are combined when the mismatch between them is small, but compete when the mismatch is large. These findings suggest that participants update their estimate of heading using a hybrid strategy that mixes the combination and competition of cues.

Successful navigation requires us to combine visual information about our environment with body-based cues about our own rotations and translations. In this work we investigated how these disparate sources of information work together to compute an estimate of heading. Using a novel virtual reality task we measured how humans integrate visual and body-based cues when there is mismatch between them—that is, when the estimate of heading from visual information is different from body-based cues. By building computational models of different strategies, we reveal that humans use a hybrid strategy for integrating visual and body-based cues—combining them when the mismatch between them is small and picking one or the other when the mismatch is large.

Lessons from reinforcement learning for biological representations of space

Neuroscientists postulate 3D representations in the brain in a variety of different coordinate frames (e.g. 'head-centred', 'hand-centred' and 'world-based'). Recent advances in reinforcement learning demonstrate a quite different approach that may provide a more promising model for biological representations underlying spatial perception and navigation. In this paper, we focus on reinforcement learning methods that reward an agent for arriving at a target image without any attempt to build up a 3D 'map'. We test the ability of this type of representation to support geometrically consistent spatial tasks such as interpolating between learned locations using decoding of feature vectors. We introduce a hand-crafted representation that has, by design, a high degree of geometric consistency and demonstrate that, in this case, information about the persistence of features as the camera translates (e.g. distant features persist) can improve performance on the geometric tasks. These examples avoid Cartesian (in this case, 2D) representations of space. Non-Cartesian, learned representations provide an important stimulus in neuroscience to the search for alternatives to a 'cognitive map'.

Sources of path integration error in young and aging humans

Path integration plays a vital role in navigation: it enables the continuous tracking of one's position in space by integrating self-motion cues. Path integration abilities vary widely across individuals, and tend to deteriorate in old age. The specific causes of path integration errors, however, remain poorly characterized. Here, we combine tests of path integration performance in participants of different ages with an analysis based on the Langevin equation for diffusive dynamics, which allows us to decompose errors into distinct causes that can corrupt path integration computations. We show that, across age groups, the dominant error source is unbiased noise that accumulates with travel distance not elapsed time, suggesting that the noise originates in the velocity input rather than within the integrator. Age-related declines are primarily traced to a growth in this noise. These findings shed light on the contributors to path integration error and the mechanisms underlying age-related navigational deficits.

Path integration in large-scale space and with novel geometries: Comparing vector addition and encoding-error models

Path integration is thought to rely on vestibular and proprioceptive cues yet most studies in humans involve primarily visual input, providing limited insight into their respective contributions. We developed a paradigm involving walking in an omnidirectional treadmill in which participants were guided on two sides of a triangle and then found their back way to origin. In Experiment 1, we tested a range of different triangle types while keeping the distance of the unguided side constant to determine the influence of spatial geometry. Participants overshot the angle they needed to turn and undershot the distance they needed to walk, with no consistent effect of triangle type. In Experiment 2, we manipulated distance while keeping angle constant to determine how path integration operated over both shorter and longer distances. Participants underestimated the distance they needed to walk to the origin, with error increasing as a function of the walked distance. To attempt to account for our findings, we developed configural-based computational models involving vector addition, the second of which included terms for the influence of past trials on the current one. We compared against a previously developed configural model of human path integration, the Encoding-Error model. We found that the vector addition models captured the tendency of participants to under-encode guided sides of the triangles and an influence of past trials on current trials. Together, our findings expand our understanding of body-based contributions to human path integration, further suggesting the value of vector addition models in understanding these important components of human navigation.

How do we remember where we have been? One important mechanism for doing so is called path integration, which refers to the computation of one’s position in space with only self-motion cues. By tracking the direction and distance we have walked, we can create a mental arrow from the current location to the origin, termed the homing vector. Previous studies have shown that the homing vector is subject to systematic distortions depending on previously experienced paths, yet what influences these patterns of errors, particularly in humans, remains uncertain. In this study, we compare two models of path integration based on participants walking two sides of a triangle without vision and then completing the third side based on their estimate of the homing vector. We found no effect of triangle shape on systematic errors, while the systematic errors scaled with path length logarithmically, similar to Weber-Fechner law. While we show that both models captured participants’ behavior, a model based on vector addition best captured the patterns of error in the homing vector. Our study therefore has important implications for how humans track their location, suggesting that vector-based models provide a reasonable and simple explanation for how we do so.

No single, stable 3D representation can explain pointing biases in a spatial updating task

People are able to keep track of objects as they navigate through space, even when objects are out of sight. This requires some kind of representation of the scene and of the observer’s location but the form this might take is debated. We tested the accuracy and reliability of observers’ estimates of the visual direction of previously-viewed targets. Participants viewed four objects from one location, with binocular vision and small head movements then, without any further sight of the targets, they walked to another location and pointed towards them. All conditions were tested in an immersive virtual environment and some were also carried out in a real scene. Participants made large, consistent pointing errors that are poorly explained by any stable 3D representation. Any explanation based on a 3D representation would have to posit a different layout of the remembered scene depending on the orientation of the obscuring wall at the moment the participant points. Our data show that the mechanisms for updating visual direction of unseen targets are not based on a stable 3D model of the scene, even a distorted one.

Influence of route decision-making and experience on human path integration

Path integration refers to a process of integrating information regarding self-motion to estimate one's current position and orientation. Here we reported two experiments designed to investigate whether, and if so, how human path integration could be influenced by route decision-making and previous experience. Using head-mounted display virtual reality and hallway mazes, we asked participants to travel along several hallways and then to directly return to the starting point, namely a path completion task. We created an active condition in which the participants had the opportunity to voluntarily select the structure of outbound paths, and a passive condition in which they followed the outbound paths chosen by others. Each participant was required to take part in the study on two consecutive days, and they performed the task under different (in Experiment 1) or the same conditions (in Experiment 2) on these two days. The results of both experiments revealed a facilitation effect of route decision-making on the participants' performance on the first day. The results also revealed that both their performance and path selection strategies on the second day were subject to their experience obtained from the first day. Collectively, these findings suggest that human path integration may be improved by having the opportunity to make decisions on the structure of outbound paths and/or more experience with the task.

Resting State Connectivity Between Medial Temporal Lobe Regions and Intrinsic Cortical Networks Predicts Performance in a Path Integration Task

Humans differ in their individual navigational performance, in part because successful navigation relies on several diverse abilities. One such navigational capability is path integration, the updating of position and orientation during movement, typically in a sparse, landmark-free environment. This study examined the relationship between path integration abilities and functional connectivity to several canonical intrinsic brain networks. Intrinsic networks within the brain reflect past inputs and communication as well as structural architecture. Individual differences in intrinsic connectivity have been observed for common networks, suggesting that these networks can inform our understanding of individual spatial abilities. Here, we examined individual differences in intrinsic connectivity using resting state magnetic resonance imaging (rsMRI). We tested path integration ability using a loop closure task, in which participants viewed a single video of movement in a circle trajectory in a sparse environment, and then indicated whether the video ended in the same location in which it started. To examine intrinsic brain networks, participants underwent a resting state scan. We found that better performance in the loop task was associated with increased connectivity during rest between the central executive network (CEN) and posterior hippocampus, parahippocampal cortex (PHC) and entorhinal cortex. We also found that connectivity between PHC and the default mode network (DMN) during rest was associated with better loop closure performance. The results indicate that interactions between medial temporal lobe (MTL) regions and intrinsic networks that involve prefrontal cortex (PFC) are important for path integration and navigation.

Rotational error in path integration: encoding and execution errors in angle reproduction

Path integration is fundamental to human navigation. When a navigator leaves home on a complex outbound path, they are able to keep track of their approximate position and orientation and return to their starting location on a direct homebound path. However, there are several sources of error during path integration. Previous research has focused almost exclusively on encoding error-the error in registering the outbound path in memory. Here, we also consider execution error-the error in the response, such as turning and walking a homebound trajectory. In two experiments conducted in ambulatory virtual environments, we examined the contribution of execution error to the rotational component of path integration using angle reproduction tasks. In the reproduction tasks, participants rotated once and then rotated again to face the original direction, either reproducing the initial turn or turning through the supplementary angle. One outstanding difficulty in disentangling encoding and execution error during a typical angle reproduction task is that as the encoding angle increases, so does the required response angle. In Experiment 1, we dissociated these two variables by asking participants to report each encoding angle using two different responses: by turning to walk on a path parallel to the initial facing direction in the same (reproduction) or opposite (supplementary angle) direction. In Experiment 2, participants reported the encoding angle by turning both rightward and leftward onto a path parallel to the initial facing direction, over a larger range of angles. The results suggest that execution error, not encoding error, is the predominant source of error in angular path integration. These findings also imply that the path integrator uses an intrinsic (action-scaled) rather than an extrinsic (objective) metric.

Building a cognitive map by assembling multiple path integration systems

Path integration and cognitive mapping are two of the most important mechanisms for navigation. Path integration is a primitive navigation system which computes a homing vector based on an animal's self-motion estimation, while cognitive map is an advanced spatial representation containing richer spatial information about the environment that is persistent and can be used to guide flexible navigation to multiple locations. Most theories of navigation conceptualize them as two distinctive, independent mechanisms, although the path integration system may provide useful information for the integration of cognitive maps. This paper demonstrates a fundamentally different scenario, where a cognitive map is constructed in three simple steps by assembling multiple path integrators and extending their basic features. The fact that a collection of path integration systems can be turned into a cognitive map suggests the possibility that cognitive maps may have evolved directly from the path integration system.

Homing by path integration when a locomotion trajectory crosses itself

Path integration is a process with which navigators derive their current position and orientation by integrating self-motion signals along a locomotion trajectory. It has been suggested that path integration becomes disproportionately erroneous when the trajectory crosses itself. However, there is a possibility that this previous finding was confounded by effects of the length of a traveled path and the amount of turns experienced along the path, two factors that are known to affect path integration performance. The present study was designed to investigate whether the crossover of a locomotion trajectory truly increases errors of path integration. In an experiment, blindfolded human navigators were guided along four paths that varied in their lengths and turns, and attempted to walk directly back to the beginning of the paths. Only one of the four paths contained a crossover. Results showed that errors yielded from the path containing the crossover were not always larger than those observed in other paths, and the errors were attributed solely to the effects of longer path lengths or greater degrees of turns. These results demonstrated that path crossover does not always cause significant disruption in path integration processes. Implications of the present findings for models of path integration are discussed.

Distraction shrinks space

Research investigating how people remember the distance of paths they walk has shown two apparently conflicting effects of experience during encoding on subsequent distance judgments. By the feature accumulation effect, discrete path features such as turns, houses, or other landmarks cause an increase in remembered distance. By the distractor effect, performance of a concurrent task during path encoding causes a decrease in remembered distance. In this study, we ask the following: What are the conditions that determine whether the feature accumulation or the distractor effect dominates distortions of space? In two experiments, blindfolded participants were guided along two legs of a right triangle while reciting nonsense syllables. On some trials, one of the two legs contained features: horizontally mounted car antennas (gates) that bent out of the way as participants walked past. At the end of the second leg, participants either indicated the remembered path leg lengths using their hands in a ratio estimation task or attempted to walk, unguided, straight back to the beginning. In addition to response mode, visual access to the paths and time between encoding and response were manipulated to determine whether these factors would affect feature accumulation or distractor effects. Path legs with added features were remembered as shorter than those without, but this result was significant only in the haptic response mode data. This finding suggests that when people form spatial memory representations with the intention of navigating in room-scale spaces, interfering with information accumulation substantially distorts spatial memory.

Ageing effects on path integration and landmark navigation

Navigation abilities show marked decline in both normal ageing and dementia. Path integration may be particularly affected, as it is supported by the hippocampus and entorhinal cortex, both of which show severe degeneration with ageing. Age differences in path integration based on kinaesthetic and vestibular cues have been clearly demonstrated, but very little research has focused on visual path integration, based only on optic flow. Path integration is complemented by landmark navigation, which may also show age differences, but has not been well studied either. Here we present a study using several simple virtual navigation tasks to explore age differences in path integration both with and without landmark information. We report that, within a virtual environment that provided only optic flow information, older participants exhibited deficits in path integration in terms of distance reproduction, rotation reproduction, and triangle completion. We also report age differences in triangle completion within an environment that provided landmark information. In all tasks, we observed a more restricted range of responses in the older participants, which we discuss in terms of a leaky integrator model, as older participants showed greater leak than younger participants. Our findings begin to explain the mechanisms underlying age differences in path integration, and thus contribute to an understanding of the substantial decline in navigation abilities observed in ageing.

Dissociable cognitive mechanisms underlying human path integration

Path integration is a fundamental mechanism of spatial navigation. In non-human species, it is assumed to be an online process in which a homing vector is updated continuously during an outward journey. In contrast, human path integration has been conceptualized as a configural process in which travelers store working memory representations of path segments, with the computation of a homing vector only occurring when required. To resolve this apparent discrepancy, we tested whether humans can employ different path integration strategies in the same task. Using a triangle completion paradigm, participants were instructed either to continuously update the start position during locomotion (continuous strategy) or to remember the shape of the outbound path and to calculate home vectors on basis of this representation (configural strategy). While overall homing accuracy was superior in the configural condition, participants were quicker to respond during continuous updating, strongly suggesting that homing vectors were computed online. Corroborating these findings, we observed reliable differences in head orientation during the outbound path: when participants applied the continuous updating strategy, the head deviated significantly from straight ahead in direction of the start place, which can be interpreted as a continuous motor expression of the homing vector. Head orientation-a novel online measure for path integration-can thus inform about the underlying updating mechanism already during locomotion. In addition to demonstrating that humans can employ different cognitive strategies during path integration, our two-systems view helps to resolve recent controversies regarding the role of the medial temporal lobe in human path integration.

Exploring the process of progressive disorientation

While an increasing number of behavioral studies examining spatial cognition use experimental paradigms involving disorientation, the process by which one becomes disoriented is not well explored. The current study examined this process using a paradigm in which participants were blindfolded and underwent a succession of 70 degrees or 200 degrees passive, whole body rotations around a fixed vertical axis. After each rotation, participants used a pointer to indicate either their heading at the start of the most recent turn or their heading at the start of the current series of turns. Analyses showed that in both cases, mean pointing errors increased gradually over successive turns. In addition to the gradual loss of orientation indicated by this increase, analysis of the pointing errors also showed evidence of occasional, abrupt loss orientation. Results indicate multiple routes from an oriented to a disoriented state, and shed light on the process of becoming disoriented.

Human non-visual discrimination of gradual turning is poor

We report three measures of the ability of normally sighted adults to discriminate turning while walking blindfolded outdoors. Constant error in selecting line drawings of paths indicated that participants under represent the amount of turning along more curved paths and over represent the amount of turning on less curved paths. Constant error in the direction of pointing to the origin of paths indicated a bias consistent with the direction of turning along more curved paths. Participants produced more accurate drawings of paths as the amount of turning increased. The results suggest that non-visual cues that accompany self movement are not sufficient for accurate representation of large radius curves in geographic scale travel.

Aging and path integration skill: kinesthetic and vestibular contributions to wayfinding

In a triangle completion task designed to assess path integration skill, younger and older adults performed similarly after being led, while blindfolded, along the route segments on foot, which provided both kinesthetic and vestibular information about the outbound path. In contrast, older adults' performance was impaired, relative to that of younger adults, after they were conveyed, while blindfolded, along the route segments in a wheelchair, which limited them principally to vestibular information. Correlational evidence suggested that cognitive resources were significant factors in accounting for age-related decline in path integration performance.

Path Integration Deficits during Linear Locomotion after Human Medial Temporal Lobectomy

Animal navigation studies have implicated structures in and around the hippocampal formation as crucial in performing path integration (a method of determining one's position by monitoring internally generated self-motion signals). Less is known about the role of these structures for human path integration. We tested path integration in patients who had undergone left or right medial temporal lobectomy as therapy for epilepsy. This procedure removed approximately 50% of the anterior portion of the hippocampus, as well as the amygdala and lateral temporal lobe. Participants attempted to walk without vision to a previously viewed target 2–6 m distant. Patients with right, but not left, hemisphere lesions exhibited both a decrease in the consistency of path integration and a systematic underregistration of linear displacement (and/or velocity) during walking. Moreover, the deficits were observable even when there were virtually no angular acceleration vestibular signals. The results suggest that structures in the medial temporal lobe participate in human path integration when individuals walk along linear paths and that this is so to a greater extent in right hemisphere structures than left. This information is relevant for future research investigating the neural substrates of navigation, not only in humans (e.g., functional neuroimaging and neuropsychological studies), but also in rodents and other animals.

Human navigation in nested environments

Navigation in humans and many other animals relies on spatial representations of their environments. Three experiments examined how humans maintain sense of orientation between nested environments. Subjects can acquire new spatial representations easily without integrating them into their existing spatial knowledge system. While navigating between nested environments, subjects seemed to constantly switch between the currently processed environment by reorienting to approaching environments and losing track of old environments at given spatial regions. These results suggest that spatial updating in naturalistic, nested environments does not occur for all environments at the same time. Implications for the hierarchical theory of spatial representations and the path integration theory of navigation are discussed.

Navigating without vision: basic and applied research

We describe some of the results of our program of basic and applied research on navigating without vision. One basic research topic that we have studied extensively is path integration, a form of navigation in which perceived self-motion is integrated over time to obtain an estimate of current position and orientation. In experiments on pathway completion, one test of path integration ability, we have found that subjects who are passively guided over the outbound path without vision exhibit significant errors when attempting to return to the origin but are nevertheless sensitive to turns and segment lengths in the stimulus path. We have also found no major differences in path integration ability among blind and sighted populations. A model we have developed that attributes errors in path integration to errors in encoding the stimulus path is a good beginning toward understanding path integration performance. In other research on path integration, in which optic flow information was manipulated in addition to the proprioceptive and vestibular information of nonvisual locomotion, we have found that optic flow is a weak input to the path integration process. In other basic research, our studies of auditory distance perception in outdoor environments show systematic underestimation of sound source distance. Our applied research has been concerned with developing and evaluating a navigation system for the visually impaired that uses three recent technologies: the Global Positioning System, Geographic Information Systems, and virtual acoustics. Our work shows that there is considerable promise of these three technologies in allowing visually impaired individuals to navigate and learn about unfamiliar environments without the assistance of human guides.