How does navigation system behavior influence human behavior?

Image memorability influences memory for where the item was seen but not when

Observers can determine whether they have previously seen hundreds of images with more than 80% accuracy. This "massive memory" for WHAT we have seen is accompanied by smaller but still massive memories for WHERE and WHEN the item was seen (spatial & temporal massive memory). Recent studies have shown that certain images are more easily remembered than others (higher "memorability"). Does memorability influence spatial massive memory and temporal massive memory? In two experiments, viewers saw 150 images presented twice in random order. These 300 images were sequentially presented at random locations in a 7 × 7 grid. If an image was categorized as old, observers clicked on the spot in the grid where they thought they had previously seen it. They also noted when they had seen it: Experiment 1-clicking on a timeline; Experiment 2-estimating the trial number when the item first appeared. Replicating prior work, data show that high-memorability images are remembered better than low-memorability images. Interestingly, in both experiments, spatial memory precision was correlated with image memorability, while temporal memory precision did not vary as a function of memorability. Apparently, properties that make images memorable help us remember WHERE but not WHEN those images were presented. The lack of correlation between memorability and temporal memory is, of course, a negative result and should be treated with caution.

Evaluating the efficacy of UNav: A computer vision-based navigation aid for persons with blindness or low vision

UNav is a computer-vision-based localization and navigation aid that provides step-by-step route instructions to reach selected destinations without any infrastructure in both indoor and outdoor environments. Despite the initial literature highlighting UNav's potential, clinical efficacy has not yet been rigorously evaluated. Herein, we assess UNav against standard in-person travel directions (SIPTD) for persons with blindness or low vision (PBLV) in an ecologically valid environment using a non-inferiority design. Twenty BLV subjects (age = 38 ± 8.4; nine females) were recruited and asked to navigate to a variety of destinations, over short-range distances (<200 m), in unfamiliar spaces, using either UNav or SIPTD. Navigation performance was assessed with nine dependent variables to assess travel confidence, as well as spatial and temporal performances, including path efficiency, total time, and wrong turns. The results suggest that UNav is not only non-inferior to the standard-of-care in wayfinding (SIPTD) but also superior on 8 out of 9 metrics, as compared to SIPTD. This study highlights the range of benefits computer vision-based aids provide to PBLV in short-range navigation and provides key insights into how users benefit from this systematic form of computer-aided guidance, demonstrating transformative promise for educational attainment, gainful employment, and recreational participation.

Towards neuroadaptive navigation assistance to reduce spatial de-skilling

Maps have been invaluable navigation aids for millennia and thus have been critical for human survival. The increasing popularity of and high dependence on digital, location-aware assistive navigation technology, however, has been shown to divert our attention from the environment and to negatively influence innate spatial abilities. To mitigate this, neuroadaptive mobile geographic information displays (namGIDs) are proposed that respond in real-time to navigators' cognitive task demands and wayfinder's situated visuo-spatial attention needs. In doing so, namGIDs may not only help navigators maintain navigation efficiency but more importantly, also continuously scaffold spatial learning. To do this, the proposed navigation assistance must strike the appropriate balance between welcomed mobility efficiency gains while limiting human spatial deskilling. Leveraging neuroadaptive cartography, we can ensure to remain effective navigators, empowered to explore the world with confidence.

How Do In-Car Navigation Aids Impair Expert Navigators' Spatial Learning Ability?

Reliance on digital navigation aids has already shown negative impacts on navigators' innate spatial abilities. How this happens is still an open research question. We report on an empirical study with twenty-four experienced (male) taxi drivers to evaluate the long-term impacts of in-car navigation system use on the spatial learning ability of these navigation experts. Specifically, we measured cognitive load by means of electroencephalography (EEG) coupled with eye tracking to assess their visuospatial attention allocation during a video-based route-following task while driving through an unknown urban environment. We found that long-term reliance on in-car navigation aids did not affect participants' visual attention allocation during spatial learning but rather limited their ability to encode viewed geographic information into memory, which, in turn, led to greater cognitive load, especially along route segments between intersections. Participants with greater dependence on in-car navigation aids performed worse on the spatial knowledge tests. Our combined behavioral and neuropsychological findings provide evidence for the impairment of expert navigators' spatial learning ability when exposed to long-term use of digital in-car navigation aids.

Active and passive exploration for spatial knowledge acquisition: A meta-analysis

Literature reported mixed evidence on whether active exploration benefits spatial knowledge acquisition over passive exploration. Active spatial learning typically involves at least physical control of one's movement or navigation decision-making, while passive participants merely observe during exploration. To quantify the effects of active exploration in learning large-scale, unfamiliar environments, we analysed previous findings with the multi-level meta-analytical model. Potential moderators were identified and examined for their contributions to the variability in effect sizes. Of the 128 effect sizes retrieved from 33 experiments, we observed a small to moderate advantage of active exploration over passive observation. Important moderators include gender composition, decision-making, types of spatial knowledge, and matched visual information. We discussed the implications of the results along with the limitations.

Fixation-related potentials during mobile map assisted navigation in the real world: The effect of landmark visualization style

An often-proposed enhancement for mobile maps to aid assisted navigation is the presentation of landmark information, yet understanding of the manner in which they should be displayed is limited. In this study, we investigated whether the visualization of landmarks as 3D map symbols with either an abstract or realistic style influenced the subsequent processing of those landmarks during route navigation. We utilized a real-world mobile electroencephalography approach to this question by combining several tools developed to overcome the challenges typically encountered in real-world neuroscience research. We coregistered eye-movement and EEG recordings from 45 participants as they navigated through a real-world environment using a mobile map. Analyses of fixation event-related potentials revealed that the amplitude of the parietal P200 component was enhanced when participants fixated landmarks in the real world that were visualized on the mobile map in a realistic style, and that frontal P200 latencies were prolonged for landmarks depicted in either a realistic or abstract style compared with features of the environment that were not presented on the map, but only for the male participants. In contrast, we did not observe any significant effects of landmark visualization style on visual P1-N1 peaks or the parietal late positive component. Overall, the findings indicate that the cognitive matching process between landmarks seen in the environment and those previously seen on a map is facilitated by more realistic map display, while low-level perceptual processing of landmarks and recall of associated information are unaffected by map visualization style.

Calibration-Free Mobile Eye-Tracking Using Corneal Imaging

In this paper, we present and evaluate a calibration-free mobile eye-traking system. The system's mobile device consists of three cameras: an IR eye camera, an RGB eye camera, and a front-scene RGB camera. The three cameras build a reliable corneal imaging system that is used to estimate the user's point of gaze continuously and reliably. The system auto-calibrates the device unobtrusively. Since the user is not required to follow any special instructions to calibrate the system, they can simply put on the eye tracker and start moving around using it. Deep learning algorithms together with 3D geometric computations were used to auto-calibrate the system per user. Once the model is built, a point-to-point transformation from the eye camera to the front camera is computed automatically by matching corneal and scene images, which allows the gaze point in the scene image to be estimated. The system was evaluated by users in real-life scenarios, indoors and outdoors. The average gaze error was 1.6∘ indoors and 1.69∘ outdoors, which is considered very good compared to state-of-the-art approaches.

Neuroadaptive LBS: towards human-, context-, and task-adaptive mobile geographic information displays to support spatial learning for pedestrian navigation

Well-designed, neuroadaptive mobile geographic information displays (namGIDs) could improve the lives of millions of mobile citizens of the mostly urban information society who daily need to make time critical and societally relevant decisions while navigating. What are the basic perceptual and neurocognitive processes with which individuals make movement decisions when guided by human- and context-adaptive namGIDs? How can we study this in an ecologically valid way, also outside of the highly controlled laboratory? We report first ideas and results from our unique neuroadaptive research agenda that brings us closer to answering this fundamental empirical question. We present our first implemented methodological solutions of novel ambulatory evaluation methods to study and improve Location-based System (LBS) displays, by critical examination of how perceptual, neurocognitive, psychophysiological, and display design factors might influence decision-making and spatial learning in pedestrian mobility across broad ranges of users and mobility contexts.

Perspective Taking Reflects Beliefs About Partner Sophistication: Modern Computer Partners Versus Basic Computer and Human Partners

We investigate partner effects on spatial perspective taking behavior in listeners, comparing behavior with a human versus a computer partner (Experiments 1 and 2), and with computer partners of different perceived capabilities (Experiment 3). Participants responded to spoken instructions from their partner which could be interpreted egocentrically (from their own perspective) or othercentrically (from their partner's perspective). In contrast to earlier work, we found that participants were more egocentric with a computer than a human partner. Participants were also more egocentric with a computer partner that appeared more modern and capable, compared to one that appeared outdated and limited in ability. Our results show that perspective taking behavior is sensitive to information about one's partner; in particular, listeners consider their partner's potential ability to collaborate, adjusting their egocentric tendencies accordingly. Moreover, we highlight what appears to be a shift in listeners' expectations regarding computers' collaborative capabilities, leading to greater willingness to push the burden of perspective taking onto a computer partner.

Using spontaneous eye blink-related brain activity to investigate cognitive load during mobile map-assisted navigation

The continuous assessment of pedestrians' cognitive load during a naturalistic mobile map-assisted navigation task is challenging because of limited experimental control over stimulus presentation, human-map-interactions, and other participant responses. To overcome this challenge, the present study takes advantage of navigators' spontaneous eye blinks during navigation to serve as event markers in continuously recorded electroencephalography (EEG) data to assess cognitive load in a mobile map-assisted navigation task. We examined if and how displaying different numbers of landmarks (3 vs. 5 vs. 7) on mobile maps along a given route would influence navigators' cognitive load during navigation in virtual urban environments. Cognitive load was assessed by the peak amplitudes of the blink-related fronto-central N2 and parieto-occipital P3. Our results show increased parieto-occipital P3 amplitude indicating higher cognitive load in the 7-landmark condition, compared to showing 3 or 5 landmarks. Our prior research already demonstrated that participants acquire more spatial knowledge in the 5- and 7-landmark conditions compared to the 3-landmark condition. Together with the current study, we find that showing 5 landmarks, compared to 3 or 7 landmarks, improved spatial learning without overtaxing cognitive load during navigation in different urban environments. Our findings also indicate a possible cognitive load spillover effect during map-assisted wayfinding whereby cognitive load during map viewing might have affected cognitive load during goal-directed locomotion in the environment or vice versa. Our research demonstrates that users' cognitive load and spatial learning should be considered together when designing the display of future navigation aids and that navigators' eye blinks can serve as useful event makers to parse continuous human brain dynamics reflecting cognitive load in naturalistic settings.

Guided Search 6.0: An updated model of visual search

This paper describes Guided Search 6.0 (GS6), a revised model of visual search. When we encounter a scene, we can see something everywhere. However, we cannot recognize more than a few items at a time. Attention is used to select items so that their features can be "bound" into recognizable objects. Attention is "guided" so that items can be processed in an intelligent order. In GS6, this guidance comes from five sources of preattentive information: (1) top-down and (2) bottom-up feature guidance, (3) prior history (e.g., priming), (4) reward, and (5) scene syntax and semantics. These sources are combined into a spatial "priority map," a dynamic attentional landscape that evolves over the course of search. Selective attention is guided to the most active location in the priority map approximately 20 times per second. Guidance will not be uniform across the visual field. It will favor items near the point of fixation. Three types of functional visual field (FVFs) describe the nature of these foveal biases. There is a resolution FVF, an FVF governing exploratory eye movements, and an FVF governing covert deployments of attention. To be identified as targets or rejected as distractors, items must be compared to target templates held in memory. The binding and recognition of an attended object is modeled as a diffusion process taking > 150 ms/item. Since selection occurs more frequently than that, it follows that multiple items are undergoing recognition at the same time, though asynchronously, making GS6 a hybrid of serial and parallel processes. In GS6, if a target is not found, search terminates when an accumulating quitting signal reaches a threshold. Setting of that threshold is adaptive, allowing feedback about performance to shape subsequent searches. Simulation shows that the combination of asynchronous diffusion and a quitting signal can produce the basic patterns of response time and error data from a range of search experiments.

Use and Perceptions of Pedestrian Navigation Apps: Findings from Bologna and Porto

Pedestrian Navigation Applications (PNAs) provide assistance in terms of self-localization, space recognition, and turn-by-turn navigation. The use, motivations and perceptions associated with these applications have been under investigated due to users being insufficiently involved in their design and development. This paper analyses the extent to which PNAs are used for assisting people to walk, the frequencies and reasons of using these applications, the perceptions about them, and the barriers preventing them from being used. The study is supported by a questionnaire (N = 1438) that was administered in Bologna (Italy) and Porto (Portugal). Results indicated that 42% of the respondents use PNAs mainly on an occasional basis to find locations and the shortest routes. Google Maps was the preferred navigation service. Statistical tests showed that PNAs were more likely to be used by younger adults and students. The lack of need was the main reason for not using these apps, due to the good spatial knowledge of the cities or the non-use of the pedestrian mode for regular trips. Respondents would like to have apps that are more accurate, usable, and adjusted to pedestrian navigation. The findings described in this paper could be helpful for future designs of PNAs, especially to match pedestrian needs more effectively and to enhance the role of these apps in promoting healthier and sustainable lifestyles.

Early communication is key - Designing a new communication tool to immediately empower people with psychogenic nonepileptic seizures

INTRODUCTION

Patient empowerment and shared decision-making has been increasingly recognized as key factors for a favorable prognosis. This is particularly true in complex brain disorders such as psychogenic nonepileptic seizures (PNES) which go along with several challenges. People with PNES (PW-PNES) often feel lost in the healthcare system. Early clear communication is one of the few favorable prognostic variables. Our goal was to design a new ultrashort user-friendly communication tool allowing immediate patient empowerment.

METHODS

We conceptualized a design thinking process with patient engagement of PW-PNES. Together with a larger group of PW-PNES, we developed a comprehensive user-friendly 1-page document summarizing the key features of PNES. We applied document engineering (DE) as a cognitive science-based new methodology. Document engineering is well established in the aviation, oil, and mining industries and measurably reduces comprehension and performance errors.

RESULTS

The design thinking process encompassed 5 phases (empathize, ideate, define, prototype, and test). A prototype of a 1-page document, the 1-Pager-PNES, was created which contained the essential 7 domains organized in a simple structure such as a promise-question-answer (PQA) format. Information was kept poignant, complete, easy-to-read integrating cognitive principles to optimize navigation. The prototype "1-Pager-PNES" was subsequently tested in a 7-member focus group. All patients expressed significant improvement in understanding their disease and felt immediately empowered. Implementing their specific feedbacks, reiterative testing, and involving PNES experts resulted in the final version of the "1-Pager-PNES".

CONCLUSION

A promising new communication tool reduced to 1-page only is introduced which improves patient guidance and enables better coping mechanisms with this complex disease. The patient/user is empowered quickly through finding answers to pressing questions. Our study is unique for three reasons: 1) it engaged patients in the developing process, 2) it produced a tool for immediate communication for PW-PNES, which follows principles of human behavior and cognitive science, and 3) it used cross-industry thinking. Despite all limitations, we consider our small pilot study an inspiration for future studies with focus on patient empowerment through user-friendly documents.