Cognitive map formation in the blind is enhanced by three-dimensional tactile information

For blind individuals, tactile maps are useful tools to form cognitive maps through touch. However, they still experience challenges in cognitive map formation and independent navigation. Three-dimensional (3D) tactile information is thus increasingly being considered to convey enriched spatial information, but it remains unclear if it can facilitate cognitive map formation compared to traditional two-dimensional (2D) tactile information. Consequently, the present study investigated the impact of the type of sensory input (tactile 2D vs. tactile 3D vs. a visual control condition) on cognitive map formation. To do so, early blind (EB, n = 13), late blind (LB, n = 12), and sighted control (SC, n = 14) participants were tasked to learn the layouts of mazes produced with different sensory information (tactile 2D vs. tactile 3D vs. visual control) and to infer routes from memory. Results show that EB manifested stronger cognitive map formation with 3D mazes, LB performed equally well with 2D and 3D tactile mazes, and SC manifested equivalent cognitive map formation with visual and 3D tactile mazes but were negatively impacted by 2D tactile mazes. 3D tactile maps therefore have the potential to improve spatial learning for EB and newly blind individuals through a reduction of cognitive overload. Installation of 3D tactile maps in public spaces should be considered to promote universal accessibility and reduce blind individuals' wayfinding deficits related to the inaccessibility of spatial information through non-visual means.

Planning Your Journey in Audio: Design and Evaluation of Auditory Route Overviews

Auditory overviews of routes can provide routing and map information to blind users enabling them to preview route maps before embarking on a journey. This paper investigates the usefulness of a system designed to do this through a Preliminary Survey, followed by a Design Study to gather the design requirements, development of a prototype and evaluation through a Usability Study. The design is drawn in 2-stages with 8 audio designers and 8 potential blind users. The auditory route overview is sequential and automatically generated as integrated audio. It comprises auditory icons to represent points of interest, earcons for auditory brackets encapsulating repeating points of interest, and speech for directions. A prototype based on this design is developed and evaluated with 22 sighted and 8 blind participants. The software architecture of the prototype including the route information retrieval and mapping onto audio has been included. The findings show that both groups perform well in route reconstruction and recognition tasks. Moreover, the functional route information and auditory icons are effectively designed and useful in forming a mental model of the route, which improves over time. However, the design of auditory brackets needs further improvement and testing. At all stages of the system development, input has been acquired from the end-user population and the design is adapted accordingly.

A Participatory Design Approach to Creating Echolocation-Enabled Virtual Environments

As virtual environments—in the form of videogames and augmented and virtual reality experiences—become more popular, it is important to ensure that they are accessible to all. Previous research has identified echolocation as a useful interaction approach to enable people with visual impairment to access virtual environments. In this paper, we further investigate the usefulness of echolocation to explore virtual environments. We follow a participatory design approach that comprised a focus group session coupled with two fast prototyping and evaluation iterations. During the focus group session, expert echolocators produced a series of seven design recommendations, of which we implemented and trialed four. Our trials revealed that the use of ambient sounds, the ability to place landmarks, directional control, and the ability to use pre-recorded mouth-clicks produced by expert echolocators improved the overall experience of our participants by facilitating the detection of openings and obstacles. The recommendations presented and evaluated in this paper may help to develop virtual environments that support a broader range of users while recognising the value of the lived experience of people with disability as a source of knowledge.

How 2.5D Maps Design Improve the Wayfinding Performance and Spatial Ability of Map Users

Useful information can be provided by 2.5D maps that can take advantage of the additional dimension. However, aside from stereoscopic landmarks, optimal methods for presenting other essential information is unclear. Two experiments were conducted to explore how the presentation of 2.5D maps can effectively increase wayfinding performance. First, analysis was performed to understand the effects of 2.5D maps on wayfinding behavior and map reading. Then, a 2.5D map design was proposed and verified to optimize the 2.5D map presentation of urban environments. The results showed that compared with users of low view angle maps, those using high view angle maps orientated more easily with elements of the map during wayfinding tasks. High view angle maps allowed superior performance, and including transparency and lines improved wayfinding performance. The participants using maps that were opaque and with lines exhibited the most confusion and hesitation. The participants who used maps that were transparent and had lines exhibited the least confusion and hesitation. Highlighting buildings at intersections can help map users use the intersections as references and increase their intuitive spatial ability.

Cognitive map formation through haptic and visual exploration of tactile city-like maps

In this study, we compared cognitive map formation of small-scale models of city-like environments presented in visual or tactile/haptic modalities. Previous research often addresses only a limited amount of cognitive map aspects. We wanted to combine several of these aspects to elucidate a more complete view. Therefore, we assessed different types of spatial information, and consider egocentric as well as allocentric perspectives. Furthermore, we compared haptic map learning with visual map learning. In total 18 sighted participants (9 in a haptic condition, 9 visuo-haptic) learned three tactile maps of city-like environments. The maps differed in complexity, and had five marked locations associated with unique items. Participants estimated distances between item pairs, rebuilt the map, recalled locations, and navigated two routes, after learning each map. All participants overall performed well on the spatial tasks. Interestingly, only on the complex maps, participants performed worse in the haptic condition than the visuo-haptic, suggesting no distinct advantage of vision on the simple map. These results support ideas of modality-independent representations of space. Although it is less clear on the more complex maps, our findings indicate that participants using only haptic or a combination of haptic and visual information both form a quite accurate cognitive map of a simple tactile city-like map.

Echolocation as a Means for People with Visual Impairment (PVI) to Acquire Spatial Knowledge of Virtual Space

In virtual environments, spatial information is communicated visually. This prevents people with visual impairment (PVI) from accessing such spaces. In this article, we investigate whether echolocation could be used as a tool to convey spatial information by answering the following research questions: What features of virtual space can be perceived by PVI through the use of echolocation? How does active echolocation support PVI in acquiring spatial knowledge of a virtual space? And what are PVI’s opinions regarding the use of echolocation to acquire landmark and survey knowledge of virtual space? To answer these questions, we conducted a two-part within-subjects experiment with 12 people who were blind or had a visual impairment and found that size and materials of rooms and 90-degree turns were detectable through echolocation, participants preferred using echoes derived from footsteps rather than from artificial sound pulses, and echolocation supported the acquisition of mental maps of a virtual space. Ultimately, we propose that appropriately designed echolocation in virtual environments improves understanding of spatial information and access to digital games for PVI.

Environmental Information Required by Individuals with Visual Impairments Who Use Orientation and Mobility Aids to Navigate Campuses

Introduction:

This study investigated the user requirements of individuals with visual impairments regarding the information to be included in orientation and mobility (O&M) aids in order for optimally useful audio-tactile maps of campuses to be developed. In addition, this study aimed at investigating the importance (usefulness) that individuals with visual impairments attribute to environmental information of campuses.

Methods:

The researchers listed 213 pieces of environmental information concerning campuses and address them in survey by conducting a respective questionnaire. Participants were asked to evaluate the information, regarding the importance or usefulness of the information in regard to safety, location of services, and orientation and wayfinding during movement. Through convenience sampling 115 adults (aged from 18 to 64 years) with visual impairments from four countries (Greece, Cyprus, Turkey, and Germany) took part in the research.

Results:

Pieces of environmental information, sorted in descending order starting with the most useful ones, have been listed. A repeated measures analysis of variance yielded a significant main effect for the type of information (safety, location of services, and wayfinding and orientation): F(2, 228) = 70.868, p < .001.

Discussion:

This study resulted in the specification of the most significant or useful information that should be included in O&M aids of campuses for individuals with visual impairments.

Implications for practitioners:

The results of this study will hold the interest of developers of O&M aids, O&M practitioners, rehabilitation teachers, and instructors who design and construct O&M aids. Moreover, the context for appropriately designed tactile or audio-tactile maps for campuses is provided, and campuses around the world could rely on this study for the creation of a valuable accessibility aid.

Spotlights and Soundscapes

For persons with visual impairment, forming cognitive maps of unfamiliar interior spaces can be challenging. Various technical developments have converged to make it feasible, without specialized equipment, to represent a variety of useful landmark objects via spatial audio, rather than solely dispensing route information. Although such systems could be key to facilitating cognitive map formation, high-density auditory environments must be crafted carefully to avoid overloading the listener. This article recounts a set of research exercises with potential users, in which the optimization of such systems was explored. In Experiment 1, a virtual reality environment was used to rapidly prototype and adjust the auditory environment in response to participant comments. In Experiment 2, three variants of the system were evaluated in terms of their effectiveness in a real-world building. This methodology revealed a variety of optimization approaches and recommendations for designing dense mixed-reality auditory environments aimed at supporting cognitive map formation by visually impaired persons.

The Effect of Spatial Tasks on Visually Impaired Peoples’ Wayfinding Abilities

Thirty-eight people with visual impairments learned a 483-meter novel route through a university campus in four groups: verbalization, modeling, pointing, and control. The performance of all four groups improved with greater experience of the route, but the modeling group improved more than did the control group.

Comparing Tactile Maps and Haptic Digital Representations of a Maritime Environment

A map exploration and representation exercise was conducted with participants who were totally blind. Representations of maritime environments were presented either with a tactile map or with a digital haptic virtual map. We assessed the knowledge of spatial configurations using a triangulation technique. The results revealed that both types of map learning were equivalent.

Does Knowledge of Spatial Configuration in Adults with Visual Impairments Improve with Tactile Exposure to a Small-scale Model of Their Urban Environment?

This study assessed the efficiency of a model of a familiar urban area for enhancing knowledge of the spatial environment by adults with visual impairments. It found a significant improvement in knowledge of spatial configuration after exposure to the model, suggesting that models are powerful means of developing cognitive mapping in people who are visually impaired.

Updated Tactile Feedback with a Pin Array Matrix Helps Blind People to Reduce Self-Location Errors

Autonomous navigation in novel environments still represents a challenge for people with visual impairment (VI). Pin array matrices (PAM) are an effective way to display spatial information to VI people in educative/rehabilitative contexts, as they provide high flexibility and versatility. Here, we tested the effectiveness of a PAM in VI participants in an orientation and mobility task. They haptically explored a map showing a scaled representation of a real room on the PAM. The map further included a symbol indicating a virtual target position. Then, participants entered the room and attempted to reach the target three times. While a control group only reviewed the same, unchanged map on the PAM between trials, an experimental group also received an updated map representing, in addition, the position they previously reached in the room. The experimental group significantly improved across trials by having both reduced self-location errors and reduced completion time, unlike the control group. We found that learning spatial layouts through updated tactile feedback on programmable displays outperforms conventional procedures on static tactile maps. This could represent a powerful tool for navigation, both in rehabilitation and everyday life contexts, improving spatial abilities and promoting independent living for VI people.

Map Learning with a 3D Printed Interactive Small-Scale Model: Improvement of Space and Text Memorization in Visually Impaired Students

Special education teachers for visually impaired students rely on tools such as raised-line maps (RLMs) to teach spatial knowledge. These tools do not fully and adequately meet the needs of the teachers because they are long to produce, expensive, and not versatile enough to provide rapid updating of the content. For instance, the same RLM can barely be used during different lessons. In addition, those maps do not provide any interactivity, which reduces students’ autonomy. With the emergence of 3D printing and low-cost microcontrollers, it is now easy to design affordable interactive small-scale models (SSMs) which are adapted to the needs of special education teachers. However, no study has previously been conducted to evaluate non-visual learning using interactive SSMs. In collaboration with a specialized teacher, we designed a SSM and a RLM representing the evolution of the geography and history of a fictitious kingdom. The two conditions were compared in a study with 24 visually impaired students regarding the memorization of the spatial layout and historical contents. The study showed that the interactive SSM improved both space and text memorization as compared to the RLM with braille legend. In conclusion, we argue that affordable home-made interactive small scale models can improve learning for visually impaired students. Interestingly, they are adaptable to any teaching situation including students with specific needs.

Orientation and mobility aids for individuals with blindness: Verbal description vs. audio-tactile map

Individuals with visual impairment face significant challenges traveling in the physical environment. Independent movement is directly connected to the quality of someone's life, and thus, orientation and mobility issues are always listed among the top priorities of research in the field. The aim of the present research was to examine the level of accuracy of the cognitive map developed through the use of a verbal description versus the cognitive map developed using an audio-tactile map. A comparison of the effectiveness of the two mobility aids in detecting specific points of interest in the physical environment was an objective of the research. The procedure involved the study of a map using the two mobility aids, and an assessment through the transfer to the corresponding physical environment. The results suggest that an individual with visual impairment can acquire and use a functional cognitive map through the use of an audio-tactile map, while relying on a verbal description entails greater difficulty in detecting specific points of interest when he/she comes into the physical environment.

Comparison of three orientation and mobility aids for individuals with blindness: Verbal description, audio-tactile map and audio-haptic map

Disorientation and inability of wayfinding are phenomena with a great frequency for individuals with visual impairments during the process of travelling novel environments. Orientation and mobility aids could suggest important tools for the preparation of a more secure and cognitively mapped travelling. The aim of the present study was to examine if spatial knowledge structured after an individual with blindness had studied the map of an urban area that was delivered through a verbal description, an audio-tactile map or an audio-haptic map, could be used for detecting in the area specific points of interest. The effectiveness of the three aids with reference to each other was also examined. The results of the present study highlight the effectiveness of the audio-tactile and the audio-haptic maps as orientation and mobility aids, especially when these are compared to verbal descriptions.

Spatial navigation by congenitally blind individuals

Spatial navigation in the absence of vision has been investigated from a variety of perspectives and disciplines. These different approaches have progressed our understanding of spatial knowledge acquisition by blind individuals, including their abilities, strategies, and corresponding mental representations. In this review, we propose a framework for investigating differences in spatial knowledge acquisition by blind and sighted people consisting of three longitudinal models (i.e., convergent, cumulative, and persistent). Recent advances in neuroscience and technological devices have provided novel insights into the different neural mechanisms underlying spatial navigation by blind and sighted people and the potential for functional reorganization. Despite these advances, there is still a lack of consensus regarding the extent to which locomotion and wayfinding depend on amodal spatial representations. This challenge largely stems from methodological limitations such as heterogeneity in the blind population and terminological ambiguity related to the concept of cognitive maps. Coupled with an over‐reliance on potential technological solutions, the field has diffused into theoretical and applied branches that do not always communicate. Here, we review research on navigation by congenitally blind individuals with an emphasis on behavioral and neuroscientific evidence, as well as the potential of technological assistance. Throughout the article, we emphasize the need to disentangle strategy choice and performance when discussing the navigation abilities of the blind population. WIREs Cogn Sci 2016, 7:37–58. doi: 10.1002/wcs.1375

For further resources related to this article, please visit the WIREs website.

Sequential vs simultaneous encoding of spatial information: a comparison between the blind and the sighted

The aim of this research is to assess whether the crucial factor in determining the characteristics of blind people's spatial mental images is concerned with the visual impairment per se or the processing style that the dominant perceptual modalities used to acquire spatial information impose, i.e. simultaneous (vision) vs sequential (kinaesthesis). Participants were asked to learn six positions in a large parking area via movement alone (congenitally blind, adventitiously blind, blindfolded sighted) or with vision plus movement (simultaneous sighted, sequential sighted), and then to mentally scan between positions in the path. The crucial manipulation concerned the sequential sighted group. Their visual exploration was made sequential by putting visual obstacles within the pathway in such a way that they could not see simultaneously the positions along the pathway. The results revealed a significant time/distance linear relation in all tested groups. However, the linear component was lower in sequential sighted and blind participants, especially congenital. Sequential sighted and congenitally blind participants showed an almost overlapping performance. Differences between groups became evident when mentally scanning farther distances (more than 5m). This threshold effect could be revealing of processing limitations due to the need of integrating and updating spatial information. Overall, the results suggest that the characteristics of the processing style rather than the visual impairment per se affect blind people's spatial mental images.

A Virtual Environment for People Who Are Blind - A Usability Study

For most people who are blind, exploring an unknown environment can be unpleasant, uncomfortable, and unsafe. Over the past years, the use of virtual reality as a learning and rehabilitation tool for people with disabilities has been on the rise. This research is based on the hypothesis that the supply of appropriate perceptual and conceptual information through compensatory sensorial channels may assist people who are blind with anticipatory exploration. In this research we developed and tested the BlindAid system, which allows the user to explore a virtual environment. The two main goals of the research were: (a) evaluation of different modalities (haptic and audio) and navigation tools, and (b) evaluation of spatial cognitive mapping employed by people who are blind. Our research included four participants who are totally blind. The preliminary findings confirm that the system enabled participants to develop comprehensive cognitive maps by exploring the virtual environment.

Newly blind persons using virtual environment system in a traditional orientation and mobility rehabilitation program: a case study

This paper presents a virtual reality system (the BlindAid) developed for orientation and mobility training of people who are newly blind. The BlindAid allows users to interact with different virtual structures and objects via auditory and haptic feedback. This case study aims to examine if and how the BlindAid, in conjunction with a traditional rehabilitation programme, can help people who are newly blind develop new orientation and mobility methods. Follow-up research based on this study, with a large experiment and control group, could contribute to the area of orientation and mobility rehabilitation training for the newly blind. The case study research focused on A., a woman who is newly blind, for 17 virtual sessions spanning ten weeks, during the 12 weeks of her traditional orientation and mobility rehabilitation programme. The research was implemented by using virtual environment (VE) exploration and orientation tasks in VE and physical spaces. The research methodology used both qualitative and quantitative methods, including interviews, questionnaire, videotape recording, and user computer logs. The results of this study helped elucidate several issues concerning the contribution of the BlindAid system to the exploration strategies and learning processes experienced by the participant in her encounters with familiar and unfamiliar physical surroundings. [Box: see text].

Evaluation of Haptic HTML Mappings Derived from a Novel Methodology

As levels of awareness surrounding accessibility increase, designers often look towards using nonvisual technologies to make existing graphical interfaces (e.g. Web pages) more inclusive. As existing haptic design guidance is not targeted to the specific needs of blind Web users, inappropriate touchable representations of graphical objects may be developed and integrated with Web interfaces, thereby reducing the quality of the browsing experience. This paper describes the evaluation of haptic HTML mappings that were developed using a participatory-design based technique, and presented using the Logitech Wingman force-feedback mouse. Findings have shown that participants were able to identify objects presented haptically, and develop a structural representation of layout from exploring content. Participants were able to perform a range of Web-based tasks that were previously found to be difficult for some blind users when using a screen reader alone. The haptic HTML mappings are presented, along with recommendations for their application derived from a validation study. The design guidance presented offers a standard reference tool for Web designers wanting to develop an accessible browsing application, using the benefits offered by a force-feedback mouse.

Using the voice of the child who is blind as a tool for exploring spatial perception

Researchers from different disciplines have attempted to investigate the way in which people who are blind conceptualize and perceive elements of the spatial environment. Most of the studies that are reported in the literature use an experimental approach based on measurements of the performance in test situations of people who are blind or people who are sighted but who are blindfolded. The findings from these studies are important and have shed light on the process of understanding spatial relations in both small- and large-scale space. However, they have sometimes produced contrasting findings. The study the authors are currently involved in diverges from other studies in this key area in that the method used is essentially qualitative and participatory in character. This article gives an example of using the child’s voice to explore spatial understanding and involves a narrative account from a 13-year-old student who was blind from birth about the strategies he uses to overcome the challenges he faces in making sense of space. The results suggest that the child’s voice can provide insights into spatial understanding that can be used to help triangulate the findings and understandings achieved from the experimental approaches that dominate the literature.

Qualitative map learning based on covisibility of objects

Autonomous map construction is one of the most fundamental and significant issues in intelligent mobile robot research. While a variety of map construction methods have been proposed, most require some quantitative measurements of the environment and a mechanism of precise self-localization. This paper proposes a novel map construction method using only qualitative information about "how often two objects are observed simultaneously." This method is based on heuristics--"closely located objects are likely to be seen simultaneously more often than distant objects" and a well-known multivariate data analysis technique-multidimensional scaling. A significant feature of this method is that it requires neither quantitative sensor measurements nor information about the robot's own position. Simulation and experimental results demonstrated that this method is sufficiently practical for capturing a qualitative spatial relationship among identifiable landmark objects rapidly.