Differences between early-blind, late-blind, and blindfolded-sighted people in haptic spatial-configuration learning and resulting memory traces

Child development and the role of visual experience in the use of spatial and non-spatial features in haptic object perception

Previous work has suggested a different developmental timeline and role of visual experience for the use of spatial and non-spatial features in haptic object recognition. To investigate this conjecture, we used a haptic ambiguous odd-one-out task in which one object needed to be selected as being different from two other objects. The odd-one-out could be selected based on four characteristics: size, shape (spatial), texture, and weight (non-spatial). We tested sighted children from 4 to 12 years of age; congenitally blind, late blind, and adult participants with low vision; and normally sighted adults. Given the protracted developmental time course for spatial perception, we expected a shift from a preference for non-spatial features toward spatial features during typical development. Due to the dominant influence of vision for spatial perception, we expected congenitally blind adults to show a similar preference for non-spatial features as the youngest children. The results confirmed our first hypothesis; the 4-year-olds demonstrated a lower dominance for spatial features for object classification compared with older children and sighted adults. In contrast, our second hypothesis was not confirmed; congenitally blind adults' preferred categorization criteria were indistinguishable from those of sighted controls. These findings suggest an early development, but late maturation, of spatial processing in haptic object recognition independent of visual experience.

Adults' spatial scaling of tactile maps: Insights from studying sighted, early and late blind individuals

The current study investigated spatial scaling of tactile maps among blind adults and blindfolded sighted controls. We were specifically interested in identifying spatial scaling strategies as well as effects of different scaling directions (up versus down) on participants' performance. To this aim, we asked late blind participants (with visual memory, Experiment 1) and early blind participants (without visual memory, Experiment 2) as well as sighted blindfolded controls to encode a map including a target and to place a response disc at the same spot on an empty, constant-sized referent space. Maps had five different sizes resulting in five scaling factors (1:3, 1:2, 1:1, 2:1, 3:1), allowing to investigate different scaling directions (up and down) in a single, comprehensive design. Accuracy and speed of learning about the target location as well as responding served as dependent variables. We hypothesized that participants who can use visual mental representations (i.e., late blind and blindfolded sighted participants) may adopt mental transformation scaling strategies. However, our results did not support this hypothesis. At the same time, we predicted the usage of relative distance scaling strategies in early blind participants, which was supported by our findings. Moreover, our results suggested that tactile maps can be scaled as accurately and even faster by blind participants than by sighted participants. Furthermore, irrespective of the visual status, participants of each visual status group gravitated their responses towards the center of the space. Overall, it seems that a lack of visual imagery does not impair early blind adults' spatial scaling ability but causes them to use a different strategy than sighted and late blind individuals.

An investigation into the effectiveness of using acoustic touch to assist people who are blind

Wearable smart glasses are an emerging technology gaining popularity in the assistive technologies industry. Smart glasses aids typically leverage computer vision and other sensory information to translate the wearer's surrounding into computer-synthesized speech. In this work, we explored the potential of a new technique known as "acoustic touch" to provide a wearable spatial audio solution for assisting people who are blind in finding objects. In contrast to traditional systems, this technique uses smart glasses to sonify objects into distinct sound auditory icons when the object enters the device's field of view. We developed a wearable Foveated Audio Device to study the efficacy and usability of using acoustic touch to search, memorize, and reach items. Our evaluation study involved 14 participants, 7 blind or low-visioned and 7 blindfolded sighted (as a control group) participants. We compared the wearable device to two idealized conditions, a verbal clock face description and a sequential audio presentation through external speakers. We found that the wearable device can effectively aid the recognition and reaching of an object. We also observed that the device does not significantly increase the user's cognitive workload. These promising results suggest that acoustic touch can provide a wearable and effective method of sensory augmentation.

The Role of Spatial and Modality Cues on Visual and Haptic Memory

This study investigates the ability to remember a sequence of stimuli in two basic conditions: haptic and visual. Participants rely on a combination of modal and/or spatial information to perform a memory task. For this purpose, an experimental setup was developed based on the "Simon Says" memory game. Individuals receive a series of sensory stimuli and need to remember the sequence and repeat it. The stimuli in visual conditions are colored or white lights, and the stimuli in haptic conditions are vibration, hot, cold, and skin stretch. Results demonstrate that participants retained longer sequences in spatial conditions compared to the modal conditions. It is also demonstrated that participants performed better in visual conditions compared to haptic conditions. Participants were able to retain more complex spatial patterns and remember them faster in visual conditions compared to haptic conditions. A spatial difficulty ranking system was developed, indicating how easily each spatial pattern can be retained visually and haptically.

How ageing and blindness affect egocentric and allocentric spatial memory

Egocentric (subject-to-object) and allocentric (object-to-object) spatial reference frames are fundamental for representing the position of objects or places around us. The literature on spatial cognition in blind people has shown that lack of vision may limit the ability to represent spatial information in an allocentric rather than egocentric way. Furthermore, much research with sighted individuals has reported that ageing has a negative impact on spatial memory. However, as far as we know, no study has assessed how ageing may affect the processing of spatial reference frames in individuals with different degrees of visual experience. To fill this gap, here we report data from a cross-sectional study in which a large sample of young and elderly participants (160 participants in total) who were congenitally blind (long-term visual deprivation), adventitiously blind (late onset of blindness), blindfolded sighted (short-term visual deprivation) and sighted (full visual availability) performed a spatial memory task that required egocentric/allocentric distance judgements with regard to memorised stimuli. The results showed that egocentric judgements were better than allocentric ones and above all that the ability to process allocentric information was influenced by both age and visual status. Specifically, the allocentric judgements of congenitally blind elderly participants were worse than those of all other groups. These findings suggest that ageing and congenital blindness can contribute to the worsening of the ability to represent spatial relationships between external, non-body-centred anchor points.

HELF (Haptic Encoded Language Framework): a digital script for deaf-blind and visually impaired

PURPOSE

Digital media has brought a revolution, making the world a global village. For people who are visually impaired and people with visual and hearing impairment, navigating through the digital world can be as precarious as moving through the real world. To enable them to connect with the digital world, we propose a solution, Haptic Encoded Language Framework (HELF), that uses haptic technology to enable them to write digital text using swiping gestures and understand the text through vibrations.

METHOD

We developed an Android application to present the concept of HELF and evaluate its performance. We tested the application on 13 users (five visually impaired and eight sighted individuals).

RESULTS

The preliminary exploratory analysis of the proposed framework using the Android application developed reveals encouraging results. Overall, the reading accuracy has been found to be approximately 91%, and the average CPM is found to be 25.7.

CONCLUSION

The volunteering users of the HELF Android application found it useful as a means of using the digital media and recommended its usage as an assistive technology for the visually challenged. The results of their performance of using the application motivate further research and development in the proposed work to make HELF more usable by people who are visually impaired and people with visual and hearing impairment.

Allocentric spatial perception through vision and touch in sighted and blind children

Vision and touch play a critical role in spatial development, facilitating the acquisition of allocentric and egocentric frames of reference, respectively. Previous works have shown that children's ability to adopt an allocentric frame of reference might be impaired by the absence of visual experience during growth. In the current work, we investigated whether visual deprivation also impairs the ability to shift from egocentric to allocentric frames of reference in a switching-perspective task performed in the visual and haptic domains. Children with and without visual impairments from 6 to 13 years of age were asked to visually (only sighted children) or haptically (blindfolded sighted children and blind children) explore and reproduce a spatial configuration of coins by assuming either an egocentric perspective or an allocentric perspective. Results indicated that temporary visual deprivation impaired the ability of blindfolded sighted children to switch from egocentric to allocentric perspective more in the haptic domain than in the visual domain. Moreover, results on visually impaired children indicated that blindness did not impair allocentric spatial coding in the haptic domain but rather affected the ability to rely on haptic egocentric cues in the switching-perspective task. Finally, our findings suggested that the total absence of vision might impair the development of an egocentric perspective in case of body midline-crossing targets.

Core knowledge of geometry can develop independently of visual experience

Geometrical intuitions spontaneously drive visuo-spatial reasoning in human adults, children and animals. Is their emergence intrinsically linked to visual experience, or does it reflect a core property of cognition shared across sensory modalities? To address this question, we tested the sensitivity of blind-from-birth adults to geometrical-invariants using a haptic deviant-figure detection task. Blind participants spontaneously used many geometric concepts such as parallelism, right angles and geometrical shapes to detect intruders in haptic displays, but experienced difficulties with symmetry and complex spatial transformations. Across items, their performance was highly correlated with that of sighted adults performing the same task in touch (blindfolded) and in vision, as well as with the performances of uneducated preschoolers and Amazonian adults. Our results support the existence of an amodal core-system of geometry that arises independently of visual experience. However, performance at selecting geometric intruders was generally higher in the visual compared to the haptic modality, suggesting that sensory-specific spatial experience may play a role in refining the properties of this core-system of geometry.

Effects of Increasing Stimulated Area in Spatiotemporally Congruent Unisensory and Multisensory Conditions

Research has shown that the ability to integrate complementary sensory inputs into a unique and coherent percept based on spatiotemporal coincidence can improve perceptual precision, namely multisensory integration. Despite the extensive research on multisensory integration, very little is known about the principal mechanisms responsible for the spatial interaction of multiple sensory stimuli. Furthermore, it is not clear whether the size of spatialized stimulation can affect unisensory and multisensory perception. The present study aims to unravel whether the stimulated area’s increase has a detrimental or beneficial effect on sensory threshold. Sixteen typical adults were asked to discriminate unimodal (visual, auditory, tactile), bimodal (audio-visual, audio-tactile, visuo-tactile) and trimodal (audio-visual-tactile) stimulation produced by one, two, three or four devices positioned on the forearm. Results related to unisensory conditions indicate that the increase of the stimulated area has a detrimental effect on auditory and tactile accuracy and visual reaction times, suggesting that the size of stimulated areas affects these perceptual stimulations. Concerning multisensory stimulation, our findings indicate that integrating auditory and tactile information improves sensory precision only when the stimulation area is augmented to four devices, suggesting that multisensory interaction is occurring for expanded spatial areas.

Accessing Passersby Proxemic Signals through a Head-Worn Camera: Opportunities and Limitations for the Blind

The spatial behavior of passersby can be critical to blind individuals to initiate interactions, preserve personal space, or practice social distancing during a pandemic. Among other use cases, wearable cameras employing computer vision can be used to extract proxemic signals of others and thus increase access to the spatial behavior of passersby for blind people. Analyzing data collected in a study with blind (N=10) and sighted (N=40) participants, we explore: (i) visual information on approaching passersby captured by a head-worn camera; (ii) pedestrian detection algorithms for extracting proxemic signals such as passerby presence, relative position, distance, and head pose; and (iii) opportunities and limitations of using wearable cameras for helping blind people access proxemics related to nearby people. Our observations and findings provide insights into dyadic behaviors for assistive pedestrian detection and lead to implications for the design of future head-worn cameras and interactions.

The Effects of an Ecological Diversifying Experience on Creativity: An Experimental Study

Sometimes, life houses rare and unexpected events, such as moving abroad or meeting a special person unexpectedly. Recently, these situations have been indicated as "diversifying experiences" (DEs), defined as unusual and unexpected events that drag people outside their daily routine and accustomed schemas. The core mechanism of DEs would entail the disruption of our mental schema, which can facilitate unexpected connections among even distant ideas, thus enhancing people's cognitive flexibility, that is, a key component of creative thinking. Despite both qualitative and lab-based studies have investigated the features of these experiences, an ecological assessment of their properties also in relation with creativity is still an open issue. The aim of this research is to study the DE-creativity link in a more ecological way, on the basis of a real-life disruptive experience of light deprivation. Specifically, we compared an ecological DE artistic established entertainment format (i.e., "dialogue in the dark," which is seeing people perform several daily life activities but in the absence of light) with an equivalent experience in which the same activities were acted in the sunlight. The absence of light played the role of violating mechanism, framed within the ecological experiential format of the "dialogue in the dark." We compared visitors' emotional profile [Positive and Negative Affect Schedule (PANAS), ad hoc Adjective Checklist], perceived impact of the experience [Centrality of Event Scale (CES)], and creative performance [Torrance Tests of Creative Thinking (TTCT)] in both groups of sighted people (in absence of light vs. in presence of light); and we also controlled for people's openness to experience and need for cognitive closure, as dispositions. Results showed that (vs. control group) "dialogue in the dark" (i) led to worse creative performances, (ii) produced more intense positive affect, and (iii) resulted as a more impacting experience. Intense short-term impact of DE could have been detrimental for participants' creativity. People may need more time to elaborate the DE and accommodate existing schema to generate more creative ideas. This is the first study proposing and succeeding in demonstrating the feasibility to investigate even real complex DEs in a controlled way, thus outlining how their link with creativity can take place in real life.

Identification of Textured Tactile Pictures in Visually Impaired and Blindfolded Sighted Children

A high level of variability in the capacity of visually impaired children to accurately identify tactile images is reported in the literature, with on average rather low percentages of correct naming responses. However, most of these studies used raised-line drawings as stimuli to be explored and named. The present experiment investigated whether blind children of 3 to 8 years of age would demonstrate a satisfactory ability to name the elements making up tactile images when tested in an experimental setting similar to their natural reading conditions. Textured tactile images taken from genuine illustrated tactile books for young children were used, and the participants received information about the title of the book or listened the text that accompanied each picture before exploration, as it would occur in a natural reading setting. The results showed that their naming scores were indeed higher than previously reported at equivalent ages and did not differ from those of age-matched sighted children. These scores were positively impacted by haptic practice in blind children and correlated with the use of some specific exploratory procedures. The blind children benefited from information provided before exploration, as did their sighted counterparts. However, only in the former did the condition in which full information was provided influence the way the children organized their exploration. The haptic identification scores increased with age regardless of visual status, with the exploration times decreasing in the blind children, while the reverse trend was observed in the sighted children. These results are discussed at the light of the image-mediation model of haptics, suggesting that during the age period considered in the present experiment, blind children would progressively learn to process haptic information directly, thus leading to a decrease of exploration times, while sighted children would learn to translate haptic information into a visual image used to retrieve semantic information, involving an increase of their exploration times.

Improved access to museum collections without vision: How museum visitors with very low or no vision perceive and process tactile–auditory pictures

This study investigated how museum visitors with very low or no vision perceived and processed tactile pictures and/or audio-descriptions of visual paintings. Two visual paintings were selected and a focus group was established ( N = 8). Qualitative interview and observation data were collected. This study found two types of museum visitors: those who explored the tactile picture first and those who rather listened to the audio-description. When exploring each element in the tactile picture, they all started by exploring the element’s global (shape) outline and, when struggling to recognise it, turned to the audio-description. They preferred the audio-description to start describing where their fingers were. Tactile texture attracted their attention, sparked their curiosity, and enabled them to create a mental image of the tactile picture, but also confused them. They preferred the global (element shape) outline to be straightened out, so that curves become angular, and texture only for targeting certain elements.

Enhancing general spatial skills of young visually impaired people with a programmable distance discrimination training: a case control study

BACKGROUND

The estimation of relative distance is a perceptual task used extensively in everyday life. This important skill suffers from biases that may be more pronounced when estimation is based on haptics. This is especially true for the blind and visually impaired, for which haptic estimation of distances is paramount but not systematically trained. We investigated whether a programmable tactile display, used autonomously, can improve distance discrimination ability in blind and severely visually impaired youngsters between 7 and 22 years-old.

METHODS

Training consisted of four weekly sessions in which participants were asked to haptically find, on the programmable tactile display, the pairs of squares which were separated by the shortest and longest distance in tactile images with multiple squares. A battery of haptic tests with raised-line drawings was administered before and after training, and scores were compared to those of a control group that did only the haptic battery, without doing the distance discrimination training on the tactile display.

RESULTS

Both blind and severely impaired youngsters became more accurate and faster at the task during training. In haptic battery results, blind and severely impaired youngsters who used the programmable display improved in three and two tests, respectively. In contrast, in the control groups, the blind control group improved in only one test, and the severely visually impaired in no tests.

CONCLUSIONS

Distance discrimination skills can be trained equally well in both blind and severely impaired participants. More importantly, autonomous training with the programmable tactile display had generalized effects beyond the trained task. Participants improved not only in the size discrimination test but also in memory span tests. Our study shows that tactile stimulation training that requires minimal human assistance can effectively improve generic spatial skills.

The format of mental imagery: from a critical review to an integrated embodied representation approach

The issue of the format of mental imagery is still an open debate. The classical analogue (depictive)-propositional (descriptive) debate has not provided definitive conclusions. Over the years, the debate has shifted within the frame of the embodied cognition approach, which focuses on the interdependence of perception, cognition and action. Although the simulation approach still retains the concept of representation, the more radical line of the embodied cognition approach emphasizes the importance of action and clearly disregards the concept of representation. In particular, the enactive approach focuses on motor procedures that allow the body to interact with the environment, whereas the sensorimotor approach focuses on the possession and exercise of sensorimotor knowledge about how the sensory input changes as a function of movement. In this review, the embodied approaches are presented and critically discussed. Then, in an attempt to show that the format of mental imagery varies according to the ability and the strategy used to represent information, the role of individual differences in imagery ability (e.g., vividness and expertise) and imagery strategy (e.g., object vs. spatial imagers) is reviewed. Since vividness is mainly associated with perceptual information, reflecting the activation level of specific imagery systems, whereas the preferred strategy used is mainly associated with perceptual (e.g., object imagery) or amodal and motor information (e.g., spatial imagery), the format of mental imagery appears to be based on dynamic embodied representations, depending on imagery abilities and imagery strategies.

Neurocognitive Functioning of Sport Climbers

Sport climbing, included in the programme of the Tokyo 2020 Summer Olympic Games, is increasingly gaining in popularity as a method of physical and mental health enhancement. Studies show a positive relationship between climbing and improvement of neurocognitive functioning. The aim of this study was to determine the differences in neurocognitive indicators: time of testing, memory, and location between climbers and non-climbers. The sample comprised 30 sport climbers (15 males, 15 females; aged 25 ± 4 years) practicing climbing regularly for five years, and 30 non-climbing age- and sex-matched controls. The Tactual Performance Test (Halstead-Reitan Test Battery) was used to measure neurocognitive functions (tactile-spatial functions, motion coordination, kinesthetic abilities, learning, memory). Significant differences were found between sport climbers and controls in reference to time, memory, and location (p < 0.05). Climbers reached higher memory as well as location ratios and lower time ratios in comparison to controls. Different strategies used to complete the task between the two groups were observed. The neurocognitive functioning of sport climbers manifests itself in faster recognition and differentiation of tactile input and better spatial perception, tactile perception, and movement memory.

Improving spatial working memory in blind and sighted youngsters using programmable tactile displays

OBJECTIVE

To investigate whether training with tactile matrices displayed with a programmable tactile display improves recalling performance of spatial images in blind, low-vision and sighted youngsters. To code and understand the behavioral underpinnings of learning two-dimensional tactile dispositions, in terms of spontaneous exploration strategies.

METHODS

Three groups of blind, low-vision and sighted youngsters between 6 and 18 years old performed four training sessions with a weekly schedule in which they were asked to memorize single or double spatial layouts, featured as two-dimensional matrices.

RESULTS

Results showed that all groups of participants significantly improved their recall performance compared to the first session baseline in the single-matrix task. No statistical difference in performance between groups emerged in this task. Instead, the learning effect in visually impaired participants is reduced in the double-matrix task, whereas it is still robust in blindfolded sighted controls. We also coded tactile exploration strategies in both tasks and their correlation with performance. Sighted youngsters, in particular, favored a proprioceptive exploration strategy. Finally, performance in the double-matrix task negatively correlated with using one hand and positively correlated with a proprioceptive strategy.

CONCLUSION

The results of our study indicate that blind persons do not easily process two separate spatial layouts. However, rehabilitation programs promoting bi-manual and proprioceptive approaches to tactile exploration might help improve spatial abilities. Finally, programmable tactile displays are an effective way to make spatial and graphical configurations accessible to visually impaired youngsters and they can be profitably exploited in rehabilitation.

Balance in Blind Subjects: Cane and Fingertip Touch Induce Similar Extent and Promptness of Stance Stabilization

Subjects with low vision often use a cane when standing and walking autonomously in everyday life. One aim of this study was to assess differences in the body stabilizing effect produced by the contact of the cane with the ground or by the fingertip touch of a firm surface. Another aim was to estimate the promptness of balance stabilization (or destabilization) on adding (or withdrawing) the haptic input from cane or fingertip. Twelve blind subjects and two subjects with severe visual impairment participated in two experimental protocols while maintaining the tandem Romberg posture on a force platform. In one protocol, subjects lowered the cane to a second platform on the ground and lifted it in sequence at their own pace. In the other protocol, they touched an instrumented pad with the index finger and withdrew the finger from the pad in sequence. In both protocols, subjects were asked to exert a force not granting mechanical stabilization. Under steady-state condition, the finger touch or the contact of the cane with the ground significantly reduced (to ∼78% and ∼86%, respectively) the amplitude of medio-lateral oscillation of the centre of foot pressure (CoP). Oscillation then increased when haptic information was removed. The delay to the change in body oscillation after the haptic shift was longer for addition than withdrawal of the haptic information (∼1.4 s and ∼0.7 s, respectively; p < 0.001), but was not different between the two haptic conditions (finger and cane). Similar stabilizing effects of input from cane on the ground and from fingertip touch, and similar latencies to integrate haptic cue from both sources, suggest that the process of integration of the input for balance control is initiated by the haptic stimulus at the interface cane-hand. Use of a tool is as helpful as the fingertip input, and does not produce different stabilization. Further, the latencies to haptic cue integration (from fingertip or cane) are similar to those previously found in a group of sighted subjects, suggesting that integration delays for automatic balance stabilization are not modified by visual impairment. Haptic input from a tool is easily exploited by the neural circuits subserving automatic balance stabilization in blind people, and its use should be enforced by sensory-enhancing devices and appropriate training.

Mental Imagery Follows Similar Cortical Reorganization as Perception: Intra-Modal and Cross-Modal Plasticity in Congenitally Blind

Cortical plasticity in congenitally blind individuals leads to cross-modal activation of the visual cortex and may lead to superior perceptual processing in the intact sensory domains. Although mental imagery is often defined as a quasi-perceptual experience, it is unknown whether it follows similar cortical reorganization as perception in blind individuals. In this study, we show that auditory versus tactile perception evokes similar intra-modal discriminative patterns in congenitally blind compared with sighted participants. These results indicate that cortical plasticity following visual deprivation does not influence broad intra-modal organization of auditory and tactile perception as measured by our task. Furthermore, not only the blind, but also the sighted participants showed cross-modal discriminative patterns for perception modality in the visual cortex. During mental imagery, both groups showed similar decoding accuracies for imagery modality in the intra-modal primary sensory cortices. However, no cross-modal discriminative information for imagery modality was found in early visual cortex of blind participants, in contrast to the sighted participants. We did find evidence of cross-modal activation of higher visual areas in blind participants, including the representation of specific-imagined auditory features in visual area V4.

Updated Tactile Feedback with a Pin Array Matrix Helps Blind People to Reduce Self-Location Errors

Autonomous navigation in novel environments still represents a challenge for people with visual impairment (VI). Pin array matrices (PAM) are an effective way to display spatial information to VI people in educative/rehabilitative contexts, as they provide high flexibility and versatility. Here, we tested the effectiveness of a PAM in VI participants in an orientation and mobility task. They haptically explored a map showing a scaled representation of a real room on the PAM. The map further included a symbol indicating a virtual target position. Then, participants entered the room and attempted to reach the target three times. While a control group only reviewed the same, unchanged map on the PAM between trials, an experimental group also received an updated map representing, in addition, the position they previously reached in the room. The experimental group significantly improved across trials by having both reduced self-location errors and reduced completion time, unlike the control group. We found that learning spatial layouts through updated tactile feedback on programmable displays outperforms conventional procedures on static tactile maps. This could represent a powerful tool for navigation, both in rehabilitation and everyday life contexts, improving spatial abilities and promoting independent living for VI people.

Spatial Representation of the Workspace in Blind, Low Vision, and Sighted Human Participants

It has been proposed that haptic spatial perception depends on one's visual abilities. We tested spatial perception in the workspace using a combination of haptic matching and line drawing tasks. There were 132 participants with varying degrees of visual ability ranging from congenitally blind to normally sighted. Each participant was blindfolded and asked to match a haptic target position felt under a table with their nondominant hand using a pen in their dominant hand. Once the pen was in position on the tabletop, they had to draw a line of equal length to a previously felt reference object by moving the pen laterally. We used targets at three different locations to evaluate whether different starting positions relative to the body give rise to different matching errors, drawn line lengths, or drawn line angles. We found no influence of visual ability on matching error, drawn line length, or line angle, but we found that early-blind participants are slightly less consistent in their matching errors across space. We conclude that the elementary haptic abilities tested in these tasks do not depend on visual experience.

Quantifying the impact on navigation performance in visually impaired: Auditory information loss versus information gain enabled through electronic travel aids

This study’s purpose was to analyze and quantify the impact of auditory information loss versus information gain provided by electronic travel aids (ETAs) on navigation performance in people with low vision. Navigation performance of ten subjects (age: 54.9±11.2 years) with visual acuities >1.0 LogMAR was assessed via the Graz Mobility Test (GMT). Subjects passed through a maze in three different modalities: ‘Normal’ with visual and auditory information available, ‘Auditory Information Loss’ with artificially reduced hearing (leaving only visual information), and ‘ETA’ with a vibrating ETA based on ultrasonic waves, thereby facilitating visual, auditory, and tactile information. Main performance measures comprised passage time and number of contacts. Additionally, head tracking was used to relate head movements to motion direction. When comparing ‘Auditory Information Loss’ to ‘Normal’, subjects needed significantly more time (p<0.001), made more contacts (p<0.001), had higher relative viewing angles (p = 0.002), and a higher percentage of orientation losses (p = 0.011). The only significant difference when comparing ‘ETA’ to ‘Normal’ was a reduced number of contacts (p<0.001). Our study provides objective, quantifiable measures of the impact of reduced hearing on the navigation performance in low vision subjects. Significant effects of ‘Auditory Information Loss’ were found for all measures; for example, passage time increased by 17.4%. These findings show that low vision subjects rely on auditory information for navigation. In contrast, the impact of the ETA was not significant but further analysis of head movements revealed two different coping strategies: half of the subjects used the ETA to increase speed, whereas the other half aimed at avoiding contacts.

How individuals who are blind locate targets

How do individuals who are blind locate, for example, the ‘@’ in an email address, the black king on a chessboard or their own house on a map? To locate information in peri-personal (non-rotated) tabletop space is a two-phase process: Phase 1 is to detect and identify the target; Phase 2 is to discover its position. This study investigated the relationship between Phase 1 and Phase 2 of the location process. A total of 23 individuals who are blind participated. Their accuracy in Phase 2 was affected by what strategy they had adopted in Phase 1; their location time was not. Three location strategies were identified in Phase 2 – the routing strategy, the global view strategy, and the touch vision strategy: the location time and accuracy not affected by which strategy had been adopted. 50% adopted the same strategy for ranking (Phase 1) target-discriminating features and (Phase 2) target-locating cues in order of importance.

Peripersonal space representation develops independently from visual experience

Our daily-life actions are typically driven by vision. When acting upon an object, we need to represent its visual features (e.g. shape, orientation, etc.) and to map them into our own peripersonal space. But what happens with people who have never had any visual experience? How can they map object features into their own peripersonal space? Do they do it differently from sighted agents? To tackle these questions, we carried out a series of behavioral experiments in sighted and congenitally blind subjects. We took advantage of a spatial alignment effect paradigm, which typically refers to a decrease of reaction times when subjects perform an action (e.g., a reach-to-grasp pantomime) congruent with that afforded by a presented object. To systematically examine peripersonal space mapping, we presented visual or auditory affording objects both within and outside subjects’ reach. The results showed that sighted and congenitally blind subjects did not differ in mapping objects into their own peripersonal space. Strikingly, this mapping occurred also when objects were presented outside subjects’ reach, but within the peripersonal space of another agent. This suggests that (the lack of) visual experience does not significantly affect the development of both one’s own and others’ peripersonal space representation.

Allocentric and contra-aligned spatial representations of a town environment in blind people

Evidence concerning the representation of space by blind individuals is still unclear, as sometimes blind people behave like sighted people do, while other times they present difficulties. A better understanding of blind people's difficulties, especially with reference to the strategies used to form the representation of the environment, may help to enhance knowledge of the consequences of the absence of vision. The present study examined the representation of the locations of landmarks of a real town by using pointing tasks that entailed either allocentric points of reference with mental rotations of different degrees, or contra-aligned representations. Results showed that, in general, people met difficulties when they had to point from a different perspective to aligned landmarks or from the original perspective to contra-aligned landmarks, but this difficulty was particularly evident for the blind. The examination of the strategies adopted to perform the tasks showed that only a small group of blind participants used a survey strategy and that this group had a better performance with respect to people who adopted route or verbal strategies. Implications for the comprehension of the consequences on spatial cognition of the absence of visual experience are discussed, focusing in particular on conceivable interventions.

Multimodal Perception of Histological Images for Persons Who Are Blind or Visually Impaired

Lack of suitable substitute assistive technology is a roadblock for students and scientists who are blind or visually impaired (BVI) from advancing in careers in science, technology, engineering, and mathematics (STEM) fields. It is challenging for persons who are BVI to interpret real-time visual scientific data which is commonly generated during lab experimentation, such as performing light microscopy, spectrometry, and observing chemical reactions. To address this problem, a real-time multimodal image perception system was developed to allow standard laboratory blood smear images to be perceived by BVI individuals by employing a combination of auditory, haptic, and vibrotactile feedback. These sensory feedback modalities were used to convey visual information through alternative perceptual channels, thus creating a palette of multimodal, sensory information. Two sets of image features of interest (primary and peripheral features) were applied to characterize images. A Bayesian network was applied to construct causal relations between these two groups of features. In order to match primary features with sensor modalities, two methods were conceived. Experimental results confirmed that this real-time approach produced higher accuracy in recognizing and analyzing objects within images compared to conventional tactile images.

Blindness and social trust: The effect of early visual deprivation on judgments of trustworthiness

Investigating the impact of early visual deprivation on evaluations related to social trust has received little attention to date. This is despite consistent evidence suggesting that early onset blindness may interfere with the normal development of social skills. In this study, we investigated whether early blindness affects judgments of trustworthiness regarding the actions of an agent, with trustworthiness representing the fundamental dimension in the social evaluation. Specifically, we compared performance between a group of early blind individuals with that of sighted controls in their evaluation of trustworthiness of an agent after hearing a pair of two positive or two negative social behaviors (impression formation). Participants then repeated the same evaluation following the presentation of a third (consistent or inconsistent) behavior regarding the same agent (impression updating). Overall, blind individuals tended to give similar evaluations compared to their sighted counterparts. However, they also valued positive behaviors significantly more than sighted controls when forming their impression of an agent's trustworthiness. Moreover, when inconsistent information was provided, blind individuals were more prone to revise their initial evaluation compared to controls. These results suggest that early visual deprivation may have a dramatic effect on the evaluation of social factors such as trustworthiness.

Orientation and mobility aids for individuals with blindness: Verbal description vs. audio-tactile map

Individuals with visual impairment face significant challenges traveling in the physical environment. Independent movement is directly connected to the quality of someone's life, and thus, orientation and mobility issues are always listed among the top priorities of research in the field. The aim of the present research was to examine the level of accuracy of the cognitive map developed through the use of a verbal description versus the cognitive map developed using an audio-tactile map. A comparison of the effectiveness of the two mobility aids in detecting specific points of interest in the physical environment was an objective of the research. The procedure involved the study of a map using the two mobility aids, and an assessment through the transfer to the corresponding physical environment. The results suggest that an individual with visual impairment can acquire and use a functional cognitive map through the use of an audio-tactile map, while relying on a verbal description entails greater difficulty in detecting specific points of interest when he/she comes into the physical environment.

Degrading emotional memories induced by a virtual reality paradigm

BACKGROUND AND OBJECTIVES

In Eye Movement and Desensitization and Reprocessing (EMDR) therapy, a dual-task approach is used: patients make horizontal eye movements while they recall aversive memories. Studies showed that this reduces memory vividness and/or emotionality. A strong explanation is provided by working memory theory, which suggests that other taxing dual-tasks are also effective. Experiment 1 tested whether a visuospatial task which was carried out while participants were blindfolded taxes working memory. Experiment 2 tested whether this task degrades negative memories induced by a virtual reality (VR) paradigm.

METHODS

In experiment 1, participants responded to auditory cues with or without simultaneously carrying out the visuospatial task. In experiment 2, participants recalled negative memories induced by a VR paradigm. The experimental group simultaneously carried out the visuospatial task, and a control group merely recalled the memories. Changes in self-rated memory vividness and emotionality were measured.

RESULTS

The slowing down of reaction times due to the visuospatial task indicated that its cognitive load was greater than the load of the eye movements task in previous studies. The task also led to reductions in emotionality (but not vividness) of memories induced by the VR paradigm.

LIMITATIONS

Weaknesses are that only males were tested in experiment 1, and the effectiveness of the VR fear/trauma induction was not assessed with ratings of mood or intrusions in experiment 2.

CONCLUSIONS

The results suggest that the visuospatial task may be applicable in clinical settings, and the VR paradigm may provide a useful method of inducing negative memories.

The Sound of Vision Project: On the Feasibility of an Audio-Haptic Representation of the Environment, for the Visually Impaired

The Sound of Vision project involves developing a sensory substitution device that is aimed at creating and conveying a rich auditory representation of the surrounding environment to the visually impaired. However, the feasibility of such an approach is strongly constrained by neural flexibility, possibilities of sensory substitution and adaptation to changed sensory input. We review evidence for such flexibility from various perspectives. We discuss neuroplasticity of the adult brain with an emphasis on functional changes in the visually impaired compared to sighted people. We discuss effects of adaptation on brain activity, in particular short-term and long-term effects of repeated exposure to particular stimuli. We then discuss evidence for sensory substitution such as Sound of Vision involves, while finally discussing evidence for adaptation to changes in the auditory environment. We conclude that sensory substitution enterprises such as Sound of Vision are quite feasible in light of the available evidence, which is encouraging regarding such projects.

Spatial navigation by congenitally blind individuals

Spatial navigation in the absence of vision has been investigated from a variety of perspectives and disciplines. These different approaches have progressed our understanding of spatial knowledge acquisition by blind individuals, including their abilities, strategies, and corresponding mental representations. In this review, we propose a framework for investigating differences in spatial knowledge acquisition by blind and sighted people consisting of three longitudinal models (i.e., convergent, cumulative, and persistent). Recent advances in neuroscience and technological devices have provided novel insights into the different neural mechanisms underlying spatial navigation by blind and sighted people and the potential for functional reorganization. Despite these advances, there is still a lack of consensus regarding the extent to which locomotion and wayfinding depend on amodal spatial representations. This challenge largely stems from methodological limitations such as heterogeneity in the blind population and terminological ambiguity related to the concept of cognitive maps. Coupled with an over‐reliance on potential technological solutions, the field has diffused into theoretical and applied branches that do not always communicate. Here, we review research on navigation by congenitally blind individuals with an emphasis on behavioral and neuroscientific evidence, as well as the potential of technological assistance. Throughout the article, we emphasize the need to disentangle strategy choice and performance when discussing the navigation abilities of the blind population. WIREs Cogn Sci 2016, 7:37–58. doi: 10.1002/wcs.1375

For further resources related to this article, please visit the WIREs website.

Allocentric Spatial Performance Higher in Early-Blind and Sighted Adults Than in Retinopathy-of-Prematurity Adults

The question as to whether people totally blind since infancy process allocentric or external spatial information like the sighted has caused considerable debate within the literature. Due to the extreme rarity of the population, researchers have often included individuals with retinopathy of prematurity (RoP--over oxygenation at birth) within the sample. However, RoP is inextricably confounded with prematurity per se. Prematurity, without visual disability, has been associated with spatial processing difficulties. In this experiment, blindfolded sighted participants and two groups of functionally totally blind participants heard text descriptions from a survey (allocentric) or route (egocentric) perspective. One blind group lost their sight due to RoP and a second group before 24 months of age. The accuracy of participants' mental representations derived from the text descriptions was assessed via questions and maps. The RoP participants had lower scores than the sighted and early blind, who performed similarly. In other words, it was not visual impairment alone that resulted in impaired allocentric spatial performance in this task but visual impairment together with RoP. This finding may help explain the contradictions within the existing literature on the role of vision in allocentric spatial processing.

The contributions of vision and haptics to reaching and grasping

This review aims to provide a comprehensive outlook on the sensory (visual and haptic) contributions to reaching and grasping. The focus is on studies in developing children, normal, and neuropsychological populations, and in sensory-deprived individuals. Studies have suggested a right-hand/left-hemisphere specialization for visually guided grasping and a left-hand/right-hemisphere specialization for haptically guided object recognition. This poses the interesting possibility that when vision is not available and grasping relies heavily on the haptic system, there is an advantage to use the left hand. We review the evidence for this possibility and dissect the unique contributions of the visual and haptic systems to grasping. We ultimately discuss how the integration of these two sensory modalities shape hand preference.

The study of blindness and technology can reveal the mechanisms of three-dimensional navigation

Jeffery et al. suggest that three-dimensional environments are not represented according to their volumetric properties, but in a quasi-planar fashion. Here we take into consideration the role of visual experience and the use of technology for spatial learning to better understand the nature of the preference of horizontal over vertical spatial representation.

"To see or not to see: that is the question." The "Protection-Against-Schizophrenia" (PaSZ) model: evidence from congenital blindness and visuo-cognitive aberrations

The causes of schizophrenia are still unknown. For the last 100 years, though, both “absent” and “perfect” vision have been associated with a lower risk for schizophrenia. Hence, vision itself and aberrations in visual functioning may be fundamental to the development and etiological explanations of the disorder. In this paper, we present the “Protection-Against-Schizophrenia” (PaSZ) model, which grades the risk for developing schizophrenia as a function of an individual's visual capacity. We review two vision perspectives: (1) “Absent” vision or how congenital blindness contributes to PaSZ and (2) “perfect” vision or how aberrations in visual functioning are associated with psychosis. First, we illustrate that, although congenitally blind and sighted individuals acquire similar world representations, blind individuals compensate for behavioral shortcomings through neurofunctional and multisensory reorganization. These reorganizations may indicate etiological explanations for their PaSZ. Second, we demonstrate that visuo-cognitive impairments are fundamental for the development of schizophrenia. Deteriorated visual information acquisition and processing contribute to higher-order cognitive dysfunctions and subsequently to schizophrenic symptoms. Finally, we provide different specific therapeutic recommendations for individuals who suffer from visual impairments (who never developed “normal” vision) and individuals who suffer from visual deterioration (who previously had “normal” visual skills). Rather than categorizing individuals as “normal” and “mentally disordered,” the PaSZ model uses a continuous scale to represent psychiatrically relevant human behavior. This not only provides a scientific basis for more fine-grained diagnostic assessments, earlier detection, and more appropriate therapeutic assignments, but it also outlines a trajectory for unraveling the causes of abnormal psychotic human self- and world-perception.

Haptic spatial configuration learning in deaf and hearing individuals

The present study investigated haptic spatial configuration learning in deaf individuals, hearing sign language interpreters and hearing controls. In three trials, participants had to match ten shapes haptically to the cut-outs in a board as fast as possible. Deaf and hearing sign language users outperformed the hearing controls. A similar difference was observed for a rotated version of the board. The groups did not differ, however, on a free relocation trial. Though a significant sign language experience advantage was observed, comparison to results from a previous study testing the same task in a group of blind individuals showed it to be smaller than the advantage observed for the blind group. These results are discussed in terms of how sign language experience and sensory deprivation benefit haptic spatial configuration processing.

Are there relationships among different spatial skills of individuals with blindness?

The aim of this study was to detect the possible relationships between various spatial skills of individuals with blindness. Twenty-eight individuals with blindness participated in five experiments that examined the body knowledge, laterality, directionality, perspective-taking, spatial coding of the near space and spatial knowledge of the far space. According to the results a positive correlation between body knowledge and directionality has emerged. Moreover, body knowledge and spatial coding of near space are found to be predictors of perspective-taking, while directionality and perspective-taking are found to be predictors of spatial coding of near space, and directionality and perspective-taking predictors of spatial knowledge of far space. This finding suggest that future studies should seriously take into account the possibility that the development of a certain skill could in fact be the result of the development of another skill/s. Moreover, the findings support the notion that a delay in the development of a spatial skill may not necessarily be a result of the visual impairment itself but of the incomplete development of another spatial skill.

Tactual perception: a review of experimental variables and procedures

This paper reviews the literature on tactual perception. Throughout this review, we will highlight some of the most relevant aspects in the touch literature: type of stimuli; type of participants; type of tactile exploration; and finally, the interaction between touch and other senses. Regarding type of stimuli, we will analyse studies with abstract stimuli such as vibrations, with two- and three-dimensional stimuli, and also concrete stimuli, considering the relation between familiar and unfamiliar stimuli and the haptic perception of faces. Under the "type of participants" topic, we separated studies with blind participants, studies with children and adults, and also performed an overview of sex differences in performance. The type of tactile exploration is explored considering conditions of active and passive touch, the relevance of movement in touch and the relation between haptic exploration and time. Finally, interactions between touch and vision, touch and smell and touch and taste are explored in the last topic. The review ends with an overall conclusion on the state of the art for the tactual perception literature. With this work, we intend to present an organised overview of the main variables in touch experiments, compiling aspects reported in the tactual literature, and attempting to provide both a summary of previous findings, and a guide to the design of future works on tactual perception and memory, through a presentation of implications from previous studies.

Tactile exploration of virtual objects for blind and sighted people: the role of beta 1 EEG band in sensory substitution and supramodal mental mapping

The neural correlates of exploration and cognitive mapping in blindness remain elusive. The role of visuo-spatial pathways in blind vs. sighted subjects is still under debate. In this preliminary study, we investigate, as a possible estimation of the activity in the visuo-spatial pathways, the EEG patterns of blind and blindfolded-sighted subjects during the active tactile construction of cognitive maps from virtual objects compared with rest and passive tactile stimulation. Ten blind and ten matched, blindfolded-sighted subjects participated in the study. Events were defined as moments when the finger was only stimulated (passive stimulation) or the contour of a virtual object was touched (during active exploration). Event-related spectral power and coherence perturbations were evaluated within the beta 1 band (14-18 Hz). They were then related to a subjective cognitive-load estimation required by the explorations [namely, perceived levels of difficulty (PLD)]. We found complementary cues for sensory substitution and spatial processing in both groups: both blind and sighted subjects showed, while exploring, late power decreases and early power increases, potentially associated with motor programming and touch, respectively. The latter involved occipital areas only for blind subjects (long-term plasticity) and only during active exploration, thus supporting tactile-to-visual sensory substitution. In both groups, coherences emerged among the fronto-central, centro-parietal, and occipito-temporal derivations associated with visuo-spatial processing. This seems in accordance with mental map construction involving spatial processing, sensory-motor processing, and working memory. The observed involvement of the occipital regions suggests that a substitution process also occurs in sighted subjects. Only during explorations did coherence correlate positively with PLD for both groups and in derivations, which can be related to visuo-spatial processing, supporting the existence of supramodal spatial processing independently of vision capabilities.

The role of visual experience for the neural basis of spatial cognition

Blindness often results in the adaptive neural reorganization of the remaining modalities, producing sharper auditory and haptic behavioral performance. Yet, non-visual modalities might not be able to fully compensate for the lack of visual experience as in the case of congenital blindness. For example, developmental visual experience seems to be necessary for the maturation of multisensory neurons for spatial tasks. Additionally, the ability of vision to convey information in parallel might be taken into account as the main attribute that cannot be fully compensated by the spared modalities. Therefore, the lack of visual experience might impair all spatial tasks that require the integration of inputs from different modalities, such as having to represent a set of objects on the basis of the spatial relationships among the objects, rather than the spatial relationship that each object has with oneself. Here we integrate behavioral and neural evidence to conclude that visual experience is necessary for the neural development of normal spatial cognition.

The impact of vision in spatial coding

The aim of this study is to examine the performance in coding and representing of near-space in relation to vision status (blindness vs. normal vision) and sensory modality (touch vs. vision). Forty-eight children and teenagers participated. Sixteen of the participants were totally blind or had only light perception, 16 were blindfolded sighted individuals, and 16 were non-blindfolded sighted individuals. Participants were given eight different object patterns in different arrays and were asked to code and represent each of them. The results suggest that vision influences performance in spatial coding and spatial representation of near space. However, there was no statistically significant difference between participants with blindness who used the most effective haptic strategy and blindfolded sighted participants. Thus, the significance of haptic strategies is highlighted.

Piaget's water-level task: the impact of vision on performance

In the present study, the aim was to examine the differences in performance between children and adolescents with visual impairment and sighted peers in the water-level task. Twenty-eight individuals with visual impairments, 14 individuals with blindness and 14 individuals with low vision, and 28 sighted individuals participated in the present study. Fourteen sighted individuals participated blindfolded and 14 were able to use their sight. The findings indicate that use of vision can influence the performance in water-level task. However, in the restriction of visual ability (participants with blindfold), individuals with blindness might present better performance than blindfolded sighted participants.

Reference Frame Preferences in Haptics Differ for the Blind and Sighted in the Horizontal but Not in the Vertical Plane

We investigated which reference frames are preferred when matching spatial language to the haptic domain. Sighted, low-vision, and blind participants were tested on a haptic-sentence-verification task where participants had to haptically explore different configurations of a ball and a shoe and judge the relation between them. Results from the spatial relation “above”, in the vertical plane, showed that various reference frames are available after haptic inspection of a configuration. Moreover, the pattern of results was similar for all three groups and resembled patterns found for the sighted on visual sentence-verification tasks. In contrast, when judging the spatial relation “in front”, in the horizontal plane, the blind showed a markedly different response pattern. The sighted and low-vision participants did not show a clear preference for either the absolute/relative or the intrinsic reference frame when these frames were dissociated. The blind, on the other hand, showed a clear preference for the intrinsic reference frame. In the absence of a dominant cue, such as gravity in the vertical plane, the blind might emphasise the functional relationship between the objects owing to enhanced experience with haptic exploration of objects.

The role of visual experience in mental scanning of actual pathways: evidence from blind and sighted people

In this research we compare blind and normally sighted people in mental scanning of spatial maps using locomotor or visual/locomotor exploration of a real 3-D environment. Different types of visual experience were tested: early (congenital) and late (adventitious) onset of blindness, short-term deprivation (blindfolded-sighted), and full vision (sighted). Participants were asked to learn six positions in a large parking area with movement alone (congenital, adventitious, blindfolded-sighted) or with vision plus movement (sighted), and then to mentally scan between positions in the path. Finally, they had to describe how they imagined scanning the learned pathway. We found a significant linear relation between space and time, ie the classic mental scanning effect, in all tested groups. However, the linear component was lower in blind participants, especially congenital. Instead, short-term visual deprivation had minimal impact on mental scanning. Overall, blind participants had shorter scanning times than both sighted groups, and the effect was particularly evident with farther distances. These results suggest that there is a quantitative rather than a qualitative difference between the blind and the sighted. In addition, the mental scanning strategies reported by participants also affected mental scanning times. The theoretical implications of these findings are discussed.

Mechanisms of cross-modal plasticity in early-blind subjects

A variety of studies have demonstrated enhanced blood oxygenation level dependent responses to auditory and tactile stimuli within occipital cortex as a result of early blindness. However, little is known about the organizational principles that drive this cross-modal plasticity. We compared BOLD responses to a wide variety of auditory and tactile tasks (vs. rest) in early-blind and sighted subjects. As expected, cross-modal responses were larger in blind than in sighted subjects in occipital cortex for all tasks (cross-modal plasticity). Within both blind and sighted subject groups, we found patterns of cross-modal activity that were remarkably similar across tasks: a large proportion of cross-modal responses within occipital cortex are neither task nor stimulus specific. We next examined the mechanisms underlying enhanced BOLD responses within early-blind subjects. We found that the enhancement of cross-modal responses due to early blindness was best described as an additive shift, suggesting that cross-modal plasticity within blind subjects does not originate from either a scaling or unmasking of cross-modal responsivities found in sighted subjects.