Tangible pictures: viewpoint effects and linear perspective in visually impaired people

Vision matters for shape representation: Evidence from sculpturing and drawing in the blind

Shape is a property that could be perceived by vision and touch, and is classically considered to be supramodal. While there is mounting evidence for the shared cognitive and neural representation space between visual and tactile shape, previous research tended to rely on dissimilarity structures between objects and had not examined the detailed properties of shape representation in the absence of vision. To address this gap, we conducted three explicit object shape knowledge production experiments with congenitally blind and sighted participants, who were asked to produce verbal features, 3D clay models, and 2D drawings of familiar objects with varying levels of tactile exposure, including tools, large nonmanipulable objects, and animals. We found that the absence of visual experience (i.e., in the blind group) led to stronger differences in animals than in tools and large objects, suggesting that direct tactile experience of objects is essential for shape representation when vision is unavailable. For tools with rich tactile/manipulation experiences, the blind produced overall good shapes comparable to the sighted, yet also showed intriguing differences. The blind group had more variations and a systematic bias in the geometric property of tools (making them stubbier than the sighted), indicating that visual experience contributes to aligning internal representations and calibrating overall object configurations, at least for tools. Taken together, the object shape representation reflects the intricate orchestration of vision, touch and language.

Evaluating the Use of Tactile Shapes in Associative Learning for People Who Are Blind

Introduction: This work investigates if simple two-dimensional (2D) tactile shapes can facilitate encoding, retention, and retrieval of associated information in the form of one-word labels. It also questions the need for the resemblance of tactile graphics with respective visual referents. Methods: Four experiments were conducted using recall tasks with verbal and tactual triggers. Students who are blind from schools for blind students in Indianapolis, Indiana (USA) and New Delhi (India) participated in these experiments. Participants learned 12 shapes with assigned (two sets of) one-word labels categorized as consonant, dissonant, or abstract. Recall tasks were conducted after 1 week and after 4 months using verbal and tactual triggers. Results: The results of experiment 1 show that recall performance for consonant associations was higher than that for dissonant and abstract. Experiment 2 shows the recall performance using orally narrated verbal triggers, while experiments 3 and 4 use tactile triggers (both verbal and shape). Additionally, in experiment 4, the participants were observed recalling most associations after 4 months. Tactile verbal triggers (braille) invoked better recall accuracy as compared to tactile shape triggers. Discussion: The results and discussion with schema theory suggest that resemblance to visual referent (or similarity of tactile shape with real-life visual stimuli) is not necessary for learning associated labels. Additionally, simple 2D tactile shapes can support long-term retention of associated verbal information. The presence of primacy effect (better retention of first few associations) and distinctiveness effect (better retention of unique associations). Implications for Practitioners: The inferences of this work can influence the redesign of educational material and pedagogy for students with blindness by: (1) contributing to the development of a standardized set of symbols with associated meanings and using them for book annotation or indicating the genre of a graphic; (2) using simple tactile images instead of complex “visually correct” images.

Extension of Dancer's Legs: Increasing Angles Show Motion

Usain Bolt’s Lightning Bolt pose, one arm highly extended to one side, suggests action. Likewise, static pictures of animals, legs extended, show animation. We tested a new cue for motion perception—extension—and in particular extension of dancer’s legs. An experiment with pictures of a dancer finds larger angles between the legs suggest greater movement, especially with in-air poses and in lateral views. Leg positions graded from simply standing to very difficult front and side splits. Liking ratings (a small range) were more related to Difficulty ratings (a large range) than Movement ratings (a moderate range).

Comparing the Effects of Congenital and Late Visual Impairments on Visuospatial Mental Abilities

This study compared participants who were congenitally visually impaired and those who became visually impaired later in life in a spatial memory task. The latter showed less efficient visuospatial processes than did the former. However, these differences were of a quantitative nature only, indicating common cognitive mechanisms that can be clearly differentiated from those of people who are congenitally blind.

Viewpoint and Orientation Influence Picture Recognition in the Blind

In the first three experiments, subjects felt solid geometrical forms and matched raised-line pictures to the objects. Performance was best in experiment 1 for top views, with shorter response latencies than for side views, front views, or 3-D views with foreshortening. In a second experiment with blind participants, matching accuracy was not significantly affected by prior visual experience, but speed advantages were found for top views, with 3-D views also yielding better matching accuracy than side views. There were no performance advantages for pictures of objects with a constant cross section in the vertical axis. The early-blind participants had lower performance for side and frontal views. The objects were rotated to oblique orientations in experiment 3. Early-blind subjects performed worse than the other subjects given object rotation. Visual experience with pictures of objects at many angles could facilitate identification at oblique orientations. In experiment 5 with blindfolded sighted subjects, tangible pictures were used as targets and as choices. The results yielded superior overall performance for 3-D views (mean, M = 74% correct) and much lower matching accuracy for top views as targets ( M = 58% correct). Performance was highest when the target and matching viewpoint were identical, but 3-D views ( M = 96% correct) were still far better than top views. The accuracy advantage of the top views also disappeared when more complex objects were tested in experiment 6. Alternative theoretical implications of the results are discussed.

Haptic Object Recognition is View-Independent in Early Blind but not Sighted People

Object recognition, whether visual or haptic, is impaired in sighted people when objects are rotated between learning and test, relative to an unrotated condition, that is, recognition is view-dependent. Loss of vision early in life results in greater reliance on haptic perception for object identification compared with the sighted. Therefore, we hypothesized that early blind people may be more adept at recognizing objects despite spatial transformations. To test this hypothesis, we compared early blind and sighted control participants on a haptic object recognition task. Participants studied pairs of unfamiliar three-dimensional objects and performed a two-alternative forced-choice identification task, with the learned objects presented both unrotated and rotated 180° about they-axis. Rotation impaired the recognition accuracy of sighted, but not blind, participants. We propose that, consistent with our hypothesis, haptic view-independence in the early blind reflects their greater experience with haptic object perception.

Designing Haptic Assistive Technology for Individuals Who Are Blind or Visually Impaired

This paper considers issues relevant for the design and use of haptic technology for assistive devices for individuals who are blind or visually impaired in some of the major areas of importance: Braille reading, tactile graphics, orientation and mobility. We show that there is a wealth of behavioral research that is highly applicable to assistive technology design. In a few cases, conclusions from behavioral experiments have been directly applied to design with positive results. Differences in brain organization and performance capabilities between individuals who are "early blind" and "late blind" from using the same tactile/haptic accommodations, such as the use of Braille, suggest the importance of training and assessing these groups individually. Practical restrictions on device design, such as performance limitations of the technology and cost, raise questions as to which aspects of these restrictions are truly important to overcome to achieve high performance. In general, this raises the question of what it means to provide functional equivalence as opposed to sensory equivalence.

Perceiving space and optical cues via a visuo-tactile sensory substitution system: a methodological approach for training of blind subjects for navigation

A methodological approach to perceptual learning was used to allow both early blind subjects (experimental group) and blindfolded sighted subjects (control group) to experience optical information and spatial phenomena, on the basis of visuo-tactile information transmitted by a 64-taxel pneumatic sensory substitution device. The learning process allowed the subjects to develop abilities in spatial localisation, shape recognition (with generalisation to different points of view), and monocular depth cue interpretation. During the training phase, early blind people initially experienced more difficulties than blindfolded sighted subjects (having previous perceptual experience of perspective) with interpreting and using monocular depth cues. The amelioration of the performance for all blind subjects during training sessions and the quite similar level of performance reached by two groups in the final navigation tasks suggested that early blind people were able to develop and apply cognitive understanding of depth cues. Both groups showed generalisation of the learning from the initial phases to cue identification in the maze, and subjectively experienced shapes facing them. Subjects' performance depended not only on their perceptual experience but also on their previous spatial competencies.

Piaget's water-level task: the impact of vision on performance

In the present study, the aim was to examine the differences in performance between children and adolescents with visual impairment and sighted peers in the water-level task. Twenty-eight individuals with visual impairments, 14 individuals with blindness and 14 individuals with low vision, and 28 sighted individuals participated in the present study. Fourteen sighted individuals participated blindfolded and 14 were able to use their sight. The findings indicate that use of vision can influence the performance in water-level task. However, in the restriction of visual ability (participants with blindfold), individuals with blindness might present better performance than blindfolded sighted participants.

Haptic Object Recognition: How Important are Depth Cues and Plane Orientation?

Raised-line drawings of familiar objects are very difficult to identify with active touch only. In contrast, haptically explored real 3-D objects are usually recognised efficiently, albeit slower and less accurately than with vision. Real 3-D objects have more depth information than outline drawings, but also extra information about identity (eg texture, hardness, temperature). Previous studies have not manipulated the availability of depth information in haptic object recognition whilst controlling for other information sources, so the importance of depth cues has not been assessed. In the present experiments, people named plastic small-scale models of familiar objects. Five versions of bilaterally symmetrical objects were produced. Versions varied only in the amount of depth information: minimal for cookie-cutter and filled-in outlines, partial for squashed and half objects, and full for 3-D models. Recognition was faster and much more accurate when more depth information was available, whether exploration was with both hands or just one finger. Novices found it almost impossible to recognise objects explored with two hand-held probes whereas experts succeeded using probes regardless of the amount of depth information. Surprisingly, plane misorientation did not impair recognition. Unlike with vision, depth information, but not object orientation, is extremely important for haptic object recognition.

Haptic recognition of two-dimensional raised-line patterns by early-blind, late-blind, and blindfolded sighted adults

We investigated the role of visual experience and visual imagery in the processing of two-dimensional (2-D) tactile patterns. The performance of early-blind (EB), late-blind (LB), and blindfolded sighted (S) adults in the recognition of 2-D raised-line patterns was compared. We also examined whether recognition of 2-D tactile patterns depends on the type of memory strategy (eg spatial, visuo-spatial, verbal, and kinesthetic) used by EB, LB, and S participants to perform the task. Significant between-group differences in the recognition performance have not been found despite significant between-group differences in self-reported memory strategies. Recognition performance does not vary significantly with the strategy, but correlates positively with visuo-spatial imagery abilities in the S participants. These findings may be taken to suggest that the difficulties some blind people experience with tactile pictures are not due to difficulties in processing 2-D tactile patterns.

Perceptual learning of view-independence in visuo-haptic object representations

We previously showed that cross-modal recognition of unfamiliar objects is view-independent, in contrast to view-dependence within-modally, in both vision and haptics. Does the view-independent, bisensory representation underlying cross-modal recognition arise from integration of unisensory, view-dependent representations or intermediate, unisensory but view-independent representations? Two psychophysical experiments sought to distinguish between these alternative models. In both experiments, participants began from baseline, within-modal, view-dependence for object recognition in both vision and haptics. The first experiment induced within-modal view-independence by perceptual learning, which was completely and symmetrically transferred cross-modally: visual view-independence acquired through visual learning also resulted in haptic view-independence and vice versa. In the second experiment, both visual and haptic view-dependence were transformed to view-independence by either haptic-visual or visual-haptic cross-modal learning. We conclude that cross-modal view-independence fits with a model in which unisensory view-dependent representations are directly integrated into a bisensory, view-independent representation, rather than via intermediate, unisensory, view-independent representations.

The Influence of Viewpoint and Object Detail in Blind People When Matching Pictures to Complex Objects

We examined haptic viewpoint effects in blindfolded-sighted (BS) and visually impaired subjects: early blind (EB), late blind (LB), and very low vision (VLV). Participants felt complex objects and matched tangible pictures to them. In experiment 1, the EB and BS subjects had similar overall performance. Experiment 2 showed that the presence of a detail on the target object lowered performance in the BS subjects, and that matching accuracy was lower overall for top views for the blind subjects. In experiments 3–5, EB, LB, VLV, and BS subjects made judgments about perspective pictures of a model house with more salient object details. In experiment 3, performance was higher for side views than for corner views. Elevated side views were identified more readily than elevated corner views in experiment 4. Performance for top views was higher than for elevated side views in experiment 5, given the relative simplicity of the top-view depictions and salient details. The EB and BS participants had somewhat lower matching accuracy scores than the other groups. We suggest that visual experience is helpful, but not essential for picture perception. Viewpoint effects may vary with experience and object complexity, but the relevant experience need not be specifically visual in nature.

Cross-modal object recognition is viewpoint-independent

BACKGROUND

Previous research suggests that visual and haptic object recognition are viewpoint-dependent both within- and cross-modally. However, this conclusion may not be generally valid as it was reached using objects oriented along their extended y-axis, resulting in differential surface processing in vision and touch. In the present study, we removed this differential by presenting objects along the z-axis, thus making all object surfaces more equally available to vision and touch.

METHODOLOGY/PRINCIPAL FINDINGS

Participants studied previously unfamiliar objects, in groups of four, using either vision or touch. Subsequently, they performed a four-alternative forced-choice object identification task with the studied objects presented in both unrotated and rotated (180 degrees about the x-, y-, and z-axes) orientations. Rotation impaired within-modal recognition accuracy in both vision and touch, but not cross-modal recognition accuracy. Within-modally, visual recognition accuracy was reduced by rotation about the x- and y-axes more than the z-axis, whilst haptic recognition was equally affected by rotation about all three axes. Cross-modal (but not within-modal) accuracy correlated with spatial (but not object) imagery scores.

CONCLUSIONS/SIGNIFICANCE

The viewpoint-independence of cross-modal object identification points to its mediation by a high-level abstract representation. The correlation between spatial imagery scores and cross-modal performance suggest that construction of this high-level representation is linked to the ability to perform spatial transformations. Within-modal viewpoint-dependence appears to have a different basis in vision than in touch, possibly due to surface occlusion being important in vision but not touch.

Effects of late visual impairment on mental representations activated by visual and tactile stimuli

Similarly to sighted people, individuals congenitally affected by a severe visual impairment can maintain and mentally manipulate spatial information about tactile stimuli [Vecchi, T., Cattaneo, Z., Monegato, M., Pece, A., Cornoldi, C., Pietrini, P., 2006. Why Cyclops could not compete with Ulysses: monocular vision and mental images. NeuroReport 17, 723-726]. The aim of the present study was to assess whether the onset timing of a severe (but not total) sight loss may influence spatial imagery abilities based on haptic input. To this purpose, a group of late severe visually impaired people and a matched group of normally sighted participants (all blindfolded) were presented with an imagery task requiring to memorize and retrieve a number of locations presented on tactile matrices. Results indicate that a severe visual deficit occurring later in life significantly impairs spatial imagery abilities to a greater extent than in the case of congenital blindness, probably as a consequence of a modest development of specific compensatory mechanisms associated with congenital deficits.

Foreshortening, convergence and drawings from a blind adult

Esref is a congenitally totally blind man, practiced in drawing. He was asked to draw solid and wire cubes situated in several places around his vantage point. He used foreshortening of receding sides and convergence of obliques, in approximate one-point perspective. We note that haptics provides information about the direction of objects--the basis of perspective.

Speed-accuracy tradeoff during performance of a tracking task without visual feedback

To help people with visual impairment, especially people with severely impaired vision, access graphic information on a computer screen, we have carried out fundamental research on the effect of increasing the number of detection fields. In general, application of the parallelism concept enables information to be accessed more precisely and easily when the number of sensors is high. We have developed a "Braille Box" by modifying Braille cells to form a tactile stimulator array which is compatible with the fingertip. Each pin can be controlled independently so that we can change the size and type of array in order to study the tactile perception of both simple and complex graphical forms. Our results show that by applying the parallelism concept to the detection field, people with visual impairment can increase the speed of exploration of geometric forms without decreasing the level of accuracy: thus, avoiding a speed-accuracy tradeoff. Further experiments need to be done with this Braille Box in order to improve the device and help people with visual impairment access graphic information.

Superior haptic perceptual selectivity in late-blind and very-low-vision subjects

Blindfolded sighted, congenitally blind, late-blind, and very-low-vision subjects were tested on a tangible version of the embedded-figures test. The results of ANOVAs on accuracy measures yielded superior performance by the very-low-vision and late-blind subjects compared with the blindfolded sighted and congenitally blind participants. Accuracy of the congenitally blind subjects was similar to that of the blindfolded sighted participants. However, all groups of blind subjects were significantly faster than the blindfolded sighted subjects. It is suggested that experience with pictures combined with haptic skill aid perceptual selectivity in touch.

Drawings from Gaia, a blind girl

Gaia, a totally blind girl, was asked to make raised-line drawings. Gaia's vision at best was peripheral. She draws out of interest, and has drawn since preschool with encouragement from her mother. She was asked to draw objects and scenes involving depth from a vantage point, eg a table from below, two cars (one behind the other), and two parallel rows of apples (receding from her, on a table top). Gaia represented space in her drawings using T-junctions for overlap, height in the picture plane, parallel projection, and inverse projection. That is, Gaia uses features of systems common in sighted children's drawings. The development of drawing in blind and sighted children may be similar in good measure because haptics provides access to many of the same spatial principles as vision.