Systematic Movements in Haptic Search: Spirals, Zigzags, and Parallel Sweeps

Applying height differentiation of tactile symbols to reduce the minimum horizontal distances between them on tactile maps

In this paper, we wanted to verify the hypothesis that extruding cartographic symbols on tactile maps to different heights might allow reducing the minimum (suggested in the literature) horizontal distances between them, without impacting the overall map’s legibility. This approach might allow preparing tactile maps in smaller scales and thus, reducing production cost, or putting additional spatial information on the same map sheet that would not fit otherwise. To verify the hypothesis we have prepared 6 different stimuli variants with or without height differentiation applied and different horizontal distances between tactile symbols adopted (1 mm, 2 mm and 3 mm). In the controlled study sessions with 30 participants with visual impairments we have measured the times required for solving 3 different spatial tasks on 3D printed tactile stimuli. We have also performed qualitative analysis to learn participants’ opinions about the proposed design and materials used. It turns out that applying height differentiation not only results in shorter times required for solving spatial tasks but is also considered by blind individuals as a convenient improvement in terms of use comfort and allows reduction of recommended minimum horizontal distances between symbols on tactile maps.

Idiosyncratic selection of active touch for shape perception

Hand movements are essential for tactile perception of objects. However, the specific functions served by active touch strategies, and their dependence on physiological parameters, are unclear and understudied. Focusing on planar shape perception, we tracked at high resolution the hands of 11 participants during shape recognition task. Two dominant hand movement strategies were identified: contour following and scanning. Contour following movements were either tangential to the contour or oscillating perpendicular to it. Scanning movements crossed between distant parts of the shapes’ contour. Both strategies exhibited non-uniform coverage of the shapes’ contours. Idiosyncratic movement patterns were specific to the sensed object. In a second experiment, we have measured the participants’ spatial and temporal tactile thresholds. Significant portions of the variations in hand speed and in oscillation patterns could be explained by the idiosyncratic thresholds. Using data-driven simulations, we show how specific strategy choices may affect receptors activation. These results suggest that motion strategies of active touch adapt to both the sensed object and to the perceiver’s physiological parameters.

Target Search and Inspection Strategies in Haptic Search

Haptic search is a common everyday task, usually consisting of two processes: target search and target analysis. During target search we need to know where our fingers are in space, remember the already completed path and the outline of the remaining space. During target analysis we need to understand whether the detected potential target is the desired one. Here we characterized dynamics of exploratory movements in these two processes. In our experiments participants searched for a particular configuration of symbols on a rectangular tactile display. We observed that participants preferentially moved the hand parallel to the edges of the tactile display during target search, which possibly eased orientation within the search space. After a potential target was detected by any of the fingers, there was higher probability that subsequent exploration was performed by the index or the middle finger. At the same time, these fingers dramatically slowed down. Being in contact with the potential target, the index and the middle finger moved within a smaller area than the other fingers, which rather seemed to move away to leave them space. These results suggest that the middle and the index finger are specialized for fine analysis in haptic search.

Deep neural network model of haptic saliency

Haptic exploration usually involves stereotypical systematic movements that are adapted to the task. Here we tested whether exploration movements are also driven by physical stimulus features. We designed haptic stimuli, whose surface relief varied locally in spatial frequency, height, orientation, and anisotropy. In Experiment 1, participants subsequently explored two stimuli in order to decide whether they were same or different. We trained a variational autoencoder to predict the spatial distribution of touch duration from the surface relief of the haptic stimuli. The model successfully predicted where participants touched the stimuli. It could also predict participants' touch distribution from the stimulus' surface relief when tested with two new groups of participants, who performed a different task (Exp. 2) or explored different stimuli (Exp. 3). We further generated a large number of virtual surface reliefs (uniformly expressing a certain combination of features) and correlated the model's responses with stimulus properties to understand the model's preferences in order to infer which stimulus features were preferentially touched by participants. Our results indicate that haptic exploratory behavior is to some extent driven by the physical features of the stimuli, with e.g. edge-like structures, vertical and horizontal patterns, and rough regions being explored in more detail.