Linguistic and perceptual-motor contributions to the kinematic properties of the braille reading finger

Biomechanical Considerations of Refreshable Braille and Tactile Graphics Toward Equitable Access: A Review

This review highlights the biomechanical foundations of braille and tactile graphic discrimination within the context of design innovations in information access for the blind and low-vision community. Braille discrimination is a complex and poorly understood process that necessitates the coordination of motor control, mechanotransduction, and cognitive-linguistic processing. Despite substantial technological advances and multiple design attempts over the last fifty years, a low-cost, high-fidelity refreshable braille and tactile graphics display has yet to be delivered. Consequently, the blind and low-vision communities are left with limited options for information access. This is amplified by the rapid adoption of graphical user interfaces for human-computer interaction, a move that the blind and low vision community were effectively excluded from. Text-to-speech screen readers lack the ability to convey the nuances necessary for science, technology, engineering, arts, and math education and offer limited privacy for the user. Printed braille and tactile graphics are effective modalities but are time and resource-intensive, difficult to access, and lack real-time rendering. Single- and multiline refreshable braille devices either lack functionality or are extremely cost-prohibitive. Early computational models of mechanotransduction through complex digital skin tissue and the kinematics of the braille reading finger are explored as insight into device design specifications. A use-centered, convergence approach for future designs is discussed in which the design space is defined by both the end-user requirements and the available technology.

Structure of variability in scanning movement predicts braille reading performance in children

Among children learning to read braille, we asked whether the quantitative kinematics of scanning movements of the reading finger would be related to the proficiency of braille reading. Over a period of 12 months, we recorded the position and orientation of the reading fingers of eight congenitally or early blind children. We found that the strength of long-range power-law temporal correlations in the velocity fluctuations increased with performance in braille reading. In addition, we found that the variability of the angular orientation of the reading finger that affects the contact region on the fingerpad was negatively related to braille reading performance. These results confirm that the quantitative kinematics of finger scanning movements were related to functional performance in braille reading. The results add to the growing body of evidence that long-range temporal correlations in exploratory behavior can predict perceptual performance, and that scanning movements that center important tactile information on the small, high resolution area contribute to the pickup of information.

Raised Dot Enumeration Via Haptic Exploration

In two experiments we investigated blindfolded, sighted participants' capacity to extract the number of raised dots from arrays of braille cells that they scanned once via active touch. The arrays could contain between one and 12 raised dots and estimates were based on scanning with one or more fingers on one or both hands (Experiment 1), or when the dots were as maximally or minimally spaced as the braille code permits (Experiment 2). We sought evidence of discontinuities in performance that reflect more than one mode of enumeration. We found that participants' estimates of numerosity increased in a linear fashion with actual numerosity, but were increasingly underestimated beyond numerosity of six, and confidence in the judgment declined linearly with increasing numerosity. Finger combinations made no difference to accuracy, errors, or confidence. Increasing dot density had the effect of diminishing perceptual accuracy, exaggerating underestimation and reducing confidence. While perceptual accuracy was generally high up to six raised dots, patterns of confusions and scaling analyses suggest that numerosities of four or less are perceptually unique. In this article, we discuss these data in terms of enumeration in touch and other modalities, and consider whether this discontinuity in enumeration signifies a subitize-to-count or a count-to-estimate transition.

Experimental Evaluation of a Braille-Reading-Inspired Finger Motion Adaptive Algorithm

Braille reading is a complex process involving intricate finger-motion patterns and finger-rubbing actions across Braille letters for the stimulation of appropriate nerves. Although Braille reading is performed by smoothly moving the finger from left-to-right, research shows that even fluent reading requires right-to-left movements of the finger, known as "reversal". Reversals are crucial as they not only enhance stimulation of nerves for correctly reading the letters, but they also show one to re-read the letters that were missed in the first pass. Moreover, it is known that reversals can be performed as often as in every sentence and can start at any location in a sentence. Here, we report experimental results on the feasibility of an algorithm that can render a machine to automatically adapt to reversal gestures of one's finger. Through Braille-reading-analogous tasks, the algorithm is tested with thirty sighted subjects that volunteered in the study. We find that the finger motion adaptive algorithm (FMAA) is useful in achieving cooperation between human finger and the machine. In the presence of FMAA, subjects' performance metrics associated with the tasks have significantly improved as supported by statistical analysis. In light of these encouraging results, preliminary experiments are carried out with five blind subjects with the aim to put the algorithm to test. Results obtained from carefully designed experiments showed that subjects' Braille reading accuracy in the presence of FMAA was more favorable then when FMAA was turned off. Utilization of FMAA in future generation Braille reading devices thus holds strong promise.

Behavioural and electrophysiological effects related to semantic violations during braille reading

This study investigated the potential to detect event related potentials (ERPs) occurring in response to a specific task in braille reading. This would expand current methodologies for studying the cognitive processes underlying braille reading. An N400 effect paradigm was utilised, whereby proficient blind braille readers read congruent- and incongruent-ending braille sentences. Kinematic and electroencephalography (EEG) data were obtained simultaneously and synchronised. The ERPs differed between the incongruent and congruent sentences in a manner consistent with the N400 effect found with a previous sighted reading paradigm, demonstrating that ERPs can be obtained during braille reading. The frequency of finger reversals and the degree of intermittency in the finger velocity were significantly higher when reading incongruent versus congruent sentence endings. Both reversals and the potential N400 effect may reflect processes involved in semantic unification. These findings have significant implications for the modelling of braille reading. The refinement of the technique will enable other ERPs to be identified and related to behavioural responses, to further our understanding of the braille reading process.

Parallel versus sequential processing in print and braille reading

In the current study we investigated word, pseudoword and story reading in Dutch speaking braille and print readers. To examine developmental patterns, these reading skills were assessed in both children and adults. The results reveal that braille readers read less accurately and fast than print readers. While item length has no impact on word reading accuracy and speed in the group of print readers, it has a significant impact on reading accuracy and speed in the group of braille readers, particularly in the younger sample. This suggests that braille readers rely more strongly on an enduring sequential reading strategy. Comparison of the different reading tasks suggests that the advantage in accuracy and speed of reading in adult as compared to young braille readers is achieved through semantic top-down processing.

Encoding/decoding of first and second order tactile afferents in a neurorobotic application

We present a neurorobotic framework to investigate tactile information processing at the early stages of the somatosensory pathway. We focus on spatiotemporal coding of first and second order responses to Braille stimulation, which offers a suitable protocol to investigate the neural bases of fine touch discrimination. First, we model Slow Adaptive type I fingertip mechanoreceptor responses to Braille characters sensed both statically and dynamically. We employ a network of spiking neurones to transduce analogue skin deformations into primary spike trains. Then, we model second order neurones in the cuneate nucleus (CN) of the brainstem to study how mechanoreceptor responses are possibly processed prior to their transmission to downstream central areas. In the model, the connectivity layout of mechanoreceptor-to-cuneate projections produces a sparse CN code. To characterise the reliability of neurotransmission we employ an information theoretical measure accounting for the metrical properties of spiking signals. Our results show that perfect discrimination of primary and secondary responses to a set of 26 Braille characters is achieved within 100 and 500 ms of stimulus onset, in static and dynamic conditions, respectively. Furthermore, clusters of responses to different stimuli are better separable after the CN processing. This finding holds for both statically and dynamically delivered stimuli. In the presented system, when sliding the artificial fingertip over a Braille line, a speed of 40-50mm/s is optimal in terms of rapid and reliable character discrimination. This result is coherent with psychophysical observations reporting average reading speeds of 30-40±5 mm/s adopted by expert Braille readers.