Influence of sparkle and saccades on tongue electro-stimulation-based vision substitution of 2D vectors

Perceived Intensity and Discrimination Ability for Lingual Electrotactile Stimulation Depends on Location and Orientation of Electrodes

Malfunctioning sensory systems can severely impact quality of life and repair is not always possible. One solution, called sensory substitution, is to use another sensory system to bring lost information to the brain. This approach often involves the use of bioengineered devices that electrically stimulate somatosensory fibers. Interestingly, the tongue is an ideal location for electrotactile stimulation due to its dense innervation, moisture, and protected environment. Success with transmitting visual and vestibular information through the tongue indicates promise for future applications. However, sensitivity and discrimination ability varies between individuals and across the tongue surface complicating efforts to produce reliable and consistent sensations. The goals of the present study were to investigate these differences more precisely to better understand the mechanosensory innervation of the tongue so that future electrotactile devices can be designed more effectively. Specifically, we tested whether stimulation of certain regions of the tongue consistently result in better perception, whether the spacing of stimulating electrodes affects perceived intensity, and whether the orientation of electrodes affects perceived intensity and discrimination. To test these hypotheses, we built a custom tongue stimulation device, recruited 25 participants, and collected perceived intensity and discrimination data. We then subjected the data to thorough statistical analyses. Consistent with previous studies, we found that stimulation of the anterior medial tongue region was perceived as more intense than stimulation of lateral and posterior regions. This region also had the best discrimination ability for electrodes. Dividing the stimulated tongue area into 16 distinct regions allowed us to compare perception ability between anterior and posterior regions, medial and lateral regions, and the left and right sides of the tongue. Stimulation of the most anterior and medial tongue resulted in the highest perceived intensity and the best discrimination ability. Most individuals were able to perceive and discriminate electrotactile stimulation better on one side of the tongue, and orientation of stimulating electrodes affected perception. In conclusion, the present studies reveal new information about the somatosensory innervation of the tongue and will assist the design of future electrotactile tongue stimulation devices that will help provide sensory information to people with damaged sensory systems.

Electrotactile vision substitution for 3D trajectory following

Navigation for blind persons represents a challenge for researchers in vision substitution. In this field, one of the used techniques to navigate is guidance. In this study, we develop a new approach for 3D trajectory following in which the requested task is to track a light path using computer input devices (keyboard and mouse) or a rigid body handled in front of a stereoscopic camera. The light path is visualized either on direct vision or by way of a electro-stimulation device, the Tongue Display Unit, a 12 × 12 matrix of electrodes. We improve our method by a series of experiments in which the effect of the modality of perception and that of the input device. Preliminary results indicated a close correlation between the stimulated and recorded trajectories.

Effect of saccades in tongue electrotactile stimulation for vision substitution applications

The visual substitution paradigm aims to facilitate the life of blind people. Generally one uses electro-stimulating devices where electrodes are arranged into arrays to stimulate the skin or the tongue mucosa to send signals of visual type to the subjects. When an electro-stimulation signal is applied continuously (e.g. when static visual scenes are displayed for a long period of time), the receptors of the affected region can get saturated and the patient may lose the displayed information. We propose here some mechanisms that ameliorate the quality of perception of the electro-stimulation information. The electrical signal is encoded as 2D scenes projected onto the tongue via a Tongue Display Unit, i.e. an electro-tactile stimulator formed by a 12×12 matrix of electrodes. We propose to apply stochastic saccades on this signal. Our assumption is that this eye-inspired mechanism should make the visual substitution more efficient (by improving the perception) because of the reduction of the tactile receptors saturation. The influence of saccades was evaluated by a series of experiments. Results revealed a benefit on the persistence of perception due to saccades. This work helps to prevent the saturation of receptors on the tongue. Therefore increasing the quality of vision by the way of the electro-stimulation. It allows new enhancement features to retinal prosthesis devices which suffer from the same phenomenon.