Temporal gap detection in tactile channels

Keep your finger on the pulse: Better rate perception and gap detection with vibrotactile compared to visual stimuli

Important characteristics of the environment can be represented in the temporal pattern of sensory stimulation. In two experiments, we compared accuracy of temporal processing by different modalities. Experiment 1 examined binary categorization of rate for visual (V) or vibrotactile (T) stimulus pulses presented at either 4 or 6 Hz. Inter-pulse intervals were either constant or variable, perturbed by random Gaussian variates. Subjects categorized the rate of T pulse sequences more accurately than V sequences. In V conditions only, subjects disproportionately tended to mis-categorize 4-Hz pulse rates, for all but the most variable sequences. In Experiment 2, we compared gap detection thresholds across modalities, using the same V and T pulses from Experiment 1, as well as with bimodal (VT) pulses. Visual gap detection thresholds were larger (3[Formula: see text]) than tactile thresholds. Additionally, performance with VT stimuli seemed to be nearly completely dominated by their T components. Together, these results suggest (i) that vibrotactile temporal acuity surpasses visual temporal acuity, and (ii) that vibrotactile stimulation has considerable, untapped potential to convey temporal information like that needed for eyes-free alerting signals.

Electro-tactile stimulation (ETS) enhances cochlear-implant Mandarin tone recognition

Objective

Electro-acoustic stimulation (EAS) is an effective method to enhance cochlear-implant performance in individuals who have residual low-frequency acoustic hearing. To help the majority of cochlear implant users who do not have any functional residual acoustic hearing, electro-tactile stimulation (ETS) may be used because tactile sensation has a frequency range and perceptual capabilities similar to that produced by acoustic stimulation in the EAS users.

Methods

Following up the first ETS study showing enhanced English sentence recognition in noise,¹ the present study evaluated the effect of ETS on Mandarin tone recognition in noise in two groups of adult Mandarin-speaking individuals. The first group included 11 normal-hearing individuals who listened to a 4-channel, noise-vocoded, cochlear-implant simulation. The second group included 1 unilateral cochlear-implant user and 2 bilateral users with each of their devices being tested independently. Both groups participated in a 4-alternative, forced-choice task, in which they had to identify a tone that was presented in noise at a 0-dB signal-to-noise ratio via electric stimulation (actual or simulated cochlear implants), tactile stimulation or the combined ETS.

Results

While electric or tactile stimulation alone produced similar tone recognition (∼40% correct), the ETS enhanced the cochlear-implant tone recognition by 17–18 percentage points. The size of the present ETS enhancement effect was similar to that of the previously reported EAS effect on Mandarin tone recognition. Psychophysical analysis on tactile sensation showed an important role of frequency discrimination in the ETS enhancement.

Conclusion

Tactile stimulation can potentially enhance Mandarin tone recognition in cochlear-implant users who do not have usable residual acoustic hearing. To optimize this potential, high fundamental frequencies need to be transposed to a 100–200 Hz range.

Electro-Tactile Stimulation Enhances Cochlear Implant Speech Recognition in Noise

For cochlear implant users, combined electro-acoustic stimulation (EAS) significantly improves the performance. However, there are many more users who do not have any functional residual acoustic hearing at low frequencies. Because tactile sensation also operates in the same low frequencies (<500 Hz) as the acoustic hearing in EAS, we propose electro-tactile stimulation (ETS) to improve cochlear implant performance. In ten cochlear implant users, a tactile aid was applied to the index finger that converted voice fundamental frequency into tactile vibrations. Speech recognition in noise was compared for cochlear implants alone and for the bimodal ETS condition. On average, ETS improved speech reception thresholds by 2.2 dB over cochlear implants alone. Nine of the ten subjects showed a positive ETS effect ranging from 0.3 to 7.0 dB, which was similar to the amount of the previously-reported EAS benefit. The comparable results indicate similar neural mechanisms that underlie both the ETS and EAS effects. The positive results suggest that the complementary auditory and tactile modes also be used to enhance performance for normal hearing listeners and automatic speech recognition for machines.

Comparison of Tactile Temporal Numerosity Judgments Between Unimanual and Bimanual Presentations

In recent years a growing interest has emerged in numerosity perception in touch. Most of the studies on tactile numerosity perception have investigated its spatial aspect by testing the ability to count the number of items presented simultaneously. On the other hand, only a small number of studies have examined its temporal aspect, and the underlying mechanisms of tactile temporal numerosity judgments (TTNJs) remain elusive. In this study, we presented a rapid sequence of vibrations, each of which was presented to one of two bodily locations, and then compared the performance of the TTNJ between two stimulus-location conditions. In one condition, each of the vibration trains was presented to one of two fingers of the left hand (unimanual condition). In the other condition, each of the vibration trains was presented to the index finger of either the right or left hand (bimanual condition). With these conditions, we aimed to examine how the differences in stimulus locations and in types of tasks affect TTNJ performance. Our results showed that when the participants were asked to count the total number of vibrations presented at two locations, the performance (proportion of correct answers) was not so much different between the two conditions. In contrast, when the participants had to report the two numbers of vibrations presented at each location or to focus on the number of vibrations at a single location, the TTNJ performance in the bimanual condition was drastically better than in the unimanual condition. These results suggest that the underlying mechanism for tactile temporal numerosity perception can segregate the interhemispheric information (bimanual condition) more precisely than the within-hemispheric information (unimanual condition), when spatiotemporal tasks are performed.

Discriminating speech rhythms in audition, vision, and touch

We investigated the extent to which people can discriminate between languages on the basis of their characteristic temporal, rhythmic information, and the extent to which this ability generalizes across sensory modalities. We used rhythmical patterns derived from the alternation of vowels and consonants in English and Japanese, presented in audition, vision, both audition and vision at the same time, or touch. Experiment 1 confirmed that discrimination is possible on the basis of auditory rhythmic patterns, and extended it to the case of vision, using 'aperture-close' mouth movements of a schematic face. In Experiment 2, language discrimination was demonstrated using visual and auditory materials that did not resemble spoken articulation. In a combined analysis including data from Experiments 1 and 2, a beneficial effect was also found when the auditory rhythmic information was available to participants. Despite the fact that discrimination could be achieved using vision alone, auditory performance was nevertheless better. In a final experiment, we demonstrate that the rhythm of speech can also be discriminated successfully by means of vibrotactile patterns delivered to the fingertip. The results of the present study therefore demonstrate that discrimination between language's syllabic rhythmic patterns is possible on the basis of visual and tactile displays.

Auditory and tactile gap discrimination by observers with normal and impaired hearing

Temporal processing ability for the senses of hearing and touch was examined through the measurement of gap-duration discrimination thresholds (GDDTs) employing the same low-frequency sinusoidal stimuli in both modalities. GDDTs were measured in three groups of observers (normal-hearing, hearing-impaired, and normal-hearing with simulated hearing loss) covering an age range of 21-69 yr. GDDTs for a baseline gap of 6 ms were measured for four different combinations of 100-ms leading and trailing markers (250-250, 250-400, 400-250, and 400-400 Hz). Auditory measurements were obtained for monaural presentation over headphones and tactile measurements were obtained using sinusoidal vibrations presented to the left middle finger. The auditory GDDTs of the hearing-impaired listeners, which were larger than those of the normal-hearing observers, were well-reproduced in the listeners with simulated loss. The magnitude of the GDDT was generally independent of modality and showed effects of age in both modalities. The use of different-frequency compared to same-frequency markers led to a greater deterioration in auditory GDDTs compared to tactile GDDTs and may reflect differences in bandwidth properties between the two sensory systems.

Two-point orientation discrimination versus the traditional two-point test for tactile spatial acuity assessment

Two-point discrimination is widely used to measure tactile spatial acuity. The validity of the two-point threshold as a spatial acuity measure rests on the assumption that two points can be distinguished from one only when the two points are sufficiently separated to evoke spatially distinguishable foci of neural activity. However, some previous research has challenged this view, suggesting instead that two-point task performance benefits from an unintended non-spatial cue, allowing spuriously good performance at small tip separations. We compared the traditional two-point task to an equally convenient alternative task in which participants attempt to discern the orientation (vertical or horizontal) of two points of contact. We used precision digital readout calipers to administer two-interval forced-choice versions of both tasks to 24 neurologically healthy adults, on the fingertip, finger base, palm, and forearm. We used Bayesian adaptive testing to estimate the participants’ psychometric functions on the two tasks. Traditional two-point performance remained significantly above chance levels even at zero point separation. In contrast, two-point orientation discrimination approached chance as point separation approached zero, as expected for a valid measure of tactile spatial acuity. Traditional two-point performance was so inflated at small point separations that 75%-correct thresholds could be determined on all tested sites for fewer than half of participants. The 95%-correct thresholds on the two tasks were similar, and correlated with receptive field spacing. In keeping with previous critiques, we conclude that the traditional two-point task provides an unintended non-spatial cue, resulting in spuriously good performance at small spatial separations. Unlike two-point discrimination, two-point orientation discrimination rigorously measures tactile spatial acuity. We recommend the use of two-point orientation discrimination for neurological assessment.

Temporal onset-order discrimination through the tactual sense: effects of frequency and site of stimulation

This research extends the study of temporal resolution of the tactual sensory system through measurements of temporal-onset order discrimination for continuous tonal signals addressing (a) the effects of frequency separation of the two stimuli whose onset orders are to be discriminated and (b) the effects of redundant coding of frequency and site of stimulation on performance. Sinusoidal signals were presented either at two separate digits (thumb and index finger of the left hand) or at a single site of stimulation (left index finger) using a multifinger tactual stimulation system. Measurements were obtained using a one-interval two-alternative forced choice procedure in which each interval consisted of the random-order presentation of two different stimuli with roving values of amplitude and duration. Thresholds were estimated from psychometric functions of d' as a function of stimulus-onset asynchrony (SOA). On average, temporal onset-order thresholds were larger for one-finger conditions (mean SOA of 74.8 ms) than for two-finger conditions (mean SOA of 48.5 ms) and decreased as frequency separation increased, particularly for single-site presentation. Redundant coding of frequency and site of stimulation resulted in higher resolution by a factor of 1.5 compared to frequency alone and by a factor of 1.2 compared to site alone.