Vibrotactile "on-thigh" alerting system in the cockpit

Vibrotactile feedback as a countermeasure for spatial disorientation

Spaceflight can make astronauts susceptible to spatial disorientation which is one of the leading causes of fatal aircraft accidents. In our experiment, blindfolded participants used a joystick to balance themselves while inside a multi-axis rotation device (MARS) in either the vertical or horizontal roll plane. On Day 1, in the vertical roll plane (Earth analog condition) participants could use gravitational cues and therefore had a good sense of their orientation. On Day 2, in the horizontal roll plane (spaceflight analog condition) participants could not use gravitational cues and rapidly became disoriented and showed minimal learning and poor performance. One potential countermeasure for spatial disorientation is vibrotactile feedback that conveys body orientation provided by small vibrating devices applied to the skin. Orientation-dependent vibrotactile feedback provided to one group enhanced performance in the spaceflight condition but the participants reported a conflict between the accurate vibrotactile cues and their erroneous perception of their orientation. Specialized vibrotactile training on Day 1 provided to another group resulted in significantly better learning and performance in the spaceflight analog task with vibrotactile cueing. In this training, participants in the Earth analog condition on Day 1 were required to disengage from the task of aligning with the gravitational vertical encoded by natural vestibular/somatosensory afference and had to align with randomized non-vertical directions of balance signaled by vibrotactile feedback. At the end of Day 2, we deactivated the vibrotactile feedback after both vibration-cued groups had practiced with it in the spaceflight analog condition. They performed as well as the group who did not have any vibrotactile feedback. We conclude that after appropriate training, vibrotactile orientation feedback augments dynamic spatial orientation and does not lead to any negative dependence.

When to use vibrotactile displays? A meta-analysis for the role of vibrotactile displays in human-computer interaction

OBJECTIVE

This study aims to investigate the benefits of unimodal tactile displays relative to other modal displays and the performance gains of adding redundant tactile displays by integrating empirical studies.

BACKGROUND

Tactile displays have attracted increasing attention in recent years due to their unique advantages. Synthesizing experimental data is necessary to analyze the performance benefits of tactile displays for participants and better help practitioners in utilizing them.

METHOD

Five meta-analyses were conducted. Two meta-analyses compared the participants' performance between tactile and other modal displays (visual vs. tactile and auditory vs. tactile). Three meta-analyses examined the performance gains of adding redundant tactile displays based on other modal displays (visual vs. visual + tactile, auditory vs. auditory + tactile, and visual + auditory vs. visual + auditory + tactile). The related moderator variables, the types of presented information and concurrent tasks, were analyzed.

RESULTS

Little evidence shows the performance difference between tactile and auditory displays. Tactile displays are more beneficial than visual displays for presenting alert information or in the situation with a visual concurrent task. The performance gains of adding redundant tactile displays to other modal displays also depend on the specific type of presented information and the concurrent task.

CONCLUSION

When using tactile displays to convey information, interface designers should consider the specific type of presented information and the concurrent tasks.

APPLICATIONS

The present study's findings can provide some implications for designers to utilize tactile displays when they construct and implement information displays.

Vibrotactile display design: Quantifying the importance of age and various factors on reaction times

Numerous factors affect reaction times to vibrotactile cues. Therefore, it is important to consider the relative magnitudes of these time delays when designing vibrotactile displays for real-time applications. The objectives of this study were to quantify reaction times to typical vibrotactile stimuli parameters through direct comparison within a single experimental setting, and to determine the relative importance of these factors on reaction times. Young (n = 10, 21.9 ± 1.3 yrs) and older adults (n = 13, 69.4 ± 5.0 yrs) performed simple reaction time tasks by responding to vibrotactile stimuli using a thumb trigger while frequency, location, auditory cues, number of tactors in the same location, and tactor type were varied. Participants also performed a secondary task in a subset of the trials. The factors investigated in this study affected reaction times by 20-300 ms (reaction time findings are noted in parentheses) depending on the specific stimuli condition. In general, auditory cues generated by the tactors (<20 ms), vibration frequency (<20 ms), number of tactors in the same location (<30 ms) and tactor type (<50 ms) had relatively small effects on reaction times, while stimulus location (20-120 ms) and secondary cognitive task (>130 ms) had relatively large effects. Factors affected young and older adults' reaction times in a similar manner, but with different magnitudes. These findings can inform the development of vibrotactile displays by enabling designers to directly compare the relative effects of key factors on reaction times.

Analysis of loss of alertness due to cognitive fatigue using motif synchronization of EEG records

Continuous and repetitive performance of cognitive tasks is likely to cause a change in the alertness levels of an individual. The present paper investigates the changes in EEG as a marker of alertness during an experiment designed to induce cognitive fatigue in subjects by continuous and repetitive performance of standard neuropsychological tests. Electroencephalogram (EEG), speech data and high-speed ocular images are recorded during the task set comprising of an Auditory Response Test (ART) Psychomotor Vigilance Test (PVT), a Letter Counting (LC) task, and a variant of the Stroop Task. EEG recorded during the ART is analyzed in the present work. Variation in network parameters in brain networks formed from the EEG records using the Motif Synchronization technique is employed to trace the change in alertness levels of subjects due to increase in cognitive fatigue.

Effectiveness of auditory and tactile crossmodal cues in a dual-task visual and auditory scenario

In this study, we examined how spatially informative auditory and tactile cues affected participants' performance on a visual search task while they simultaneously performed a secondary auditory task. Visual search task performance was assessed via reaction time and accuracy. Tactile and auditory cues provided the approximate location of the visual target within the search display. The inclusion of tactile and auditory cues improved performance in comparison to the no-cue baseline conditions. In comparison to the no-cue conditions, both tactile and auditory cues resulted in faster response times in the visual search only (single task) and visual-auditory (dual-task) conditions. However, the effectiveness of auditory and tactile cueing for visual task accuracy was shown to be dependent on task-type condition. Crossmodal cueing remains a viable strategy for improving task performance without increasing attentional load within a singular sensory modality. Practitioner Summary: Crossmodal cueing with dual-task performance has not been widely explored, yet has practical applications. We examined the effects of auditory and tactile crossmodal cues on visual search performance, with and without a secondary auditory task. Tactile cues aided visual search accuracy when also engaged in a secondary auditory task, whereas auditory cues did not.

Comparing spatially static and dynamic vibrotactile take-over requests in the driver seat

Vibrotactile stimuli can be effective as warning signals, but their effectiveness as directional take-over requests in automated driving is yet unknown. This study aimed to investigate the correct response rate, reaction times, and eye and head orientation for static versus dynamic directional take-over requests presented via vibrating motors in the driver seat. In a driving simulator, eighteen participants performed three sessions: 1) a session involving no driving (Baseline), 2) driving a highly automated car without additional task (HAD), and 3) driving a highly automated car while performing a mentally demanding task (N-Back). Per session, participants received four directional static (in the left or right part of the seat) and four dynamic (moving from one side towards the opposite left or right of the seat) take-over requests via two 6×4 motor matrices embedded in the seat back and bottom. In the Baseline condition, participants reported whether the cue was left or right, and in the HAD and N-Back conditions participants had to change lanes to the left or to the right according to the directional cue. The correct response rate was operationalized as the accuracy of the self-reported direction (Baseline session) and the accuracy of the lane change direction (HAD & N-Back sessions). The results showed that the correct response rate ranged between 94% for static patterns in the Baseline session and 74% for dynamic patterns in the N-Back session, although these effects were not statistically significant. Steering wheel touch and steering input reaction times were approximately 200ms faster for static patterns than for dynamic ones. Eye tracking results revealed a correspondence between head/eye-gaze direction and lane change direction, and showed that head and eye-gaze movements where initiated faster for static vibrations than for dynamic ones. In conclusion, vibrotactile stimuli presented via the driver seat are effective as warnings, but their effectiveness as directional take-over requests may be limited. The present study may encourage further investigation into how to get drivers safely back into the loop.

Vibrotactile perception assessment for a haptic interface on an antigravity suit

Haptic technology is used in various fields to transmit information to the user with or without visual and auditory cues. This study aimed to provide preliminary data for use in developing a haptic interface for an antigravity (anti-G) suit. With the structural characteristics of the anti-G suit in mind, we determined five areas on the body (lower back, outer thighs, inner thighs, outer calves, and inner calves) on which to install ten bar-type eccentric rotating mass (ERM) motors as vibration actuators. To determine the design factors of the haptic anti-G suit, we conducted three experiments to find the absolute threshold, moderate intensity, and subjective assessments of vibrotactile stimuli. Twenty-six fighter pilots participated in the experiments, which were conducted in a fixed-based flight simulator. From the results of our study, we recommend 1) absolute thresholds of ∼11.98-15.84 Hz and 102.01-104.06 dB, 2) moderate intensities of 74.36 Hz and 126.98 dB for the lower back and 58.65 Hz and 122.37 dB for either side of the thighs and calves, and 3) subjective assessments of vibrotactile stimuli (displeasure, easy to perceive, and level of comfort). The results of this study will be useful for the design of a haptic anti-G suit.

In Touch With the Simon Effect *The first two authors contributed equally

Cognitive control has been extensively studied using the auditory and visual modalities. In the current study, a tactile version of the Simon task was created in order to test control mechanisms in a modality that was less studied, to provide comparative and new information. A significant Simon effect – reaction time gap between congruent (i.e., stimulus and response in the same relative location) and incongruent (i.e., stimulus and response in opposite locations) stimuli – provided grounds to further examine both general and tactile-specific aspects of cognitive control in three experiments. By implementing a neutral condition and conducting sequential and distributional analysis, the present study: (a) supports two different independent mechanisms of cognitive control – reactive control and proactive control; (b) reveals facilitation and interference within the tactile Simon effect; and (c) proposes modality differences in activation and processing of the spatially driven stimulus-response association.

Evaluation of the attention network test using vibrotactile stimulations

We report a vibrotactile version of the attention network test (ANT)-the tactile ANT (T-ANT). It has been questioned whether attentional components are modality specific or not. The T-ANT explores alertness, orienting, cognitive control, and their relationships, similar to its visual counterpart, in the tactile modality. The unique features of the T-ANT are in utilizing stimuli on a single plane-the torso-and replacing the original imperative flanker task with a tactile Simon task. Subjects wore a waist belt mounted with two vibrotactile stimulators situated on the back and positioned to the right and left of the spinal column. They responded by pressing keys with their right or left hand in reaction to the type of vibrotactile stimulation (pulsed/continuous signal). On a single trial, an alerting tone was followed by a short tactile (informative/noninformative) peripheral cue and an imperative tactile Simon task target. The T-ANT was compared with a variant of the ANT in which the flanker task was replaced with a visual Simon task. Experimental data showed effects of orienting over control only when the peripheral cues were informative. In contrast to the visual task, interactions between alertness and control or alertness and orienting were not found in the tactile task. A possible rationale for these results is discussed. The T-ANT allows examination of attentional processes among patients with tactile attentional deficits and patients with eyesight deficits who cannot take part in visual tasks. Technological advancement would enable implementation of the T-ANT in brain-imaging studies.

The effects of actuator selection on non-volitional postural responses to torso-based vibrotactile stimulation

Background

Torso-based vibrotactile feedback may significantly reduce postural sway in balance-compromised adults during quiet standing or in response to perturbations. However, natural non-volitional postural responses to vibrotactile stimulation applied to the torso remain unknown.

Methods

The primary goal of this study was to determine, for two types of actuators (tactors) and in the absence of instruction, whether vibrotactile stimulation induces a directional postural shift as a function of stimulation location. Eleven healthy young adults (20 – 29 years old) were asked to maintain an upright erect posture with feet hip-width apart and eyes closed. Two types of tactors, Tactaid and C2, which differ in design and stimulation strength, were placed on the skin over the right and left external oblique, internal oblique, and erector spinae muscles in a horizontal plane corresponding approximately to the L4/L5 level. Each tactor of the same type was activated twice randomly for each individual location and twice simultaneously for all locations at a frequency of 250 Hz for a period of 5 s.

Results

Vibration applied over the internal oblique and erector spinae muscle locations induced a postural shift in the direction of the stimulation regardless of the tactor type. For the aforementioned four locations, the root-mean-square (RMS) and power spectral density (PSD) of the body sway in both the A/P and M/L directions were also significantly greater during the vibration than before or after, and were greater for the C2 tactors than for the Tactaid tactors. However, simultaneous activation of all tactors or those over the external oblique muscle locations did not produce significant postural responses regardless of the tactor type.

Conclusion

The results suggest that the use of a torso-based vibrotactile sensory augmentation display should carefully consider the tactor type as well as the instruction of corrective movements. Attractive instructional cues (“move in the direction of the vibration”) are compatible with the observed non-volitional response to stimulation and may facilitate postural adjustments during vibrotactile biofeedback balance applications.