1
|
Gao B, Shao T, Tu H, Ma Q, Liu Z, Han T. Exploring Bimanual Haptic Feedback for Spatial Search in Virtual Reality. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2024; 30:2422-2433. [PMID: 38437136 DOI: 10.1109/tvcg.2024.3372045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2024]
Abstract
Spatial search tasks are common and crucial in many Virtual Reality (VR) applications. Traditional methods to enhance the performance of spatial search often employ sensory cues such as visual, auditory, or haptic feedback. However, the design and use of bimanual haptic feedback with two VR controllers for spatial search in VR remains largely unexplored. In this work, we explored bimanual haptic feedback with various combinations of haptic properties, where four types of bimanual haptic feedback were designed, for spatial search tasks in VR. Two experiments were designed to evaluate the effectiveness of bimanual haptic feedback on spatial direction guidance and search in VR. The results from the first experiment reveal that our proposed bimanual haptic schemes significantly enhanced the recognition of spatial directions in terms of accuracy and speed compared to spatial audio feedback. The second experiment's findings suggest that the performance of bimanual haptic feedback was comparable to or even better than the visual arrow, especially in reducing the angle of head movement and enhancing searching targets behind the participants, which was supported by subjective feedback as well. Based on these findings, we have derived a set of design recommendations for spatial search using bimanual haptic feedback in VR.
Collapse
|
2
|
Rosenkranz R, Altinsoy ME. A Perceptual Model-Based Approach to Plausible Authoring of Vibration for the Haptic Metaverse. IEEE TRANSACTIONS ON HAPTICS 2024; 17:263-276. [PMID: 37747856 DOI: 10.1109/toh.2023.3318644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/27/2023]
Abstract
Haptic virtual reality is often misunderstood as being solely a physically identical copy of real environments. Thus, a perfect recording and reproduction of vibration that is indistinguishable in an A:B comparison is often the aim. However, in most virtual reality applications the real environment is not available for direct comparison. Instead, when judging the plausibility of a presented scene, the user compares the vibration to his expectations shaped by the audiovisual context. Therefore, it should be sufficient to find any vibration that the user expects to potentially occur in the given context. Such a vibration needs to elicit a perceptual profile with a minimal distance to an expected profile in the sensory tactile perceptual space. Building onto this formalization, this article demonstrates a novel generative model-based approach to authoring vibrations. First, users quantify expectations as tactile profiles consisting of ratings of six sensory tactile attributes without the presence of vibrations. Subsequently, the model predicts vibration parameters from such profiles. This ensures the fulfillment of user expectations and thus high plausibility. Furthermore, it eliminates the necessity of recordings, infeasible for scenes with no real counterpart and opens the door to crowdsourcing the authoring process with laypersons for the haptic metaverse.
Collapse
|
3
|
Lee DY, Jeong SH, Cohen AJ, Vogt DM, Kollosche M, Lansberry G, Mengüç Y, Israr A, Clarke DR, Wood RJ. A Wearable Textile-Embedded Dielectric Elastomer Actuator Haptic Display. Soft Robot 2022; 9:1186-1197. [PMID: 35856695 DOI: 10.1089/soro.2021.0098] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023] Open
Abstract
With advances in mobile computing and virtual/augmented reality technologies, communicating through touch using wearable haptic devices is poised to enrich and augment current information delivery channels that typically rely on sight and hearing. To realize a wearable haptic device capable of effective data communication, both ergonomics and haptic performance (i.e., array size, bandwidth, and perception accuracy) are essential considerations. However, these goals often involve challenging and conflicting requirements. We present an integrated approach to address these conflicts, which includes incorporating multilayered dielectric elastomer actuators, a lumped-parameter model of the skin, and a wearable frame in the design loop. An antagonistic arrangement-consisting of an actuator deforming the skin-was used to achieve effective force transmission while maintaining a low profile, and the effect of the wearable frame and structure was investigated through lumped-model analysis and human perception studies.
Collapse
Affiliation(s)
- Dae-Young Lee
- School of Engineering and Applied Sciences, Harvard University, Boston, Massachusetts, USA.,Department of Aerospace Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Seung Hee Jeong
- School of Engineering and Applied Sciences, Harvard University, Boston, Massachusetts, USA.,Department of Materials Science and Engineering, Uppsala University, Uppsala, Sweden
| | - Andy J Cohen
- School of Engineering and Applied Sciences, Harvard University, Boston, Massachusetts, USA
| | - Daniel M Vogt
- School of Engineering and Applied Sciences, Harvard University, Boston, Massachusetts, USA
| | - Matthias Kollosche
- School of Engineering and Applied Sciences, Harvard University, Boston, Massachusetts, USA
| | - Geoffrey Lansberry
- Wyss Institute for Biologically Inspired Engineering, Harvard University, Boston, Massachusetts, USA
| | - Yiğit Mengüç
- Meta Platforms, Inc., Redmond, Washington, USA.,Collaborative Robotics and Intelligent Systems (CoRIS) Institute, Oregon State University, Corvallis, Oregon, USA
| | - Ali Israr
- Meta Platforms, Inc., Redmond, Washington, USA
| | - David R Clarke
- School of Engineering and Applied Sciences, Harvard University, Boston, Massachusetts, USA
| | - Robert J Wood
- School of Engineering and Applied Sciences, Harvard University, Boston, Massachusetts, USA
| |
Collapse
|
4
|
Kwon J, Park S, Sakamoto M, Mito K. The Effects of Vibratory Frequency and Temporal Interval on Tactile Apparent Motion. IEEE TRANSACTIONS ON HAPTICS 2021; 14:675-679. [PMID: 33439848 DOI: 10.1109/toh.2021.3051388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Vibrotactile stimuli can be used to generate the haptic sensation of a static object or the motion of a dynamic object. Here, in this article, we investigated the effects of vibratory frequency and temporal interval on tactile apparent motion. In the experiment, we examined the effect of vibratory frequency with different temporal intervals on tactile apparent motion that results from two successive tactile stimuli on the index fingerpad. Results indicated that tactile apparent motion was perceived not only when both stimuli were either "flutter" or "vibration" stimuli, but also when one of each type was used. Specifically, when the first stimulus was introduced at 40Hz, "continuous motion" was viewed at all combinations of stimulus frequency, and "continuous motion" was clearly noted at the high-frequency combination instead of the low-frequency combination. Also, tactile apparent motion was predominantly viewed in the SOA range of 105 ms to 125 ms. We anticipate that our findings and further research will be essential resources for the design of tactile devices to represent the motion of dynamic objects.
Collapse
|
5
|
Rosenkranz R, Altinsoy ME. Mapping the Sensory-Perceptual Space of Vibration for User-Centered Intuitive Tactile Design. IEEE TRANSACTIONS ON HAPTICS 2021; 14:95-108. [PMID: 32776881 DOI: 10.1109/toh.2020.3015313] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In vibrotactile design, it can be beneficial to communicate with potential users about the desired properties of a product. However, such users' expectations would need to be translated into physical vibration parameters. In everyday life, humans are frequently exposed to seat vibration. Humans have learned to intuitively associate specific labels (e.g., "tingling") with specific vibrations. Thus, the aim of this article is to identify the most common sensory-perceptual attributes and their relationships to vibration parameters. First, we generalized everyday-life seat vibration into sinusoidal, amplitude-modulated sinusoidal, white Gaussian noise and impulse-like vibrations. Subsequently, the (peak) level, (center/carrier) frequency, bandwidth, modulation frequency and exponential decay rate parameters of these vibrations were systematically varied depending on the signal type. A free association task was conducted to reveal the most common sensory-perceptual attributes for each vibration. After aggregating similar attributes, the 21 most frequently occurring attributes were utilized in a second experiment to rate their suitability for describing each vibration stimulus. Principal component analysis guided the selection of six attribute groups, which can be represented by "up and down," "tingling," "weak," "repetitive," "uniform" and "fading." The observed relationships between vibration parameters and attribute ratings are suitable for future model building.
Collapse
|
6
|
Improvements in the learnability of smartphone haptic interfaces for visually impaired users. PLoS One 2019; 14:e0225053. [PMID: 31710628 PMCID: PMC6844543 DOI: 10.1371/journal.pone.0225053] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2019] [Accepted: 10/28/2019] [Indexed: 11/25/2022] Open
Abstract
We report the results of a study on the learnability of haptic icons used as alerts or notifications in smartphones. The aim was to explore the feasibility of using haptic icons to create assistive technologies for people with visual impairments. We compared the performance and satisfaction of users with different visual capacities (visually impaired vs. sighted) and using different learning processes (with or without a reinforcement learning stage). The reinforcement learning stage improves the recognition rate in both types of users, although the improvement obtained by the visually impaired users is even better as their recognition rates become very similar to those obtained by the sighted users. Finally, it was observed that the better recognized haptic icons are those assigned to the most employed applications by the user.
Collapse
|