1
|
Park J, Lee Y, Cho S, Choe A, Yeom J, Ro YG, Kim J, Kang DH, Lee S, Ko H. Soft Sensors and Actuators for Wearable Human-Machine Interfaces. Chem Rev 2024; 124:1464-1534. [PMID: 38314694 DOI: 10.1021/acs.chemrev.3c00356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Haptic human-machine interfaces (HHMIs) combine tactile sensation and haptic feedback to allow humans to interact closely with machines and robots, providing immersive experiences and convenient lifestyles. Significant progress has been made in developing wearable sensors that accurately detect physical and electrophysiological stimuli with improved softness, functionality, reliability, and selectivity. In addition, soft actuating systems have been developed to provide high-quality haptic feedback by precisely controlling force, displacement, frequency, and spatial resolution. In this Review, we discuss the latest technological advances of soft sensors and actuators for the demonstration of wearable HHMIs. We particularly focus on highlighting material and structural approaches that enable desired sensing and feedback properties necessary for effective wearable HHMIs. Furthermore, promising practical applications of current HHMI technology in various areas such as the metaverse, robotics, and user-interactive devices are discussed in detail. Finally, this Review further concludes by discussing the outlook for next-generation HHMI technology.
Collapse
Affiliation(s)
- Jonghwa Park
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Youngoh Lee
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Seungse Cho
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Ayoung Choe
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Jeonghee Yeom
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Yun Goo Ro
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Jinyoung Kim
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Dong-Hee Kang
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Seungjae Lee
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Hyunhyub Ko
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| |
Collapse
|
2
|
Du Q, Luo J, Cheng Q, Wang Y, Guo S. Vibrotactile enhancement in hand rehabilitation has a reinforcing effect on sensorimotor brain activities. Front Neurosci 2022; 16:935827. [PMID: 36267238 PMCID: PMC9577243 DOI: 10.3389/fnins.2022.935827] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Accepted: 08/31/2022] [Indexed: 11/13/2022] Open
Abstract
Objective Stroke patients often suffer from hand dysfunction or loss of tactile perception, which in turn interferes with hand rehabilitation. Tactile-enhanced multi-sensory feedback rehabilitation is an approach worth considering, but its effectiveness has not been well studied. By using functional near-infrared spectroscopy (fNIRS) to analyze the causal activity patterns in the sensorimotor cortex, the present study aims to investigate the cortical hemodynamic effects of hand rehabilitation training when tactile stimulation is applied, and to provide a basis for rehabilitation program development. Methods A vibrotactile enhanced pneumatically actuated hand rehabilitation device was tested on the less-preferred hand of 14 healthy right-handed subjects. The training tasks consisted of move hand and observe video (MO), move hand and vibration stimulation (MV), move hand, observe video, and vibration stimulation (MOV), and a contrast resting task. Region of interest (ROI), a laterality index (LI), and causal brain network analysis methods were used to explore the brain’s cortical blood flow response to a multi-sensory feedback rehabilitation task from multiple perspectives. Results (1) A more pronounced contralateral activation in the right-brain region occurred under the MOV stimulation. Rehabilitation tasks containing vibrotactile enhancement (MV and MOV) had significantly more oxyhemoglobin than the MO task at 5 s after the task starts, indicating faster contralateral activation in sensorimotor brain regions. (2) Five significant lateralized channel connections were generated under the MV and MOV tasks (p < 0.05), one significant lateralized channel connection was generated by the MO task, and the Rest were not, showing that MV and MOV caused stronger lateralization activation. (3) We investigated all thresholds of granger causality (GC) resulting in consistent relative numbers of effect connections. MV elicited stronger causal interactions between the left and right cerebral hemispheres, and at the GC threshold of 0.4, there were 13 causal network connection pairs for MV, 7 for MO, and 9 for MOV. Conclusion Vibrotactile cutaneous stimulation as a tactile enhancement can produce a stronger stimulation of the brain’s sensorimotor brain areas, promoting the establishment of neural pathways, and causing a richer effect between the left and right cerebral hemispheres. The combination of kinesthetic, vibrotactile, and visual stimulation can achieve a more prominent training efficiency from the perspective of functional cerebral hemodynamics.
Collapse
Affiliation(s)
- Qiang Du
- Academy for Engineering and Technology, Fudan University, Shanghai, China
- Shanghai Engineering Research Center of AI and Robotics, Shanghai, China
- Engineering Research Center of AI and Robotics, Ministry of Education, Shanghai, China
| | - Jingjing Luo
- Academy for Engineering and Technology, Fudan University, Shanghai, China
- Shanghai Engineering Research Center of AI and Robotics, Shanghai, China
- Engineering Research Center of AI and Robotics, Ministry of Education, Shanghai, China
- Jihua Laboratory, Foshan, China
- *Correspondence: Jingjing Luo,
| | - Qiying Cheng
- Academy for Engineering and Technology, Fudan University, Shanghai, China
- Shanghai Engineering Research Center of AI and Robotics, Shanghai, China
- Engineering Research Center of AI and Robotics, Ministry of Education, Shanghai, China
| | - Youhao Wang
- Academy for Engineering and Technology, Fudan University, Shanghai, China
- Shanghai Engineering Research Center of AI and Robotics, Shanghai, China
- Engineering Research Center of AI and Robotics, Ministry of Education, Shanghai, China
| | - Shijie Guo
- Academy for Engineering and Technology, Fudan University, Shanghai, China
- Shanghai Engineering Research Center of AI and Robotics, Shanghai, China
- Engineering Research Center of AI and Robotics, Ministry of Education, Shanghai, China
- Department of the State Key Laboratory of Reliability and Intelligence of Electrical Equipment and the Hebei Key Laboratory of Robot Perception and Human-Robot Interaction, Hebei University of Technology, Tianjin, China
- Shijie Guo,
| |
Collapse
|
3
|
Welker CG, Collins SH, Okamura AM. Human Perception of Wrist Flexion and Extension Torque During Upper and Lower Extremity Movement. IEEE TRANSACTIONS ON HAPTICS 2022; 15:741-752. [PMID: 36343009 DOI: 10.1109/toh.2022.3219031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Real-world application of haptic feedback from kinesthetic devices is implemented while the user is in motion, but human wrist torque magnitude discrimination has previously only been characterized while users are stationary. In this study, we measured wrist torque discrimination in conditions relevant to activities of daily living, using a previously developed backdrivable wrist exoskeleton capable of applying wrist flexion and extension torque. We implemented a torque comparison test using a two-alternative forced-choice paradigm while participants were both seated and walking on a treadmill, with both a stationary and a moving wrist. Like most kinesthetic haptic devices, the wrist exoskeleton output torque is commanded in an open-loop manner. Thus, the study design was informed by Monte Carlo simulations to verify that the errors in the wrist exoskeleton output torque would not significantly affect the results. Results from ten participants show that although both walking and moving wrist conditions result in higher Weber Fractions (worse perception), participants were able to detect relatively small changes in torque of 12-19% on average in all grouped conditions. The results provide insight regarding the torque magnitudes necessary to make wrist-worn kinesthetic haptic devices noticeable and meaningful to the user in various conditions relevant to activities of daily living.
Collapse
|
4
|
Martinez-Hernandez U, Metcalfe B, Assaf T, Jabban L, Male J, Zhang D. Wearable Assistive Robotics: A Perspective on Current Challenges and Future Trends. SENSORS (BASEL, SWITZERLAND) 2021; 21:6751. [PMID: 34695964 PMCID: PMC8539021 DOI: 10.3390/s21206751] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Revised: 09/30/2021] [Accepted: 10/06/2021] [Indexed: 11/16/2022]
Abstract
Wearable assistive robotics is an emerging technology with the potential to assist humans with sensorimotor impairments to perform daily activities. This assistance enables individuals to be physically and socially active, perform activities independently, and recover quality of life. These benefits to society have motivated the study of several robotic approaches, developing systems ranging from rigid to soft robots with single and multimodal sensing, heuristics and machine learning methods, and from manual to autonomous control for assistance of the upper and lower limbs. This type of wearable robotic technology, being in direct contact and interaction with the body, needs to comply with a variety of requirements to make the system and assistance efficient, safe and usable on a daily basis by the individual. This paper presents a brief review of the progress achieved in recent years, the current challenges and trends for the design and deployment of wearable assistive robotics including the clinical and user need, material and sensing technology, machine learning methods for perception and control, adaptability and acceptability, datasets and standards, and translation from lab to the real world.
Collapse
Affiliation(s)
- Uriel Martinez-Hernandez
- Multimodal Inte-R-Action Lab, University of Bath, Bath BA2 7AY, UK;
- Centre for Autonomous Robotics (CENTAUR), University of Bath, Bath BA2 7AY, UK; (B.M.); (T.A.); (D.Z.)
- Centre for Biosensors, Bioelectronics and Biodevices (C3Bio), University of Bath, Bath BA2 7AY, UK;
- Department of Electronics and Electrical Engineering, University of Bath, Bath BA2 7AY, UK
| | - Benjamin Metcalfe
- Centre for Autonomous Robotics (CENTAUR), University of Bath, Bath BA2 7AY, UK; (B.M.); (T.A.); (D.Z.)
- Centre for Biosensors, Bioelectronics and Biodevices (C3Bio), University of Bath, Bath BA2 7AY, UK;
- Department of Electronics and Electrical Engineering, University of Bath, Bath BA2 7AY, UK
| | - Tareq Assaf
- Centre for Autonomous Robotics (CENTAUR), University of Bath, Bath BA2 7AY, UK; (B.M.); (T.A.); (D.Z.)
- Centre for Biosensors, Bioelectronics and Biodevices (C3Bio), University of Bath, Bath BA2 7AY, UK;
- Department of Electronics and Electrical Engineering, University of Bath, Bath BA2 7AY, UK
| | - Leen Jabban
- Centre for Biosensors, Bioelectronics and Biodevices (C3Bio), University of Bath, Bath BA2 7AY, UK;
- Department of Electronics and Electrical Engineering, University of Bath, Bath BA2 7AY, UK
| | - James Male
- Multimodal Inte-R-Action Lab, University of Bath, Bath BA2 7AY, UK;
- Centre for Autonomous Robotics (CENTAUR), University of Bath, Bath BA2 7AY, UK; (B.M.); (T.A.); (D.Z.)
- Department of Electronics and Electrical Engineering, University of Bath, Bath BA2 7AY, UK
| | - Dingguo Zhang
- Centre for Autonomous Robotics (CENTAUR), University of Bath, Bath BA2 7AY, UK; (B.M.); (T.A.); (D.Z.)
- Centre for Biosensors, Bioelectronics and Biodevices (C3Bio), University of Bath, Bath BA2 7AY, UK;
- Department of Electronics and Electrical Engineering, University of Bath, Bath BA2 7AY, UK
| |
Collapse
|
5
|
Shabaniverki S, Xie S, Ren J, Juárez JJ. Soft Ferrofluid Actuator Based on 3D-Printed Scaffold Removal. 3D PRINTING AND ADDITIVE MANUFACTURING 2021; 8:126-135. [PMID: 36655058 PMCID: PMC9828599 DOI: 10.1089/3dp.2020.0012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Fabricating soft functional materials via additive manufacturing is an emerging field with a wide variety of applications due to their ability to respond to specifically engineered stimuli (e.g., mechanical, electrical, magnetic, chemical). This article describes an approach to engineering magnetically sensitive structures using three-dimensional printing of acrylonitrile butadiene styrene scaffolds. These scaffolds are encapsulated in polydimethylsiloxane (PDMS) and removed using organic solvents. The open channels that remain after removal are filled in with a ferrofluid to render the structure magnetically sensitive. A three-point flexural test shows that introducing a channel in this way only reduces the flexural modulus of the PDMS by a factor ∼8%. We perform magnetic deflection experiments on samples with three different channel diameters. Our results show a linear dependence between applied magnetic field strength and deflection. We also find that there is a minimum magnetic field strength that needs to be applied to achieve deflection. These results suggest that there is a minimum yield stress, beyond which deflection will occur. We perform experiments on a more complex channel geometry to find that there are multiple modes of deflection. A rational approach to channel design may enable us to tune the mechanical response and direct these actuators to undergo complex motion.
Collapse
Affiliation(s)
| | - Shengwen Xie
- Department of Mechanical Engineering, Iowa State University, Ames, Iowa, USA
| | - Juan Ren
- Department of Mechanical Engineering, Iowa State University, Ames, Iowa, USA
| | - Jaime J. Juárez
- Department of Mechanical Engineering, Iowa State University, Ames, Iowa, USA
- Center for Multiphase Flow Research and Education, Iowa State University, Ames, Iowa, USA
| |
Collapse
|
6
|
Chiaradia D, Tiseni L, Xiloyannis M, Solazzi M, Masia L, Frisoli A. An Assistive Soft Wrist Exosuit for Flexion Movements With an Ergonomic Reinforced Glove. Front Robot AI 2021; 7:595862. [PMID: 33537345 PMCID: PMC7848217 DOI: 10.3389/frobt.2020.595862] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Accepted: 11/02/2020] [Indexed: 11/13/2022] Open
Abstract
Soft exosuits are a promising solution for the assistance and augmentation of human motor abilities in the industrial field, where the use of more symbiotic wearable robots can avoid excessive worker fatigue and improve the quality of the work. One of the challenges in the design of soft exosuits is the choice of the right amount of softness to balance load transfer, ergonomics, and weight. This article presents a cable-driven based soft wrist exosuit for flexion assistance with the use of an ergonomic reinforced glove. The flexible and highly compliant three-dimensional (3D)-printed plastic structure that is sewn on the glove allows an optimal force transfer from the remotely located motor to the wrist articulation and to preserve a high level of comfort for the user during assistance. The device is shown to reduce fatigue and the muscular effort required for holding and lifting loads in healthy subjects for weights up to 3 kg.
Collapse
Affiliation(s)
- Domenico Chiaradia
- Percro Laboratory, Tecip Institute, Sant'Anna School of Advanced Studies, Pisa, Italy
| | - Luca Tiseni
- Percro Laboratory, Tecip Institute, Sant'Anna School of Advanced Studies, Pisa, Italy
| | - Michele Xiloyannis
- Sensory-Motor Systems (SMS) Lab, Institute of Robotics and Intelligent Systems (IRIS), ETH Zurich, Switzerland and the Spinal Cord Injury Center, University Hospital Balgrist, Zurich, Switzerland
| | - Massimiliano Solazzi
- Percro Laboratory, Tecip Institute, Sant'Anna School of Advanced Studies, Pisa, Italy
| | - Lorenzo Masia
- Institut für Technische Informatik (ZITI), Heidelberg University, Heidelberg, Germany
| | - Antonio Frisoli
- Percro Laboratory, Tecip Institute, Sant'Anna School of Advanced Studies, Pisa, Italy
| |
Collapse
|
7
|
|
8
|
Abdi E, Kulic D, Croft E. Haptics in Teleoperated Medical Interventions: Force Measurement, Haptic Interfaces and Their Influence on User's Performance. IEEE Trans Biomed Eng 2020; 67:3438-3451. [PMID: 32305890 DOI: 10.1109/tbme.2020.2987603] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVES Haptics in teleoperated medical interventions enables measurement and transfer of force information to the operator during robot-environment interaction. This paper provides an overview of the current research in this domain and guidelines for future investigations. METHODS We review current technologies in force measurement and haptic devices as well as their experimental evaluation and influence on user's performance. RESULTS Force sensing is moving away from the conventional proximal measurement methods to distal sensing and contact-less methods. Wearable devices that deliver haptic feedback on different body parts are increasingly playing an important role. Performance and accuracy improvement are the widely reported benefits of haptic feedback, while there is a debate on its effect on task completion time and exerted force. CONCLUSION With the surge of new ideas, there is a need for better and more systematic validation of the new sensing and feedback technology, through better user studies and novel methods like validated benchmarks and new taxonomies. SIGNIFICANCE This review investigates haptics from sensing to interfaces within the context of user's performance and the validation procedures to highlight salient advances. It provides guidelines to future developments and highlights the shortcomings in the field.
Collapse
|
9
|
Osgouei RH, Marechal L, Kontovounisios C, Bello F. Soft Pneumatic Actuator for Rendering Anal Sphincter Tone. IEEE TRANSACTIONS ON HAPTICS 2020; 13:183-190. [PMID: 31985441 DOI: 10.1109/toh.2020.2968446] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Sphincter tone examination, as part of digital rectal examination (DRE), can provide essential information to support the early detection of colorectal cancer. Mastering DRE skills for junior doctors is always challenging due to the lack of real training cases. In this article, we developed a soft pneumatic active actuator,made of a compound of silicone rubber materials, to mimic human sphincter muscles and simulate various anal sphincter tones for the purpose of training. Different pumping actuation (syringe and bellows) and driving mechanisms (linear, stepper, and servo motor) were implemented and compared for their effect on the rendered tones. A further comparison was made with a previous prototype based on a cable-driven mechanism. Both quantitative and qualitative assessments were conducted to evaluate the performance of each mechanism. A differential pressure sensor was used to measure applied pressure on a catheter balloon placed inside the sphincter, comparing the readings with anorectal manometry data obtained from real patients. Qualitative feedback was gathered through a user study with ten colorectal expert practitioners. Four questions were asked targeting reaction/response time, pressure level, pressure quality, and similarity to a real case. The results show the capacity and limitation of each mechanism, with the one based on a servo motor and a bellows being the most favourably rated.
Collapse
|
10
|
Design of Shape Memory Alloy-Based Soft Wearable Robot for Assisting Wrist Motion. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9194025] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
In this paper, we propose a shape memory alloy (SMA)-based wearable robot that assists the wrist motion for patients who have difficulties in manipulating the lower arm. Since SMA shows high contraction strain when it is designed as a form of coil spring shape, the proposed muscle-like actuator was designed after optimizing the spring parameters. The fabricated actuator shows a maximum force of 10 N and a maximum contraction ratio of 40%. The SMA-based wearable robot, named soft wrist assist (SWA), assists 2 degrees of freedom (DOF) wrist motions. In addition, the robot is totally flexible and weighs 151g for the wearable parts. A maximum torque of 1.32 Nm was measured for wrist flexion, and a torque of larger than 0.5 Nm was measured for the other motions. The robot showed the average range of motion (ROM) with 33.8, 30.4, 15.4, and 21.4 degrees for flexion, extension, ulnar, and radial deviation, respectively. Thanks to the soft feature of the SWA, time cost for wearing the device is shorter than 2 min as was also the case for patients when putting it on by themselves. From the experimental results, the SWA is expected to support wrist motion for diverse activities of daily living (ADL) routinely for patients.
Collapse
|
11
|
Barreiros J, Claure H, Peele B, Shapira O, Spjut J, Luebke D, Jung M, Shepherd R. Fluidic Elastomer Actuators for Haptic Interactions in Virtual Reality. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2018.2888628] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
12
|
Kanjanapas S, Nunez CM, Williams SR, Okamura AM, Luo M. Design and Analysis of Pneumatic 2-DoF Soft Haptic Devices for Shear Display. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2895890] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
13
|
Haynes A, Simons MF, Helps T, Nakamura Y, Rossiter J. A Wearable Skin-Stretching Tactile Interface for Human–Robot and Human–Human Communication. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2896933] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|