1
|
Park M, Park T, Park S, Yoon SJ, Koo SH, Park YL. Stretchable glove for accurate and robust hand pose reconstruction based on comprehensive motion data. Nat Commun 2024; 15:5821. [PMID: 38987530 PMCID: PMC11237015 DOI: 10.1038/s41467-024-50101-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 06/29/2024] [Indexed: 07/12/2024] Open
Abstract
We propose a compact wearable glove capable of estimating both the finger bone lengths and the joint angles of the wearer with a simple stretch-based sensing mechanism. The soft sensing glove is designed to easily stretch and to be one-size-fits-all, both measuring the size of the hand and estimating the finger joint motions of the thumb, index, and middle fingers. The system was calibrated and evaluated using comprehensive hand motion data that reflect the extensive range of natural human hand motions and various anatomical structures. The data were collected with a custom motion-capture setup and transformed into the joint angles through our post-processing method. The glove system is capable of reconstructing arbitrary and even unconventional hand poses with accuracy and robustness, confirmed by evaluations on the estimation of bone lengths (mean error: 2.1 mm), joint angles (mean error: 4.16°), and fingertip positions (mean 3D error: 4.02 mm), and on overall hand pose reconstructions in various applications. The proposed glove allows us to take advantage of the dexterity of the human hand with potential applications, including but not limited to teleoperation of anthropomorphic robot hands or surgical robots, virtual and augmented reality, and collection of human motion data.
Collapse
Affiliation(s)
- Myungsun Park
- Department of Mechanical Engineering, Seoul National University, Seoul, 08826, South Korea
- Department of Mechanical and Aerospace Engineering, University of California San Diego, La Jolla, CA, 92093, USA
| | - Taejun Park
- Department of Mechanical Engineering, Seoul National University, Seoul, 08826, South Korea
- Institute of Advanced Machines and Design, Seoul National University, Seoul, 08826, South Korea
| | - Soah Park
- Department of Clothing and Textiles, Yonsei University, Seoul, 03722, South Korea
| | - Sohee John Yoon
- Department of Mechanical Engineering, Seoul National University, Seoul, 08826, South Korea
- Institute of Advanced Machines and Design, Seoul National University, Seoul, 08826, South Korea
| | - Sumin Helen Koo
- Department of Clothing and Textiles, Yonsei University, Seoul, 03722, South Korea.
| | - Yong-Lae Park
- Department of Mechanical Engineering, Seoul National University, Seoul, 08826, South Korea.
- Institute of Advanced Machines and Design, Seoul National University, Seoul, 08826, South Korea.
- Institute of Engineering Research, Seoul National University, Seoul, 08826, South Korea.
| |
Collapse
|
2
|
Rapp J, Sandurkov B, Müller P, Jung N, Gleich B. A compact setup for behavioral studies measuring limb acceleration. HARDWAREX 2024; 18:e00522. [PMID: 38633334 PMCID: PMC11022083 DOI: 10.1016/j.ohx.2024.e00522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 02/29/2024] [Accepted: 03/15/2024] [Indexed: 04/19/2024]
Abstract
Behavioral studies contribute largely to a broader understanding of human brain mechanisms and the process of learning and memory. An established method to quantify motor learning is the analysis of thumb activity. In combination with brain stimulation, the effect of various treatments on neural plasticity and motor learning can be assessed. So far, the setups for thumb abduction measurements employed consist of bulky amplifiers and digital-to-analog devices to record the data. We developed a compact hardware setup to measure acceleration data which can be integrated into a wearable, including a sensor board and a microcontroller board which can be connected to a PC via USB. Additionally, we provide two software packages including graphical user interfaces, one to communicate with the hardware and one to evaluate and process the data. This work demonstrates the construction and application of our setup at the example of thumb acceleration measurement with a custom made glove and its use for research. Using integrated circuits, the size of the measurement devices is reduced to this wearable. It is simple to construct and can be operated easily by non-technical staff.
Collapse
Affiliation(s)
- J. Rapp
- Munich Institute of Biomedical Engineering (MIBE), Technische Universität München, Garching 85748, Germany
| | - B. Sandurkov
- Munich Institute of Biomedical Engineering (MIBE), Technische Universität München, Garching 85748, Germany
| | - P. Müller
- Department of Pediatrics, Technical University Munich, Kinderzentrum München gemeinnützige GmbH, Heiglhofstrasse 65, Munich 81377, Germany
| | - N.H. Jung
- Department of Pediatrics, Technical University Munich, Kinderzentrum München gemeinnützige GmbH, Heiglhofstrasse 65, Munich 81377, Germany
| | - B. Gleich
- Munich Institute of Biomedical Engineering (MIBE), Technische Universität München, Garching 85748, Germany
| |
Collapse
|
3
|
Xiao K, Wang Z, Ye Y, Teng C, Min R. PDMS-embedded wearable FBG sensors for gesture recognition and communication assistance. BIOMEDICAL OPTICS EXPRESS 2024; 15:1892-1909. [PMID: 38495686 PMCID: PMC10942691 DOI: 10.1364/boe.517104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 01/31/2024] [Accepted: 01/31/2024] [Indexed: 03/19/2024]
Abstract
This study introduces fiber Bragg grating (FBG) sensors embedded in polydimethylsiloxane (PDMS) silicone elastomer specifically engineered for recognizing intricate gestures like wrist pitch, finger bending, and mouth movement. Sensors with different PDMS patch thicknesses underwent evaluation including thermal, tensile strain, and bending deformation characterization, demonstrating a stability of at least four months. Experiments revealed the FBG sensors' accurate wrist pitch recognition across participants after calibration, confirmed by statistical metrics and Bland-Altman plots. Utilizing finger and mouth movements, the developed system shows promise in assisting post-stroke patients and individuals with disabilities, enhancing their interaction capabilities with the external surroundings.
Collapse
Affiliation(s)
- Kun Xiao
- Faculty of Arts and Sciences, Beijing Normal University, Zhuhai 519087, China
| | - Zhuo Wang
- Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Zhuhai 519087, China
| | - Yudong Ye
- Planetary Environmental and Astrobiological Research Laboratory, School of Atmospheric Sciences, Sun Yat-sen University, Zhuhai 519082, China
| | - Chuanxin Teng
- Photonics Research Center, Guilin University of Electronic Technology, Guilin 541004, China
| | - Rui Min
- Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Zhuhai 519087, China
| |
Collapse
|
4
|
Zhang X, Wang C, Zheng T, Wu H, Wu Q, Wang Y. Wearable Optical Fiber Sensors in Medical Monitoring Applications: A Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:6671. [PMID: 37571457 PMCID: PMC10422468 DOI: 10.3390/s23156671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 07/17/2023] [Accepted: 07/21/2023] [Indexed: 08/13/2023]
Abstract
Wearable optical fiber sensors have great potential for development in medical monitoring. With the increasing demand for compactness, comfort, accuracy, and other features in new medical monitoring devices, the development of wearable optical fiber sensors is increasingly meeting these requirements. This paper reviews the latest evolution of wearable optical fiber sensors in the medical field. Three types of wearable optical fiber sensors are analyzed: wearable optical fiber sensors based on Fiber Bragg grating, wearable optical fiber sensors based on light intensity changes, and wearable optical fiber sensors based on Fabry-Perot interferometry. The innovation of wearable optical fiber sensors in respiration and joint monitoring is introduced in detail, and the main principles of three kinds of wearable optical fiber sensors are summarized. In addition, we discuss their advantages, limitations, directions to improve accuracy and the challenges they face. We also look forward to future development prospects, such as the combination of wireless networks which will change how medical services are provided. Wearable optical fiber sensors offer a viable technology for prospective continuous medical surveillance and will change future medical benefits.
Collapse
Affiliation(s)
- Xuhui Zhang
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China; (X.Z.); (C.W.); (H.W.)
| | - Chunyang Wang
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China; (X.Z.); (C.W.); (H.W.)
| | - Tong Zheng
- School of Artificial Intelligence, Beijing Technology and Business University, Beijing 100048, China;
| | - Haibin Wu
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China; (X.Z.); (C.W.); (H.W.)
| | - Qing Wu
- Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China; (X.Z.); (C.W.); (H.W.)
| | - Yunzheng Wang
- Center for Optics Research and Engineering, Shandong University, Qingdao 266237, China
| |
Collapse
|
5
|
Dong H, Shin H, Ho E, Jin HJ, Letourneau S, Banerjee T, Masschelein G, Davidson J, Wilson C, de Ribaupierre S, Eagleson R, Symonette CJ. Next-Generation Remote Hand Assessments: Cross-Platform DIGITS Web Application. JOURNAL OF HAND SURGERY GLOBAL ONLINE 2023. [DOI: 10.1016/j.jhsg.2023.01.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2023] Open
|
6
|
Morozov OG. Fiber Bragg Grating-Based Sensors and Systems. SENSORS 2021; 21:s21248225. [PMID: 34960319 PMCID: PMC8708303 DOI: 10.3390/s21248225] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Accepted: 12/07/2021] [Indexed: 11/16/2022]
Affiliation(s)
- Oleg G Morozov
- Department of Radiophotonics and Microwave Technologies, Kazan National Research Technical University Named after A.N. Tupolev-KAI, 10 Karl Marx Str., 420111 Kazan, Russia
| |
Collapse
|
7
|
Low-Latency Haptic Open Glove for Immersive Virtual Reality Interaction. SENSORS 2021; 21:s21113682. [PMID: 34070608 PMCID: PMC8198336 DOI: 10.3390/s21113682] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 05/17/2021] [Accepted: 05/21/2021] [Indexed: 11/17/2022]
Abstract
Recent advancements in telecommunications and the tactile Internet have paved the way for studying human senses through haptic technology. Haptic technology enables tactile sensations and control using virtual reality (VR) over a network. Researchers are developing various haptic devices to allow for real-time tactile sensation, which can be used in various industries, telesurgery, and other mission-critical operations. One of the main criteria of such devices is extremely low latency, as low as 1 ms. Although researchers are attempting to develop haptic devices with low latency, there remains a need to improve latency and robustness to hand sizes. In this paper, a low-latency haptic open glove (LLHOG) based on a rotary position sensor and min-max scaling (MMS) filter is proposed to realize immersive VR interaction. The proposed device detects finger flexion/extension and adduction/abduction motions using two position sensors located in the metacarpophalangeal (MCP) joint. The sensor data are processed using an MMS filter to enable low latency and ensure high accuracy. Moreover, the MMS filter is used to process object handling control data to enable hand motion-tracking. Its performance is evaluated in terms of accuracy, latency, and robustness to finger length variations. We achieved a very low processing delay of 145.37 μs per finger and overall hand motion-tracking latency of 4 ms. Moreover, we tested the proposed glove with 10 subjects and achieved an average mean absolute error (MAE) of 3.091∘ for flexion/extension, and 2.068∘ for adduction/abduction. The proposed method is therefore superior to the existing methods in terms of the above factors for immersive VR interaction.
Collapse
|
8
|
Ahmad Tarar A, Mohammad U, K. Srivastava S. Wearable Skin Sensors and Their Challenges: A Review of Transdermal, Optical, and Mechanical Sensors. BIOSENSORS-BASEL 2020; 10:bios10060056. [PMID: 32481598 PMCID: PMC7345448 DOI: 10.3390/bios10060056] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/22/2020] [Revised: 05/15/2020] [Accepted: 05/25/2020] [Indexed: 12/21/2022]
Abstract
Wearable technology and mobile healthcare systems are both increasingly popular solutions to traditional healthcare due to their ease of implementation and cost-effectiveness for remote health monitoring. Recent advances in research, especially the miniaturization of sensors, have significantly contributed to commercializing the wearable technology. Most of the traditional commercially available sensors are either mechanical or optical, but nowadays transdermal microneedles are also being used for micro-sensing such as continuous glucose monitoring. However, there remain certain challenges that need to be addressed before the possibility of large-scale deployment. The biggest challenge faced by all these wearable sensors is our skin, which has an inherent property to resist and protect the body from the outside world. On the other hand, biosensing is not possible without overcoming this resistance. Consequently, understanding the skin structure and its response to different types of sensing is necessary to remove the scientific barriers that are hindering our ability to design more efficient and robust skin sensors. In this article, we review research reports related to three different biosensing modalities that are commonly used along with the challenges faced in their implementation for detection. We believe this review will be of significant use to researchers looking to solve existing problems within the ongoing research in wearable sensors.
Collapse
Affiliation(s)
- Ammar Ahmad Tarar
- Department of Biological Engineering, University of Idaho, Moscow, ID 83844, USA;
| | - Umair Mohammad
- Department of Electrical & Computer Engineering, University of Idaho, Moscow, ID 83844, USA;
| | - Soumya K. Srivastava
- Department of Chemical & Materials Engineering, University of Idaho, Moscow, ID 83844, USA
- Correspondence: ; Tel.: +1-208-885-7652
| |
Collapse
|
9
|
Han Y, Ni K, Li X, Wu G, Yu K, Zhou Q, Wang X. An FPGA Platform for Next-Generation Grating Encoders. SENSORS 2020; 20:s20082266. [PMID: 32316231 PMCID: PMC7219053 DOI: 10.3390/s20082266] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2020] [Revised: 04/11/2020] [Accepted: 04/12/2020] [Indexed: 11/26/2022]
Abstract
Among various nanometer-level displacement measurement methods, grating interferometry-based linear encoders are widely used due to their high robustness, relatively low cost, and compactness. One trend of grating encoders is multi-axis measurement capability for simultaneous precision positioning and small order error motion measurement. However, due to both lack of suitable hardware data processing platform and of a real-time displacement calculation system, meeting the requirements of real-time data processing while maintaining the nanometer order resolutions on all these axes is a challenge. To solve above-mentioned problem, in this paper we introduce a design and experimental validation of a field programmable gate array (FPGA)-cored real-time data processing platform for grating encoders. This platform includes the following functions. First, a front-end photodetector and I/V conversion analog circuit are used to realize basic analog signal filtering, while an eight-channel parallel, 16-bit precision, 200 kSPS maximum acquisition rate Analog-to-digital (ADC) is used to obtain digital signals that are easy to process. Then, an FPGA-based digital signal processing platform is implemented, which can calculate the displacement values corresponding to the phase subdivision signals in parallel and in real time at high speed. Finally, the displacement result is transferred by USB2.0 to the PC in real time through an Universal Asynchronous Receiver/Transmitter (UART) serial port to form a complete real-time displacement calculation system. The experimental results show that the system achieves real-time data processing and displacement result display while meeting the high accuracy of traditional offline data solution methods, which demonstrates the industrial potential and practicality of our absolute two-dimensional grating scale displacement measurement system.
Collapse
Affiliation(s)
- Yaodong Han
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (Y.H.); (K.N.); (G.W.); (K.Y.); (Q.Z.); (X.W.)
| | - Kai Ni
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (Y.H.); (K.N.); (G.W.); (K.Y.); (Q.Z.); (X.W.)
| | - Xinghui Li
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (Y.H.); (K.N.); (G.W.); (K.Y.); (Q.Z.); (X.W.)
- Correspondence: ; Tel.: +86-26032544
| | - Guanhao Wu
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (Y.H.); (K.N.); (G.W.); (K.Y.); (Q.Z.); (X.W.)
- Department of Precision Instrument, Tsinghua University, Haidian District, Beijing 100084, China
| | - Kangning Yu
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (Y.H.); (K.N.); (G.W.); (K.Y.); (Q.Z.); (X.W.)
| | - Qian Zhou
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (Y.H.); (K.N.); (G.W.); (K.Y.); (Q.Z.); (X.W.)
| | - Xiaohao Wang
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (Y.H.); (K.N.); (G.W.); (K.Y.); (Q.Z.); (X.W.)
| |
Collapse
|