1
|
Boateng D, Li X, Zhu Y, Zhang H, Wu M, Liu J, Kang Y, Zeng H, Han L. Recent advances in flexible hydrogel sensors: Enhancing data processing and machine learning for intelligent perception. Biosens Bioelectron 2024; 261:116499. [PMID: 38896981 DOI: 10.1016/j.bios.2024.116499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Revised: 06/07/2024] [Accepted: 06/12/2024] [Indexed: 06/21/2024]
Abstract
With the advent of flexible electronics and sensing technology, hydrogel-based flexible sensors have exhibited considerable potential across a diverse range of applications, including wearable electronics and soft robotics. Recently, advanced machine learning (ML) algorithms have been integrated into flexible hydrogel sensing technology to enhance their data processing capabilities and to achieve intelligent perception. However, there are no reviews specifically focusing on the data processing steps and analysis based on the raw sensing data obtained by flexible hydrogel sensors. Here we provide a comprehensive review of the latest advancements and breakthroughs in intelligent perception achieved through the fusion of ML algorithms with flexible hydrogel sensors, across various applications. Moreover, this review thoroughly examines the data processing techniques employed in flexible hydrogel sensors, offering valuable perspectives expected to drive future data-driven applications in this field.
Collapse
Affiliation(s)
- Derrick Boateng
- College of Applied Sciences, Shenzhen University, Shenzhen, 518060, China; Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen, 518060, China; College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518188, China
| | - Xukai Li
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518188, China
| | - Yuhan Zhu
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518188, China
| | - Hao Zhang
- School of Physics and Optoelectronic Engineering, Hainan University, Haikou, 570228, China.
| | - Meng Wu
- Chemical and Materials Engineering, University of Alberta, Edmonton, Alberta, T6G 2V4, Canada
| | - Jifang Liu
- The Fifth Affiliated Hospital, Guangzhou Medical University, Guangzhou, Guangdong, 510700, China
| | - Yan Kang
- College of Applied Sciences, Shenzhen University, Shenzhen, 518060, China; Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen, 518060, China; College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518188, China
| | - Hongbo Zeng
- Chemical and Materials Engineering, University of Alberta, Edmonton, Alberta, T6G 2V4, Canada
| | - Linbo Han
- College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, 518188, China.
| |
Collapse
|
2
|
Cui J, Yan B, Du H, Shang Y, Tong L. Application of Foot Hallux Contact Force Signal for Assistive Hand Fine Control. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115277. [PMID: 37300003 DOI: 10.3390/s23115277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 05/20/2023] [Accepted: 05/29/2023] [Indexed: 06/12/2023]
Abstract
Accurate recognition of disabled persons' behavioral intentions is the key to reconstructing hand function. Their intentions can be understood to some extent by electromyography (EMG), electroencephalogram (EEG), and arm movements, but they are not reliable enough to be generally accepted. In this paper, characteristics of foot contact force signals are investigated, and a method of expressing grasping intentions based on hallux (big toe) touch sense is proposed. First, force signals acquisition methods and devices are investigated and designed. By analyzing characteristics of signals in different areas of the foot, the hallux is selected. The peak number and other characteristic parameters are used to characterize signals, which can significantly express grasping intentions. Second, considering complex and fine tasks of the assistive hand, a posture control method is proposed. Based on this, many human-in-the-loop experiments are conducted using human-computer interaction methods. The results showed that people with hand disabilities could accurately express their grasping intentions through their toes, and could accurately grasp objects of different sizes, shapes, and hardness using their feet. The accuracy of the action completion for single-handed and double-handed disabled individuals was 99% and 98%, respectively. This proves that the method of using toe tactile sensation for assisting disabled individuals in hand control can help them complete daily fine motor activities. The method is easily acceptable in terms of reliability, unobtrusiveness, and aesthetics.
Collapse
Affiliation(s)
- Jianwei Cui
- School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China
| | - Bingyan Yan
- School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China
| | - Han Du
- School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China
| | - Yucheng Shang
- School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China
| | - Liyan Tong
- School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China
| |
Collapse
|
3
|
Ardhianto P, Subiakto RBR, Lin CY, Jan YK, Liau BY, Tsai JY, Akbari VBH, Lung CW. A Deep Learning Method for Foot Progression Angle Detection in Plantar Pressure Images. SENSORS 2022; 22:s22072786. [PMID: 35408399 PMCID: PMC9003219 DOI: 10.3390/s22072786] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 03/31/2022] [Accepted: 04/01/2022] [Indexed: 02/01/2023]
Abstract
Foot progression angle (FPA) analysis is one of the core methods to detect gait pathologies as basic information to prevent foot injury from excessive in-toeing and out-toeing. Deep learning-based object detection can assist in measuring the FPA through plantar pressure images. This study aims to establish a precision model for determining the FPA. The precision detection of FPA can provide information with in-toeing, out-toeing, and rearfoot kinematics to evaluate the effect of physical therapy programs on knee pain and knee osteoarthritis. We analyzed a total of 1424 plantar images with three different You Only Look Once (YOLO) networks: YOLO v3, v4, and v5x, to obtain a suitable model for FPA detection. YOLOv4 showed higher performance of the profile-box, with average precision in the left foot of 100.00% and the right foot of 99.78%, respectively. Besides, in detecting the foot angle-box, the ground-truth has similar results with YOLOv4 (5.58 ± 0.10° vs. 5.86 ± 0.09°, p = 0.013). In contrast, there was a significant difference in FPA between ground-truth vs. YOLOv3 (5.58 ± 0.10° vs. 6.07 ± 0.06°, p < 0.001), and ground-truth vs. YOLOv5x (5.58 ± 0.10° vs. 6.75 ± 0.06°, p < 0.001). This result implies that deep learning with YOLOv4 can enhance the detection of FPA.
Collapse
Affiliation(s)
- Peter Ardhianto
- Department of Visual Communication Design, Soegijapranata Catholic University, Semarang 50234, Indonesia;
- Department of Digital Media Design, Asia University, Taichung 413305, Taiwan;
| | | | - Chih-Yang Lin
- Department of Electrical Engineering, Yuan Ze University, Chung-Li 32003, Taiwan;
| | - Yih-Kuen Jan
- Rehabilitation Engineering Lab, University of Illinois at Urbana-Champaign, Champaign, IL 61820, USA;
- Kinesiology and Community Health, University of Illinois at Urbana-Champaign, Champaign, IL 61820, USA
- Computational Science and Engineering, University of Illinois at Urbana-Champaign, Champaign, IL 61820, USA
| | - Ben-Yi Liau
- Department of Biomedical Engineering, Hungkuang University, Taichung 433304, Taiwan;
| | - Jen-Yung Tsai
- Department of Digital Media Design, Asia University, Taichung 413305, Taiwan;
| | | | - Chi-Wen Lung
- Rehabilitation Engineering Lab, University of Illinois at Urbana-Champaign, Champaign, IL 61820, USA;
- Department of Creative Product Design, Asia University, Taichung 413305, Taiwan;
- Correspondence: or
| |
Collapse
|