1
|
Feng J, Wang Z, Zhanghu M, Zhang X, Shen Y, Yang J, Li Z, Chen B, Wang T, Chen X, Liu Z. Monolithic integrated optoelectronic chip for vector force detection. MICROSYSTEMS & NANOENGINEERING 2024; 10:85. [PMID: 38915831 PMCID: PMC11194277 DOI: 10.1038/s41378-024-00712-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Revised: 03/26/2024] [Accepted: 05/04/2024] [Indexed: 06/26/2024]
Abstract
Sensors with a small footprint and real-time detection capabilities are crucial in robotic surgery and smart wearable equipment. Reducing device footprint while maintaining its high performance is a major challenge and a significant limitation to their development. Here, we proposed a monolithic integrated micro-scale sensor, which can be used for vector force detection. This sensor combines an optical source, four photodetectors, and a hemispherical silicone elastomer component on the same sapphire-based AlGaInP wafer. The chip-scale optical coupling is achieved by employing the laser lift-off techniques and the flip-chip bonding to a processed sapphire substrate. This hemispherical structure device can detect normal and shear forces as low as 1 mN within a measurement range of 0-220 mN for normal force and 0-15 mN for shear force. After packaging, the sensor is capable of detecting forces over a broader range, with measurement capabilities extending up to 10 N for normal forces and 0.2 N for shear forces. It has an accuracy of detecting a minimum normal force of 25 mN and a minimum shear force of 20 mN. Furthermore, this sensor has been validated to have a compact footprint of approximately 1.5 mm2, while maintaining high real-time response. We also demonstrate its promising potential by combining this sensor with fine surface texture perception in the fields of compact medical robot interaction and wearable devices.
Collapse
Affiliation(s)
- Jiansong Feng
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Zhongqi Wang
- Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China
| | - Mengyuan Zhanghu
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Xu Zhang
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Yong Shen
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Jing Yang
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Zhibin Li
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Bin Chen
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Taihong Wang
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Xiaolong Chen
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| | - Zhaojun Liu
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, 518055 China
| |
Collapse
|
2
|
Wei Z, Zhang ZQ, Xie SQ. Continuous Motion Intention Prediction Using sEMG for Upper-Limb Rehabilitation: A Systematic Review of Model-Based and Model-Free Approaches. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1487-1504. [PMID: 38557618 DOI: 10.1109/tnsre.2024.3383857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Upper limb functional impairments persisting after stroke significantly affect patients' quality of life. Precise adjustment of robotic assistance levels based on patients' motion intentions using sEMG signals is crucial for active rehabilitation. This paper systematically reviews studies on continuous prediction of upper limb single joints and multi-joint combinations motion intention using Model-Based (MB) and Model-Free (MF) approaches over the past decade, based on 186 relevant studies screened from six major electronic databases. The findings indicate ongoing challenges in terms of subject composition, algorithm robustness and generalization, and algorithm feasibility for practical applications. Moreover, it suggests integrating the strengths of both MB and MF approaches to improve existing algorithms. Therefore, future research should further explore personalized MB-MF combination methods incorporating deep learning, attention mechanisms, muscle synergy features, motor unit features, and closed-loop feedback to achieve precise, real-time, and long-duration prediction of multi-joint complex movements, while further refining the transfer learning strategy for rapid algorithm deployment across days and subjects. Overall, this review summarizes the current research status, significant findings, and challenges, aiming to inspire future research on predicting upper limb motion intentions based on sEMG.
Collapse
|
3
|
Gao X, Zhang P, Peng X, Zhao J, Liu K, Miao M, Zhao P, Luo D, Li Y. Autonomous motion and control of lower limb exoskeleton rehabilitation robot. Front Bioeng Biotechnol 2023; 11:1223831. [PMID: 37520296 PMCID: PMC10375019 DOI: 10.3389/fbioe.2023.1223831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Accepted: 07/04/2023] [Indexed: 08/01/2023] Open
Abstract
Introduction: The lower limb exoskeleton rehabilitation robot should perform gait planning based on the patient's motor intention and training status and provide multimodal and robust control schemes in the control strategy to enhance patient participation. Methods: This paper proposes an adaptive particle swarm optimization admittance control algorithm (APSOAC), which adaptively optimizes the weights and learning factors of the PSO algorithm to avoid the problem of particle swarm falling into local optimal points. The proposed improved adaptive particle swarm algorithm adjusts the stiffness and damping parameters of the admittance control online to reduce the interaction force between the patient and the robot and adaptively plans the patient's desired gait profile. In addition, this study proposes a dual RBF neural network adaptive sliding mode controller (DRNNASMC) to track the gait profile, compensate for frictional forces and external perturbations generated in the human-robot interaction using the RBF network, calculate the required moments for each joint motor based on the lower limb exoskeleton dynamics model, and perform stability analysis based on the Lyapunov theory. Results and discussion: Finally, the efficiency of the APSOAC and DRNNASMC algorithms is demonstrated by active and passive walking experiments with three healthy subjects, respectively.
Collapse
Affiliation(s)
- Xueshan Gao
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Pengfei Zhang
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Xuefeng Peng
- China Shipbuilding Industry Corporation, No.713 Institute, Zhengzhou, Henan, China
| | - Jianbo Zhao
- China Shipbuilding Industry Corporation, No.713 Institute, Zhengzhou, Henan, China
| | - Kaiyuan Liu
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Mingda Miao
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Peng Zhao
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Dingji Luo
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Yige Li
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| |
Collapse
|
4
|
Chen W, Gao Y, Li Y, Yan Y, Ou JY, Ma W, Zhu J. Broadband Solar Metamaterial Absorbers Empowered by Transformer-Based Deep Learning. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2206718. [PMID: 36852630 PMCID: PMC10161039 DOI: 10.1002/advs.202206718] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 02/03/2023] [Indexed: 05/06/2023]
Abstract
The research of metamaterial shows great potential in the field of solar energy harvesting. In the past decade, the design of broadband solar metamaterial absorber (SMA) has attracted a surge of interest. The conventional design typically requires brute-force optimizations with a huge sampling space of structure parameters. Very recently, deep learning (DL) has provided a promising way in metamaterial design, but its application on SMA development is barely reported due to the complicated features of broadband spectrum. Here, this work develops the DL model based on metamaterial spectrum transformer (MST) for the powerful design of high-performance SMAs. The MST divides the optical spectrum of metamaterial into N patches, which overcomes the severe problem of overfitting in traditional DL and boosts the learning capability significantly. A flexible design tool based on free customer definition is developed to facilitate the real-time on-demand design of metamaterials with various optical functions. The scheme is applied to the design and fabrication of SMAs with graded-refractive-index nanostructures. They demonstrate the high average absorptance of 94% in a broad solar spectrum and exhibit exceptional advantages over many state-of-the-art counterparts. The outdoor testing implies the high-efficiency energy collection of about 1061 kW h m-2 from solar radiation annually. This work paves a way for the rapid smart design of SMA, and will also provide a real-time developing tool for many other metamaterials and metadevices.
Collapse
Affiliation(s)
- Wei Chen
- Institute of Electromagnetics and Acoustics and Key Laboratory of Electromagnetic Wave Science and Detection Technology, Xiamen University, Xiamen, Fujian, 361005, P. R. China
- Shenzhen Research Institute of Xiamen University, Shenzhen, Guangdong, 518057, China
| | - Yuan Gao
- Institute of Electromagnetics and Acoustics and Key Laboratory of Electromagnetic Wave Science and Detection Technology, Xiamen University, Xiamen, Fujian, 361005, P. R. China
| | - Yuyang Li
- Institute of Electromagnetics and Acoustics and Key Laboratory of Electromagnetic Wave Science and Detection Technology, Xiamen University, Xiamen, Fujian, 361005, P. R. China
| | - Yiming Yan
- Institute of Electromagnetics and Acoustics and Key Laboratory of Electromagnetic Wave Science and Detection Technology, Xiamen University, Xiamen, Fujian, 361005, P. R. China
| | - Jun-Yu Ou
- Optoelectronics Research Centre and Centre for Photonic Metamaterials, University of Southampton, Highfield, Southampton, UK, SO17 1BJ
| | - Wenzhuang Ma
- State Key Laboratory of Electronic Thin Films and Integrated Devices, National Engineering Research Center of Electromagnetic Radiation Control Materials, Key Laboratory of Multi-spectral Absorbing Materials and Structures of Ministry of Education, University of Electronic Science and Technology of China, Chengdu, Sichuan, 610054, P. R. China
| | - Jinfeng Zhu
- Institute of Electromagnetics and Acoustics and Key Laboratory of Electromagnetic Wave Science and Detection Technology, Xiamen University, Xiamen, Fujian, 361005, P. R. China
- Shenzhen Research Institute of Xiamen University, Shenzhen, Guangdong, 518057, China
| |
Collapse
|
5
|
Application of Multi-Dimensional Intelligent Visual Quantitative Assessment System to Evaluate Hand Function Rehabilitation in Stroke Patients. Brain Sci 2022; 12:brainsci12121698. [PMID: 36552157 PMCID: PMC9775443 DOI: 10.3390/brainsci12121698] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 12/02/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022] Open
Abstract
Background: Hand dysfunction is one of the main symptoms of stroke patients, but there is still a lack of accurate hand function assessment systems. This study focused on the application of the multi-dimensional intelligent visual quantitative assessment system (MDIVQAS) in the rehabilitation assessment of hand function in stroke patients and evaluate hand function rehabilitation in stroke patients. Methods: Eighty-two patients with stroke and unilateral hand dysfunction were evaluated by MDIVQAS. Cronbach’s Alpha coefficient was used to assess the internal consistency of MDIVQAS; the F-test is used to assess the differences in MDIVQAS for multiple repeated measures. Spearman’s analysis was used to identify correlations of MDIVQAS with other assessment systems. t-tests were used to identify differences in outcomes assessed with MDIVQAS in patients before and after treatment. p < 0.05 were considered significant. Results: (1) Cronbach’s Alpha coefficient of MDIVQAS in evaluating hand’s function > 0.9. (2) There was no significant difference between the other repeated measurements, except for thumb rotation in MDIVQAS. (3) MDIVQAS had a significant correlation with other assessment systems (r > 0.5, p < 0.01). (4) There were significant differences in the evaluation of hand function in patients before and after treatment using MDIVQAS. Conclusion: The MDIVQAS system has good reliability and validity in the evaluation of stroke hand function, and it can also better evaluate the treatment effect.
Collapse
|
6
|
Fu J, Choudhury R, Hosseini SM, Simpson R, Park JH. Myoelectric Control Systems for Upper Limb Wearable Robotic Exoskeletons and Exosuits-A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:8134. [PMID: 36365832 PMCID: PMC9655258 DOI: 10.3390/s22218134] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 10/13/2022] [Accepted: 10/21/2022] [Indexed: 06/16/2023]
Abstract
In recent years, myoelectric control systems have emerged for upper limb wearable robotic exoskeletons to provide movement assistance and/or to restore motor functions in people with motor disabilities and to augment human performance in able-bodied individuals. In myoelectric control, electromyographic (EMG) signals from muscles are utilized to implement control strategies in exoskeletons and exosuits, improving adaptability and human-robot interactions during various motion tasks. This paper reviews the state-of-the-art myoelectric control systems designed for upper-limb wearable robotic exoskeletons and exosuits, and highlights the key focus areas for future research directions. Here, different modalities of existing myoelectric control systems were described in detail, and their advantages and disadvantages were summarized. Furthermore, key design aspects (i.e., supported degrees of freedom, portability, and intended application scenario) and the type of experiments conducted to validate the efficacy of the proposed myoelectric controllers were also discussed. Finally, the challenges and limitations of current myoelectric control systems were analyzed, and future research directions were suggested.
Collapse
Affiliation(s)
- Jirui Fu
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Renoa Choudhury
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Saba M. Hosseini
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Rylan Simpson
- Department of Electrical and Computer Engineering, University of Central Florida, Orlando, FL 32816, USA
| | - Joon-Hyuk Park
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL 32816, USA
| |
Collapse
|
7
|
Xu B, Zhang K, Yang X, Liu D, Hu C, Li H, Song A. Natural grasping movement recognition and force estimation using electromyography. Front Neurosci 2022; 16:1020086. [DOI: 10.3389/fnins.2022.1020086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 10/06/2022] [Indexed: 11/13/2022] Open
Abstract
Electromyography (EMG) generated by human hand movements is usually used to decode different action types with high accuracy. However, the classifications of the gestures rarely consider the impact of force, and the estimation of the grasp force when performing natural grasping movements is so far overlooked. Decoding natural grasping movements and estimating the force generated by the associated movements can help patients to improve the accuracy of prosthesis control. This study mainly focused on two aspects: the classification of four natural grasping movements and the force estimation of these actions. For this purpose, we designed an experimental platform where subjects could perform four common natural grasping movements in daily life, including pinch, palmar, twist, and plug grasp, to complete target profiles. On the one hand, the results showed that, for natural grasping movements with different levels of force (three levels at 20, 50, and 80%), the average accuracy could reach from 91.43 to 97.33% under five classification schemes. On the other hand, the feasibility of force estimation for natural grasping movements was demonstrated. Furthermore, in the process of force estimation, we confirmed that the regression performance about plug grasp was the best, and the average R2 could reach 0.9082. Besides, we found that the regression results were affected by the speed of force application. These findings contribute to the natural control of myoelectric prosthesis and the EMG-based rehabilitation training system, improving the user’s experience and acceptance.
Collapse
|
8
|
Clinically oriented ankle rehabilitation robot with a novel mechanism. ROBOTICA 2022. [DOI: 10.1017/s026357472200128x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Abstract
In order to make the designed ankle robotic system simpler, practical, and clinically oriented, we developed a novel
$\underline{R}-2\underline{U}PS/RR$
ankle rehabilitation robot with a variety of training functions covering all the required ranges of motion of the ankle joint complex (AJC), where
$U$
,
$P$
,
$S$
, and
$R$
denote universal, prismatic, spherical, and revolute joints, respectively, and the underlined letter denotes the actuated joint. The robot was designed with three degrees of freedom (DOFs), with a series
$R$
mechanism and a
$2\underline{U}PS/RR$
parallel mechanism. The main advantage is that the height of the robot is very low, which is convenient for clinical use by patients. At first, the mechanism design and inverse solution of positions were introduced in detail. Then, the patient-passive exercise based on the predefined trajectory tracking and patient-active exercise based on the spring model were developed to satisfy different rehabilitation stages. Finally, experiments with healthy subjects were conducted to verify the effectiveness of the developed patient-passive and patient-active exercises of the developed ankle rehabilitation robot, with results compared with the existing ankle robotic system showing good trajectory tracking performance and interactive performance.
Collapse
|
9
|
Ramírez-Vera VI, Mendoza-Gutiérrez MO, Bonilla-Gutiérrez I. Impedance Control with Bounded Actions for Human–Robot Interaction. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2022. [DOI: 10.1007/s13369-022-06638-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|