1
|
Luo J, Zhou X, Zeng C, Jiang Y, Qi W, Xiang K, Pang M, Tang B. Robotics Perception and Control: Key Technologies and Applications. MICROMACHINES 2024; 15:531. [PMID: 38675342 PMCID: PMC11052398 DOI: 10.3390/mi15040531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 04/10/2024] [Accepted: 04/11/2024] [Indexed: 04/28/2024]
Abstract
The integration of advanced sensor technologies has significantly propelled the dynamic development of robotics, thus inaugurating a new era in automation and artificial intelligence. Given the rapid advancements in robotics technology, its core area-robot control technology-has attracted increasing attention. Notably, sensors and sensor fusion technologies, which are considered essential for enhancing robot control technologies, have been widely and successfully applied in the field of robotics. Therefore, the integration of sensors and sensor fusion techniques with robot control technologies, which enables adaptation to various tasks in new situations, is emerging as a promising approach. This review seeks to delineate how sensors and sensor fusion technologies are combined with robot control technologies. It presents nine types of sensors used in robot control, discusses representative control methods, and summarizes their applications across various domains. Finally, this survey discusses existing challenges and potential future directions.
Collapse
Affiliation(s)
- Jing Luo
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
- Chongqing Research Institute, Wuhan University of Technology, Chongqing 401135, China
| | - Xiangyu Zhou
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
| | - Chao Zeng
- Department of Informatics, University of Hamburg, 22527 Hamburg, Germany;
| | - Yiming Jiang
- School of Robotics, Hunan University, Changsha 410082, China;
| | - Wen Qi
- School of Future Technology, South China University of Technology, Guangzhou 510641, China;
| | - Kui Xiang
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
| | - Muye Pang
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
| | - Biwei Tang
- School of Automation, Wuhan University of Technology, Wuhan 430070, China; (J.L.); (X.Z.); (K.X.)
| |
Collapse
|
2
|
Adamczyk PG, Harper SE, Reiter AJ, Roembke RA, Wang Y, Nichols KM, Thelen DG. Wearable sensing for understanding and influencing human movement in ecological contexts. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2023; 28:100492. [PMID: 37663049 PMCID: PMC10469849 DOI: 10.1016/j.cobme.2023.100492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Wearable sensors offer a unique opportunity to study movement in ecological contexts - that is, outside the laboratory where movement happens in ordinary life. This article discusses the purpose, means, and impact of using wearable sensors to assess movement context, kinematics, and kinetics during locomotion, and how this information can be used to better understand and influence movement. We outline the types of information wearable sensors can gather and highlight recent developments in sensor technology, data analysis, and applications. We close with a vision for important future research and key questions the field will need to address to bring the potential benefits of wearable sensing to fruition.
Collapse
Affiliation(s)
- Peter Gabriel Adamczyk
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Sara E Harper
- University of Wisconsin – Madison, Department of Biomedical Engineering, 1550 Engineering Dr., Madison, Wisconsin, USA
| | - Alex J Reiter
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Rebecca A Roembke
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Yisen Wang
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Kieran M Nichols
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
| | - Darryl G. Thelen
- University of Wisconsin – Madison, Department of Mechanical Engineering, 1513 University Ave., Madison, Wisconsin, USA
- University of Wisconsin – Madison, Department of Biomedical Engineering, 1550 Engineering Dr., Madison, Wisconsin, USA
| |
Collapse
|
3
|
Zou R, Liu Y, Li Y, Chu G, Zhao J, Cai H. A Novel Human Intention Prediction Approach Based on Fuzzy Rules through Wearable Sensing in Human-Robot Handover. Biomimetics (Basel) 2023; 8:358. [PMID: 37622963 PMCID: PMC10452752 DOI: 10.3390/biomimetics8040358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 07/25/2023] [Accepted: 08/08/2023] [Indexed: 08/26/2023] Open
Abstract
With the use of collaborative robots in intelligent manufacturing, human-robot interaction has become more important in human-robot collaborations. Human-robot handover has a huge impact on human-robot interaction. For current research on human-robot handover, special attention is paid to robot path planning and motion control during the handover process; seldom is research focused on human handover intentions. However, enabling robots to predict human handover intentions is important for improving the efficiency of object handover. To enable robots to predict human handover intentions, a novel human handover intention prediction approach was proposed in this study. In the proposed approach, a wearable data glove and fuzzy rules are firstly used to achieve faster and accurate human handover intention sensing (HIS) and human handover intention prediction (HIP). This approach mainly includes human handover intention sensing (HIS) and human handover intention prediction (HIP). For human HIS, we employ wearable data gloves to sense human handover intention information. Compared with vision-based and physical contact-based sensing, wearable data glove-based sensing cannot be affected by visual occlusion and does not pose threats to human safety. For human HIP, we propose a fast handover intention prediction method based on fuzzy rules. Using this method, the robot can efficiently predict human handover intentions based on the sensing data obtained by the data glove. The experimental results demonstrate the advantages and efficacy of the proposed method in human intention prediction during human-robot handover.
Collapse
Affiliation(s)
- Rui Zou
- State Key Laboratory of Robotics and Systems, Harbin 150001, China; (R.Z.); (G.C.); (J.Z.); (H.C.)
| | - Yubin Liu
- State Key Laboratory of Robotics and Systems, Harbin 150001, China; (R.Z.); (G.C.); (J.Z.); (H.C.)
| | - Ying Li
- School of Management, Harbin University of Commerce, Harbin 150080, China
| | - Guoqing Chu
- State Key Laboratory of Robotics and Systems, Harbin 150001, China; (R.Z.); (G.C.); (J.Z.); (H.C.)
| | - Jie Zhao
- State Key Laboratory of Robotics and Systems, Harbin 150001, China; (R.Z.); (G.C.); (J.Z.); (H.C.)
| | - Hegao Cai
- State Key Laboratory of Robotics and Systems, Harbin 150001, China; (R.Z.); (G.C.); (J.Z.); (H.C.)
| |
Collapse
|
4
|
Neural-learning-enhanced Cartesian Admittance control of robot with moving RCM constraints. ROBOTICA 2022. [DOI: 10.1017/s0263574722001679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Abstract
In this manuscript, a scheme for neural-learning-enhanced Cartesian Admittance control is presented for a robotic manipulator to deal with dynamic environments with moving remote center of motion (RCM) constraints. Although some research has been implemented to address fixed constrained motion, the dynamic moving movement constraint is still challenging. Indeed, the moving active RCM constraints generate uncertain disturbance on the robot tool shaft with unknown dynamics. The neural-learning-enhanced decoupled controller with disturbance optimisation is employed and implemented to maintain the performance under the kinematic uncertain and dynamic uncertain generated. In addition, the admittance Cartesian control method is introduced to control the robot, providing compliant behaviour to an external force in its operational space. In this proposed framework, a neural-learning-enhanced disturbance observer is investigated to calculate the external factor operating on the end effector premised on generalised momentum in order to ensure accuracy. Finally, the experiments are implemented using a redundant robot to validate the efficacy of the suggested approach with moving RCM constraints.
Collapse
|
5
|
Semprini M, Lencioni T, Hinterlang W, Vassallo C, Scarpetta S, Maludrottu S, Iandolo R, Carè M, Laffranchi M, Chiappalone M, Ferrarin M, De Michieli L, Jonsdottir J. User-centered design and development of TWIN-Acta: A novel control suite of the TWIN lower limb exoskeleton for the rehabilitation of persons post-stroke. Front Neurosci 2022; 16:915707. [PMID: 36507352 PMCID: PMC9729698 DOI: 10.3389/fnins.2022.915707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 11/07/2022] [Indexed: 11/25/2022] Open
Abstract
Introduction Difficulties faced while walking are common symptoms after stroke, significantly reducing the quality of life. Walking recovery is therefore one of the main priorities of rehabilitation. Wearable powered exoskeletons have been developed to provide lower limb assistance and enable training for persons with gait impairments by using typical physiological movement patterns. Exoskeletons were originally designed for individuals without any walking capacities, such as subjects with complete spinal cord injuries. Recent systematic reviews suggested that lower limb exoskeletons could be valid tools to restore independent walking in subjects with residual motor function, such as persons post-stroke. To ensure that devices meet end-user needs, it is important to understand and incorporate their perspectives. However, only a limited number of studies have followed such an approach in the post-stroke population. Methods The aim of the study was to identify the end-users needs and to develop a user-centered-based control system for the TWIN lower limb exoskeleton to provide post-stroke rehabilitation. We thus describe the development and validation, by clinical experts, of TWIN-Acta: a novel control suite for TWIN, specifically designed for persons post-stroke. We detailed the conceived control strategy and developmental phases, and reported evaluation sessions performed on healthy clinical experts and people post-stroke to evaluate TWIN-Acta usability, acceptability, and barriers to usage. At each developmental stage, the clinical experts received a one-day training on the TWIN exoskeleton equipped with the TWIN-Acta control suite. Data on usability, acceptability, and limitations to system usage were collected through questionnaires and semi-structured interviews. Results The system received overall good usability and acceptability ratings and resulted in a well-conceived and safe approach. All experts gave excellent ratings regarding the possibility of modulating the assistance provided by the exoskeleton during the movement execution and concluded that the TWIN-Acta would be useful in gait rehabilitation for persons post-stroke. The main limit was the low level of system learnability, attributable to the short-time of usage. This issue can be minimized with prolonged training and must be taken into consideration when planning rehabilitation. Discussion This study showed the potential of the novel control suite TWIN-Acta for gait rehabilitation and efficacy studies are the next step in its evaluation process.
Collapse
Affiliation(s)
- Marianna Semprini
- Rehab Technologies Lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Tiziana Lencioni
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering (DIBRIS), Universitá degli Studi di Genova, Genoa, Italy
| | - Wiebke Hinterlang
- Rehab Technologies Lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | | | - Silvia Scarpetta
- Rehab Technologies Lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | | | - Riccardo Iandolo
- Rehab Technologies Lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Marta Carè
- Rehab Technologies Lab, Istituto Italiano di Tecnologia, Genoa, Italy,Department of Informatics, Bioengineering, Robotics, and Systems Engineering (DIBRIS), Universitá degli Studi di Genova, Genoa, Italy
| | - Matteo Laffranchi
- Rehab Technologies Lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | | | - Maurizio Ferrarin
- IRCCS Fondazione Don Carlo Gnocchi, Milan, Italy,*Correspondence: Maurizio Ferrarin,
| | | | | |
Collapse
|
6
|
Chen X, Chen C, Wang Y, Yang B, Ma T, Leng Y, Fu C. A Piecewise Monotonic Gait Phase Estimation Model for Controlling a Powered Transfemoral Prosthesis in Various Locomotion Modes. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3191945] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Affiliation(s)
- Xinxing Chen
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Chuheng Chen
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Yuxuan Wang
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Bowen Yang
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Teng Ma
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Yuquan Leng
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| | - Chenglong Fu
- Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
| |
Collapse
|
7
|
A reinforcement learning fuzzy system for continuous control in robotic odor plume tracking. ROBOTICA 2022. [DOI: 10.1017/s0263574722001321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Abstract
In dynamic outdoor environments characterized by turbulent airflow and intermittent odor plumes, robotic odor plume tracking remains challenging, because existing algorithms heavily rely on manually tuning or learning from expert experience, which are hard to implement in an unknown environment. In this paper, a multi-continuous-output Takagi–Sugeno–Kang fuzzy system was designed and tuned with reinforcement learning to solve the robotic odor source localization problem in dynamic odor plumes. Based on the Lévy Taxis plume tracking controller, the proposed fuzzy system determined the parameters of the controller based on the robot’s observation and guided the robot to turn and move towards the odor source at each searching step. The trained fuzzy system was tested in simulated filament-based odor plumes dispersed by a changing wind field. The results showed that the performance of the proposed fuzzy system-based controller trained with reinforcement learning can achieve a similar success rate and higher efficiency compared with a manually tuned and well-designed fuzzy system-based controller. The fuzzy system-based plume tracking controller was also validated through real robotic experiments.
Collapse
|
8
|
Chen X, Leng Y, Fu C. A Supervised-Reinforced Successive Training Framework for a Fuzzy Inference System and Its Application in Robotic Odor Source Searching. Front Neurorobot 2022; 16:914706. [PMID: 35711281 PMCID: PMC9194852 DOI: 10.3389/fnbot.2022.914706] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 04/27/2022] [Indexed: 11/13/2022] Open
Abstract
Fuzzy inference systems have been widely applied in robotic control. Previous studies proposed various methods to tune the fuzzy rules and the parameters of the membership functions (MFs). Training the systems with only supervised learning requires a large amount of input-output data, and the performance of the trained system is confined by that of the target system. Training the systems with only reinforcement learning (RL) does not require prior knowledge but is time-consuming, and the initialization of the system remains a problem. In this paper, a supervised-reinforced successive training framework is proposed for a multi-continuous-output fuzzy inference system (MCOFIS). The parameters of the fuzzy inference system are first tuned by a limited number of input-output data from an existing controller with supervised training and then are utilized to initialize the system in the reinforcement training stage. The proposed framework is applied in a robotic odor source searching task and the evaluation results demonstrate that the performance of the fuzzy inference system trained by the successive framework is superior to the systems trained by only supervised learning or RL. The system trained by the proposed framework can achieve around a 10% higher success rate compared to the systems trained by only supervised learning or RL.
Collapse
Affiliation(s)
- Xinxing Chen
- Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
- Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen, China
| | - Yuquan Leng
- Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
- Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen, China
| | - Chenglong Fu
- Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Shenzhen, China
- Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology, Shenzhen, China
- *Correspondence: Chenglong Fu
| |
Collapse
|