1
|
Mielke E, Townsend E, Wingate D, Salmon JL, Killpack MD. Human-robot planar co-manipulation of extended objects: data-driven models and control from human-human dyads. Front Neurorobot 2024; 18:1291694. [PMID: 38410142 PMCID: PMC10894988 DOI: 10.3389/fnbot.2024.1291694] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Accepted: 01/12/2024] [Indexed: 02/28/2024] Open
Abstract
Human teams are able to easily perform collaborative manipulation tasks. However, simultaneously manipulating a large extended object for a robot and human is a difficult task due to the inherent ambiguity in the desired motion. Our approach in this paper is to leverage data from human-human dyad experiments to determine motion intent for a physical human-robot co-manipulation task. We do this by showing that the human-human dyad data exhibits distinct torque triggers for a lateral movement. As an alternative intent estimation method, we also develop a deep neural network based on motion data from human-human trials to predict future trajectories based on past object motion. We then show how force and motion data can be used to determine robot control in a human-robot dyad. Finally, we compare human-human dyad performance to the performance of two controllers that we developed for human-robot co-manipulation. We evaluate these controllers in three-degree-of-freedom planar motion where determining if the task involves rotation or translation is ambiguous.
Collapse
Affiliation(s)
- Erich Mielke
- Robotics and Dynamics Laboratory, Brigham Young University, Mechanical Engineering, Provo, UT, United States
| | - Eric Townsend
- Robotics and Dynamics Laboratory, Brigham Young University, Mechanical Engineering, Provo, UT, United States
| | - David Wingate
- Robotics and Dynamics Laboratory, Brigham Young University, Mechanical Engineering, Provo, UT, United States
| | - John L Salmon
- Robotics and Dynamics Laboratory, Brigham Young University, Mechanical Engineering, Provo, UT, United States
| | - Marc D Killpack
- Robotics and Dynamics Laboratory, Brigham Young University, Mechanical Engineering, Provo, UT, United States
| |
Collapse
|
2
|
Chen Z, Guo Q, Li T, Yan Y, Jiang D. Gait Prediction and Variable Admittance Control for Lower Limb Exoskeleton With Measurement Delay and Extended-State-Observer. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:8693-8706. [PMID: 35302939 DOI: 10.1109/tnnls.2022.3152255] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The measurement delay of the feedback control system is a universal problem in industrial engineering, which will degrade output performance, especially causing undesirable chatter responses. In this study, a deep-Gaussian-process (DGP)-based method for operator's gait prediction is proposed to estimate the real-time motion intention and to compensate for the measurement delay of the inertial measurement unit (IMU). On the basis of these gait prediction uncertainties quantified by the DGP method, a variable admittance controller is designed to reduce real-time human-exoskeleton interaction torque. The reference trajectory is generated by the admittance controller, which is smoothed by the two-order Bessel interpolation. Meanwhile, the admittance parameters are self-regulated based on the defined uncertainty index of gait prediction. The extend-state observer (ESO) with backstepping iteration is adopted to compensate unmeasured system state, model uncertainties, and unmodeled dynamics of lower limb exoskeleton. The effectiveness of the proposed gait prediction and control scheme is verified by both the comparative simulations and experimental results of the human-exoskeleton cooperative motion.
Collapse
|
3
|
Zeng C, Li S, Chen Z, Yang C, Sun F, Zhang J. Multifingered Robot Hand Compliant Manipulation Based on Vision-Based Demonstration and Adaptive Force Control. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:5452-5463. [PMID: 35767493 DOI: 10.1109/tnnls.2022.3184258] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Multifingered hand dexterous manipulation is quite challenging in the domain of robotics. One remaining issue is how to achieve compliant behaviors. In this work, we propose a human-in-the-loop learning-control approach for acquiring compliant grasping and manipulation skills of a multifinger robot hand. This approach takes the depth image of the human hand as input and generates the desired force commands for the robot. The markerless vision-based teleoperation system is used for the task demonstration, and an end-to-end neural network model (i.e., TeachNet) is trained to map the pose of the human hand to the joint angles of the robot hand in real-time. To endow the robot hand with compliant human-like behaviors, an adaptive force control strategy is designed to predict the desired force control commands based on the pose difference between the robot hand and the human hand during the demonstration. The force controller is derived from a computational model of the biomimetic control strategy in human motor learning, which allows adapting the control variables (impedance and feedforward force) online during the execution of the reference joint angles. The simultaneous adaptation of the impedance and feedforward profiles enables the robot to interact with the environment compliantly. Our approach has been verified in both simulation and real-world task scenarios based on a multifingered robot hand, that is, the Shadow Hand, and has shown more reliable performances than the current widely used position control mode for obtaining compliant grasping and manipulation behaviors.
Collapse
|
4
|
Wolbrecht E, Ketkar V, Perry JC. Impedance Control of a 2-DOF Spherical 5-Bar Exoskeleton for Physical Human-Robot Interaction During Rehabilitation and Assessment. IEEE Int Conf Rehabil Robot 2023; 2023:1-6. [PMID: 37941197 DOI: 10.1109/icorr58425.2023.10304762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
This paper presents a novel impedance controller for THINGER (THumb INdividuating Grasp Exercise Robot), a 2-degree-of-freedom (DOF) spherical 5-bar exoskeleton designed to augment FINGER (Finger INdividuating Grasp Exercise Robot). Many rehabilitation and assessment tasks, for which THINGER is designed, are improved by rendering near-zero impedance during physical human-robot interaction (pHRI). To achieve this goal, the presented impedance controller includes several novel features. First, a reference trajectory is omitted, allowing free movements. Second, force-feedback gains are reduced near actuator limits and a saturation function limits the maximum commanded force; both allow more responsive (higher) force-feedback gains within the workspace and mitigate transient oscillations caused by external disturbances. Finally, manipulability-based directional force-feedback gains help improve rendered impedance isotropy. Validation experiments included free exploration of the workspace, following a prescribed circular thumb motion, and intentional exposure to external disturbances. The experimental results show that the presented impedance controller significantly reduces impedance to subject-initiated motion and accurately renders the desired isotropic low-impedance environment.
Collapse
|
5
|
Abdulazeem N, Hu Y. Human Factors Considerations for Quantifiable Human States in Physical Human-Robot Interaction: A Literature Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:7381. [PMID: 37687837 PMCID: PMC10490212 DOI: 10.3390/s23177381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 08/11/2023] [Accepted: 08/16/2023] [Indexed: 09/10/2023]
Abstract
As the global population rapidly ages with longer life expectancy and declining birth rates, the need for healthcare services and caregivers for older adults is increasing. Current research envisions addressing this shortage by introducing domestic service robots to assist with daily activities. The successful integration of robots as domestic service providers in our lives requires them to possess efficient manipulation capabilities, provide effective physical assistance, and have adaptive control frameworks that enable them to develop social understanding during human-robot interaction. In this context, human factors, especially quantifiable ones, represent a necessary component. The objective of this paper is to conduct an unbiased review encompassing the studies on human factors studied in research involving physical interactions and strong manipulation capabilities. We identified the prevalent human factors in physical human-robot interaction (pHRI), noted the factors typically addressed together, and determined the frequently utilized assessment approaches. Additionally, we gathered and categorized proposed quantification approaches based on the measurable data for each human factor. We also formed a map of the common contexts and applications addressed in pHRI for a comprehensive understanding and easier navigation of the field. We found out that most of the studies in direct pHRI (when there is direct physical contact) focus on social behaviors with belief being the most commonly addressed human factor type. Task collaboration is moderately investigated, while physical assistance is rarely studied. In contrast, indirect pHRI studies (when the physical contact is mediated via a third item) often involve industrial settings, with physical ergonomics being the most frequently investigated human factor. More research is needed on the human factors in direct and indirect physical assistance applications, including studies that combine physical social behaviors with physical assistance tasks. We also found that while the predominant approach in most studies involves the use of questionnaires as the main method of quantification, there is a recent trend that seeks to address the quantification approaches based on measurable data.
Collapse
Affiliation(s)
| | - Yue Hu
- Active & Interactive Robotics Lab, Department of Mechanical and Mechatronics Engineering, University of Waterloo, 200 University Ave. W., Waterloo, ON N2L 3G1, Canada;
| |
Collapse
|
6
|
Tang B, Li R, Luo J, Pang M, Xiang K. A membership-function-based broad learning system for human-robot interaction force estimation under drawing task. Med Biol Eng Comput 2023:10.1007/s11517-023-02821-2. [PMID: 37269470 DOI: 10.1007/s11517-023-02821-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 03/06/2023] [Indexed: 06/05/2023]
Abstract
Estimating interaction force is of great significance in the field of human-robot interaction (HRI) thanks to its guarantee of interaction safety. To this end, this paper proposes a novel estimation method by leveraging broad learning system (BLS) and human surface electromyography (sEMG) signals. Since the previous sEMG may also contain valuable information of human muscle force, it would cause the estimation to be incomplete and abate the estimation accuracy in the case of neglecting the previous sEMG. To remedy this thorn, a new linear membership function is first developed to calculate contributions of sEMG at different sampling times in the proposed method. Subsequently, the contribution values calculated by the membership function are integrated with features of sEMG to be considered as the input layer of BLS. For extensive studies, five different features extracted from sEMG signals and their combination are explored to estimate the interaction force by the proposed method. Lastly, the performance of the proposed method is compared with those of three well-known methods through experimental test regarding the drawing task. The experimental results confirm that combining the time domain (TD) with frequency domain (FD) features of sEMG can enhance the estimation quality. Moreover, the proposed method outperforms its contenders with respect to estimation accuracy.
Collapse
Affiliation(s)
- Biwei Tang
- School of Automation, Wuhan University of Technology, Luoshi Road, Wuhan, 430070, Hubei, China
| | - Ruiqing Li
- School of Automation, Wuhan University of Technology, Luoshi Road, Wuhan, 430070, Hubei, China
| | - Jing Luo
- School of Automation, Wuhan University of Technology, Luoshi Road, Wuhan, 430070, Hubei, China.
| | - Muye Pang
- School of Automation, Wuhan University of Technology, Luoshi Road, Wuhan, 430070, Hubei, China
| | - Kui Xiang
- School of Automation, Wuhan University of Technology, Luoshi Road, Wuhan, 430070, Hubei, China
| |
Collapse
|
7
|
Harandi MRJ. Comments on "Novel adaptive impedance control for exoskeleton robot for rehabilitation using a nonlinear time-delay disturbance observer". ISA TRANSACTIONS 2023; 136:755-757. [PMID: 36481100 DOI: 10.1016/j.isatra.2022.11.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2022] [Revised: 09/12/2022] [Accepted: 11/25/2022] [Indexed: 05/16/2023]
Abstract
In this note, the controllers of Brahmi et al. (2021) are analyzed. It is shown that the stability analysis of both controllers is questionable. A corrected version of controllers by a slight modification of them is also presented.
Collapse
Affiliation(s)
- M Reza J Harandi
- Advanced Robotics and Automated Systems (ARAS), Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran.
| |
Collapse
|
8
|
Zheng G, Lei J, Hu L, Zhang L. Adaptive variable impedance position/force tracking control of fracture reduction robot. Int J Med Robot 2023; 19:e2469. [PMID: 36302164 DOI: 10.1002/rcs.2469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 10/06/2022] [Accepted: 10/11/2022] [Indexed: 11/06/2022]
Abstract
BACKGROUND The operation object of robot-assisted fracture reduction surgery is the musculoskeletal tissue with rigid-compliance coupling characteristics. It is necessary to improve the interactive compliance and safety between the reduction robot and the musculoskeletal tissue. METHOD An adaptive variable impedance position/force tracking control strategy based on friction compensation is proposed. The stiffness of the reduction robot can be adaptively adjusted according to the contact force between the end-effector and the environment. The Stribeck friction force model of the branch chain electric cylinder is derived to improve the motion control performance. RESULTS The fracture reduction experiment is completed. The experimental results show that the adaptive variable impedance position/force control strategy can realize position and force tracking in fracture reduction. CONCLUSION A safety control strategy is proposed and applied to robot-assisted fracture reduction surgery, which improves the coordination and compliance of the human-robot interaction between the reduction robot and the patient.
Collapse
Affiliation(s)
- Gongliang Zheng
- School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, China
| | - Jingtao Lei
- School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, China
| | - Lei Hu
- School of Mechanical Engineering and Automation, Beihang University, Beijing, China
| | - Lihai Zhang
- Department of Orthopedics, Chinese PLA General Hospital, Beijing, China
| |
Collapse
|
9
|
Rhee I, Kang G, Moon SJ, Choi YS, Choi HR. Hybrid impedance and admittance control of robot manipulator with unknown environment. INTEL SERV ROBOT 2022. [DOI: 10.1007/s11370-022-00451-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
|
10
|
Yu X, Li B, He W, Feng Y, Cheng L, Silvestre C. Adaptive-Constrained Impedance Control for Human-Robot Co-Transportation. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:13237-13249. [PMID: 34570713 DOI: 10.1109/tcyb.2021.3107357] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Human-robot co-transportation allows for a human and a robot to perform an object transportation task cooperatively on a shared environment. This range of applications raises a great number of theoretical and practical challenges arising mainly from the unknown human-robot interaction model as well as from the difficulty of accurately model the robot dynamics. In this article, an adaptive impedance controller for human-robot co-transportation is put forward in task space. Vision and force sensing are employed to obtain the human hand position, and to measure the interaction force between the human and the robot. Using the latest developments in nonlinear control theory, we propose a robot end-effector controller to track the motion of the human partner under actuators' input constraints, unknown initial conditions, and unknown robot dynamics. The proposed adaptive impedance control algorithm offers a safe interaction between the human and the robot and achieves a smooth control behavior along the different phases of the co-transportation task. Simulations and experiments are conducted to illustrate the performance of the proposed techniques in a co-transportation task.
Collapse
|
11
|
Lyu J, Maýe A, Görner M, Ruppel P, Engel AK, Zhang J. Coordinating human-robot collaboration by EEG-based human intention prediction and vigilance control. Front Neurorobot 2022; 16:1068274. [DOI: 10.3389/fnbot.2022.1068274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Accepted: 11/08/2022] [Indexed: 12/04/2022] Open
Abstract
In human-robot collaboration scenarios with shared workspaces, a highly desired performance boost is offset by high requirements for human safety, limiting speed and torque of the robot drives to levels which cannot harm the human body. Especially for complex tasks with flexible human behavior, it becomes vital to maintain safe working distances and coordinate tasks efficiently. An established approach in this regard is reactive servo in response to the current human pose. However, such an approach does not exploit expectations of the human's behavior and can therefore fail to react to fast human motions in time. To adapt the robot's behavior as soon as possible, predicting human intention early becomes a factor which is vital but hard to achieve. Here, we employ a recently developed type of brain-computer interface (BCI) which can detect the focus of the human's overt attention as a predictor for impending action. In contrast to other types of BCI, direct projection of stimuli onto the workspace facilitates a seamless integration in workflows. Moreover, we demonstrate how the signal-to-noise ratio of the brain response can be used to adjust the velocity of the robot movements to the vigilance or alertness level of the human. Analyzing this adaptive system with respect to performance and safety margins in a physical robot experiment, we found the proposed method could improve both collaboration efficiency and safety distance.
Collapse
|
12
|
Li H, Nie X, Duan D, Li Y, Zhang J, Zhou M, Magid E. An admittance‐controlled amplified force tracking scheme for collaborative lumbar puncture surgical robot system. Int J Med Robot 2022; 18:e2428. [DOI: 10.1002/rcs.2428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 05/02/2022] [Accepted: 05/24/2022] [Indexed: 11/06/2022]
Affiliation(s)
- Hongbing Li
- Department of Instrument Science and Engineering, and Shanghai Engineering Research Center for Intelligent Diagnosis and Treatment Instrument School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University Shanghai China
| | - Xun Nie
- Department of Instrument Science and Engineering School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University Shanghai China
| | - Ding Duan
- Department of Instrument Science and Engineering School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University Shanghai China
| | - Yuling Li
- Department of Instrument Science and Engineering School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University Shanghai China
| | - Jing Zhang
- Department of Hematology and Oncology Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine Shanghai China
| | - Min Zhou
- Department of Hematology and Oncology Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine Shanghai China
| | - Evgeni Magid
- Institute of Information Technology and Intelligent Systems Kazan Federal University Kazan Russia
- HSE University Moscow Russia
| |
Collapse
|
13
|
Liu W, Duo Y, Liu J, Yuan F, Li L, Li L, Wang G, Chen B, Wang S, Yang H, Liu Y, Mo Y, Wang Y, Fang B, Sun F, Ding X, Zhang C, Wen L. Touchless interactive teaching of soft robots through flexible bimodal sensory interfaces. Nat Commun 2022; 13:5030. [PMID: 36028481 PMCID: PMC9412806 DOI: 10.1038/s41467-022-32702-5] [Citation(s) in RCA: 47] [Impact Index Per Article: 23.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Accepted: 08/12/2022] [Indexed: 11/09/2022] Open
Abstract
In this paper, we propose a multimodal flexible sensory interface for interactively teaching soft robots to perform skilled locomotion using bare human hands. First, we develop a flexible bimodal smart skin (FBSS) based on triboelectric nanogenerator and liquid metal sensing that can perform simultaneous tactile and touchless sensing and distinguish these two modes in real time. With the FBSS, soft robots can react on their own to tactile and touchless stimuli. We then propose a distance control method that enabled humans to teach soft robots movements via bare hand-eye coordination. The results showed that participants can effectively teach a self-reacting soft continuum manipulator complex motions in three-dimensional space through a "shifting sensors and teaching" method within just a few minutes. The soft manipulator can repeat the human-taught motions and replay them at different speeds. Finally, we demonstrate that humans can easily teach the soft manipulator to complete specific tasks such as completing a pen-and-paper maze, taking a throat swab, and crossing a barrier to grasp an object. We envision that this user-friendly, non-programmable teaching method based on flexible multimodal sensory interfaces could broadly expand the domains in which humans interact with and utilize soft robots.
Collapse
Affiliation(s)
- Wenbo Liu
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Youning Duo
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Jiaqi Liu
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Feiyang Yuan
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Lei Li
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Luchen Li
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Gang Wang
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Bohan Chen
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Siqi Wang
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Hui Yang
- Institute of Semiconductors, Guangdong Academy of Sciences, Guangdong, 510075, China
| | - Yuchen Liu
- School of General Engineering, Beihang University, Beijing, 100191, China
| | - Yanru Mo
- School of General Engineering, Beihang University, Beijing, 100191, China
| | - Yun Wang
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Bin Fang
- Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China
| | - Fuchun Sun
- Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China
| | - Xilun Ding
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China
| | - Chi Zhang
- CAS Center for Excellence in Nanoscience, Beijing Key Laboratory of Micro-Nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing, 101400, China.,School of Nanoscience and Technology, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Li Wen
- School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China.
| |
Collapse
|
14
|
Human–Robot Interaction: A Review and Analysis on Variable Admittance Control, Safety, and Perspectives. MACHINES 2022. [DOI: 10.3390/machines10070591] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Human–robot interaction (HRI) is a broad research topic, which is defined as understanding, designing, developing, and evaluating the robotic system to be used with or by humans. This paper presents a survey on the control, safety, and perspectives for HRI systems. The first part of this paper reviews the variable admittance (VA) control for human–robot co-manipulation tasks, where the virtual damping, inertia, or both are adjusted. An overview of the published research for the VA control approaches, their methods, the accomplished collaborative co-manipulation tasks and applications, and the criteria for evaluating them are presented and compared. Then, the performance of various VA controllers is compared and investigated. In the second part, the safety of HRI systems is discussed. The various methods for detection of human–robot collisions (model-based and data-based) are investigated and compared. Furthermore, the criteria, the main aspects, and the requirements for the determination of the collision and their thresholds are discussed. The performance measure and the effectiveness of each method are analyzed and compared. The third and final part of the paper discusses the perspectives, necessity, influences, and expectations of the HRI for future robotic systems.
Collapse
|
15
|
Zhao J, Giammarino A, Lamon E, Gandarias JM, Momi ED, Ajoudani A. A Hybrid Learning and Optimization Framework to Achieve Physically Interactive Tasks With Mobile Manipulators. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3187258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Jianzhuang Zhao
- Human-Robot Interfaces and physical Interaction lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Alberto Giammarino
- Human-Robot Interfaces and physical Interaction lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Edoardo Lamon
- Human-Robot Interfaces and physical Interaction lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Juan M. Gandarias
- Human-Robot Interfaces and physical Interaction lab, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Elena De Momi
- Deptartment of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Arash Ajoudani
- Human-Robot Interfaces and physical Interaction lab, Istituto Italiano di Tecnologia, Genoa, Italy
| |
Collapse
|
16
|
Sharifi M, Zakerimanesh A, Mehr JK, Torabi A, Mushahwar VK, Tavakoli M. Impedance Variation and Learning Strategies in Human-Robot Interaction. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:6462-6475. [PMID: 33449901 DOI: 10.1109/tcyb.2020.3043798] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
In this survey, various concepts and methodologies developed over the past two decades for varying and learning the impedance or admittance of robotic systems that physically interact with humans are explored. For this purpose, the assumptions and mathematical formulations for the online adjustment of impedance models and controllers for physical human-robot interaction (HRI) are categorized and compared. In this systematic review, studies on: 1) variation and 2) learning of appropriate impedance elements are taken into account. These strategies are classified and described in terms of their objectives, points of view (approaches), and signal requirements (including position, HRI force, and electromyography activity). Different methods involving linear/nonlinear analyses (e.g., optimal control design and nonlinear Lyapunov-based stability guarantee) and the Gaussian approximation algorithms (e.g., Gaussian mixture model-based and dynamic movement primitives-based strategies) are reviewed. Current challenges and research trends in physical HRI are finally discussed.
Collapse
|
17
|
Zeng C, Li S, Fang B, Chen Z, Zhang J. Generalization of Robot Force-Relevant Skills Through Adapting Compliant Profiles. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2021.3137907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
18
|
Bai K, Chen W, Lee KM, Que Z, Huang R. Spherical Wrist With Hybrid Motion-Impedance Control for Enhanced Robotic Manipulations. IEEE T ROBOT 2022. [DOI: 10.1109/tro.2021.3099310] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
19
|
Haninger K, Radke M, Vick A, Kruger J. Towards High-Payload Admittance Control for Manual Guidance With Environmental Contact. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3150051] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
20
|
Adaptive Variable Impedance Control with Fuzzy-PI Compound Controller for Robot Trimming System. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2022. [DOI: 10.1007/s13369-022-06755-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
21
|
Deep Deterministic Policy Gradient with Reward Function Based on Fuzzy Logic for Robotic Peg-in-Hole Assembly Tasks. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12063181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Robot automatic assembly of weak stiffness parts is difficult due to potential deformation during assembly. The robot manipulation cannot adapt to the dynamic contact changes during the assembly process. A robot assembly skill learning system is designed by combining the compliance control and deep reinforcement, which could acquire a better robot assembly strategy. In this paper, a robot assembly strategy learning method based on variable impedance control is proposed to solve the robot assembly contact tasks. During the assembly process, the quality evaluation is designed based on fuzzy logic, and the impedance parameters in the assembly process are studied with a deep deterministic policy gradient. Finally, the effectiveness of the method is verified using the KUKA iiwa robot in the weak stiffness peg-in-hole assembly. Experimental results show that the robot obtains the robot assembly strategy with variable compliant in the process of weak stiffness peg-in-hole assembly. Compared with the previous methods, the assembly success rate of the proposed method reaches 100%.
Collapse
|
22
|
Tang R, Yang Q, Song R. Variable Impedance Control Based on Target Position and Tracking Error for Rehabilitation Robots During a Reaching Task. Front Neurorobot 2022; 16:850692. [PMID: 35308312 PMCID: PMC8927629 DOI: 10.3389/fnbot.2022.850692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Accepted: 01/28/2022] [Indexed: 11/13/2022] Open
Abstract
To obtain an anthropomorphic performance in physical human-robot interaction during a reaching task, a variable impedance control (vIC) algorithm with human-like characteristics is proposed in this article. The damping value of the proposed method is varied with the target position as well as through the tracking error. The proposed control algorithm is compared with the impedance control algorithm with constant parameters (IC) and another vIC algorithm, which is only changed with the tracking error (vIC-e). The different control algorithms are validated through the simulation study, and are experimentally implemented on a cable-driven rehabilitation robot. The results show that the proposed vIC can improve the tracking accuracy and trajectory smoothness, and reduce the interaction force at the same time.
Collapse
Affiliation(s)
- Rongrong Tang
- The Key Laboratory of Sensing Technology and Biomedical Instrument of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, China
- The Shenzhen Research Institute, Sun Yat-sen University, Guangzhou, China
| | - Qianqian Yang
- The Key Laboratory of Sensing Technology and Biomedical Instrument of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, China
- The Shenzhen Research Institute, Sun Yat-sen University, Guangzhou, China
- The School of Mechatronic Engineering, Guangdong Polytechnic Normal University, Guangzhou, China
- *Correspondence: Qianqian Yang
| | - Rong Song
- The Key Laboratory of Sensing Technology and Biomedical Instrument of Guangdong Province, School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, China
- The Shenzhen Research Institute, Sun Yat-sen University, Guangzhou, China
- Rong Song
| |
Collapse
|
23
|
A Novel Intrinsic Force Sensing Method for Robot Manipulators During Human–Robot Interaction. IEEE T ROBOT 2021. [DOI: 10.1109/tro.2021.3072736] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
24
|
Iturrate I, Kramberger A, Sloth C. Quick Setup of Force-Controlled Industrial Gluing Tasks Using Learning From Demonstration. Front Robot AI 2021; 8:767878. [PMID: 34805294 PMCID: PMC8602700 DOI: 10.3389/frobt.2021.767878] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Accepted: 10/15/2021] [Indexed: 11/18/2022] Open
Abstract
This paper presents a framework for programming in-contact tasks using learning by demonstration. The framework is demonstrated on an industrial gluing task, showing that a high quality robot behavior can be programmed using a single demonstration. A unified controller structure is proposed for the demonstration and execution of in-contact tasks that eases the transition from admittance controller for demonstration to parallel force/position control for the execution. The proposed controller is adapted according to the geometry of the task constraints, which is estimated online during the demonstration. In addition, the controller gains are adapted to the human behavior during demonstration to improve the quality of the demonstration. The considered gluing task requires the robot to alternate between free motion and in-contact motion; hence, an approach for minimizing contact forces during the switching between the two situations is presented. We evaluate our proposed system in a series of experiments, where we show that we are able to estimate the geometry of a curved surface, that our adaptive controller for demonstration allows users to achieve higher accuracy in a shorter demonstration duration when compared to an off-the-shelf controller for teaching implemented on a collaborative robot, and that our execution controller is able to reduce impact forces and apply a constant process force while adapting to the surface geometry.
Collapse
Affiliation(s)
- Iñigo Iturrate
- SDU Robotics, Maersk McKinney Moller Institute, University of Southern Denmark, Odense, Denmark
| | - Aljaz Kramberger
- SDU Robotics, Maersk McKinney Moller Institute, University of Southern Denmark, Odense, Denmark
| | - Christoffer Sloth
- SDU Robotics, Maersk McKinney Moller Institute, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
25
|
Design and Control of an Inflatable Spherical Robotic Arm for Pick and Place Applications. ACTUATORS 2021. [DOI: 10.3390/act10110299] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
We present an inflatable soft robotic arm made of fabric that leverages state-of-the-art manufacturing techniques, leading to a robust and reliable manipulator. Three bellow-type actuators are used to control two rotational degrees of freedom, as well as the joint stiffness that is coupled to a longitudinal elongation of the movable link used to grasp objects. The design is motivated by a safety analysis based on first principles. It shows that the interaction forces during an unexpected collision are primarily caused by the attached payload mass, but can be reduced by a lightweight design of the robot arm. A control allocation strategy is employed that simplifies the modeling and control of the robot arm and we show that a particular property of the allocation strategy ensures equal usage of the actuators and valves. The modeling and control approach systematically incorporates the effect of changing joint stiffness and the presence of a payload mass. An investigation of the valve flow capacity reveals that a proper timescale separation between the pressure and arm dynamics is only given for sufficient flow capacity. Otherwise, the applied cascaded control approach can introduce oscillatory behavior, degrading the overall control performance. A closed form feed forward strategy is derived that compensates errors induced by the longitudinal elongation of the movable link and allows the realization of different object manipulation applications. In one of the applications, the robot arm hands an object over to a human, emphasizing the safety aspect of the soft robotic system. Thereby, the intrinsic compliance of the robot arm is leveraged to detect the time when the robot should release the object.
Collapse
|
26
|
Impedance matching control between a human arm and a haptic joystick for long-term. ROBOTICA 2021. [DOI: 10.1017/s0263574721001430] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Abstract
An impedance matching control framework between a human and a haptic joystick for long-term teleoperation is proposed in this research. An impedance model of the human arm is established analyzing the characteristics of human perception, decision, and action. The coefficients of the human arm’s impedance have been identified using a least squares method. The human arm’s impedance matching algorithm generates a corresponding motion vector for the human arm, which is determined by the interaction force measured by a force/torque sensor considering the impedance modeling of the human arm. The impedance control has been adopted for the haptic joystick to match the desired impedance to that of the human arm, which is aimed to minimize the energy consumption of the human arm for long-term teleoperation. By minimizing the fatigue of the operator, the remote control accuracy of the teleoperation can be improved. A PD control with gravity compensation algorithm has been adopted to maintain desired trajectory for the joystick by the operator more conveniently. The effectiveness of matching control has been demonstrated by trajectory following experiments for a mobile robot.
Collapse
|
27
|
Bazzi D, Roveda F, Zanchettin AM, Rocco P. A Unified Approach for Virtual Fixtures and Goal-Driven Variable Admittance Control in Manual Guidance Applications. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3093283] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
28
|
Chang P, Luo R, Dorostian M, Padr T. A Shared Control Method for Collaborative Human-Robot Plug Task. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3098323] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
29
|
Abstract
SUMMARYRobots of next-generation physically interact with the world rather than be caged in a controlled area, and they need to make contact with the open-ended environment to perform their task. Compliant robot links offer intrinsic mechanical compliance for addressing the safety issue for physical human–robot interactions (pHRI). However, many important research questions are yet to be answered. For instance, how do system parameters, for example, mechanical compliance, motor torque, impact velocities, and so on, affect the impact force? how to formulate system impact dynamics of compliant robots, and how to size their geometric dimensions to maximize impact force reduction. In this paper, we present a parametric study of compliant link (CL) design for safe pHRI. We first present a theoretical model of the pHRI system that is comprised of robot dynamics, an impact contact model, and dummy head dynamics. After experimentally validating the theoretical model, we then systematically study the effects of CL parameters on the impact force in more detail. Specifically, we explore how the design and actuation parameters affect the impact force of pHRI system. Based on the parametric studies of the CL design, we propose a step-by-step process and a list of concrete guidelines for designing CL with safety constraints in pHRI. We further conduct a simulation case study to validate this design process and design guidelines.
Collapse
|
30
|
Tognon M, Alami R, Siciliano B. Physical Human-Robot Interaction With a Tethered Aerial Vehicle: Application to a Force-Based Human Guiding Problem. IEEE T ROBOT 2021. [DOI: 10.1109/tro.2020.3038700] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
31
|
Arnold J, Lee H. Variable Impedance Control for pHRI: Impact on Stability, Agility, and Human Effort in Controlling a Wearable Ankle Robot. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3062015] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
32
|
Takagi A, Li Y, Burdet E. Flexible Assimilation of Human's Target for Versatile Human-Robot Physical Interaction. IEEE TRANSACTIONS ON HAPTICS 2021; 14:421-431. [PMID: 33226954 DOI: 10.1109/toh.2020.3039725] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Recent studies on the physical interaction between humans have revealed their ability to read the partner's motion plan and use it to improve one's own control. Inspired by these results, we develop an intention assimilation controller (IAC) that enables a contact robot to estimate the human's virtual target from the interaction force, and combine it with its own target to plan motion. While the virtual target depends on the control gains assumed for the human, we show that this does not affect the stability of the human-robot system, and our novel scheme covers a continuum of interaction behaviours from cooperation to competition. Simulations and experiments illustrate how the IAC can assist the human or compete with them to prevent collisions. In this article, we demonstrate the IAC's advantages over related methods, such as faster convergence to a target, guidance with less force, safer obstacle avoidance and a wider range of interaction behaviours.
Collapse
|
33
|
Yu X, He W, Li Y, Xue C, Li J, Zou J, Yang C. Bayesian Estimation of Human Impedance and Motion Intention for Human-Robot Collaboration. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:1822-1834. [PMID: 31647450 DOI: 10.1109/tcyb.2019.2940276] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This article proposes a Bayesian method to acquire the estimation of human impedance and motion intention in a human-robot collaborative task. Combining with the prior knowledge of human stiffness, estimated stiffness obeying Gaussian distribution is obtained by Bayesian estimation, and human motion intention can be also estimated. An adaptive impedance control strategy is employed to track a target impedance model and neural networks are used to compensate for uncertainties in robotic dynamics. Comparative simulation results are carried out to verify the effectiveness of estimation method and emphasize the advantages of the proposed control strategy. The experiment, performed on Baxter robot platform, illustrates a good system performance.
Collapse
|
34
|
Hermus J, Lachner J, Verdi D, Hogan N. Exploiting Redundancy to Facilitate Physical Interaction. IEEE T ROBOT 2021. [DOI: 10.1109/tro.2021.3086632] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
35
|
Abu-Dakka FJ, Saveriano M. Variable Impedance Control and Learning-A Review. Front Robot AI 2020; 7:590681. [PMID: 33501348 PMCID: PMC7805898 DOI: 10.3389/frobt.2020.590681] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2020] [Accepted: 10/22/2020] [Indexed: 11/13/2022] Open
Abstract
Robots that physically interact with their surroundings, in order to accomplish some tasks or assist humans in their activities, require to exploit contact forces in a safe and proficient manner. Impedance control is considered as a prominent approach in robotics to avoid large impact forces while operating in unstructured environments. In such environments, the conditions under which the interaction occurs may significantly vary during the task execution. This demands robots to be endowed with online adaptation capabilities to cope with sudden and unexpected changes in the environment. In this context, variable impedance control arises as a powerful tool to modulate the robot's behavior in response to variations in its surroundings. In this survey, we present the state-of-the-art of approaches devoted to variable impedance control from control and learning perspectives (separately and jointly). Moreover, we propose a new taxonomy for mechanical impedance based on variability, learning, and control. The objective of this survey is to put together the concepts and efforts that have been done so far in this field, and to describe advantages and disadvantages of each approach. The survey concludes with open issues in the field and an envisioned framework that may potentially solve them.
Collapse
Affiliation(s)
- Fares J. Abu-Dakka
- Intelligent Robotics Group, Department of Electrical Engineering and Automation (EEA), Aalto University, Espoo, Finland
| | - Matteo Saveriano
- Intelligent and Interactive Systems, Department of Computer Science and Digital Science Center (DiSC), University of Innsbruck, Innsbruck, Austria
| |
Collapse
|
36
|
Aydin Y, Tokatli O, Patoglu V, Basdogan C. A Computational Multicriteria Optimization Approach to Controller Design for Physical Human-Robot Interaction. IEEE T ROBOT 2020. [DOI: 10.1109/tro.2020.2998606] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
37
|
Jo H, Choi W, Lee G, Park W, Kim J. Analysis of Visuo Motor Control between Dominant Hand and Non-Dominant Hand for Effective Human-Robot Collaboration. SENSORS 2020; 20:s20216368. [PMID: 33171652 PMCID: PMC7664673 DOI: 10.3390/s20216368] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 11/04/2020] [Accepted: 11/05/2020] [Indexed: 11/16/2022]
Abstract
The human-in-the-loop technology requires studies on sensory-motor characteristics of each hand for an effective human-robot collaboration. This study aims to investigate the differences in visuomotor control between the dominant (DH) and non-dominant hands in tracking a target in the three-dimensional space. We compared the circular tracking performances of the hands on the frontal plane of the virtual reality space in terms of radial position error (ΔR), phase error (Δθ), acceleration error (Δa), and dimensionless squared jerk (DSJ) at four different speeds for 30 subjects. ΔR and Δθ significantly differed at relatively high speeds (ΔR: 0.5 Hz; Δθ: 0.5, 0.75 Hz), with maximum values of ≤1% compared to the target trajectory radius. DSJ significantly differed only at low speeds (0.125, 0.25 Hz), whereas Δa significantly differed at all speeds. In summary, the feedback-control mechanism of the DH has a wider range of speed control capability and is efficient according to an energy saving model. The central nervous system (CNS) uses different models for the two hands, which react dissimilarly. Despite the precise control of the DH, both hands exhibited dependences on limb kinematic properties at high speeds (0.75 Hz). Thus, the CNS uses a different strategy according to the model for optimal results.
Collapse
Affiliation(s)
- Hanjin Jo
- Department of Mechanical and Control Engineering, Handong Global University, Pohang 37554, Korea; (H.J.); (G.L.); (W.P.)
| | - Woong Choi
- Department of Information and Computer Engineering, National Institute of Technology, Gunma College, Maebashi 371–8530, Japan
- Correspondence: (W.C.); (J.K.)
| | - Geonhui Lee
- Department of Mechanical and Control Engineering, Handong Global University, Pohang 37554, Korea; (H.J.); (G.L.); (W.P.)
| | - Wookhyun Park
- Department of Mechanical and Control Engineering, Handong Global University, Pohang 37554, Korea; (H.J.); (G.L.); (W.P.)
| | - Jaehyo Kim
- Department of Mechanical and Control Engineering, Handong Global University, Pohang 37554, Korea; (H.J.); (G.L.); (W.P.)
- Correspondence: (W.C.); (J.K.)
| |
Collapse
|
38
|
Marvel JA, Bagchi S, Zimmerman M, Antonishek B. Towards Effective Interface Designs for Collaborative HRI in Manufacturing. ACM TRANSACTIONS ON HUMAN-ROBOT INTERACTION 2020. [DOI: 10.1145/3385009] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
We present a comprehensive framework and test methodology for the evaluation of human-machine interfaces (HMI) and human-robot interactions (HRI) in collaborative manufacturing applications. An overview of the challenges that face current- and next-generation collaborative robot systems is presented, specifically focused on the interactions between man and machine, and a series of objectively quantitative and subjectively qualitative metrics are given to guide the development and assessment of interfaces and interactions. A generalized set of guidelines for the design of HMI is also proposed to address these challenges and thereby enable effective and intuitive diagnostics and error corrections when process failures occur. These guidelines are aimed at aiding researchers in developing effective interface and interaction technologies, maximizing operator situation awareness in human-robot collaborative manufacturing teams, promoting effective process and system diagnostics reporting, and enabling faster responses to equipment or application errors.
Collapse
Affiliation(s)
| | - Shelly Bagchi
- U.S. National Institute of Standards and Technology, USA
| | | | | |
Collapse
|
39
|
Abstract
SUMMARYIn this paper, we propose a novel unified framework for virtual guides. The human–robot interaction is based on a virtual robot, which is controlled by the admittance control. The unified framework combines virtual guides, control of the dynamic behavior, and path tracking. Different virtual guides and active constraints can be realized by using dead-zones in the position part of the admittance controller. The proposed algorithm can act in a changing task space and allows selection of the tasks-space and redundant degrees-of-freedom during the task execution. The admittance control algorithm can be implemented either on a velocity or on acceleration level. The proposed framework has been validated by an experiment on a KUKA LWR robot performing the Buzz-Wire task.
Collapse
|
40
|
Torabi A, Zareinia K, Sutherland GR, Tavakoli M. Dynamic Reconfiguration of Redundant Haptic Interfaces for Rendering Soft and Hard Contacts. IEEE TRANSACTIONS ON HAPTICS 2020; 13:668-678. [PMID: 32324568 DOI: 10.1109/toh.2020.2988495] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
There are conflicting objectives between required characteristics of haptic interfaces such as maximum force feedback capability versus back-drive friction, which can be optimally traded-off in a redundant haptic interface; a redundant haptic interface has more degrees of freedom than minimally required ones for a given task. In this article, a contact-aware null-space control approach for redundant haptic interfaces is proposed to address these trade-offs. First, we introduce a task-dependent null-space controller in which the internal motion of the redundant haptic interface is appropriately controlled to achieve a desired performance; i.e., low back-drive friction in case of free-space motion and soft contact or large force feedback capability in case of stiff contact. Next, a transition method is developed to facilitate the adaptation of the null-space controller's varying objectives according to the varying nature of the task. The transition method prevents discontinuities in the null-space control signal. This transition method is informed by a proposed actuator saturation observer that monitors the distance of joint torques from their saturation levels. The overall outcome is an ability to recreate the feelings of soft contacts and hard contacts with higher fidelity compared to what a conventional non-redundant haptic interface can achieve. Simulations are provided throughout the paper to illustrate the concepts. Moreover, experimental results are reported to verify the effectiveness of the proposed control strategies. It is shown that the proposed controller can perform well in the soft-contact, hard-contact, and transition phases.
Collapse
|
41
|
Li HY, Yang L, Tan UX. A Control Scheme for Smooth Transition in Physical Human-Robot-Environment Between Two Modes: Augmentation and Autonomous. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.3010450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
42
|
An Intuitive Formulation of the Human Arm Active Endpoint Stiffness. SENSORS 2020; 20:s20185357. [PMID: 32962084 PMCID: PMC7570772 DOI: 10.3390/s20185357] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Revised: 08/31/2020] [Accepted: 09/14/2020] [Indexed: 11/16/2022]
Abstract
In this work, we propose an intuitive and real-time model of the human arm active endpoint stiffness. In our model, the symmetric and positive-definite stiffness matrix is constructed through the eigendecomposition Kc=VDVT, where V is an orthonormal matrix whose columns are the normalized eigenvectors of Kc, and D is a diagonal matrix whose entries are the eigenvalues of Kc. In this formulation, we propose to construct V and D directly by exploiting the geometric information from a reduced human arm skeleton structure in 3D and from the assumption that human arm muscles work synergistically when co-contracted. Through the perturbation experiments across multiple subjects under different arm configurations and muscle activation states, we identified the model parameters and examined the modeling accuracy. In comparison to our previous models for predicting human active arm endpoint stiffness, the new model offers significant advantages such as fast identification and personalization due to its principled simplicity. The proposed model is suitable for applications such as teleoperation, human–robot interaction and collaboration, and human ergonomic assessments, where a personalizable and real-time human kinodynamic model is a crucial requirement.
Collapse
|
43
|
Ye L, Xiong G, Zeng C, Zhang H. Trajectory tracking control of 7-DOF redundant robot based on estimation of intention in physical human-robot interaction. Sci Prog 2020; 103:36850420953642. [PMID: 32924809 PMCID: PMC10358565 DOI: 10.1177/0036850420953642] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Collaborative robot has been widespread application prospect, such as homes, manufacturing, and health-care etc. In physical human-robot interaction, the external force appears inevitably in contact with environment or human, especially the interactive tasks such as trajectory tracking requirements and force compliance control. In this article, a method based on interaction intention estimation, which solve the problem of trajectory tracking accuracy and force compliance control in the same direction for the 7-DOF robot, is proposed. The increased virtual force depended on the manipuility performance index and inverse kinematic solution used the kinematic decoupling method based on the redundant angle avoid the singularity of redundant robot. Then, based on interactive intention estimation, a control strategy of variable impedance sliding mode theory in the presence of virtual force and contact force is proposed to achieve the trajectory tracking. We adopted hyperbolic tangent function to alleviate the chattering problem caused by switch function and validated the control system stability by Lyapunov theorem. Finally, Matlab simulations exhibit a 97.8% of high tracking accuracy amid the external force is 43% less than variable impedance parameters. It is therefore proved that the proposed method can achieve asymptotic tracking and the compliant behavior in physical human-robot interaction.
Collapse
Affiliation(s)
- Lan Ye
- School of Mechanical Engineering, Nanchang University, Nanchang, China
- School of mechanical and vehicle engineering, Nanchang Institute of Science and Technology, Nanchang, China
| | - Genliang Xiong
- School of Mechanical Engineering, Nanchang University, Nanchang, China
| | - Cheng Zeng
- School of Mechanical Engineering, Nanchang University, Nanchang, China
| | - Hua Zhang
- School of Mechanical Engineering, Nanchang University, Nanchang, China
- School of Mechatronic Engineering, Shanghai University of Engineering Science, Shanghai, China
| |
Collapse
|
44
|
Memar AH, Esfahani ET. Objective Assessment of Human Workload in Physical Human-robot Cooperation Using Brain Monitoring. ACM TRANSACTIONS ON HUMAN-ROBOT INTERACTION 2020. [DOI: 10.1145/3368854] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
The notions of safe and compliant interaction are not sufficient to ensure effective physical human-robot cooperation. To obtain an optimal compliant behavior (e.g., variable impedance/admittance control), assessment techniques are required to measure the effectiveness of the interaction in terms of perceived workload by users. This study investigates electroencephalography (EEG) monitoring as an objective measure to classify workload in cooperative manipulation with compliance. An experimental study is conducted including two types of manipulation (gross and fine) with two admittance levels (low- and high-damping). Performance and self-reported measures indicate that a proper admittance level that enhances perceived workload is task-dependent. This information is used to form a binary classification problem (low- and high-workload) with spectral power density and coherence as the features extracted from EEG data. Using a subject-independent feature selection approach, a subject-dependent Linear Discriminant Analysis (LDA) is used for classification. An average classification rate of 81% is achieved that indicates the reliability of the proposed approach for assessing human workload in interaction with varying compliance across the gross and fine manipulation. Furthermore, to validate our proposed objective measure of workload, we have conducted a second experiment composed of both fine and gross motor tasks. Compared to interaction with a constant admittance, a lower EEG-based workload is observed with an open-loop variable admittance controller. This observation is in agreement with the subjective workload score (NASA-TLX).
Collapse
|
45
|
Estimating Human Wrist Stiffness during a Tooling Task. SENSORS 2020; 20:s20113260. [PMID: 32521678 PMCID: PMC7308925 DOI: 10.3390/s20113260] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 05/25/2020] [Accepted: 05/27/2020] [Indexed: 11/16/2022]
Abstract
In this work, we propose a practical approach to estimate human joint stiffness during tooling tasks for the purpose of programming a robot by demonstration. More specifically, we estimate the stiffness along the wrist radial-ulnar deviation while a human operator performs flexion-extension movements during a polishing task. The joint stiffness information allows to transfer skills from expert human operators to industrial robots. A typical hand-held, abrasive tool used by humans during finishing tasks was instrumented at the handle (through which both robots and humans are attached to the tool) to assess the 3D force/torque interactions between operator and tool during finishing task, as well as the 3D kinematics of the tool itself. Building upon stochastic methods for human arm impedance estimation, the novelty of our approach is that we rely on the natural variability taking place during the multi-passes task itself to estimate (neuro-)mechanical impedance during motion. Our apparatus (hand-held, finishing tool instrumented with motion capture and multi-axis force/torque sensors) and algorithms (for filtering and impedance estimation) were first tested on an impedance-controlled industrial robot carrying out the finishing task of interest, where the impedance could be pre-programmed. We were able to accurately estimate impedance in this case. The same apparatus and algorithms were then applied to the same task performed by a human operators. The stiffness values of the human operator, at different force level, correlated positively with the muscular activity, measured during the same task.
Collapse
|
46
|
Umemoto K, Endo T, Matsuno F. Dynamic Cooperative Transportation Control Using Friction Forces of n Multi-Rotor Unmanned Aerial Vehicles. J INTELL ROBOT SYST 2020. [DOI: 10.1007/s10846-020-01212-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
47
|
Papageorgiou D, Kastritsi T, Doulgeri Z, Rovithakis GA. A Passive pHRI Controller for Assisting the User in Partially Known Tasks. IEEE T ROBOT 2020. [DOI: 10.1109/tro.2020.2969018] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
48
|
Influence of human operator on stability of haptic rendering: a closed-form equation. INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS 2020. [DOI: 10.1007/s41315-020-00131-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
49
|
An Adaptive Sliding Mode Variable Admittance Control Method for Lower Limb Rehabilitation Exoskeleton Robot. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10072536] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
As passive rehabilitation training with fixed trajectory ignores the active participation of patients, in order to increase the active participation of patients and improve the effect of rehabilitation training, this paper proposes an innovative adaptive sliding mode variable admittance (ASMVA) controller for the Lower Limb Rehabilitation Exoskeleton Robot. The ASMVA controller consists of an outer loop with variable admittance controller and an inner loop with an adaptive sliding mode controller. It estimates the wearer’s active muscle strength and movement intention by judging the deviation between the actual and standard interaction force of the wearer’s leg and the exoskeleton, thereby adaptively changing admittance controller parameters to alter training intensity. Three healthy volunteers engaged in further experimental studies, including trajectory tracking experiments with no admittance, fixed admittance, and variable admittance adjustment. The experimental results show that the proposed ASMVA control scheme has high control accuracy. Besides, the ASMVA can not only increase training intensity according to the active muscle strength of the patient during positive movement intention (so as to increase active participation of the patient), but also increase the amount of trajectory adjustment during negative movement intention to ensure the safety of the patient.
Collapse
|
50
|
de Cos CR, Acosta JA, Ollero A. Adaptive Integral Inverse Kinematics Control for Lightweight Compliant Manipulators. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.2977261] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|