1
|
Zheng X, Han Y, Liang J. Anthropomorphic motion planning for multi-degree-of-freedom arms. Front Bioeng Biotechnol 2024; 12:1388609. [PMID: 38863490 PMCID: PMC11165200 DOI: 10.3389/fbioe.2024.1388609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Accepted: 05/13/2024] [Indexed: 06/13/2024] Open
Abstract
With the development of technology, the humanoid robot is no longer a concept, but a practical partner with the potential to assist people in industry, healthcare and other daily scenarios. The basis for the success of humanoid robots is not only their appearance, but more importantly their anthropomorphic behaviors, which is crucial for the human-robot interaction. Conventionally, robots are designed to follow meticulously calculated and planned trajectories, which typically rely on predefined algorithms and models, resulting in the inadaptability to unknown environments. Especially when faced with the increasing demand for personalized and customized services, predefined motion planning cannot be adapted in time to adapt to personal behavior. To solve this problem, anthropomorphic motion planning has become the focus of recent research with advances in biomechanics, neurophysiology, and exercise physiology which deepened the understanding of the body for generating and controlling movement. However, there is still no consensus on the criteria by which anthropomorphic motion is accurately generated and how to generate anthropomorphic motion. Although there are articles that provide an overview of anthropomorphic motion planning such as sampling-based, optimization-based, mimicry-based, and other methods, these methods differ only in the nature of the planning algorithms and have not yet been systematically discussed in terms of the basis for extracting upper limb motion characteristics. To better address the problem of anthropomorphic motion planning, the key milestones and most recent literature have been collated and summarized, and three crucial topics are proposed to achieve anthropomorphic motion, which are motion redundancy, motion variation, and motion coordination. The three characteristics are interrelated and interdependent, posing the challenge for anthropomorphic motion planning system. To provide some insights for the research on anthropomorphic motion planning, and improve the anthropomorphic motion ability, this article proposes a new taxonomy based on physiology, and a more complete system of anthropomorphic motion planning by providing a detailed overview of the existing methods and their contributions.
Collapse
Affiliation(s)
- Xiongfei Zheng
- State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, China
| | - Yunyun Han
- Department of Neurobiology, School of Basic Medicine, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Jiejunyi Liang
- State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
2
|
Li F, Bai Y, Zhao M, Fu T, Men Y, Song R. Research on Robot Screwing Skill Method Based on Demonstration Learning. SENSORS (BASEL, SWITZERLAND) 2023; 24:21. [PMID: 38202883 PMCID: PMC10780978 DOI: 10.3390/s24010021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 12/08/2023] [Accepted: 12/11/2023] [Indexed: 01/12/2024]
Abstract
A robot screwing skill learning framework based on teaching-learning is proposed to improve the generalization ability of robots for different scenarios and objects, combined with the experience of a human operation. This framework includes task-based teaching, learning, and summarization. We teach a robot to twist and gather the operation's trajectories, define the obstacles with potential functions, and counter the twisting of the robot using a skill-learning-based dynamic movement primitive (DMP) and Gaussian mixture model-Gaussian mixture regression (GMM-GMR). The hole-finding and screwing stages of the process are modeled. In order to verify the effectiveness of the robot tightening skill learning model and its adaptability to different tightening scenarios, obstacle avoidance trends and tightening experiments were conducted. Obstacle avoidance and tightening experiments were conducted on the robot tightening platform for bolts, plastic bottle caps, and faucets. The robot successfully avoided obstacles and completed the twisting task, verifying the effectiveness of the robot tightening skill learning model and its adaptability to different tightening scenarios.
Collapse
Affiliation(s)
- Fengming Li
- The School of Information and Engineering, Shandong Jianzhu University, Jinan 250101, China;
| | - Yunfeng Bai
- The School of Control Science and Engineering, Shandong University, Jinan 250061, China; (Y.B.); (M.Z.); (Y.M.)
| | - Man Zhao
- The School of Control Science and Engineering, Shandong University, Jinan 250061, China; (Y.B.); (M.Z.); (Y.M.)
| | - Tianyu Fu
- The School of Control Science and Engineering, Shandong University, Jinan 250061, China; (Y.B.); (M.Z.); (Y.M.)
| | - Yu Men
- The School of Control Science and Engineering, Shandong University, Jinan 250061, China; (Y.B.); (M.Z.); (Y.M.)
| | - Rui Song
- The School of Control Science and Engineering, Shandong University, Jinan 250061, China; (Y.B.); (M.Z.); (Y.M.)
| |
Collapse
|
3
|
Zhou J, Peng H, Su S, Song R. Spatiotemporal Compliance Control for a Wearable Lower Limb Rehabilitation Robot. IEEE Trans Biomed Eng 2023; 70:1858-1868. [PMID: 37015454 DOI: 10.1109/tbme.2022.3230784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Compliance control is crucial for physical human-robot interaction, which can enhance the safety and comfort of robot-assisted rehabilitation. In this study, we designed a spatiotemporal compliance control strategy for a new self-designed wearable lower limb rehabilitation robot (WLLRR), allowing the users to regulate the spatiotemporal characteristics of their motion. The high-level trajectory planner consists of a trajectory generator, an interaction torque estimator, and a gait speed adaptive regulator, which can provide spatial and temporal compliance for the WLLRR. A radial basis function neural network adaptive controller is adopted as the low-level position controller. Over-ground walking experiments with passive control, spatial compliance control, and spatiotemporal compliance control strategies were conducted on five healthy participants, respectively. The results demonstrated that the spatiotemporal compliance control strategy allows participants to adjust reference trajectory through physical human-robot interaction, and can adaptively modify gait speed according to participants' motor performance. It was found that the spatiotemporal compliance control strategy could provide greater enhancement of motor variability and reduction of interaction torque than other tested control strategies. Therefore, the spatiotemporal compliance control strategy has great potential in robot-assisted rehabilitation training and other fields involving physical human-robot interaction.
Collapse
|
4
|
Ramdya P, Ijspeert AJ. The neuromechanics of animal locomotion: From biology to robotics and back. Sci Robot 2023; 8:eadg0279. [PMID: 37256966 DOI: 10.1126/scirobotics.adg0279] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 05/05/2023] [Indexed: 06/02/2023]
Abstract
Robotics and neuroscience are sister disciplines that both aim to understand how agile, efficient, and robust locomotion can be achieved in autonomous agents. Robotics has already benefitted from neuromechanical principles discovered by investigating animals. These include the use of high-level commands to control low-level central pattern generator-like controllers, which, in turn, are informed by sensory feedback. Reciprocally, neuroscience has benefited from tools and intuitions in robotics to reveal how embodiment, physical interactions with the environment, and sensory feedback help sculpt animal behavior. We illustrate and discuss exemplar studies of this dialog between robotics and neuroscience. We also reveal how the increasing biorealism of simulations and robots is driving these two disciplines together, forging an integrative science of autonomous behavioral control with many exciting future opportunities.
Collapse
Affiliation(s)
- Pavan Ramdya
- Neuroengineering Laboratory, Brain Mind Institute and Institute of Bioengineering, EPFL, Lausanne, Switzerland
| | - Auke Jan Ijspeert
- Biorobotics Laboratory, Institute of Bioengineering, EPFL, Lausanne, Switzerland
| |
Collapse
|
5
|
Xu J, Xu L, Ji A, Cao K. Learning robotic motion with mirror therapy framework for hemiparesis rehabilitation. Inf Process Manag 2023. [DOI: 10.1016/j.ipm.2022.103244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
6
|
Lu Z, Wang N, Li Q, Yang C. A Trajectory and Force Dual-incremental Robot Skill Learning and Generalization Framework using Improved Dynamical Movement Primitives and Adaptive Neural Network Control. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.11.076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
|
7
|
Sutanto G, Rombach K, Chebotar Y, Su Z, Schaal S, Sukhatme GS, Meier F. Supervised learning and reinforcement learning of feedback models for reactive behaviors: Tactile feedback testbed. Int J Rob Res 2022. [DOI: 10.1177/02783649221143399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Robots need to be able to adapt to unexpected changes in the environment such that they can autonomously succeed in their tasks. However, hand-designing feedback models for adaptation is tedious, if at all possible, making data-driven methods a promising alternative. In this paper, we introduce a full framework for learning feedback models for reactive motion planning. Our pipeline starts by segmenting demonstrations of a complete task into motion primitives via a semi-automated segmentation algorithm. Then, given additional demonstrations of successful adaptation behaviors, we learn initial feedback models through learning-from-demonstrations. In the final phase, a sample-efficient reinforcement learning algorithm fine-tunes these feedback models for novel task settings through few real system interactions. We evaluate our approach on a real anthropomorphic robot in learning a tactile feedback task.
Collapse
Affiliation(s)
- Giovanni Sutanto
- Autonomous Motion Department, Max Planck Institute for Intelligent Systems (AMD at MPI-IS), Tübingen, Germany
- Department of Computer Science, University of Southern California (CS at USC), Los Angeles, CA, USA
- Intrinsic Innovation LLC., Mountain View, CA, USA
| | | | | | - Zhe Su
- Dexterity Inc., Redwood City, CA, USA
| | | | - Gaurav S. Sukhatme
- Department of Computer Science, University of Southern California (CS at USC), Los Angeles, CA, USA
| | | |
Collapse
|
8
|
DMPs-based skill learning for redundant dual-arm robotic synchronized cooperative manipulation. COMPLEX INTELL SYST 2022. [DOI: 10.1007/s40747-021-00429-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
AbstractDual-arm robot manipulation is applicable to many domains, such as industrial, medical, and home service scenes. Learning from demonstrations is a highly effective paradigm for robotic learning, where a robot learns from human actions directly and can be used autonomously for new tasks, avoiding the complicated analytical calculation for motion programming. However, the learned skills are not easy to generalize to new cases where special constraints such as varying relative distance limitation of robotic end effectors for human-like cooperative manipulations exist. In this paper, we propose a dynamic movement primitives (DMPs) based skills learning framework for redundant dual-arm robots. The method, with a coupling acceleration term to the DMPs function, is inspired by the transient performance control of Barrier Lyapunov Functions. The additional coupling acceleration term is calculated based on the constant joint distance and varying relative distance limitations of end effectors for object-approaching actions. In addition, we integrate the generated actions in joint space and the solution for a redundant dual-arm robot to complete a human-like manipulation. Simulations undertaken in Matlab and Gazebo environments certify the effectiveness of the proposed method.
Collapse
|
9
|
Davchev T, Luck KS, Burke M, Meier F, Schaal S, Ramamoorthy S. Residual Learning From Demonstration: Adapting DMPs for Contact-Rich Manipulation. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3150024] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
10
|
Cui Z, Ma W, Lai J, Chu HK, Guo Y. Coupled Multiple Dynamic Movement Primitives Generalization for Deformable Object Manipulation. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3156656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
11
|
User intent estimation during robot learning using physical human robot interaction primitives. Auton Robots 2022. [DOI: 10.1007/s10514-021-10030-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
AbstractAs robotic systems transition from traditional setups to collaborative work spaces, the prevalence of physical Human Robot Interaction has risen in both industrial and domestic environments. A popular representation for robot behavior is movement primitives which learn, imitate, and generalize from expert demonstrations. While there are existing works in context-aware movement primitives, they are usually limited to contact-free human robot interactions. This paper presents physical Human Robot Interaction Primitives (pHRIP), which utilize only the interaction forces between the human user and robot to estimate user intent and generate the appropriate robot response during physical human robot interactions. The efficacy of pHRIP is evaluated through multiple experiments based on target-directed reaching and obstacle avoidance tasks using a real seven degree of freedom robot arm. The results are validated against Interaction Primitives which use observations of robotic trajectories, with discussions of future pHRI applications utilizing pHRIP.
Collapse
|
12
|
Guan Y, Wang N, Yang C. Review of the techniques used in motor‐cognitive human‐robot skill transfer. COGNITIVE COMPUTATION AND SYSTEMS 2021. [DOI: 10.1049/ccs2.12025] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Yuan Guan
- Bristol Robotics Laboratory University of the West of England Bristol UK
| | - Ning Wang
- Bristol Robotics Laboratory University of the West of England Bristol UK
| | - Chenguang Yang
- Bristol Robotics Laboratory University of the West of England Bristol UK
| |
Collapse
|
13
|
Sliding mode-based online fault compensation control for modular reconfigurable robots through adaptive dynamic programming. COMPLEX INTELL SYST 2021. [DOI: 10.1007/s40747-021-00364-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
AbstractIn this paper, a sliding mode (SM)-based online fault compensation control scheme is investigated for modular reconfigurable robots (MRRs) with actuator failures via adaptive dynamic programming. It consists of a SM-based iterative controller, an adaptive robust term and an online fault compensator. For fault-free MRR systems, the SM surface-based Hamilton–Jacobi–Bellman equation is solved by online policy iteration algorithm. The adaptive robust term is added to guarantee the reachable condition of SM surface. For faulty MRR systems, the actuator failure is compensated online to avoid the fault detection and isolation mechanism. The closed-loop MRR system is guaranteed to be asymptotically stable under the developed fault compensation control scheme. Simulation results verify the effectiveness of the present fault compensation control approach.
Collapse
|
14
|
Dynamic Movement Primitives: Volumetric Obstacle Avoidance Using Dynamic Potential Functions. J INTELL ROBOT SYST 2021. [DOI: 10.1007/s10846-021-01344-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
AbstractObstacle avoidance for Dynamic Movement Primitives (DMPs) is still a challenging problem. In our previous work, we proposed a framework for obstacle avoidance based on superquadric potential functions to represent volumes. In this work, we extend our previous work to include the velocity of the system in the definition of the potential. Our formulations guarantee smoother behavior with respect to state-of-the-art point-like methods. Moreover, our new formulation allows obtaining a smoother behavior in proximity of the obstacle than when using a static (i.e. velocity independent) potential. We validate our framework for obstacle avoidance in a simulated multi-robot scenario and with different real robots: a pick-and-place task for an industrial manipulator and a surgical robot to show scalability; and navigation with a mobile robot in a dynamic environment.
Collapse
|
15
|
Si W, Wang N, Yang C. A review on manipulation skill acquisition through teleoperation‐based learning from demonstration. COGNITIVE COMPUTATION AND SYSTEMS 2021. [DOI: 10.1049/ccs2.12005] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Affiliation(s)
- Weiyong Si
- Bristol Robotics Laboratory University of the West of England Bristol UK
| | - Ning Wang
- Bristol Robotics Laboratory University of the West of England Bristol UK
| | - Chenguang Yang
- Bristol Robotics Laboratory University of the West of England Bristol UK
| |
Collapse
|
16
|
Composite dynamic movement primitives based on neural networks for human–robot skill transfer. Neural Comput Appl 2021. [DOI: 10.1007/s00521-021-05747-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
AbstractIn this paper, composite dynamic movement primitives (DMPs) based on radial basis function neural networks (RBFNNs) are investigated for robots’ skill learning from human demonstrations. The composite DMPs could encode the position and orientation manipulation skills simultaneously for human-to-robot skills transfer. As the robot manipulator is expected to perform tasks in unstructured and uncertain environments, it requires the manipulator to own the adaptive ability to adjust its behaviours to new situations and environments. Since the DMPs can adapt to uncertainties and perturbation, and spatial and temporal scaling, it has been successfully employed for various tasks, such as trajectory planning and obstacle avoidance. However, the existing skill model mainly focuses on position or orientation modelling separately; it is a common constraint in terms of position and orientation simultaneously in practice. Besides, the generalisation of the skill learning model based on DMPs is still hard to deal with dynamic tasks, e.g., reaching a moving target and obstacle avoidance. In this paper, we proposed a composite DMPs-based framework representing position and orientation simultaneously for robot skill acquisition and the neural networks technique is used to train the skill model. The effectiveness of the proposed approach is validated by simulation and experiments.
Collapse
|
17
|
Hua J, Zeng L, Li G, Ju Z. Learning for a Robot: Deep Reinforcement Learning, Imitation Learning, Transfer Learning. SENSORS 2021; 21:s21041278. [PMID: 33670109 PMCID: PMC7916895 DOI: 10.3390/s21041278] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 02/01/2021] [Accepted: 02/05/2021] [Indexed: 11/16/2022]
Abstract
Dexterous manipulation of the robot is an important part of realizing intelligence, but manipulators can only perform simple tasks such as sorting and packing in a structured environment. In view of the existing problem, this paper presents a state-of-the-art survey on an intelligent robot with the capability of autonomous deciding and learning. The paper first reviews the main achievements and research of the robot, which were mainly based on the breakthrough of automatic control and hardware in mechanics. With the evolution of artificial intelligence, many pieces of research have made further progresses in adaptive and robust control. The survey reveals that the latest research in deep learning and reinforcement learning has paved the way for highly complex tasks to be performed by robots. Furthermore, deep reinforcement learning, imitation learning, and transfer learning in robot control are discussed in detail. Finally, major achievements based on these methods are summarized and analyzed thoroughly, and future research challenges are proposed.
Collapse
Affiliation(s)
- Jiang Hua
- Key Laboratory of Metallurgical Equipment and Control Technology, Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China; (J.H.); (L.Z.); (G.L.)
| | - Liangcai Zeng
- Key Laboratory of Metallurgical Equipment and Control Technology, Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China; (J.H.); (L.Z.); (G.L.)
| | - Gongfa Li
- Key Laboratory of Metallurgical Equipment and Control Technology, Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China; (J.H.); (L.Z.); (G.L.)
| | - Zhaojie Ju
- School of Computing, University of Portsmouth, Portsmouth 03801, UK
- Correspondence:
| |
Collapse
|
18
|
Abu-Dakka FJ, Saveriano M. Variable Impedance Control and Learning-A Review. Front Robot AI 2020; 7:590681. [PMID: 33501348 PMCID: PMC7805898 DOI: 10.3389/frobt.2020.590681] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2020] [Accepted: 10/22/2020] [Indexed: 11/13/2022] Open
Abstract
Robots that physically interact with their surroundings, in order to accomplish some tasks or assist humans in their activities, require to exploit contact forces in a safe and proficient manner. Impedance control is considered as a prominent approach in robotics to avoid large impact forces while operating in unstructured environments. In such environments, the conditions under which the interaction occurs may significantly vary during the task execution. This demands robots to be endowed with online adaptation capabilities to cope with sudden and unexpected changes in the environment. In this context, variable impedance control arises as a powerful tool to modulate the robot's behavior in response to variations in its surroundings. In this survey, we present the state-of-the-art of approaches devoted to variable impedance control from control and learning perspectives (separately and jointly). Moreover, we propose a new taxonomy for mechanical impedance based on variability, learning, and control. The objective of this survey is to put together the concepts and efforts that have been done so far in this field, and to describe advantages and disadvantages of each approach. The survey concludes with open issues in the field and an envisioned framework that may potentially solve them.
Collapse
Affiliation(s)
- Fares J. Abu-Dakka
- Intelligent Robotics Group, Department of Electrical Engineering and Automation (EEA), Aalto University, Espoo, Finland
| | - Matteo Saveriano
- Intelligent and Interactive Systems, Department of Computer Science and Digital Science Center (DiSC), University of Innsbruck, Innsbruck, Austria
| |
Collapse
|
19
|
Bazzi S, Sternad D. Human control of complex objects: Towards more dexterous robots. Adv Robot 2020; 34:1137-1155. [PMID: 33100448 PMCID: PMC7577404 DOI: 10.1080/01691864.2020.1777198] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2020] [Revised: 05/08/2020] [Accepted: 05/27/2020] [Indexed: 10/24/2022]
Abstract
Manipulation of objects with underactuated dynamics remains a challenge for robots. In contrast, humans excel at 'tool use' and more insight into human control strategies may inform robotic control architectures. We examined human control of objects that exhibit complex - underactuated, nonlinear, and potentially chaotic dynamics, such as transporting a cup of coffee. Simple control strategies appropriate for unconstrained movements, such as maximizing smoothness, fail as interaction forces have to be compensated or preempted. However, predictive control based on internal models appears daunting when the objects have nonlinear and unpredictable dynamics. We hypothesized that humans learn strategies that make these interactions predictable. Using a virtual environment subjects interacted with a virtual cup and rolling ball using a robotic visual and haptic interface. Two different metrics quantified predictability: stability or contraction, and mutual information between controller and object. In point-to-point displacements subjects exploited the contracting regions of the object dynamics to safely navigate perturbations. Control contraction metrics showed that subjects used a controller that exponentially stabilized trajectories. During continuous cup-and-ball displacements subjects developed predictable solutions sacrificing smoothness and energy efficiency. These results may stimulate control strategies for dexterous robotic manipulators and human-robot interaction.
Collapse
Affiliation(s)
- Salah Bazzi
- Department of Biology, Northeastern University, Boston, Massachusetts 02115, USA
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts 02115, USA
| | - Dagmar Sternad
- Department of Biology, Northeastern University, Boston, Massachusetts 02115, USA
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts 02115, USA
- Department of Physics, Northeastern University, Boston, Massachusetts 02115, USA
| |
Collapse
|
20
|
Ito T, Ayusawa K, Yoshida E, Kobayashi H. Simultaneous Control Framework for Humanoid Tracking Human Movement With Interacting Wearable Assistive Device. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.2979663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
21
|
Vlachos K, Doulgeri Z. A Control Scheme With a Novel DMP-Robot Coupling Achieving Compliance and Tracking Accuracy Under Unknown Task Dynamics and Model Uncertainties. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.2970985] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
22
|
Sloth C, Kramberger A, Iturrate I. Towards easy setup of robotic assembly tasks. Adv Robot 2019. [DOI: 10.1080/01691864.2019.1704869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
| | | | - Iñigo Iturrate
- SDU Robotics, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
23
|
Motor Skills Learning and Generalization with Adapted Curvilinear Gaussian Mixture Model. J INTELL ROBOT SYST 2019. [DOI: 10.1007/s10846-019-00999-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
24
|
Pairet E, Ardon P, Mistry M, Petillot Y. Learning Generalizable Coupling Terms for Obstacle Avoidance via Low-Dimensional Geometric Descriptors. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2930431] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
25
|
Fang B, Jia S, Guo D, Xu M, Wen S, Sun F. Survey of imitation learning for robotic manipulation. INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS 2019. [DOI: 10.1007/s41315-019-00103-5] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
26
|
Raković M, Savić S, Santos-Victor J, Nikolić M, Borovac B. Human-Inspired Online Path Planning and Biped Walking Realization in Unknown Environment. Front Neurorobot 2019; 13:36. [PMID: 31214011 PMCID: PMC6558152 DOI: 10.3389/fnbot.2019.00036] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2018] [Accepted: 05/17/2019] [Indexed: 11/13/2022] Open
Abstract
The focus of research in biped locomotion has moved toward real-life scenario applications, like walking on uneven terrain, passing through doors, climbing stairs and ladders. As a result, we are witnessing significant advances in the locomotion of biped robots, enabling them to move in hazardous environments while simultaneously accomplishing complex manipulation tasks. Yet, considering walking in an unknown environment, the efficiency of humanoid robots is still far from being comparable with the human. Currently, bipeds are very sensitive to external changes and they have severe constraints for adaptation of walk to conditions from such a complex environment. Promising approaches for efficient generation and realization of walking in a complex environment are based on biological solutions that have been developed for many years of evolution. This work presents one such human-inspired methodology for path planning and realization of biped walk appropriate for motion in a complex unfamiliar environment. Path planning results in calculating clothoid curves that represent well the human-like walking path. The robot walk is realized by the composition of parametric motion primitives. Such an approach enables on-line modification of planned path and walk parameters at any moment, instantly. To establish the relationship between high-level path planner and the low-level joint motion realization, we had to find a way to extract the parameters of the clothoid paths that can be linked with the parameters of the walk and consequently to motion primitive parameters. This enabled the robot to adopt its walking for avoiding the obstacles and for a smooth transition between different paths. In this paper we provide a complete framework that integrates the following components: (i) bio-inspired online path planning, (ii) path-dependent automatic calculation of high-level gait parameters (step length, walking speed, direction, and the height of the foot sole), and (iii) automatic calculation of low-level joint movements and corresponding control terms (driving motor voltage) through the adaptation of motion primitives which realize walking pattern and preserves the dynamic balance of the robot.
Collapse
Affiliation(s)
- Mirko Raković
- Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia.,Institute for Systems and Robotics, Instituto Superior Tecnico, University of Lisbon, Lisbon, Portugal
| | - Srdjan Savić
- Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia
| | - José Santos-Victor
- Institute for Systems and Robotics, Instituto Superior Tecnico, University of Lisbon, Lisbon, Portugal
| | - Milutin Nikolić
- Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia
| | - Branislav Borovac
- Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia
| |
Collapse
|
27
|
Abstract
Imitation learning has been studied widely as a convenient way to transfer human skills to robots. This learning approach is aimed at extracting relevant motion patterns from human demonstrations and subsequently applying these patterns to different situations. Despite the many advancements that have been achieved, solutions for coping with unpredicted situations (e.g., obstacles and external perturbations) and high-dimensional inputs are still largely absent. In this paper, we propose a novel kernelized movement primitive (KMP), which allows the robot to adapt the learned motor skills and fulfill a variety of additional constraints arising over the course of a task. Specifically, KMP is capable of learning trajectories associated with high-dimensional inputs owing to the kernel treatment, which in turn renders a model with fewer open parameters in contrast to methods that rely on basis functions. Moreover, we extend our approach by exploiting local trajectory representations in different coordinate systems that describe the task at hand, endowing KMP with reliable extrapolation capabilities in broader domains. We apply KMP to the learning of time-driven trajectories as a special case, where a compact parametric representation describing a trajectory and its first-order derivative is utilized. In order to verify the effectiveness of our method, several examples of trajectory modulations and extrapolations associated with time inputs, as well as trajectory adaptations with high-dimensional inputs are provided.
Collapse
Affiliation(s)
- Yanlong Huang
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, Genova, Italy
| | - Leonel Rozo
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, Genova, Italy
| | - João Silvério
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, Genova, Italy
| | - Darwin G Caldwell
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
28
|
|
29
|
Armesto L, Moura J, Ivan V, Erden MS, Sala A, Vijayakumar S. Constraint-aware learning of policies by demonstration. Int J Rob Res 2018. [DOI: 10.1177/0278364918784354] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Many practical tasks in robotic systems, such as cleaning windows, writing, or grasping, are inherently constrained. Learning policies subject to constraints is a challenging problem. In this paper, we propose a method of constraint-aware learning that solves the policy learning problem using redundant robots that execute a policy that is acting in the null space of a constraint. In particular, we are interested in generalizing learned null-space policies across constraints that were not known during the training. We split the combined problem of learning constraints and policies into two: first estimating the constraint, and then estimating a null-space policy using the remaining degrees of freedom. For a linear parametrization, we provide a closed-form solution of the problem. We also define a metric for comparing the similarity of estimated constraints, which is useful to pre-process the trajectories recorded in the demonstrations. We have validated our method by learning a wiping task from human demonstration on flat surfaces and reproducing it on an unknown curved surface using a force- or torque-based controller to achieve tool alignment. We show that, despite the differences between the training and validation scenarios, we learn a policy that still provides the desired wiping motion.
Collapse
Affiliation(s)
- Leopoldo Armesto
- Instituto de Diseño y Fabricación, Universitat Politécnica de València, Spain
| | - João Moura
- Institute of Sensors, Signals and Systems, Heriot-Watt University, UK
- Institute of Action, Perception, and Behaviour, University of Edinburgh, UK
| | - Vladimir Ivan
- Institute of Action, Perception, and Behaviour, University of Edinburgh, UK
| | | | - Antonio Sala
- Instituto U. de Automática e Inf. Industrial, Universitat Politécnica de València, Spain
| | - Sethu Vijayakumar
- Institute of Action, Perception, and Behaviour, University of Edinburgh, UK
| |
Collapse
|
30
|
Sado F, Yap HJ, Ghazilla RAR, Ahmad N. Exoskeleton robot control for synchronous walking assistance in repetitive manual handling works based on dual unscented Kalman filter. PLoS One 2018; 13:e0200193. [PMID: 30001415 PMCID: PMC6042736 DOI: 10.1371/journal.pone.0200193] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2018] [Accepted: 06/21/2018] [Indexed: 11/25/2022] Open
Abstract
Prolong walking is a notable risk factor for work-related lower-limb disorders (WRLLD) in industries such as agriculture, construction, service profession, healthcare and retail works. It is one of the common causes of lower limb fatigue or muscular exhaustion leading to poor balance and fall. Exoskeleton technology is seen as a modern strategy to assist worker’s in these professions to minimize or eliminate the risk of WRLLDs. Exoskeleton has potentials to benefit workers in prolong walking (amongst others) by augmenting their strength, increasing their endurance, and minimizing high muscular activation, resulting in overall work efficiency and productivity. Controlling exoskeleton to achieve this purpose for able-bodied personnel without impeding their natural movement is, however, challenging. In this study, we propose a control strategy that integrates a Dual Unscented Kalman Filter (DUKF) for trajectory generation/prediction of the spatio-temporal features of human walking (i.e. joint position, and velocity, and acceleration) and an impedance cum supervisory controller to enable the exoskeleton to follow this trajectory to synchronize with the human walking. Experiment is conducted with four subjects carrying a load and walking at their normal speed- a typical scenario in industries. EMG signals taken at two muscles: Right Vastus Intermedius (on the thigh) and Right Gastrocnemius (on the calf) indicated reduction in muscular activation during the experiment. The results also show the ability of the control system to predict spatio-temporal features of the pilots’ walking and to enable the exoskeleton to move in concert with the pilot.
Collapse
Affiliation(s)
- Fatai Sado
- Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur, Malaysia
| | - Hwa Jen Yap
- Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur, Malaysia
- * E-mail:
| | - Raja Ariffin Raja Ghazilla
- Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur, Malaysia
| | - Norhafizan Ahmad
- Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur, Malaysia
| |
Collapse
|
31
|
Lee H, Kim H, Kim W, Kim HJ. An Integrated Framework for Cooperative Aerial Manipulators in Unknown Environments. IEEE Robot Autom Lett 2018. [DOI: 10.1109/lra.2018.2807486] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
32
|
Dometios AC, Zhou Y, Papageorgiou XS, Tzafestas CS, Asfour T. Vision-Based Online Adaptation of Motion Primitives to Dynamic Surfaces: Application to an Interactive Robotic Wiping Task. IEEE Robot Autom Lett 2018. [DOI: 10.1109/lra.2018.2800031] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
33
|
Paraschos A, Rueckert E, Peters J, Neumann G. Probabilistic movement primitives under unknown system dynamics. Adv Robot 2018. [DOI: 10.1080/01691864.2018.1437674] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Affiliation(s)
| | - Elmar Rueckert
- Intelligent Autonomous Systems, TU Darmstadt, Darmstadt, Germany
| | - Jan Peters
- Intelligent Autonomous Systems, TU Darmstadt, Darmstadt, Germany
- Robot Learning Group, Max Planck Institute for Intelligent Systems, Tuebingen, Germany
| | - Gerhard Neumann
- Lincoln Centre for Autonomous Systems (LCAS), University of Lincoln, Lincoln, UK
| |
Collapse
|
34
|
|
35
|
Huang R, Cheng H, Guo H, Lin X, Zhang J. Hierarchical learning control with physical human-exoskeleton interaction. Inf Sci (N Y) 2018. [DOI: 10.1016/j.ins.2017.09.068] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
36
|
|
37
|
Ajoudani A, Zanchettin AM, Ivaldi S, Albu-Schäffer A, Kosuge K, Khatib O. Progress and prospects of the human–robot collaboration. Auton Robots 2017. [DOI: 10.1007/s10514-017-9677-2] [Citation(s) in RCA: 235] [Impact Index Per Article: 33.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
38
|
Paraschos A, Daniel C, Peters J, Neumann G. Using probabilistic movement primitives in robotics. Auton Robots 2017. [DOI: 10.1007/s10514-017-9648-7] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
39
|
Peternel L, Tsagarakis N, Ajoudani A. A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information. IEEE Trans Neural Syst Rehabil Eng 2017; 25:811-822. [PMID: 28436880 DOI: 10.1109/tnsre.2017.2694553] [Citation(s) in RCA: 67] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
This paper aims to improve the interaction and coordination between the human and the robot in cooperative execution of complex, powerful, and dynamic tasks. We propose a novel approach that integrates online information about the human motor function and manipulability properties into the hybrid controller of the assistive robot. Through this human-in-the-loop framework, the robot can adapt to the human motor behavior and provide the appropriate assistive response in different phases of the cooperative task. We experimentally evaluate the proposed approach in two human-robot co-manipulation tasks that require specific complementary behavior from the two agents. Results suggest that the proposed technique, which relies on a minimum degree of task-level pre-programming, can achieve an enhanced physical human-robot interaction performance and deliver appropriate level of assistance to the human operator.
Collapse
|
40
|
|
41
|
Khansari M, Klingbeil E, Khatib O. Adaptive human-inspired compliant contact primitives to perform surface–surface contact under uncertainty. Int J Rob Res 2016. [DOI: 10.1177/0278364916648389] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
This paper focuses on devising a control policy that is inspired by human strategy to enable robots to perform surface–surface contact between a hand-held object (e.g. a box) and the environment (e.g. table). We assume the object’s shape is partially known and consider uncertainties in both the environment and the object grasp. Our analysis on ten untrained subjects indicates that during this task: (1) the subjects start decreasing the angular velocity before the complete alignment (in contrast to existing approaches), and (2) they do not control the contact force to remain at a fixed value. Our study is also consistent with the hypothesis that the subjects determine an over-estimate of the relative angle between the object in hand and the environment. Based on these observations we propose a novel control policy, called Surface-Surface Contact Primitive (SSCP), which can perform the surface–surface alignment task with only partial information about the hand-held object and the environment. Furthermore, SSCP only requires a rough estimate of the surface normal vector and does not rely on either the estimation of contact type (i.e. point or edge contact) or locations of contact points. We evaluate the performance of the proposed controller on a set of robot experiments using two seven-degree-of-freedom robots, one for imposing uncertainty to the environment, and the other to perform the experiment. We show the applicability of the controller on four objects with different geometries, its generalization to four different surface materials, and its robustness to uncertainty in environment and grasp as well as external perturbations.
Collapse
|
42
|
Rozo L, Calinon S, Caldwell DG, Jimenez P, Torras C. Learning Physical Collaborative Robot Behaviors From Human Demonstrations. IEEE T ROBOT 2016. [DOI: 10.1109/tro.2016.2540623] [Citation(s) in RCA: 144] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
43
|
Generalization of Force Control Policies from Demonstrations for Constrained Robotic Motion Tasks. J INTELL ROBOT SYST 2015. [DOI: 10.1007/s10846-015-0218-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|