1
|
Petrič T. Phase-Synchronized Learning of Periodic Compliant Movement Primitives (P-CMPs). Front Neurorobot 2020; 14:599889. [PMID: 33281594 PMCID: PMC7688913 DOI: 10.3389/fnbot.2020.599889] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Accepted: 10/07/2020] [Indexed: 11/25/2022] Open
Abstract
Autonomous trajectory and torque profile synthesis through modulation and generalization require a database of motion with accompanying dynamics, which is typically difficult and time-consuming to obtain. Inspired by adaptive control strategies, this paper presents a novel method for learning and synthesizing Periodic Compliant Movement Primitives (P-CMPs). P-CMPs combine periodic trajectories encoded as Periodic Dynamic Movement Primitives (P-DMPs) with accompanying task-specific Periodic Torque Primitives (P-TPs). The state-of-the-art approach requires to learn TPs for each variation of the task, e.g., modulation of frequency. Comparatively, in this paper, we propose a novel P-TPs framework, which is both frequency and phase-dependent. Thereby, the executed P-CMPs can be easily modulated, and consequently, the learning rate can be improved. Moreover, both the kinematic and the dynamic profiles are parameterized, thus enabling the representation of skills using corresponding parameters. The proposed framework was evaluated on two robot systems, i.e., Kuka LWR-4 and Franka Emika Panda. The evaluation of the proposed approach on a Kuka LWR-4 robot performing a swinging motion and on Franka Emika Panda performing an exercise for elbow rehabilitation shows fast P-CTPs acquisition and accurate and compliant motion in real-world scenarios.
Collapse
Affiliation(s)
- Tadej Petrič
- CoBoTaT Lab, Department of Automatics, Biocybernetics and Robotics, Jožef Stean Institute (JSI), Ljubljana, Slovenia
| |
Collapse
|
2
|
Li C, Fahmy A, Li S, Sienz J. An Enhanced Robot Massage System in Smart Homes Using Force Sensing and a Dynamic Movement Primitive. Front Neurorobot 2020; 14:30. [PMID: 32714174 PMCID: PMC7344303 DOI: 10.3389/fnbot.2020.00030] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2020] [Accepted: 05/04/2020] [Indexed: 11/18/2022] Open
Abstract
With requirements to improve life quality, smart homes, and healthcare have gradually become a future lifestyle. In particular, service robots with human behavioral sensing for private or personal use in the home have attracted a lot of research attention thanks to their advantages in relieving high labor costs and the fatigue of human assistance. In this paper, a novel force-sensing- and robotic learning algorithm-based teaching interface for robot massaging has been proposed. For the teaching purposes, a human operator physically holds the end-effector of the robot to perform the demonstration. At this stage, the end position data are outputted and sent to be segmented via the Finite Difference (FD) method. A Dynamic Movement Primitive (DMP) is utilized to model and generalize the human-like movements. In order to learn from multiple demonstrations, Dynamic Time Warping (DTW) is used for the preprocessing of the data recorded on the robot platform, and a Gaussian Mixture Model (GMM) is employed for the evaluation of DMP to generate multiple patterns after the completion of the teaching process. After that, a Gaussian Mixture Regression (GMR) algorithm is applied to generate a synthesized trajectory to minimize position errors. Then a hybrid position/force controller is integrated to track the desired trajectory in the task space while considering the safety of human-robot interaction. The validation of our proposed method has been performed and proved by conducting massage tasks on a KUKA LBR iiwa robot platform.
Collapse
Affiliation(s)
- Chunxu Li
- Centre for Robotics and Neural Systems, University of Plymouth, Plymouth, United Kingdom.,Shandong Marine Corrosion and Safety Protection Engineering Research Center, Qingdao University of Science and Technology, Qingdao, China
| | - Ashraf Fahmy
- ASTUTE 2020 in Future Manufacturing Research Institute, College of Engineering, Swansea University, Swansea, United Kingdom.,Department of Electrical Power and Machines, Helwan University, Helwan, Egypt
| | - Shaoxiang Li
- Shandong Marine Corrosion and Safety Protection Engineering Research Center, Qingdao University of Science and Technology, Qingdao, China
| | - Johann Sienz
- ASTUTE 2020 in Future Manufacturing Research Institute, College of Engineering, Swansea University, Swansea, United Kingdom
| |
Collapse
|
3
|
Chatzilygeroudis K, Vassiliades V, Stulp F, Calinon S, Mouret JB. A Survey on Policy Search Algorithms for Learning Robot Controllers in a Handful of Trials. IEEE T ROBOT 2020. [DOI: 10.1109/tro.2019.2958211] [Citation(s) in RCA: 51] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
4
|
Villa DKD, Brandão AS, Sarcinelli-Filho M. A Survey on Load Transportation Using Multirotor UAVs. J INTELL ROBOT SYST 2019. [DOI: 10.1007/s10846-019-01088-w] [Citation(s) in RCA: 53] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
5
|
Kim H, Seo H, Choi S, Tomlin CJ, Kim HJ. Incorporating Safety Into Parametric Dynamic Movement Primitives. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2900762] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
6
|
Biologically Inspired Motion Modeling and Neural Control for Robot Learning From Demonstrations. IEEE Trans Cogn Dev Syst 2019. [DOI: 10.1109/tcds.2018.2866477] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
7
|
Hazara M, Kyrki V. Transferring Generalizable Motor Primitives From Simulation to Real World. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2900768] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
8
|
|
9
|
Petric T, Gams A, Colasanto L, Ijspeert AJ, Ude A. Accelerated Sensorimotor Learning of Compliant Movement Primitives. IEEE T ROBOT 2018. [DOI: 10.1109/tro.2018.2861921] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
10
|
Takano W, Takahashi T, Nakamura Y. Sequential Monte Carlo controller that integrates physical consistency and motion knowledge. Auton Robots 2018. [DOI: 10.1007/s10514-018-9815-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
11
|
Environment-adaptive interaction primitives through visual context for human–robot motor skill learning. Auton Robots 2018. [DOI: 10.1007/s10514-018-9798-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|
12
|
Calvo Tapia C, Tyukin IY, Makarov VA. Fast social-like learning of complex behaviors based on motor motifs. Phys Rev E 2018; 97:052308. [PMID: 29906958 DOI: 10.1103/physreve.97.052308] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2018] [Indexed: 01/01/2023]
Abstract
Social learning is widely observed in many species. Less experienced agents copy successful behaviors exhibited by more experienced individuals. Nevertheless, the dynamical mechanisms behind this process remain largely unknown. Here we assume that a complex behavior can be decomposed into a sequence of n motor motifs. Then a neural network capable of activating motor motifs in a given sequence can drive an agent. To account for (n-1)! possible sequences of motifs in a neural network, we employ the winnerless competition approach. We then consider a teacher-learner situation: one agent exhibits a complex movement, while another one aims at mimicking the teacher's behavior. Despite the huge variety of possible motif sequences we show that the learner, equipped with the provided learning model, can rewire "on the fly" its synaptic couplings in no more than (n-1) learning cycles and converge exponentially to the durations of the teacher's motifs. We validate the learning model on mobile robots. Experimental results show that the learner is indeed capable of copying the teacher's behavior composed of six motor motifs in a few learning cycles. The reported mechanism of learning is general and can be used for replicating different functions, including, for example, sound patterns or speech.
Collapse
Affiliation(s)
- Carlos Calvo Tapia
- Instituto de Matemática Interdisciplinar, Faculty of Mathematics, Universidad Complutense de Madrid, Plaza Ciencias 3, 28040 Madrid, Spain
| | - Ivan Y Tyukin
- University of Leicester, Department of Mathematics, University Road, LE1 7RH, United Kingdom
| | - Valeri A Makarov
- Instituto de Matemática Interdisciplinar, Faculty of Mathematics, Universidad Complutense de Madrid, Plaza Ciencias 3, 28040 Madrid, Spain.,Lobachevsky State University of Nizhny Novgorod, Gagarin Ave. 23, 603950 Nizhny Novgorod, Russia
| |
Collapse
|
13
|
Queißer JF, Steil JJ. Bootstrapping of Parameterized Skills Through Hybrid Optimization in Task and Policy Spaces. Front Robot AI 2018; 5:49. [PMID: 33500934 PMCID: PMC7805929 DOI: 10.3389/frobt.2018.00049] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2017] [Accepted: 04/11/2018] [Indexed: 11/13/2022] Open
Abstract
Modern robotic applications create high demands on adaptation of actions with respect to variance in a given task. Reinforcement learning is able to optimize for these changing conditions, but relearning from scratch is hardly feasible due to the high number of required rollouts. We propose a parameterized skill that generalizes to new actions for changing task parameters, which is encoded as a meta-learner that provides parameters for task-specific dynamic motion primitives. Our work shows that utilizing parameterized skills for initialization of the optimization process leads to a more effective incremental task learning. In addition, we introduce a hybrid optimization method that combines a fast coarse optimization on a manifold of policy parameters with a fine grained parameter search in the unrestricted space of actions. The proposed algorithm reduces the number of required rollouts for adaptation to new task conditions. Application in illustrative toy scenarios, for a 10-DOF planar arm, and a humanoid robot point reaching task validate the approach.
Collapse
Affiliation(s)
- Jeffrey F Queißer
- Research Institute for Cognition and Robotics (CoR-Lab), Machine Learning Group, CITEC, Bielefeld University, Bielefeld, Germany
| | - Jochen J Steil
- Institute for Robotics and Process Control, Technische Universität Braunschweig, Braunschweig, Germany
| |
Collapse
|
14
|
Pervez A, Lee D. Learning task-parameterized dynamic movement primitives using mixture of GMMs. INTEL SERV ROBOT 2017. [DOI: 10.1007/s11370-017-0235-8] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
15
|
Paraschos A, Daniel C, Peters J, Neumann G. Using probabilistic movement primitives in robotics. Auton Robots 2017. [DOI: 10.1007/s10514-017-9648-7] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
16
|
|
17
|
Matsubara T, Uchikata A, Morimoto J. Spatiotemporal synchronization of biped walking patterns with multiple external inputs by style-phase adaptation. BIOLOGICAL CYBERNETICS 2015; 109:597-610. [PMID: 26459123 DOI: 10.1007/s00422-015-0663-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2015] [Accepted: 09/29/2015] [Indexed: 06/05/2023]
Abstract
In this paper, we propose a framework for generating coordinated periodic movements of robotic systems with multiple external inputs. We developed an adaptive pattern generator model that is composed of a two-factor observation model with a style parameter and phase dynamics with a phase variable. The style parameter controls the spatial patterns of the generated trajectories, and the phase variable manages its temporal profiles. By exploiting the style-phase separation in the pattern generation, we can independently design adaptation schemes for the spatial and temporal profiles of the pattern generator to multiple external inputs. To validate the effectiveness of our proposed method, we applied it to a user-exoskeleton model to achieve user-adaptive walking assistance for which the exoskeleton robot's movements need to be coordinated with the user walking patterns and environment. As a result, the exoskeleton robot successfully performed stable biped walking behaviors for walking assistance even when the style of the observed walking pattern and the period were suddenly changed.
Collapse
Affiliation(s)
- Takamitsu Matsubara
- Department of Brain Robot Interface, ATR Computational Neuroscience Laboratories, Kyoto, Japan.
- Nara Institute of Science and Technology (NAIST), Nara, Japan.
| | - Akimasa Uchikata
- Department of Brain Robot Interface, ATR Computational Neuroscience Laboratories, Kyoto, Japan
- Nara Institute of Science and Technology (NAIST), Nara, Japan
| | - Jun Morimoto
- Department of Brain Robot Interface, ATR Computational Neuroscience Laboratories, Kyoto, Japan.
| |
Collapse
|
18
|
|
19
|
|
20
|
Gams A, Nemec B, Ijspeert AJ, Ude A. Coupling Movement Primitives: Interaction With the Environment and Bimanual Tasks. IEEE T ROBOT 2014. [DOI: 10.1109/tro.2014.2304775] [Citation(s) in RCA: 121] [Impact Index Per Article: 12.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|