1
|
Ghonasgi K, Mirsky R, Bhargava N, Haith AM, Stone P, Deshpande AD. Kinematic coordinations capture learning during human-exoskeleton interaction. Sci Rep 2023; 13:10322. [PMID: 37365176 DOI: 10.1038/s41598-023-35231-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 05/14/2023] [Indexed: 06/28/2023] Open
Abstract
Human-exoskeleton interactions have the potential to bring about changes in human behavior for physical rehabilitation or skill augmentation. Despite significant advances in the design and control of these robots, their application to human training remains limited. The key obstacles to the design of such training paradigms are the prediction of human-exoskeleton interaction effects and the selection of interaction control to affect human behavior. In this article, we present a method to elucidate behavioral changes in the human-exoskeleton system and identify expert behaviors correlated with a task goal. Specifically, we observe the joint coordinations of the robot, also referred to as kinematic coordination behaviors, that emerge from human-exoskeleton interaction during learning. We demonstrate the use of kinematic coordination behaviors with two task domains through a set of three human-subject studies. We find that participants (1) learn novel tasks within the exoskeleton environment, (2) demonstrate similarity of coordination during successful movements within participants, (3) learn to leverage these coordination behaviors to maximize success within participants, and (4) tend to converge to similar coordinations for a given task strategy across participants. At a high level, we identify task-specific joint coordinations that are used by different experts for a given task goal. These coordinations can be quantified by observing experts and the similarity to these coordinations can act as a measure of learning over the course of training for novices. The observed expert coordinations may further be used in the design of adaptive robot interactions aimed at teaching a participant the expert behaviors.
Collapse
Affiliation(s)
- Keya Ghonasgi
- Department of Mechanical Engineering, The University of Texas at Austin, Austin, TX, USA
| | - Reuth Mirsky
- Department of Computer Science, Bar-Ilan University, Ramat Gan, Israel
| | - Nisha Bhargava
- Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Adrian M Haith
- Department of Neurology, Johns Hopkins University, Baltimore, MD, USA
| | - Peter Stone
- Department of Computer Science, The University of Texas at Austin, Austin, TX, USA
- Sony AI, Austin, TX, USA
| | - Ashish D Deshpande
- Department of Mechanical Engineering, The University of Texas at Austin, Austin, TX, USA.
| |
Collapse
|
2
|
Nayeem R, Sohn WJ, DiCarlo JA, Gochyyev P, Lin DJ, Sternad D. Novel Platform for Quantitative Assessment of Functional Object Interactions After Stroke. IEEE Trans Neural Syst Rehabil Eng 2022; 31:426-436. [PMID: 36455078 PMCID: PMC10079607 DOI: 10.1109/tnsre.2022.3226067] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
Abstract
Many persons with stroke exhibit upper extremity motor impairments. These impairments often lead to dysfunction and affect performance in activities of daily living, where successful manipulation of objects is essential. Hence, understanding how upper extremity motor deficits manifest in functional interactions with objects is critical for rehabilitation. However, quantifying skill in these tasks has been a challenge. Traditional rehabilitation assessments require highly trained clinicians, are time-consuming, and yield subjective scores. This paper introduces a custom-designed device, the "MAGIC Table", that can record real-time kinematics of persons with stroke during interaction with objects, specifically a 'cup of coffee'. The task and its quantitative assessments were derived from previous basic-science studies. Six participants after stroke and six able-bodied participants moved a 3D-printed cup with a rolling ball inside, representing sloshing coffee, with 3 levels of difficulty. Movements were captured via a high-resolution camera above the table. Conventional kinematic metrics (movement time and smoothness) and novel kinematic metrics accounting for object interaction (risk and predictability) evaluated performance. Expectedly, persons with stroke moved more slowly and less smoothly than able-bodied participants, in both simple reaches and during transport of the cup-and-ball system. However, the more sensitive metric was mutual information, which captured the predictability of interactions, essential in cup transport as shown in previous theoretical research. Predictability sensitively measured differences in performance with increasing levels of difficulty. It also showed the best intraclass consistency, promising sensitive differentiation between different levels of impairment. This first study highlights the feasibility of this new device and indicates that examining dynamic object interaction may provide valuable insights into upper extremity function after stroke useful for assessment and rehabilitation.
Collapse
Affiliation(s)
- Rashida Nayeem
- Department of Electrical and Computer Engineering, Northeastern University, Boston, MA, USA
| | - Won Joon Sohn
- Department of Electrical and Computer Engineering, Northeastern University, Boston, MA, USA
| | - Julie A. DiCarlo
- Department of Neurology, Massachusetts General Hospital, Center for Neurotechnology and Neurorecovery, Harvard Medical School, Boston, MA, USA
| | - Perman Gochyyev
- Department of Neurology, Massachusetts General Hospital, Center for Neurotechnology and Neurorecovery, Harvard Medical School, Boston, MA, USA
| | - David J. Lin
- Department of Neurology, Massachusetts General Hospital, Center for Neurotechnology and Neurorecovery, Harvard Medical School, Boston, MA, USA
| | - Dagmar Sternad
- Department of Electrical and Computer Engineering and the Department of Biology and Physics, Northeastern University, Boston, MA, USA
| |
Collapse
|
3
|
Krotov A, Russo M, Nah M, Hogan N, Sternad D. Motor control beyond reach-how humans hit a target with a whip. ROYAL SOCIETY OPEN SCIENCE 2022; 9:220581. [PMID: 36249337 PMCID: PMC9533004 DOI: 10.1098/rsos.220581] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Accepted: 09/16/2022] [Indexed: 06/01/2023]
Abstract
Humans are strikingly adept at manipulating complex objects, from tying shoelaces to cracking a bullwhip. These motor skills have highly nonlinear interactive dynamics that defy reduction into parts. Yet, despite advances in data recording and processing, experiments in motor neuroscience still prioritize experimental reduction over realistic complexity. This study embraced the fully unconstrained behaviour of hitting a target with a 1.6-m bullwhip, both in rhythmic and discrete fashion. Adopting an object-centered approach to test the hypothesis that skilled movement simplifies the whip dynamics, the whip's evolution was characterized in relation to performance error and hand speed. Despite widely differing individual strategies, both discrete and rhythmic styles featured a cascade-like unfolding of the whip. Whip extension and orientation at peak hand speed predicted performance error, at least in the rhythmic style, suggesting that humans accomplished the task by setting initial conditions. These insights may inform further studies on human and robot control of complex objects.
Collapse
Affiliation(s)
- Aleksei Krotov
- Department of Bioengineering, Northeastern University, Boston, MA, USA
| | - Marta Russo
- Departments of Biology, Electrical and Computer Engineering, and Physics, Northeastern University, Boston, MA, USA
- Department of Neurology, Tor Vergata Polyclinic and Laboratory of Neuromotor Physiology, IRCCS Fondazione Santa Lucia, Rome, Italy
| | - Moses Nah
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Neville Hogan
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Dagmar Sternad
- Departments of Biology, Electrical and Computer Engineering, and Physics, Northeastern University, Boston, MA, USA
| |
Collapse
|
4
|
Nayeem R, Bazzi S, Sadeghi M, Hogan N, Sternad D. Preparing to move: Setting initial conditions to simplify interactions with complex objects. PLoS Comput Biol 2021; 17:e1009597. [PMID: 34919539 PMCID: PMC8683040 DOI: 10.1371/journal.pcbi.1009597] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Accepted: 10/28/2021] [Indexed: 12/15/2022] Open
Abstract
Humans dexterously interact with a variety of objects, including those with complex internal dynamics. Even in the simple action of carrying a cup of coffee, the hand not only applies a force to the cup, but also indirectly to the liquid, which elicits complex reaction forces back on the hand. Due to underactuation and nonlinearity, the object's dynamic response to an action sensitively depends on its initial state and can display unpredictable, even chaotic behavior. With the overarching hypothesis that subjects strive for predictable object-hand interactions, this study examined how subjects explored and prepared the dynamics of an object for subsequent execution of the target task. We specifically hypothesized that subjects find initial conditions that shorten the transients prior to reaching a stable and predictable steady state. Reaching a predictable steady state is desirable as it may reduce the need for online error corrections and facilitate feed forward control. Alternative hypotheses were that subjects seek to reduce effort, increase smoothness, and reduce risk of failure. Motivated by the task of 'carrying a cup of coffee', a simplified cup-and-ball model was implemented in a virtual environment. Human subjects interacted with this virtual object via a robotic manipulandum that provided force feedback. Subjects were encouraged to first explore and prepare the cup-and-ball before initiating a rhythmic movement at a specified frequency between two targets without losing the ball. Consistent with the hypotheses, subjects increased the predictability of interaction forces between hand and object and converged to a set of initial conditions followed by significantly decreased transients. The three alternative hypotheses were not supported. Surprisingly, the subjects' strategy was more effortful and less smooth, unlike the observed behavior in simple reaching movements. Inverse dynamics of the cup-and-ball system and forward simulations with an impedance controller successfully described subjects' behavior. The initial conditions chosen by the subjects in the experiment matched those that produced the most predictable interactions in simulation. These results present first support for the hypothesis that humans prepare the object to minimize transients and increase stability and, overall, the predictability of hand-object interactions.
Collapse
Affiliation(s)
- Rashida Nayeem
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, United States of America
| | - Salah Bazzi
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, United States of America
- Department of Biology, Northeastern University, Boston, Massachusetts, United States of America
- Institute for Experiential Robotics, Northeastern University, Boston, Massachusetts, United States of America
| | - Mohsen Sadeghi
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, United States of America
- Department of Biology, Northeastern University, Boston, Massachusetts, United States of America
| | - Neville Hogan
- Departments of Mechanical Engineering and Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
| | - Dagmar Sternad
- Department of Electrical and Computer Engineering, Northeastern University, Boston, Massachusetts, United States of America
- Department of Biology, Northeastern University, Boston, Massachusetts, United States of America
- Institute for Experiential Robotics, Northeastern University, Boston, Massachusetts, United States of America
- Department of Physics, Northeastern University, Boston, Massachusetts, United States of America
| |
Collapse
|
5
|
Özen Ö, Buetler KA, Marchal-Crespo L. Promoting Motor Variability During Robotic Assistance Enhances Motor Learning of Dynamic Tasks. Front Neurosci 2021; 14:600059. [PMID: 33603642 PMCID: PMC7884323 DOI: 10.3389/fnins.2020.600059] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Accepted: 12/18/2020] [Indexed: 11/20/2022] Open
Abstract
Despite recent advances in robot-assisted training, the benefits of haptic guidance on motor (re)learning are still limited. While haptic guidance may increase task performance during training, it may also decrease participants' effort and interfere with the perception of the environment dynamics, hindering somatosensory information crucial for motor learning. Importantly, haptic guidance limits motor variability, a factor considered essential for learning. We propose that Model Predictive Controllers (MPC) might be good alternatives to haptic guidance since they minimize the assisting forces and promote motor variability during training. We conducted a study with 40 healthy participants to investigate the effectiveness of MPCs on learning a dynamic task. The task consisted of swinging a virtual pendulum to hit incoming targets with the pendulum ball. The environment was haptically rendered using a Delta robot. We designed two MPCs: the first MPC-end-effector MPC-applied the optimal assisting forces on the end-effector. A second MPC-ball MPC-applied its forces on the virtual pendulum ball to further reduce the assisting forces. The participants' performance during training and learning at short- and long-term retention tests were compared to a control group who trained without assistance, and a group that trained with conventional haptic guidance. We hypothesized that the end-effector MPC would promote motor variability and minimize the assisting forces during training, and thus, promote learning. Moreover, we hypothesized that the ball MPC would enhance the performance and motivation during training but limit the motor variability and sense of agency (i.e., the feeling of having control over their movements), and therefore, limit learning. We found that the MPCs reduce the assisting forces compared to haptic guidance. Training with the end-effector MPC increases the movement variability and does not hinder the pendulum swing variability during training, ultimately enhancing the learning of the task dynamics compared to the other groups. Finally, we observed that increases in the sense of agency seemed to be associated with learning when training with the end-effector MPC. In conclusion, training with MPCs enhances motor learning of tasks with complex dynamics and are promising strategies to improve robotic training outcomes in neurological patients.
Collapse
Affiliation(s)
- Özhan Özen
- Motor Learning and Neurorehabilitation Laboratory, ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland
| | - Karin A. Buetler
- Motor Learning and Neurorehabilitation Laboratory, ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland
| | - Laura Marchal-Crespo
- Motor Learning and Neurorehabilitation Laboratory, ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland
- Department of Cognitive Robotics, Delft University of Technology, Delft, Netherlands
| |
Collapse
|
6
|
Mathematical Model and FPGA Realization of a Multi-Stable Chaotic Dynamical System with a Closed Butterfly-Like Curve of Equilibrium Points. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11020788] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
This paper starts with a review of three-dimensional chaotic dynamical systems equipped with special curves of balance points. We also propose the mathematical model of a new three-dimensional chaotic system equipped with a closed butterfly-like curve of balance points. By performing a bifurcation study of the new system, we analyze intrinsic properties such as chaoticity, multi-stability, and transient chaos. Finally, we carry out a realization of the new multi-stable chaotic model using Field-Programmable Gate Array (FPGA).
Collapse
|