1
|
Kodama D, Mizuho T, Hatada Y, Narumi T, Hirose M. Effects of Collaborative Training Using Virtual Co-embodiment on Motor Skill Learning. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2023; PP:2304-2314. [PMID: 37027734 DOI: 10.1109/tvcg.2023.3247112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Virtual reality (VR) is a promising tool for motor skill learning. Previous studies have indicated that observing and following a teacher's movements from a first-person perspective using VR facilitates motor skill learning. Conversely, it has also been pointed out that this learning method makes the learner so strongly aware of the need to follow that it weakens their sense of agency (SoA) for motor skills and prevents them from updating the body schema, thereby preventing long-term retention of motor skills. To address this problem, we propose applying "virtual co-embodiment" to motor skill learning. Virtual co-embodiment is a system in which a virtual avatar is controlled based on the weighted average of the movements of multiple entities. Because users in virtual co-embodiment overestimate their SoA, we hypothesized that learning using virtual co-embodiment with a teacher would improve motor skill retention. In this study, we focused on learning a dual task to evaluate the automation of movement, which is considered an essential element of motor skills. As a result, learning in virtual co-embodiment with the teacher improves motor skill learning efficiency compared with sharing the teacher's first-person perspective or learning alone.
Collapse
|
2
|
Küçüktabak EB, Kim SJ, Wen Y, Lynch K, Pons JL. Human-machine-human interaction in motor control and rehabilitation: a review. J Neuroeng Rehabil 2021; 18:183. [PMID: 34961530 PMCID: PMC8714449 DOI: 10.1186/s12984-021-00974-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Accepted: 12/07/2021] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Human-human (HH) interaction mediated by machines (e.g., robots or passive sensorized devices), which we call human-machine-human (HMH) interaction, has been studied with increasing interest in the last decade. The use of machines allows the implementation of different forms of audiovisual and/or physical interaction in dyadic tasks. HMH interaction between two partners can improve the dyad's ability to accomplish a joint motor task (task performance) beyond either partner's ability to perform the task solo. It can also be used to more efficiently train an individual to improve their solo task performance (individual motor learning). We review recent research on the impact of HMH interaction on task performance and individual motor learning in the context of motor control and rehabilitation, and we propose future research directions in this area. METHODS A systematic search was performed on the Scopus, IEEE Xplore, and PubMed databases. The search query was designed to find studies that involve HMH interaction in motor control and rehabilitation settings. Studies that do not investigate the effect of changing the interaction conditions were filtered out. Thirty-one studies met our inclusion criteria and were used in the qualitative synthesis. RESULTS Studies are analyzed based on their results related to the effects of interaction type (e.g., audiovisual communication and/or physical interaction), interaction mode (collaborative, cooperative, co-active, and competitive), and partner characteristics. Visuo-physical interaction generally results in better dyadic task performance than visual interaction alone. In cases where the physical interaction between humans is described by a spring, there are conflicting results as to the effect of the stiffness of the spring. In terms of partner characteristics, having a more skilled partner improves dyadic task performance more than having a less skilled partner. However, conflicting results were observed in terms of individual motor learning. CONCLUSIONS Although it is difficult to draw clear conclusions as to which interaction type, mode, or partner characteristic may lead to optimal task performance or individual motor learning, these results show the possibility for improved outcomes through HMH interaction. Future work that focuses on selecting the optimal personalized interaction conditions and exploring their impact on rehabilitation settings may facilitate the transition of HMH training protocols to clinical implementations.
Collapse
Affiliation(s)
- Emek Barış Küçüktabak
- Department of Mechanical Engineering, McCormick School of Engineering, Northwestern University, 60208 Evanston, IL USA
- Legs + Walking Lab, Shirley Ryan Ability Lab, 60611 Chicago, IL USA
| | - Sangjoon J. Kim
- Legs + Walking Lab, Shirley Ryan Ability Lab, 60611 Chicago, IL USA
- Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, 60611 Chicago, IL USA
| | - Yue Wen
- Legs + Walking Lab, Shirley Ryan Ability Lab, 60611 Chicago, IL USA
- Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, 60611 Chicago, IL USA
| | - Kevin Lynch
- Department of Mechanical Engineering, McCormick School of Engineering, Northwestern University, 60208 Evanston, IL USA
| | - Jose L. Pons
- Department of Mechanical Engineering, McCormick School of Engineering, Northwestern University, 60208 Evanston, IL USA
- Legs + Walking Lab, Shirley Ryan Ability Lab, 60611 Chicago, IL USA
- Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, 60611 Chicago, IL USA
- Department of Biomedical Engineering, McCormick School of Engineering, Northwestern University, 60208 Evanston, IL USA
| |
Collapse
|
3
|
Kim SJ, Wen Y, Kucuktabak EB, Zhan S, Lynch K, Hargrove L, Perreault EJ, Pons JL. A Framework for Dyadic Physical Interaction Studies During Ankle Motor Tasks. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3092265] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
4
|
Budhota A, Chua KSG, Hussain A, Kager S, Cherpin A, Contu S, Vishwanath D, Kuah CWK, Ng CY, Yam LHL, Loh YJ, Rajeswaran DK, Xiang L, Burdet E, Campolo D. Robotic Assisted Upper Limb Training Post Stroke: A Randomized Control Trial Using Combinatory Approach Toward Reducing Workforce Demands. Front Neurol 2021; 12:622014. [PMID: 34149587 PMCID: PMC8206540 DOI: 10.3389/fneur.2021.622014] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Accepted: 04/23/2021] [Indexed: 01/31/2023] Open
Abstract
Post stroke upper limb rehabilitation is a challenging problem with poor outcomes as 40% of survivors have functionally useless upper limbs. Robot-aided therapy (RAT) is a potential method to alleviate the effort of intensive, task-specific, repetitive upper limb exercises for both patients and therapists. The present study aims to investigate how a time matched combinatory training scheme that incorporates conventional and RAT, using H-Man, compares with conventional training toward reducing workforce demands. In a randomized control trial (NCT02188628, www.clinicaltrials.gov), 44 subacute to chronic stroke survivors with first-ever clinical stroke and predominant arm motor function deficits were recruited and randomized into two groups of 22 subjects: Robotic Therapy (RT) and Conventional Therapy (CT). Both groups received 18 sessions of 90 min; three sessions per week over 6 weeks. In each session, participants of the CT group received 90 min of 1:1 therapist-supervised conventional therapy while participants of the RT group underwent combinatory training which consisted of 60 min of minimally-supervised H-Man therapy followed by 30 min of conventional therapy. The clinical outcomes [Fugl-Meyer (FMA), Action Research Arm Test and, Grip Strength] and the quantitative measures (smoothness, time efficiency, and task error, derived from two robotic assessment tasks) were independently evaluated prior to therapy intervention (week 0), at mid-training (week 3), at the end of training (week 6), and post therapy (week 12 and 24). Significant differences within group were observed at the end of training for all clinical scales compared with baseline [mean and standard deviation of FMA score changes between baseline and week 6; RT: Δ4.41 (3.46) and CT: Δ3.0 (4.0); p < 0.01]. FMA gains were retained 18 weeks post-training [week 24; RT: Δ5.38 (4.67) and week 24 CT: Δ4.50 (5.35); p < 0.01]. The RT group clinical scores improved similarly when compared to CT group with no significant inter-group at all time points although the conventional therapy time was reduced to one third in RT group. There were no training-related adverse side effects. In conclusion, time matched combinatory training incorporating H-Man RAT produced similar outcomes compared to conventional therapy alone. Hence, this study supports a combinatory approach to improve motor function in post-stroke arm paresis. Clinical Trial Registration: www.ClinicalTrials.gov, identifier: NCT02188628.
Collapse
Affiliation(s)
- Aamani Budhota
- Interdisciplinary Graduate School, Nanyang Technological University, Singapore, Singapore.,Robotic Research Center, Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
| | - Karen S G Chua
- Centre for Advanced Rehabilitation Therapeutics, Tan Tock Seng Hospital Rehabilitation Centre, Singapore, Singapore
| | - Asif Hussain
- Robotic Research Center, Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
| | - Simone Kager
- NUS Graduate School for Integrative Sciences and Engineering, National University of Singapore, Singapore, Singapore
| | - Adèle Cherpin
- Robotic Research Center, Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
| | - Sara Contu
- Robotic Research Center, Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
| | - Deshmukh Vishwanath
- Centre for Advanced Rehabilitation Therapeutics, Tan Tock Seng Hospital Rehabilitation Centre, Singapore, Singapore
| | - Christopher W K Kuah
- Centre for Advanced Rehabilitation Therapeutics, Tan Tock Seng Hospital Rehabilitation Centre, Singapore, Singapore
| | - Chwee Yin Ng
- Centre for Advanced Rehabilitation Therapeutics, Tan Tock Seng Hospital Rehabilitation Centre, Singapore, Singapore
| | - Lester H L Yam
- Centre for Advanced Rehabilitation Therapeutics, Tan Tock Seng Hospital Rehabilitation Centre, Singapore, Singapore
| | - Yong Joo Loh
- Centre for Advanced Rehabilitation Therapeutics, Tan Tock Seng Hospital Rehabilitation Centre, Singapore, Singapore
| | - Deshan Kumar Rajeswaran
- Centre for Advanced Rehabilitation Therapeutics, Tan Tock Seng Hospital Rehabilitation Centre, Singapore, Singapore
| | - Liming Xiang
- School of Physical and Mathematical Sciences, Nanyang Technological University, Singapore, Singapore
| | - Etienne Burdet
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, United Kingdom
| | - Domenico Campolo
- Robotic Research Center, Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
5
|
Beckers N, van Asseldonk EHF, van der Kooij H. Haptic human-human interaction does not improve individual visuomotor adaptation. Sci Rep 2020; 10:19902. [PMID: 33199831 PMCID: PMC7670433 DOI: 10.1038/s41598-020-76706-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Accepted: 11/01/2020] [Indexed: 11/23/2022] Open
Abstract
Haptic interaction between two humans, for example, a physiotherapist assisting a patient regaining the ability to grasp a cup, likely facilitates motor skill acquisition. Haptic human–human interaction has been shown to enhance individual performance improvement in a tracking task with a visuomotor rotation perturbation. These results are remarkable given that haptically assisting or guiding an individual rarely benefits their individual improvement when the assistance is removed. We, therefore, replicated a study that reported that haptic interaction between humans was beneficial for individual improvement for tracking a target in a visuomotor rotation perturbation. In addition, we tested the effect of more interaction time and a stronger haptic coupling between the partners on individual improvement in the same task. We found no benefits of haptic interaction on individual improvement compared to individuals who practised the task alone, independent of interaction time or interaction strength.
Collapse
Affiliation(s)
- Niek Beckers
- Department of Biomechanical Engineering, University of Twente, Enschede, The Netherlands. .,Cognitive Robotics, Delft University of Technology, Delft, The Netherlands.
| | | | - Herman van der Kooij
- Department of Biomechanical Engineering, University of Twente, Enschede, The Netherlands.,Department of Biomechanical Engineering, Delft University of Technology, Delft, The Netherlands
| |
Collapse
|
6
|
Batson JP, Kato Y, Shuster K, Patton JL, Reed KB, Tsuji T, Novak D. Haptic Coupling in Dyads Improves Motor Learning in a Simple Force Field. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:4795-4798. [PMID: 33019063 DOI: 10.1109/embc44109.2020.9176261] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
In dyadic motor learning, pairs of people learn the same motion while their limbs are loosely coupled together using haptic devices. Such coupled learning has been shown to outperform solo learning (including robot-guided learning) for simple one-degree-of-freedom tasks. However, results from more complex tasks are limited and sometimes conflicting. We thus evaluated coupled learning in a two-degree-of-freedom tracking task where participants also had to compensate for a simple force field. Participant pairs were split into two groups: an experiment group that experienced a compliant haptic coupling between participants' hands and a control group that did not. The study protocol consisted of 70 repetitions of 18.9-second tracking trials: 10 initial solo trials with no coupling, 50 "learning" trials (where participants in the experiment group were coupled), and 10 final solo trials with no coupling. The experiment group (coupled) improved their solo tracking performance both in the presence (p = 0.008) and absence (p <; 0.001) of the force field; however, the control group (no coupling) only improved their solo performance in the absence of the force field (p <; 0.001) but not in the presence of the field (p = 0.81). This suggests that dyadic motor learning can outperform solo learning for two-dimensional tracking motions in the presence of a simple force field, though the mechanism by which learning is improved is not yet clear.Clinical Relevance-As motor learning is critical for applications such as motor rehabilitation, dyadic training could be used to achieve a better overall outcome and a faster learning speed in these applications compared to solo training.
Collapse
|